[2025-09-22T17:00:02.361864] [INFO ] [MAIN ] Using last completed trading day: 2025-09-22 [2025-09-22T17:00:02.362249] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-22T17:00:02.362356] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-22T17:00:02.362394] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-22T17:00:03.751827] [DEBUG] [SYMBOL ] Found 2424 valid NYSE symbols. [2025-09-22T17:00:03.752096] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-22T17:00:03.752405] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-22T17:00:03.753343] [INFO ] [LOCAL ] Symbols cache updated with 2372 symbols. [2025-09-22T17:00:03.753406] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-22T17:00:03.753441] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-22T17:00:03.753507] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-22T17:00:03.753726] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-22T17:00:03.754212] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-22T17:00:03.754267] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-22T17:00:03.754440] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-22T17:00:03.754498] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2372 valid symbols. [2025-09-22T17:00:03.754532] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-22T17:00:03.754565] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-22T17:00:03.776197] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/JPI.csv (symbol JPI no longer active). [2025-09-22T17:00:03.785709] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-22T17:00:03.806225] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/JPI.csv (symbol JPI no longer active). [2025-09-22T17:00:03.815573] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-09-22T17:00:03.815773] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-22T17:00:03.815826] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-22T17:00:03.815857] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-22T17:00:03.816298] [WARN ] [STATE ] State set to: RUNNING [2025-09-22T17:00:03.816477] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-22T17:00:03.816886] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-22T17:00:03.816985] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-22T17:00:03.817035] [INFO ] [MAIN ] Starting incremental update for 2372 symbols. [2025-09-22T17:00:03.817064] [INFO ] [MAIN ] Running in parallel mode [2025-09-22T17:00:03.817422] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2372 symbols [2025-09-22T17:00:04.396413] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:04.466311] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:04.579776] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:04.576582] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:04.580106] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-22T17:00:04.580299] [DEBUG] [LOCAL ] AACT: No existing data file found in primary storage. [2025-09-22T17:00:04.580193] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-22T17:00:04.580468] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-22T17:00:04.580508] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-22T17:00:04.580550] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-22T17:00:04.580674] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-22T17:00:04.580350] [WARN ] [MAIN ] AACT: No existing data found, performing full refresh instead. [2025-09-22T17:00:04.644902] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-22T17:00:04.687172] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-22T17:00:04.687758] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-22T17:00:04.703933] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-22T17:00:05.255614] [DEBUG] [LOCAL ] A: Loaded 51608 existing records from primary storage. [2025-09-22T17:00:05.299378] [INFO ] [MAIN ] A: Loaded 51608 existing records. [2025-09-22T17:00:05.305555] [DEBUG] [LOCAL ] AA: Loaded 54365 existing records from primary storage. [2025-09-22T17:00:05.293984] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:05.321913] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-22T17:00:05.334565] [INFO ] [MAIN ] AA: Loaded 54365 existing records. [2025-09-22T17:00:05.752116] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:05.832225] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-22T17:00:05.821358] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:05.835409] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:05.836708] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-22T17:00:05.836888] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-22T17:00:05.836835] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-22T17:00:05.837037] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-22T17:00:05.838436] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-22T17:00:05.838499] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-22T17:00:05.838516] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-22T17:00:05.838696] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-22T17:00:06.076050] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-22T17:00:06.107202] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-22T17:00:06.255210] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-22T17:00:06.299604] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-22T17:00:06.573914] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:06.614376] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-22T17:00:06.606217] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-22T17:00:06.615779] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-22T17:00:06.614281] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:06.616880] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-22T17:00:06.907062] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-22T17:00:06.908103] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-22T17:00:07.154633] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T17:00:07.155850] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-22T17:00:07.269579] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-22T17:00:07.270599] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-22T17:00:07.577203] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-22T17:00:07.578250] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-22T17:00:07.586633] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T17:00:07.587635] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-22T17:00:07.832680] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-22T17:00:07.833635] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-22T17:00:08.003899] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T17:00:08.014529] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-22T17:00:08.021146] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T17:00:08.022559] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-22T17:00:08.082229] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-22T17:00:08.083244] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-22T17:00:08.345496] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-22T17:00:08.346535] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-22T17:00:08.387182] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T17:00:08.399613] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-22T17:00:08.658793] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T17:00:08.662937] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-22T17:00:08.790854] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T17:00:08.793233] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-22T17:00:09.258937] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-22T17:00:09.259770] [INFO ] [REMOTE ] AAM: Full fetch complete (972 records). [2025-09-22T17:00:09.259851] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-22T17:00:09.510032] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-22T17:00:09.510470] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:00:09.510743] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:00:09.510945] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-22T17:00:09.511090] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-22T17:00:09.511188] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-22T17:00:09.511369] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-22T17:00:09.511543] [INFO ] [MAIN ] Update Progress: 1/2372 symbols completed. AAM took 5.6s. Estimated remaining: 3h 45m 1s. Rate: 10.5 symbols/min [2025-09-22T17:00:09.757942] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:09.758336] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-22T17:00:09.758929] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-22T17:00:09.766345] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-22T17:00:09.766448] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-22T17:00:09.766775] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-22T17:00:09.767435] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-22T17:00:09.767700] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T17:00:09.824462] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-22T17:00:09.900931] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-22T17:00:09.929484] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-22T17:00:10.232062] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:10.232730] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-22T17:00:10.319618] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T17:00:10.330175] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-22T17:00:10.459633] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:00:10.460021] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-22T17:00:10.460504] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-22T17:00:10.495995] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-22T17:00:10.499175] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-22T17:00:11.024986] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T17:00:11.028033] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-22T17:00:11.101974] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T17:00:11.106185] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-22T17:00:11.838865] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-22T17:00:11.841888] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-22T17:00:11.992282] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T17:00:11.996356] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-22T17:00:12.080343] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T17:00:12.093840] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-22T17:00:12.751513] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-22T17:00:12.756962] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-22T17:00:13.366716] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T17:00:13.369480] [INFO ] [REMOTE ] AACT: Full fetch complete (10489 records). [2025-09-22T17:00:13.369559] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-22T17:00:13.369998] [FATAL] [VALIDATOR ] AACT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:00:13.370088] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:00:13.370132] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:00:13.370197] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-22T17:00:13.370282] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-22T17:00:13.370339] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-22T17:00:13.370381] [DEBUG] [LOCAL ] AACT: No derivative data file found to delete. [2025-09-22T17:00:13.370437] [INFO ] [MAIN ] Update Progress: 2/2372 symbols completed. AACT took 9.5s. Estimated remaining: 3h 8m 41s. Rate: 12.6 symbols/min [2025-09-22T17:00:13.546255] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:13.546532] [DEBUG] [LOCAL ] AAP: No existing data file found in primary storage. [2025-09-22T17:00:13.546626] [WARN ] [MAIN ] AAP: No existing data found, performing full refresh instead. [2025-09-22T17:00:13.547008] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-22T17:00:13.547166] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-22T17:00:13.547276] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-22T17:00:13.547425] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-22T17:00:13.928708] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (4.00 seconds). [2025-09-22T17:00:13.975254] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-22T17:00:13.974983] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:13.976430] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-22T17:00:14.424444] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T17:00:14.431011] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-22T17:00:14.709963] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-22T17:00:14.721027] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-22T17:00:15.591204] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T17:00:15.607504] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-22T17:00:15.697589] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T17:00:15.703094] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-22T17:00:16.072265] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-22T17:00:16.082812] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-22T17:00:16.731806] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T17:00:16.737011] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-22T17:00:17.099665] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T17:00:17.111307] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-22T17:00:17.165343] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-22T17:00:17.177207] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-22T17:00:17.551491] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T17:00:17.562830] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-22T17:00:18.199584] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T17:00:18.205534] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-22T17:00:19.608544] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-22T17:00:19.648839] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-22T17:00:19.651447] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-22T17:00:19.664625] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-22T17:00:19.725106] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-22T17:00:19.736565] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-22T17:00:20.153698] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T17:00:20.159870] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-22T17:00:21.079075] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T17:00:21.089597] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-22T17:00:21.120106] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T17:00:21.125127] [INFO ] [REMOTE ] AAMI: Full fetch complete (29914 records). [2025-09-22T17:00:21.125208] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-22T17:00:21.125748] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:00:21.125836] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:00:21.125880] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:00:21.125919] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-22T17:00:21.125974] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-22T17:00:21.126009] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-22T17:00:21.126056] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-22T17:00:21.126109] [INFO ] [MAIN ] Update Progress: 3/2372 symbols completed. AAMI took 11.6s. Estimated remaining: 3h 47m 48s. Rate: 10.4 symbols/min [2025-09-22T17:00:21.298708] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:21.298948] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-09-22T17:00:21.299074] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-09-22T17:00:21.299334] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-22T17:00:21.299455] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-22T17:00:21.299530] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-22T17:00:21.299567] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-22T17:00:21.652286] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T17:00:21.699027] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-22T17:00:21.735447] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:21.736050] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-22T17:00:21.768623] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-22T17:00:21.781478] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-22T17:00:22.504630] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T17:00:22.515880] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-22T17:00:22.689336] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-22T17:00:22.696562] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-22T17:00:23.259166] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T17:00:23.274530] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-22T17:00:23.519604] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T17:00:23.532908] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-22T17:00:23.892701] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T17:00:23.905603] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-22T17:00:24.669605] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T17:00:24.680935] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-22T17:00:25.149486] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T17:00:25.162175] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-22T17:00:25.187185] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-22T17:00:25.193224] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-22T17:00:25.636156] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T17:00:25.644957] [INFO ] [REMOTE ] A: Full fetch complete (73099 records). [2025-09-22T17:00:25.645104] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-22T17:00:26.052298] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-22T17:00:26.052447] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-22T17:00:26.053484] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-22T17:00:26.053718] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-22T17:00:26.056012] [DEBUG] [LOCAL ] A: Trimmed 73099 records to 50829 (keeping 200 days of data) [2025-09-22T17:00:26.353013] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T17:00:26.379734] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T17:00:26.380457] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-22T17:00:26.388789] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-22T17:00:26.484845] [DEBUG] [LOCAL ] A: Primary data saved (50829 records). [2025-09-22T17:00:26.485438] [INFO ] [MAIN ] A: Full history saved. [2025-09-22T17:00:26.485897] [INFO ] [MAIN ] Update Progress: 4/2372 symbols completed. A took 22.7s. Estimated remaining: 3h 43m 40s. Rate: 10.6 symbols/min [2025-09-22T17:00:26.656852] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:26.657033] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-22T17:00:26.657071] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-22T17:00:26.657217] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-22T17:00:26.657259] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-22T17:00:26.657299] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-22T17:00:26.657332] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-22T17:00:27.022046] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:27.022696] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-22T17:00:27.046079] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T17:00:27.054969] [INFO ] [REMOTE ] AA: Full fetch complete (77512 records). [2025-09-22T17:00:27.055122] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-22T17:00:27.328249] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:00:27.367945] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-22T17:00:27.368711] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-22T17:00:27.472956] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-22T17:00:27.473082] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-22T17:00:27.473951] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-22T17:00:27.474046] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-22T17:00:27.497094] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T17:00:27.496395] [DEBUG] [LOCAL ] AA: Trimmed 77512 records to 53614 (keeping 200 days of data) [2025-09-22T17:00:27.578359] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-22T17:00:27.705967] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:00:27.714335] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-22T17:00:27.714968] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-22T17:00:27.859902] [DEBUG] [LOCAL ] AA: Primary data saved (53614 records). [2025-09-22T17:00:27.860070] [INFO ] [MAIN ] AA: Full history saved. [2025-09-22T17:00:27.860478] [INFO ] [MAIN ] Update Progress: 5/2372 symbols completed. AA took 24.0s. Estimated remaining: 3h 9m 42s. Rate: 12.5 symbols/min [2025-09-22T17:00:27.962958] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:00:27.979517] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-22T17:00:28.021577] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-22T17:00:28.043572] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:28.076473] [DEBUG] [LOCAL ] AB: Loaded 29406 existing records from primary storage. [2025-09-22T17:00:28.076776] [INFO ] [MAIN ] AB: Loaded 29406 existing records. [2025-09-22T17:00:28.264715] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:28.265724] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:00:28.266564] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-22T17:00:28.266487] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-22T17:00:28.267249] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-22T17:00:28.267335] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-22T17:00:28.284463] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-22T17:00:28.297454] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-22T17:00:28.364713] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T17:00:28.415287] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-22T17:00:28.526350] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:00:28.566035] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-22T17:00:28.596744] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-22T17:00:28.682618] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:28.683489] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-22T17:00:28.707226] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T17:00:28.714848] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-22T17:00:28.845976] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:00:28.846355] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-22T17:00:28.846933] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-22T17:00:29.376723] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-22T17:00:29.378943] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-22T17:00:29.650489] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T17:00:29.657132] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-22T17:00:29.902174] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T17:00:29.909892] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-22T17:00:30.076265] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T17:00:30.087063] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-22T17:00:30.126118] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T17:00:30.128822] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-22T17:00:30.510825] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T17:00:30.517282] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-22T17:00:31.000703] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T17:00:31.004914] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-22T17:00:31.902806] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-22T17:00:31.911504] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-22T17:00:32.284997] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-22T17:00:32.293168] [INFO ] [REMOTE ] AAP: Full fetch complete (75205 records). [2025-09-22T17:00:32.293346] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-22T17:00:32.705832] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-22T17:00:32.705944] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-22T17:00:32.706715] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-22T17:00:32.706796] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-22T17:00:32.708507] [DEBUG] [LOCAL ] AAP: Trimmed 75205 records to 52149 (keeping 200 days of data) [2025-09-22T17:00:32.843629] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-22T17:00:32.853316] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-22T17:00:33.081471] [DEBUG] [LOCAL ] AAP: Primary data saved (52149 records). [2025-09-22T17:00:33.081673] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-22T17:00:33.081790] [INFO ] [MAIN ] Update Progress: 6/2372 symbols completed. AAP took 19.7s. Estimated remaining: 3h 12m 20s. Rate: 12.3 symbols/min [2025-09-22T17:00:33.269857] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:33.281204] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-22T17:00:33.285015] [INFO ] [REMOTE ] AAUC: Full fetch complete (7127 records). [2025-09-22T17:00:33.285095] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-22T17:00:33.481147] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 73 unique days, need 200 days [2025-09-22T17:00:33.481442] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:00:33.481515] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:00:33.481599] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-22T17:00:33.495556] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-22T17:00:33.495731] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-22T17:00:33.495801] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-22T17:00:33.495873] [INFO ] [MAIN ] Update Progress: 7/2372 symbols completed. AAUC took 7.0s. Estimated remaining: 2h 47m 7s. Rate: 14.2 symbols/min [2025-09-22T17:00:33.671219] [DEBUG] [LOCAL ] ABBV: Loaded 54467 existing records from primary storage. [2025-09-22T17:00:33.688284] [INFO ] [MAIN ] ABBV: Loaded 54467 existing records. [2025-09-22T17:00:33.689972] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:33.886576] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:33.887129] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-22T17:00:33.887283] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-22T17:00:33.897572] [DEBUG] [LOCAL ] ABCB: Loaded 31310 existing records from primary storage. [2025-09-22T17:00:33.897924] [INFO ] [MAIN ] ABCB: Loaded 31310 existing records. [2025-09-22T17:00:33.909398] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-22T17:00:33.919081] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-22T17:00:34.230171] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T17:00:34.313782] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:34.350201] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-22T17:00:34.372476] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-22T17:00:34.377853] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-22T17:00:34.406140] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-22T17:00:34.416627] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-22T17:00:34.566972] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:34.588233] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-22T17:00:34.830025] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-09-22T17:00:34.872894] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-22T17:00:34.895246] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:34.895542] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-22T17:00:35.705287] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T17:00:35.710609] [INFO ] [REMOTE ] AAT: Full fetch complete (42736 records). [2025-09-22T17:00:35.710722] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-22T17:00:36.128491] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-22T17:00:36.128586] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-22T17:00:36.129051] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-22T17:00:36.129117] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-22T17:00:36.130171] [DEBUG] [LOCAL ] AAT: Trimmed 42736 records to 30600 (keeping 200 days of data) [2025-09-22T17:00:36.366838] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T17:00:36.403674] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-22T17:00:36.413066] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T17:00:36.425976] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-22T17:00:36.446702] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T17:00:36.453630] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-22T17:00:36.454876] [DEBUG] [LOCAL ] AAT: Primary data saved (30600 records). [2025-09-22T17:00:36.455720] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-22T17:00:36.455799] [INFO ] [MAIN ] Update Progress: 8/2372 symbols completed. AAT took 15.3s. Estimated remaining: 2h 40m 45s. Rate: 14.7 symbols/min [2025-09-22T17:00:36.632977] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:36.698524] [DEBUG] [LOCAL ] ABEV: Loaded 54050 existing records from primary storage. [2025-09-22T17:00:36.698756] [INFO ] [MAIN ] ABEV: Loaded 54050 existing records. [2025-09-22T17:00:36.874222] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:36.874500] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-22T17:00:36.874555] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-22T17:00:36.876451] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-22T17:00:36.876513] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-22T17:00:37.227399] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:37.227748] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-22T17:00:37.421408] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T17:00:37.428000] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-22T17:00:37.916613] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T17:00:37.925474] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-22T17:00:38.183254] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T17:00:38.193804] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-22T17:00:38.414901] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T17:00:38.420974] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-22T17:00:38.812696] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T17:00:38.823598] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-22T17:00:39.233541] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T17:00:39.240090] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-22T17:00:39.624138] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T17:00:39.631873] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-22T17:00:40.054874] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T17:00:40.060292] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-22T17:00:40.317912] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-22T17:00:40.327975] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-22T17:00:40.493551] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T17:00:40.503957] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-22T17:00:40.762942] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T17:00:40.771308] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-22T17:00:40.806499] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T17:00:40.812185] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-22T17:00:41.523317] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T17:00:41.528517] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-22T17:00:41.655074] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T17:00:41.662093] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-22T17:00:41.715542] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T17:00:41.726141] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-22T17:00:42.435018] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-22T17:00:42.449308] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-22T17:00:42.483105] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T17:00:42.487461] [INFO ] [REMOTE ] AB: Full fetch complete (46020 records). [2025-09-22T17:00:42.487563] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-22T17:00:42.885446] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T17:00:42.908260] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-22T17:00:42.908787] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-22T17:00:42.908703] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-22T17:00:42.910446] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-22T17:00:42.910573] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-22T17:00:42.911905] [DEBUG] [LOCAL ] AB: Trimmed 46020 records to 28542 (keeping 200 days of data) [2025-09-22T17:00:43.090727] [DEBUG] [LOCAL ] AB: Primary data saved (28542 records). [2025-09-22T17:00:43.090881] [INFO ] [MAIN ] AB: Full history saved. [2025-09-22T17:00:43.093059] [INFO ] [MAIN ] Update Progress: 9/2372 symbols completed. AB took 15.2s. Estimated remaining: 2h 51m 52s. Rate: 13.7 symbols/min [2025-09-22T17:00:43.267878] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:43.292619] [DEBUG] [LOCAL ] ABG: Loaded 19221 existing records from primary storage. [2025-09-22T17:00:43.292787] [INFO ] [MAIN ] ABG: Loaded 19221 existing records. [2025-09-22T17:00:43.514834] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T17:00:43.520462] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:43.531383] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-22T17:00:43.531583] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-22T17:00:43.532086] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-22T17:00:43.533836] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-22T17:00:43.533910] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-22T17:00:43.890995] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:43.891569] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-22T17:00:43.942241] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T17:00:43.950567] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-22T17:00:44.572386] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-22T17:00:44.583908] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-22T17:00:44.619279] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T17:00:44.622558] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-22T17:00:44.816688] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T17:00:44.825119] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-22T17:00:45.182587] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T17:00:45.193866] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-22T17:00:45.541336] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T17:00:45.545850] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-22T17:00:45.982826] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T17:00:45.987955] [INFO ] [REMOTE ] ABCB: Full fetch complete (44268 records). [2025-09-22T17:00:45.988048] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-22T17:00:46.387405] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-22T17:00:46.387766] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-22T17:00:46.388326] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-22T17:00:46.388423] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-22T17:00:46.401214] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T17:00:46.404975] [DEBUG] [LOCAL ] ABCB: Trimmed 44268 records to 30792 (keeping 200 days of data) [2025-09-22T17:00:46.406360] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-22T17:00:46.627570] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-22T17:00:46.644908] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-22T17:00:46.655218] [DEBUG] [LOCAL ] ABCB: Primary data saved (30792 records). [2025-09-22T17:00:46.655309] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-22T17:00:46.655431] [INFO ] [MAIN ] Update Progress: 10/2372 symbols completed. ABCB took 13.2s. Estimated remaining: 2h 48m 38s. Rate: 14.0 symbols/min [2025-09-22T17:00:46.859152] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:46.856019] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T17:00:46.871080] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-22T17:00:46.904067] [DEBUG] [LOCAL ] ABM: Loaded 32750 existing records from primary storage. [2025-09-22T17:00:46.904207] [INFO ] [MAIN ] ABM: Loaded 32750 existing records. [2025-09-22T17:00:47.091915] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:47.092186] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-22T17:00:47.092233] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-22T17:00:47.093132] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-22T17:00:47.093195] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-22T17:00:47.456411] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:47.456853] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-22T17:00:47.471537] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T17:00:47.477021] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-22T17:00:48.221565] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T17:00:48.234348] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-22T17:00:48.374608] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T17:00:48.386536] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-22T17:00:48.447914] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T17:00:48.455224] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-22T17:00:48.475024] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T17:00:48.481397] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-22T17:00:49.430817] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T17:00:49.440187] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-22T17:00:49.476988] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-22T17:00:49.481072] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-22T17:00:49.997521] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T17:00:50.009160] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-22T17:00:50.384628] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T17:00:50.390024] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-22T17:00:50.464860] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T17:00:50.468797] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-22T17:00:50.511809] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-22T17:00:50.526070] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-22T17:00:51.418223] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T17:00:51.431246] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-22T17:00:51.479770] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T17:00:51.487314] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-22T17:00:51.724839] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T17:00:51.732539] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-22T17:00:52.429949] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T17:00:52.522111] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-22T17:00:52.552001] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T17:00:52.823996] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T17:00:52.835529] [INFO ] [REMOTE ] ABEV: Full fetch complete (77197 records). [2025-09-22T17:00:52.835761] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-22T17:00:53.173574] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T17:00:53.279966] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-22T17:00:53.280069] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-22T17:00:53.280803] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-22T17:00:53.280885] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-22T17:00:53.282560] [DEBUG] [LOCAL ] ABEV: Trimmed 77197 records to 53275 (keeping 200 days of data) [2025-09-22T17:00:53.349608] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-22T17:00:53.609305] [DEBUG] [LOCAL ] ABEV: Primary data saved (53275 records). [2025-09-22T17:00:53.609467] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-22T17:00:53.609593] [INFO ] [MAIN ] Update Progress: 11/2372 symbols completed. ABEV took 17.2s. Estimated remaining: 2h 58m 7s. Rate: 13.3 symbols/min [2025-09-22T17:00:53.797483] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:53.855684] [DEBUG] [LOCAL ] ABR: Loaded 52915 existing records from primary storage. [2025-09-22T17:00:53.855874] [INFO ] [MAIN ] ABR: Loaded 52915 existing records. [2025-09-22T17:00:54.060164] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:54.060546] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-22T17:00:54.060608] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-22T17:00:54.062160] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-22T17:00:54.062236] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-22T17:00:54.130548] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-22T17:00:54.417455] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T17:00:54.524943] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:54.548629] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-22T17:00:54.557313] [INFO ] [REMOTE ] ABBV: Full fetch complete (77721 records). [2025-09-22T17:00:54.557526] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-22T17:00:54.933749] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-22T17:00:54.962963] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-22T17:00:54.963083] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-22T17:00:54.963816] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-22T17:00:54.963883] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-22T17:00:54.965798] [DEBUG] [LOCAL ] ABBV: Trimmed 77721 records to 53687 (keeping 200 days of data) [2025-09-22T17:00:55.342192] [DEBUG] [LOCAL ] ABBV: Primary data saved (53687 records). [2025-09-22T17:00:55.342565] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-22T17:00:55.344840] [INFO ] [MAIN ] Update Progress: 12/2372 symbols completed. ABBV took 22.3s. Estimated remaining: 2h 48m 54s. Rate: 14.0 symbols/min [2025-09-22T17:00:55.529996] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:55.562031] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T17:00:55.565833] [INFO ] [REMOTE ] ABG: Full fetch complete (26324 records). [2025-09-22T17:00:55.565948] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-22T17:00:55.739281] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-22T17:00:55.880379] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-22T17:00:55.900250] [INFO ] [MAIN ] ABT: Loaded 54400 existing records. [2025-09-22T17:00:56.167845] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-22T17:00:56.175154] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-22T17:00:56.178395] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-22T17:00:56.178475] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-22T17:00:56.201498] [DEBUG] [LOCAL ] ABG: Trimmed 26324 records to 18829 (keeping 200 days of data) [2025-09-22T17:00:56.201343] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:56.202113] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-22T17:00:56.202176] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-22T17:00:56.203847] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-22T17:00:56.203917] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-22T17:00:56.405952] [DEBUG] [LOCAL ] ABG: Primary data saved (18829 records). [2025-09-22T17:00:56.424336] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-22T17:00:56.424888] [INFO ] [MAIN ] Update Progress: 13/2372 symbols completed. ABG took 13.3s. Estimated remaining: 2h 39m 6s. Rate: 14.8 symbols/min [2025-09-22T17:00:56.812268] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:00:56.888451] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:56.889054] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-22T17:00:56.908692] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-22T17:00:56.937048] [DEBUG] [LOCAL ] ACA: Loaded 24626 existing records from primary storage. [2025-09-22T17:00:56.937192] [INFO ] [MAIN ] ACA: Loaded 24626 existing records. [2025-09-22T17:00:57.115935] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:00:57.116208] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-22T17:00:57.116260] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-22T17:00:57.117089] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-22T17:00:57.117152] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-22T17:00:57.329173] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-22T17:00:57.495024] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:00:57.565749] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T17:00:58.122069] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-22T17:00:58.634318] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T17:00:58.843528] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T17:00:58.889564] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T17:00:58.922049] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-22T17:00:59.722073] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-22T17:01:00.522055] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-22T17:01:01.068309] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-22T17:01:01.165929] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T17:01:01.322114] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-22T17:01:01.440307] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T17:01:02.122128] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-22T17:01:02.730807] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T17:01:02.922057] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-22T17:01:03.722061] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-22T17:01:03.918057] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T17:01:04.522118] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-22T17:01:04.784894] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T17:01:04.814624] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T17:01:05.322056] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-22T17:01:06.104553] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T17:01:06.122014] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-22T17:01:06.922066] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-22T17:01:07.130244] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T17:01:07.634629] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T17:01:07.722058] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-22T17:01:08.266922] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-22T17:01:08.522129] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-22T17:01:09.189573] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T17:01:09.322034] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-22T17:01:10.121874] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T17:01:10.122032] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-22T17:01:10.300988] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-22T17:01:10.922082] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-22T17:01:11.722056] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-22T17:01:12.007910] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T17:01:12.047150] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T17:01:12.053926] [INFO ] [REMOTE ] ABM: Full fetch complete (44380 records). [2025-09-22T17:01:12.054122] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-22T17:01:12.445010] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-22T17:01:12.445118] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-22T17:01:12.445576] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-22T17:01:12.445620] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-22T17:01:12.446617] [DEBUG] [LOCAL ] ABM: Trimmed 44380 records to 32357 (keeping 200 days of data) [2025-09-22T17:01:12.535795] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-22T17:01:12.646208] [DEBUG] [LOCAL ] ABM: Primary data saved (32357 records). [2025-09-22T17:01:12.646374] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-22T17:01:12.647896] [INFO ] [MAIN ] Update Progress: 14/2372 symbols completed. ABM took 26.0s. Estimated remaining: 3h 13m 13s. Rate: 12.2 symbols/min [2025-09-22T17:01:12.815959] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:01:12.859180] [DEBUG] [LOCAL ] ACCO: Loaded 38568 existing records from primary storage. [2025-09-22T17:01:12.859324] [INFO ] [MAIN ] ACCO: Loaded 38568 existing records. [2025-09-22T17:01:13.039219] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:01:13.039509] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-22T17:01:13.039577] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-22T17:01:13.041002] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-22T17:01:13.041065] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-22T17:01:13.327119] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-22T17:01:13.417237] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:01:13.448127] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T17:01:13.528073] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T17:01:14.122063] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-22T17:01:14.734254] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T17:01:14.922104] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-22T17:01:15.180907] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T17:01:15.722073] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-22T17:01:16.501484] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T17:01:16.522030] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-22T17:01:16.818537] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T17:01:17.322090] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-22T17:01:17.543223] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T17:01:18.122060] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-22T17:01:18.898377] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T17:01:18.922004] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-22T17:01:19.506034] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T17:01:19.722059] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-22T17:01:20.522074] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-22T17:01:20.658085] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T17:01:20.666615] [INFO ] [REMOTE ] ABT: Full fetch complete (77583 records). [2025-09-22T17:01:20.666849] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-22T17:01:21.072349] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-22T17:01:21.072452] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-22T17:01:21.073177] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-22T17:01:21.073263] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-22T17:01:21.075042] [DEBUG] [LOCAL ] ABT: Trimmed 77583 records to 53620 (keeping 200 days of data) [2025-09-22T17:01:21.322175] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-22T17:01:21.455197] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T17:01:21.454080] [DEBUG] [LOCAL ] ABT: Primary data saved (53620 records). [2025-09-22T17:01:21.466205] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-22T17:01:21.467482] [INFO ] [MAIN ] Update Progress: 15/2372 symbols completed. ABT took 26.1s. Estimated remaining: 3h 23m 21s. Rate: 11.6 symbols/min [2025-09-22T17:01:21.650390] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:01:21.680589] [DEBUG] [LOCAL ] ACEL: Loaded 27839 existing records from primary storage. [2025-09-22T17:01:21.680756] [INFO ] [MAIN ] ACEL: Loaded 27839 existing records. [2025-09-22T17:01:21.876261] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:01:21.876538] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-22T17:01:21.876587] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-22T17:01:21.877501] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-22T17:01:21.877563] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-22T17:01:22.144159] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-22T17:01:22.276331] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:01:22.292269] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T17:01:22.331721] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T17:01:22.922065] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-22T17:01:23.722053] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-22T17:01:23.794679] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T17:01:24.205979] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-22T17:01:24.522093] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-22T17:01:25.057804] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T17:01:25.322054] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-22T17:01:25.472338] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T17:01:26.122083] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-22T17:01:26.370023] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T17:01:26.922065] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-22T17:01:27.674224] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T17:01:27.682439] [INFO ] [REMOTE ] ABR: Full fetch complete (75182 records). [2025-09-22T17:01:27.682607] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-22T17:01:27.729293] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-22T17:01:28.089792] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-22T17:01:28.089991] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-22T17:01:28.090741] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-22T17:01:28.090857] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-22T17:01:28.105727] [DEBUG] [LOCAL ] ABR: Trimmed 75182 records to 52125 (keeping 200 days of data) [2025-09-22T17:01:28.106172] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T17:01:28.430599] [DEBUG] [LOCAL ] ABR: Primary data saved (52125 records). [2025-09-22T17:01:28.430773] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-22T17:01:28.430870] [INFO ] [MAIN ] Update Progress: 16/2372 symbols completed. ABR took 34.8s. Estimated remaining: 3h 27m 39s. Rate: 11.3 symbols/min [2025-09-22T17:01:28.527806] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-22T17:01:28.605969] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:01:28.624087] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T17:01:28.627793] [INFO ] [REMOTE ] ACA: Full fetch complete (34288 records). [2025-09-22T17:01:28.627879] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-22T17:01:28.847251] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-22T17:01:28.862986] [INFO ] [MAIN ] ACHR: Loaded 54598 existing records. [2025-09-22T17:01:29.240095] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:01:29.256627] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-22T17:01:29.258415] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-22T17:01:29.262120] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-22T17:01:29.262204] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-22T17:01:29.327149] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-22T17:01:29.314794] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-22T17:01:29.336940] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-22T17:01:29.349518] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-22T17:01:29.354775] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-22T17:01:29.389511] [DEBUG] [LOCAL ] ACA: Trimmed 34288 records to 23948 (keeping 200 days of data) [2025-09-22T17:01:29.775500] [DEBUG] [LOCAL ] ACA: Primary data saved (23948 records). [2025-09-22T17:01:29.791693] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-22T17:01:29.792675] [INFO ] [MAIN ] Update Progress: 17/2372 symbols completed. ACA took 33.4s. Estimated remaining: 3h 18m 30s. Rate: 11.9 symbols/min [2025-09-22T17:01:29.796364] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:01:30.058418] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:01:30.083087] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T17:01:30.131485] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-22T17:01:30.154558] [DEBUG] [LOCAL ] ACI: Loaded 54052 existing records from primary storage. [2025-09-22T17:01:30.154798] [INFO ] [MAIN ] ACI: Loaded 54052 existing records. [2025-09-22T17:01:30.365509] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:01:30.366023] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-22T17:01:30.366098] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-22T17:01:30.383743] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-22T17:01:30.383670] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T17:01:30.383947] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-22T17:01:30.752680] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:01:30.922064] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-22T17:01:31.722056] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-22T17:01:32.527375] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-22T17:01:32.549353] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T17:01:32.642227] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-22T17:01:32.744852] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-22T17:01:33.322057] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-22T17:01:33.995841] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T17:01:34.122051] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-22T17:01:34.709523] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T17:01:34.922061] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-22T17:01:35.302327] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T17:01:35.722058] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-22T17:01:36.200916] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T17:01:36.522063] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-22T17:01:37.321597] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T17:01:37.328830] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-22T17:01:38.017788] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T17:01:38.117051] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T17:01:38.123138] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-22T17:01:38.922124] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-22T17:01:39.210019] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T17:01:39.215613] [INFO ] [REMOTE ] ACCO: Full fetch complete (53930 records). [2025-09-22T17:01:39.215796] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-22T17:01:39.216823] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:01:39.217441] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:01:39.217600] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:01:39.217768] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-22T17:01:39.217919] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-22T17:01:39.218001] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-09-22T17:01:39.218630] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-09-22T17:01:39.220414] [INFO ] [MAIN ] Update Progress: 18/2372 symbols completed. ACCO took 26.6s. Estimated remaining: 3h 27m 57s. Rate: 11.3 symbols/min [2025-09-22T17:01:39.413276] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:01:39.462296] [DEBUG] [LOCAL ] ACM: Loaded 43847 existing records from primary storage. [2025-09-22T17:01:39.462479] [INFO ] [MAIN ] ACM: Loaded 43847 existing records. [2025-09-22T17:01:39.643916] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:01:39.644455] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-22T17:01:39.644567] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-22T17:01:39.650931] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-22T17:01:39.658837] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-22T17:01:39.725034] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T17:01:39.723430] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-22T17:01:40.030931] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:01:40.522079] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-22T17:01:41.322074] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-22T17:01:42.058745] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-22T17:01:42.122018] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-22T17:01:42.290992] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T17:01:42.316883] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T17:01:42.922069] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-22T17:01:43.722096] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-22T17:01:44.337088] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-22T17:01:44.368324] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T17:01:44.522038] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-22T17:01:45.142531] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T17:01:45.322058] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-22T17:01:46.122109] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-22T17:01:46.676054] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T17:01:46.755854] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-22T17:01:46.922082] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-22T17:01:47.078255] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T17:01:47.722061] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-22T17:01:48.174286] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T17:01:48.522077] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-22T17:01:48.921633] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T17:01:48.925976] [INFO ] [REMOTE ] ACEL: Full fetch complete (38932 records). [2025-09-22T17:01:48.926071] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-22T17:01:49.329093] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-22T17:01:49.328244] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-22T17:01:49.330086] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-22T17:01:49.330499] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-22T17:01:49.330544] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-22T17:01:49.331724] [DEBUG] [LOCAL ] ACEL: Trimmed 38932 records to 27250 (keeping 200 days of data) [2025-09-22T17:01:49.493580] [DEBUG] [LOCAL ] ACEL: Primary data saved (27250 records). [2025-09-22T17:01:49.493744] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-22T17:01:49.493836] [INFO ] [MAIN ] Update Progress: 19/2372 symbols completed. ACEL took 28.0s. Estimated remaining: 3h 38m 7s. Rate: 10.8 symbols/min [2025-09-22T17:01:49.662746] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:01:49.731936] [DEBUG] [LOCAL ] ACN: Loaded 54199 existing records from primary storage. [2025-09-22T17:01:49.732153] [INFO ] [MAIN ] ACN: Loaded 54199 existing records. [2025-09-22T17:01:49.913518] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:01:49.913854] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-22T17:01:49.913925] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-22T17:01:49.915306] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-22T17:01:49.915370] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-22T17:01:50.127532] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-22T17:01:50.280808] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:01:50.639119] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T17:01:50.793312] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-22T17:01:50.922096] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-22T17:01:51.472947] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T17:01:51.722092] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-22T17:01:52.519541] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T17:01:52.523678] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-22T17:01:53.322083] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-22T17:01:54.122128] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-22T17:01:54.334384] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T17:01:54.485388] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-22T17:01:54.771115] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T17:01:54.781082] [INFO ] [REMOTE ] ACI: Full fetch complete (77024 records). [2025-09-22T17:01:54.781276] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-22T17:01:54.926741] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-22T17:01:55.369986] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-22T17:01:55.370119] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-22T17:01:55.370918] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-22T17:01:55.370996] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-22T17:01:55.373011] [DEBUG] [LOCAL ] ACI: Trimmed 77024 records to 53272 (keeping 200 days of data) [2025-09-22T17:01:55.749968] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-22T17:01:55.802428] [DEBUG] [LOCAL ] ACI: Primary data saved (53272 records). [2025-09-22T17:01:55.802692] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-22T17:01:55.803636] [INFO ] [MAIN ] Update Progress: 20/2372 symbols completed. ACI took 26.0s. Estimated remaining: 3h 39m 30s. Rate: 10.7 symbols/min [2025-09-22T17:01:56.003168] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:01:56.073817] [DEBUG] [LOCAL ] ACP: Loaded 31749 existing records from primary storage. [2025-09-22T17:01:56.072875] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T17:01:56.074097] [INFO ] [MAIN ] ACP: Loaded 31749 existing records. [2025-09-22T17:01:56.264417] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:01:56.264897] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-22T17:01:56.264956] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-22T17:01:56.265768] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-22T17:01:56.265830] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-22T17:01:56.527216] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-22T17:01:56.627241] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:01:57.149212] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T17:01:57.234172] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-22T17:01:57.322089] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-22T17:01:58.122093] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-22T17:01:58.166806] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T17:01:58.543211] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T17:01:58.922104] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-22T17:01:59.677484] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T17:01:59.722069] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-22T17:02:00.473801] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T17:02:00.522076] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-22T17:02:01.322078] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-22T17:02:01.815666] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T17:02:01.893392] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-22T17:02:02.122092] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-22T17:02:02.574302] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T17:02:02.922094] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-22T17:02:03.722110] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-22T17:02:04.459276] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-22T17:02:04.522110] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-22T17:02:04.721507] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T17:02:04.767758] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-22T17:02:05.322099] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-22T17:02:06.122118] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-22T17:02:06.287192] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T17:02:06.845921] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-22T17:02:06.922077] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-22T17:02:07.722075] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-22T17:02:07.868254] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T17:02:08.522062] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-22T17:02:09.032281] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T17:02:09.322091] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-22T17:02:09.604771] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-22T17:02:09.613491] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-09-22T17:02:09.613694] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-22T17:02:09.614718] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:02:09.614859] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:02:09.614933] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:02:09.615002] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-22T17:02:09.615101] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-09-22T17:02:09.615164] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-09-22T17:02:09.615899] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-09-22T17:02:09.616028] [INFO ] [MAIN ] Update Progress: 21/2372 symbols completed. ACHR took 41.2s. Estimated remaining: 3h 54m 43s. Rate: 10.0 symbols/min [2025-09-22T17:02:09.807904] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:02:09.816988] [DEBUG] [LOCAL ] ACR: Loaded 6555 existing records from primary storage. [2025-09-22T17:02:09.817111] [INFO ] [MAIN ] ACR: Loaded 6555 existing records. [2025-09-22T17:02:10.018490] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:02:10.018771] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-22T17:02:10.018827] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-22T17:02:10.019167] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-22T17:02:10.019229] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-22T17:02:10.122784] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-22T17:02:10.404015] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:02:10.428379] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T17:02:10.707734] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T17:02:10.715976] [INFO ] [REMOTE ] ACM: Full fetch complete (62560 records). [2025-09-22T17:02:10.716148] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-22T17:02:10.928249] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-22T17:02:11.131130] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-22T17:02:11.131220] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-22T17:02:11.131826] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-22T17:02:11.131891] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-22T17:02:11.133580] [DEBUG] [LOCAL ] ACM: Trimmed 62560 records to 43137 (keeping 200 days of data) [2025-09-22T17:02:11.401966] [DEBUG] [LOCAL ] ACM: Primary data saved (43137 records). [2025-09-22T17:02:11.402105] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-22T17:02:11.405665] [INFO ] [MAIN ] Update Progress: 22/2372 symbols completed. ACM took 32.2s. Estimated remaining: 3h 47m 9s. Rate: 10.3 symbols/min [2025-09-22T17:02:11.579199] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:02:11.618220] [DEBUG] [LOCAL ] ACRE: Loaded 34131 existing records from primary storage. [2025-09-22T17:02:11.618367] [INFO ] [MAIN ] ACRE: Loaded 34131 existing records. [2025-09-22T17:02:11.727199] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-22T17:02:11.811184] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:02:11.816068] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T17:02:11.815842] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-22T17:02:11.818817] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-22T17:02:11.819949] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-22T17:02:11.820015] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-22T17:02:12.235560] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-22T17:02:12.241485] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:02:12.522078] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-22T17:02:12.803161] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T17:02:13.322056] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-22T17:02:14.122078] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-22T17:02:14.153498] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T17:02:14.506118] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T17:02:14.922075] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-22T17:02:15.025832] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T17:02:15.313840] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-22T17:02:15.722109] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-22T17:02:16.292009] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T17:02:16.522179] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-22T17:02:17.144054] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T17:02:17.322063] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-22T17:02:18.122057] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-22T17:02:18.664681] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T17:02:18.922090] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-22T17:02:19.722082] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-22T17:02:19.922450] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-22T17:02:20.103248] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T17:02:20.153049] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T17:02:20.522119] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-22T17:02:21.322082] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-22T17:02:22.122068] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-22T17:02:22.368224] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T17:02:22.435873] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T17:02:22.743244] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T17:02:22.922063] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-22T17:02:23.722075] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-22T17:02:24.005377] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T17:02:24.522097] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-22T17:02:24.843867] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T17:02:24.969795] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T17:02:25.322068] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-22T17:02:26.014725] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T17:02:26.122056] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-22T17:02:26.712808] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-22T17:02:26.922067] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-22T17:02:27.722105] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-22T17:02:28.145976] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T17:02:28.522072] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-22T17:02:28.940363] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T17:02:28.947417] [INFO ] [REMOTE ] ACP: Full fetch complete (47861 records). [2025-09-22T17:02:28.947577] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-22T17:02:29.074993] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-22T17:02:29.087258] [INFO ] [REMOTE ] ACR: Full fetch complete (8561 records). [2025-09-22T17:02:29.097666] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-22T17:02:29.322462] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-22T17:02:29.797249] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-22T17:02:29.797135] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-22T17:02:29.797367] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-22T17:02:29.797416] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-22T17:02:29.797625] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-22T17:02:29.798196] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-22T17:02:29.797731] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-22T17:02:29.798307] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-22T17:02:29.799861] [DEBUG] [LOCAL ] ACR: Trimmed 8561 records to 6375 (keeping 200 days of data) [2025-09-22T17:02:29.800506] [DEBUG] [LOCAL ] ACP: Trimmed 47861 records to 31322 (keeping 200 days of data) [2025-09-22T17:02:29.940585] [DEBUG] [LOCAL ] ACR: Primary data saved (6375 records). [2025-09-22T17:02:29.941239] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-22T17:02:29.941616] [INFO ] [MAIN ] Update Progress: 23/2372 symbols completed. ACR took 20.3s. Estimated remaining: 4h 8m 44s. Rate: 9.4 symbols/min [2025-09-22T17:02:30.139078] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-22T17:02:30.179247] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:02:30.207692] [DEBUG] [LOCAL ] ACV: Loaded 7006 existing records from primary storage. [2025-09-22T17:02:30.208324] [INFO ] [MAIN ] ACV: Loaded 7006 existing records. [2025-09-22T17:02:30.403268] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:02:30.404376] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-22T17:02:30.404779] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-22T17:02:30.406160] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-22T17:02:30.406521] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-22T17:02:30.453200] [DEBUG] [LOCAL ] ACP: Primary data saved (31322 records). [2025-09-22T17:02:30.486687] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-22T17:02:30.505812] [INFO ] [MAIN ] Update Progress: 24/2372 symbols completed. ACP took 34.7s. Estimated remaining: 3h 59m 11s. Rate: 9.8 symbols/min [2025-09-22T17:02:30.831755] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:02:30.985284] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:02:30.985755] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-22T17:02:31.024407] [DEBUG] [LOCAL ] ACVA: Loaded 50110 existing records from primary storage. [2025-09-22T17:02:31.024543] [INFO ] [MAIN ] ACVA: Loaded 50110 existing records. [2025-09-22T17:02:31.212732] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:02:31.213048] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-22T17:02:31.213533] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-22T17:02:31.221400] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-22T17:02:31.233798] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-22T17:02:31.257013] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T17:02:31.629247] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:02:31.655162] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T17:02:31.657299] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-22T17:02:31.674014] [INFO ] [REMOTE ] ACN: Full fetch complete (76710 records). [2025-09-22T17:02:31.674158] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-22T17:02:31.675120] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:02:31.675215] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:02:31.675260] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:02:31.675304] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-22T17:02:31.675379] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-09-22T17:02:31.675440] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-09-22T17:02:31.675867] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-09-22T17:02:31.677103] [INFO ] [MAIN ] Update Progress: 25/2372 symbols completed. ACN took 42.2s. Estimated remaining: 3h 51m 21s. Rate: 10.1 symbols/min [2025-09-22T17:02:31.727241] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-22T17:02:31.859816] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:02:31.859987] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-22T17:02:31.860027] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-22T17:02:31.860171] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-22T17:02:31.860214] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-22T17:02:31.860258] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-22T17:02:31.860292] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-22T17:02:32.241876] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:02:32.522065] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-22T17:02:32.758985] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:02:32.759316] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-22T17:02:32.970065] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T17:02:33.322067] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-22T17:02:34.122049] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-22T17:02:34.361124] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:02:34.361455] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-22T17:02:34.922074] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-22T17:02:35.008139] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T17:02:35.166163] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:02:35.166472] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-22T17:02:35.722060] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-22T17:02:36.522105] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-22T17:02:36.896453] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T17:02:36.920858] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-22T17:02:37.322057] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-22T17:02:37.530634] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:02:37.530991] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-22T17:02:38.122116] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-22T17:02:38.356156] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:02:38.356475] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-22T17:02:38.922078] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-22T17:02:39.362920] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T17:02:39.722073] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-22T17:02:40.522103] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-22T17:02:40.660231] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-22T17:02:41.231637] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-22T17:02:41.322069] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-22T17:02:42.122111] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-22T17:02:42.825386] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T17:02:42.853703] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:02:42.922084] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-22T17:02:43.722156] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-22T17:02:43.979971] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T17:02:44.522050] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-22T17:02:44.937059] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T17:02:45.246010] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T17:02:45.322014] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-22T17:02:46.122139] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-22T17:02:46.729802] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T17:02:46.922083] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-22T17:02:47.007775] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T17:02:47.012554] [INFO ] [REMOTE ] ACRE: Full fetch complete (50224 records). [2025-09-22T17:02:47.012776] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-22T17:02:47.013707] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:02:47.013817] [FATAL] [MAIN ] ACRE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:02:47.013906] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:02:47.014006] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-22T17:02:47.014094] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-22T17:02:47.014134] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-09-22T17:02:47.014626] [DEBUG] [LOCAL ] ACRE: Deleted derivative data file. [2025-09-22T17:02:47.015769] [INFO ] [MAIN ] Update Progress: 26/2372 symbols completed. ACRE took 35.6s. Estimated remaining: 4h 5m 26s. Rate: 9.6 symbols/min [2025-09-22T17:02:47.210291] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:02:47.210486] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-09-22T17:02:47.210553] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-09-22T17:02:47.210734] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-22T17:02:47.210785] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-22T17:02:47.210828] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-22T17:02:47.210861] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-22T17:02:47.581569] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:02:47.722096] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-22T17:02:48.280343] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T17:02:48.522083] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-22T17:02:48.925459] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T17:02:49.322079] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-22T17:02:49.561322] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:02:49.561631] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-22T17:02:49.614345] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T17:02:50.122063] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-22T17:02:50.922070] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-22T17:02:51.204198] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:02:51.204564] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-22T17:02:51.276063] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T17:02:51.722066] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-22T17:02:52.522091] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-22T17:02:53.322059] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-22T17:02:53.417334] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T17:02:53.540212] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:02:53.540498] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-22T17:02:53.680389] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T17:02:54.122059] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-22T17:02:54.922058] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-22T17:02:55.398799] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-22T17:02:55.727153] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-22T17:02:55.739054] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T17:02:55.747267] [INFO ] [REMOTE ] ACVA: Full fetch complete (70155 records). [2025-09-22T17:02:55.747457] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-22T17:02:56.146288] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-22T17:02:56.146372] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-22T17:02:56.147026] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-22T17:02:56.147116] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-22T17:02:56.148608] [DEBUG] [LOCAL ] ACVA: Trimmed 70155 records to 49361 (keeping 200 days of data) [2025-09-22T17:02:56.445907] [DEBUG] [LOCAL ] ACVA: Primary data saved (49361 records). [2025-09-22T17:02:56.446171] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-22T17:02:56.447273] [INFO ] [MAIN ] Update Progress: 27/2372 symbols completed. ACVA took 25.9s. Estimated remaining: 4h 9m 53s. Rate: 9.4 symbols/min [2025-09-22T17:02:56.527277] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-22T17:02:56.621165] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:02:56.663077] [DEBUG] [LOCAL ] ADCT: Loaded 34128 existing records from primary storage. [2025-09-22T17:02:56.663216] [INFO ] [MAIN ] ADCT: Loaded 34128 existing records. [2025-09-22T17:02:56.840988] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:02:56.841262] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-22T17:02:56.841318] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-22T17:02:56.842376] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-22T17:02:56.842447] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-22T17:02:57.208394] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:02:57.213935] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T17:02:57.238029] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T17:02:57.322036] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-22T17:02:58.122051] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-22T17:02:58.618427] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-22T17:02:58.656112] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T17:02:58.922082] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-22T17:02:59.722120] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-22T17:02:59.783279] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T17:03:00.522059] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-22T17:03:01.128833] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T17:03:01.130793] [INFO ] [REMOTE ] ACV: Full fetch complete (9634 records). [2025-09-22T17:03:01.130863] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-22T17:03:01.328705] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-22T17:03:01.546673] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T17:03:01.544865] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-22T17:03:01.546850] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-22T17:03:01.556173] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-22T17:03:01.556675] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-22T17:03:01.557624] [DEBUG] [LOCAL ] ACV: Trimmed 9634 records to 6905 (keeping 200 days of data) [2025-09-22T17:03:01.605752] [DEBUG] [LOCAL ] ACV: Primary data saved (6905 records). [2025-09-22T17:03:01.605904] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-22T17:03:01.605992] [INFO ] [MAIN ] Update Progress: 28/2372 symbols completed. ACV took 31.7s. Estimated remaining: 4h 8m 3s. Rate: 9.4 symbols/min [2025-09-22T17:03:01.777606] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:03:01.851300] [DEBUG] [LOCAL ] ADM: Loaded 54176 existing records from primary storage. [2025-09-22T17:03:01.851521] [INFO ] [MAIN ] ADM: Loaded 54176 existing records. [2025-09-22T17:03:02.045065] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:03:02.045416] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-22T17:03:02.045476] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-22T17:03:02.047221] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-22T17:03:02.047508] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-22T17:03:02.129432] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-22T17:03:02.451832] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:03:02.922058] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-22T17:03:03.722082] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-22T17:03:04.626505] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (3.30 seconds). [2025-09-22T17:03:04.634303] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-22T17:03:05.107250] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T17:03:05.124794] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-09-22T17:03:05.135122] [INFO ] [REMOTE ] AD: Full fetch complete (5589 records). [2025-09-22T17:03:05.135344] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-22T17:03:05.154290] [FATAL] [VALIDATOR ] AD: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:03:05.171342] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:03:05.171527] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:03:05.171731] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-22T17:03:05.172025] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-22T17:03:05.172555] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-22T17:03:05.172687] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-22T17:03:05.174488] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-22T17:03:05.174815] [INFO ] [MAIN ] Update Progress: 29/2372 symbols completed. AD took 33.5s. Estimated remaining: 4h 4m 12s. Rate: 9.6 symbols/min [2025-09-22T17:03:05.327276] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-22T17:03:05.374016] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:03:05.447265] [DEBUG] [LOCAL ] ADNT: Loaded 48333 existing records from primary storage. [2025-09-22T17:03:05.447424] [INFO ] [MAIN ] ADNT: Loaded 48333 existing records. [2025-09-22T17:03:05.631456] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:03:05.632536] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-22T17:03:05.632594] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-22T17:03:05.634318] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-22T17:03:05.634382] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-22T17:03:05.935035] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T17:03:06.018694] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:03:06.122046] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-22T17:03:06.904465] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T17:03:06.922003] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-22T17:03:07.392479] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T17:03:07.722111] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-22T17:03:08.414474] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T17:03:08.522119] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-22T17:03:09.333427] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-22T17:03:09.340451] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T17:03:09.520954] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-22T17:03:10.122059] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-22T17:03:10.928069] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-22T17:03:10.930638] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T17:03:11.433018] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-22T17:03:11.722119] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-22T17:03:12.522101] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-22T17:03:13.159521] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-22T17:03:13.322040] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-22T17:03:14.122146] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-22T17:03:14.460626] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T17:03:14.896404] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T17:03:14.922022] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-22T17:03:14.977604] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-09-22T17:03:15.656996] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T17:03:15.722094] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-22T17:03:16.187481] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T17:03:16.522093] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-22T17:03:17.322191] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-22T17:03:17.525689] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T17:03:17.822013] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T17:03:18.122088] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-22T17:03:18.538335] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T17:03:18.922119] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-22T17:03:19.584048] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T17:03:19.722121] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-22T17:03:20.522147] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-22T17:03:20.720779] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T17:03:21.023001] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-22T17:03:21.322101] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-22T17:03:21.664032] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T17:03:22.122107] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-22T17:03:22.922093] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-22T17:03:23.242832] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T17:03:23.411732] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T17:03:23.722144] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-22T17:03:24.333753] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T17:03:24.522098] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-22T17:03:25.053174] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T17:03:25.060780] [INFO ] [REMOTE ] ADC: Full fetch complete (65621 records). [2025-09-22T17:03:25.060957] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-22T17:03:25.061999] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:03:25.062099] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:03:25.062147] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:03:25.062220] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-22T17:03:25.062330] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-22T17:03:25.062390] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-09-22T17:03:25.062439] [DEBUG] [LOCAL ] ADC: No derivative data file found to delete. [2025-09-22T17:03:25.062508] [INFO ] [MAIN ] Update Progress: 30/2372 symbols completed. ADC took 38.0s. Estimated remaining: 4h 21m 51s. Rate: 8.9 symbols/min [2025-09-22T17:03:25.238340] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:03:25.316853] [DEBUG] [LOCAL ] ADT: Loaded 54231 existing records from primary storage. [2025-09-22T17:03:25.317256] [INFO ] [MAIN ] ADT: Loaded 54231 existing records. [2025-09-22T17:03:25.329088] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-22T17:03:25.521415] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:03:25.521836] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-22T17:03:25.521907] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-22T17:03:25.523281] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-22T17:03:25.523360] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-22T17:03:25.874674] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T17:03:25.945887] [INFO ] [REMOTE ] ADCT: Full fetch complete (51570 records). [2025-09-22T17:03:25.952219] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:03:25.952467] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-22T17:03:26.130351] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-22T17:03:26.395091] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-22T17:03:26.395236] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-22T17:03:26.395933] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-22T17:03:26.396023] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-22T17:03:26.398196] [DEBUG] [LOCAL ] ADCT: Trimmed 51570 records to 33810 (keeping 200 days of data) [2025-09-22T17:03:26.643116] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T17:03:26.664316] [DEBUG] [LOCAL ] ADCT: Primary data saved (33810 records). [2025-09-22T17:03:26.664495] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-22T17:03:26.664599] [INFO ] [MAIN ] Update Progress: 31/2372 symbols completed. ADCT took 30.2s. Estimated remaining: 4h 15m 18s. Rate: 9.2 symbols/min [2025-09-22T17:03:26.844703] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:03:26.891830] [DEBUG] [LOCAL ] ADX: Loaded 28540 existing records from primary storage. [2025-09-22T17:03:26.892103] [INFO ] [MAIN ] ADX: Loaded 28540 existing records. [2025-09-22T17:03:26.927249] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-22T17:03:27.159057] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:03:27.159442] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-22T17:03:27.159498] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-22T17:03:27.160392] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-22T17:03:27.160457] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-22T17:03:27.556240] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:03:27.722090] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-22T17:03:28.018574] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T17:03:28.495083] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T17:03:28.522001] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-22T17:03:28.738971] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T17:03:29.322070] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-22T17:03:30.122036] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-22T17:03:30.208948] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T17:03:30.217364] [INFO ] [REMOTE ] ADM: Full fetch complete (77218 records). [2025-09-22T17:03:30.217519] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-22T17:03:30.611694] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-22T17:03:30.611794] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-22T17:03:30.612555] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-22T17:03:30.612601] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-22T17:03:30.614275] [DEBUG] [LOCAL ] ADM: Trimmed 77218 records to 53397 (keeping 200 days of data) [2025-09-22T17:03:30.885620] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T17:03:30.953625] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-22T17:03:31.000025] [DEBUG] [LOCAL ] ADM: Primary data saved (53397 records). [2025-09-22T17:03:31.000131] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-22T17:03:31.000212] [INFO ] [MAIN ] Update Progress: 32/2372 symbols completed. ADM took 29.4s. Estimated remaining: 4h 12m 30s. Rate: 9.3 symbols/min [2025-09-22T17:03:31.171105] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:03:31.171264] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-09-22T17:03:31.171299] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-09-22T17:03:31.171457] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-22T17:03:31.171499] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-22T17:03:31.171539] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-22T17:03:31.171575] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-22T17:03:31.535024] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:03:31.592920] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T17:03:31.722007] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-22T17:03:32.106757] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T17:03:32.522066] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-22T17:03:33.074956] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T17:03:33.322070] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-22T17:03:33.933700] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T17:03:34.122040] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-22T17:03:34.222452] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T17:03:34.922063] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-22T17:03:35.673996] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T17:03:35.722059] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-22T17:03:35.889782] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T17:03:36.522061] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-22T17:03:37.323095] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-22T17:03:37.326623] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T17:03:38.122067] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-22T17:03:38.336101] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T17:03:38.615005] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-22T17:03:38.922065] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-22T17:03:39.345130] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T17:03:39.352298] [INFO ] [REMOTE ] ADNT: Full fetch complete (68143 records). [2025-09-22T17:03:39.352413] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-22T17:03:39.734478] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-22T17:03:39.737932] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-22T17:03:39.738832] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-22T17:03:39.739462] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-22T17:03:39.739507] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-22T17:03:39.741045] [DEBUG] [LOCAL ] ADNT: Trimmed 68143 records to 47567 (keeping 200 days of data) [2025-09-22T17:03:40.011042] [DEBUG] [LOCAL ] ADNT: Primary data saved (47567 records). [2025-09-22T17:03:40.011179] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-22T17:03:40.011262] [INFO ] [MAIN ] Update Progress: 33/2372 symbols completed. ADNT took 34.8s. Estimated remaining: 4h 15m 24s. Rate: 9.2 symbols/min [2025-09-22T17:03:40.193308] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:03:40.204396] [DEBUG] [LOCAL ] AEFC: Loaded 8763 existing records from primary storage. [2025-09-22T17:03:40.204531] [INFO ] [MAIN ] AEFC: Loaded 8763 existing records. [2025-09-22T17:03:40.444282] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:03:40.445138] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-22T17:03:40.445223] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-22T17:03:40.445947] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-22T17:03:40.448742] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:03:40.448976] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-22T17:03:40.523965] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-22T17:03:40.820661] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:03:41.233420] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T17:03:41.322058] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-22T17:03:41.623038] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T17:03:42.122082] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-22T17:03:42.922078] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-22T17:03:43.079941] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T17:03:43.688715] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T17:03:43.722009] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-22T17:03:43.797392] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T17:03:44.522079] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-22T17:03:45.322071] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-22T17:03:45.419805] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-22T17:03:45.726272] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T17:03:45.910630] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-22T17:03:46.122044] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-22T17:03:46.922071] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-22T17:03:47.474078] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T17:03:47.694855] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-22T17:03:47.722082] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-22T17:03:48.522101] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-22T17:03:49.174883] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T17:03:49.266337] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T17:03:49.322017] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-22T17:03:49.883612] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T17:03:50.122061] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-22T17:03:50.922108] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-22T17:03:51.722149] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-22T17:03:51.842381] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T17:03:51.984320] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T17:03:52.522020] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-22T17:03:53.322040] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-22T17:03:53.385261] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T17:03:53.611382] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T17:03:53.615934] [INFO ] [REMOTE ] ADX: Full fetch complete (42185 records). [2025-09-22T17:03:53.616020] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-22T17:03:53.997253] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-22T17:03:53.997350] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-22T17:03:53.997812] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-22T17:03:53.997880] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-22T17:03:53.999276] [DEBUG] [LOCAL ] ADX: Trimmed 42185 records to 27927 (keeping 200 days of data) [2025-09-22T17:03:54.122205] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-22T17:03:54.174970] [DEBUG] [LOCAL ] ADX: Primary data saved (27927 records). [2025-09-22T17:03:54.175117] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-22T17:03:54.176348] [INFO ] [MAIN ] Update Progress: 34/2372 symbols completed. ADX took 27.5s. Estimated remaining: 4h 24m 1s. Rate: 8.9 symbols/min [2025-09-22T17:03:54.354782] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:03:54.407257] [DEBUG] [LOCAL ] AEG: Loaded 50293 existing records from primary storage. [2025-09-22T17:03:54.407444] [INFO ] [MAIN ] AEG: Loaded 50293 existing records. [2025-09-22T17:03:54.596348] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:03:54.596607] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-22T17:03:54.596697] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-22T17:03:54.597856] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-22T17:03:54.597915] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-22T17:03:54.924087] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-22T17:03:54.982135] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:03:55.018104] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T17:03:55.712745] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T17:03:55.721992] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-22T17:03:55.795799] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T17:03:55.804896] [INFO ] [REMOTE ] ADT: Full fetch complete (77205 records). [2025-09-22T17:03:55.805037] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-22T17:03:56.215265] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-22T17:03:56.215378] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-22T17:03:56.216244] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-22T17:03:56.216323] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-22T17:03:56.218408] [DEBUG] [LOCAL ] ADT: Trimmed 77205 records to 53479 (keeping 200 days of data) [2025-09-22T17:03:56.527168] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-22T17:03:56.539748] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T17:03:56.563783] [DEBUG] [LOCAL ] ADT: Primary data saved (53479 records). [2025-09-22T17:03:56.563937] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-22T17:03:56.565730] [INFO ] [MAIN ] Update Progress: 35/2372 symbols completed. ADT took 31.5s. Estimated remaining: 4h 19m 1s. Rate: 9.0 symbols/min [2025-09-22T17:03:56.736998] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:03:56.737176] [DEBUG] [LOCAL ] AEM: No existing data file found in primary storage. [2025-09-22T17:03:56.737213] [WARN ] [MAIN ] AEM: No existing data found, performing full refresh instead. [2025-09-22T17:03:56.737358] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-22T17:03:56.737401] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-22T17:03:56.737440] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-22T17:03:56.737472] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-22T17:03:57.092608] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:03:57.322053] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-22T17:03:57.888638] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T17:03:58.122105] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-22T17:03:58.587757] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-22T17:03:58.678876] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T17:03:58.922073] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-22T17:03:59.722052] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-22T17:04:00.298182] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-22T17:04:00.458093] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T17:04:00.522074] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-22T17:04:01.322169] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-22T17:04:01.929919] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T17:04:02.122172] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-22T17:04:02.597438] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-22T17:04:02.922085] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-22T17:04:03.412362] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-22T17:04:03.722057] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-22T17:04:04.108990] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T17:04:04.522100] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-22T17:04:05.331794] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-22T17:04:05.334874] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T17:04:05.976268] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T17:04:05.977856] [INFO ] [REMOTE ] AEFC: Full fetch complete (12425 records). [2025-09-22T17:04:05.977931] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-22T17:04:06.127291] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-22T17:04:06.369587] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-22T17:04:06.369727] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-22T17:04:06.369954] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-22T17:04:06.370147] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-22T17:04:06.370927] [DEBUG] [LOCAL ] AEFC: Trimmed 12425 records to 8633 (keeping 200 days of data) [2025-09-22T17:04:06.460810] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T17:04:06.477330] [DEBUG] [LOCAL ] AEFC: Primary data saved (8633 records). [2025-09-22T17:04:06.477500] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-22T17:04:06.477588] [INFO ] [MAIN ] Update Progress: 36/2372 symbols completed. AEFC took 26.5s. Estimated remaining: 4h 22m 26s. Rate: 8.9 symbols/min [2025-09-22T17:04:06.655947] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:04:06.713318] [DEBUG] [LOCAL ] AEO: Loaded 54337 existing records from primary storage. [2025-09-22T17:04:06.713478] [INFO ] [MAIN ] AEO: Loaded 54337 existing records. [2025-09-22T17:04:06.894529] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:04:06.894841] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-22T17:04:06.894907] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-22T17:04:06.896220] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-22T17:04:06.896280] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-22T17:04:06.927257] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-22T17:04:07.319011] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:04:07.722145] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-22T17:04:08.178157] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-22T17:04:08.299054] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T17:04:08.522164] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-22T17:04:09.322081] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-22T17:04:09.414710] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T17:04:10.122059] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-22T17:04:10.323355] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T17:04:10.884335] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T17:04:10.922095] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-22T17:04:11.467925] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T17:04:11.722110] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-22T17:04:12.221060] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T17:04:12.522104] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-22T17:04:13.322072] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-22T17:04:13.501707] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T17:04:13.509908] [INFO ] [REMOTE ] AEE: Full fetch complete (72490 records). [2025-09-22T17:04:13.510029] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-22T17:04:13.917948] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-22T17:04:13.918064] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-22T17:04:13.918819] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-22T17:04:13.918903] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-22T17:04:13.920905] [DEBUG] [LOCAL ] AEE: Trimmed 72490 records to 50205 (keeping 200 days of data) [2025-09-22T17:04:14.042028] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T17:04:14.142297] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-22T17:04:14.281429] [DEBUG] [LOCAL ] AEE: Primary data saved (50205 records). [2025-09-22T17:04:14.281729] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-22T17:04:14.281821] [INFO ] [MAIN ] Update Progress: 37/2372 symbols completed. AEE took 43.3s. Estimated remaining: 4h 23m 26s. Rate: 8.9 symbols/min [2025-09-22T17:04:14.686635] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T17:04:14.922126] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-22T17:04:15.722086] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-22T17:04:16.050636] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-22T17:04:16.495054] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T17:04:16.522009] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-22T17:04:17.322134] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-22T17:04:17.727771] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-22T17:04:17.866014] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T17:04:18.122058] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-22T17:04:18.922065] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-22T17:04:18.986787] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T17:04:19.561724] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T17:04:19.722069] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-22T17:04:20.464028] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T17:04:20.522054] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-22T17:04:21.291276] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T17:04:21.322022] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-22T17:04:22.122095] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-22T17:04:22.440199] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-22T17:04:22.448267] [INFO ] [REMOTE ] AEG: Full fetch complete (70165 records). [2025-09-22T17:04:22.448441] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-22T17:04:22.845685] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-22T17:04:22.845807] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-22T17:04:22.846453] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-22T17:04:22.846502] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-22T17:04:22.847888] [DEBUG] [LOCAL ] AEG: Trimmed 70165 records to 49596 (keeping 200 days of data) [2025-09-22T17:04:23.140767] [DEBUG] [LOCAL ] AEG: Primary data saved (49596 records). [2025-09-22T17:04:23.140922] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-22T17:04:23.141121] [INFO ] [MAIN ] Update Progress: 38/2372 symbols completed. AEG took 29.0s. Estimated remaining: 4h 25m 28s. Rate: 8.8 symbols/min [2025-09-22T17:04:23.162581] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T17:04:23.171086] [INFO ] [REMOTE ] AEM: Full fetch complete (77117 records). [2025-09-22T17:04:23.171225] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-22T17:04:23.570402] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-22T17:04:23.570496] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-22T17:04:23.571202] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-22T17:04:23.571271] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-22T17:04:23.572945] [DEBUG] [LOCAL ] AEM: Trimmed 77117 records to 53465 (keeping 200 days of data) [2025-09-22T17:04:23.756554] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T17:04:23.832188] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-22T17:04:23.989016] [DEBUG] [LOCAL ] AEM: Primary data saved (53465 records). [2025-09-22T17:04:23.989208] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-22T17:04:23.989304] [INFO ] [MAIN ] Update Progress: 39/2372 symbols completed. AEM took 27.4s. Estimated remaining: 4h 19m 24s. Rate: 9.0 symbols/min [2025-09-22T17:04:25.731946] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-22T17:04:25.742633] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-22T17:04:27.471253] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T17:04:27.485883] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-22T17:04:29.380943] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T17:04:29.392289] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-22T17:04:31.386805] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-22T17:04:31.395392] [INFO ] [REMOTE ] AEO: Full fetch complete (77446 records). [2025-09-22T17:04:31.395575] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-22T17:04:31.795364] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-22T17:04:31.795467] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-22T17:04:31.796459] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-22T17:04:31.796539] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-22T17:04:31.798458] [DEBUG] [LOCAL ] AEO: Trimmed 77446 records to 53558 (keeping 200 days of data) [2025-09-22T17:04:32.143932] [DEBUG] [LOCAL ] AEO: Primary data saved (53558 records). [2025-09-22T17:04:32.144087] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-22T17:04:32.144177] [INFO ] [MAIN ] Update Progress: 40/2372 symbols completed. AEO took 25.7s. Estimated remaining: 4h 20m 43s. Rate: 8.9 symbols/min [2025-09-22T17:04:32.681086] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:04:32.763326] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:04:32.821369] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:04:32.852726] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:04:32.870875] [DEBUG] [LOCAL ] AFB: Loaded 11692 existing records from primary storage. [2025-09-22T17:04:32.871018] [INFO ] [MAIN ] AFB: Loaded 11692 existing records. [2025-09-22T17:04:33.112063] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:04:33.139593] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-22T17:04:33.141476] [DEBUG] [LOCAL ] AER: Loaded 49562 existing records from primary storage. [2025-09-22T17:04:33.156176] [INFO ] [MAIN ] AER: Loaded 49562 existing records. [2025-09-22T17:04:33.156065] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-22T17:04:33.158491] [DEBUG] [LOCAL ] AESI: Loaded 50259 existing records from primary storage. [2025-09-22T17:04:33.179361] [INFO ] [MAIN ] AESI: Loaded 50259 existing records. [2025-09-22T17:04:33.189621] [DEBUG] [LOCAL ] AES: Loaded 54454 existing records from primary storage. [2025-09-22T17:04:33.211402] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-22T17:04:33.243766] [INFO ] [MAIN ] AES: Loaded 54454 existing records. [2025-09-22T17:04:33.243662] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-22T17:04:33.809886] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:04:33.828463] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:04:33.870265] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-22T17:04:33.914670] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-22T17:04:33.976952] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-22T17:04:33.976771] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:04:33.976863] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-22T17:04:34.000580] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-22T17:04:34.005908] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-22T17:04:34.016385] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-22T17:04:34.052482] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-22T17:04:34.061953] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-22T17:04:34.062135] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-22T17:04:34.133301] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-22T17:04:34.167609] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-22T17:04:34.371867] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:04:34.406942] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-22T17:04:35.181895] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:04:35.209107] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:04:35.240712] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-22T17:04:35.268959] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-22T17:04:35.279467] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:04:35.281041] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-22T17:04:35.337811] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T17:04:35.340816] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-22T17:04:36.128896] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T17:04:36.131938] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-22T17:04:36.500142] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T17:04:36.508932] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-22T17:04:36.602453] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-22T17:04:36.605203] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-22T17:04:36.883563] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T17:04:36.894586] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-22T17:04:37.077285] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T17:04:37.086437] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-22T17:04:37.500225] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T17:04:37.503516] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-22T17:04:37.852007] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T17:04:37.861622] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-22T17:04:38.069311] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-22T17:04:38.073173] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-22T17:04:38.275183] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T17:04:38.284635] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-22T17:04:38.388421] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T17:04:38.398821] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-22T17:04:38.537966] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-22T17:04:38.540781] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-22T17:04:39.061087] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-22T17:04:39.064460] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-22T17:04:39.097665] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T17:04:39.486478] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T17:04:39.615785] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-22T17:04:39.722108] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-22T17:04:39.985055] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T17:04:40.268066] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T17:04:40.522060] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-22T17:04:41.322057] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-22T17:04:42.122080] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-22T17:04:42.430367] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T17:04:42.629114] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T17:04:42.922063] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-22T17:04:43.572210] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T17:04:43.722111] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-22T17:04:44.522037] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-22T17:04:44.571669] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T17:04:45.066357] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T17:04:45.293153] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T17:04:45.295771] [INFO ] [REMOTE ] AFB: Full fetch complete (16539 records). [2025-09-22T17:04:45.295890] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-22T17:04:45.327929] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-22T17:04:45.682719] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-22T17:04:45.682846] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-22T17:04:45.683237] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-22T17:04:45.683338] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-22T17:04:45.684059] [DEBUG] [LOCAL ] AFB: Trimmed 16539 records to 11445 (keeping 200 days of data) [2025-09-22T17:04:45.767974] [DEBUG] [LOCAL ] AFB: Primary data saved (11445 records). [2025-09-22T17:04:45.768225] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-22T17:04:45.768448] [INFO ] [MAIN ] Update Progress: 41/2372 symbols completed. AFB took 13.6s. Estimated remaining: 4h 27m 10s. Rate: 8.7 symbols/min [2025-09-22T17:04:45.951982] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:04:46.015608] [DEBUG] [LOCAL ] AFG: Loaded 33259 existing records from primary storage. [2025-09-22T17:04:46.015832] [INFO ] [MAIN ] AFG: Loaded 33259 existing records. [2025-09-22T17:04:46.128374] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-22T17:04:46.215759] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:04:46.216105] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-22T17:04:46.216165] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-22T17:04:46.217228] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-22T17:04:46.217317] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-22T17:04:46.604895] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:04:46.922047] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-22T17:04:46.926368] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T17:04:47.602311] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T17:04:47.722070] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-22T17:04:47.999549] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T17:04:48.522090] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-22T17:04:49.012955] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T17:04:49.322057] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-22T17:04:50.122073] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-22T17:04:50.351032] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T17:04:50.653195] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T17:04:50.922128] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-22T17:04:51.722125] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-22T17:04:51.783815] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T17:04:51.823938] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-22T17:04:52.522067] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-22T17:04:53.322139] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-22T17:04:53.322050] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T17:04:53.827179] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T17:04:54.122094] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-22T17:04:54.901271] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T17:04:54.922092] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-22T17:04:55.562264] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T17:04:55.575544] [INFO ] [REMOTE ] AESI: Full fetch complete (70191 records). [2025-09-22T17:04:55.575797] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-22T17:04:55.727233] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-22T17:04:56.138439] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-22T17:04:56.138785] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-22T17:04:56.139562] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-22T17:04:56.139840] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-22T17:04:56.147163] [DEBUG] [LOCAL ] AESI: Trimmed 70191 records to 49488 (keeping 200 days of data) [2025-09-22T17:04:56.291624] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T17:04:56.509259] [DEBUG] [LOCAL ] AESI: Primary data saved (49488 records). [2025-09-22T17:04:56.509406] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-22T17:04:56.509524] [INFO ] [MAIN ] Update Progress: 42/2372 symbols completed. AESI took 24.4s. Estimated remaining: 4h 30m 37s. Rate: 8.6 symbols/min [2025-09-22T17:04:56.530729] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-22T17:04:56.682569] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:04:56.682755] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-09-22T17:04:56.682802] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-09-22T17:04:56.682944] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-22T17:04:56.682987] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-22T17:04:56.683028] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-09-22T17:04:56.683072] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-22T17:04:57.033023] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:04:57.196912] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T17:04:57.322085] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-22T17:04:57.789370] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-22T17:04:58.122156] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-22T17:04:58.922170] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-22T17:04:59.038838] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T17:04:59.330759] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T17:04:59.554233] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-22T17:04:59.722103] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-22T17:05:00.522085] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-22T17:05:00.738369] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-22T17:05:01.322069] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-22T17:05:02.122108] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-22T17:05:02.209703] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-22T17:05:02.505077] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T17:05:02.653621] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-22T17:05:02.922140] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-22T17:05:03.722180] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-22T17:05:03.955710] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T17:05:04.522137] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-22T17:05:04.825439] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-22T17:05:05.322058] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-22T17:05:05.899205] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-22T17:05:05.910116] [INFO ] [REMOTE ] AER: Full fetch complete (69157 records). [2025-09-22T17:05:05.910323] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-22T17:05:05.913399] [FATAL] [VALIDATOR ] AER: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:05:05.913605] [FATAL] [MAIN ] AER: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:05:05.913711] [WARN ] [MAIN ] AER: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:05:05.913788] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-22T17:05:05.913863] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-09-22T17:05:05.913921] [INFO ] [LOCAL ] AER: Starting deletion of derivative data. [2025-09-22T17:05:05.914665] [DEBUG] [LOCAL ] AER: Deleted derivative data file. [2025-09-22T17:05:05.914832] [INFO ] [MAIN ] Update Progress: 43/2372 symbols completed. AER took 33.8s. Estimated remaining: 4h 32m 42s. Rate: 8.5 symbols/min [2025-09-22T17:05:06.109827] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:05:06.110129] [DEBUG] [LOCAL ] AFGC: No existing data file found in primary storage. [2025-09-22T17:05:06.110168] [WARN ] [MAIN ] AFGC: No existing data found, performing full refresh instead. [2025-09-22T17:05:06.110342] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-22T17:05:06.110387] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-22T17:05:06.110429] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-09-22T17:05:06.110465] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-22T17:05:06.132072] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-22T17:05:06.518627] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:05:06.541486] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T17:05:06.922058] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-22T17:05:07.320707] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-22T17:05:07.722103] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-22T17:05:08.164097] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-22T17:05:08.522079] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-22T17:05:08.611635] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-22T17:05:08.913268] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-22T17:05:09.322073] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-22T17:05:10.122051] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-22T17:05:10.488004] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T17:05:10.494561] [INFO ] [REMOTE ] AFG: Full fetch complete (45515 records). [2025-09-22T17:05:10.494686] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-22T17:05:10.495385] [FATAL] [VALIDATOR ] AFG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:05:10.495501] [FATAL] [MAIN ] AFG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:05:10.495547] [WARN ] [MAIN ] AFG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:05:10.495588] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-22T17:05:10.495676] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-09-22T17:05:10.495738] [INFO ] [LOCAL ] AFG: Starting deletion of derivative data. [2025-09-22T17:05:10.496175] [DEBUG] [LOCAL ] AFG: Deleted derivative data file. [2025-09-22T17:05:10.496995] [INFO ] [MAIN ] Update Progress: 44/2372 symbols completed. AFG took 24.7s. Estimated remaining: 4h 30m 26s. Rate: 8.6 symbols/min [2025-09-22T17:05:10.671767] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-22T17:05:10.674999] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:05:10.681922] [DEBUG] [LOCAL ] AFGD: Loaded 1913 existing records from primary storage. [2025-09-22T17:05:10.682025] [INFO ] [MAIN ] AFGD: Loaded 1913 existing records. [2025-09-22T17:05:10.864285] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:05:10.864526] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-22T17:05:10.864583] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-22T17:05:10.864834] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-22T17:05:10.864896] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-22T17:05:10.929041] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-22T17:05:11.239758] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:05:11.722091] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-22T17:05:12.015298] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-22T17:05:12.522055] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-22T17:05:12.726898] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T17:05:12.736270] [INFO ] [REMOTE ] AES: Full fetch complete (77724 records). [2025-09-22T17:05:12.736426] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-22T17:05:13.075593] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-22T17:05:13.160313] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-22T17:05:13.160411] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-22T17:05:13.161143] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-22T17:05:13.161212] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-22T17:05:13.163084] [DEBUG] [LOCAL ] AES: Trimmed 77724 records to 53672 (keeping 200 days of data) [2025-09-22T17:05:13.352305] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-22T17:05:13.505758] [DEBUG] [LOCAL ] AES: Primary data saved (53672 records). [2025-09-22T17:05:13.505939] [INFO ] [MAIN ] AES: Full history saved. [2025-09-22T17:05:13.506041] [INFO ] [MAIN ] Update Progress: 45/2372 symbols completed. AES took 41.4s. Estimated remaining: 4h 26m 54s. Rate: 8.7 symbols/min [2025-09-22T17:05:13.681302] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:05:13.686411] [DEBUG] [LOCAL ] AFGE: Loaded 2548 existing records from primary storage. [2025-09-22T17:05:13.686521] [INFO ] [MAIN ] AFGE: Loaded 2548 existing records. [2025-09-22T17:05:13.808323] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T17:05:13.889555] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:05:13.889910] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-22T17:05:13.889970] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-22T17:05:13.890468] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-22T17:05:13.890532] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-22T17:05:14.127778] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-22T17:05:14.287016] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:05:14.538846] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-22T17:05:14.922061] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-22T17:05:15.253483] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-22T17:05:15.722061] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-22T17:05:16.179092] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-22T17:05:16.522067] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-22T17:05:16.938595] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-22T17:05:17.322055] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-22T17:05:17.639001] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-22T17:05:18.122063] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-22T17:05:18.589687] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-22T17:05:18.922083] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-22T17:05:19.222705] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-22T17:05:19.722051] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-22T17:05:20.021668] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-22T17:05:20.522057] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-22T17:05:21.018854] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-22T17:05:21.322054] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-22T17:05:22.112800] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T17:05:22.113837] [INFO ] [REMOTE ] AFGB: Full fetch complete (3647 records). [2025-09-22T17:05:22.113914] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-22T17:05:22.127332] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-22T17:05:22.514862] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-22T17:05:22.514950] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-22T17:05:22.515071] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-22T17:05:22.515109] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-22T17:05:22.515461] [DEBUG] [LOCAL ] AFGB: Trimmed 3647 records to 2450 (keeping 200 days of data) [2025-09-22T17:05:22.530983] [DEBUG] [LOCAL ] AFGB: Primary data saved (2450 records). [2025-09-22T17:05:22.531049] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-22T17:05:22.531112] [INFO ] [MAIN ] Update Progress: 46/2372 symbols completed. AFGB took 26.0s. Estimated remaining: 4h 28m 36s. Rate: 8.7 symbols/min [2025-09-22T17:05:22.700112] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:05:22.714707] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T17:05:22.768275] [DEBUG] [LOCAL ] AFL: Loaded 53927 existing records from primary storage. [2025-09-22T17:05:22.768438] [INFO ] [MAIN ] AFL: Loaded 53927 existing records. [2025-09-22T17:05:22.929547] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-22T17:05:22.956916] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:05:22.957186] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-22T17:05:22.957255] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-22T17:05:22.958771] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-22T17:05:22.958834] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-22T17:05:23.317445] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:05:23.341269] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-22T17:05:23.722071] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-22T17:05:24.253083] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-22T17:05:24.522066] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-22T17:05:25.097672] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-22T17:05:25.322053] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-22T17:05:25.724139] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-22T17:05:26.122019] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-22T17:05:26.544078] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-22T17:05:26.545524] [INFO ] [REMOTE ] AFGC: Full fetch complete (3700 records). [2025-09-22T17:05:26.545607] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-22T17:05:26.913591] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-22T17:05:26.913691] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-22T17:05:26.913825] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-22T17:05:26.913888] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-22T17:05:26.914258] [DEBUG] [LOCAL ] AFGC: Trimmed 3700 records to 2558 (keeping 200 days of data) [2025-09-22T17:05:26.926018] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-22T17:05:26.931011] [DEBUG] [LOCAL ] AFGC: Primary data saved (2558 records). [2025-09-22T17:05:26.931074] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-22T17:05:26.931133] [INFO ] [MAIN ] Update Progress: 47/2372 symbols completed. AFGC took 21.0s. Estimated remaining: 4h 26m 24s. Rate: 8.7 symbols/min [2025-09-22T17:05:27.111837] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:05:27.175353] [DEBUG] [LOCAL ] AG: Loaded 54421 existing records from primary storage. [2025-09-22T17:05:27.175538] [INFO ] [MAIN ] AG: Loaded 54421 existing records. [2025-09-22T17:05:27.359810] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:05:27.359976] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T17:05:27.361795] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-22T17:05:27.361866] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-22T17:05:27.363282] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-22T17:05:27.363377] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-22T17:05:27.727274] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-22T17:05:27.732380] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:05:28.174849] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-22T17:05:28.522072] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-22T17:05:28.889490] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-22T17:05:29.322074] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-22T17:05:30.122101] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-22T17:05:30.432267] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-22T17:05:30.922051] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-22T17:05:31.062361] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T17:05:31.220153] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-22T17:05:31.722065] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-22T17:05:32.522084] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-22T17:05:33.076532] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-22T17:05:33.322026] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-22T17:05:33.355467] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T17:05:34.122084] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-22T17:05:34.414988] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-22T17:05:34.837901] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T17:05:34.922051] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-22T17:05:35.722068] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-22T17:05:36.522018] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-22T17:05:36.566704] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T17:05:36.834003] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-22T17:05:37.275202] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T17:05:37.322057] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-22T17:05:37.769121] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T17:05:37.770217] [INFO ] [REMOTE ] AFGD: Full fetch complete (3224 records). [2025-09-22T17:05:37.770292] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-22T17:05:38.140527] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-22T17:05:38.133398] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-22T17:05:38.140665] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-22T17:05:38.141607] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-22T17:05:38.141694] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-22T17:05:38.142121] [DEBUG] [LOCAL ] AFGD: Trimmed 3224 records to 1879 (keeping 200 days of data) [2025-09-22T17:05:38.154268] [DEBUG] [LOCAL ] AFGD: Primary data saved (1879 records). [2025-09-22T17:05:38.154372] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-22T17:05:38.154453] [INFO ] [MAIN ] Update Progress: 48/2372 symbols completed. AFGD took 27.7s. Estimated remaining: 4h 29m 47s. Rate: 8.6 symbols/min [2025-09-22T17:05:38.327006] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:05:38.380568] [DEBUG] [LOCAL ] AGCO: Loaded 43447 existing records from primary storage. [2025-09-22T17:05:38.380758] [INFO ] [MAIN ] AGCO: Loaded 43447 existing records. [2025-09-22T17:05:38.578608] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:05:38.578919] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-22T17:05:38.578971] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-22T17:05:38.580192] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-22T17:05:38.580258] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-22T17:05:38.925135] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-22T17:05:38.947376] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:05:39.286931] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-22T17:05:39.722082] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-22T17:05:39.934667] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T17:05:40.030771] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-22T17:05:40.522109] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-22T17:05:41.322058] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-22T17:05:41.671911] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-22T17:05:41.961046] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T17:05:42.122049] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-22T17:05:42.922078] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-22T17:05:43.610019] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T17:05:43.610573] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T17:05:43.722015] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-22T17:05:44.522057] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-22T17:05:45.068133] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-22T17:05:45.069111] [INFO ] [REMOTE ] AFGE: Full fetch complete (3494 records). [2025-09-22T17:05:45.069180] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-22T17:05:45.279694] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T17:05:45.327121] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-22T17:05:45.513635] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-22T17:05:45.513757] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-22T17:05:45.513888] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-22T17:05:45.513928] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-22T17:05:45.514288] [DEBUG] [LOCAL ] AFGE: Trimmed 3494 records to 2534 (keeping 200 days of data) [2025-09-22T17:05:45.530066] [DEBUG] [LOCAL ] AFGE: Primary data saved (2534 records). [2025-09-22T17:05:45.530141] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-22T17:05:45.530213] [INFO ] [MAIN ] Update Progress: 49/2372 symbols completed. AFGE took 32.0s. Estimated remaining: 4h 29m 60s. Rate: 8.6 symbols/min [2025-09-22T17:05:45.698328] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:05:45.717384] [DEBUG] [LOCAL ] AGD: Loaded 17845 existing records from primary storage. [2025-09-22T17:05:45.717517] [INFO ] [MAIN ] AGD: Loaded 17845 existing records. [2025-09-22T17:05:45.894213] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:05:45.894489] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-22T17:05:45.894536] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-22T17:05:45.895138] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-22T17:05:45.895199] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-22T17:05:46.133551] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-22T17:05:46.254017] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:05:46.922060] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-22T17:05:47.173121] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T17:05:47.505943] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T17:05:47.722098] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-22T17:05:48.461255] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T17:05:48.522144] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-22T17:05:49.322115] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-22T17:05:49.516631] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T17:05:49.917480] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T17:05:49.958600] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T17:05:50.122064] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-22T17:05:50.819398] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T17:05:50.922062] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-22T17:05:51.521193] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-22T17:05:51.722083] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-22T17:05:52.522028] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-22T17:05:52.606125] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T17:05:53.322070] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-22T17:05:54.122028] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-22T17:05:54.191390] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T17:05:54.200762] [INFO ] [REMOTE ] AFL: Full fetch complete (76932 records). [2025-09-22T17:05:54.200961] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-22T17:05:54.622551] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-22T17:05:54.622691] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-22T17:05:54.623550] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-22T17:05:54.623637] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-22T17:05:54.625593] [DEBUG] [LOCAL ] AFL: Trimmed 76932 records to 53151 (keeping 200 days of data) [2025-09-22T17:05:54.779775] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T17:05:54.923020] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-22T17:05:55.017838] [DEBUG] [LOCAL ] AFL: Primary data saved (53151 records). [2025-09-22T17:05:55.018102] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-22T17:05:55.018243] [INFO ] [MAIN ] Update Progress: 50/2372 symbols completed. AFL took 32.5s. Estimated remaining: 4h 31m 50s. Rate: 8.5 symbols/min [2025-09-22T17:05:55.200102] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:05:55.259250] [DEBUG] [LOCAL ] AGI: Loaded 54192 existing records from primary storage. [2025-09-22T17:05:55.259459] [INFO ] [MAIN ] AGI: Loaded 54192 existing records. [2025-09-22T17:05:55.451855] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:05:55.463808] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T17:05:55.463255] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-22T17:05:55.467572] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-22T17:05:55.469932] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-22T17:05:55.470005] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-22T17:05:55.734212] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-22T17:05:55.861709] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:05:56.106210] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T17:05:56.522074] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-22T17:05:57.182944] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T17:05:57.322054] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-22T17:05:57.674135] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T17:05:58.122058] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-22T17:05:58.656792] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T17:05:58.922117] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-22T17:05:59.722040] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-22T17:06:00.246767] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T17:06:00.289424] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-22T17:06:00.522099] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-22T17:06:01.322084] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-22T17:06:01.374295] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T17:06:01.609832] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T17:06:02.122071] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-22T17:06:02.922090] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-22T17:06:03.543703] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-22T17:06:03.722065] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-22T17:06:04.522111] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-22T17:06:05.104042] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T17:06:05.212060] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-22T17:06:05.265141] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (3.14 seconds). [2025-09-22T17:06:05.291882] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T17:06:05.322043] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-22T17:06:06.016885] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T17:06:06.122125] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-22T17:06:06.901999] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-22T17:06:06.906213] [INFO ] [REMOTE ] AGD: Full fetch complete (25035 records). [2025-09-22T17:06:06.906361] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-22T17:06:06.907884] [FATAL] [VALIDATOR ] AGD: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:06:06.908135] [FATAL] [MAIN ] AGD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:06:06.908185] [WARN ] [MAIN ] AGD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:06:06.908260] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-22T17:06:06.908359] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-09-22T17:06:06.908418] [INFO ] [LOCAL ] AGD: Starting deletion of derivative data. [2025-09-22T17:06:06.908943] [DEBUG] [LOCAL ] AGD: Deleted derivative data file. [2025-09-22T17:06:06.909069] [INFO ] [MAIN ] Update Progress: 51/2372 symbols completed. AGD took 21.4s. Estimated remaining: 4h 35m 24s. Rate: 8.4 symbols/min [2025-09-22T17:06:06.931146] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-22T17:06:07.093377] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:06:07.155343] [DEBUG] [LOCAL ] AGL: Loaded 53174 existing records from primary storage. [2025-09-22T17:06:07.155519] [INFO ] [MAIN ] AGL: Loaded 53174 existing records. [2025-09-22T17:06:07.333045] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:06:07.333326] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-22T17:06:07.333381] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-22T17:06:07.334989] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-22T17:06:07.335051] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-22T17:06:07.694585] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:06:07.722005] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-22T17:06:08.236750] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T17:06:08.522052] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-22T17:06:09.219216] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T17:06:09.322010] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-22T17:06:09.852441] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T17:06:10.122061] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-22T17:06:10.660765] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T17:06:10.922106] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-22T17:06:11.722076] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-22T17:06:12.400751] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-22T17:06:12.439894] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T17:06:12.522054] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-22T17:06:12.933960] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T17:06:13.322083] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-22T17:06:14.058696] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T17:06:14.122054] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-22T17:06:14.922057] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-22T17:06:15.309704] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-22T17:06:15.317268] [INFO ] [REMOTE ] AGCO: Full fetch complete (62079 records). [2025-09-22T17:06:15.317511] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-22T17:06:15.730397] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-22T17:06:15.733830] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-22T17:06:15.735072] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-22T17:06:15.735775] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-22T17:06:15.735852] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-22T17:06:15.737354] [DEBUG] [LOCAL ] AGCO: Trimmed 62079 records to 42600 (keeping 200 days of data) [2025-09-22T17:06:16.008878] [DEBUG] [LOCAL ] AGCO: Primary data saved (42600 records). [2025-09-22T17:06:16.009066] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-22T17:06:16.010036] [INFO ] [MAIN ] Update Progress: 52/2372 symbols completed. AGCO took 37.9s. Estimated remaining: 4h 36m 46s. Rate: 8.4 symbols/min [2025-09-22T17:06:16.184008] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:06:16.198349] [DEBUG] [LOCAL ] AGM: Loaded 9993 existing records from primary storage. [2025-09-22T17:06:16.198487] [INFO ] [MAIN ] AGM: Loaded 9993 existing records. [2025-09-22T17:06:16.455033] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:06:16.455329] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-22T17:06:16.455380] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-22T17:06:16.455874] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-22T17:06:16.455949] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-22T17:06:16.845937] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:06:16.846265] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-22T17:06:16.943399] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-22T17:06:17.322131] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-22T17:06:17.634571] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T17:06:17.748975] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-22T17:06:17.787356] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T17:06:18.122054] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-22T17:06:18.922027] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-22T17:06:19.004440] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T17:06:19.405702] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T17:06:19.722061] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-22T17:06:20.068978] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-22T17:06:20.077531] [INFO ] [REMOTE ] AG: Full fetch complete (77571 records). [2025-09-22T17:06:20.077714] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-22T17:06:20.491564] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-22T17:06:20.491748] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-22T17:06:20.492511] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-22T17:06:20.492562] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-22T17:06:20.494411] [DEBUG] [LOCAL ] AG: Trimmed 77571 records to 53643 (keeping 200 days of data) [2025-09-22T17:06:20.557782] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-22T17:06:20.832115] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-09-22T17:06:20.832270] [INFO ] [MAIN ] AG: Full history saved. [2025-09-22T17:06:20.832355] [INFO ] [MAIN ] Update Progress: 53/2372 symbols completed. AG took 53.9s. Estimated remaining: 4h 34m 56s. Rate: 8.4 symbols/min [2025-09-22T17:06:21.003547] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:06:21.032938] [DEBUG] [LOCAL ] AGO: Loaded 28590 existing records from primary storage. [2025-09-22T17:06:21.033121] [INFO ] [MAIN ] AGO: Loaded 28590 existing records. [2025-09-22T17:06:21.151274] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T17:06:21.221384] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:06:21.221632] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-22T17:06:21.221731] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-22T17:06:21.223288] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-22T17:06:21.223350] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-22T17:06:21.330463] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-22T17:06:21.668257] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:06:21.702475] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-22T17:06:21.948207] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T17:06:22.122075] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-22T17:06:22.922081] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-22T17:06:23.725092] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-22T17:06:23.730737] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T17:06:24.173538] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-22T17:06:24.522121] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-22T17:06:25.322082] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-22T17:06:25.478023] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T17:06:25.478616] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T17:06:25.931602] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-22T17:06:26.122080] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-22T17:06:26.619935] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-22T17:06:26.922160] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-22T17:06:27.722098] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-22T17:06:27.981118] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T17:06:28.522030] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-22T17:06:28.541716] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T17:06:29.322061] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-22T17:06:30.127185] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-22T17:06:30.140379] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T17:06:30.841690] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T17:06:30.922036] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-22T17:06:31.012378] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T17:06:31.722062] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-22T17:06:32.338119] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T17:06:32.397445] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T17:06:32.406089] [INFO ] [REMOTE ] AGI: Full fetch complete (76686 records). [2025-09-22T17:06:32.406236] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-22T17:06:32.527239] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-22T17:06:32.808357] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-22T17:06:32.808466] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-22T17:06:32.809224] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-22T17:06:32.809294] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-22T17:06:32.811102] [DEBUG] [LOCAL ] AGI: Trimmed 76686 records to 53418 (keeping 200 days of data) [2025-09-22T17:06:33.165620] [DEBUG] [LOCAL ] AGI: Primary data saved (53418 records). [2025-09-22T17:06:33.165800] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-22T17:06:33.165889] [INFO ] [MAIN ] Update Progress: 54/2372 symbols completed. AGI took 38.1s. Estimated remaining: 4h 38m 33s. Rate: 8.3 symbols/min [2025-09-22T17:06:33.334038] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-22T17:06:33.362066] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:06:33.408886] [DEBUG] [LOCAL ] AGRO: Loaded 34460 existing records from primary storage. [2025-09-22T17:06:33.409188] [INFO ] [MAIN ] AGRO: Loaded 34460 existing records. [2025-09-22T17:06:33.638444] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:06:33.638849] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-22T17:06:33.638906] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-22T17:06:33.639947] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-22T17:06:33.640010] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-22T17:06:34.079309] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T17:06:34.078722] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:06:34.084387] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T17:06:34.122016] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-22T17:06:34.922077] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-22T17:06:35.529554] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T17:06:35.722087] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-22T17:06:36.039233] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-22T17:06:36.381581] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T17:06:36.383710] [INFO ] [REMOTE ] AGM: Full fetch complete (12480 records). [2025-09-22T17:06:36.383792] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-22T17:06:36.541505] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-22T17:06:36.813500] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-22T17:06:36.813585] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-22T17:06:36.813807] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-22T17:06:36.813869] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-22T17:06:36.814385] [DEBUG] [LOCAL ] AGM: Trimmed 12480 records to 9877 (keeping 200 days of data) [2025-09-22T17:06:36.885661] [DEBUG] [LOCAL ] AGM: Primary data saved (9877 records). [2025-09-22T17:06:36.885807] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-22T17:06:36.885933] [INFO ] [MAIN ] Update Progress: 55/2372 symbols completed. AGM took 20.9s. Estimated remaining: 4h 35m 59s. Rate: 8.4 symbols/min [2025-09-22T17:06:37.073869] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:06:37.121292] [DEBUG] [LOCAL ] AGX: Loaded 34119 existing records from primary storage. [2025-09-22T17:06:37.121472] [INFO ] [MAIN ] AGX: Loaded 34119 existing records. [2025-09-22T17:06:37.325333] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-22T17:06:37.325796] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:06:37.327275] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-22T17:06:37.327338] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-22T17:06:37.328560] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-22T17:06:37.328625] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-22T17:06:37.711602] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:06:38.124467] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-22T17:06:38.129594] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T17:06:38.236873] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-22T17:06:38.922055] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-22T17:06:39.561623] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T17:06:39.722059] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-22T17:06:40.036741] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T17:06:40.522096] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-22T17:06:40.620773] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T17:06:41.322064] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-22T17:06:41.546794] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T17:06:42.122058] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-22T17:06:42.528994] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T17:06:42.922133] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-22T17:06:43.576203] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T17:06:43.586039] [INFO ] [REMOTE ] AGL: Full fetch complete (75403 records). [2025-09-22T17:06:43.586166] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-22T17:06:43.727348] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-22T17:06:44.007090] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-22T17:06:44.007573] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-22T17:06:44.008413] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-22T17:06:44.008528] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-22T17:06:44.029925] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T17:06:44.036608] [DEBUG] [LOCAL ] AGL: Trimmed 75403 records to 52417 (keeping 200 days of data) [2025-09-22T17:06:44.354460] [DEBUG] [LOCAL ] AGL: Primary data saved (52417 records). [2025-09-22T17:06:44.354597] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-22T17:06:44.354764] [INFO ] [MAIN ] Update Progress: 56/2372 symbols completed. AGL took 37.4s. Estimated remaining: 4h 36m 5s. Rate: 8.4 symbols/min [2025-09-22T17:06:44.534671] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-22T17:06:44.537885] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:06:44.585495] [DEBUG] [LOCAL ] AHH: Loaded 42133 existing records from primary storage. [2025-09-22T17:06:44.585666] [INFO ] [MAIN ] AHH: Loaded 42133 existing records. [2025-09-22T17:06:44.760470] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:06:44.760886] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-22T17:06:44.760942] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-22T17:06:44.762058] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-22T17:06:44.762173] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-22T17:06:45.120770] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:06:45.171552] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T17:06:45.322065] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-22T17:06:45.456102] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T17:06:46.122061] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-22T17:06:46.447460] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T17:06:46.922079] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-22T17:06:47.731800] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-22T17:06:47.733901] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T17:06:47.841449] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T17:06:48.522059] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-22T17:06:49.025200] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-22T17:06:49.322068] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-22T17:06:49.702289] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T17:06:50.122062] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-22T17:06:50.548945] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T17:06:50.922070] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-22T17:06:51.177403] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T17:06:51.722051] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-22T17:06:51.801220] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T17:06:52.522083] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-22T17:06:52.856071] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T17:06:53.322069] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-22T17:06:53.408833] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T17:06:53.414097] [INFO ] [REMOTE ] AGO: Full fetch complete (39328 records). [2025-09-22T17:06:53.414249] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-22T17:06:53.812793] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-22T17:06:53.812872] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-22T17:06:53.813296] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-22T17:06:53.813387] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-22T17:06:53.814413] [DEBUG] [LOCAL ] AGO: Trimmed 39328 records to 28128 (keeping 200 days of data) [2025-09-22T17:06:54.019659] [DEBUG] [LOCAL ] AGO: Primary data saved (28128 records). [2025-09-22T17:06:54.019950] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-22T17:06:54.020069] [INFO ] [MAIN ] Update Progress: 57/2372 symbols completed. AGO took 33.2s. Estimated remaining: 4h 37m 40s. Rate: 8.3 symbols/min [2025-09-22T17:06:54.127233] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-22T17:06:54.191080] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:06:54.191269] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-22T17:06:54.191324] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-22T17:06:54.191491] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-22T17:06:54.191533] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-22T17:06:54.191573] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-22T17:06:54.191619] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-22T17:06:54.549971] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:06:54.620924] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T17:06:54.922092] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-22T17:06:55.268422] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T17:06:55.635207] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T17:06:55.722067] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-22T17:06:56.522095] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-22T17:06:56.585210] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T17:06:57.322057] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-22T17:06:57.801058] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-22T17:06:58.122096] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-22T17:06:58.410275] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T17:06:58.922074] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-22T17:06:59.245275] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T17:06:59.722091] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-22T17:07:00.534181] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-22T17:07:00.541989] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T17:07:00.957511] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T17:07:01.322099] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-22T17:07:01.661763] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T17:07:01.667486] [INFO ] [REMOTE ] AGRO: Full fetch complete (49893 records). [2025-09-22T17:07:01.667703] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-22T17:07:02.127866] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-22T17:07:02.130809] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-22T17:07:02.131828] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-22T17:07:02.132388] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-22T17:07:02.132442] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-22T17:07:02.133803] [DEBUG] [LOCAL ] AGRO: Trimmed 49893 records to 33821 (keeping 200 days of data) [2025-09-22T17:07:02.352712] [DEBUG] [LOCAL ] AGRO: Primary data saved (33821 records). [2025-09-22T17:07:02.352880] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-22T17:07:02.352996] [INFO ] [MAIN ] Update Progress: 58/2372 symbols completed. AGRO took 29.2s. Estimated remaining: 4h 38m 18s. Rate: 8.3 symbols/min [2025-09-22T17:07:02.424169] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:02.459930] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-22T17:07:02.530632] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:07:02.588620] [DEBUG] [LOCAL ] AHR: Loaded 50104 existing records from primary storage. [2025-09-22T17:07:02.588818] [INFO ] [MAIN ] AHR: Loaded 50104 existing records. [2025-09-22T17:07:02.776482] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:07:02.777021] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-22T17:07:02.777165] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-22T17:07:02.778741] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-22T17:07:02.778806] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-22T17:07:02.925740] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-22T17:07:02.948770] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T17:07:03.200806] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:07:03.722089] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-22T17:07:03.939970] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:03.940278] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-22T17:07:04.100789] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T17:07:04.522062] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-22T17:07:05.322097] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-22T17:07:05.509881] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T17:07:05.696380] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:05.696764] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-22T17:07:06.122064] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-22T17:07:06.922075] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-22T17:07:07.501754] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T17:07:07.507368] [INFO ] [REMOTE ] AHH: Full fetch complete (60348 records). [2025-09-22T17:07:07.507477] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-22T17:07:07.727556] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-22T17:07:07.906105] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-22T17:07:07.906205] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-22T17:07:07.906821] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-22T17:07:07.906886] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-22T17:07:07.908244] [DEBUG] [LOCAL ] AHH: Trimmed 60348 records to 41463 (keeping 200 days of data) [2025-09-22T17:07:08.086796] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:08.113562] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-22T17:07:08.160321] [DEBUG] [LOCAL ] AHH: Primary data saved (41463 records). [2025-09-22T17:07:08.160467] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-22T17:07:08.160555] [INFO ] [MAIN ] Update Progress: 59/2372 symbols completed. AHH took 23.8s. Estimated remaining: 4h 37m 16s. Rate: 8.3 symbols/min [2025-09-22T17:07:08.329509] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:07:08.337687] [DEBUG] [LOCAL ] AHT: Loaded 6046 existing records from primary storage. [2025-09-22T17:07:08.337790] [INFO ] [MAIN ] AHT: Loaded 6046 existing records. [2025-09-22T17:07:08.537708] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:07:08.531425] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-22T17:07:08.538321] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-22T17:07:08.539576] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-22T17:07:08.540151] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-22T17:07:08.540387] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-22T17:07:08.726640] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T17:07:08.976639] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:07:09.322051] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-22T17:07:09.551155] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T17:07:10.122100] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-22T17:07:10.736858] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T17:07:10.922068] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-22T17:07:10.948862] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T17:07:11.165530] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:11.165871] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-22T17:07:11.722066] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-22T17:07:12.150361] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-22T17:07:12.522057] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-22T17:07:13.322060] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-22T17:07:13.445946] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-22T17:07:14.122065] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-22T17:07:14.558860] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T17:07:14.910220] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T17:07:14.915704] [INFO ] [REMOTE ] AGX: Full fetch complete (48839 records). [2025-09-22T17:07:14.915831] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-22T17:07:14.916492] [FATAL] [VALIDATOR ] AGX: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:07:14.916582] [FATAL] [MAIN ] AGX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:07:14.916698] [WARN ] [MAIN ] AGX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:07:14.916779] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-22T17:07:14.916852] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-09-22T17:07:14.916903] [INFO ] [LOCAL ] AGX: Starting deletion of derivative data. [2025-09-22T17:07:14.917402] [DEBUG] [LOCAL ] AGX: Deleted derivative data file. [2025-09-22T17:07:14.918319] [INFO ] [MAIN ] Update Progress: 60/2372 symbols completed. AGX took 38.0s. Estimated remaining: 4h 36m 52s. Rate: 8.4 symbols/min [2025-09-22T17:07:14.930253] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-22T17:07:15.106886] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:07:15.199733] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-22T17:07:15.199898] [INFO ] [MAIN ] AI: Loaded 54529 existing records. [2025-09-22T17:07:15.404374] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:07:15.409846] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-22T17:07:15.410619] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-22T17:07:15.410886] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-22T17:07:15.413372] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-22T17:07:15.413467] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-22T17:07:15.727255] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-22T17:07:15.830757] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:07:16.196288] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T17:07:16.522054] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-22T17:07:17.082247] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T17:07:17.322068] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-22T17:07:18.122128] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-22T17:07:18.221916] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T17:07:18.922085] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-22T17:07:19.344605] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T17:07:19.722032] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-22T17:07:19.777896] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T17:07:20.520272] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T17:07:20.522350] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-22T17:07:21.322105] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-22T17:07:22.122070] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-22T17:07:22.617877] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T17:07:22.914675] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-22T17:07:22.925858] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-22T17:07:23.158426] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T17:07:23.160309] [INFO ] [REMOTE ] AHT: Full fetch complete (9466 records). [2025-09-22T17:07:23.160381] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-22T17:07:23.160887] [FATAL] [VALIDATOR ] AHT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:07:23.160986] [FATAL] [MAIN ] AHT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:07:23.161033] [WARN ] [MAIN ] AHT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:07:23.161217] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-22T17:07:23.161555] [DEBUG] [LOCAL ] AHT: No primary data file found to delete. [2025-09-22T17:07:23.161609] [INFO ] [LOCAL ] AHT: Starting deletion of derivative data. [2025-09-22T17:07:23.162134] [DEBUG] [LOCAL ] AHT: Deleted derivative data file. [2025-09-22T17:07:23.162318] [INFO ] [MAIN ] Update Progress: 61/2372 symbols completed. AHT took 15.0s. Estimated remaining: 4h 37m 25s. Rate: 8.3 symbols/min [2025-09-22T17:07:23.338093] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:07:23.391275] [DEBUG] [LOCAL ] AIG: Loaded 54257 existing records from primary storage. [2025-09-22T17:07:23.391430] [INFO ] [MAIN ] AIG: Loaded 54257 existing records. [2025-09-22T17:07:23.573616] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:07:23.573906] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-22T17:07:23.573953] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-22T17:07:23.575389] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-22T17:07:23.575451] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-22T17:07:23.727983] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-22T17:07:23.975261] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:07:24.153979] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T17:07:24.522077] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-22T17:07:25.322057] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-22T17:07:25.965582] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T17:07:26.006412] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-22T17:07:26.122004] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-22T17:07:26.415975] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T17:07:26.922112] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-22T17:07:27.722046] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-22T17:07:28.085235] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-22T17:07:28.298735] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T17:07:28.522087] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-22T17:07:29.092534] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T17:07:29.113264] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-22T17:07:29.322056] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-22T17:07:30.122066] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-22T17:07:30.325575] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T17:07:30.922064] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-22T17:07:31.722183] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-22T17:07:31.961936] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T17:07:32.522062] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-22T17:07:32.858073] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T17:07:33.322020] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-22T17:07:33.405869] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T17:07:33.837810] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T17:07:34.122063] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-22T17:07:34.598482] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T17:07:34.604260] [INFO ] [REMOTE ] AHL: Full fetch complete (17031 records). [2025-09-22T17:07:34.604340] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-22T17:07:34.797324] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 94 unique days, need 200 days [2025-09-22T17:07:34.797669] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:07:34.797741] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:07:34.797788] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-22T17:07:34.797843] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-22T17:07:34.797884] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-22T17:07:34.797921] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-22T17:07:34.797978] [INFO ] [MAIN ] Update Progress: 62/2372 symbols completed. AHL took 40.8s. Estimated remaining: 4h 40m 3s. Rate: 8.2 symbols/min [2025-09-22T17:07:34.927272] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-22T17:07:34.975831] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:07:34.976018] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-22T17:07:34.976108] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-22T17:07:34.976267] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-22T17:07:34.976317] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-22T17:07:34.976361] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-22T17:07:34.976394] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-22T17:07:35.362082] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:07:35.722060] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-22T17:07:35.968256] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:35.968598] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-22T17:07:36.114057] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T17:07:36.522115] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-22T17:07:36.896974] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-22T17:07:37.322086] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-22T17:07:37.796517] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T17:07:38.122084] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-22T17:07:38.799349] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T17:07:38.922053] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-22T17:07:39.153278] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:39.153596] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-22T17:07:39.722054] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-22T17:07:40.056076] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T17:07:40.064554] [INFO ] [REMOTE ] AHR: Full fetch complete (71035 records). [2025-09-22T17:07:40.064774] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-22T17:07:40.522154] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-22T17:07:40.544788] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-22T17:07:40.544905] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-22T17:07:40.545638] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-22T17:07:40.545730] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-22T17:07:40.547710] [DEBUG] [LOCAL ] AHR: Trimmed 71035 records to 49322 (keeping 200 days of data) [2025-09-22T17:07:40.799142] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:40.799474] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-22T17:07:40.856407] [DEBUG] [LOCAL ] AHR: Primary data saved (49322 records). [2025-09-22T17:07:40.856594] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-22T17:07:40.856734] [INFO ] [MAIN ] Update Progress: 63/2372 symbols completed. AHR took 38.5s. Estimated remaining: 4h 39m 11s. Rate: 8.3 symbols/min [2025-09-22T17:07:41.024128] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:07:41.047950] [DEBUG] [LOCAL ] AIN: Loaded 24971 existing records from primary storage. [2025-09-22T17:07:41.048084] [INFO ] [MAIN ] AIN: Loaded 24971 existing records. [2025-09-22T17:07:41.250717] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:07:41.251261] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-22T17:07:41.251336] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-22T17:07:41.252373] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-22T17:07:41.252439] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-22T17:07:41.323100] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-22T17:07:41.614039] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T17:07:41.687189] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:07:42.122078] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-22T17:07:42.922062] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-22T17:07:43.127572] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:43.127988] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-22T17:07:43.385732] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-22T17:07:43.722071] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-22T17:07:43.891217] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T17:07:43.944034] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:07:43.944504] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-22T17:07:44.522094] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-22T17:07:45.322058] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-22T17:07:45.449432] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T17:07:46.122062] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-22T17:07:46.801341] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T17:07:46.922021] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-22T17:07:47.450567] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-22T17:07:47.617018] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T17:07:47.722019] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-22T17:07:48.522115] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-22T17:07:48.605599] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T17:07:49.322057] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-22T17:07:49.970009] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T17:07:50.042967] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T17:07:50.122071] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-22T17:07:50.922057] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-22T17:07:51.727146] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-22T17:07:51.740541] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T17:07:52.505495] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-22T17:07:52.522037] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-22T17:07:53.322065] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-22T17:07:53.395423] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T17:07:53.640556] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T17:07:54.122088] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-22T17:07:54.828407] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T17:07:54.922171] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-22T17:07:55.596308] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-22T17:07:55.722096] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-22T17:07:56.223338] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-22T17:07:56.527130] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-22T17:07:56.539964] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T17:07:56.551628] [INFO ] [REMOTE ] AIG: Full fetch complete (77375 records). [2025-09-22T17:07:56.551867] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-22T17:07:56.951415] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-22T17:07:56.951511] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-22T17:07:56.952258] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-22T17:07:56.952328] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-22T17:07:56.953980] [DEBUG] [LOCAL ] AIG: Trimmed 77375 records to 53478 (keeping 200 days of data) [2025-09-22T17:07:57.288626] [DEBUG] [LOCAL ] AIG: Primary data saved (53478 records). [2025-09-22T17:07:57.288843] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-22T17:07:57.288960] [INFO ] [MAIN ] Update Progress: 64/2372 symbols completed. AIG took 34.1s. Estimated remaining: 4h 44m 35s. Rate: 8.1 symbols/min [2025-09-22T17:07:57.327195] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-22T17:07:57.468022] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:07:57.486151] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T17:07:57.502146] [DEBUG] [LOCAL ] AIO: Loaded 13548 existing records from primary storage. [2025-09-22T17:07:57.502270] [INFO ] [MAIN ] AIO: Loaded 13548 existing records. [2025-09-22T17:07:57.681398] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:07:57.681715] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-22T17:07:57.681770] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-22T17:07:57.682348] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-22T17:07:57.682408] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-22T17:07:58.082470] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:07:58.091925] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T17:07:58.122066] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-22T17:07:58.922091] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-22T17:07:59.263520] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T17:07:59.268082] [INFO ] [REMOTE ] AII: Full fetch complete (10281 records). [2025-09-22T17:07:59.268297] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-22T17:07:59.482323] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 94 unique days, need 200 days [2025-09-22T17:07:59.482586] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:07:59.482680] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:07:59.482761] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-22T17:07:59.482851] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-22T17:07:59.482889] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-22T17:07:59.482928] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-22T17:07:59.482988] [INFO ] [MAIN ] Update Progress: 65/2372 symbols completed. AII took 24.7s. Estimated remaining: 4h 41m 22s. Rate: 8.2 symbols/min [2025-09-22T17:07:59.662733] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:07:59.662920] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-09-22T17:07:59.662958] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-09-22T17:07:59.663109] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-22T17:07:59.663154] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-22T17:07:59.663195] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-09-22T17:07:59.663227] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-22T17:07:59.732563] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-22T17:08:00.051742] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T17:08:00.084274] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:08:00.522074] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-22T17:08:01.322072] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-22T17:08:01.345568] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-22T17:08:01.966759] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T17:08:02.056069] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-22T17:08:02.064447] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-22T17:08:02.064598] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-22T17:08:02.127195] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-22T17:08:02.501738] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-22T17:08:02.501862] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-22T17:08:02.502624] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-22T17:08:02.502715] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-22T17:08:02.504429] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53749 (keeping 200 days of data) [2025-09-22T17:08:02.833988] [DEBUG] [LOCAL ] AI: Primary data saved (53749 records). [2025-09-22T17:08:02.834167] [INFO ] [MAIN ] AI: Full history saved. [2025-09-22T17:08:02.835245] [INFO ] [MAIN ] Update Progress: 66/2372 symbols completed. AI took 47.9s. Estimated remaining: 4h 38m 57s. Rate: 8.3 symbols/min [2025-09-22T17:08:02.927301] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-22T17:08:03.034861] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:08:03.071388] [DEBUG] [LOCAL ] AIT: Loaded 28788 existing records from primary storage. [2025-09-22T17:08:03.071586] [INFO ] [MAIN ] AIT: Loaded 28788 existing records. [2025-09-22T17:08:03.255671] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:08:03.256069] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-22T17:08:03.261291] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-22T17:08:03.267690] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T17:08:03.269165] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-22T17:08:03.272298] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-22T17:08:03.626504] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:08:03.722016] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-22T17:08:03.853060] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T17:08:04.522066] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-22T17:08:04.668870] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-22T17:08:05.322112] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-22T17:08:05.378130] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T17:08:06.122108] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-22T17:08:06.144703] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T17:08:06.149526] [INFO ] [REMOTE ] AIN: Full fetch complete (33212 records). [2025-09-22T17:08:06.149795] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-22T17:08:06.564764] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-22T17:08:06.564881] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-22T17:08:06.565360] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-22T17:08:06.565407] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-22T17:08:06.566566] [DEBUG] [LOCAL ] AIN: Trimmed 33212 records to 24581 (keeping 200 days of data) [2025-09-22T17:08:06.728788] [DEBUG] [LOCAL ] AIN: Primary data saved (24581 records). [2025-09-22T17:08:06.728985] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-22T17:08:06.729110] [INFO ] [MAIN ] Update Progress: 67/2372 symbols completed. AIN took 25.9s. Estimated remaining: 4h 36m 54s. Rate: 8.3 symbols/min [2025-09-22T17:08:06.917022] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:08:06.922127] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-22T17:08:06.961402] [DEBUG] [LOCAL ] AIV: Loaded 40790 existing records from primary storage. [2025-09-22T17:08:06.961606] [INFO ] [MAIN ] AIV: Loaded 40790 existing records. [2025-09-22T17:08:07.182722] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T17:08:07.182194] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:08:07.187172] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-22T17:08:07.187263] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-22T17:08:07.188250] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-22T17:08:07.188316] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-22T17:08:07.558898] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:08:07.637301] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T17:08:07.722069] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-22T17:08:08.522037] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-22T17:08:08.686492] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T17:08:09.322087] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-22T17:08:09.779814] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-22T17:08:10.122104] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-22T17:08:10.366249] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T17:08:10.922048] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-22T17:08:11.148749] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T17:08:11.722073] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-22T17:08:11.802364] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T17:08:12.522027] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-22T17:08:12.552347] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-22T17:08:13.322058] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-22T17:08:13.483460] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T17:08:14.122083] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-22T17:08:14.247061] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-22T17:08:14.922070] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-22T17:08:15.306581] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T17:08:15.722067] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-22T17:08:16.059442] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-22T17:08:16.522072] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-22T17:08:16.870287] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T17:08:17.322059] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-22T17:08:17.943866] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T17:08:18.122047] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-22T17:08:18.404622] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T17:08:18.922094] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-22T17:08:19.044309] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T17:08:19.722182] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-22T17:08:19.836514] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-22T17:08:20.522082] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-22T17:08:21.273099] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T17:08:21.322003] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-22T17:08:21.513417] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T17:08:22.122070] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-22T17:08:22.258526] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T17:08:22.764717] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T17:08:22.922074] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-22T17:08:23.624096] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T17:08:23.722091] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-22T17:08:24.522043] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-22T17:08:24.532026] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-22T17:08:25.322075] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-22T17:08:25.568936] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T17:08:26.122159] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-22T17:08:26.712179] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T17:08:26.922137] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-22T17:08:27.089189] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T17:08:27.091808] [INFO ] [REMOTE ] AIO: Full fetch complete (20063 records). [2025-09-22T17:08:27.091892] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-22T17:08:27.489991] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-22T17:08:27.490126] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-22T17:08:27.490463] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-22T17:08:27.490509] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-22T17:08:27.491393] [DEBUG] [LOCAL ] AIO: Trimmed 20063 records to 13283 (keeping 200 days of data) [2025-09-22T17:08:27.583778] [DEBUG] [LOCAL ] AIO: Primary data saved (13283 records). [2025-09-22T17:08:27.584004] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-22T17:08:27.584118] [INFO ] [MAIN ] Update Progress: 68/2372 symbols completed. AIO took 30.3s. Estimated remaining: 4h 44m 29s. Rate: 8.1 symbols/min [2025-09-22T17:08:27.732941] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-22T17:08:27.769013] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:08:27.818901] [DEBUG] [LOCAL ] AIZ: Loaded 30801 existing records from primary storage. [2025-09-22T17:08:27.819176] [INFO ] [MAIN ] AIZ: Loaded 30801 existing records. [2025-09-22T17:08:28.013233] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:08:28.013567] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-22T17:08:28.013660] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-22T17:08:28.015020] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-22T17:08:28.015122] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-22T17:08:28.406379] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:08:28.435447] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T17:08:28.522102] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-22T17:08:28.768481] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T17:08:28.773410] [INFO ] [REMOTE ] AIR: Full fetch complete (37440 records). [2025-09-22T17:08:28.773508] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-22T17:08:29.172706] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-22T17:08:29.172846] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-22T17:08:29.173422] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-22T17:08:29.173478] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-22T17:08:29.174975] [DEBUG] [LOCAL ] AIR: Trimmed 37440 records to 27260 (keeping 200 days of data) [2025-09-22T17:08:29.323638] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-22T17:08:29.355669] [DEBUG] [LOCAL ] AIR: Primary data saved (27260 records). [2025-09-22T17:08:29.355909] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-22T17:08:29.356043] [INFO ] [MAIN ] Update Progress: 69/2372 symbols completed. AIR took 29.9s. Estimated remaining: 4h 41m 13s. Rate: 8.2 symbols/min [2025-09-22T17:08:29.543999] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:08:29.551192] [DEBUG] [LOCAL ] AIZN: Loaded 4012 existing records from primary storage. [2025-09-22T17:08:29.551314] [INFO ] [MAIN ] AIZN: Loaded 4012 existing records. [2025-09-22T17:08:29.736434] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:08:29.736974] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-22T17:08:29.737143] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-22T17:08:29.737575] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-22T17:08:29.737638] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-22T17:08:29.837133] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T17:08:30.126080] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-22T17:08:30.129830] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:08:30.706341] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T17:08:30.922057] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-22T17:08:31.419832] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T17:08:31.722112] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-22T17:08:32.072292] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T17:08:32.522087] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-22T17:08:32.628556] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-22T17:08:33.322085] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-22T17:08:33.611559] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T17:08:34.122099] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-22T17:08:34.345051] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-22T17:08:34.922061] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-22T17:08:35.238792] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T17:08:35.722071] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-22T17:08:36.003599] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T17:08:36.145300] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-22T17:08:36.522078] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-22T17:08:37.322055] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-22T17:08:37.711270] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T17:08:38.122055] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-22T17:08:38.198172] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T17:08:38.201419] [INFO ] [REMOTE ] AIT: Full fetch complete (39435 records). [2025-09-22T17:08:38.201506] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-22T17:08:38.202119] [FATAL] [VALIDATOR ] AIT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:08:38.202204] [FATAL] [MAIN ] AIT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:08:38.202246] [WARN ] [MAIN ] AIT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:08:38.202312] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-22T17:08:38.202376] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-09-22T17:08:38.202411] [INFO ] [LOCAL ] AIT: Starting deletion of derivative data. [2025-09-22T17:08:38.202965] [DEBUG] [LOCAL ] AIT: Deleted derivative data file. [2025-09-22T17:08:38.203059] [INFO ] [MAIN ] Update Progress: 70/2372 symbols completed. AIT took 35.4s. Estimated remaining: 4h 41m 56s. Rate: 8.2 symbols/min [2025-09-22T17:08:38.376893] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:08:38.425961] [DEBUG] [LOCAL ] AJG: Loaded 47861 existing records from primary storage. [2025-09-22T17:08:38.426181] [INFO ] [MAIN ] AJG: Loaded 47861 existing records. [2025-09-22T17:08:38.613355] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:08:38.613580] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-22T17:08:38.613630] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-22T17:08:38.615189] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-22T17:08:38.615253] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-22T17:08:38.928172] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-22T17:08:39.011459] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:08:39.489515] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T17:08:39.496811] [INFO ] [REMOTE ] AIV: Full fetch complete (59060 records). [2025-09-22T17:08:39.496947] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-22T17:08:39.728292] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-22T17:08:39.910941] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-22T17:08:39.911020] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-22T17:08:39.911575] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-22T17:08:39.911616] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-22T17:08:39.912868] [DEBUG] [LOCAL ] AIV: Trimmed 59060 records to 40199 (keeping 200 days of data) [2025-09-22T17:08:40.145120] [DEBUG] [LOCAL ] AIV: Primary data saved (40199 records). [2025-09-22T17:08:40.145257] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-22T17:08:40.145340] [INFO ] [MAIN ] Update Progress: 71/2372 symbols completed. AIV took 33.4s. Estimated remaining: 4h 38m 53s. Rate: 8.3 symbols/min [2025-09-22T17:08:40.323187] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:08:40.323557] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-22T17:08:40.323690] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-22T17:08:40.323954] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-22T17:08:40.324025] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-22T17:08:40.324079] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-22T17:08:40.324203] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-22T17:08:40.542789] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-22T17:08:40.638848] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T17:08:40.741103] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:08:41.070888] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-22T17:08:41.322009] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-22T17:08:41.780146] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-22T17:08:41.830000] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-22T17:08:42.122119] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-22T17:08:42.470591] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-22T17:08:42.922068] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-22T17:08:43.722096] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-22T17:08:44.273714] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-22T17:08:44.406034] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T17:08:44.522098] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-22T17:08:44.892268] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-22T17:08:45.322082] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-22T17:08:46.122094] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-22T17:08:46.690256] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-22T17:08:46.732250] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T17:08:46.922077] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-22T17:08:47.722146] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-22T17:08:48.087995] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-22T17:08:48.152106] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T17:08:48.522141] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-22T17:08:49.322080] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-22T17:08:49.593433] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T17:08:49.785190] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-22T17:08:50.122044] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-22T17:08:50.922084] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-22T17:08:51.088917] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T17:08:51.093471] [INFO ] [REMOTE ] AIZ: Full fetch complete (43032 records). [2025-09-22T17:08:51.093605] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-22T17:08:51.275680] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-22T17:08:51.480200] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-22T17:08:51.480282] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-22T17:08:51.480752] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-22T17:08:51.480828] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-22T17:08:51.481925] [DEBUG] [LOCAL ] AIZ: Trimmed 43032 records to 30228 (keeping 200 days of data) [2025-09-22T17:08:51.678155] [DEBUG] [LOCAL ] AIZ: Primary data saved (30228 records). [2025-09-22T17:08:51.678294] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-22T17:08:51.678410] [INFO ] [MAIN ] Update Progress: 72/2372 symbols completed. AIZ took 24.1s. Estimated remaining: 4h 41m 2s. Rate: 8.2 symbols/min [2025-09-22T17:08:51.731692] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-22T17:08:51.872787] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:08:51.925548] [DEBUG] [LOCAL ] AKR: Loaded 46371 existing records from primary storage. [2025-09-22T17:08:51.925756] [INFO ] [MAIN ] AKR: Loaded 46371 existing records. [2025-09-22T17:08:52.116224] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:08:52.116494] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-22T17:08:52.116544] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-22T17:08:52.117929] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-22T17:08:52.117992] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-22T17:08:52.497414] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:08:52.522044] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-22T17:08:52.699474] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T17:08:53.322142] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-22T17:08:54.010742] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T17:08:54.122112] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-22T17:08:54.782413] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T17:08:54.922110] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-22T17:08:55.215616] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T17:08:55.722118] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-22T17:08:56.522094] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-22T17:08:56.967267] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-22T17:08:56.983921] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-22T17:08:57.323104] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-22T17:08:57.326768] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T17:08:58.122110] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-22T17:08:58.884293] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T17:08:58.922009] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-22T17:08:59.453264] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T17:08:59.722096] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-22T17:09:00.283263] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T17:09:00.307543] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-22T17:09:00.522090] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-22T17:09:01.322102] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-22T17:09:02.122055] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-22T17:09:02.832202] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T17:09:02.876298] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-22T17:09:02.922175] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-22T17:09:03.722062] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-22T17:09:03.897925] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T17:09:04.522072] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-22T17:09:04.706269] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T17:09:04.854182] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-22T17:09:04.870272] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T17:09:04.871406] [INFO ] [REMOTE ] AIZN: Full fetch complete (5715 records). [2025-09-22T17:09:04.871498] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-22T17:09:05.241905] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-22T17:09:05.242007] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-22T17:09:05.242277] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-22T17:09:05.242390] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-22T17:09:05.243135] [DEBUG] [LOCAL ] AIZN: Trimmed 5715 records to 3925 (keeping 200 days of data) [2025-09-22T17:09:05.271672] [DEBUG] [LOCAL ] AIZN: Primary data saved (3925 records). [2025-09-22T17:09:05.271807] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-22T17:09:05.271964] [INFO ] [MAIN ] Update Progress: 73/2372 symbols completed. AIZN took 35.9s. Estimated remaining: 4h 44m 12s. Rate: 8.1 symbols/min [2025-09-22T17:09:05.327330] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-22T17:09:05.447623] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:09:05.515634] [DEBUG] [LOCAL ] AL: Loaded 44621 existing records from primary storage. [2025-09-22T17:09:05.515838] [INFO ] [MAIN ] AL: Loaded 44621 existing records. [2025-09-22T17:09:05.696810] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:09:05.697110] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-22T17:09:05.697159] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-22T17:09:05.698320] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-22T17:09:05.698400] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-22T17:09:06.060188] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:09:06.122059] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-22T17:09:06.922071] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-22T17:09:07.363153] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T17:09:07.692018] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T17:09:07.722072] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-22T17:09:08.522092] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-22T17:09:08.993057] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T17:09:09.001819] [INFO ] [REMOTE ] AJG: Full fetch complete (69774 records). [2025-09-22T17:09:09.002022] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-22T17:09:09.327212] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-22T17:09:09.413630] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-22T17:09:09.413766] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-22T17:09:09.414442] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-22T17:09:09.414497] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-22T17:09:09.416060] [DEBUG] [LOCAL ] AJG: Trimmed 69774 records to 47141 (keeping 200 days of data) [2025-09-22T17:09:09.669632] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-22T17:09:09.769879] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T17:09:09.788681] [DEBUG] [LOCAL ] AJG: Primary data saved (47141 records). [2025-09-22T17:09:09.788824] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-22T17:09:09.790095] [INFO ] [MAIN ] Update Progress: 74/2372 symbols completed. AJG took 31.6s. Estimated remaining: 4h 42m 35s. Rate: 8.1 symbols/min [2025-09-22T17:09:09.968050] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:09:10.031295] [DEBUG] [LOCAL ] ALB: Loaded 54006 existing records from primary storage. [2025-09-22T17:09:10.031443] [INFO ] [MAIN ] ALB: Loaded 54006 existing records. [2025-09-22T17:09:10.130294] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-22T17:09:10.215039] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:09:10.215322] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-22T17:09:10.215387] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-22T17:09:10.216633] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-22T17:09:10.216725] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-22T17:09:10.502396] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-22T17:09:10.595034] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:09:10.922054] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-22T17:09:11.386733] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-22T17:09:11.387465] [INFO ] [REMOTE ] AKA: Full fetch complete (2438 records). [2025-09-22T17:09:11.387533] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-22T17:09:11.569305] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T17:09:11.569520] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:09:11.569581] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:09:11.569681] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-22T17:09:11.569770] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-22T17:09:11.569839] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-22T17:09:11.569908] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-22T17:09:11.569970] [INFO ] [MAIN ] Update Progress: 75/2372 symbols completed. AKA took 31.4s. Estimated remaining: 4h 39m 36s. Rate: 8.2 symbols/min [2025-09-22T17:09:11.747196] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:09:11.743354] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-22T17:09:11.780041] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (4.86 seconds). [2025-09-22T17:09:11.850534] [DEBUG] [LOCAL ] ALC: Loaded 51559 existing records from primary storage. [2025-09-22T17:09:11.850708] [INFO ] [MAIN ] ALC: Loaded 51559 existing records. [2025-09-22T17:09:12.039565] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:09:12.041081] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-22T17:09:12.041147] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-22T17:09:12.043809] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-22T17:09:12.043876] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-22T17:09:12.424388] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:09:12.522110] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-22T17:09:13.322049] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-22T17:09:13.498560] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T17:09:14.122030] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-22T17:09:14.263382] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T17:09:14.484123] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T17:09:14.922101] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-22T17:09:15.203232] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T17:09:15.722091] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-22T17:09:16.510516] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T17:09:16.522008] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-22T17:09:17.054614] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T17:09:17.322076] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-22T17:09:18.042453] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T17:09:18.122066] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-22T17:09:18.922031] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-22T17:09:18.996819] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T17:09:19.722051] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-22T17:09:20.184397] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-22T17:09:20.522056] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-22T17:09:21.322035] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-22T17:09:21.356129] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-22T17:09:21.448728] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T17:09:22.110560] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T17:09:22.122065] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-22T17:09:22.922114] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-22T17:09:23.086598] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T17:09:23.722043] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-22T17:09:23.850122] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T17:09:24.266117] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T17:09:24.522085] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-22T17:09:25.322084] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-22T17:09:25.450782] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T17:09:25.714295] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T17:09:26.122151] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-22T17:09:26.922023] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-22T17:09:26.989772] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T17:09:27.382191] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T17:09:27.390474] [INFO ] [REMOTE ] AKR: Full fetch complete (65290 records). [2025-09-22T17:09:27.390614] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-22T17:09:27.727392] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-22T17:09:27.790123] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-22T17:09:27.790257] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-22T17:09:27.792272] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-22T17:09:27.792350] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-22T17:09:27.794611] [DEBUG] [LOCAL ] AKR: Trimmed 65290 records to 45691 (keeping 200 days of data) [2025-09-22T17:09:28.108519] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-22T17:09:28.127580] [DEBUG] [LOCAL ] AKR: Primary data saved (45691 records). [2025-09-22T17:09:28.127834] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-22T17:09:28.127971] [INFO ] [MAIN ] Update Progress: 76/2372 symbols completed. AKR took 36.4s. Estimated remaining: 4h 44m 8s. Rate: 8.1 symbols/min [2025-09-22T17:09:28.325262] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:09:28.364929] [DEBUG] [LOCAL ] ALE: Loaded 30622 existing records from primary storage. [2025-09-22T17:09:28.365170] [INFO ] [MAIN ] ALE: Loaded 30622 existing records. [2025-09-22T17:09:28.527292] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-22T17:09:28.576007] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:09:28.576413] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-22T17:09:28.576474] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-22T17:09:28.577353] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-22T17:09:28.577417] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-22T17:09:28.980618] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:09:29.314346] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T17:09:29.324550] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-22T17:09:29.934940] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T17:09:30.122055] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-22T17:09:30.353211] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T17:09:30.922106] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-22T17:09:31.349235] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T17:09:31.722056] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-22T17:09:32.257528] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-22T17:09:32.522101] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-22T17:09:33.322017] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-22T17:09:33.449817] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T17:09:33.812759] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T17:09:34.122058] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-22T17:09:34.796885] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T17:09:34.922091] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-22T17:09:35.670989] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T17:09:35.678982] [INFO ] [REMOTE ] AL: Full fetch complete (62029 records). [2025-09-22T17:09:35.679094] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-22T17:09:35.727222] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-22T17:09:36.064076] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-22T17:09:36.064156] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-22T17:09:36.064767] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-22T17:09:36.064848] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-22T17:09:36.066264] [DEBUG] [LOCAL ] AL: Trimmed 62029 records to 44012 (keeping 200 days of data) [2025-09-22T17:09:36.344063] [DEBUG] [LOCAL ] AL: Primary data saved (44012 records). [2025-09-22T17:09:36.344252] [INFO ] [MAIN ] AL: Full history saved. [2025-09-22T17:09:36.344351] [INFO ] [MAIN ] Update Progress: 77/2372 symbols completed. AL took 31.1s. Estimated remaining: 4h 44m 24s. Rate: 8.1 symbols/min [2025-09-22T17:09:36.522149] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-22T17:09:37.359748] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-22T17:09:37.373388] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-22T17:09:37.662170] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-22T17:09:38.122073] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-22T17:09:38.837368] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T17:09:38.922539] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-22T17:09:38.923048] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T17:09:39.508846] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-09-22T17:09:39.722110] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-22T17:09:40.522103] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-22T17:09:40.558011] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T17:09:40.566128] [INFO ] [REMOTE ] ALC: Full fetch complete (72500 records). [2025-09-22T17:09:40.566273] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-22T17:09:41.048460] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-22T17:09:41.048587] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-22T17:09:41.049455] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-22T17:09:41.049537] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-22T17:09:41.051470] [DEBUG] [LOCAL ] ALC: Trimmed 72500 records to 50771 (keeping 200 days of data) [2025-09-22T17:09:41.421810] [DEBUG] [LOCAL ] ALC: Primary data saved (50771 records). [2025-09-22T17:09:41.421961] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-22T17:09:41.422048] [INFO ] [MAIN ] Update Progress: 78/2372 symbols completed. ALC took 29.9s. Estimated remaining: 4h 43m 8s. Rate: 8.1 symbols/min [2025-09-22T17:09:41.588306] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-22T17:09:41.614422] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T17:09:41.622205] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-22T17:09:42.122129] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-22T17:09:42.981403] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T17:09:42.990246] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-22T17:09:43.817248] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T17:09:43.826816] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-22T17:09:43.864799] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-22T17:09:43.874278] [INFO ] [REMOTE ] ALB: Full fetch complete (76760 records). [2025-09-22T17:09:43.874478] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-22T17:09:44.270471] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-22T17:09:44.270562] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-22T17:09:44.271310] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-22T17:09:44.271382] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-22T17:09:44.273033] [DEBUG] [LOCAL ] ALB: Trimmed 76760 records to 53228 (keeping 200 days of data) [2025-09-22T17:09:44.614873] [DEBUG] [LOCAL ] ALB: Primary data saved (53228 records). [2025-09-22T17:09:44.615063] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-22T17:09:44.616189] [INFO ] [MAIN ] Update Progress: 79/2372 symbols completed. ALB took 34.8s. Estimated remaining: 4h 40m 58s. Rate: 8.2 symbols/min [2025-09-22T17:09:45.405969] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T17:09:45.413915] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-22T17:09:47.024012] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T17:09:47.031948] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-22T17:09:48.141256] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T17:09:48.147254] [INFO ] [REMOTE ] ALE: Full fetch complete (42143 records). [2025-09-22T17:09:48.147368] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-22T17:09:48.526038] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-22T17:09:48.526142] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-22T17:09:48.526752] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-22T17:09:48.526823] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-22T17:09:48.528066] [DEBUG] [LOCAL ] ALE: Trimmed 42143 records to 30184 (keeping 200 days of data) [2025-09-22T17:09:48.713196] [DEBUG] [LOCAL ] ALE: Primary data saved (30184 records). [2025-09-22T17:09:48.713347] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-22T17:09:48.713434] [INFO ] [MAIN ] Update Progress: 80/2372 symbols completed. ALE took 20.6s. Estimated remaining: 4h 39m 17s. Rate: 8.2 symbols/min [2025-09-22T17:09:49.318361] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:09:49.420467] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:09:49.541880] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:09:49.537777] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:09:49.546709] [DEBUG] [LOCAL ] ALG: Loaded 10840 existing records from primary storage. [2025-09-22T17:09:49.547260] [INFO ] [MAIN ] ALG: Loaded 10840 existing records. [2025-09-22T17:09:49.791029] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:09:49.802949] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-22T17:09:49.802758] [DEBUG] [LOCAL ] ALEX: Loaded 32090 existing records from primary storage. [2025-09-22T17:09:49.803669] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-22T17:09:49.803868] [INFO ] [MAIN ] ALEX: Loaded 32090 existing records. [2025-09-22T17:09:49.817441] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-22T17:09:49.830346] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-22T17:09:49.858323] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-22T17:09:49.934947] [INFO ] [MAIN ] ALK: Loaded 53840 existing records. [2025-09-22T17:09:50.169119] [DEBUG] [LOCAL ] ALIT: Loaded 53499 existing records from primary storage. [2025-09-22T17:09:50.174526] [INFO ] [MAIN ] ALIT: Loaded 53499 existing records. [2025-09-22T17:09:50.332587] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:09:50.575122] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-22T17:09:50.621530] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:09:50.652349] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-22T17:09:50.679588] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-22T17:09:50.680129] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-22T17:09:50.685360] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-22T17:09:50.701800] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-22T17:09:50.718352] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:09:50.799092] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-22T17:09:50.819163] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-22T17:09:50.829863] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-22T17:09:50.865061] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-22T17:09:50.845880] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-22T17:09:50.879490] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-22T17:09:51.151954] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:09:51.180764] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-22T17:09:51.731329] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:09:51.813810] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-22T17:09:51.993076] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:09:52.032578] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-22T17:09:52.067431] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:09:52.068408] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-22T17:09:52.077484] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T17:09:52.080807] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-22T17:09:52.983736] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-22T17:09:52.987977] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-22T17:09:53.017472] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T17:09:53.025508] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-22T17:09:53.528303] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T17:09:53.538982] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-22T17:09:53.567264] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-22T17:09:53.570683] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-22T17:09:53.627629] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T17:09:53.638186] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-22T17:09:54.263878] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T17:09:54.270184] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-22T17:09:54.532281] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T17:09:54.891387] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T17:09:54.922025] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-22T17:09:55.040680] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T17:09:55.169609] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T17:09:55.722079] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-22T17:09:55.791704] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T17:09:56.522088] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-22T17:09:57.072205] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T17:09:57.322062] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-22T17:09:57.726110] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T17:09:58.019795] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T17:09:58.122061] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-22T17:09:58.692728] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T17:09:58.922108] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-22T17:09:59.586557] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T17:09:59.722138] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-22T17:10:00.522084] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-22T17:10:01.322100] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-22T17:10:01.434963] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T17:10:01.631424] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T17:10:01.808342] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T17:10:02.122099] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-22T17:10:02.922066] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-22T17:10:03.475691] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T17:10:03.652625] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T17:10:03.654634] [INFO ] [REMOTE ] ALG: Full fetch complete (15840 records). [2025-09-22T17:10:03.654792] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-22T17:10:03.727223] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-22T17:10:04.075559] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-22T17:10:04.075768] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-22T17:10:04.076107] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-22T17:10:04.076153] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-22T17:10:04.077090] [DEBUG] [LOCAL ] ALG: Trimmed 15840 records to 10523 (keeping 200 days of data) [2025-09-22T17:10:04.146043] [DEBUG] [LOCAL ] ALG: Primary data saved (10523 records). [2025-09-22T17:10:04.146182] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-22T17:10:04.146285] [INFO ] [MAIN ] Update Progress: 81/2372 symbols completed. ALG took 15.4s. Estimated remaining: 4h 42m 60s. Rate: 8.1 symbols/min [2025-09-22T17:10:04.324099] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:10:04.377890] [DEBUG] [LOCAL ] ALL: Loaded 50961 existing records from primary storage. [2025-09-22T17:10:04.378071] [INFO ] [MAIN ] ALL: Loaded 50961 existing records. [2025-09-22T17:10:04.527210] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-22T17:10:04.567620] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:10:04.567880] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-22T17:10:04.567931] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-22T17:10:04.569771] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-22T17:10:04.569835] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-22T17:10:04.951347] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:10:05.322082] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-22T17:10:05.489787] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T17:10:06.122073] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-22T17:10:06.277361] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T17:10:06.808963] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T17:10:06.922046] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-22T17:10:07.722067] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-22T17:10:08.079126] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T17:10:08.522509] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-22T17:10:08.527633] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T17:10:09.012718] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T17:10:09.322040] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-22T17:10:09.757993] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T17:10:10.122053] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-22T17:10:10.915144] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T17:10:10.926365] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-22T17:10:11.378874] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T17:10:11.722057] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-22T17:10:12.522083] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-22T17:10:12.556823] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T17:10:13.322177] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-22T17:10:13.633969] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-22T17:10:13.773494] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T17:10:14.122081] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-22T17:10:14.723557] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T17:10:14.922098] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-22T17:10:15.683116] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T17:10:15.722042] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-22T17:10:16.522110] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-22T17:10:16.634509] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T17:10:17.322041] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-22T17:10:17.375669] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T17:10:18.122107] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-22T17:10:18.270266] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T17:10:18.922022] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-22T17:10:19.097474] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T17:10:19.106891] [INFO ] [REMOTE ] ALIT: Full fetch complete (76416 records). [2025-09-22T17:10:19.107062] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-22T17:10:19.548239] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-22T17:10:19.548576] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-22T17:10:19.549479] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-22T17:10:19.549575] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-22T17:10:19.571501] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T17:10:19.579186] [DEBUG] [LOCAL ] ALIT: Trimmed 76416 records to 52759 (keeping 200 days of data) [2025-09-22T17:10:19.766415] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-22T17:10:19.920785] [DEBUG] [LOCAL ] ALIT: Primary data saved (52759 records). [2025-09-22T17:10:19.921030] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-22T17:10:19.922141] [INFO ] [MAIN ] Update Progress: 82/2372 symbols completed. ALIT took 31.2s. Estimated remaining: 4h 46m 46s. Rate: 8.0 symbols/min [2025-09-22T17:10:20.109004] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:10:20.166536] [DEBUG] [LOCAL ] ALLE: Loaded 46000 existing records from primary storage. [2025-09-22T17:10:20.166874] [INFO ] [MAIN ] ALLE: Loaded 46000 existing records. [2025-09-22T17:10:20.413045] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:10:20.413846] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-22T17:10:20.414170] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-22T17:10:20.423926] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-22T17:10:20.443524] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-22T17:10:20.481456] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T17:10:20.524315] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-22T17:10:20.870938] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T17:10:20.879928] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:10:21.322051] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-22T17:10:22.122067] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-22T17:10:22.271295] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T17:10:22.769775] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T17:10:22.922114] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-22T17:10:23.093133] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T17:10:23.098618] [INFO ] [REMOTE ] ALEX: Full fetch complete (44545 records). [2025-09-22T17:10:23.098767] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-22T17:10:23.514623] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-22T17:10:23.514777] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-22T17:10:23.515368] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-22T17:10:23.515438] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-22T17:10:23.516681] [DEBUG] [LOCAL ] ALEX: Trimmed 44545 records to 31417 (keeping 200 days of data) [2025-09-22T17:10:23.719882] [DEBUG] [LOCAL ] ALEX: Primary data saved (31417 records). [2025-09-22T17:10:23.720054] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-22T17:10:23.720194] [INFO ] [MAIN ] Update Progress: 83/2372 symbols completed. ALEX took 35.0s. Estimated remaining: 4h 44m 56s. Rate: 8.0 symbols/min [2025-09-22T17:10:23.732218] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-22T17:10:23.906935] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:10:23.961670] [DEBUG] [LOCAL ] ALLY: Loaded 53994 existing records from primary storage. [2025-09-22T17:10:23.961839] [INFO ] [MAIN ] ALLY: Loaded 53994 existing records. [2025-09-22T17:10:24.168998] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:10:24.169458] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-22T17:10:24.169528] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-22T17:10:24.171413] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-22T17:10:24.171478] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-22T17:10:24.525031] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-22T17:10:24.574045] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:10:24.598630] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T17:10:24.607583] [INFO ] [REMOTE ] ALK: Full fetch complete (76802 records). [2025-09-22T17:10:24.607793] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-22T17:10:25.019815] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-22T17:10:25.019909] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-22T17:10:25.020620] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-22T17:10:25.020704] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-22T17:10:25.025448] [DEBUG] [LOCAL ] ALK: Trimmed 76802 records to 53078 (keeping 200 days of data) [2025-09-22T17:10:25.271962] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T17:10:25.345211] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-22T17:10:25.390855] [DEBUG] [LOCAL ] ALK: Primary data saved (53078 records). [2025-09-22T17:10:25.391008] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-22T17:10:25.391113] [INFO ] [MAIN ] Update Progress: 84/2372 symbols completed. ALK took 36.7s. Estimated remaining: 4h 42m 10s. Rate: 8.1 symbols/min [2025-09-22T17:10:25.576366] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:10:25.624142] [DEBUG] [LOCAL ] ALSN: Loaded 44026 existing records from primary storage. [2025-09-22T17:10:25.624295] [INFO ] [MAIN ] ALSN: Loaded 44026 existing records. [2025-09-22T17:10:25.849188] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:10:25.849545] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-22T17:10:25.849605] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-22T17:10:25.851404] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-22T17:10:25.851487] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-22T17:10:26.127399] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-22T17:10:26.279165] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:10:26.368545] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T17:10:26.922044] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-22T17:10:26.954458] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T17:10:27.676934] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T17:10:27.722013] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-22T17:10:28.454055] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T17:10:28.522082] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-22T17:10:28.976480] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-22T17:10:29.322071] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-22T17:10:30.122068] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-22T17:10:30.252410] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T17:10:30.260347] [INFO ] [REMOTE ] ALL: Full fetch complete (72520 records). [2025-09-22T17:10:30.260492] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-22T17:10:30.675679] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-22T17:10:30.675791] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-22T17:10:30.676703] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-22T17:10:30.676822] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-22T17:10:30.678578] [DEBUG] [LOCAL ] ALL: Trimmed 72520 records to 50217 (keeping 200 days of data) [2025-09-22T17:10:30.809382] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T17:10:30.939356] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-22T17:10:31.051883] [DEBUG] [LOCAL ] ALL: Primary data saved (50217 records). [2025-09-22T17:10:31.052114] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-22T17:10:31.052231] [INFO ] [MAIN ] Update Progress: 85/2372 symbols completed. ALL took 26.9s. Estimated remaining: 4h 41m 16s. Rate: 8.1 symbols/min [2025-09-22T17:10:31.237036] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:10:31.265487] [DEBUG] [LOCAL ] ALTG: Loaded 24604 existing records from primary storage. [2025-09-22T17:10:31.265775] [INFO ] [MAIN ] ALTG: Loaded 24604 existing records. [2025-09-22T17:10:31.478706] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:10:31.479170] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-22T17:10:31.479229] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-22T17:10:31.480205] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-22T17:10:31.480271] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-22T17:10:31.728604] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-22T17:10:31.742997] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T17:10:31.914956] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:10:32.486358] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T17:10:32.522006] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-22T17:10:33.213025] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T17:10:33.322009] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-22T17:10:33.909215] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T17:10:34.122044] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-22T17:10:34.556777] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T17:10:34.922067] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-22T17:10:35.660747] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T17:10:35.722059] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-22T17:10:35.988539] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T17:10:36.522090] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-22T17:10:37.305287] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T17:10:37.322015] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-22T17:10:37.695926] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T17:10:38.122087] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-22T17:10:38.892709] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T17:10:38.922000] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-22T17:10:39.395279] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T17:10:39.722125] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-22T17:10:40.384170] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T17:10:40.522059] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-22T17:10:41.158168] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T17:10:41.322062] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-22T17:10:42.122075] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-22T17:10:42.154705] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T17:10:42.757008] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T17:10:42.922053] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-22T17:10:43.453348] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T17:10:43.722090] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-22T17:10:44.126463] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T17:10:44.522101] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-22T17:10:45.016393] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T17:10:45.023945] [INFO ] [REMOTE ] ALLE: Full fetch complete (65122 records). [2025-09-22T17:10:45.024057] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-22T17:10:45.327228] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-22T17:10:45.422692] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-22T17:10:45.422908] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-22T17:10:45.423784] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-22T17:10:45.423850] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-22T17:10:45.428703] [DEBUG] [LOCAL ] ALLE: Trimmed 65122 records to 45317 (keeping 200 days of data) [2025-09-22T17:10:45.727994] [DEBUG] [LOCAL ] ALLE: Primary data saved (45317 records). [2025-09-22T17:10:45.728124] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-22T17:10:45.729689] [INFO ] [MAIN ] Update Progress: 86/2372 symbols completed. ALLE took 25.8s. Estimated remaining: 4h 44m 23s. Rate: 8.0 symbols/min [2025-09-22T17:10:45.911141] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:10:45.925547] [DEBUG] [LOCAL ] ALUR: Loaded 11223 existing records from primary storage. [2025-09-22T17:10:45.925703] [INFO ] [MAIN ] ALUR: Loaded 11223 existing records. [2025-09-22T17:10:46.129929] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-22T17:10:46.159974] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:10:46.164377] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T17:10:46.164702] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-22T17:10:46.174079] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-22T17:10:46.175413] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-22T17:10:46.175488] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-22T17:10:46.571106] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:10:46.824265] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T17:10:46.865619] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T17:10:46.922095] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-22T17:10:47.722070] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-22T17:10:48.180746] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T17:10:48.522057] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-22T17:10:49.322085] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-22T17:10:49.367685] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T17:10:49.377755] [INFO ] [REMOTE ] ALLY: Full fetch complete (76870 records). [2025-09-22T17:10:49.378028] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-22T17:10:49.877997] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T17:10:49.891851] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-22T17:10:49.892929] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-22T17:10:49.895777] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-22T17:10:49.895893] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-22T17:10:49.902253] [DEBUG] [LOCAL ] ALLY: Trimmed 76870 records to 53218 (keeping 200 days of data) [2025-09-22T17:10:50.126682] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-22T17:10:50.244877] [DEBUG] [LOCAL ] ALLY: Primary data saved (53218 records). [2025-09-22T17:10:50.245033] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-22T17:10:50.245219] [INFO ] [MAIN ] Update Progress: 87/2372 symbols completed. ALLY took 26.5s. Estimated remaining: 4h 42m 58s. Rate: 8.1 symbols/min [2025-09-22T17:10:50.429288] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:10:50.483879] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T17:10:50.507314] [DEBUG] [LOCAL ] ALV: Loaded 43481 existing records from primary storage. [2025-09-22T17:10:50.507499] [INFO ] [MAIN ] ALV: Loaded 43481 existing records. [2025-09-22T17:10:50.710406] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:10:50.710715] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-22T17:10:50.710772] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-22T17:10:50.712152] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-22T17:10:50.712223] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-22T17:10:50.927234] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-22T17:10:51.083738] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:10:51.490713] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T17:10:51.722118] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-22T17:10:52.153615] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T17:10:52.522070] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-22T17:10:53.218380] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T17:10:53.322078] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-22T17:10:53.710134] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T17:10:54.122124] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-22T17:10:54.352596] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-22T17:10:54.922096] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-22T17:10:55.315678] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T17:10:55.722077] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-22T17:10:55.755265] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T17:10:56.522030] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-22T17:10:56.546191] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T17:10:57.322052] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-22T17:10:57.372457] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T17:10:58.122030] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-22T17:10:58.151320] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T17:10:58.922064] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-22T17:10:59.367074] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T17:10:59.722049] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-22T17:11:00.438520] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-22T17:11:00.522021] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-22T17:11:00.609500] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T17:11:00.616617] [INFO ] [REMOTE ] ALSN: Full fetch complete (62007 records). [2025-09-22T17:11:00.616756] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-22T17:11:01.034982] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-22T17:11:01.035082] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-22T17:11:01.035710] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-22T17:11:01.035801] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-22T17:11:01.037313] [DEBUG] [LOCAL ] ALSN: Trimmed 62007 records to 43348 (keeping 200 days of data) [2025-09-22T17:11:01.310518] [DEBUG] [LOCAL ] ALSN: Primary data saved (43348 records). [2025-09-22T17:11:01.310674] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-22T17:11:01.310792] [INFO ] [MAIN ] Update Progress: 88/2372 symbols completed. ALSN took 35.9s. Estimated remaining: 4h 44m 25s. Rate: 8.0 symbols/min [2025-09-22T17:11:01.332250] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-22T17:11:01.498063] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:11:01.513546] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T17:11:01.524069] [DEBUG] [LOCAL ] ALX: Loaded 5880 existing records from primary storage. [2025-09-22T17:11:01.524170] [INFO ] [MAIN ] ALX: Loaded 5880 existing records. [2025-09-22T17:11:01.712847] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:11:01.713097] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-22T17:11:01.713145] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-22T17:11:01.713613] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-22T17:11:01.713720] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-22T17:11:02.086396] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:11:02.122077] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-22T17:11:02.139864] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T17:11:02.922062] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-22T17:11:03.417753] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-22T17:11:03.495599] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T17:11:03.722050] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-22T17:11:04.454087] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-22T17:11:04.522059] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-22T17:11:05.322068] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-22T17:11:05.515794] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-22T17:11:05.519967] [INFO ] [REMOTE ] ALTG: Full fetch complete (33583 records). [2025-09-22T17:11:05.520048] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-22T17:11:05.892284] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-22T17:11:05.892382] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-22T17:11:05.892818] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-22T17:11:05.892884] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-22T17:11:05.893909] [DEBUG] [LOCAL ] ALTG: Trimmed 33583 records to 24033 (keeping 200 days of data) [2025-09-22T17:11:06.048395] [DEBUG] [LOCAL ] ALTG: Primary data saved (24033 records). [2025-09-22T17:11:06.048968] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-22T17:11:06.049202] [INFO ] [MAIN ] Update Progress: 89/2372 symbols completed. ALTG took 35.0s. Estimated remaining: 4h 43m 7s. Rate: 8.1 symbols/min [2025-09-22T17:11:06.127176] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-22T17:11:06.229818] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:11:06.292509] [DEBUG] [LOCAL ] AM: Loaded 52944 existing records from primary storage. [2025-09-22T17:11:06.292692] [INFO ] [MAIN ] AM: Loaded 52944 existing records. [2025-09-22T17:11:06.471354] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:11:06.471635] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-22T17:11:06.471720] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-22T17:11:06.473452] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-22T17:11:06.473519] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-22T17:11:06.756566] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-22T17:11:06.877985] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:11:06.910916] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T17:11:06.922003] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-22T17:11:07.722070] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-22T17:11:07.844688] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T17:11:08.179975] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T17:11:08.522058] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-22T17:11:09.116094] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T17:11:09.322057] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-22T17:11:09.673900] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T17:11:10.122039] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-22T17:11:10.922065] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-22T17:11:11.286725] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T17:11:11.436282] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-22T17:11:11.722062] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-22T17:11:12.194485] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T17:11:12.522122] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-22T17:11:13.322067] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-22T17:11:13.884490] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T17:11:14.122054] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-22T17:11:14.252382] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T17:11:14.922070] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-22T17:11:15.530551] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T17:11:15.532755] [INFO ] [REMOTE ] ALUR: Full fetch complete (21214 records). [2025-09-22T17:11:15.532829] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-22T17:11:15.727297] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-22T17:11:15.922294] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-22T17:11:15.922406] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-22T17:11:15.922737] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-22T17:11:15.922799] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-22T17:11:15.923369] [DEBUG] [LOCAL ] ALUR: Trimmed 21214 records to 10934 (keeping 200 days of data) [2025-09-22T17:11:15.989662] [DEBUG] [LOCAL ] ALUR: Primary data saved (10934 records). [2025-09-22T17:11:15.989808] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-22T17:11:15.989906] [INFO ] [MAIN ] Update Progress: 90/2372 symbols completed. ALUR took 30.3s. Estimated remaining: 4h 44m 3s. Rate: 8.0 symbols/min [2025-09-22T17:11:16.164137] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:11:16.199285] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-22T17:11:16.255375] [DEBUG] [LOCAL ] AMBC: Loaded 38086 existing records from primary storage. [2025-09-22T17:11:16.255527] [INFO ] [MAIN ] AMBC: Loaded 38086 existing records. [2025-09-22T17:11:16.451098] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:11:16.451392] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-22T17:11:16.451442] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-22T17:11:16.452773] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-22T17:11:16.452837] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-22T17:11:16.527240] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-22T17:11:16.812906] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:11:17.322089] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-22T17:11:17.642155] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T17:11:18.131623] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-22T17:11:18.137552] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T17:11:18.374482] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T17:11:18.922086] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-22T17:11:19.010838] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T17:11:19.722090] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-22T17:11:20.369290] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T17:11:20.522083] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-22T17:11:21.140983] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T17:11:21.301974] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T17:11:21.322035] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-22T17:11:22.122079] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-22T17:11:22.523495] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T17:11:22.922060] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-22T17:11:23.509711] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T17:11:23.722046] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-22T17:11:24.235361] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T17:11:24.522042] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-22T17:11:25.322057] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-22T17:11:25.623372] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T17:11:25.678885] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-22T17:11:26.123575] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-22T17:11:26.126530] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T17:11:26.922108] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-22T17:11:27.477985] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T17:11:27.480116] [INFO ] [REMOTE ] ALX: Full fetch complete (6761 records). [2025-09-22T17:11:27.480342] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-22T17:11:27.726700] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-22T17:11:27.833335] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T17:11:27.928940] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-22T17:11:27.929030] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-22T17:11:27.929243] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-22T17:11:27.929291] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-22T17:11:27.929826] [DEBUG] [LOCAL ] ALX: Trimmed 6761 records to 5896 (keeping 200 days of data) [2025-09-22T17:11:27.976560] [DEBUG] [LOCAL ] ALX: Primary data saved (5896 records). [2025-09-22T17:11:27.976782] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-22T17:11:27.976908] [INFO ] [MAIN ] Update Progress: 91/2372 symbols completed. ALX took 26.7s. Estimated remaining: 4h 45m 49s. Rate: 8.0 symbols/min [2025-09-22T17:11:28.159361] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:11:28.211088] [DEBUG] [LOCAL ] AMBP: Loaded 46014 existing records from primary storage. [2025-09-22T17:11:28.211246] [INFO ] [MAIN ] AMBP: Loaded 46014 existing records. [2025-09-22T17:11:28.397882] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:11:28.398154] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-22T17:11:28.398215] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-22T17:11:28.399528] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-22T17:11:28.399589] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-22T17:11:28.527136] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-22T17:11:28.779018] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:11:29.014072] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T17:11:29.322070] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-22T17:11:29.595392] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T17:11:30.122058] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-22T17:11:30.662419] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T17:11:30.922098] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-22T17:11:31.281873] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T17:11:31.722122] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-22T17:11:32.322910] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T17:11:32.522064] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-22T17:11:33.322042] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-22T17:11:33.390986] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T17:11:33.752979] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T17:11:34.122063] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-22T17:11:34.749711] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T17:11:34.922080] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-22T17:11:35.272994] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T17:11:35.722126] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-22T17:11:36.335576] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T17:11:36.522083] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-22T17:11:36.797872] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T17:11:37.322101] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-22T17:11:38.122167] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-22T17:11:38.299744] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T17:11:38.308184] [INFO ] [REMOTE ] AM: Full fetch complete (75617 records). [2025-09-22T17:11:38.308382] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-22T17:11:38.724083] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-22T17:11:38.724204] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-22T17:11:38.725002] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-22T17:11:38.725192] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-22T17:11:38.747398] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T17:11:38.747563] [DEBUG] [LOCAL ] AM: Trimmed 75617 records to 52159 (keeping 200 days of data) [2025-09-22T17:11:38.756490] [INFO ] [REMOTE ] ALV: Full fetch complete (61932 records). [2025-09-22T17:11:38.756724] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-22T17:11:38.925914] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-22T17:11:39.331600] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-22T17:11:39.333450] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-22T17:11:39.334789] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-22T17:11:39.334994] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-22T17:11:39.352015] [DEBUG] [LOCAL ] ALV: Trimmed 61932 records to 42725 (keeping 200 days of data) [2025-09-22T17:11:39.461629] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T17:11:39.749524] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-22T17:11:39.816497] [DEBUG] [LOCAL ] AM: Primary data saved (52159 records). [2025-09-22T17:11:39.817169] [INFO ] [MAIN ] AM: Full history saved. [2025-09-22T17:11:39.817306] [INFO ] [MAIN ] Update Progress: 92/2372 symbols completed. AM took 33.8s. Estimated remaining: 4h 47m 29s. Rate: 7.9 symbols/min [2025-09-22T17:11:40.010385] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:11:40.011581] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-22T17:11:40.012783] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-22T17:11:40.014236] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-22T17:11:40.014964] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-22T17:11:40.016252] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-22T17:11:40.016804] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-22T17:11:40.238808] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T17:11:40.449510] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:11:40.453434] [DEBUG] [LOCAL ] ALV: Primary data saved (42725 records). [2025-09-22T17:11:40.453504] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-22T17:11:40.453575] [INFO ] [MAIN ] Update Progress: 93/2372 symbols completed. ALV took 50.2s. Estimated remaining: 4h 44m 31s. Rate: 8.0 symbols/min [2025-09-22T17:11:40.527790] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-22T17:11:40.624882] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:11:40.679917] [DEBUG] [LOCAL ] AMC: Loaded 54537 existing records from primary storage. [2025-09-22T17:11:40.680078] [INFO ] [MAIN ] AMC: Loaded 54537 existing records. [2025-09-22T17:11:40.803953] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:11:40.832793] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-22T17:11:40.864390] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:11:40.864620] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-22T17:11:40.864706] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-22T17:11:40.866612] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-22T17:11:40.866709] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-22T17:11:41.229848] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:11:41.322050] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-22T17:11:41.496681] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T17:11:41.549078] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:11:41.549381] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-22T17:11:42.122057] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-22T17:11:42.922117] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-22T17:11:43.722047] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-22T17:11:43.876441] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T17:11:43.881599] [INFO ] [REMOTE ] AMBC: Full fetch complete (50987 records). [2025-09-22T17:11:43.881729] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-22T17:11:43.974941] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:11:43.985860] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-22T17:11:44.385484] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-22T17:11:44.385783] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-22T17:11:44.386492] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-22T17:11:44.386597] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-22T17:11:44.388710] [DEBUG] [LOCAL ] AMBC: Trimmed 50987 records to 37269 (keeping 200 days of data) [2025-09-22T17:11:44.515054] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-22T17:11:44.526581] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-22T17:11:44.668178] [DEBUG] [LOCAL ] AMBC: Primary data saved (37269 records). [2025-09-22T17:11:44.668503] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-22T17:11:44.669502] [INFO ] [MAIN ] Update Progress: 94/2372 symbols completed. AMBC took 28.7s. Estimated remaining: 4h 43m 4s. Rate: 8.0 symbols/min [2025-09-22T17:11:44.849201] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:11:44.936955] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-22T17:11:44.937170] [INFO ] [MAIN ] AMCR: Loaded 54449 existing records. [2025-09-22T17:11:45.127017] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:11:45.127362] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-22T17:11:45.127417] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-22T17:11:45.129485] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-22T17:11:45.129569] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-22T17:11:45.333748] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-22T17:11:45.530307] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:11:45.649547] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:11:45.650020] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-22T17:11:45.907168] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T17:11:46.122074] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-22T17:11:46.922125] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-22T17:11:47.722111] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-22T17:11:47.798519] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T17:11:48.370880] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T17:11:48.522093] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-22T17:11:49.322124] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-22T17:11:49.692212] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-22T17:11:49.732417] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-22T17:11:50.122056] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-22T17:11:50.699032] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T17:11:50.922057] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-22T17:11:51.135206] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:11:51.135553] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-22T17:11:51.722047] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-22T17:11:51.933005] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:11:51.933323] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-22T17:11:52.128818] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-22T17:11:52.522070] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-22T17:11:52.739731] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:11:52.740078] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-22T17:11:53.322056] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-22T17:11:53.803353] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-22T17:11:54.122060] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-22T17:11:54.922108] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-22T17:11:55.722073] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-22T17:11:56.309575] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T17:11:56.522033] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-22T17:11:56.618808] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-22T17:11:57.004456] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T17:11:57.322061] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-22T17:11:57.892956] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T17:11:57.898622] [INFO ] [REMOTE ] AMBQ: Full fetch complete (7644 records). [2025-09-22T17:11:57.898817] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-22T17:11:58.086567] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 38 unique days, need 200 days [2025-09-22T17:11:58.086822] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:11:58.086891] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:11:58.086962] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-22T17:11:58.087027] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-22T17:11:58.087062] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-22T17:11:58.087099] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-22T17:11:58.087169] [INFO ] [MAIN ] Update Progress: 95/2372 symbols completed. AMBQ took 18.3s. Estimated remaining: 4h 45m 20s. Rate: 8.0 symbols/min [2025-09-22T17:11:58.131424] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-22T17:11:58.271158] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:11:58.323269] [DEBUG] [LOCAL ] AME: Loaded 49312 existing records from primary storage. [2025-09-22T17:11:58.323449] [INFO ] [MAIN ] AME: Loaded 49312 existing records. [2025-09-22T17:11:58.508495] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:11:58.508769] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-22T17:11:58.508824] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-22T17:11:58.510637] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-22T17:11:58.510721] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-22T17:11:58.888332] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:11:58.922018] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-22T17:11:59.558471] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T17:11:59.722033] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-22T17:11:59.793143] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-22T17:12:00.309428] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:12:00.522071] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-22T17:12:01.002571] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T17:12:01.322074] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-22T17:12:02.122102] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-22T17:12:02.922065] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-22T17:12:03.246155] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-22T17:12:03.722147] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-22T17:12:05.061410] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (3.74 seconds). [2025-09-22T17:12:05.073002] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-22T17:12:05.177947] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-09-22T17:12:05.188686] [INFO ] [REMOTE ] AMBP: Full fetch complete (66100 records). [2025-09-22T17:12:05.189028] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-22T17:12:05.613261] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-22T17:12:05.613532] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-22T17:12:05.614363] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-22T17:12:05.614600] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-22T17:12:05.617397] [DEBUG] [LOCAL ] AMBP: Trimmed 66100 records to 45371 (keeping 200 days of data) [2025-09-22T17:12:05.737742] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-09-22T17:12:05.786063] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-22T17:12:05.801074] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-22T17:12:05.954128] [DEBUG] [LOCAL ] AMBP: Primary data saved (45371 records). [2025-09-22T17:12:05.954313] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-22T17:12:05.954408] [INFO ] [MAIN ] Update Progress: 96/2372 symbols completed. AMBP took 38.0s. Estimated remaining: 4h 45m 21s. Rate: 8.0 symbols/min [2025-09-22T17:12:06.129254] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-22T17:12:06.133413] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:12:06.134384] [DEBUG] [LOCAL ] AMG: No existing data file found in primary storage. [2025-09-22T17:12:06.134429] [WARN ] [MAIN ] AMG: No existing data found, performing full refresh instead. [2025-09-22T17:12:06.134625] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-22T17:12:06.134711] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-22T17:12:06.134797] [DEBUG] [LOCAL ] AMG: No primary data file found to delete. [2025-09-22T17:12:06.134848] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-22T17:12:06.512526] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:12:06.598665] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T17:12:06.922065] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-22T17:12:07.139281] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T17:12:07.722059] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-22T17:12:08.069383] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T17:12:08.522034] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-22T17:12:08.948153] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-22T17:12:09.322119] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-22T17:12:09.529909] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T17:12:09.975597] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T17:12:10.122058] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-22T17:12:10.922070] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-22T17:12:11.363454] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T17:12:11.534215] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T17:12:11.722084] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-22T17:12:11.815757] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T17:12:12.522116] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-22T17:12:13.134305] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T17:12:13.322087] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-22T17:12:14.098575] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T17:12:14.122022] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-22T17:12:14.922100] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-22T17:12:15.256143] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T17:12:15.652268] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-22T17:12:15.722023] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-22T17:12:15.839620] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T17:12:16.522090] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-22T17:12:17.322070] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-22T17:12:17.701600] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-22T17:12:18.122152] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-22T17:12:18.922085] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-22T17:12:19.273200] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T17:12:19.375172] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-09-22T17:12:19.384704] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-22T17:12:19.384969] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-22T17:12:19.727326] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-22T17:12:19.822540] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-22T17:12:19.822713] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-22T17:12:19.823811] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-22T17:12:19.823921] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-22T17:12:19.826197] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 53668 (keeping 200 days of data) [2025-09-22T17:12:20.185665] [DEBUG] [LOCAL ] AMCR: Primary data saved (53668 records). [2025-09-22T17:12:20.185899] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-22T17:12:20.186842] [INFO ] [MAIN ] Update Progress: 97/2372 symbols completed. AMCR took 35.5s. Estimated remaining: 4h 47m 51s. Rate: 7.9 symbols/min [2025-09-22T17:12:20.377421] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:12:20.451734] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T17:12:20.483469] [DEBUG] [LOCAL ] AMH: Loaded 52456 existing records from primary storage. [2025-09-22T17:12:20.483852] [INFO ] [MAIN ] AMH: Loaded 52456 existing records. [2025-09-22T17:12:20.522219] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-22T17:12:20.736936] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:12:20.737763] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-22T17:12:20.737993] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-22T17:12:20.746201] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-22T17:12:20.755211] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-22T17:12:20.755774] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T17:12:20.900631] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (3.58 seconds). [2025-09-22T17:12:20.951098] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-22T17:12:20.962702] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-22T17:12:21.322137] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-22T17:12:21.433707] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:12:21.649969] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-22T17:12:21.650088] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-22T17:12:21.650890] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-22T17:12:21.650966] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-22T17:12:21.653480] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53758 (keeping 200 days of data) [2025-09-22T17:12:21.999842] [DEBUG] [LOCAL ] AMC: Primary data saved (53758 records). [2025-09-22T17:12:22.000105] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-22T17:12:22.000218] [INFO ] [MAIN ] Update Progress: 98/2372 symbols completed. AMC took 41.5s. Estimated remaining: 4h 45m 29s. Rate: 8.0 symbols/min [2025-09-22T17:12:22.132227] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-22T17:12:22.224594] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:12:22.273947] [DEBUG] [LOCAL ] AMN: Loaded 42768 existing records from primary storage. [2025-09-22T17:12:22.274152] [INFO ] [MAIN ] AMN: Loaded 42768 existing records. [2025-09-22T17:12:22.486091] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:12:22.486700] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-22T17:12:22.486866] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-22T17:12:22.498826] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-22T17:12:22.498934] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-22T17:12:22.613027] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-22T17:12:22.895758] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T17:12:22.940734] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-22T17:12:22.982410] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:12:23.568892] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T17:12:23.722030] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-22T17:12:24.336960] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T17:12:24.522054] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-22T17:12:25.174305] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T17:12:25.322048] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-22T17:12:25.908610] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T17:12:25.920186] [INFO ] [REMOTE ] AME: Full fetch complete (69644 records). [2025-09-22T17:12:25.920378] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-22T17:12:26.128002] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-22T17:12:26.327763] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-22T17:12:26.327846] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-22T17:12:26.328545] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-22T17:12:26.328589] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-22T17:12:26.329992] [DEBUG] [LOCAL ] AME: Trimmed 69644 records to 48548 (keeping 200 days of data) [2025-09-22T17:12:26.721635] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T17:12:26.748840] [DEBUG] [LOCAL ] AME: Primary data saved (48548 records). [2025-09-22T17:12:26.749098] [INFO ] [MAIN ] AME: Full history saved. [2025-09-22T17:12:26.749237] [INFO ] [MAIN ] Update Progress: 99/2372 symbols completed. AME took 28.7s. Estimated remaining: 4h 44m 17s. Rate: 8.0 symbols/min [2025-09-22T17:12:26.934411] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-22T17:12:26.936015] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:12:26.969614] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T17:12:26.996906] [DEBUG] [LOCAL ] AMP: Loaded 33358 existing records from primary storage. [2025-09-22T17:12:26.997070] [INFO ] [MAIN ] AMP: Loaded 33358 existing records. [2025-09-22T17:12:27.183699] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:12:27.183934] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-22T17:12:27.183992] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-22T17:12:27.185552] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-22T17:12:27.185612] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-22T17:12:27.535038] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:12:27.722049] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-22T17:12:28.407383] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T17:12:28.522064] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-22T17:12:28.958368] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T17:12:29.322064] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-22T17:12:29.912419] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T17:12:30.083610] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T17:12:30.122071] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-22T17:12:30.922118] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-22T17:12:31.727320] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-22T17:12:31.748266] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T17:12:32.006537] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T17:12:32.010292] [INFO ] [REMOTE ] AMG: Full fetch complete (29761 records). [2025-09-22T17:12:32.010453] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-22T17:12:32.407071] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-22T17:12:32.407202] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-22T17:12:32.407577] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-22T17:12:32.407620] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-22T17:12:32.408433] [DEBUG] [LOCAL ] AMG: Trimmed 29761 records to 20789 (keeping 200 days of data) [2025-09-22T17:12:32.524789] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-22T17:12:32.547756] [DEBUG] [LOCAL ] AMG: Primary data saved (20789 records). [2025-09-22T17:12:32.547897] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-22T17:12:32.547971] [INFO ] [MAIN ] Update Progress: 100/2372 symbols completed. AMG took 26.6s. Estimated remaining: 4h 43m 31s. Rate: 8.0 symbols/min [2025-09-22T17:12:32.717721] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:12:32.769826] [DEBUG] [LOCAL ] AMPX: Loaded 52848 existing records from primary storage. [2025-09-22T17:12:32.769970] [INFO ] [MAIN ] AMPX: Loaded 52848 existing records. [2025-09-22T17:12:32.948449] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:12:32.948722] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-22T17:12:32.948777] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-22T17:12:32.951462] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-22T17:12:32.951524] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-22T17:12:33.311576] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:12:33.332182] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-22T17:12:33.339192] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T17:12:33.993473] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T17:12:34.122146] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-22T17:12:34.922095] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-22T17:12:35.019785] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T17:12:35.520713] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T17:12:35.722074] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-22T17:12:36.146821] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T17:12:36.522073] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-22T17:12:37.024815] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T17:12:37.322057] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-22T17:12:37.726255] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T17:12:38.122103] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-22T17:12:38.867294] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T17:12:38.877691] [INFO ] [REMOTE ] AMH: Full fetch complete (74680 records). [2025-09-22T17:12:38.877932] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-22T17:12:38.929719] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-22T17:12:39.300245] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-22T17:12:39.300343] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-22T17:12:39.301096] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-22T17:12:39.301165] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-22T17:12:39.302704] [DEBUG] [LOCAL ] AMH: Trimmed 74680 records to 51691 (keeping 200 days of data) [2025-09-22T17:12:39.628090] [DEBUG] [LOCAL ] AMH: Primary data saved (51691 records). [2025-09-22T17:12:39.628256] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-22T17:12:39.630265] [INFO ] [MAIN ] Update Progress: 101/2372 symbols completed. AMH took 19.4s. Estimated remaining: 4h 43m 15s. Rate: 8.0 symbols/min [2025-09-22T17:12:39.723939] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-22T17:12:39.809445] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:12:39.865268] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T17:12:39.891077] [DEBUG] [LOCAL ] AMPY: Loaded 37926 existing records from primary storage. [2025-09-22T17:12:39.891244] [INFO ] [MAIN ] AMPY: Loaded 37926 existing records. [2025-09-22T17:12:40.076422] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:12:40.076884] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-22T17:12:40.077009] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-22T17:12:40.077844] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-22T17:12:40.084788] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-22T17:12:40.201481] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T17:12:40.527602] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-22T17:12:40.599623] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:12:41.203586] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T17:12:41.322088] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-22T17:12:41.811232] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T17:12:42.129033] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-22T17:12:42.131455] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-22T17:12:42.922093] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-22T17:12:43.415244] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T17:12:43.722043] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-22T17:12:44.446688] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T17:12:44.522069] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-22T17:12:45.322061] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-22T17:12:45.430254] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T17:12:45.493808] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T17:12:46.122072] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-22T17:12:46.793790] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T17:12:46.922056] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-22T17:12:47.151226] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T17:12:47.722046] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-22T17:12:48.522122] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-22T17:12:48.736386] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T17:12:49.302325] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T17:12:49.322086] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-22T17:12:49.609919] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T17:12:50.122052] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-22T17:12:50.572233] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T17:12:50.922057] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-22T17:12:51.441935] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T17:12:51.722042] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-22T17:12:51.875449] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T17:12:52.522094] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-22T17:12:53.322064] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-22T17:12:53.489055] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T17:12:54.088686] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T17:12:54.122021] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-22T17:12:54.922149] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-22T17:12:55.050032] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T17:12:55.618320] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T17:12:55.722027] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-22T17:12:56.522053] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-22T17:12:56.702351] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T17:12:57.103055] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T17:12:57.322059] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-22T17:12:57.788857] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T17:12:58.122090] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-22T17:12:58.909747] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T17:12:58.922046] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-22T17:12:59.343683] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T17:12:59.353897] [INFO ] [REMOTE ] AMN: Full fetch complete (60480 records). [2025-09-22T17:12:59.354130] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-22T17:12:59.727188] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-22T17:12:59.785876] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-22T17:12:59.785988] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-22T17:12:59.786882] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-22T17:12:59.786985] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-22T17:12:59.789312] [DEBUG] [LOCAL ] AMN: Trimmed 60480 records to 42032 (keeping 200 days of data) [2025-09-22T17:13:00.080071] [DEBUG] [LOCAL ] AMN: Primary data saved (42032 records). [2025-09-22T17:13:00.080348] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-22T17:13:00.080616] [INFO ] [MAIN ] Update Progress: 102/2372 symbols completed. AMN took 38.1s. Estimated remaining: 4h 47m 56s. Rate: 7.9 symbols/min [2025-09-22T17:13:00.268829] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:13:00.298551] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T17:13:00.346851] [DEBUG] [LOCAL ] AMR: Loaded 29761 existing records from primary storage. [2025-09-22T17:13:00.347058] [INFO ] [MAIN ] AMR: Loaded 29761 existing records. [2025-09-22T17:13:00.531143] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-22T17:13:00.537631] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:13:00.539454] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-22T17:13:00.539517] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-22T17:13:00.540585] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-22T17:13:00.540686] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-22T17:13:00.906442] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:13:01.322072] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-22T17:13:01.560342] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-22T17:13:01.805852] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-22T17:13:02.122084] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-22T17:13:02.152462] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T17:13:02.922149] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-22T17:13:03.722099] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-22T17:13:04.115617] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T17:13:04.284106] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-22T17:13:04.522025] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-22T17:13:04.578960] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T17:13:05.322051] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-22T17:13:06.122089] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-22T17:13:06.330853] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T17:13:06.585323] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-22T17:13:06.593886] [INFO ] [REMOTE ] AMPX: Full fetch complete (74504 records). [2025-09-22T17:13:06.594035] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-22T17:13:06.927272] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-22T17:13:07.018503] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-22T17:13:07.018606] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-22T17:13:07.019676] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-22T17:13:07.019853] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-22T17:13:07.022228] [DEBUG] [LOCAL ] AMPX: Trimmed 74504 records to 52158 (keeping 200 days of data) [2025-09-22T17:13:07.103398] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T17:13:07.361387] [DEBUG] [LOCAL ] AMPX: Primary data saved (52158 records). [2025-09-22T17:13:07.361537] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-22T17:13:07.361665] [INFO ] [MAIN ] Update Progress: 103/2372 symbols completed. AMPX took 34.8s. Estimated remaining: 4h 47m 41s. Rate: 7.9 symbols/min [2025-09-22T17:13:07.542774] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:13:07.585116] [DEBUG] [LOCAL ] AMRC: Loaded 39283 existing records from primary storage. [2025-09-22T17:13:07.585337] [INFO ] [MAIN ] AMRC: Loaded 39283 existing records. [2025-09-22T17:13:07.727237] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-22T17:13:07.796312] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:13:07.796670] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-22T17:13:07.796735] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-22T17:13:07.798131] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-22T17:13:07.798239] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-22T17:13:08.163710] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:13:08.302538] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T17:13:08.522065] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-22T17:13:08.933066] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T17:13:08.940104] [INFO ] [REMOTE ] AMPY: Full fetch complete (50168 records). [2025-09-22T17:13:08.940213] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-22T17:13:09.327191] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-22T17:13:09.344685] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-22T17:13:09.344799] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-22T17:13:09.346437] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-22T17:13:09.346500] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-22T17:13:09.348025] [DEBUG] [LOCAL ] AMPY: Trimmed 50168 records to 37411 (keeping 200 days of data) [2025-09-22T17:13:09.579788] [DEBUG] [LOCAL ] AMPY: Primary data saved (37411 records). [2025-09-22T17:13:09.580496] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-22T17:13:09.581351] [INFO ] [MAIN ] Update Progress: 104/2372 symbols completed. AMPY took 30.0s. Estimated remaining: 4h 45m 36s. Rate: 7.9 symbols/min [2025-09-22T17:13:09.769884] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:13:09.770081] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-22T17:13:09.770136] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-22T17:13:09.770347] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-22T17:13:09.770399] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-22T17:13:09.770443] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-22T17:13:09.770476] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-22T17:13:10.137564] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-22T17:13:10.145981] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:13:10.170111] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T17:13:10.177413] [INFO ] [REMOTE ] AMP: Full fetch complete (47612 records). [2025-09-22T17:13:10.177590] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-22T17:13:10.609795] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-22T17:13:10.610005] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-22T17:13:10.610591] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-22T17:13:10.610727] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-22T17:13:10.618918] [DEBUG] [LOCAL ] AMP: Trimmed 47612 records to 32634 (keeping 200 days of data) [2025-09-22T17:13:10.631714] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T17:13:10.874509] [DEBUG] [LOCAL ] AMP: Primary data saved (32634 records). [2025-09-22T17:13:10.874717] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-22T17:13:10.874893] [INFO ] [MAIN ] Update Progress: 105/2372 symbols completed. AMP took 44.1s. Estimated remaining: 4h 43m 13s. Rate: 8.0 symbols/min [2025-09-22T17:13:10.934475] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-22T17:13:11.068696] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:13:11.137892] [DEBUG] [LOCAL ] AMT: Loaded 53223 existing records from primary storage. [2025-09-22T17:13:11.138111] [INFO ] [MAIN ] AMT: Loaded 53223 existing records. [2025-09-22T17:13:11.293208] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T17:13:11.357059] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:13:11.357349] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-22T17:13:11.357401] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-22T17:13:11.360267] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-22T17:13:11.360333] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-22T17:13:11.729785] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-22T17:13:11.755529] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:13:11.816269] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T17:13:11.962370] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:13:11.962773] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-22T17:13:12.522079] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-22T17:13:12.760673] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:13:12.761100] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-22T17:13:13.322064] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-22T17:13:14.122059] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-22T17:13:14.322540] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:13:14.323005] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-22T17:13:14.654934] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T17:13:14.922104] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-22T17:13:15.722059] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-22T17:13:16.197337] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T17:13:16.522106] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-22T17:13:17.322063] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-22T17:13:17.353580] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T17:13:17.542853] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:13:17.543166] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-22T17:13:17.567971] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T17:13:18.122063] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-22T17:13:18.922058] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-22T17:13:19.070249] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T17:13:19.132795] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:13:19.133114] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-22T17:13:19.722087] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-22T17:13:20.522058] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-22T17:13:20.616763] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T17:13:21.322056] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-22T17:13:21.404182] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T17:13:21.408593] [INFO ] [REMOTE ] AMR: Full fetch complete (39513 records). [2025-09-22T17:13:21.408724] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-22T17:13:21.785292] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-22T17:13:21.785374] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-22T17:13:21.785818] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-22T17:13:21.785879] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-22T17:13:21.786778] [DEBUG] [LOCAL ] AMR: Trimmed 39513 records to 29089 (keeping 200 days of data) [2025-09-22T17:13:21.967142] [DEBUG] [LOCAL ] AMR: Primary data saved (29089 records). [2025-09-22T17:13:21.967320] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-22T17:13:21.967418] [INFO ] [MAIN ] Update Progress: 106/2372 symbols completed. AMR took 21.9s. Estimated remaining: 4h 44m 22s. Rate: 8.0 symbols/min [2025-09-22T17:13:22.143450] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-22T17:13:22.148206] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:13:22.171041] [DEBUG] [LOCAL ] AMTB: Loaded 20984 existing records from primary storage. [2025-09-22T17:13:22.171189] [INFO ] [MAIN ] AMTB: Loaded 20984 existing records. [2025-09-22T17:13:22.373527] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:13:22.373902] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-22T17:13:22.373975] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-22T17:13:22.375023] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-22T17:13:22.375104] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-22T17:13:22.422284] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:13:22.471065] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-22T17:13:22.777370] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:13:22.840550] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T17:13:22.922081] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-22T17:13:23.722088] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-22T17:13:24.522119] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-22T17:13:24.592684] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T17:13:24.643891] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T17:13:25.322062] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-22T17:13:26.018973] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T17:13:26.122009] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-22T17:13:26.371078] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T17:13:26.880738] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T17:13:26.922032] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-22T17:13:27.722066] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-22T17:13:27.922746] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-22T17:13:28.522084] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-22T17:13:29.322027] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-22T17:13:29.656017] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T17:13:29.698864] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T17:13:30.122067] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-22T17:13:30.473287] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T17:13:30.851905] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T17:13:30.922116] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-22T17:13:31.674032] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-22T17:13:31.722002] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-22T17:13:32.522068] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-22T17:13:33.322058] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-22T17:13:33.637611] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T17:13:33.974209] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T17:13:34.122110] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-22T17:13:34.922187] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-22T17:13:35.318110] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T17:13:35.471287] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T17:13:35.722084] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-22T17:13:36.522151] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-22T17:13:36.762930] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T17:13:37.015112] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-22T17:13:37.322088] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-22T17:13:38.122069] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-22T17:13:38.409748] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T17:13:38.781227] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T17:13:38.922045] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-22T17:13:38.976362] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T17:13:39.722020] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-22T17:13:40.387077] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T17:13:40.394981] [INFO ] [REMOTE ] AMRZ: Full fetch complete (24188 records). [2025-09-22T17:13:40.395061] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-22T17:13:40.533937] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-22T17:13:40.581813] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 64 unique days, need 200 days [2025-09-22T17:13:40.582189] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:13:40.582275] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:13:40.582349] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-22T17:13:40.582411] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-22T17:13:40.582458] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-22T17:13:40.582552] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-22T17:13:40.582631] [INFO ] [MAIN ] Update Progress: 107/2372 symbols completed. AMRZ took 31.0s. Estimated remaining: 4h 48m 9s. Rate: 7.9 symbols/min [2025-09-22T17:13:40.754063] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:13:40.759982] [DEBUG] [LOCAL ] AMTD: Loaded 3591 existing records from primary storage. [2025-09-22T17:13:40.760082] [INFO ] [MAIN ] AMTD: Loaded 3591 existing records. [2025-09-22T17:13:40.939072] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:13:40.939477] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-22T17:13:40.939586] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-22T17:13:40.945206] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-22T17:13:40.954079] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-22T17:13:41.000361] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T17:13:41.327208] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-22T17:13:41.372378] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:13:42.031618] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T17:13:42.122103] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-22T17:13:42.208579] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T17:13:42.922066] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-22T17:13:43.248094] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T17:13:43.254260] [INFO ] [REMOTE ] AMRC: Full fetch complete (52237 records). [2025-09-22T17:13:43.254367] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-22T17:13:43.642851] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-22T17:13:43.642975] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-22T17:13:43.643548] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-22T17:13:43.643610] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-22T17:13:43.644976] [DEBUG] [LOCAL ] AMRC: Trimmed 52237 records to 38463 (keeping 200 days of data) [2025-09-22T17:13:43.730879] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-22T17:13:43.873761] [DEBUG] [LOCAL ] AMRC: Primary data saved (38463 records). [2025-09-22T17:13:43.873918] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-22T17:13:43.874005] [INFO ] [MAIN ] Update Progress: 108/2372 symbols completed. AMRC took 36.5s. Estimated remaining: 4h 46m 31s. Rate: 7.9 symbols/min [2025-09-22T17:13:44.050381] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:13:44.101273] [DEBUG] [LOCAL ] AMTM: Loaded 51512 existing records from primary storage. [2025-09-22T17:13:44.101431] [INFO ] [MAIN ] AMTM: Loaded 51512 existing records. [2025-09-22T17:13:44.291944] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:13:44.292281] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-22T17:13:44.292360] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-22T17:13:44.294143] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-22T17:13:44.294219] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-22T17:13:44.407187] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-22T17:13:44.531725] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-22T17:13:44.673888] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:13:44.720251] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-22T17:13:45.322054] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-22T17:13:45.645781] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T17:13:45.648935] [INFO ] [REMOTE ] AMTB: Full fetch complete (30341 records). [2025-09-22T17:13:45.649056] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-22T17:13:46.028948] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-22T17:13:46.029043] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-22T17:13:46.029413] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-22T17:13:46.029453] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-22T17:13:46.030316] [DEBUG] [LOCAL ] AMTB: Trimmed 30341 records to 20461 (keeping 200 days of data) [2025-09-22T17:13:46.124176] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-22T17:13:46.157295] [DEBUG] [LOCAL ] AMTB: Primary data saved (20461 records). [2025-09-22T17:13:46.157426] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-22T17:13:46.157508] [INFO ] [MAIN ] Update Progress: 109/2372 symbols completed. AMTB took 24.2s. Estimated remaining: 4h 44m 33s. Rate: 8.0 symbols/min [2025-09-22T17:13:46.337105] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:13:46.347058] [DEBUG] [LOCAL ] AMWL: Loaded 8803 existing records from primary storage. [2025-09-22T17:13:46.347168] [INFO ] [MAIN ] AMWL: Loaded 8803 existing records. [2025-09-22T17:13:46.524850] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:13:46.525163] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-22T17:13:46.525216] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-22T17:13:46.525613] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-22T17:13:46.525710] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-22T17:13:46.644189] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-22T17:13:46.904457] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:13:46.922009] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-22T17:13:46.994674] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T17:13:47.722046] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-22T17:13:47.754155] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T17:13:48.316316] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T17:13:48.522083] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-22T17:13:49.322066] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-22T17:13:49.665699] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-22T17:13:50.122031] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-22T17:13:50.187760] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T17:13:50.922129] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-22T17:13:51.722080] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-22T17:13:51.779700] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T17:13:51.977438] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T17:13:51.986561] [INFO ] [REMOTE ] AMT: Full fetch complete (75997 records). [2025-09-22T17:13:51.986781] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-22T17:13:52.106179] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-22T17:13:52.492950] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-22T17:13:52.493050] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-22T17:13:52.494079] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-22T17:13:52.494154] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-22T17:13:52.496065] [DEBUG] [LOCAL ] AMT: Trimmed 75997 records to 52455 (keeping 200 days of data) [2025-09-22T17:13:52.559862] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-22T17:13:52.843514] [DEBUG] [LOCAL ] AMT: Primary data saved (52455 records). [2025-09-22T17:13:52.843692] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-22T17:13:52.843976] [INFO ] [MAIN ] Update Progress: 110/2372 symbols completed. AMT took 42.0s. Estimated remaining: 4h 44m 8s. Rate: 8.0 symbols/min [2025-09-22T17:13:52.975226] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T17:13:53.048120] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:13:53.101200] [DEBUG] [LOCAL ] AMX: Loaded 49778 existing records from primary storage. [2025-09-22T17:13:53.101384] [INFO ] [MAIN ] AMX: Loaded 49778 existing records. [2025-09-22T17:13:53.290430] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:13:53.290734] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-22T17:13:53.290790] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-22T17:13:53.291998] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-22T17:13:53.292062] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-22T17:13:53.327274] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-22T17:13:53.664845] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:13:53.860255] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-22T17:13:54.122124] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-22T17:13:54.922068] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-22T17:13:55.456125] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T17:13:55.722076] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-22T17:13:56.201093] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-22T17:13:56.331259] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-22T17:13:56.522069] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-22T17:13:57.322072] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-22T17:13:57.850736] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T17:13:57.998324] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-22T17:13:58.122078] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-22T17:13:58.922056] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-22T17:13:59.292536] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T17:13:59.440088] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T17:13:59.722054] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-22T17:14:00.257702] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-22T17:14:00.522056] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-22T17:14:01.087354] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T17:14:01.322100] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-22T17:14:02.105016] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T17:14:02.122047] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-22T17:14:02.922060] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-22T17:14:03.094869] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T17:14:03.722097] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-22T17:14:04.108020] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-22T17:14:04.311792] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T17:14:04.522079] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-22T17:14:05.079734] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T17:14:05.081291] [INFO ] [REMOTE ] AMTD: Full fetch complete (5602 records). [2025-09-22T17:14:05.081362] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-22T17:14:05.327250] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-22T17:14:05.493884] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-22T17:14:05.493983] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-22T17:14:05.494183] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-22T17:14:05.494223] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-22T17:14:05.494689] [DEBUG] [LOCAL ] AMTD: Trimmed 5602 records to 3554 (keeping 200 days of data) [2025-09-22T17:14:05.517582] [DEBUG] [LOCAL ] AMTD: Primary data saved (3554 records). [2025-09-22T17:14:05.517775] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-22T17:14:05.517877] [INFO ] [MAIN ] Update Progress: 111/2372 symbols completed. AMTD took 24.9s. Estimated remaining: 4h 45m 45s. Rate: 7.9 symbols/min [2025-09-22T17:14:05.708083] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:14:05.749391] [DEBUG] [LOCAL ] AN: Loaded 33301 existing records from primary storage. [2025-09-22T17:14:05.749557] [INFO ] [MAIN ] AN: Loaded 33301 existing records. [2025-09-22T17:14:05.924372] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:14:05.924729] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-22T17:14:05.924808] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-22T17:14:05.925695] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-22T17:14:05.925755] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-22T17:14:06.133716] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-22T17:14:06.293390] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:14:06.750692] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T17:14:06.771348] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T17:14:06.922096] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-22T17:14:07.722070] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-22T17:14:08.257521] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T17:14:08.522102] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-22T17:14:09.322037] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-22T17:14:09.365933] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T17:14:09.368697] [INFO ] [REMOTE ] AMWL: Full fetch complete (14002 records). [2025-09-22T17:14:09.368821] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-22T17:14:09.766896] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-22T17:14:09.805925] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-22T17:14:09.806126] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-22T17:14:09.806406] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-22T17:14:09.806788] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-22T17:14:09.807417] [DEBUG] [LOCAL ] AMWL: Trimmed 14002 records to 8612 (keeping 200 days of data) [2025-09-22T17:14:09.856399] [DEBUG] [LOCAL ] AMWL: Primary data saved (8612 records). [2025-09-22T17:14:09.856548] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-22T17:14:09.856731] [INFO ] [MAIN ] Update Progress: 112/2372 symbols completed. AMWL took 23.7s. Estimated remaining: 4h 44m 32s. Rate: 7.9 symbols/min [2025-09-22T17:14:10.035624] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:14:10.092133] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-22T17:14:10.092289] [INFO ] [MAIN ] ANET: Loaded 54546 existing records. [2025-09-22T17:14:10.127309] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-22T17:14:10.279123] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:14:10.279361] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-22T17:14:10.279409] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-22T17:14:10.280772] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-22T17:14:10.280833] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-22T17:14:10.662994] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:14:10.712418] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:14:10.922058] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-22T17:14:11.489165] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T17:14:11.722052] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-22T17:14:12.323143] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T17:14:12.522118] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-22T17:14:13.327212] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-22T17:14:13.340023] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T17:14:14.122092] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-22T17:14:14.435532] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T17:14:14.676776] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T17:14:14.922075] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-22T17:14:15.506716] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T17:14:15.722056] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-22T17:14:16.522052] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-22T17:14:16.626787] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T17:14:17.322073] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-22T17:14:17.359901] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T17:14:18.122133] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-22T17:14:18.617857] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-22T17:14:18.669691] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T17:14:18.922089] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-22T17:14:19.120386] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T17:14:19.722064] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-22T17:14:20.272080] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T17:14:20.280428] [INFO ] [REMOTE ] AMX: Full fetch complete (70777 records). [2025-09-22T17:14:20.280910] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-22T17:14:20.530566] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-22T17:14:20.694343] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-22T17:14:20.694539] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-22T17:14:20.695738] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-22T17:14:20.695832] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-22T17:14:20.698363] [DEBUG] [LOCAL ] AMX: Trimmed 70777 records to 49133 (keeping 200 days of data) [2025-09-22T17:14:21.016759] [DEBUG] [LOCAL ] AMX: Primary data saved (49133 records). [2025-09-22T17:14:21.017087] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-22T17:14:21.017240] [INFO ] [MAIN ] Update Progress: 113/2372 symbols completed. AMX took 28.2s. Estimated remaining: 4h 45m 36s. Rate: 7.9 symbols/min [2025-09-22T17:14:21.199966] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:14:21.257068] [DEBUG] [LOCAL ] ANF: Loaded 53051 existing records from primary storage. [2025-09-22T17:14:21.257276] [INFO ] [MAIN ] ANF: Loaded 53051 existing records. [2025-09-22T17:14:21.330545] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-22T17:14:21.453077] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:14:21.453534] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-22T17:14:21.453586] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-22T17:14:21.455060] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-22T17:14:21.455134] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-22T17:14:21.839216] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:14:21.902091] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-22T17:14:22.105699] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T17:14:22.122068] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-22T17:14:22.803179] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T17:14:22.922059] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-22T17:14:23.722021] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-22T17:14:24.164896] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-22T17:14:24.522083] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-22T17:14:25.103491] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T17:14:25.111607] [INFO ] [REMOTE ] AMTM: Full fetch complete (73959 records). [2025-09-22T17:14:25.111826] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-22T17:14:25.324853] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-22T17:14:25.611679] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-22T17:14:25.611961] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-22T17:14:25.613358] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-22T17:14:25.613790] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-22T17:14:25.616891] [DEBUG] [LOCAL ] AMTM: Trimmed 73959 records to 50777 (keeping 200 days of data) [2025-09-22T17:14:25.659064] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-22T17:14:25.819548] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T17:14:26.018854] [DEBUG] [LOCAL ] AMTM: Primary data saved (50777 records). [2025-09-22T17:14:26.019046] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-22T17:14:26.019140] [INFO ] [MAIN ] Update Progress: 114/2372 symbols completed. AMTM took 42.1s. Estimated remaining: 4h 44m 38s. Rate: 7.9 symbols/min [2025-09-22T17:14:26.128392] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-22T17:14:26.203678] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:14:26.203895] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-22T17:14:26.203951] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-22T17:14:26.204092] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-22T17:14:26.204135] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-22T17:14:26.204176] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-22T17:14:26.204209] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-22T17:14:26.562307] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:14:26.922096] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-22T17:14:27.270671] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T17:14:27.446497] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T17:14:27.722018] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-22T17:14:28.522118] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-22T17:14:28.730415] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:14:28.730684] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-22T17:14:28.904742] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-22T17:14:29.126394] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T17:14:29.322030] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-22T17:14:29.520748] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:14:29.520992] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-22T17:14:30.122116] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-22T17:14:30.922087] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-22T17:14:31.108835] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:14:31.109158] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-22T17:14:31.437713] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T17:14:31.722056] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-22T17:14:31.944886] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:14:31.945215] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-22T17:14:32.522066] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-22T17:14:33.322067] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-22T17:14:33.534058] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:14:33.534361] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-22T17:14:33.622362] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T17:14:34.122073] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-22T17:14:34.922063] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-22T17:14:35.136418] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:14:35.136787] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-22T17:14:35.722062] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-22T17:14:36.000715] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:14:36.001042] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-22T17:14:36.212409] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-22T17:14:36.522059] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-22T17:14:37.322062] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-22T17:14:38.122073] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-22T17:14:38.398960] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T17:14:38.922094] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-22T17:14:39.232449] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-22T17:14:39.616428] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T17:14:39.722104] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-22T17:14:40.522104] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-22T17:14:40.619262] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T17:14:40.624526] [INFO ] [REMOTE ] AN: Full fetch complete (47740 records). [2025-09-22T17:14:40.624629] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-22T17:14:40.783891] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:14:40.816335] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-22T17:14:41.031504] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-22T17:14:41.031759] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-22T17:14:41.032347] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-22T17:14:41.032427] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-22T17:14:41.033767] [DEBUG] [LOCAL ] AN: Trimmed 47740 records to 32596 (keeping 200 days of data) [2025-09-22T17:14:41.159811] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-22T17:14:41.283291] [DEBUG] [LOCAL ] AN: Primary data saved (32596 records). [2025-09-22T17:14:41.283459] [INFO ] [MAIN ] AN: Full history saved. [2025-09-22T17:14:41.287539] [INFO ] [MAIN ] Update Progress: 115/2372 symbols completed. AN took 35.8s. Estimated remaining: 4h 47m 1s. Rate: 7.9 symbols/min [2025-09-22T17:14:41.327183] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-22T17:14:41.476051] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:14:41.498215] [DEBUG] [LOCAL ] ANRO: Loaded 20526 existing records from primary storage. [2025-09-22T17:14:41.498391] [INFO ] [MAIN ] ANRO: Loaded 20526 existing records. [2025-09-22T17:14:41.690346] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:14:41.690700] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-22T17:14:41.690785] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-22T17:14:41.691451] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-22T17:14:41.691514] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-22T17:14:42.078007] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:14:42.122063] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-22T17:14:42.322628] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:14:42.323012] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-22T17:14:42.922137] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-22T17:14:43.252587] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T17:14:43.722179] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-22T17:14:44.424399] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T17:14:44.428463] [INFO ] [REMOTE ] ANGX: Full fetch complete (2799 records). [2025-09-22T17:14:44.428530] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-22T17:14:44.527213] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-22T17:14:44.609350] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 8 unique days, need 200 days [2025-09-22T17:14:44.609536] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:14:44.609606] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:14:44.609693] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-22T17:14:44.609766] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-22T17:14:44.609802] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-22T17:14:44.609858] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-22T17:14:44.609957] [INFO ] [MAIN ] Update Progress: 116/2372 symbols completed. ANGX took 18.6s. Estimated remaining: 4h 45m 30s. Rate: 7.9 symbols/min [2025-09-22T17:14:44.778104] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:14:44.800988] [DEBUG] [LOCAL ] ANVS: Loaded 23662 existing records from primary storage. [2025-09-22T17:14:44.801116] [INFO ] [MAIN ] ANVS: Loaded 23662 existing records. [2025-09-22T17:14:44.978734] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:14:44.979026] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-22T17:14:44.979075] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-22T17:14:44.979767] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-22T17:14:44.979837] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-22T17:14:45.330560] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-22T17:14:45.335948] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:14:45.642228] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T17:14:45.910326] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T17:14:46.122042] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-22T17:14:46.884286] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T17:14:46.922085] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-22T17:14:46.981216] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T17:14:47.722118] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-22T17:14:48.468154] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T17:14:48.522011] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-22T17:14:49.322079] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-22T17:14:49.366762] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T17:14:49.528476] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T17:14:50.122058] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-22T17:14:50.922111] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-22T17:14:51.699634] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T17:14:51.722038] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-22T17:14:52.110870] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T17:14:52.226316] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-09-22T17:14:52.235047] [INFO ] [REMOTE ] ANET: Full fetch complete (77835 records). [2025-09-22T17:14:52.235186] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-22T17:14:52.527196] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-22T17:14:52.691098] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-22T17:14:52.691200] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-22T17:14:52.692145] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-22T17:14:52.692230] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-22T17:14:52.694155] [DEBUG] [LOCAL ] ANET: Trimmed 77835 records to 53766 (keeping 200 days of data) [2025-09-22T17:14:53.034277] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-22T17:14:53.034424] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-22T17:14:53.034512] [INFO ] [MAIN ] Update Progress: 117/2372 symbols completed. ANET took 43.2s. Estimated remaining: 4h 45m 38s. Rate: 7.9 symbols/min [2025-09-22T17:14:53.253170] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T17:14:53.341082] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-22T17:14:53.351378] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T17:14:54.122058] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-22T17:14:54.900671] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T17:14:54.922010] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-22T17:14:55.365762] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T17:14:55.722086] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-22T17:14:56.522101] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-22T17:14:56.561217] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T17:14:56.569348] [INFO ] [REMOTE ] ANF: Full fetch complete (75643 records). [2025-09-22T17:14:56.569472] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-22T17:14:56.896529] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T17:14:57.006813] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-22T17:14:57.006930] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-22T17:14:57.007913] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-22T17:14:57.007986] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-22T17:14:57.013494] [DEBUG] [LOCAL ] ANF: Trimmed 75643 records to 52264 (keeping 200 days of data) [2025-09-22T17:14:57.322420] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-22T17:14:57.347147] [DEBUG] [LOCAL ] ANF: Primary data saved (52264 records). [2025-09-22T17:14:57.347250] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-22T17:14:57.347368] [INFO ] [MAIN ] Update Progress: 118/2372 symbols completed. ANF took 36.3s. Estimated remaining: 4h 44m 28s. Rate: 7.9 symbols/min [2025-09-22T17:14:57.446142] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-22T17:14:57.998210] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T17:14:58.122055] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-22T17:14:58.896613] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T17:14:58.922005] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-22T17:14:59.623443] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T17:14:59.722057] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-22T17:15:00.304975] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T17:15:00.522124] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-22T17:15:01.322087] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-22T17:15:01.792817] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T17:15:02.122142] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-22T17:15:03.061474] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T17:15:03.063780] [INFO ] [REMOTE ] ANRO: Full fetch complete (30764 records). [2025-09-22T17:15:03.063859] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-22T17:15:03.449598] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-22T17:15:03.449714] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-22T17:15:03.450618] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-22T17:15:03.450717] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-22T17:15:03.451619] [DEBUG] [LOCAL ] ANRO: Trimmed 30764 records to 19673 (keeping 200 days of data) [2025-09-22T17:15:03.572243] [DEBUG] [LOCAL ] ANRO: Primary data saved (19673 records). [2025-09-22T17:15:03.572397] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-22T17:15:03.572515] [INFO ] [MAIN ] Update Progress: 119/2372 symbols completed. ANRO took 22.3s. Estimated remaining: 4h 43m 55s. Rate: 7.9 symbols/min [2025-09-22T17:15:04.969346] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-22T17:15:04.975306] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-22T17:15:06.103530] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T17:15:06.110161] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-22T17:15:07.119849] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T17:15:07.126980] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-22T17:15:08.014573] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T17:15:08.020911] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-22T17:15:08.842536] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T17:15:08.845619] [INFO ] [REMOTE ] ANVS: Full fetch complete (36929 records). [2025-09-22T17:15:08.845750] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-22T17:15:09.278000] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-22T17:15:09.278151] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-22T17:15:09.278712] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-22T17:15:09.278799] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-22T17:15:09.279869] [DEBUG] [LOCAL ] ANVS: Trimmed 36929 records to 23209 (keeping 200 days of data) [2025-09-22T17:15:09.428020] [DEBUG] [LOCAL ] ANVS: Primary data saved (23209 records). [2025-09-22T17:15:09.428161] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-22T17:15:09.428339] [INFO ] [MAIN ] Update Progress: 120/2372 symbols completed. ANVS took 24.8s. Estimated remaining: 4h 43m 15s. Rate: 8.0 symbols/min [2025-09-22T17:15:10.052364] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:15:10.111852] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:15:10.146278] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:15:10.153957] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-22T17:15:10.156261] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-22T17:15:10.175431] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:15:10.175795] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-22T17:15:10.176130] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-22T17:15:10.176237] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-22T17:15:10.176404] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-22T17:15:10.299575] [DEBUG] [LOCAL ] AOMR: Loaded 17257 existing records from primary storage. [2025-09-22T17:15:10.309120] [INFO ] [MAIN ] AOMR: Loaded 17257 existing records. [2025-09-22T17:15:10.590034] [DEBUG] [LOCAL ] AOD: Loaded 30803 existing records from primary storage. [2025-09-22T17:15:10.632413] [INFO ] [MAIN ] AOD: Loaded 30803 existing records. [2025-09-22T17:15:10.724046] [DEBUG] [LOCAL ] AON: Loaded 46389 existing records from primary storage. [2025-09-22T17:15:10.790175] [INFO ] [MAIN ] AON: Loaded 46389 existing records. [2025-09-22T17:15:10.857537] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:15:10.994159] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:15:11.004866] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-22T17:15:11.037025] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-22T17:15:11.047496] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-22T17:15:11.065407] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-22T17:15:11.065518] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-22T17:15:11.276995] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:15:11.304547] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:15:11.309968] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:15:11.286880] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-22T17:15:11.315935] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-22T17:15:11.316066] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-22T17:15:11.316210] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-22T17:15:11.326764] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-22T17:15:11.341206] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-22T17:15:11.344946] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-22T17:15:11.345106] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-22T17:15:11.350784] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-22T17:15:11.351009] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-22T17:15:11.863077] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:15:11.924827] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-22T17:15:12.001250] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-22T17:15:12.181092] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:15:12.243796] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-22T17:15:12.416218] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:15:12.400284] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:15:12.415422] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:15:12.416828] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-22T17:15:12.417341] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-22T17:15:12.418962] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-22T17:15:12.419679] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-22T17:15:12.630166] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:15:12.630543] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-22T17:15:12.631209] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-22T17:15:12.860847] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:15:12.861185] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-22T17:15:12.861776] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-22T17:15:12.962936] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-22T17:15:13.322009] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-22T17:15:13.480292] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T17:15:13.481472] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T17:15:13.937561] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T17:15:14.116966] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T17:15:14.125782] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-22T17:15:14.922084] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-22T17:15:15.435680] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T17:15:15.722107] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-22T17:15:15.929481] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T17:15:16.522104] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-22T17:15:16.615881] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T17:15:17.231500] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T17:15:17.322087] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-22T17:15:18.122070] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-22T17:15:18.922031] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-22T17:15:19.044305] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T17:15:19.722075] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-22T17:15:19.942607] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-22T17:15:20.014608] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T17:15:20.522054] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-22T17:15:20.605213] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T17:15:21.322064] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-22T17:15:21.870115] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T17:15:22.122099] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-22T17:15:22.366942] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T17:15:22.779774] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-22T17:15:22.922109] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-22T17:15:23.722062] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-22T17:15:24.533077] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-22T17:15:24.542777] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T17:15:24.816773] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T17:15:25.322058] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-22T17:15:25.592009] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T17:15:25.869365] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-22T17:15:26.122073] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-22T17:15:26.841502] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-22T17:15:26.922044] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-22T17:15:27.722031] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-22T17:15:27.860394] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-22T17:15:28.149451] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T17:15:28.522086] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-22T17:15:28.985154] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-22T17:15:28.986243] [INFO ] [REMOTE ] AOMD: Full fetch complete (1738 records). [2025-09-22T17:15:28.986331] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-22T17:15:29.179595] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 82 unique days, need 200 days [2025-09-22T17:15:29.179850] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:15:29.179911] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:15:29.179977] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-22T17:15:29.180039] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-22T17:15:29.180092] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-22T17:15:29.180175] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-22T17:15:29.180277] [INFO ] [MAIN ] Update Progress: 121/2372 symbols completed. AOMD took 19.7s. Estimated remaining: 4h 46m 55s. Rate: 7.8 symbols/min [2025-09-22T17:15:29.327153] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-22T17:15:29.367490] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:15:29.428825] [DEBUG] [LOCAL ] AORT: Loaded 30407 existing records from primary storage. [2025-09-22T17:15:29.428989] [INFO ] [MAIN ] AORT: Loaded 30407 existing records. [2025-09-22T17:15:29.609690] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:15:29.609947] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-22T17:15:29.609997] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-22T17:15:29.612094] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-22T17:15:29.612156] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-22T17:15:29.987530] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:15:30.122084] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-22T17:15:30.922067] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-22T17:15:31.141719] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T17:15:31.282490] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T17:15:31.722059] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-22T17:15:31.823052] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T17:15:32.522058] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-22T17:15:33.322055] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-22T17:15:33.569628] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T17:15:33.643215] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T17:15:34.122064] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-22T17:15:34.411231] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T17:15:34.414357] [INFO ] [REMOTE ] AOMR: Full fetch complete (23142 records). [2025-09-22T17:15:34.414459] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-22T17:15:34.792287] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-22T17:15:34.792382] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-22T17:15:34.792738] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-22T17:15:34.792800] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-22T17:15:34.793436] [DEBUG] [LOCAL ] AOMR: Trimmed 23142 records to 16786 (keeping 200 days of data) [2025-09-22T17:15:34.903790] [DEBUG] [LOCAL ] AOMR: Primary data saved (16786 records). [2025-09-22T17:15:34.903991] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-22T17:15:34.904088] [INFO ] [MAIN ] Update Progress: 122/2372 symbols completed. AOMR took 25.5s. Estimated remaining: 4h 46m 12s. Rate: 7.9 symbols/min [2025-09-22T17:15:34.927171] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-22T17:15:35.079677] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:15:35.134521] [DEBUG] [LOCAL ] AOS: Loaded 50129 existing records from primary storage. [2025-09-22T17:15:35.134698] [INFO ] [MAIN ] AOS: Loaded 50129 existing records. [2025-09-22T17:15:35.311881] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:15:35.312280] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-22T17:15:35.312368] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-22T17:15:35.315150] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-22T17:15:35.315218] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-22T17:15:35.671102] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:15:35.722002] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-22T17:15:35.830885] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T17:15:35.895906] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T17:15:36.522102] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-22T17:15:36.807093] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T17:15:37.322068] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-22T17:15:38.122029] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-22T17:15:38.235080] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T17:15:38.295366] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-22T17:15:38.922112] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-22T17:15:39.546034] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T17:15:39.722073] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-22T17:15:40.036977] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T17:15:40.045385] [INFO ] [REMOTE ] AOD: Full fetch complete (44014 records). [2025-09-22T17:15:40.045598] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-22T17:15:40.527196] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-22T17:15:40.664708] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-22T17:15:40.664863] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-22T17:15:40.665792] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-22T17:15:40.665882] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-22T17:15:40.667526] [DEBUG] [LOCAL ] AOD: Trimmed 44014 records to 30300 (keeping 200 days of data) [2025-09-22T17:15:40.873095] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T17:15:40.970972] [DEBUG] [LOCAL ] AOD: Primary data saved (30300 records). [2025-09-22T17:15:40.971178] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-22T17:15:40.971329] [INFO ] [MAIN ] Update Progress: 123/2372 symbols completed. AOD took 31.5s. Estimated remaining: 4h 45m 35s. Rate: 7.9 symbols/min [2025-09-22T17:15:41.213439] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:15:41.225903] [DEBUG] [LOCAL ] AP: Loaded 6911 existing records from primary storage. [2025-09-22T17:15:41.226057] [INFO ] [MAIN ] AP: Loaded 6911 existing records. [2025-09-22T17:15:41.327228] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-22T17:15:41.425761] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:15:41.426060] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-22T17:15:41.426132] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-22T17:15:41.426753] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-22T17:15:41.426815] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-22T17:15:41.783793] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:15:41.982386] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T17:15:42.122064] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-22T17:15:42.922096] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-22T17:15:43.061417] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T17:15:43.069120] [INFO ] [REMOTE ] AON: Full fetch complete (64932 records). [2025-09-22T17:15:43.069284] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-22T17:15:43.459057] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-22T17:15:43.459296] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-22T17:15:43.460018] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-22T17:15:43.460115] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-22T17:15:43.461848] [DEBUG] [LOCAL ] AON: Trimmed 64932 records to 45635 (keeping 200 days of data) [2025-09-22T17:15:43.601630] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T17:15:43.741473] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-22T17:15:43.822167] [DEBUG] [LOCAL ] AON: Primary data saved (45635 records). [2025-09-22T17:15:43.822327] [INFO ] [MAIN ] AON: Full history saved. [2025-09-22T17:15:43.822421] [INFO ] [MAIN ] Update Progress: 124/2372 symbols completed. AON took 34.4s. Estimated remaining: 4h 44m 1s. Rate: 7.9 symbols/min [2025-09-22T17:15:44.009469] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:15:44.030299] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T17:15:44.072786] [DEBUG] [LOCAL ] APAM: Loaded 37305 existing records from primary storage. [2025-09-22T17:15:44.072931] [INFO ] [MAIN ] APAM: Loaded 37305 existing records. [2025-09-22T17:15:44.336174] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:15:44.336421] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-22T17:15:44.336470] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-22T17:15:44.338549] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-22T17:15:44.338611] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-22T17:15:44.532555] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-22T17:15:44.726404] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:15:45.322945] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-22T17:15:45.325635] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-22T17:15:45.563732] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T17:15:46.122068] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-22T17:15:46.547701] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T17:15:46.922061] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-22T17:15:47.696160] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T17:15:47.722007] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-22T17:15:47.931725] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T17:15:48.522067] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-22T17:15:48.877385] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-22T17:15:49.200858] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T17:15:49.322067] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-22T17:15:50.122101] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-22T17:15:50.922068] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-22T17:15:50.986792] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T17:15:51.131151] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T17:15:51.722062] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-22T17:15:51.890712] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T17:15:52.084414] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-22T17:15:52.522060] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-22T17:15:52.880131] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-22T17:15:53.322056] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-22T17:15:54.122068] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-22T17:15:54.792134] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T17:15:54.816041] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T17:15:54.922037] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-22T17:15:55.722054] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-22T17:15:56.522051] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-22T17:15:56.606490] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T17:15:56.707505] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T17:15:57.322052] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-22T17:15:57.814126] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T17:15:58.122067] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-22T17:15:58.132127] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T17:15:58.922061] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-22T17:15:59.422008] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T17:15:59.479266] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T17:15:59.722076] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-22T17:16:00.522096] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-22T17:16:01.310009] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-22T17:16:01.322000] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-22T17:16:01.510677] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T17:16:01.887334] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T17:16:01.889277] [INFO ] [REMOTE ] AP: Full fetch complete (8694 records). [2025-09-22T17:16:01.889385] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-22T17:16:02.127287] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-22T17:16:02.285279] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-22T17:16:02.285377] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-22T17:16:02.285764] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-22T17:16:02.285828] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-22T17:16:02.286335] [DEBUG] [LOCAL ] AP: Trimmed 8694 records to 6931 (keeping 200 days of data) [2025-09-22T17:16:02.326968] [DEBUG] [LOCAL ] AP: Primary data saved (6931 records). [2025-09-22T17:16:02.327128] [INFO ] [MAIN ] AP: Full history saved. [2025-09-22T17:16:02.327222] [INFO ] [MAIN ] Update Progress: 125/2372 symbols completed. AP took 21.4s. Estimated remaining: 4h 47m 10s. Rate: 7.8 symbols/min [2025-09-22T17:16:02.505382] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:16:02.561445] [DEBUG] [LOCAL ] APD: Loaded 46133 existing records from primary storage. [2025-09-22T17:16:02.561663] [INFO ] [MAIN ] APD: Loaded 46133 existing records. [2025-09-22T17:16:02.749345] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:16:02.749616] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-22T17:16:02.749697] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-22T17:16:02.752324] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-22T17:16:02.752389] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-22T17:16:02.922299] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-22T17:16:03.127607] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:16:03.144811] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T17:16:03.722064] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-22T17:16:04.522108] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-22T17:16:04.739888] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T17:16:05.284208] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T17:16:05.322046] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-22T17:16:05.783841] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T17:16:06.122131] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-22T17:16:06.674683] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T17:16:06.922079] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-22T17:16:07.159498] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T17:16:07.722060] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-22T17:16:08.522072] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-22T17:16:08.687740] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T17:16:08.951039] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T17:16:08.955955] [INFO ] [REMOTE ] AORT: Full fetch complete (41410 records). [2025-09-22T17:16:08.956042] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-22T17:16:08.956804] [FATAL] [VALIDATOR ] AORT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:16:08.956968] [FATAL] [MAIN ] AORT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:16:08.957024] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:16:08.957067] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-22T17:16:08.957125] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-09-22T17:16:08.957170] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-09-22T17:16:08.957617] [DEBUG] [LOCAL ] AORT: Deleted derivative data file. [2025-09-22T17:16:08.957738] [INFO ] [MAIN ] Update Progress: 126/2372 symbols completed. AORT took 39.8s. Estimated remaining: 4h 46m 44s. Rate: 7.8 symbols/min [2025-09-22T17:16:09.127573] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:16:09.183184] [DEBUG] [LOCAL ] APG: Loaded 51009 existing records from primary storage. [2025-09-22T17:16:09.183357] [INFO ] [MAIN ] APG: Loaded 51009 existing records. [2025-09-22T17:16:09.332662] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-22T17:16:09.376313] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:16:09.376569] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-22T17:16:09.376673] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-22T17:16:09.379563] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-22T17:16:09.379628] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-22T17:16:09.743768] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:16:09.913987] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T17:16:10.122036] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-22T17:16:10.750512] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T17:16:10.922029] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-22T17:16:11.374218] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T17:16:11.722073] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-22T17:16:12.522149] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-22T17:16:12.864500] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T17:16:13.133957] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T17:16:13.141395] [INFO ] [REMOTE ] AOS: Full fetch complete (70766 records). [2025-09-22T17:16:13.141526] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-22T17:16:13.323091] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-22T17:16:13.539037] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-22T17:16:13.539181] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-22T17:16:13.539915] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-22T17:16:13.540033] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-22T17:16:13.541735] [DEBUG] [LOCAL ] AOS: Trimmed 70766 records to 49320 (keeping 200 days of data) [2025-09-22T17:16:13.657408] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-22T17:16:13.878844] [DEBUG] [LOCAL ] AOS: Primary data saved (49320 records). [2025-09-22T17:16:13.878998] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-22T17:16:13.879817] [INFO ] [MAIN ] Update Progress: 127/2372 symbols completed. AOS took 39.0s. Estimated remaining: 4h 45m 48s. Rate: 7.9 symbols/min [2025-09-22T17:16:14.066213] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:16:14.125778] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-22T17:16:14.127851] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-22T17:16:14.128073] [INFO ] [MAIN ] APH: Loaded 54471 existing records. [2025-09-22T17:16:14.345886] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:16:14.346152] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-22T17:16:14.346202] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-22T17:16:14.348897] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-22T17:16:14.348963] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-22T17:16:14.729365] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:16:14.922094] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-22T17:16:15.179321] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T17:16:15.203596] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T17:16:15.209127] [INFO ] [REMOTE ] APAM: Full fetch complete (51494 records). [2025-09-22T17:16:15.209252] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-22T17:16:15.620838] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-22T17:16:15.620978] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-22T17:16:15.621684] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-22T17:16:15.621770] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-22T17:16:15.622996] [DEBUG] [LOCAL ] APAM: Trimmed 51494 records to 36619 (keeping 200 days of data) [2025-09-22T17:16:15.722881] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-22T17:16:15.853571] [DEBUG] [LOCAL ] APAM: Primary data saved (36619 records). [2025-09-22T17:16:15.853778] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-22T17:16:15.853885] [INFO ] [MAIN ] Update Progress: 128/2372 symbols completed. APAM took 32.0s. Estimated remaining: 4h 44m 1s. Rate: 7.9 symbols/min [2025-09-22T17:16:16.028543] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:16:16.028749] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-09-22T17:16:16.028803] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-09-22T17:16:16.029033] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-22T17:16:16.029089] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-22T17:16:16.029134] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-09-22T17:16:16.029166] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-22T17:16:16.384932] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:16:16.522052] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-22T17:16:16.808525] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T17:16:17.322031] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-22T17:16:17.849562] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-22T17:16:18.122117] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-22T17:16:18.399420] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T17:16:18.930524] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-22T17:16:18.949957] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T17:16:19.346179] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T17:16:19.722061] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-22T17:16:20.522051] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-22T17:16:20.636337] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T17:16:21.322078] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-22T17:16:21.610474] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T17:16:22.030884] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T17:16:22.122082] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-22T17:16:22.898345] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T17:16:22.922007] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-22T17:16:23.722062] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-22T17:16:23.797864] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T17:16:24.150980] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T17:16:24.522080] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-22T17:16:24.828551] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T17:16:25.322076] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-22T17:16:26.122057] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-22T17:16:26.539077] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-22T17:16:26.922159] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-22T17:16:27.147310] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T17:16:27.153912] [INFO ] [REMOTE ] APD: Full fetch complete (66556 records). [2025-09-22T17:16:27.154027] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-22T17:16:27.581007] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-22T17:16:27.581139] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-22T17:16:27.582329] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-22T17:16:27.582413] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-22T17:16:27.584291] [DEBUG] [LOCAL ] APD: Trimmed 66556 records to 45375 (keeping 200 days of data) [2025-09-22T17:16:27.722561] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-22T17:16:27.721577] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T17:16:27.943259] [DEBUG] [LOCAL ] APD: Primary data saved (45375 records). [2025-09-22T17:16:27.943457] [INFO ] [MAIN ] APD: Full history saved. [2025-09-22T17:16:27.944997] [INFO ] [MAIN ] Update Progress: 129/2372 symbols completed. APD took 25.6s. Estimated remaining: 4h 45m 12s. Rate: 7.9 symbols/min [2025-09-22T17:16:28.116957] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:16:28.182708] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-22T17:16:28.182859] [INFO ] [MAIN ] APO: Loaded 54162 existing records. [2025-09-22T17:16:28.365548] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:16:28.365925] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-22T17:16:28.366158] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-22T17:16:28.368801] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-22T17:16:28.368867] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-22T17:16:28.524995] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-22T17:16:28.679181] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T17:16:28.779694] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:16:29.322033] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-22T17:16:29.358831] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T17:16:30.122068] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-22T17:16:30.201154] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T17:16:30.756166] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T17:16:30.922067] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-22T17:16:31.722079] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-22T17:16:32.058328] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T17:16:32.416007] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T17:16:32.522053] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-22T17:16:33.019311] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T17:16:33.322094] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-22T17:16:34.021522] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T17:16:34.122069] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-22T17:16:34.922023] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-22T17:16:35.039799] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T17:16:35.515077] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T17:16:35.722045] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-22T17:16:36.522060] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-22T17:16:36.868368] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T17:16:37.328453] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-22T17:16:37.350165] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T17:16:37.999197] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T17:16:38.122134] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-22T17:16:38.818555] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T17:16:38.922028] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-22T17:16:39.722082] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-22T17:16:40.009521] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T17:16:40.413342] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T17:16:40.522070] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-22T17:16:41.322074] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-22T17:16:41.426250] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T17:16:42.130814] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-22T17:16:42.153301] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T17:16:42.922034] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-22T17:16:43.395756] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-22T17:16:43.404348] [INFO ] [REMOTE ] APG: Full fetch complete (71544 records). [2025-09-22T17:16:43.404518] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-22T17:16:43.723739] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-22T17:16:43.810362] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-22T17:16:43.810671] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-22T17:16:43.811571] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-22T17:16:43.811731] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-22T17:16:43.814460] [DEBUG] [LOCAL ] APG: Trimmed 71544 records to 50234 (keeping 200 days of data) [2025-09-22T17:16:43.964349] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T17:16:44.173799] [DEBUG] [LOCAL ] APG: Primary data saved (50234 records). [2025-09-22T17:16:44.174079] [INFO ] [MAIN ] APG: Full history saved. [2025-09-22T17:16:44.174181] [INFO ] [MAIN ] Update Progress: 130/2372 symbols completed. APG took 35.2s. Estimated remaining: 4h 47m 32s. Rate: 7.8 symbols/min [2025-09-22T17:16:44.348340] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:16:44.357988] [DEBUG] [LOCAL ] APOS: Loaded 7543 existing records from primary storage. [2025-09-22T17:16:44.358106] [INFO ] [MAIN ] APOS: Loaded 7543 existing records. [2025-09-22T17:16:44.542686] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-22T17:16:44.565553] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:16:44.566974] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-22T17:16:44.567260] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-22T17:16:44.569748] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T17:16:44.569901] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-22T17:16:44.577916] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-22T17:16:44.600002] [INFO ] [REMOTE ] APLE: Full fetch complete (74248 records). [2025-09-22T17:16:44.611531] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-22T17:16:45.374712] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:16:45.397927] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-22T17:16:45.398281] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-22T17:16:45.399019] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-22T17:16:45.399966] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-22T17:16:45.400033] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-22T17:16:45.404439] [DEBUG] [LOCAL ] APLE: Trimmed 74248 records to 52036 (keeping 200 days of data) [2025-09-22T17:16:45.741439] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T17:16:45.769502] [DEBUG] [LOCAL ] APLE: Primary data saved (52036 records). [2025-09-22T17:16:45.769623] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-22T17:16:45.769732] [INFO ] [MAIN ] Update Progress: 131/2372 symbols completed. APLE took 29.9s. Estimated remaining: 4h 45m 40s. Rate: 7.8 symbols/min [2025-09-22T17:16:45.940519] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:16:45.940694] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-09-22T17:16:45.940750] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-09-22T17:16:45.940892] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-22T17:16:45.940933] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-22T17:16:45.940975] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-09-22T17:16:45.941007] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-22T17:16:46.162106] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-22T17:16:46.315345] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:16:46.316407] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T17:16:46.581762] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T17:16:46.922055] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-22T17:16:47.729373] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-22T17:16:47.765773] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T17:16:48.522085] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-22T17:16:48.680049] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T17:16:48.688851] [INFO ] [REMOTE ] APH: Full fetch complete (77682 records). [2025-09-22T17:16:48.689052] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-22T17:16:49.039038] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-22T17:16:49.130545] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-22T17:16:49.130722] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-22T17:16:49.131835] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-22T17:16:49.131930] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-22T17:16:49.134080] [DEBUG] [LOCAL ] APH: Trimmed 77682 records to 53691 (keeping 200 days of data) [2025-09-22T17:16:49.326308] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-22T17:16:49.403453] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T17:16:49.534413] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-09-22T17:16:49.534568] [INFO ] [MAIN ] APH: Full history saved. [2025-09-22T17:16:49.537881] [INFO ] [MAIN ] Update Progress: 132/2372 symbols completed. APH took 35.7s. Estimated remaining: 4h 44m 27s. Rate: 7.9 symbols/min [2025-09-22T17:16:49.719187] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:16:49.779548] [DEBUG] [LOCAL ] AQN: Loaded 52736 existing records from primary storage. [2025-09-22T17:16:49.779787] [INFO ] [MAIN ] AQN: Loaded 52736 existing records. [2025-09-22T17:16:49.977002] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:16:49.977218] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T17:16:49.980187] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-22T17:16:49.980255] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-22T17:16:49.984867] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-22T17:16:49.984933] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-22T17:16:50.127167] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-22T17:16:50.347138] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:16:50.922055] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-22T17:16:51.722054] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-22T17:16:51.919494] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T17:16:52.449402] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-22T17:16:52.522075] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-22T17:16:52.809484] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T17:16:53.322053] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-22T17:16:54.053810] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T17:16:54.122025] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-22T17:16:54.612220] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-22T17:16:54.819250] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T17:16:54.922034] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-22T17:16:55.722060] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-22T17:16:56.522030] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-22T17:16:56.638623] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T17:16:57.322051] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-22T17:16:57.366134] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T17:16:57.793336] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T17:16:58.122057] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-22T17:16:58.719968] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T17:16:58.922030] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-22T17:16:59.459541] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T17:16:59.722107] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-22T17:17:00.522061] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-22T17:17:00.747534] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T17:17:01.097054] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T17:17:01.322022] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-22T17:17:01.364360] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T17:17:01.778621] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-22T17:17:02.122096] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-22T17:17:02.922068] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-22T17:17:03.722078] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-22T17:17:03.928224] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T17:17:04.522092] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-22T17:17:05.027377] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-22T17:17:05.037493] [INFO ] [REMOTE ] APO: Full fetch complete (77288 records). [2025-09-22T17:17:05.037784] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-22T17:17:05.327404] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-22T17:17:05.487405] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-22T17:17:05.503631] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-22T17:17:05.517050] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-22T17:17:05.517231] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-22T17:17:05.519744] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T17:17:05.532731] [DEBUG] [LOCAL ] APO: Trimmed 77288 records to 53386 (keeping 200 days of data) [2025-09-22T17:17:05.799758] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-22T17:17:05.894048] [DEBUG] [LOCAL ] APO: Primary data saved (53386 records). [2025-09-22T17:17:05.894209] [INFO ] [MAIN ] APO: Full history saved. [2025-09-22T17:17:05.897065] [INFO ] [MAIN ] Update Progress: 133/2372 symbols completed. APO took 38.0s. Estimated remaining: 4h 46m 46s. Rate: 7.8 symbols/min [2025-09-22T17:17:06.091176] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:17:06.104269] [DEBUG] [LOCAL ] AQNB: Loaded 4281 existing records from primary storage. [2025-09-22T17:17:06.104409] [INFO ] [MAIN ] AQNB: Loaded 4281 existing records. [2025-09-22T17:17:06.129600] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-22T17:17:06.295783] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T17:17:06.373879] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:17:06.374190] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-22T17:17:06.374253] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-22T17:17:06.374833] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-22T17:17:06.374896] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-22T17:17:06.731623] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:17:06.922063] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-22T17:17:07.722062] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-22T17:17:08.091793] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T17:17:08.278216] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T17:17:08.486671] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T17:17:08.522091] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-22T17:17:09.261015] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-22T17:17:09.322014] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-22T17:17:09.690409] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-22T17:17:10.122059] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-22T17:17:10.568562] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-22T17:17:10.922055] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-22T17:17:11.722100] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-22T17:17:11.811806] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T17:17:11.815932] [INFO ] [REMOTE ] APOS: Full fetch complete (10436 records). [2025-09-22T17:17:11.816080] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-22T17:17:12.187304] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-22T17:17:12.187386] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-22T17:17:12.187627] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-22T17:17:12.187709] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-22T17:17:12.188214] [DEBUG] [LOCAL ] APOS: Trimmed 10436 records to 7486 (keeping 200 days of data) [2025-09-22T17:17:12.238057] [DEBUG] [LOCAL ] APOS: Primary data saved (7486 records). [2025-09-22T17:17:12.238190] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-22T17:17:12.238377] [INFO ] [MAIN ] Update Progress: 134/2372 symbols completed. APOS took 28.1s. Estimated remaining: 4h 46m 16s. Rate: 7.8 symbols/min [2025-09-22T17:17:12.349276] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T17:17:12.420194] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:17:12.484251] [DEBUG] [LOCAL ] AR: Loaded 54365 existing records from primary storage. [2025-09-22T17:17:12.484407] [INFO ] [MAIN ] AR: Loaded 54365 existing records. [2025-09-22T17:17:12.527177] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-22T17:17:12.690471] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:17:12.691265] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-22T17:17:12.691396] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-22T17:17:12.693531] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-22T17:17:12.693677] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-22T17:17:13.046455] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:17:13.322056] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-22T17:17:13.921639] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T17:17:14.122047] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-22T17:17:14.922113] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-22T17:17:15.017367] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T17:17:15.307322] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-22T17:17:15.505378] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T17:17:15.722074] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-22T17:17:16.143708] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T17:17:16.522096] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-22T17:17:17.322073] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-22T17:17:17.789714] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T17:17:18.023601] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T17:17:18.122070] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-22T17:17:18.922057] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-22T17:17:19.513195] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:17:19.722077] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-22T17:17:20.414191] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T17:17:20.422303] [INFO ] [REMOTE ] APTV: Full fetch complete (76067 records). [2025-09-22T17:17:20.422460] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-22T17:17:20.522259] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-22T17:17:20.822264] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-22T17:17:20.822362] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-22T17:17:20.823121] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-22T17:17:20.823184] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-22T17:17:20.825117] [DEBUG] [LOCAL ] APTV: Trimmed 76067 records to 52232 (keeping 200 days of data) [2025-09-22T17:17:21.146795] [DEBUG] [LOCAL ] APTV: Primary data saved (52232 records). [2025-09-22T17:17:21.146948] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-22T17:17:21.147086] [INFO ] [MAIN ] Update Progress: 135/2372 symbols completed. APTV took 35.4s. Estimated remaining: 4h 46m 29s. Rate: 7.8 symbols/min [2025-09-22T17:17:21.251829] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T17:17:21.323546] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-22T17:17:21.325223] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:17:21.378984] [DEBUG] [LOCAL ] ARCO: Loaded 45295 existing records from primary storage. [2025-09-22T17:17:21.379181] [INFO ] [MAIN ] ARCO: Loaded 45295 existing records. [2025-09-22T17:17:21.600812] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:17:21.601378] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-22T17:17:21.601471] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-22T17:17:21.605117] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-22T17:17:21.605244] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-22T17:17:21.734521] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-22T17:17:21.784792] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-22T17:17:21.847346] [INFO ] [REMOTE ] AQN: Full fetch complete (75251 records). [2025-09-22T17:17:21.907824] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-22T17:17:22.128372] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-22T17:17:22.175026] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:17:22.479598] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-22T17:17:22.479731] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-22T17:17:22.480504] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-22T17:17:22.480571] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-22T17:17:22.484174] [DEBUG] [LOCAL ] AQN: Trimmed 75251 records to 51958 (keeping 200 days of data) [2025-09-22T17:17:22.813007] [DEBUG] [LOCAL ] AQN: Primary data saved (51958 records). [2025-09-22T17:17:22.813166] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-22T17:17:22.813965] [INFO ] [MAIN ] Update Progress: 136/2372 symbols completed. AQN took 33.3s. Estimated remaining: 4h 44m 42s. Rate: 7.9 symbols/min [2025-09-22T17:17:22.923897] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-22T17:17:23.016381] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:17:23.036896] [DEBUG] [LOCAL ] ARDC: Loaded 14872 existing records from primary storage. [2025-09-22T17:17:23.037042] [INFO ] [MAIN ] ARDC: Loaded 14872 existing records. [2025-09-22T17:17:23.230908] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:17:23.231562] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-22T17:17:23.231621] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-22T17:17:23.232502] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-22T17:17:23.232564] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-22T17:17:23.584352] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T17:17:23.606617] [INFO ] [REMOTE ] AQNB: Full fetch complete (5918 records). [2025-09-22T17:17:23.606785] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-22T17:17:23.604607] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:17:23.607583] [FATAL] [VALIDATOR ] AQNB: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:17:23.608031] [FATAL] [MAIN ] AQNB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:17:23.608139] [WARN ] [MAIN ] AQNB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:17:23.608237] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-22T17:17:23.608336] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-09-22T17:17:23.608482] [INFO ] [LOCAL ] AQNB: Starting deletion of derivative data. [2025-09-22T17:17:23.609151] [DEBUG] [LOCAL ] AQNB: Deleted derivative data file. [2025-09-22T17:17:23.609276] [INFO ] [MAIN ] Update Progress: 137/2372 symbols completed. AQNB took 17.7s. Estimated remaining: 4h 42m 43s. Rate: 7.9 symbols/min [2025-09-22T17:17:23.727417] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-22T17:17:23.859738] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:17:23.904506] [DEBUG] [LOCAL ] ARDT: Loaded 29081 existing records from primary storage. [2025-09-22T17:17:23.904895] [INFO ] [MAIN ] ARDT: Loaded 29081 existing records. [2025-09-22T17:17:24.111458] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:17:24.125967] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-22T17:17:24.126080] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-22T17:17:24.129164] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-22T17:17:24.129259] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-22T17:17:24.207189] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-22T17:17:24.532375] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-22T17:17:24.559245] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:17:25.283463] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T17:17:25.322007] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-22T17:17:25.851563] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T17:17:26.122135] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-22T17:17:26.636285] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T17:17:26.922118] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-22T17:17:27.603417] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T17:17:27.722056] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-22T17:17:28.137342] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T17:17:28.522054] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-22T17:17:29.133806] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T17:17:29.322085] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-22T17:17:29.778910] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T17:17:30.122068] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-22T17:17:30.199787] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T17:17:30.922076] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-22T17:17:31.712523] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T17:17:31.722011] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-22T17:17:32.527171] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-22T17:17:32.543284] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T17:17:33.254566] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T17:17:33.322026] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-22T17:17:33.865978] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T17:17:34.122045] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-22T17:17:34.783281] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T17:17:34.922094] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-22T17:17:35.527495] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T17:17:35.722075] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-22T17:17:36.510379] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T17:17:36.521995] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-22T17:17:37.222845] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T17:17:37.322067] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-22T17:17:37.877814] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-22T17:17:38.122010] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-22T17:17:38.145670] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T17:17:38.922056] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-22T17:17:39.631215] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T17:17:39.722082] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-22T17:17:40.526421] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-22T17:17:40.531978] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T17:17:40.897400] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T17:17:40.904851] [INFO ] [REMOTE ] ARCO: Full fetch complete (65674 records). [2025-09-22T17:17:40.904984] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-22T17:17:41.327859] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-22T17:17:41.344348] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-22T17:17:41.345580] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-22T17:17:41.346445] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-22T17:17:41.346515] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-22T17:17:41.348039] [DEBUG] [LOCAL ] ARCO: Trimmed 65674 records to 44673 (keeping 200 days of data) [2025-09-22T17:17:41.626983] [DEBUG] [LOCAL ] ARCO: Primary data saved (44673 records). [2025-09-22T17:17:41.627129] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-22T17:17:41.627220] [INFO ] [MAIN ] Update Progress: 138/2372 symbols completed. ARCO took 20.5s. Estimated remaining: 4h 45m 24s. Rate: 7.8 symbols/min [2025-09-22T17:17:41.829137] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:17:41.883576] [DEBUG] [LOCAL ] ARE: Loaded 51282 existing records from primary storage. [2025-09-22T17:17:41.883760] [INFO ] [MAIN ] ARE: Loaded 51282 existing records. [2025-09-22T17:17:42.075527] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:17:42.076835] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-22T17:17:42.076895] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-22T17:17:42.086475] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-22T17:17:42.086621] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-22T17:17:42.121139] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T17:17:42.126461] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-22T17:17:42.309232] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T17:17:42.503763] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:17:42.922089] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-22T17:17:43.018965] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T17:17:43.722064] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-22T17:17:44.402848] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T17:17:44.522393] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-22T17:17:44.522470] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-22T17:17:45.322069] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-22T17:17:45.869873] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T17:17:46.122032] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-22T17:17:46.222133] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T17:17:46.873153] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-22T17:17:46.922002] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-22T17:17:47.703833] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T17:17:47.722003] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-22T17:17:48.346503] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T17:17:48.522076] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-22T17:17:49.211964] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T17:17:49.322030] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-22T17:17:50.122061] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-22T17:17:50.922108] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-22T17:17:51.323126] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T17:17:51.579327] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T17:17:51.722042] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-22T17:17:51.767269] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-22T17:17:51.775949] [INFO ] [REMOTE ] AR: Full fetch complete (77526 records). [2025-09-22T17:17:51.776100] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-22T17:17:52.179243] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-22T17:17:52.179333] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-22T17:17:52.180093] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-22T17:17:52.180162] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-22T17:17:52.181727] [DEBUG] [LOCAL ] AR: Trimmed 77526 records to 53585 (keeping 200 days of data) [2025-09-22T17:17:52.510524] [DEBUG] [LOCAL ] AR: Primary data saved (53585 records). [2025-09-22T17:17:52.510733] [INFO ] [MAIN ] AR: Full history saved. [2025-09-22T17:17:52.510834] [INFO ] [MAIN ] Update Progress: 139/2372 symbols completed. AR took 40.3s. Estimated remaining: 4h 46m 8s. Rate: 7.8 symbols/min [2025-09-22T17:17:52.531886] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-22T17:17:52.682375] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:17:52.736341] [DEBUG] [LOCAL ] ARES: Loaded 50464 existing records from primary storage. [2025-09-22T17:17:52.736476] [INFO ] [MAIN ] ARES: Loaded 50464 existing records. [2025-09-22T17:17:52.922342] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:17:52.922775] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-22T17:17:52.923029] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-22T17:17:52.925955] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-22T17:17:52.926104] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-22T17:17:53.049212] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T17:17:53.323000] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:17:53.323087] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-22T17:17:53.334682] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T17:17:54.122052] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-22T17:17:54.922069] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-22T17:17:55.128742] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-22T17:17:55.512758] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:17:55.701852] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-22T17:17:55.704512] [INFO ] [REMOTE ] ARDC: Full fetch complete (20211 records). [2025-09-22T17:17:55.704586] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-22T17:17:55.727289] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-22T17:17:56.091344] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-22T17:17:56.091453] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-22T17:17:56.091886] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-22T17:17:56.091950] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-22T17:17:56.092769] [DEBUG] [LOCAL ] ARDC: Trimmed 20211 records to 14387 (keeping 200 days of data) [2025-09-22T17:17:56.184860] [DEBUG] [LOCAL ] ARDC: Primary data saved (14387 records). [2025-09-22T17:17:56.185103] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-22T17:17:56.185224] [INFO ] [MAIN ] Update Progress: 140/2372 symbols completed. ARDC took 33.4s. Estimated remaining: 4h 44m 57s. Rate: 7.8 symbols/min [2025-09-22T17:17:56.357585] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:17:56.417581] [DEBUG] [LOCAL ] ARI: Loaded 43976 existing records from primary storage. [2025-09-22T17:17:56.417840] [INFO ] [MAIN ] ARI: Loaded 43976 existing records. [2025-09-22T17:17:56.527247] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-22T17:17:56.656853] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:17:56.657262] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-22T17:17:56.657341] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-22T17:17:56.659587] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-22T17:17:56.659685] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-22T17:17:57.038819] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:17:57.059337] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T17:17:57.322090] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-22T17:17:58.122107] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-22T17:17:58.244704] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T17:17:58.685029] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T17:17:58.922086] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-22T17:17:58.962886] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T17:17:58.967374] [INFO ] [REMOTE ] ARDT: Full fetch complete (41132 records). [2025-09-22T17:17:58.967461] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-22T17:17:59.353818] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-22T17:17:59.353905] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-22T17:17:59.354377] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-22T17:17:59.354431] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-22T17:17:59.355380] [DEBUG] [LOCAL ] ARDT: Trimmed 41132 records to 28318 (keeping 200 days of data) [2025-09-22T17:17:59.531215] [DEBUG] [LOCAL ] ARDT: Primary data saved (28318 records). [2025-09-22T17:17:59.531355] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-22T17:17:59.531449] [INFO ] [MAIN ] Update Progress: 141/2372 symbols completed. ARDT took 35.9s. Estimated remaining: 4h 43m 41s. Rate: 7.9 symbols/min [2025-09-22T17:17:59.705682] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:17:59.722137] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-22T17:17:59.751545] [DEBUG] [LOCAL ] ARIS: Loaded 42669 existing records from primary storage. [2025-09-22T17:17:59.751730] [INFO ] [MAIN ] ARIS: Loaded 42669 existing records. [2025-09-22T17:17:59.996278] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:17:59.996529] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-22T17:17:59.996577] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-22T17:17:59.998753] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-22T17:17:59.998819] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-22T17:18:00.428685] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:18:00.432309] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T17:18:00.522090] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-22T17:18:01.322097] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-22T17:18:01.841669] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-22T17:18:02.122075] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-22T17:18:02.922140] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-22T17:18:03.022756] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-22T17:18:03.722099] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-22T17:18:04.457926] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (3.14 seconds). [2025-09-22T17:18:04.522052] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-22T17:18:04.705307] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-22T17:18:05.170278] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-22T17:18:05.322089] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-22T17:18:05.633141] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T17:18:06.122144] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-22T17:18:06.387528] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-22T17:18:06.557547] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T17:18:06.922103] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-22T17:18:07.722074] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-22T17:18:07.868565] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T17:18:08.141037] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T17:18:08.522091] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-22T17:18:09.043858] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T17:18:09.322078] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-22T17:18:10.122067] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-22T17:18:10.318911] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T17:18:10.793139] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T17:18:10.922092] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-22T17:18:11.655436] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T17:18:11.722066] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-22T17:18:12.214421] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T17:18:12.522087] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-22T17:18:13.072490] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T17:18:13.322076] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-22T17:18:14.010218] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T17:18:14.122114] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-22T17:18:14.837569] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T17:18:14.922049] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-22T17:18:15.722083] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-22T17:18:15.922686] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T17:18:16.522059] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-22T17:18:17.322021] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-22T17:18:17.446403] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-22T17:18:18.122130] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-22T17:18:18.327556] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-22T17:18:18.533324] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-22T17:18:18.922119] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-22T17:18:19.355936] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-22T17:18:19.363851] [INFO ] [REMOTE ] ARE: Full fetch complete (72313 records). [2025-09-22T17:18:19.364200] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-22T17:18:19.375753] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:18:19.395600] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:18:19.397287] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:18:19.397110] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T17:18:19.397539] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-22T17:18:19.406530] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-09-22T17:18:19.407013] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-09-22T17:18:19.408086] [DEBUG] [LOCAL ] ARE: Deleted derivative data file. [2025-09-22T17:18:19.408256] [INFO ] [MAIN ] Update Progress: 142/2372 symbols completed. ARE took 37.8s. Estimated remaining: 4h 46m 45s. Rate: 7.8 symbols/min [2025-09-22T17:18:19.588462] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:18:19.632905] [DEBUG] [LOCAL ] ARLO: Loaded 44833 existing records from primary storage. [2025-09-22T17:18:19.633068] [INFO ] [MAIN ] ARLO: Loaded 44833 existing records. [2025-09-22T17:18:19.727545] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-22T17:18:19.820441] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:18:19.820727] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-22T17:18:19.820783] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-22T17:18:19.822731] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-22T17:18:19.822794] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-22T17:18:20.201292] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:18:20.441178] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T17:18:20.522062] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-22T17:18:21.032352] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T17:18:21.322056] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-22T17:18:21.896708] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T17:18:22.122068] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-22T17:18:22.773061] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T17:18:22.922068] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-22T17:18:23.697874] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T17:18:23.722047] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-22T17:18:24.524033] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-22T17:18:24.530407] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T17:18:24.537132] [INFO ] [REMOTE ] ARI: Full fetch complete (62682 records). [2025-09-22T17:18:24.537258] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-22T17:18:24.946247] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-22T17:18:24.946435] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-22T17:18:24.947351] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-22T17:18:24.947423] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-22T17:18:24.949361] [DEBUG] [LOCAL ] ARI: Trimmed 62682 records to 43335 (keeping 200 days of data) [2025-09-22T17:18:25.230988] [DEBUG] [LOCAL ] ARI: Primary data saved (43335 records). [2025-09-22T17:18:25.231192] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-22T17:18:25.232103] [INFO ] [MAIN ] Update Progress: 143/2372 symbols completed. ARI took 29.0s. Estimated remaining: 4h 46m 8s. Rate: 7.8 symbols/min [2025-09-22T17:18:25.326930] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-22T17:18:25.416834] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:18:25.446549] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T17:18:25.503254] [DEBUG] [LOCAL ] ARMK: Loaded 51064 existing records from primary storage. [2025-09-22T17:18:25.503409] [INFO ] [MAIN ] ARMK: Loaded 51064 existing records. [2025-09-22T17:18:25.686633] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:18:25.686955] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-22T17:18:25.687031] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-22T17:18:25.689272] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-22T17:18:25.689335] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-22T17:18:26.088722] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:18:26.117290] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T17:18:26.126913] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-22T17:18:26.838500] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T17:18:26.922021] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-22T17:18:27.400589] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T17:18:27.407798] [INFO ] [REMOTE ] ARIS: Full fetch complete (59696 records). [2025-09-22T17:18:27.407954] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-22T17:18:27.727267] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-22T17:18:27.813532] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-22T17:18:27.813673] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-22T17:18:27.814301] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-22T17:18:27.814356] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-22T17:18:27.815878] [DEBUG] [LOCAL ] ARIS: Trimmed 59696 records to 41970 (keeping 200 days of data) [2025-09-22T17:18:28.075216] [DEBUG] [LOCAL ] ARIS: Primary data saved (41970 records). [2025-09-22T17:18:28.075363] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-22T17:18:28.075460] [INFO ] [MAIN ] Update Progress: 144/2372 symbols completed. ARIS took 28.5s. Estimated remaining: 4h 44m 45s. Rate: 7.8 symbols/min [2025-09-22T17:18:28.247570] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:18:28.294905] [DEBUG] [LOCAL ] AROC: Loaded 49755 existing records from primary storage. [2025-09-22T17:18:28.295061] [INFO ] [MAIN ] AROC: Loaded 49755 existing records. [2025-09-22T17:18:28.481105] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T17:18:28.509168] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:18:28.509979] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-22T17:18:28.510053] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-22T17:18:28.511667] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-22T17:18:28.511730] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-22T17:18:28.527175] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-22T17:18:28.888901] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:18:29.238336] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T17:18:29.322068] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-22T17:18:30.122071] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-22T17:18:30.532030] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T17:18:30.540509] [INFO ] [REMOTE ] ARES: Full fetch complete (70558 records). [2025-09-22T17:18:30.540684] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-22T17:18:30.926156] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-22T17:18:30.975366] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-22T17:18:30.985578] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-22T17:18:30.999136] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-22T17:18:31.001936] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-22T17:18:31.003889] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T17:18:31.014999] [DEBUG] [LOCAL ] ARES: Trimmed 70558 records to 49656 (keeping 200 days of data) [2025-09-22T17:18:31.352201] [DEBUG] [LOCAL ] ARES: Primary data saved (49656 records). [2025-09-22T17:18:31.352417] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-22T17:18:31.352529] [INFO ] [MAIN ] Update Progress: 145/2372 symbols completed. ARES took 38.8s. Estimated remaining: 4h 43m 30s. Rate: 7.9 symbols/min [2025-09-22T17:18:31.556591] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:18:31.620000] [DEBUG] [LOCAL ] ARR: Loaded 52797 existing records from primary storage. [2025-09-22T17:18:31.620221] [INFO ] [MAIN ] ARR: Loaded 52797 existing records. [2025-09-22T17:18:31.726047] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-22T17:18:31.806628] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:18:31.806944] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-22T17:18:31.807001] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-22T17:18:31.809104] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-22T17:18:31.809164] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-22T17:18:32.182079] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:18:32.244033] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-22T17:18:32.522110] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-22T17:18:32.758437] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T17:18:33.322074] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-22T17:18:33.467692] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T17:18:34.122079] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-22T17:18:34.333711] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T17:18:34.613917] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T17:18:34.922054] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-22T17:18:35.184971] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T17:18:35.722097] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-22T17:18:36.380573] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T17:18:36.522094] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-22T17:18:37.120049] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T17:18:37.322055] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-22T17:18:37.754267] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T17:18:38.122081] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-22T17:18:38.910584] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T17:18:38.922769] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-22T17:18:39.684889] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T17:18:39.722013] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-22T17:18:40.106620] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T17:18:40.522118] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-22T17:18:41.253168] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T17:18:41.322081] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-22T17:18:42.007816] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T17:18:42.122058] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-22T17:18:42.920623] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T17:18:42.929330] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-22T17:18:43.722076] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-22T17:18:43.750424] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T17:18:44.522029] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-22T17:18:44.843046] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T17:18:45.322069] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-22T17:18:45.549086] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T17:18:45.558001] [INFO ] [REMOTE ] ARLO: Full fetch complete (62480 records). [2025-09-22T17:18:45.558276] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-22T17:18:45.974711] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-22T17:18:45.975024] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-22T17:18:45.975995] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-22T17:18:45.976101] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-22T17:18:45.978347] [DEBUG] [LOCAL ] ARLO: Trimmed 62480 records to 43987 (keeping 200 days of data) [2025-09-22T17:18:46.011342] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T17:18:46.123064] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-22T17:18:46.278819] [DEBUG] [LOCAL ] ARLO: Primary data saved (43987 records). [2025-09-22T17:18:46.278981] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-22T17:18:46.279105] [INFO ] [MAIN ] Update Progress: 146/2372 symbols completed. ARLO took 26.9s. Estimated remaining: 4h 45m 14s. Rate: 7.8 symbols/min [2025-09-22T17:18:46.448633] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:18:46.448811] [DEBUG] [LOCAL ] ARW: No existing data file found in primary storage. [2025-09-22T17:18:46.448850] [WARN ] [MAIN ] ARW: No existing data found, performing full refresh instead. [2025-09-22T17:18:46.448989] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-22T17:18:46.449031] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-22T17:18:46.449439] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-09-22T17:18:46.449565] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-22T17:18:46.850624] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:18:46.914810] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T17:18:46.929570] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-22T17:18:47.722131] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-22T17:18:47.884282] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T17:18:48.148341] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T17:18:48.522085] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-22T17:18:48.835901] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T17:18:49.322095] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-22T17:18:50.032092] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T17:18:50.122051] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-22T17:18:50.922064] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-22T17:18:51.266813] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T17:18:51.722067] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-22T17:18:51.871439] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T17:18:52.265708] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T17:18:52.522057] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-22T17:18:53.328613] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-22T17:18:53.334290] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T17:18:53.885846] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T17:18:54.122049] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-22T17:18:54.406164] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T17:18:54.922068] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-22T17:18:55.722035] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-22T17:18:56.172506] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T17:18:56.375134] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T17:18:56.522052] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-22T17:18:57.126332] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T17:18:57.322056] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-22T17:18:58.022672] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T17:18:58.122059] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-22T17:18:58.922183] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-22T17:18:59.184414] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T17:18:59.261635] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T17:18:59.722091] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-22T17:19:00.522124] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-22T17:19:00.749833] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T17:19:00.757317] [INFO ] [REMOTE ] ARMK: Full fetch complete (72138 records). [2025-09-22T17:19:00.757440] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-22T17:19:00.758276] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:19:00.758365] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:19:00.758409] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:19:00.758449] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-22T17:19:00.758524] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-22T17:19:00.758581] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-09-22T17:19:00.759130] [DEBUG] [LOCAL ] ARMK: Deleted derivative data file. [2025-09-22T17:19:00.763622] [INFO ] [MAIN ] Update Progress: 147/2372 symbols completed. ARMK took 35.5s. Estimated remaining: 4h 46m 49s. Rate: 7.8 symbols/min [2025-09-22T17:19:00.940024] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:00.940305] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-22T17:19:00.940499] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-22T17:19:00.940837] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-22T17:19:00.940967] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-22T17:19:00.941091] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-22T17:19:00.941231] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-22T17:19:01.330468] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-22T17:19:01.336384] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:01.377119] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T17:19:02.122090] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-22T17:19:02.306364] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T17:19:02.711325] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-22T17:19:02.720748] [INFO ] [REMOTE ] ARR: Full fetch complete (75047 records). [2025-09-22T17:19:02.721044] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-22T17:19:02.927269] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-22T17:19:03.132855] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-22T17:19:03.132950] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-22T17:19:03.133724] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-22T17:19:03.133791] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-22T17:19:03.135327] [DEBUG] [LOCAL ] ARR: Trimmed 75047 records to 52064 (keeping 200 days of data) [2025-09-22T17:19:03.459523] [DEBUG] [LOCAL ] ARR: Primary data saved (52064 records). [2025-09-22T17:19:03.459706] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-22T17:19:03.459806] [INFO ] [MAIN ] Update Progress: 148/2372 symbols completed. ARR took 32.1s. Estimated remaining: 4h 45m 25s. Rate: 7.8 symbols/min [2025-09-22T17:19:03.635859] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:03.666812] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T17:19:03.726366] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-22T17:19:03.728775] [DEBUG] [LOCAL ] AS: Loaded 53846 existing records from primary storage. [2025-09-22T17:19:03.729029] [INFO ] [MAIN ] AS: Loaded 53846 existing records. [2025-09-22T17:19:03.916954] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:19:03.917278] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-22T17:19:03.917331] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-22T17:19:03.918576] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-22T17:19:03.918675] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-22T17:19:04.322459] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:04.344600] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T17:19:04.522077] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-22T17:19:05.322097] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-22T17:19:05.548976] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:19:05.559769] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T17:19:05.559091] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-22T17:19:05.567966] [INFO ] [REMOTE ] AROC: Full fetch complete (70502 records). [2025-09-22T17:19:05.568077] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-22T17:19:05.961814] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-22T17:19:05.961937] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-22T17:19:05.962697] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-22T17:19:05.962782] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-22T17:19:05.964609] [DEBUG] [LOCAL ] AROC: Trimmed 70502 records to 48989 (keeping 200 days of data) [2025-09-22T17:19:06.085769] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T17:19:06.122166] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-22T17:19:06.310857] [DEBUG] [LOCAL ] AROC: Primary data saved (48989 records). [2025-09-22T17:19:06.311029] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-22T17:19:06.311187] [INFO ] [MAIN ] Update Progress: 149/2372 symbols completed. AROC took 38.2s. Estimated remaining: 4h 44m 5s. Rate: 7.8 symbols/min [2025-09-22T17:19:06.483321] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:06.500525] [DEBUG] [LOCAL ] ASA: Loaded 13682 existing records from primary storage. [2025-09-22T17:19:06.500677] [INFO ] [MAIN ] ASA: Loaded 13682 existing records. [2025-09-22T17:19:06.678956] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:19:06.679262] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-22T17:19:06.679335] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-22T17:19:06.679856] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-22T17:19:06.679920] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-22T17:19:06.927178] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-22T17:19:07.066561] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:07.154959] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:19:07.155276] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-22T17:19:07.722111] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-22T17:19:08.023595] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T17:19:08.522115] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-22T17:19:08.715975] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:19:08.716295] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-22T17:19:09.255704] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T17:19:09.322008] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-22T17:19:10.122096] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-22T17:19:10.421453] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-22T17:19:10.427587] [INFO ] [REMOTE ] ARW: Full fetch complete (47852 records). [2025-09-22T17:19:10.427751] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-22T17:19:10.771274] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-22T17:19:10.837422] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-22T17:19:10.837494] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-22T17:19:10.838019] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-22T17:19:10.838123] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-22T17:19:10.839195] [DEBUG] [LOCAL ] ARW: Trimmed 47852 records to 33224 (keeping 200 days of data) [2025-09-22T17:19:10.936899] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-22T17:19:11.055960] [DEBUG] [LOCAL ] ARW: Primary data saved (33224 records). [2025-09-22T17:19:11.056146] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-22T17:19:11.056283] [INFO ] [MAIN ] Update Progress: 150/2372 symbols completed. ARW took 24.8s. Estimated remaining: 4h 43m 14s. Rate: 7.8 symbols/min [2025-09-22T17:19:11.234418] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:11.294178] [DEBUG] [LOCAL ] ASAN: Loaded 53526 existing records from primary storage. [2025-09-22T17:19:11.294341] [INFO ] [MAIN ] ASAN: Loaded 53526 existing records. [2025-09-22T17:19:11.475019] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:19:11.475266] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-22T17:19:11.475315] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-22T17:19:11.476445] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-22T17:19:11.476507] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-22T17:19:11.727407] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-22T17:19:11.864037] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:11.867073] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-22T17:19:12.522086] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-22T17:19:13.081782] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T17:19:13.322032] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-22T17:19:13.365293] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T17:19:14.122118] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-22T17:19:14.338779] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:19:14.339168] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-22T17:19:14.922060] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-22T17:19:15.170043] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:19:15.170328] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-22T17:19:15.356886] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-22T17:19:15.722073] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-22T17:19:15.918308] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:19:15.918612] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-22T17:19:16.522108] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-22T17:19:16.725987] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:19:16.726325] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-22T17:19:17.322065] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-22T17:19:17.963513] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T17:19:18.122100] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-22T17:19:18.922133] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-22T17:19:19.477204] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T17:19:19.722103] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-22T17:19:19.882175] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T17:19:20.522102] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-22T17:19:21.322030] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-22T17:19:21.368447] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T17:19:21.390257] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T17:19:22.122067] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-22T17:19:22.748101] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T17:19:22.922055] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-22T17:19:23.722113] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-22T17:19:23.765737] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T17:19:23.856466] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T17:19:24.522123] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-22T17:19:25.087985] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T17:19:25.094858] [INFO ] [REMOTE ] ARX: Full fetch complete (13229 records). [2025-09-22T17:19:25.094996] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-22T17:19:25.275579] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 42 unique days, need 200 days [2025-09-22T17:19:25.275889] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:19:25.275988] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:19:25.276084] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-22T17:19:25.276195] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-22T17:19:25.276252] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-22T17:19:25.276313] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-22T17:19:25.276395] [INFO ] [MAIN ] Update Progress: 151/2372 symbols completed. ARX took 24.5s. Estimated remaining: 4h 44m 43s. Rate: 7.8 symbols/min [2025-09-22T17:19:25.330558] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-22T17:19:25.450916] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:25.524101] [DEBUG] [LOCAL ] ASB: Loaded 50356 existing records from primary storage. [2025-09-22T17:19:25.524451] [INFO ] [MAIN ] ASB: Loaded 50356 existing records. [2025-09-22T17:19:25.707771] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:19:25.708255] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-22T17:19:25.708337] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-22T17:19:25.709518] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-22T17:19:25.709595] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-22T17:19:26.088334] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:26.122024] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-22T17:19:26.193715] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T17:19:26.219114] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T17:19:26.922107] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-22T17:19:27.722130] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-22T17:19:27.868879] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T17:19:28.522055] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-22T17:19:28.637166] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T17:19:28.792129] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-22T17:19:29.322082] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-22T17:19:29.697393] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T17:19:30.122077] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-22T17:19:30.922098] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-22T17:19:31.029738] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T17:19:31.576049] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T17:19:31.722095] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-22T17:19:32.522038] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-22T17:19:32.653963] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T17:19:33.322038] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-22T17:19:33.445712] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T17:19:33.528205] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T17:19:34.122102] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-22T17:19:34.845810] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T17:19:34.922087] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-22T17:19:35.189724] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T17:19:35.194028] [INFO ] [REMOTE ] ASA: Full fetch complete (18432 records). [2025-09-22T17:19:35.194139] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-22T17:19:35.583808] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-22T17:19:35.583911] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-22T17:19:35.584239] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-22T17:19:35.584321] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-22T17:19:35.585076] [DEBUG] [LOCAL ] ASA: Trimmed 18432 records to 13639 (keeping 200 days of data) [2025-09-22T17:19:35.677140] [DEBUG] [LOCAL ] ASA: Primary data saved (13639 records). [2025-09-22T17:19:35.677287] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-22T17:19:35.677459] [INFO ] [MAIN ] Update Progress: 152/2372 symbols completed. ASA took 29.4s. Estimated remaining: 4h 45m 15s. Rate: 7.8 symbols/min [2025-09-22T17:19:35.733272] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-22T17:19:35.852527] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:35.860890] [DEBUG] [LOCAL ] ASBA: Loaded 3461 existing records from primary storage. [2025-09-22T17:19:35.860987] [INFO ] [MAIN ] ASBA: Loaded 3461 existing records. [2025-09-22T17:19:36.041011] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:19:36.041275] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-22T17:19:36.041323] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-22T17:19:36.041562] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-22T17:19:36.041634] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-22T17:19:36.404577] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:36.472168] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T17:19:36.522027] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-22T17:19:37.141313] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T17:19:37.322099] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-22T17:19:37.810823] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T17:19:38.122097] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-22T17:19:38.922075] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-22T17:19:39.118248] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T17:19:39.362159] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-22T17:19:39.533627] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T17:19:39.722064] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-22T17:19:40.122058] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-22T17:19:40.522063] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-22T17:19:41.322063] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-22T17:19:41.947243] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T17:19:42.122067] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-22T17:19:42.510943] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-22T17:19:42.922060] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-22T17:19:43.722068] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-22T17:19:43.886062] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T17:19:43.895464] [INFO ] [REMOTE ] AS: Full fetch complete (76133 records). [2025-09-22T17:19:43.895633] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-22T17:19:43.896484] [FATAL] [VALIDATOR ] AS: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:19:43.896578] [FATAL] [MAIN ] AS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:19:43.896621] [WARN ] [MAIN ] AS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:19:43.896698] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-22T17:19:43.896771] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-22T17:19:43.896819] [INFO ] [LOCAL ] AS: Starting deletion of derivative data. [2025-09-22T17:19:43.897420] [DEBUG] [LOCAL ] AS: Deleted derivative data file. [2025-09-22T17:19:43.897547] [INFO ] [MAIN ] Update Progress: 153/2372 symbols completed. AS took 40.4s. Estimated remaining: 4h 45m 15s. Rate: 7.8 symbols/min [2025-09-22T17:19:44.089452] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:44.164992] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T17:19:44.176624] [DEBUG] [LOCAL ] ASC: Loaded 38686 existing records from primary storage. [2025-09-22T17:19:44.176990] [INFO ] [MAIN ] ASC: Loaded 38686 existing records. [2025-09-22T17:19:44.364558] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:19:44.365020] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-22T17:19:44.365083] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-22T17:19:44.366123] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-22T17:19:44.366184] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-22T17:19:44.527216] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-22T17:19:44.765438] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:45.184337] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-22T17:19:45.322042] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-22T17:19:45.788358] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-22T17:19:45.865742] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-22T17:19:46.122075] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-22T17:19:46.727348] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T17:19:46.922071] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-22T17:19:47.722050] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-22T17:19:48.114904] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-22T17:19:48.382323] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T17:19:48.522042] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-22T17:19:49.322059] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-22T17:19:49.781371] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-22T17:19:49.952552] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T17:19:50.122067] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-22T17:19:50.922131] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-22T17:19:51.722061] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-22T17:19:52.009542] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T17:19:52.522062] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-22T17:19:52.525018] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T17:19:53.322073] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-22T17:19:53.491236] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T17:19:53.500262] [INFO ] [REMOTE ] ASAN: Full fetch complete (76548 records). [2025-09-22T17:19:53.500462] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-22T17:19:53.916415] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-22T17:19:53.916518] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-22T17:19:53.917281] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-22T17:19:53.917349] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-22T17:19:53.920005] [DEBUG] [LOCAL ] ASAN: Trimmed 76548 records to 52755 (keeping 200 days of data) [2025-09-22T17:19:54.139502] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-22T17:19:54.262488] [DEBUG] [LOCAL ] ASAN: Primary data saved (52755 records). [2025-09-22T17:19:54.262841] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-22T17:19:54.263030] [INFO ] [MAIN ] Update Progress: 154/2372 symbols completed. ASAN took 43.2s. Estimated remaining: 4h 45m 46s. Rate: 7.8 symbols/min [2025-09-22T17:19:54.456681] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:54.480165] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-22T17:19:54.490324] [INFO ] [REMOTE ] ASB: Full fetch complete (71570 records). [2025-09-22T17:19:54.490516] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-22T17:19:54.633806] [DEBUG] [LOCAL ] ASG: Loaded 21328 existing records from primary storage. [2025-09-22T17:19:54.640181] [INFO ] [MAIN ] ASG: Loaded 21328 existing records. [2025-09-22T17:19:54.645721] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-22T17:19:54.929379] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-22T17:19:55.105764] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:19:55.141683] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-22T17:19:55.141814] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-22T17:19:55.159381] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-22T17:19:55.159556] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-22T17:19:55.160628] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-22T17:19:55.160803] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-22T17:19:55.161200] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-22T17:19:55.161318] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-22T17:19:55.243212] [DEBUG] [LOCAL ] ASB: Trimmed 71570 records to 49584 (keeping 200 days of data) [2025-09-22T17:19:55.441561] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-22T17:19:55.703967] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T17:19:55.706812] [INFO ] [REMOTE ] ASBA: Full fetch complete (5301 records). [2025-09-22T17:19:55.722883] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-22T17:19:55.707196] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-22T17:19:55.881444] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:56.263522] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-22T17:19:56.263859] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-22T17:19:56.264315] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-22T17:19:56.264612] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-22T17:19:56.266434] [DEBUG] [LOCAL ] ASBA: Trimmed 5301 records to 3446 (keeping 200 days of data) [2025-09-22T17:19:56.292924] [DEBUG] [LOCAL ] ASBA: Primary data saved (3446 records). [2025-09-22T17:19:56.293580] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-22T17:19:56.293941] [INFO ] [MAIN ] Update Progress: 155/2372 symbols completed. ASBA took 20.6s. Estimated remaining: 4h 44m 16s. Rate: 7.8 symbols/min [2025-09-22T17:19:56.479169] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:56.529000] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-22T17:19:56.555109] [DEBUG] [LOCAL ] ASGI: Loaded 22591 existing records from primary storage. [2025-09-22T17:19:56.555822] [INFO ] [MAIN ] ASGI: Loaded 22591 existing records. [2025-09-22T17:19:56.734805] [DEBUG] [LOCAL ] ASB: Primary data saved (49584 records). [2025-09-22T17:19:56.752517] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-22T17:19:56.761364] [INFO ] [MAIN ] Update Progress: 156/2372 symbols completed. ASB took 31.5s. Estimated remaining: 4h 42m 26s. Rate: 7.8 symbols/min [2025-09-22T17:19:56.761543] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:19:56.774531] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-22T17:19:56.774625] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-22T17:19:56.810269] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-22T17:19:56.831310] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-22T17:19:57.094252] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:19:57.371995] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:57.372785] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-22T17:19:57.406919] [DEBUG] [LOCAL ] ASGN: Loaded 36601 existing records from primary storage. [2025-09-22T17:19:57.408422] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T17:19:57.416521] [INFO ] [MAIN ] ASGN: Loaded 36601 existing records. [2025-09-22T17:19:57.611112] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:19:57.611368] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-22T17:19:57.611417] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-22T17:19:57.612331] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-22T17:19:57.612393] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-22T17:19:57.940889] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T17:19:58.008110] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:19:58.122063] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-22T17:19:58.641342] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T17:19:58.894614] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-22T17:19:58.922011] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-22T17:19:59.722081] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-22T17:20:00.137258] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T17:20:00.522112] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-22T17:20:01.322043] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-22T17:20:01.358023] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T17:20:01.619040] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T17:20:02.122076] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-22T17:20:02.926835] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-22T17:20:02.932762] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T17:20:03.189303] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T17:20:03.722100] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-22T17:20:04.262424] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T17:20:04.522065] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-22T17:20:04.848922] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T17:20:05.303314] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T17:20:05.322086] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-22T17:20:06.122165] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-22T17:20:06.719139] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T17:20:06.922115] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-22T17:20:07.220303] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T17:20:07.722095] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-22T17:20:08.158041] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T17:20:08.522107] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-22T17:20:09.043329] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-22T17:20:09.322077] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-22T17:20:09.681944] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T17:20:10.122100] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-22T17:20:10.238070] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-22T17:20:10.922096] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-22T17:20:11.296396] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T17:20:11.722073] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-22T17:20:12.360303] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T17:20:12.522044] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-22T17:20:12.667541] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T17:20:13.322057] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-22T17:20:14.122098] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-22T17:20:14.225488] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-22T17:20:14.299576] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T17:20:14.892306] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T17:20:14.922074] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-22T17:20:15.722061] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-22T17:20:15.875969] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T17:20:16.522103] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-22T17:20:16.553338] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T17:20:16.558469] [INFO ] [REMOTE ] ASG: Full fetch complete (31516 records). [2025-09-22T17:20:16.558571] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-22T17:20:16.939447] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-22T17:20:16.939537] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-22T17:20:16.939999] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-22T17:20:16.940078] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-22T17:20:16.941028] [DEBUG] [LOCAL ] ASG: Trimmed 31516 records to 20751 (keeping 200 days of data) [2025-09-22T17:20:17.062440] [DEBUG] [LOCAL ] ASG: Primary data saved (20751 records). [2025-09-22T17:20:17.062572] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-22T17:20:17.062680] [INFO ] [MAIN ] Update Progress: 157/2372 symbols completed. ASG took 22.8s. Estimated remaining: 4h 45m 17s. Rate: 7.8 symbols/min [2025-09-22T17:20:17.322079] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-22T17:20:17.598491] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T17:20:18.122108] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-22T17:20:18.922133] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-22T17:20:19.440347] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-22T17:20:19.446169] [INFO ] [REMOTE ] ASC: Full fetch complete (57328 records). [2025-09-22T17:20:19.446358] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-22T17:20:19.856106] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-22T17:20:19.856307] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-22T17:20:19.857003] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-22T17:20:19.857122] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-22T17:20:19.871872] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T17:20:19.872079] [DEBUG] [LOCAL ] ASC: Trimmed 57328 records to 37878 (keeping 200 days of data) [2025-09-22T17:20:19.878029] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-22T17:20:20.115824] [DEBUG] [LOCAL ] ASC: Primary data saved (37878 records). [2025-09-22T17:20:20.115988] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-22T17:20:20.116078] [INFO ] [MAIN ] Update Progress: 158/2372 symbols completed. ASC took 36.2s. Estimated remaining: 4h 44m 4s. Rate: 7.8 symbols/min [2025-09-22T17:20:20.550556] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (3.23 seconds). [2025-09-22T17:20:20.559139] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-22T17:20:21.087145] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-22T17:20:21.322109] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-22T17:20:21.988928] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T17:20:22.057429] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-22T17:20:22.122052] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-22T17:20:22.922078] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-22T17:20:23.296448] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T17:20:23.300980] [INFO ] [REMOTE ] ASGI: Full fetch complete (33372 records). [2025-09-22T17:20:23.301104] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-22T17:20:23.696601] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-22T17:20:23.696712] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-22T17:20:23.697168] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-22T17:20:23.697210] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-22T17:20:23.698028] [DEBUG] [LOCAL ] ASGI: Trimmed 33372 records to 22400 (keeping 200 days of data) [2025-09-22T17:20:23.838623] [DEBUG] [LOCAL ] ASGI: Primary data saved (22400 records). [2025-09-22T17:20:23.838820] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-22T17:20:23.838932] [INFO ] [MAIN ] Update Progress: 159/2372 symbols completed. ASGI took 27.5s. Estimated remaining: 4h 43m 1s. Rate: 7.8 symbols/min [2025-09-22T17:20:24.012356] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T17:20:24.020609] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-22T17:20:25.528612] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T17:20:25.541866] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-22T17:20:26.837564] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T17:20:26.846968] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-22T17:20:27.976606] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T17:20:27.985811] [INFO ] [REMOTE ] ASGN: Full fetch complete (51518 records). [2025-09-22T17:20:27.985970] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-22T17:20:28.399671] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-22T17:20:28.399794] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-22T17:20:28.400356] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-22T17:20:28.400398] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-22T17:20:28.401533] [DEBUG] [LOCAL ] ASGN: Trimmed 51518 records to 35998 (keeping 200 days of data) [2025-09-22T17:20:28.608699] [DEBUG] [LOCAL ] ASGN: Primary data saved (35998 records). [2025-09-22T17:20:28.608841] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-22T17:20:28.608927] [INFO ] [MAIN ] Update Progress: 160/2372 symbols completed. ASGN took 31.8s. Estimated remaining: 4h 42m 13s. Rate: 7.8 symbols/min [2025-09-22T17:20:29.167241] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:20:29.196943] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-09-22T17:20:29.239329] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-09-22T17:20:29.370886] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-22T17:20:29.370712] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:20:29.365411] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:20:29.371569] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-22T17:20:29.379705] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-22T17:20:29.406637] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-22T17:20:29.406275] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:20:29.559403] [DEBUG] [LOCAL ] ASR: Loaded 9307 existing records from primary storage. [2025-09-22T17:20:29.586366] [INFO ] [MAIN ] ASR: Loaded 9307 existing records. [2025-09-22T17:20:29.857748] [DEBUG] [LOCAL ] ASPN: Loaded 50351 existing records from primary storage. [2025-09-22T17:20:29.858853] [DEBUG] [LOCAL ] ASH: Loaded 38526 existing records from primary storage. [2025-09-22T17:20:29.869520] [INFO ] [MAIN ] ASPN: Loaded 50351 existing records. [2025-09-22T17:20:29.897676] [INFO ] [MAIN ] ASH: Loaded 38526 existing records. [2025-09-22T17:20:30.233415] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:20:30.257162] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:20:30.257464] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-22T17:20:30.277758] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-22T17:20:30.312528] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-22T17:20:30.379439] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-22T17:20:30.384716] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-22T17:20:30.410905] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:20:30.495065] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-22T17:20:30.517125] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-22T17:20:30.517264] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:20:30.556931] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-22T17:20:30.557194] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-22T17:20:30.557384] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-22T17:20:30.578106] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-22T17:20:30.613320] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-22T17:20:30.648538] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-22T17:20:31.234428] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:20:31.285534] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-22T17:20:31.504210] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:20:31.513265] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-22T17:20:31.589700] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:20:31.590030] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-22T17:20:31.600389] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T17:20:31.604539] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-22T17:20:32.311165] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T17:20:32.314723] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-22T17:20:32.588771] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T17:20:32.595689] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-22T17:20:32.644691] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T17:20:32.648762] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-22T17:20:32.791704] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T17:20:32.793701] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-22T17:20:33.372924] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T17:20:33.383957] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-22T17:20:33.395528] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-22T17:20:33.516713] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T17:20:33.653985] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T17:20:34.122120] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-22T17:20:34.895938] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T17:20:34.911450] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T17:20:34.921991] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-22T17:20:35.518389] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-22T17:20:35.722055] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-22T17:20:36.505364] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-22T17:20:36.522002] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-22T17:20:37.322063] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-22T17:20:37.344669] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T17:20:37.994231] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T17:20:38.122058] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-22T17:20:38.922054] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-22T17:20:39.591820] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T17:20:39.728974] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-22T17:20:39.734227] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T17:20:40.522072] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-22T17:20:41.322056] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-22T17:20:41.517358] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T17:20:42.006416] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T17:20:42.032545] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T17:20:42.122071] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-22T17:20:42.922054] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-22T17:20:43.722024] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-22T17:20:43.806463] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T17:20:44.247262] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T17:20:44.522058] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-22T17:20:44.599511] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T17:20:45.322066] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-22T17:20:45.963553] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T17:20:46.025417] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T17:20:46.122100] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-22T17:20:46.922054] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-22T17:20:47.078339] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T17:20:47.722058] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-22T17:20:48.388039] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T17:20:48.522045] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-22T17:20:49.322043] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-22T17:20:49.504937] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T17:20:49.600083] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-22T17:20:50.122061] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-22T17:20:50.663385] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T17:20:50.922059] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-22T17:20:51.254629] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T17:20:51.256867] [INFO ] [REMOTE ] ASR: Full fetch complete (12197 records). [2025-09-22T17:20:51.256940] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-22T17:20:51.257410] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:20:51.257521] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:20:51.257564] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:20:51.257602] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-22T17:20:51.257799] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-22T17:20:51.257867] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-09-22T17:20:51.258292] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-09-22T17:20:51.258401] [INFO ] [MAIN ] Update Progress: 161/2372 symbols completed. ASR took 22.6s. Estimated remaining: 4h 45m 31s. Rate: 7.7 symbols/min [2025-09-22T17:20:51.430615] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:20:51.488313] [DEBUG] [LOCAL ] ASX: Loaded 53698 existing records from primary storage. [2025-09-22T17:20:51.488459] [INFO ] [MAIN ] ASX: Loaded 53698 existing records. [2025-09-22T17:20:51.664328] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:20:51.664618] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-22T17:20:51.664699] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-22T17:20:51.667130] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-22T17:20:51.667191] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-22T17:20:51.722062] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-22T17:20:52.023111] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:20:52.217251] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T17:20:52.522044] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-22T17:20:52.940256] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T17:20:53.322049] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-22T17:20:54.122037] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-22T17:20:54.310939] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T17:20:54.569426] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T17:20:54.922118] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-22T17:20:55.722061] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-22T17:20:56.034038] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T17:20:56.207971] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T17:20:56.522055] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-22T17:20:56.769093] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T17:20:56.774758] [INFO ] [REMOTE ] ASH: Full fetch complete (54419 records). [2025-09-22T17:20:56.774928] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-22T17:20:57.184665] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-22T17:20:57.184801] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-22T17:20:57.185597] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-22T17:20:57.185689] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-22T17:20:57.187063] [DEBUG] [LOCAL ] ASH: Trimmed 54419 records to 37815 (keeping 200 days of data) [2025-09-22T17:20:57.366939] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-22T17:20:57.430969] [DEBUG] [LOCAL ] ASH: Primary data saved (37815 records). [2025-09-22T17:20:57.431144] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-22T17:20:57.433140] [INFO ] [MAIN ] Update Progress: 162/2372 symbols completed. ASH took 28.8s. Estimated remaining: 4h 45m 2s. Rate: 7.8 symbols/min [2025-09-22T17:20:57.605970] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:20:57.654016] [DEBUG] [LOCAL ] ATEN: Loaded 40681 existing records from primary storage. [2025-09-22T17:20:57.654165] [INFO ] [MAIN ] ATEN: Loaded 40681 existing records. [2025-09-22T17:20:57.829834] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:20:57.830100] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-22T17:20:57.830149] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-22T17:20:57.832413] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-22T17:20:57.832479] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-22T17:20:58.128353] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-22T17:20:58.211484] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:20:58.228878] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-22T17:20:58.232909] [INFO ] [REMOTE ] ASIX: Full fetch complete (29672 records). [2025-09-22T17:20:58.233044] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-22T17:20:58.623904] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-22T17:20:58.624087] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-22T17:20:58.624798] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-22T17:20:58.624878] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-22T17:20:58.654884] [DEBUG] [LOCAL ] ASIX: Trimmed 29672 records to 22422 (keeping 200 days of data) [2025-09-22T17:20:58.657032] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-22T17:20:58.803571] [DEBUG] [LOCAL ] ASIX: Primary data saved (22422 records). [2025-09-22T17:20:58.803741] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-22T17:20:58.803832] [INFO ] [MAIN ] Update Progress: 163/2372 symbols completed. ASIX took 30.2s. Estimated remaining: 4h 43m 28s. Rate: 7.8 symbols/min [2025-09-22T17:20:58.927303] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-22T17:20:58.986555] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:20:59.022415] [DEBUG] [LOCAL ] ATGE: Loaded 32625 existing records from primary storage. [2025-09-22T17:20:59.022561] [INFO ] [MAIN ] ATGE: Loaded 32625 existing records. [2025-09-22T17:20:59.217424] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:20:59.217867] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-22T17:20:59.217952] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-22T17:20:59.220185] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-22T17:20:59.220283] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-22T17:20:59.641482] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:20:59.703481] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T17:20:59.722035] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-22T17:21:00.348255] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T17:21:00.522114] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-22T17:21:01.322271] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-22T17:21:01.523041] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T17:21:01.530816] [INFO ] [REMOTE ] ASPN: Full fetch complete (72361 records). [2025-09-22T17:21:01.530956] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-22T17:21:01.955715] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-22T17:21:01.955810] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-22T17:21:01.956536] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-22T17:21:01.956584] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-22T17:21:01.958535] [DEBUG] [LOCAL ] ASPN: Trimmed 72361 records to 49599 (keeping 200 days of data) [2025-09-22T17:21:02.149797] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-22T17:21:02.297609] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T17:21:02.326234] [DEBUG] [LOCAL ] ASPN: Primary data saved (49599 records). [2025-09-22T17:21:02.326429] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-22T17:21:02.326538] [INFO ] [MAIN ] Update Progress: 164/2372 symbols completed. ASPN took 33.7s. Estimated remaining: 4h 42m 24s. Rate: 7.8 symbols/min [2025-09-22T17:21:02.527027] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:21:02.565093] [DEBUG] [LOCAL ] ATHM: Loaded 33480 existing records from primary storage. [2025-09-22T17:21:02.565234] [INFO ] [MAIN ] ATHM: Loaded 33480 existing records. [2025-09-22T17:21:02.745098] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:21:02.745357] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-22T17:21:02.745404] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-22T17:21:02.746297] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-22T17:21:02.746357] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-22T17:21:02.949242] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-22T17:21:03.143222] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:21:03.722109] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-22T17:21:03.914693] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T17:21:04.522125] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-22T17:21:04.798892] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (3.48 seconds). [2025-09-22T17:21:05.131080] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T17:21:05.322068] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-22T17:21:05.403430] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-22T17:21:05.650922] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-22T17:21:06.122052] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-22T17:21:06.822248] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T17:21:06.922117] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-22T17:21:07.161377] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-22T17:21:07.722152] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-22T17:21:07.946311] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-22T17:21:08.522137] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-22T17:21:09.259983] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T17:21:09.322061] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-22T17:21:09.847586] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T17:21:10.122086] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-22T17:21:10.738543] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T17:21:10.922107] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-22T17:21:11.629962] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T17:21:11.722018] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-22T17:21:12.522079] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-22T17:21:12.655678] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T17:21:13.322087] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-22T17:21:13.376132] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T17:21:13.962418] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T17:21:14.122070] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-22T17:21:14.922093] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-22T17:21:14.975930] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T17:21:15.533724] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T17:21:15.722108] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-22T17:21:16.522107] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-22T17:21:16.812708] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T17:21:16.877942] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T17:21:17.322061] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-22T17:21:17.620624] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T17:21:18.122060] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-22T17:21:18.922048] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-22T17:21:19.396239] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-22T17:21:19.718879] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T17:21:19.726435] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-22T17:21:20.492681] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T17:21:20.522126] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-22T17:21:20.765129] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T17:21:21.322078] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-22T17:21:22.122067] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-22T17:21:22.226588] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-22T17:21:22.327782] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T17:21:22.922049] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-22T17:21:23.259293] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T17:21:23.722110] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-22T17:21:24.410250] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T17:21:24.418576] [INFO ] [REMOTE ] ASX: Full fetch complete (76636 records). [2025-09-22T17:21:24.418751] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-22T17:21:24.527135] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-22T17:21:24.829893] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-22T17:21:24.830033] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-22T17:21:24.830907] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-22T17:21:24.830977] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-22T17:21:24.832621] [DEBUG] [LOCAL ] ASX: Trimmed 76636 records to 52907 (keeping 200 days of data) [2025-09-22T17:21:25.179301] [DEBUG] [LOCAL ] ASX: Primary data saved (52907 records). [2025-09-22T17:21:25.179462] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-22T17:21:25.181084] [INFO ] [MAIN ] Update Progress: 165/2372 symbols completed. ASX took 33.9s. Estimated remaining: 4h 45m 39s. Rate: 7.7 symbols/min [2025-09-22T17:21:25.324665] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-22T17:21:25.358424] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:21:25.391697] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T17:21:25.407102] [DEBUG] [LOCAL ] ATHS: Loaded 7291 existing records from primary storage. [2025-09-22T17:21:25.407600] [INFO ] [MAIN ] ATHS: Loaded 7291 existing records. [2025-09-22T17:21:25.623331] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:21:25.623923] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-22T17:21:25.624108] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-22T17:21:25.630165] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-22T17:21:25.639958] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-22T17:21:25.674064] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T17:21:26.006954] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:21:26.122047] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-22T17:21:26.459576] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-22T17:21:26.922071] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-22T17:21:26.964497] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T17:21:27.722063] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-22T17:21:27.871538] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T17:21:27.876263] [INFO ] [REMOTE ] ATGE: Full fetch complete (46209 records). [2025-09-22T17:21:27.876366] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-22T17:21:28.257449] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-22T17:21:28.257543] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-22T17:21:28.258074] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-22T17:21:28.258137] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-22T17:21:28.259286] [DEBUG] [LOCAL ] ATGE: Trimmed 46209 records to 32042 (keeping 200 days of data) [2025-09-22T17:21:28.471336] [DEBUG] [LOCAL ] ATGE: Primary data saved (32042 records). [2025-09-22T17:21:28.471503] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-22T17:21:28.471593] [INFO ] [MAIN ] Update Progress: 166/2372 symbols completed. ATGE took 29.7s. Estimated remaining: 4h 44m 32s. Rate: 7.8 symbols/min [2025-09-22T17:21:28.527275] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-22T17:21:28.666364] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:21:28.666590] [DEBUG] [LOCAL ] ATI: No existing data file found in primary storage. [2025-09-22T17:21:28.666632] [WARN ] [MAIN ] ATI: No existing data found, performing full refresh instead. [2025-09-22T17:21:28.666793] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-22T17:21:28.666836] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-22T17:21:28.666876] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-09-22T17:21:28.666909] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-22T17:21:29.031447] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:21:29.051160] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T17:21:29.322059] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-22T17:21:29.719857] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T17:21:30.122116] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-22T17:21:30.708409] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:21:30.922046] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-22T17:21:31.289518] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T17:21:31.293815] [INFO ] [REMOTE ] ATHM: Full fetch complete (52111 records). [2025-09-22T17:21:31.293963] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-22T17:21:31.691441] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-22T17:21:31.691535] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-22T17:21:31.692106] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-22T17:21:31.692170] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-22T17:21:31.693275] [DEBUG] [LOCAL ] ATHM: Trimmed 52111 records to 32743 (keeping 200 days of data) [2025-09-22T17:21:31.741320] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-22T17:21:31.892500] [DEBUG] [LOCAL ] ATHM: Primary data saved (32743 records). [2025-09-22T17:21:31.892675] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-22T17:21:31.892779] [INFO ] [MAIN ] Update Progress: 167/2372 symbols completed. ATHM took 29.6s. Estimated remaining: 4h 43m 27s. Rate: 7.8 symbols/min [2025-09-22T17:21:32.063942] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:21:32.105598] [DEBUG] [LOCAL ] ATKR: Loaded 36395 existing records from primary storage. [2025-09-22T17:21:32.105826] [INFO ] [MAIN ] ATKR: Loaded 36395 existing records. [2025-09-22T17:21:32.293411] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:21:32.293916] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-22T17:21:32.294184] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-22T17:21:32.296267] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-22T17:21:32.296345] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-22T17:21:32.419266] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T17:21:32.522529] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-22T17:21:32.572244] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T17:21:32.751923] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:21:33.096132] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T17:21:33.322063] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-22T17:21:34.122064] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-22T17:21:34.922043] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-22T17:21:35.213322] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T17:21:35.722121] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-22T17:21:35.957103] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T17:21:36.196506] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-22T17:21:36.522101] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-22T17:21:36.632057] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T17:21:36.638215] [INFO ] [REMOTE ] ATEN: Full fetch complete (57524 records). [2025-09-22T17:21:36.638357] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-22T17:21:37.018198] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-22T17:21:37.018300] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-22T17:21:37.018979] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-22T17:21:37.019048] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-22T17:21:37.020527] [DEBUG] [LOCAL ] ATEN: Trimmed 57524 records to 39993 (keeping 200 days of data) [2025-09-22T17:21:37.275222] [DEBUG] [LOCAL ] ATEN: Primary data saved (39993 records). [2025-09-22T17:21:37.275386] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-22T17:21:37.275488] [INFO ] [MAIN ] Update Progress: 168/2372 symbols completed. ATEN took 39.8s. Estimated remaining: 4h 42m 49s. Rate: 7.8 symbols/min [2025-09-22T17:21:37.329939] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-22T17:21:37.452268] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:21:37.497492] [DEBUG] [LOCAL ] ATMU: Loaded 40306 existing records from primary storage. [2025-09-22T17:21:37.497706] [INFO ] [MAIN ] ATMU: Loaded 40306 existing records. [2025-09-22T17:21:37.677153] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:21:37.677458] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-22T17:21:37.677511] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-22T17:21:37.680379] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-22T17:21:37.680444] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-22T17:21:38.086233] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:21:38.116733] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T17:21:38.127797] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-22T17:21:38.601399] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T17:21:38.922087] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-22T17:21:39.588878] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T17:21:39.722067] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-22T17:21:40.139196] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T17:21:40.522108] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-22T17:21:40.531447] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T17:21:41.322106] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-22T17:21:41.859403] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T17:21:42.122060] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-22T17:21:42.835456] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T17:21:42.922064] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-22T17:21:43.305260] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-22T17:21:43.722055] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-22T17:21:44.434527] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T17:21:44.522186] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-22T17:21:44.645286] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T17:21:45.073980] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-22T17:21:45.322053] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-22T17:21:46.122064] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-22T17:21:46.814731] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T17:21:46.886251] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T17:21:46.922019] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-22T17:21:47.603968] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T17:21:47.722060] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-22T17:21:48.522060] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-22T17:21:49.318054] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T17:21:49.322598] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-22T17:21:49.944561] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T17:21:50.051884] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T17:21:50.053374] [INFO ] [REMOTE ] ATHS: Full fetch complete (10048 records). [2025-09-22T17:21:50.053443] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-22T17:21:50.127258] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-22T17:21:50.450617] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-22T17:21:50.450740] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-22T17:21:50.451112] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-22T17:21:50.451154] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-22T17:21:50.451760] [DEBUG] [LOCAL ] ATHS: Trimmed 10048 records to 7074 (keeping 200 days of data) [2025-09-22T17:21:50.502237] [DEBUG] [LOCAL ] ATHS: Primary data saved (7074 records). [2025-09-22T17:21:50.502407] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-22T17:21:50.502500] [INFO ] [MAIN ] Update Progress: 169/2372 symbols completed. ATHS took 25.3s. Estimated remaining: 4h 43m 53s. Rate: 7.8 symbols/min [2025-09-22T17:21:50.686034] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:21:50.746089] [DEBUG] [LOCAL ] ATO: Loaded 42708 existing records from primary storage. [2025-09-22T17:21:50.746302] [INFO ] [MAIN ] ATO: Loaded 42708 existing records. [2025-09-22T17:21:50.928792] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-22T17:21:50.934912] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:21:50.936978] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-22T17:21:50.937046] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-22T17:21:50.939864] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-22T17:21:50.939933] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-22T17:21:51.301473] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:21:51.722093] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-22T17:21:51.845133] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T17:21:52.522086] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-22T17:21:52.721019] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T17:21:53.308554] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T17:21:53.322002] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-22T17:21:54.122006] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-22T17:21:54.212508] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T17:21:54.596677] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T17:21:54.922133] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-22T17:21:55.130931] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T17:21:55.722115] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-22T17:21:56.023959] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T17:21:56.522086] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-22T17:21:56.715032] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T17:21:57.322080] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-22T17:21:57.599429] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-22T17:21:58.122073] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-22T17:21:58.706159] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T17:21:58.922065] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-22T17:21:59.246605] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T17:21:59.722123] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-22T17:22:00.364583] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T17:22:00.522087] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-22T17:22:01.109159] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T17:22:01.322072] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-22T17:22:02.119319] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T17:22:02.132409] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-22T17:22:02.922126] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-22T17:22:03.086204] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T17:22:03.094281] [INFO ] [REMOTE ] ATI: Full fetch complete (73776 records). [2025-09-22T17:22:03.094433] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-22T17:22:03.542293] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-22T17:22:03.542496] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-22T17:22:03.543362] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-22T17:22:03.543518] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-22T17:22:03.546909] [DEBUG] [LOCAL ] ATI: Trimmed 73776 records to 51595 (keeping 200 days of data) [2025-09-22T17:22:03.696199] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T17:22:03.722623] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-22T17:22:03.958857] [DEBUG] [LOCAL ] ATI: Primary data saved (51595 records). [2025-09-22T17:22:03.959074] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-22T17:22:03.959219] [INFO ] [MAIN ] Update Progress: 170/2372 symbols completed. ATI took 35.5s. Estimated remaining: 4h 44m 60s. Rate: 7.7 symbols/min [2025-09-22T17:22:04.148090] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:22:04.198034] [DEBUG] [LOCAL ] ATR: Loaded 30949 existing records from primary storage. [2025-09-22T17:22:04.198384] [INFO ] [MAIN ] ATR: Loaded 30949 existing records. [2025-09-22T17:22:04.385550] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T17:22:04.413505] [INFO ] [REMOTE ] ATMU: Full fetch complete (56753 records). [2025-09-22T17:22:04.422497] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-22T17:22:04.436920] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:22:04.517817] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-22T17:22:04.535910] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-22T17:22:04.539229] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-22T17:22:04.546221] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-22T17:22:04.546454] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-22T17:22:05.200570] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-22T17:22:05.207308] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-22T17:22:05.233292] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:22:05.229204] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-22T17:22:05.233837] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-22T17:22:05.261790] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T17:22:05.268746] [DEBUG] [LOCAL ] ATMU: Trimmed 56753 records to 39666 (keeping 200 days of data) [2025-09-22T17:22:05.270311] [INFO ] [REMOTE ] ATKR: Full fetch complete (53586 records). [2025-09-22T17:22:05.270445] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-22T17:22:05.340582] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-22T17:22:05.871463] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-22T17:22:05.871950] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-22T17:22:05.927848] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-22T17:22:05.936617] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-22T17:22:05.945731] [DEBUG] [LOCAL ] ATMU: Primary data saved (39666 records). [2025-09-22T17:22:05.946238] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-22T17:22:05.946527] [INFO ] [MAIN ] Update Progress: 171/2372 symbols completed. ATMU took 28.7s. Estimated remaining: 4h 43m 38s. Rate: 7.8 symbols/min [2025-09-22T17:22:06.013221] [DEBUG] [LOCAL ] ATKR: Trimmed 53586 records to 35746 (keeping 200 days of data) [2025-09-22T17:22:06.231917] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:22:06.287928] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T17:22:06.302335] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-22T17:22:06.367959] [DEBUG] [LOCAL ] ATS: Loaded 18502 existing records from primary storage. [2025-09-22T17:22:06.368458] [INFO ] [MAIN ] ATS: Loaded 18502 existing records. [2025-09-22T17:22:06.596489] [DEBUG] [LOCAL ] ATKR: Primary data saved (35746 records). [2025-09-22T17:22:06.611093] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-22T17:22:06.611287] [INFO ] [MAIN ] Update Progress: 172/2372 symbols completed. ATKR took 34.7s. Estimated remaining: 4h 41m 59s. Rate: 7.8 symbols/min [2025-09-22T17:22:06.610950] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:22:06.688120] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-22T17:22:06.711706] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-22T17:22:06.727216] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-22T17:22:06.756152] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-22T17:22:06.791294] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:22:07.040325] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T17:22:07.083080] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-22T17:22:07.202742] [DEBUG] [LOCAL ] ATUS: Loaded 49936 existing records from primary storage. [2025-09-22T17:22:07.206310] [INFO ] [MAIN ] ATUS: Loaded 49936 existing records. [2025-09-22T17:22:07.313910] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:22:07.426052] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:22:07.426356] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-22T17:22:07.426407] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-22T17:22:07.428618] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-22T17:22:07.428705] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-22T17:22:07.727226] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-22T17:22:07.791426] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:22:07.900639] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T17:22:08.490471] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T17:22:08.522149] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-22T17:22:08.859579] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T17:22:09.322072] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-22T17:22:09.889083] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T17:22:10.122051] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-22T17:22:10.922088] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-22T17:22:10.945087] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T17:22:11.616939] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T17:22:11.722027] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-22T17:22:11.901383] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-22T17:22:12.522102] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-22T17:22:13.081522] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T17:22:13.322071] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-22T17:22:14.122044] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-22T17:22:14.262342] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T17:22:14.313403] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T17:22:14.922082] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-22T17:22:15.049011] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T17:22:15.722097] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-22T17:22:15.924541] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-22T17:22:16.522150] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-22T17:22:16.957251] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T17:22:17.322071] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-22T17:22:17.845592] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T17:22:18.122095] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-22T17:22:18.604692] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-22T17:22:18.922068] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-22T17:22:19.519317] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T17:22:19.722051] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-22T17:22:20.232269] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-22T17:22:20.522029] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-22T17:22:20.805343] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T17:22:21.322071] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-22T17:22:21.904962] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T17:22:21.959075] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T17:22:22.122054] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-22T17:22:22.922088] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-22T17:22:23.298281] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T17:22:23.722068] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-22T17:22:24.241160] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T17:22:24.522114] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-22T17:22:25.073197] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T17:22:25.322074] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-22T17:22:25.624606] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T17:22:26.122103] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-22T17:22:26.315470] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T17:22:26.922089] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-22T17:22:27.722026] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-22T17:22:27.774150] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T17:22:27.805184] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T17:22:28.522078] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-22T17:22:29.322068] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-22T17:22:29.457816] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T17:22:29.792047] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T17:22:30.122066] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-22T17:22:30.439396] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T17:22:30.922055] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-22T17:22:31.710532] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T17:22:31.720501] [INFO ] [REMOTE ] ATO: Full fetch complete (60403 records). [2025-09-22T17:22:31.720709] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-22T17:22:31.727108] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-22T17:22:32.147038] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-22T17:22:32.147465] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-22T17:22:32.161122] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-22T17:22:32.161301] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-22T17:22:32.162896] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T17:22:32.168539] [INFO ] [REMOTE ] ATR: Full fetch complete (43325 records). [2025-09-22T17:22:32.168692] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-22T17:22:32.168789] [DEBUG] [LOCAL ] ATO: Trimmed 60403 records to 42015 (keeping 200 days of data) [2025-09-22T17:22:32.532697] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-22T17:22:32.710831] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-22T17:22:32.711168] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-22T17:22:32.712324] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-22T17:22:32.712887] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-22T17:22:32.716975] [DEBUG] [LOCAL ] ATR: Trimmed 43325 records to 30532 (keeping 200 days of data) [2025-09-22T17:22:33.058310] [DEBUG] [LOCAL ] ATR: Primary data saved (30532 records). [2025-09-22T17:22:33.059520] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-22T17:22:33.059912] [INFO ] [MAIN ] Update Progress: 173/2372 symbols completed. ATR took 29.1s. Estimated remaining: 4h 45m 50s. Rate: 7.7 symbols/min [2025-09-22T17:22:33.262347] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:22:33.284247] [DEBUG] [LOCAL ] ATO: Primary data saved (42015 records). [2025-09-22T17:22:33.284422] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-22T17:22:33.285340] [INFO ] [MAIN ] Update Progress: 174/2372 symbols completed. ATO took 42.8s. Estimated remaining: 4h 44m 7s. Rate: 7.7 symbols/min [2025-09-22T17:22:33.553444] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:22:33.555132] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-22T17:22:33.557169] [DEBUG] [LOCAL ] AU: Loaded 53682 existing records from primary storage. [2025-09-22T17:22:33.557729] [INFO ] [MAIN ] AU: Loaded 53682 existing records. [2025-09-22T17:22:33.567476] [DEBUG] [LOCAL ] AUB: No existing data file found in primary storage. [2025-09-22T17:22:33.573610] [WARN ] [MAIN ] AUB: No existing data found, performing full refresh instead. [2025-09-22T17:22:33.584025] [INFO ] [REMOTE ] ATS: Full fetch complete (25846 records). [2025-09-22T17:22:33.584380] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-22T17:22:33.596353] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-22T17:22:33.651041] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-22T17:22:33.711791] [DEBUG] [LOCAL ] AUB: No primary data file found to delete. [2025-09-22T17:22:33.718515] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-22T17:22:33.721743] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-22T17:22:33.910870] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-22T17:22:34.307443] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:22:34.381901] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-22T17:22:34.416922] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-22T17:22:34.558850] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-22T17:22:34.584952] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-22T17:22:34.991009] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:22:35.065467] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-22T17:22:35.074532] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-22T17:22:35.103668] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-22T17:22:35.146737] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-22T17:22:35.163591] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-22T17:22:35.201939] [DEBUG] [LOCAL ] ATS: Trimmed 25846 records to 18112 (keeping 200 days of data) [2025-09-22T17:22:35.360698] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:22:35.361318] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-22T17:22:35.393154] [DEBUG] [LOCAL ] ATS: Primary data saved (18112 records). [2025-09-22T17:22:35.393321] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-22T17:22:35.393420] [INFO ] [MAIN ] Update Progress: 175/2372 symbols completed. ATS took 29.4s. Estimated remaining: 4h 42m 48s. Rate: 7.8 symbols/min [2025-09-22T17:22:35.568686] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:22:35.568850] [DEBUG] [LOCAL ] AUNA: No existing data file found in primary storage. [2025-09-22T17:22:35.568904] [WARN ] [MAIN ] AUNA: No existing data found, performing full refresh instead. [2025-09-22T17:22:35.569057] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-22T17:22:35.569101] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-22T17:22:35.569144] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-09-22T17:22:35.569364] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-22T17:22:35.971187] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:22:35.971601] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-22T17:22:35.994588] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-22T17:22:36.003849] [INFO ] [REMOTE ] ATUS: Full fetch complete (70894 records). [2025-09-22T17:22:36.004017] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-22T17:22:36.411415] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-22T17:22:36.411528] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-22T17:22:36.412309] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-22T17:22:36.412385] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-22T17:22:36.414071] [DEBUG] [LOCAL ] ATUS: Trimmed 70894 records to 49259 (keeping 200 days of data) [2025-09-22T17:22:36.704810] [DEBUG] [LOCAL ] ATUS: Primary data saved (49259 records). [2025-09-22T17:22:36.704988] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-22T17:22:36.705084] [INFO ] [MAIN ] Update Progress: 176/2372 symbols completed. ATUS took 30.1s. Estimated remaining: 4h 41m 20s. Rate: 7.8 symbols/min [2025-09-22T17:22:36.851753] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T17:22:36.881013] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-22T17:22:36.949561] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:22:36.983101] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T17:22:37.035929] [DEBUG] [LOCAL ] AVA: Loaded 40280 existing records from primary storage. [2025-09-22T17:22:37.036103] [INFO ] [MAIN ] AVA: Loaded 40280 existing records. [2025-09-22T17:22:37.247277] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:22:37.247738] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-22T17:22:37.247858] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-22T17:22:37.258904] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-22T17:22:37.264100] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-22T17:22:37.333232] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-22T17:22:37.385212] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T17:22:37.587206] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T17:22:37.677967] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:22:38.122060] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-22T17:22:38.890208] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T17:22:38.922075] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-22T17:22:39.722068] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-22T17:22:39.994986] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T17:22:40.085910] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-22T17:22:40.522054] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-22T17:22:41.187413] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T17:22:41.322070] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-22T17:22:41.589800] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T17:22:42.122065] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-22T17:22:42.821560] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T17:22:42.922053] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-22T17:22:43.442627] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T17:22:43.722054] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-22T17:22:44.522083] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-22T17:22:44.783206] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T17:22:44.906623] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-22T17:22:45.253053] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:22:45.322019] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-22T17:22:46.122055] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-22T17:22:46.626505] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T17:22:46.693915] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-22T17:22:46.922066] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-22T17:22:47.722064] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-22T17:22:48.076439] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T17:22:48.522052] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-22T17:22:49.322055] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-22T17:22:49.850709] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-22T17:22:49.872947] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-22T17:22:50.057886] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T17:22:50.122121] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-22T17:22:50.922089] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-22T17:22:51.333832] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-22T17:22:51.613677] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T17:22:51.722076] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-22T17:22:52.133521] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-22T17:22:52.522100] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-22T17:22:53.163790] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T17:22:53.322075] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-22T17:22:54.122089] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-22T17:22:54.531688] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-22T17:22:54.537301] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T17:22:54.922079] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-22T17:22:55.722068] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-22T17:22:56.236293] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-22T17:22:56.237797] [INFO ] [REMOTE ] AUNA: Full fetch complete (7409 records). [2025-09-22T17:22:56.237867] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-22T17:22:56.527299] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-22T17:22:56.638907] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-22T17:22:56.638998] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-22T17:22:56.639223] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-22T17:22:56.639274] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-22T17:22:56.639741] [DEBUG] [LOCAL ] AUNA: Trimmed 7409 records to 4683 (keeping 200 days of data) [2025-09-22T17:22:56.665818] [DEBUG] [LOCAL ] AUNA: Primary data saved (4683 records). [2025-09-22T17:22:56.665935] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-22T17:22:56.666009] [INFO ] [MAIN ] Update Progress: 177/2372 symbols completed. AUNA took 21.3s. Estimated remaining: 4h 43m 45s. Rate: 7.7 symbols/min [2025-09-22T17:22:56.843406] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:22:56.854434] [DEBUG] [LOCAL ] AVAL: Loaded 9642 existing records from primary storage. [2025-09-22T17:22:56.854579] [INFO ] [MAIN ] AVAL: Loaded 9642 existing records. [2025-09-22T17:22:57.044028] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:22:57.044585] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-22T17:22:57.044885] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-22T17:22:57.045817] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-22T17:22:57.045883] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-22T17:22:57.324897] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-22T17:22:57.284328] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-22T17:22:57.505268] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:22:57.957179] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T17:22:58.122083] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-22T17:22:58.922088] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-22T17:22:58.987028] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T17:22:59.722060] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-22T17:22:59.944169] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T17:23:00.522144] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-22T17:23:01.330550] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-22T17:23:01.333387] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T17:23:01.340633] [INFO ] [REMOTE ] AUB: Full fetch complete (65363 records). [2025-09-22T17:23:01.340791] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-22T17:23:01.752060] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-22T17:23:01.752200] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-22T17:23:01.752975] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-22T17:23:01.753046] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-22T17:23:01.755080] [DEBUG] [LOCAL ] AUB: Trimmed 65363 records to 46477 (keeping 200 days of data) [2025-09-22T17:23:02.070639] [DEBUG] [LOCAL ] AUB: Primary data saved (46477 records). [2025-09-22T17:23:02.070840] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-22T17:23:02.070924] [INFO ] [MAIN ] Update Progress: 178/2372 symbols completed. AUB took 28.8s. Estimated remaining: 4h 43m 8s. Rate: 7.7 symbols/min [2025-09-22T17:23:02.249277] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:23:02.249492] [DEBUG] [LOCAL ] AVB: No existing data file found in primary storage. [2025-09-22T17:23:02.249537] [WARN ] [MAIN ] AVB: No existing data found, performing full refresh instead. [2025-09-22T17:23:02.249786] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-22T17:23:02.249852] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-22T17:23:02.249903] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-09-22T17:23:02.249943] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-22T17:23:02.677848] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:23:02.678464] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-22T17:23:02.744520] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-22T17:23:02.746285] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T17:23:02.922093] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-22T17:23:03.722080] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-22T17:23:03.897440] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T17:23:04.522123] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-22T17:23:05.124238] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (6.20 seconds). [2025-09-22T17:23:05.322171] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-22T17:23:05.899074] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T17:23:06.019509] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T17:23:06.122009] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-22T17:23:06.261845] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-22T17:23:06.589749] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (3.67 seconds). [2025-09-22T17:23:06.922056] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-22T17:23:07.300034] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T17:23:07.722079] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-22T17:23:08.007574] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T17:23:08.522072] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-22T17:23:09.026973] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T17:23:09.104950] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-22T17:23:09.322073] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-22T17:23:10.122154] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-22T17:23:10.922063] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-22T17:23:11.163775] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T17:23:11.169882] [INFO ] [REMOTE ] AVA: Full fetch complete (55496 records). [2025-09-22T17:23:11.169991] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-22T17:23:11.598227] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-22T17:23:11.598748] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-22T17:23:11.599828] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-22T17:23:11.599938] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-22T17:23:11.611855] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-22T17:23:11.616881] [DEBUG] [LOCAL ] AVA: Trimmed 55496 records to 39610 (keeping 200 days of data) [2025-09-22T17:23:11.737772] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-22T17:23:11.742930] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-22T17:23:11.907548] [DEBUG] [LOCAL ] AVA: Primary data saved (39610 records). [2025-09-22T17:23:11.907732] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-22T17:23:11.907831] [INFO ] [MAIN ] Update Progress: 179/2372 symbols completed. AVA took 35.2s. Estimated remaining: 4h 43m 26s. Rate: 7.7 symbols/min [2025-09-22T17:23:12.078036] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:23:12.078247] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-22T17:23:12.078301] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-22T17:23:12.078468] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-22T17:23:12.078511] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-22T17:23:12.078552] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-22T17:23:12.078626] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-22T17:23:12.452011] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:23:12.522061] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-22T17:23:12.788316] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:23:12.788695] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-22T17:23:13.322069] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-22T17:23:13.476912] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T17:23:13.919140] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-22T17:23:14.122058] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-22T17:23:14.922093] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-22T17:23:15.714224] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T17:23:15.721990] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-22T17:23:15.871741] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T17:23:16.160677] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-22T17:23:16.522084] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-22T17:23:16.724718] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:23:16.725145] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-22T17:23:17.322057] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-22T17:23:18.122146] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-22T17:23:18.310955] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:23:18.311329] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-22T17:23:18.922130] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-22T17:23:19.432987] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-22T17:23:19.445241] [INFO ] [REMOTE ] AU: Full fetch complete (76259 records). [2025-09-22T17:23:19.445455] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-22T17:23:19.727340] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-22T17:23:19.844299] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-22T17:23:19.844383] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-22T17:23:19.845156] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-22T17:23:19.845222] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-22T17:23:19.846701] [DEBUG] [LOCAL ] AU: Trimmed 76259 records to 52931 (keeping 200 days of data) [2025-09-22T17:23:20.177841] [DEBUG] [LOCAL ] AU: Primary data saved (52931 records). [2025-09-22T17:23:20.177983] [INFO ] [MAIN ] AU: Full history saved. [2025-09-22T17:23:20.178068] [INFO ] [MAIN ] Update Progress: 180/2372 symbols completed. AU took 47.1s. Estimated remaining: 4h 43m 25s. Rate: 7.7 symbols/min [2025-09-22T17:23:20.347779] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:23:20.369859] [DEBUG] [LOCAL ] AVD: Loaded 23590 existing records from primary storage. [2025-09-22T17:23:20.369995] [INFO ] [MAIN ] AVD: Loaded 23590 existing records. [2025-09-22T17:23:20.554889] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:23:20.555162] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-22T17:23:20.556393] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-22T17:23:20.556497] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-22T17:23:20.557602] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-22T17:23:20.557692] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-22T17:23:20.715441] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T17:23:20.817058] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T17:23:20.843511] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:23:20.882085] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-22T17:23:21.017857] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:23:21.322066] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-22T17:23:22.090099] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T17:23:22.122046] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-22T17:23:22.677430] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T17:23:22.679162] [INFO ] [REMOTE ] AVAL: Full fetch complete (14643 records). [2025-09-22T17:23:22.679233] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-22T17:23:22.927204] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-22T17:23:23.047547] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-22T17:23:23.047638] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-22T17:23:23.047959] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-22T17:23:23.048002] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-22T17:23:23.048552] [DEBUG] [LOCAL ] AVAL: Trimmed 14643 records to 9095 (keeping 200 days of data) [2025-09-22T17:23:23.111168] [DEBUG] [LOCAL ] AVAL: Primary data saved (9095 records). [2025-09-22T17:23:23.111340] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-22T17:23:23.111433] [INFO ] [MAIN ] Update Progress: 181/2372 symbols completed. AVAL took 26.4s. Estimated remaining: 4h 42m 18s. Rate: 7.8 symbols/min [2025-09-22T17:23:23.187403] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:23:23.211982] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-22T17:23:23.284041] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:23:23.304211] [DEBUG] [LOCAL ] AVK: Loaded 18451 existing records from primary storage. [2025-09-22T17:23:23.304345] [INFO ] [MAIN ] AVK: Loaded 18451 existing records. [2025-09-22T17:23:23.486221] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:23:23.486542] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-22T17:23:23.486609] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-22T17:23:23.487941] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-22T17:23:23.488003] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-22T17:23:23.727301] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-22T17:23:23.880301] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:23:24.522055] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-22T17:23:24.756821] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:23:24.757173] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-22T17:23:24.863784] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T17:23:25.322058] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-22T17:23:26.122110] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-22T17:23:26.300564] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T17:23:26.922510] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-22T17:23:26.924741] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-22T17:23:27.722137] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-22T17:23:27.964387] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:23:27.965149] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-22T17:23:28.048292] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-22T17:23:28.522133] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-22T17:23:29.318020] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T17:23:29.322149] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-22T17:23:30.122125] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-22T17:23:30.123066] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T17:23:30.837397] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T17:23:30.922138] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-22T17:23:31.722062] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-22T17:23:31.797292] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-22T17:23:32.522091] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-22T17:23:33.207310] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-22T17:23:33.322060] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-22T17:23:33.478428] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T17:23:34.122121] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-22T17:23:34.320481] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:23:34.321742] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T17:23:34.321816] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-22T17:23:34.922066] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-22T17:23:35.671765] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T17:23:35.722043] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-22T17:23:36.522060] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-22T17:23:36.940880] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T17:23:37.181038] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T17:23:37.322062] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-22T17:23:38.122060] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-22T17:23:38.219358] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T17:23:38.223100] [INFO ] [REMOTE ] AVD: Full fetch complete (33913 records). [2025-09-22T17:23:38.223241] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-22T17:23:38.637327] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-22T17:23:38.637417] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-22T17:23:38.637980] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-22T17:23:38.638045] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-22T17:23:38.638949] [DEBUG] [LOCAL ] AVD: Trimmed 33913 records to 23038 (keeping 200 days of data) [2025-09-22T17:23:38.787601] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T17:23:38.796663] [DEBUG] [LOCAL ] AVD: Primary data saved (23038 records). [2025-09-22T17:23:38.796762] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-22T17:23:38.796837] [INFO ] [MAIN ] Update Progress: 182/2372 symbols completed. AVD took 18.6s. Estimated remaining: 4h 43m 46s. Rate: 7.7 symbols/min [2025-09-22T17:23:38.936461] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-22T17:23:38.970362] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:23:39.006764] [DEBUG] [LOCAL ] AVNS: Loaded 34169 existing records from primary storage. [2025-09-22T17:23:39.006916] [INFO ] [MAIN ] AVNS: Loaded 34169 existing records. [2025-09-22T17:23:39.184304] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:23:39.184580] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-22T17:23:39.184635] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-22T17:23:39.186112] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-22T17:23:39.186175] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-22T17:23:39.545213] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:23:39.722013] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-22T17:23:39.860522] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T17:23:40.522112] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-22T17:23:40.670765] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-22T17:23:41.322063] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-22T17:23:42.028357] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T17:23:42.035739] [INFO ] [REMOTE ] AVB: Full fetch complete (58017 records). [2025-09-22T17:23:42.035908] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-22T17:23:42.127280] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-22T17:23:42.468786] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-22T17:23:42.468892] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-22T17:23:42.469525] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-22T17:23:42.469576] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-22T17:23:42.471395] [DEBUG] [LOCAL ] AVB: Trimmed 58017 records to 41705 (keeping 200 days of data) [2025-09-22T17:23:42.727935] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T17:23:42.777638] [DEBUG] [LOCAL ] AVB: Primary data saved (41705 records). [2025-09-22T17:23:42.777803] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-22T17:23:42.777880] [INFO ] [MAIN ] Update Progress: 183/2372 symbols completed. AVB took 40.7s. Estimated remaining: 4h 42m 53s. Rate: 7.7 symbols/min [2025-09-22T17:23:42.927183] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-22T17:23:42.953905] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:23:42.954117] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-09-22T17:23:42.954159] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-09-22T17:23:42.954265] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-22T17:23:42.954303] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-22T17:23:42.954343] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-22T17:23:42.954375] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-22T17:23:43.310023] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T17:23:43.334131] [INFO ] [REMOTE ] AVBC: Full fetch complete (4443 records). [2025-09-22T17:23:43.354760] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-22T17:23:43.481851] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:23:43.610851] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 36 unique days, need 200 days [2025-09-22T17:23:43.611097] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:23:43.611146] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:23:43.611215] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-22T17:23:43.611352] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-22T17:23:43.611412] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-22T17:23:43.611473] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-22T17:23:43.611559] [INFO ] [MAIN ] Update Progress: 184/2372 symbols completed. AVBC took 31.7s. Estimated remaining: 4h 41m 23s. Rate: 7.8 symbols/min [2025-09-22T17:23:43.727242] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-22T17:23:43.841898] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:23:43.860809] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-22T17:23:43.925559] [DEBUG] [LOCAL ] AVTR: Loaded 54351 existing records from primary storage. [2025-09-22T17:23:43.925757] [INFO ] [MAIN ] AVTR: Loaded 54351 existing records. [2025-09-22T17:23:44.124934] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:23:44.125271] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-22T17:23:44.125330] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-22T17:23:44.132055] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-22T17:23:44.132124] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-22T17:23:44.523138] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-22T17:23:44.527083] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:23:44.917047] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T17:23:45.322058] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-22T17:23:45.552811] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T17:23:46.122101] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-22T17:23:46.736465] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T17:23:46.922074] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-22T17:23:47.104885] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T17:23:47.722076] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-22T17:23:48.519751] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T17:23:48.524229] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-22T17:23:49.322126] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-22T17:23:49.547695] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T17:23:49.875275] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T17:23:50.122125] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-22T17:23:50.156414] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T17:23:50.922111] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-22T17:23:51.662950] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-22T17:23:51.722135] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-22T17:23:51.729400] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T17:23:52.396046] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-22T17:23:52.522089] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-22T17:23:53.322111] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-22T17:23:54.122070] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-22T17:23:54.248753] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T17:23:54.442698] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T17:23:54.445994] [INFO ] [REMOTE ] AVK: Full fetch complete (26634 records). [2025-09-22T17:23:54.446082] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-22T17:23:54.814632] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-22T17:23:54.814738] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-22T17:23:54.815130] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-22T17:23:54.815225] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-22T17:23:54.815943] [DEBUG] [LOCAL ] AVK: Trimmed 26634 records to 18073 (keeping 200 days of data) [2025-09-22T17:23:54.922202] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-22T17:23:54.927743] [DEBUG] [LOCAL ] AVK: Primary data saved (18073 records). [2025-09-22T17:23:54.927849] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-22T17:23:54.927931] [INFO ] [MAIN ] Update Progress: 185/2372 symbols completed. AVK took 31.8s. Estimated remaining: 4h 41m 58s. Rate: 7.8 symbols/min [2025-09-22T17:23:55.102573] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:23:55.148967] [DEBUG] [LOCAL ] AVY: Loaded 38393 existing records from primary storage. [2025-09-22T17:23:55.149134] [INFO ] [MAIN ] AVY: Loaded 38393 existing records. [2025-09-22T17:23:55.346070] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:23:55.346346] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-22T17:23:55.346395] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-22T17:23:55.348710] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-22T17:23:55.348772] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-22T17:23:55.706977] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:23:55.726271] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-22T17:23:55.729889] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T17:23:56.314212] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T17:23:56.522096] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-22T17:23:57.234235] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T17:23:57.322011] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-22T17:23:57.629295] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T17:23:58.122138] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-22T17:23:58.443356] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T17:23:58.922056] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-22T17:23:59.454118] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T17:23:59.685407] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-22T17:23:59.722038] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-22T17:24:00.522052] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-22T17:24:00.651892] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T17:24:01.322085] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-22T17:24:02.122155] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-22T17:24:02.339606] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T17:24:02.922077] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-22T17:24:03.485020] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-22T17:24:03.722065] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-22T17:24:04.065037] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T17:24:04.522084] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-22T17:24:05.322049] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-22T17:24:05.450137] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T17:24:05.630000] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-22T17:24:05.710193] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T17:24:05.718186] [INFO ] [REMOTE ] AVNS: Full fetch complete (47697 records). [2025-09-22T17:24:05.718336] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-22T17:24:06.112465] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-22T17:24:06.112575] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-22T17:24:06.113363] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-22T17:24:06.113460] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-22T17:24:06.115048] [DEBUG] [LOCAL ] AVNS: Trimmed 47697 records to 33592 (keeping 200 days of data) [2025-09-22T17:24:06.122094] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-22T17:24:06.338505] [DEBUG] [LOCAL ] AVNS: Primary data saved (33592 records). [2025-09-22T17:24:06.338919] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-22T17:24:06.339273] [INFO ] [MAIN ] Update Progress: 186/2372 symbols completed. AVNS took 27.5s. Estimated remaining: 4h 42m 34s. Rate: 7.7 symbols/min [2025-09-22T17:24:06.523822] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:24:06.550238] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T17:24:06.579035] [DEBUG] [LOCAL ] AWF: Loaded 24565 existing records from primary storage. [2025-09-22T17:24:06.579177] [INFO ] [MAIN ] AWF: Loaded 24565 existing records. [2025-09-22T17:24:06.754688] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:24:06.754997] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-22T17:24:06.755055] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-22T17:24:06.755956] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-22T17:24:06.756048] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-22T17:24:06.927330] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-22T17:24:07.112734] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:24:07.290136] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T17:24:07.722067] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-22T17:24:08.430526] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T17:24:08.522048] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-22T17:24:08.785243] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T17:24:09.322061] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-22T17:24:09.893716] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T17:24:10.122056] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-22T17:24:10.663051] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T17:24:10.922076] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-22T17:24:11.703010] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T17:24:11.722000] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-22T17:24:11.966391] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T17:24:12.522034] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-22T17:24:12.885245] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T17:24:13.322051] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-22T17:24:13.943753] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T17:24:13.953216] [INFO ] [REMOTE ] AVTR: Full fetch complete (77438 records). [2025-09-22T17:24:13.953392] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-22T17:24:14.133223] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-22T17:24:14.369789] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-22T17:24:14.369883] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-22T17:24:14.370705] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-22T17:24:14.370784] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-22T17:24:14.375322] [DEBUG] [LOCAL ] AVTR: Trimmed 77438 records to 53567 (keeping 200 days of data) [2025-09-22T17:24:14.713728] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T17:24:14.734408] [DEBUG] [LOCAL ] AVTR: Primary data saved (53567 records). [2025-09-22T17:24:14.734523] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-22T17:24:14.734693] [INFO ] [MAIN ] Update Progress: 187/2372 symbols completed. AVTR took 31.1s. Estimated remaining: 4h 42m 33s. Rate: 7.7 symbols/min [2025-09-22T17:24:14.909627] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:24:14.929442] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-22T17:24:14.943314] [DEBUG] [LOCAL ] AWI: Loaded 26546 existing records from primary storage. [2025-09-22T17:24:14.943688] [INFO ] [MAIN ] AWI: Loaded 26546 existing records. [2025-09-22T17:24:15.142395] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:24:15.142836] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-22T17:24:15.142901] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-22T17:24:15.144998] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-22T17:24:15.145078] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-22T17:24:15.569142] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:24:15.722067] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-22T17:24:16.027858] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T17:24:16.487041] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T17:24:16.522031] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-22T17:24:16.760601] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T17:24:17.322068] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-22T17:24:18.062362] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T17:24:18.127138] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-22T17:24:18.149487] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T17:24:18.922100] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-22T17:24:19.722080] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-22T17:24:20.522146] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-22T17:24:20.747799] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-22T17:24:20.807560] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-22T17:24:21.291469] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T17:24:21.322097] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-22T17:24:22.122061] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-22T17:24:22.260583] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T17:24:22.266359] [INFO ] [REMOTE ] AVNT: Full fetch complete (56000 records). [2025-09-22T17:24:22.266476] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-22T17:24:22.646333] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-22T17:24:22.646501] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-22T17:24:22.647169] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-22T17:24:22.647332] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-22T17:24:22.650100] [DEBUG] [LOCAL ] AVNT: Trimmed 56000 records to 39407 (keeping 200 days of data) [2025-09-22T17:24:22.669846] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T17:24:22.918343] [DEBUG] [LOCAL ] AVNT: Primary data saved (39407 records). [2025-09-22T17:24:22.918494] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-22T17:24:22.918591] [INFO ] [MAIN ] Update Progress: 188/2372 symbols completed. AVNT took 40.1s. Estimated remaining: 4h 42m 30s. Rate: 7.7 symbols/min [2025-09-22T17:24:22.924678] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-22T17:24:23.092234] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:24:23.113122] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-22T17:24:23.170800] [DEBUG] [LOCAL ] AWK: Loaded 49612 existing records from primary storage. [2025-09-22T17:24:23.170941] [INFO ] [MAIN ] AWK: Loaded 49612 existing records. [2025-09-22T17:24:23.346010] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:24:23.346322] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-22T17:24:23.346370] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-22T17:24:23.349478] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-22T17:24:23.349544] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-22T17:24:23.710693] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:24:23.722008] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-22T17:24:24.467343] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T17:24:24.522021] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-22T17:24:25.322071] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-22T17:24:25.481029] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T17:24:25.538311] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T17:24:26.122031] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-22T17:24:26.262742] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T17:24:26.922056] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-22T17:24:27.464889] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T17:24:27.722059] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-22T17:24:28.278118] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T17:24:28.359291] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T17:24:28.522068] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-22T17:24:29.322055] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-22T17:24:29.746746] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T17:24:30.122065] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-22T17:24:30.158038] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T17:24:30.922081] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-22T17:24:31.598856] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T17:24:31.605043] [INFO ] [REMOTE ] AVY: Full fetch complete (56022 records). [2025-09-22T17:24:31.605188] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-22T17:24:31.727231] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-22T17:24:32.017124] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-22T17:24:32.017265] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-22T17:24:32.018404] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-22T17:24:32.018498] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-22T17:24:32.020585] [DEBUG] [LOCAL ] AVY: Trimmed 56022 records to 37716 (keeping 200 days of data) [2025-09-22T17:24:32.276080] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T17:24:32.347988] [DEBUG] [LOCAL ] AVY: Primary data saved (37716 records). [2025-09-22T17:24:32.348215] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-22T17:24:32.348432] [INFO ] [MAIN ] Update Progress: 189/2372 symbols completed. AVY took 37.4s. Estimated remaining: 4h 42m 42s. Rate: 7.7 symbols/min [2025-09-22T17:24:32.530322] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-22T17:24:32.550150] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:24:32.580889] [DEBUG] [LOCAL ] AWP: Loaded 22526 existing records from primary storage. [2025-09-22T17:24:32.581113] [INFO ] [MAIN ] AWP: Loaded 22526 existing records. [2025-09-22T17:24:32.797988] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:24:32.798261] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-22T17:24:32.798318] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-22T17:24:32.799046] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-22T17:24:32.799108] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-22T17:24:33.165834] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:24:33.322052] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-22T17:24:33.496271] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T17:24:33.563718] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T17:24:34.122110] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-22T17:24:34.242961] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T17:24:34.922043] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-22T17:24:35.267442] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T17:24:35.722048] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-22T17:24:35.742449] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-22T17:24:36.527182] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-22T17:24:36.540987] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T17:24:37.322068] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-22T17:24:37.558063] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T17:24:38.122052] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-22T17:24:38.922092] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-22T17:24:39.722076] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-22T17:24:40.119830] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T17:24:40.523359] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-22T17:24:40.526379] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (3.20 seconds). [2025-09-22T17:24:40.672782] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T17:24:40.677254] [INFO ] [REMOTE ] AWF: Full fetch complete (36024 records). [2025-09-22T17:24:40.677384] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-22T17:24:41.073297] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-22T17:24:41.073412] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-22T17:24:41.074056] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-22T17:24:41.074127] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-22T17:24:41.075224] [DEBUG] [LOCAL ] AWF: Trimmed 36024 records to 24294 (keeping 200 days of data) [2025-09-22T17:24:41.256584] [DEBUG] [LOCAL ] AWF: Primary data saved (24294 records). [2025-09-22T17:24:41.254119] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T17:24:41.261792] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T17:24:41.256833] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-22T17:24:41.266859] [INFO ] [REMOTE ] AWI: Full fetch complete (35427 records). [2025-09-22T17:24:41.266960] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-22T17:24:41.266771] [INFO ] [MAIN ] Update Progress: 190/2372 symbols completed. AWF took 34.9s. Estimated remaining: 4h 42m 47s. Rate: 7.7 symbols/min [2025-09-22T17:24:41.322377] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-22T17:24:41.638329] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:24:41.861385] [DEBUG] [LOCAL ] AWR: Loaded 22805 existing records from primary storage. [2025-09-22T17:24:41.863579] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-22T17:24:41.863688] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-22T17:24:41.864159] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-22T17:24:41.864231] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-22T17:24:41.863499] [INFO ] [MAIN ] AWR: Loaded 22805 existing records. [2025-09-22T17:24:41.969310] [DEBUG] [LOCAL ] AWI: Trimmed 35427 records to 26066 (keeping 200 days of data) [2025-09-22T17:24:42.142580] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-22T17:24:42.150354] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:24:42.152955] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-22T17:24:42.153303] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-22T17:24:42.154521] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-22T17:24:42.154916] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-22T17:24:42.567075] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:24:42.623484] [DEBUG] [LOCAL ] AWI: Primary data saved (26066 records). [2025-09-22T17:24:42.623658] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-22T17:24:42.623770] [INFO ] [MAIN ] Update Progress: 191/2372 symbols completed. AWI took 27.9s. Estimated remaining: 4h 41m 26s. Rate: 7.7 symbols/min [2025-09-22T17:24:42.792677] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:24:42.822244] [DEBUG] [LOCAL ] AX: Loaded 29273 existing records from primary storage. [2025-09-22T17:24:42.822388] [INFO ] [MAIN ] AX: Loaded 29273 existing records. [2025-09-22T17:24:42.922987] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-22T17:24:43.005406] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:24:43.005773] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-22T17:24:43.005849] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-22T17:24:43.016636] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-22T17:24:43.016769] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-22T17:24:43.138081] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T17:24:43.401862] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T17:24:43.436467] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:24:43.722071] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-22T17:24:43.771464] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T17:24:44.522138] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-22T17:24:44.861485] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T17:24:45.322064] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-22T17:24:45.613867] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T17:24:46.122089] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-22T17:24:46.922084] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-22T17:24:46.990581] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T17:24:47.019809] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T17:24:47.677535] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T17:24:47.722090] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-22T17:24:48.522081] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-22T17:24:48.660230] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T17:24:49.322067] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-22T17:24:50.122082] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-22T17:24:50.241298] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T17:24:50.653995] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T17:24:50.922012] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-22T17:24:50.985095] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T17:24:51.722086] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-22T17:24:51.978814] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T17:24:52.522090] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-22T17:24:52.798186] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T17:24:53.290429] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T17:24:53.294005] [INFO ] [REMOTE ] AWP: Full fetch complete (32540 records). [2025-09-22T17:24:53.294105] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-22T17:24:53.327128] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-22T17:24:53.672784] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-22T17:24:53.672874] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-22T17:24:53.673293] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-22T17:24:53.673336] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-22T17:24:53.674439] [DEBUG] [LOCAL ] AWP: Trimmed 32540 records to 21999 (keeping 200 days of data) [2025-09-22T17:24:53.801864] [DEBUG] [LOCAL ] AWP: Primary data saved (21999 records). [2025-09-22T17:24:53.802002] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-22T17:24:53.802085] [INFO ] [MAIN ] Update Progress: 192/2372 symbols completed. AWP took 21.5s. Estimated remaining: 4h 41m 58s. Rate: 7.7 symbols/min [2025-09-22T17:24:54.040740] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:24:54.091988] [DEBUG] [LOCAL ] AXL: Loaded 51287 existing records from primary storage. [2025-09-22T17:24:54.092165] [INFO ] [MAIN ] AXL: Loaded 51287 existing records. [2025-09-22T17:24:54.127241] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-22T17:24:54.278608] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:24:54.278899] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-22T17:24:54.278948] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-22T17:24:54.279950] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-22T17:24:54.280012] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-22T17:24:54.637237] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:24:54.657498] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T17:24:54.922080] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-22T17:24:55.544278] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T17:24:55.722071] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-22T17:24:55.957481] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-22T17:24:56.522090] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-22T17:24:57.114392] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T17:24:57.322080] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-22T17:24:58.122070] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-22T17:24:58.187954] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T17:24:58.246953] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T17:24:58.792296] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-22T17:24:58.922097] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-22T17:24:59.722118] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-22T17:25:00.509242] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T17:25:00.521994] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-22T17:25:01.235851] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T17:25:01.322073] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-22T17:25:01.858240] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T17:25:02.122061] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-22T17:25:02.314729] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T17:25:02.922082] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-22T17:25:03.722060] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-22T17:25:03.971727] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T17:25:04.114437] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T17:25:04.522093] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-22T17:25:05.322090] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-22T17:25:05.397455] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T17:25:05.850897] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T17:25:05.855270] [INFO ] [REMOTE ] AWR: Full fetch complete (31680 records). [2025-09-22T17:25:05.855360] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-22T17:25:06.130240] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-22T17:25:06.256907] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-22T17:25:06.257084] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-22T17:25:06.257860] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-22T17:25:06.257931] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-22T17:25:06.259105] [DEBUG] [LOCAL ] AWR: Trimmed 31680 records to 22541 (keeping 200 days of data) [2025-09-22T17:25:06.412720] [DEBUG] [LOCAL ] AWR: Primary data saved (22541 records). [2025-09-22T17:25:06.412931] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-22T17:25:06.413067] [INFO ] [MAIN ] Update Progress: 193/2372 symbols completed. AWR took 25.1s. Estimated remaining: 4h 42m 45s. Rate: 7.7 symbols/min [2025-09-22T17:25:06.605474] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:25:06.676279] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T17:25:06.684316] [INFO ] [REMOTE ] AWK: Full fetch complete (70519 records). [2025-09-22T17:25:06.684469] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-22T17:25:06.818144] [DEBUG] [LOCAL ] AXP: Loaded 54046 existing records from primary storage. [2025-09-22T17:25:06.824269] [INFO ] [MAIN ] AXP: Loaded 54046 existing records. [2025-09-22T17:25:06.933488] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-22T17:25:07.271575] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:25:07.331280] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-22T17:25:07.332597] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-22T17:25:07.370542] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-22T17:25:07.352210] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-22T17:25:07.370768] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-22T17:25:07.371675] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-22T17:25:07.371902] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-22T17:25:07.371806] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-22T17:25:07.477201] [DEBUG] [LOCAL ] AWK: Trimmed 70519 records to 48853 (keeping 200 days of data) [2025-09-22T17:25:07.864700] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:25:07.879238] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-22T17:25:07.888021] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T17:25:08.071279] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T17:25:08.139142] [DEBUG] [LOCAL ] AWK: Primary data saved (48853 records). [2025-09-22T17:25:08.139298] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-22T17:25:08.140431] [INFO ] [MAIN ] Update Progress: 194/2372 symbols completed. AWK took 45.2s. Estimated remaining: 4h 41m 29s. Rate: 7.7 symbols/min [2025-09-22T17:25:08.309566] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:25:08.315331] [DEBUG] [LOCAL ] AXR: Loaded 3219 existing records from primary storage. [2025-09-22T17:25:08.315474] [INFO ] [MAIN ] AXR: Loaded 3219 existing records. [2025-09-22T17:25:08.495126] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:25:08.495373] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-22T17:25:08.495421] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-22T17:25:08.495698] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-22T17:25:08.495758] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-22T17:25:08.527324] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-22T17:25:08.856485] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:25:09.322114] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-22T17:25:09.899493] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T17:25:10.083083] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T17:25:10.122064] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-22T17:25:10.501815] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T17:25:10.922054] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-22T17:25:11.484954] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-22T17:25:11.722021] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-22T17:25:12.178975] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-22T17:25:12.522062] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-22T17:25:13.033353] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T17:25:13.322057] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-22T17:25:14.131316] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-22T17:25:14.165805] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T17:25:14.922101] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-22T17:25:15.048485] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T17:25:15.124848] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T17:25:15.297514] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-22T17:25:15.722074] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-22T17:25:16.522082] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-22T17:25:17.322072] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-22T17:25:17.568196] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T17:25:18.122114] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-22T17:25:18.354530] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-22T17:25:18.359478] [INFO ] [REMOTE ] AX: Full fetch complete (42756 records). [2025-09-22T17:25:18.359577] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-22T17:25:18.657188] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-22T17:25:18.765736] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-22T17:25:18.765886] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-22T17:25:18.766447] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-22T17:25:18.766586] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-22T17:25:18.767849] [DEBUG] [LOCAL ] AX: Trimmed 42756 records to 28679 (keeping 200 days of data) [2025-09-22T17:25:18.925097] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-22T17:25:18.958169] [DEBUG] [LOCAL ] AX: Primary data saved (28679 records). [2025-09-22T17:25:18.958455] [INFO ] [MAIN ] AX: Full history saved. [2025-09-22T17:25:18.958558] [INFO ] [MAIN ] Update Progress: 195/2372 symbols completed. AX took 36.3s. Estimated remaining: 4h 41m 55s. Rate: 7.7 symbols/min [2025-09-22T17:25:19.076529] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-22T17:25:19.184145] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:25:19.223499] [DEBUG] [LOCAL ] AXS: Loaded 38897 existing records from primary storage. [2025-09-22T17:25:19.223662] [INFO ] [MAIN ] AXS: Loaded 38897 existing records. [2025-09-22T17:25:19.414909] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:25:19.415148] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-22T17:25:19.415195] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-22T17:25:19.416216] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-22T17:25:19.416278] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-22T17:25:19.580298] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-22T17:25:19.727170] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-22T17:25:19.801310] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:25:20.204150] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-22T17:25:20.522068] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-22T17:25:21.322066] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-22T17:25:21.819102] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T17:25:22.122074] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-22T17:25:22.922097] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-22T17:25:23.544990] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T17:25:23.616053] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-22T17:25:23.722064] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-22T17:25:24.256711] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-22T17:25:24.470778] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T17:25:24.480207] [INFO ] [REMOTE ] AXL: Full fetch complete (71994 records). [2025-09-22T17:25:24.480338] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-22T17:25:24.481146] [FATAL] [VALIDATOR ] AXL: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:25:24.481239] [FATAL] [MAIN ] AXL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:25:24.481285] [WARN ] [MAIN ] AXL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:25:24.481356] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-22T17:25:24.481425] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-09-22T17:25:24.481461] [INFO ] [LOCAL ] AXL: Starting deletion of derivative data. [2025-09-22T17:25:24.481932] [DEBUG] [LOCAL ] AXL: Deleted derivative data file. [2025-09-22T17:25:24.482045] [INFO ] [MAIN ] Update Progress: 196/2372 symbols completed. AXL took 30.7s. Estimated remaining: 4h 41m 22s. Rate: 7.7 symbols/min [2025-09-22T17:25:24.527275] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-22T17:25:24.670443] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:25:24.724368] [DEBUG] [LOCAL ] AXTA: Loaded 52811 existing records from primary storage. [2025-09-22T17:25:24.724524] [INFO ] [MAIN ] AXTA: Loaded 52811 existing records. [2025-09-22T17:25:24.912912] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:25:24.913172] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-22T17:25:24.913223] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-22T17:25:24.914253] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-22T17:25:24.914316] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-22T17:25:25.290739] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:25:25.322086] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-22T17:25:26.122081] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-22T17:25:26.289767] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T17:25:26.922060] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-22T17:25:27.260097] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-22T17:25:27.490171] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T17:25:27.722052] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-22T17:25:28.337896] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-22T17:25:28.522075] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-22T17:25:28.881666] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T17:25:29.322059] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-22T17:25:29.811713] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T17:25:29.873835] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-22T17:25:30.122072] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-22T17:25:30.922068] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-22T17:25:31.359158] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T17:25:31.715132] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T17:25:31.724847] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-22T17:25:32.522071] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-22T17:25:33.050083] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T17:25:33.322094] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-22T17:25:34.122074] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-22T17:25:34.760501] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-22T17:25:34.922059] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-22T17:25:34.988192] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T17:25:35.368461] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T17:25:35.596445] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-22T17:25:35.598084] [INFO ] [REMOTE ] AXR: Full fetch complete (5017 records). [2025-09-22T17:25:35.598209] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-22T17:25:35.727275] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-22T17:25:36.008359] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-22T17:25:36.008539] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-22T17:25:36.008783] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-22T17:25:36.008850] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-22T17:25:36.009485] [DEBUG] [LOCAL ] AXR: Trimmed 5017 records to 3148 (keeping 200 days of data) [2025-09-22T17:25:36.028343] [DEBUG] [LOCAL ] AXR: Primary data saved (3148 records). [2025-09-22T17:25:36.028438] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-22T17:25:36.028538] [INFO ] [MAIN ] Update Progress: 197/2372 symbols completed. AXR took 27.9s. Estimated remaining: 4h 41m 57s. Rate: 7.7 symbols/min [2025-09-22T17:25:36.522079] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-22T17:25:37.322060] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-22T17:25:37.703928] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-22T17:25:37.841952] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T17:25:38.122110] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-22T17:25:38.761390] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T17:25:38.922060] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-22T17:25:39.722027] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-22T17:25:39.808731] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T17:25:39.817388] [INFO ] [REMOTE ] AXP: Full fetch complete (76927 records). [2025-09-22T17:25:39.817569] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-22T17:25:40.232859] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-22T17:25:40.233001] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-22T17:25:40.233932] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-22T17:25:40.241555] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-22T17:25:40.256547] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T17:25:40.267079] [DEBUG] [LOCAL ] AXP: Trimmed 76927 records to 53264 (keeping 200 days of data) [2025-09-22T17:25:40.523398] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-22T17:25:40.606808] [DEBUG] [LOCAL ] AXP: Primary data saved (53264 records). [2025-09-22T17:25:40.606937] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-22T17:25:40.607020] [INFO ] [MAIN ] Update Progress: 198/2372 symbols completed. AXP took 34.2s. Estimated remaining: 4h 41m 14s. Rate: 7.7 symbols/min [2025-09-22T17:25:41.031601] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T17:25:41.322049] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-22T17:25:42.002939] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T17:25:42.122079] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-22T17:25:42.607719] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T17:25:42.922119] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-22T17:25:43.721708] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T17:25:43.730336] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-22T17:25:44.775591] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T17:25:44.787887] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-22T17:25:45.053205] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-22T17:25:45.059527] [INFO ] [REMOTE ] AXS: Full fetch complete (55318 records). [2025-09-22T17:25:45.059749] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-22T17:25:45.475235] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-22T17:25:45.475325] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-22T17:25:45.475934] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-22T17:25:45.476001] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-22T17:25:45.477285] [DEBUG] [LOCAL ] AXS: Trimmed 55318 records to 38244 (keeping 200 days of data) [2025-09-22T17:25:45.712263] [DEBUG] [LOCAL ] AXS: Primary data saved (38244 records). [2025-09-22T17:25:45.712423] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-22T17:25:45.712507] [INFO ] [MAIN ] Update Progress: 199/2372 symbols completed. AXS took 26.8s. Estimated remaining: 4h 40m 37s. Rate: 7.7 symbols/min [2025-09-22T17:25:46.043341] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T17:25:46.055394] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-22T17:25:47.428368] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T17:25:47.437223] [INFO ] [REMOTE ] AXTA: Full fetch complete (74732 records). [2025-09-22T17:25:47.437439] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-22T17:25:47.877432] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-22T17:25:47.877553] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-22T17:25:47.878482] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-22T17:25:47.878560] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-22T17:25:47.880584] [DEBUG] [LOCAL ] AXTA: Trimmed 74732 records to 52052 (keeping 200 days of data) [2025-09-22T17:25:48.217880] [DEBUG] [LOCAL ] AXTA: Primary data saved (52052 records). [2025-09-22T17:25:48.218120] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-22T17:25:48.218277] [INFO ] [MAIN ] Update Progress: 200/2372 symbols completed. AXTA took 23.7s. Estimated remaining: 4h 39m 32s. Rate: 7.8 symbols/min [2025-09-22T17:25:48.867199] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:25:48.965241] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:25:48.967048] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:25:48.988762] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:25:48.989710] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-22T17:25:48.989767] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-22T17:25:48.989923] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-22T17:25:48.989976] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-22T17:25:48.990018] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-22T17:25:48.990184] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-22T17:25:49.127466] [DEBUG] [LOCAL ] AZO: Loaded 11785 existing records from primary storage. [2025-09-22T17:25:49.127686] [INFO ] [MAIN ] AZO: Loaded 11785 existing records. [2025-09-22T17:25:49.267793] [DEBUG] [LOCAL ] AYI: Loaded 25858 existing records from primary storage. [2025-09-22T17:25:49.316782] [INFO ] [MAIN ] AYI: Loaded 25858 existing records. [2025-09-22T17:25:49.353265] [DEBUG] [LOCAL ] AZZ: Loaded 22536 existing records from primary storage. [2025-09-22T17:25:49.372843] [INFO ] [MAIN ] AZZ: Loaded 22536 existing records. [2025-09-22T17:25:49.759070] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:25:49.836043] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-22T17:25:49.942308] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-22T17:25:49.947791] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:25:49.973859] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-22T17:25:50.001763] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:25:50.016474] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-22T17:25:50.035934] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-22T17:25:50.035345] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-22T17:25:50.065139] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-22T17:25:50.081292] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-22T17:25:50.091985] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-22T17:25:50.091886] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:25:50.180570] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-22T17:25:50.246976] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-22T17:25:50.276152] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-22T17:25:50.295038] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-22T17:25:51.144705] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:25:51.190404] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-22T17:25:51.229407] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:25:51.275388] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-22T17:25:51.315441] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:25:51.316091] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-22T17:25:51.346568] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T17:25:51.354269] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-22T17:25:52.176163] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T17:25:52.179875] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-22T17:25:52.201349] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T17:25:52.208220] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-22T17:25:52.438134] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:25:52.438498] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-22T17:25:52.439019] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-22T17:25:52.487678] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T17:25:52.522011] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-22T17:25:52.611044] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T17:25:52.645458] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:25:52.645753] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-22T17:25:52.751308] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T17:25:53.322055] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-22T17:25:53.347824] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T17:25:53.978353] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T17:25:54.122080] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-22T17:25:54.327320] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:25:54.327663] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-22T17:25:54.922054] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-22T17:25:55.722049] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-22T17:25:55.954148] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T17:25:56.393739] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T17:25:56.522061] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-22T17:25:57.305394] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T17:25:57.322007] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-22T17:25:58.122060] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-22T17:25:58.223420] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-22T17:25:58.922107] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-22T17:25:59.521042] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T17:25:59.722143] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-22T17:25:59.758548] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T17:26:00.522059] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-22T17:26:01.322076] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-22T17:26:01.587120] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T17:26:01.792265] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T17:26:02.007133] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T17:26:02.122067] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-22T17:26:02.922127] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-22T17:26:03.128750] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T17:26:03.722076] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-22T17:26:03.914270] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T17:26:04.522090] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-22T17:26:04.797785] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T17:26:05.203119] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T17:26:05.322062] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-22T17:26:06.122090] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-22T17:26:06.152387] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T17:26:06.922149] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-22T17:26:07.173742] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T17:26:07.722060] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-22T17:26:08.522141] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-22T17:26:08.577901] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T17:26:09.263686] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-22T17:26:09.322029] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-22T17:26:09.398861] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T17:26:10.122058] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-22T17:26:10.694405] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-22T17:26:10.922043] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-22T17:26:11.148469] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T17:26:11.612341] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T17:26:11.614471] [INFO ] [REMOTE ] AZO: Full fetch complete (16373 records). [2025-09-22T17:26:11.614544] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-22T17:26:11.727471] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-22T17:26:12.009474] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-22T17:26:12.009586] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-22T17:26:12.009966] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-22T17:26:12.010029] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-22T17:26:12.011451] [DEBUG] [LOCAL ] AZO: Trimmed 16373 records to 11466 (keeping 200 days of data) [2025-09-22T17:26:12.092696] [DEBUG] [LOCAL ] AZO: Primary data saved (11466 records). [2025-09-22T17:26:12.092858] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-22T17:26:12.092999] [INFO ] [MAIN ] Update Progress: 201/2372 symbols completed. AZO took 23.9s. Estimated remaining: 4h 42m 19s. Rate: 7.7 symbols/min [2025-09-22T17:26:12.294349] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:26:12.357897] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-22T17:26:12.358059] [INFO ] [MAIN ] BA: Loaded 54571 existing records. [2025-09-22T17:26:12.527638] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-22T17:26:12.579990] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:26:12.580305] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-22T17:26:12.580364] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-22T17:26:12.585021] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-22T17:26:12.585110] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-22T17:26:12.949737] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:26:13.322070] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-22T17:26:13.822773] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T17:26:13.945181] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-22T17:26:14.122089] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-22T17:26:14.208572] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T17:26:14.922086] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-22T17:26:15.722098] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-22T17:26:16.141391] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-22T17:26:16.149808] [INFO ] [REMOTE ] B: Full fetch complete (44751 records). [2025-09-22T17:26:16.149936] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-22T17:26:16.357551] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-22T17:26:16.358252] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:26:16.358346] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:26:16.358433] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-22T17:26:16.358517] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-22T17:26:16.358559] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-22T17:26:16.358628] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-22T17:26:16.358759] [INFO ] [MAIN ] Update Progress: 202/2372 symbols completed. B took 28.1s. Estimated remaining: 4h 41m 33s. Rate: 7.7 symbols/min [2025-09-22T17:26:16.529575] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-22T17:26:16.561097] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:26:16.645150] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-22T17:26:16.645396] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-09-22T17:26:16.773943] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T17:26:16.866004] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:26:16.866403] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-22T17:26:16.866491] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-22T17:26:16.870812] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-22T17:26:16.870911] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-22T17:26:17.254667] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:26:17.322214] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-22T17:26:17.362465] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-22T17:26:17.591583] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T17:26:17.597781] [INFO ] [REMOTE ] AZZ: Full fetch complete (30710 records). [2025-09-22T17:26:17.597933] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-22T17:26:17.599604] [FATAL] [VALIDATOR ] AZZ: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:26:17.599741] [FATAL] [MAIN ] AZZ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:26:17.599786] [WARN ] [MAIN ] AZZ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:26:17.599841] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-22T17:26:17.599940] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-09-22T17:26:17.600033] [INFO ] [LOCAL ] AZZ: Starting deletion of derivative data. [2025-09-22T17:26:17.600677] [DEBUG] [LOCAL ] AZZ: Deleted derivative data file. [2025-09-22T17:26:17.600859] [INFO ] [MAIN ] Update Progress: 203/2372 symbols completed. AZZ took 29.4s. Estimated remaining: 4h 40m 15s. Rate: 7.7 symbols/min [2025-09-22T17:26:17.786488] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:26:17.861977] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-22T17:26:17.862122] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-09-22T17:26:18.063387] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:26:18.063754] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-22T17:26:18.063817] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-22T17:26:18.066580] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-22T17:26:18.066667] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-22T17:26:18.134708] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-22T17:26:18.479147] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:26:18.497525] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T17:26:18.922073] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-22T17:26:19.722084] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-22T17:26:20.469401] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-22T17:26:20.522008] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-22T17:26:21.135903] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-22T17:26:21.322060] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-22T17:26:21.830172] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-22T17:26:22.122076] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-22T17:26:22.624258] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-22T17:26:22.922021] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-22T17:26:23.234918] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T17:26:23.238984] [INFO ] [REMOTE ] AYI: Full fetch complete (36651 records). [2025-09-22T17:26:23.239106] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-22T17:26:23.240578] [FATAL] [VALIDATOR ] AYI: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:26:23.240691] [FATAL] [MAIN ] AYI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:26:23.240746] [WARN ] [MAIN ] AYI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:26:23.240798] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-22T17:26:23.240895] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-09-22T17:26:23.240961] [INFO ] [LOCAL ] AYI: Starting deletion of derivative data. [2025-09-22T17:26:23.241425] [DEBUG] [LOCAL ] AYI: Deleted derivative data file. [2025-09-22T17:26:23.241567] [INFO ] [MAIN ] Update Progress: 204/2372 symbols completed. AYI took 35.0s. Estimated remaining: 4h 39m 45s. Rate: 7.7 symbols/min [2025-09-22T17:26:23.423110] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:26:23.495871] [DEBUG] [LOCAL ] BAH: Loaded 52533 existing records from primary storage. [2025-09-22T17:26:23.496132] [INFO ] [MAIN ] BAH: Loaded 52533 existing records. [2025-09-22T17:26:23.723302] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-22T17:26:23.728748] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-22T17:26:23.745053] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:26:23.747863] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-22T17:26:23.748279] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-22T17:26:23.750772] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-22T17:26:23.750844] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-22T17:26:24.118595] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:26:24.522082] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-22T17:26:25.322097] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-22T17:26:25.360267] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-22T17:26:25.947412] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-22T17:26:26.122056] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-22T17:26:26.531563] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-22T17:26:26.728986] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T17:26:26.922120] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-22T17:26:27.722080] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-22T17:26:28.459360] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-22T17:26:28.522070] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-22T17:26:29.333442] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-22T17:26:29.339354] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-22T17:26:29.714668] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T17:26:30.122142] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-22T17:26:30.777466] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T17:26:30.922034] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-22T17:26:30.996494] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-22T17:26:31.722090] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-22T17:26:32.522112] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-22T17:26:32.745863] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-22T17:26:33.284357] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-22T17:26:33.322051] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-22T17:26:33.370079] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T17:26:34.122084] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-22T17:26:34.813304] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-22T17:26:34.922013] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-22T17:26:35.591238] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-22T17:26:35.722057] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-22T17:26:36.448914] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-22T17:26:36.522055] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-22T17:26:37.213030] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-22T17:26:37.322082] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-22T17:26:38.122057] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-22T17:26:38.333342] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-22T17:26:38.695550] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-22T17:26:38.922118] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-22T17:26:39.264598] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T17:26:39.722057] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-22T17:26:40.424453] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-22T17:26:40.522030] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-22T17:26:41.322070] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-22T17:26:41.458293] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-22T17:26:41.603165] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T17:26:42.122086] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-22T17:26:42.835025] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-22T17:26:42.922029] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-22T17:26:43.722029] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-22T17:26:43.889750] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-22T17:26:44.326815] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-22T17:26:44.522074] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-22T17:26:45.223008] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T17:26:45.326524] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-22T17:26:45.332411] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-22T17:26:45.341464] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-22T17:26:45.341858] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-22T17:26:45.774720] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-22T17:26:45.774896] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-22T17:26:45.775879] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-22T17:26:45.775971] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-22T17:26:45.778114] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-09-22T17:26:46.124562] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-22T17:26:46.176112] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-09-22T17:26:46.176408] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-22T17:26:46.176533] [INFO ] [MAIN ] Update Progress: 205/2372 symbols completed. BABA took 29.8s. Estimated remaining: 4h 42m 18s. Rate: 7.7 symbols/min [2025-09-22T17:26:46.363337] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:26:46.363700] [DEBUG] [LOCAL ] BAK: No existing data file found in primary storage. [2025-09-22T17:26:46.363757] [WARN ] [MAIN ] BAK: No existing data found, performing full refresh instead. [2025-09-22T17:26:46.363964] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-22T17:26:46.364009] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-22T17:26:46.364051] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-09-22T17:26:46.364084] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-22T17:26:46.744458] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:26:46.795193] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-22T17:26:46.922056] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-22T17:26:47.434817] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-22T17:26:47.446323] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-22T17:26:47.446524] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-22T17:26:47.744190] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-22T17:26:47.893783] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-22T17:26:47.894012] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-22T17:26:47.894906] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-22T17:26:47.895080] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-22T17:26:47.931367] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T17:26:47.942202] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 53791 (keeping 200 days of data) [2025-09-22T17:26:48.290796] [DEBUG] [LOCAL ] BA: Primary data saved (53791 records). [2025-09-22T17:26:48.290959] [INFO ] [MAIN ] BA: Full history saved. [2025-09-22T17:26:48.291054] [INFO ] [MAIN ] Update Progress: 206/2372 symbols completed. BA took 36.2s. Estimated remaining: 4h 41m 10s. Rate: 7.7 symbols/min [2025-09-22T17:26:48.464584] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:26:48.524040] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-22T17:26:48.527444] [DEBUG] [LOCAL ] BALL: Loaded 52602 existing records from primary storage. [2025-09-22T17:26:48.527769] [INFO ] [MAIN ] BALL: Loaded 52602 existing records. [2025-09-22T17:26:48.709430] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:26:48.709741] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-22T17:26:48.709811] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-22T17:26:48.711938] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-22T17:26:48.712000] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-22T17:26:49.081377] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:26:49.110953] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T17:26:49.143806] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-22T17:26:49.152340] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-22T17:26:49.152477] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-22T17:26:49.334038] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-22T17:26:49.563194] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-22T17:26:49.563292] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-22T17:26:49.564153] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-22T17:26:49.564222] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-22T17:26:49.568263] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-09-22T17:26:49.911696] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-22T17:26:49.911870] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-22T17:26:49.911978] [INFO ] [MAIN ] Update Progress: 207/2372 symbols completed. BAC took 32.3s. Estimated remaining: 4h 39m 58s. Rate: 7.7 symbols/min [2025-09-22T17:26:50.086322] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:26:50.086512] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-22T17:26:50.086594] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-22T17:26:50.086977] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-22T17:26:50.087065] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-22T17:26:50.087174] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-22T17:26:50.087236] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-22T17:26:50.130070] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-22T17:26:50.452706] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:26:50.482784] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T17:26:50.583341] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T17:26:50.922070] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-22T17:26:51.722058] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-22T17:26:51.876810] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T17:26:51.994842] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T17:26:52.529948] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-22T17:26:52.531835] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-22T17:26:53.322063] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-22T17:26:53.909592] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T17:26:54.122118] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-22T17:26:54.712532] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T17:26:54.922108] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-22T17:26:55.722031] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-22T17:26:55.969985] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T17:26:55.978427] [INFO ] [REMOTE ] BAH: Full fetch complete (74821 records). [2025-09-22T17:26:55.978603] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-22T17:26:56.399880] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-22T17:26:56.399979] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-22T17:26:56.400797] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-22T17:26:56.400864] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-22T17:26:56.402364] [DEBUG] [LOCAL ] BAH: Trimmed 74821 records to 51749 (keeping 200 days of data) [2025-09-22T17:26:56.522144] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-22T17:26:56.664128] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T17:26:56.716143] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T17:26:56.812020] [DEBUG] [LOCAL ] BAH: Primary data saved (51749 records). [2025-09-22T17:26:56.812167] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-22T17:26:56.814250] [INFO ] [MAIN ] Update Progress: 208/2372 symbols completed. BAH took 33.6s. Estimated remaining: 4h 39m 41s. Rate: 7.7 symbols/min [2025-09-22T17:26:56.983737] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:26:57.042901] [DEBUG] [LOCAL ] BAM: Loaded 52787 existing records from primary storage. [2025-09-22T17:26:57.043057] [INFO ] [MAIN ] BAM: Loaded 52787 existing records. [2025-09-22T17:26:57.224049] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:26:57.224302] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-22T17:26:57.224350] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-22T17:26:57.226824] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-22T17:26:57.226888] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-22T17:26:57.328071] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-22T17:26:57.597753] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:26:58.122153] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-22T17:26:58.184697] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T17:26:58.741289] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T17:26:58.770292] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T17:26:58.922107] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-22T17:26:59.414813] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-22T17:26:59.722118] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-22T17:27:00.522086] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-22T17:27:01.265149] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T17:27:01.302210] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T17:27:01.322008] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-22T17:27:02.122076] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-22T17:27:02.922067] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-22T17:27:03.722077] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-22T17:27:04.584536] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (3.26 seconds). [2025-09-22T17:27:04.588004] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-22T17:27:05.031874] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-22T17:27:05.320277] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T17:27:05.322929] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-22T17:27:05.441982] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T17:27:05.502263] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-22T17:27:06.122056] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-22T17:27:06.334406] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T17:27:06.666341] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-22T17:27:06.922044] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-22T17:27:07.722115] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-22T17:27:08.522038] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-22T17:27:08.840570] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T17:27:09.327149] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-22T17:27:09.343592] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T17:27:09.571183] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T17:27:09.577910] [INFO ] [REMOTE ] BAK: Full fetch complete (57066 records). [2025-09-22T17:27:09.578065] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-22T17:27:09.864171] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-22T17:27:09.989437] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-22T17:27:09.989525] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-22T17:27:09.990186] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-22T17:27:09.990252] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-22T17:27:09.991565] [DEBUG] [LOCAL ] BAK: Trimmed 57066 records to 38789 (keeping 200 days of data) [2025-09-22T17:27:10.149252] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-22T17:27:10.211682] [DEBUG] [LOCAL ] BAK: Primary data saved (38789 records). [2025-09-22T17:27:10.211805] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-22T17:27:10.211878] [INFO ] [MAIN ] Update Progress: 209/2372 symbols completed. BAK took 24.0s. Estimated remaining: 4h 40m 32s. Rate: 7.7 symbols/min [2025-09-22T17:27:10.381831] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:27:10.382024] [DEBUG] [LOCAL ] BANC: No existing data file found in primary storage. [2025-09-22T17:27:10.382087] [WARN ] [MAIN ] BANC: No existing data found, performing full refresh instead. [2025-09-22T17:27:10.382260] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-22T17:27:10.382302] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-22T17:27:10.382344] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-09-22T17:27:10.382376] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-22T17:27:10.745049] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:27:10.922055] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-22T17:27:11.548668] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T17:27:11.722053] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-22T17:27:12.217721] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T17:27:12.522131] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-22T17:27:13.322033] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-22T17:27:13.426736] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T17:27:13.427452] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T17:27:13.440712] [INFO ] [REMOTE ] BALY: Full fetch complete (17561 records). [2025-09-22T17:27:13.440803] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-22T17:27:13.630445] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T17:27:13.630821] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:27:13.630910] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:27:13.631004] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-22T17:27:13.631089] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-22T17:27:13.631129] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-22T17:27:13.631195] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-22T17:27:13.631278] [INFO ] [MAIN ] Update Progress: 210/2372 symbols completed. BALY took 23.7s. Estimated remaining: 4h 39m 39s. Rate: 7.7 symbols/min [2025-09-22T17:27:13.802321] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:27:13.830390] [DEBUG] [LOCAL ] BAP: Loaded 26919 existing records from primary storage. [2025-09-22T17:27:13.830527] [INFO ] [MAIN ] BAP: Loaded 26919 existing records. [2025-09-22T17:27:14.009963] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:27:14.010237] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-22T17:27:14.010287] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-22T17:27:14.011523] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-22T17:27:14.011597] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-22T17:27:14.127147] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-22T17:27:14.389273] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:27:14.695343] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T17:27:14.922114] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-22T17:27:15.722110] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-22T17:27:15.893893] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T17:27:15.929046] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T17:27:16.522056] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-22T17:27:17.322054] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-22T17:27:18.122075] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-22T17:27:18.762024] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-22T17:27:18.922093] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-22T17:27:19.068192] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (3.35 seconds). [2025-09-22T17:27:19.631984] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-22T17:27:19.722111] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-22T17:27:20.082134] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T17:27:20.522134] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-22T17:27:20.741721] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-22T17:27:21.135690] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T17:27:21.322099] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-22T17:27:21.420096] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T17:27:22.122130] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-22T17:27:22.865545] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T17:27:22.922010] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-22T17:27:23.722054] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-22T17:27:23.946554] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T17:27:24.235009] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T17:27:24.522108] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-22T17:27:24.784287] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T17:27:25.322069] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-22T17:27:26.122067] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-22T17:27:26.188759] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T17:27:26.922101] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-22T17:27:27.022393] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T17:27:27.722058] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-22T17:27:27.871362] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T17:27:27.896270] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T17:27:28.522057] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-22T17:27:29.322044] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-22T17:27:29.681381] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T17:27:30.122096] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-22T17:27:30.521262] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T17:27:30.922118] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-22T17:27:31.205849] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T17:27:31.214241] [INFO ] [REMOTE ] BAM: Full fetch complete (73939 records). [2025-09-22T17:27:31.214383] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-22T17:27:31.610676] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-22T17:27:31.610821] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-22T17:27:31.611582] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-22T17:27:31.611753] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-22T17:27:31.634601] [DEBUG] [LOCAL ] BAM: Trimmed 73939 records to 52009 (keeping 200 days of data) [2025-09-22T17:27:31.634453] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T17:27:31.643823] [INFO ] [REMOTE ] BALL: Full fetch complete (75348 records). [2025-09-22T17:27:31.643975] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-22T17:27:31.728086] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-22T17:27:32.279086] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-22T17:27:32.280561] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-22T17:27:32.281487] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-22T17:27:32.281853] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-22T17:27:32.374816] [DEBUG] [LOCAL ] BALL: Trimmed 75348 records to 51825 (keeping 200 days of data) [2025-09-22T17:27:32.519788] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T17:27:32.534032] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-22T17:27:32.772888] [DEBUG] [LOCAL ] BAM: Primary data saved (52009 records). [2025-09-22T17:27:32.773576] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-22T17:27:32.775547] [INFO ] [MAIN ] Update Progress: 211/2372 symbols completed. BAM took 36.0s. Estimated remaining: 4h 41m 28s. Rate: 7.7 symbols/min [2025-09-22T17:27:32.957355] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:27:33.035984] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T17:27:33.076198] [DEBUG] [LOCAL ] BARK: Loaded 39179 existing records from primary storage. [2025-09-22T17:27:33.076859] [INFO ] [MAIN ] BARK: Loaded 39179 existing records. [2025-09-22T17:27:33.242552] [DEBUG] [LOCAL ] BALL: Primary data saved (51825 records). [2025-09-22T17:27:33.263541] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-22T17:27:33.263852] [INFO ] [MAIN ] Update Progress: 212/2372 symbols completed. BALL took 45.0s. Estimated remaining: 4h 40m 6s. Rate: 7.7 symbols/min [2025-09-22T17:27:33.263674] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:27:33.264090] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-22T17:27:33.264277] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-22T17:27:33.307891] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-22T17:27:33.334807] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-22T17:27:33.324061] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-22T17:27:33.646686] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:27:33.855197] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:27:33.906039] [DEBUG] [LOCAL ] BAX: Loaded 54268 existing records from primary storage. [2025-09-22T17:27:33.907035] [INFO ] [MAIN ] BAX: Loaded 54268 existing records. [2025-09-22T17:27:34.111352] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:27:34.111735] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-22T17:27:34.111798] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-22T17:27:34.114038] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-22T17:27:34.114120] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-22T17:27:34.149056] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-22T17:27:34.528021] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:27:34.545638] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T17:27:34.582166] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-22T17:27:34.922021] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-22T17:27:35.722021] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-22T17:27:35.918395] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T17:27:36.063698] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-22T17:27:36.522095] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-22T17:27:37.259222] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T17:27:37.322083] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-22T17:27:38.122086] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-22T17:27:38.427406] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T17:27:38.532569] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T17:27:38.922103] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-22T17:27:39.610585] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T17:27:39.722036] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-22T17:27:39.985089] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T17:27:39.990068] [INFO ] [REMOTE ] BAP: Full fetch complete (38124 records). [2025-09-22T17:27:39.990163] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-22T17:27:40.387850] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-22T17:27:40.387944] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-22T17:27:40.388483] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-22T17:27:40.388527] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-22T17:27:40.389530] [DEBUG] [LOCAL ] BAP: Trimmed 38124 records to 26391 (keeping 200 days of data) [2025-09-22T17:27:40.536617] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-22T17:27:40.560924] [DEBUG] [LOCAL ] BAP: Primary data saved (26391 records). [2025-09-22T17:27:40.561032] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-22T17:27:40.561115] [INFO ] [MAIN ] Update Progress: 213/2372 symbols completed. BAP took 26.9s. Estimated remaining: 4h 39m 53s. Rate: 7.7 symbols/min [2025-09-22T17:27:40.744116] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:27:40.798256] [DEBUG] [LOCAL ] BB: Loaded 53703 existing records from primary storage. [2025-09-22T17:27:40.798442] [INFO ] [MAIN ] BB: Loaded 53703 existing records. [2025-09-22T17:27:40.975356] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:27:40.975669] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-22T17:27:40.975731] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-22T17:27:40.977779] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-22T17:27:40.977844] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-22T17:27:41.323962] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-22T17:27:41.357097] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:27:41.389711] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T17:27:41.398795] [INFO ] [REMOTE ] BANC: Full fetch complete (74043 records). [2025-09-22T17:27:41.398973] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-22T17:27:41.807892] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-22T17:27:41.808003] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-22T17:27:41.808916] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-22T17:27:41.809066] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-22T17:27:41.811021] [DEBUG] [LOCAL ] BANC: Trimmed 74043 records to 51261 (keeping 200 days of data) [2025-09-22T17:27:41.965799] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T17:27:42.137613] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-22T17:27:42.181044] [DEBUG] [LOCAL ] BANC: Primary data saved (51261 records). [2025-09-22T17:27:42.181253] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-22T17:27:42.181349] [INFO ] [MAIN ] Update Progress: 214/2372 symbols completed. BANC took 32.0s. Estimated remaining: 4h 38m 43s. Rate: 7.7 symbols/min [2025-09-22T17:27:42.360571] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:27:42.424931] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-22T17:27:42.425174] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-09-22T17:27:42.631383] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:27:42.631771] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-22T17:27:42.631833] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-22T17:27:42.634293] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-22T17:27:42.634366] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-22T17:27:42.930254] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-22T17:27:43.059192] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:27:43.063113] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T17:27:43.722102] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-22T17:27:44.140206] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-22T17:27:44.522061] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-22T17:27:44.747511] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T17:27:45.322091] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-22T17:27:46.109280] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T17:27:46.122006] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-22T17:27:46.928800] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-22T17:27:46.950702] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T17:27:47.059610] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (3.34 seconds). [2025-09-22T17:27:47.722027] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-22T17:27:47.795730] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T17:27:48.522105] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-22T17:27:48.771760] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T17:27:49.322066] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-22T17:27:49.544179] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T17:27:49.977449] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-22T17:27:50.122020] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-22T17:27:50.884474] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T17:27:50.922007] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-22T17:27:51.722062] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-22T17:27:52.522084] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-22T17:27:52.595508] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-22T17:27:52.884230] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T17:27:53.246369] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T17:27:53.322081] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-22T17:27:53.438311] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-22T17:27:54.122165] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-22T17:27:54.922063] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-22T17:27:55.649520] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-22T17:27:55.722070] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-22T17:27:55.915533] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T17:27:56.522137] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-22T17:27:56.657812] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T17:27:57.322056] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-22T17:27:58.122115] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-22T17:27:58.458476] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-22T17:27:58.608663] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-22T17:27:58.922063] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-22T17:27:58.921954] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T17:27:59.555319] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T17:27:59.722063] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-22T17:28:00.522067] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-22T17:28:00.832131] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T17:28:01.314697] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-22T17:28:01.325301] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-22T17:28:02.122071] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-22T17:28:02.183242] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T17:28:02.913450] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T17:28:02.919210] [INFO ] [REMOTE ] BARK: Full fetch complete (57203 records). [2025-09-22T17:28:02.919338] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-22T17:28:02.931568] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-22T17:28:03.306141] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-22T17:28:03.306307] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-22T17:28:03.307008] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-22T17:28:03.307079] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-22T17:28:03.308448] [DEBUG] [LOCAL ] BARK: Trimmed 57203 records to 38462 (keeping 200 days of data) [2025-09-22T17:28:03.522509] [DEBUG] [LOCAL ] BARK: Primary data saved (38462 records). [2025-09-22T17:28:03.522674] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-22T17:28:03.524931] [INFO ] [MAIN ] Update Progress: 215/2372 symbols completed. BARK took 30.7s. Estimated remaining: 4h 40m 52s. Rate: 7.7 symbols/min [2025-09-22T17:28:03.695156] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:28:03.723192] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-22T17:28:03.743077] [DEBUG] [LOCAL ] BBAR: Loaded 41690 existing records from primary storage. [2025-09-22T17:28:03.743238] [INFO ] [MAIN ] BBAR: Loaded 41690 existing records. [2025-09-22T17:28:03.928193] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:28:03.928474] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-22T17:28:03.928549] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-22T17:28:03.929755] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-22T17:28:03.929815] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-22T17:28:04.283730] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:28:04.522122] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-22T17:28:04.595682] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-22T17:28:04.975313] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-22T17:28:05.322073] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-22T17:28:05.559048] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T17:28:05.996147] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T17:28:06.122065] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-22T17:28:06.922060] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-22T17:28:07.651521] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T17:28:07.722097] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-22T17:28:08.057442] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-22T17:28:08.411481] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T17:28:08.522075] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-22T17:28:09.322084] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-22T17:28:09.567803] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T17:28:09.579010] [INFO ] [REMOTE ] BB: Full fetch complete (76955 records). [2025-09-22T17:28:09.579339] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-22T17:28:10.063883] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-22T17:28:10.063986] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-22T17:28:10.064842] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-22T17:28:10.064910] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-22T17:28:10.066530] [DEBUG] [LOCAL ] BB: Trimmed 76955 records to 52923 (keeping 200 days of data) [2025-09-22T17:28:10.124703] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-22T17:28:10.383305] [DEBUG] [LOCAL ] BB: Primary data saved (52923 records). [2025-09-22T17:28:10.383491] [INFO ] [MAIN ] BB: Full history saved. [2025-09-22T17:28:10.383623] [INFO ] [MAIN ] Update Progress: 216/2372 symbols completed. BB took 29.8s. Estimated remaining: 4h 40m 34s. Rate: 7.7 symbols/min [2025-09-22T17:28:10.558751] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:28:10.592193] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-22T17:28:10.602485] [INFO ] [REMOTE ] BAX: Full fetch complete (77433 records). [2025-09-22T17:28:10.602848] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-22T17:28:10.923201] [DEBUG] [LOCAL ] BBD: Loaded 53954 existing records from primary storage. [2025-09-22T17:28:10.934528] [INFO ] [MAIN ] BBD: Loaded 53954 existing records. [2025-09-22T17:28:11.262259] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-22T17:28:11.277799] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-22T17:28:11.278909] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-22T17:28:11.278998] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-22T17:28:11.286753] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:28:11.287429] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-22T17:28:11.287606] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-22T17:28:11.288477] [DEBUG] [LOCAL ] BAX: Trimmed 77433 records to 53491 (keeping 200 days of data) [2025-09-22T17:28:11.290405] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-22T17:28:11.290484] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-22T17:28:11.820253] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:28:11.821302] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-22T17:28:11.857918] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T17:28:11.872036] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-22T17:28:12.090509] [DEBUG] [LOCAL ] BAX: Primary data saved (53491 records). [2025-09-22T17:28:12.090678] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-22T17:28:12.090813] [INFO ] [MAIN ] Update Progress: 217/2372 symbols completed. BAX took 38.8s. Estimated remaining: 4h 39m 26s. Rate: 7.7 symbols/min [2025-09-22T17:28:12.237856] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-09-22T17:28:12.312812] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:28:12.348160] [DEBUG] [LOCAL ] BBDC: Loaded 33965 existing records from primary storage. [2025-09-22T17:28:12.348310] [INFO ] [MAIN ] BBDC: Loaded 33965 existing records. [2025-09-22T17:28:12.527723] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-22T17:28:12.533639] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:28:12.535354] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-22T17:28:12.535417] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-22T17:28:12.538180] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-22T17:28:12.538241] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-22T17:28:12.917106] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:28:13.322030] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-22T17:28:13.359155] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T17:28:13.843733] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T17:28:14.122174] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-22T17:28:14.512301] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T17:28:14.927239] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-22T17:28:14.950065] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-22T17:28:14.962358] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-22T17:28:14.962605] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-22T17:28:15.550959] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-22T17:28:15.551179] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-22T17:28:15.552825] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-22T17:28:15.552919] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-22T17:28:15.554916] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-22T17:28:15.716488] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T17:28:15.730783] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-22T17:28:15.957625] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-22T17:28:15.957814] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-22T17:28:15.957905] [INFO ] [MAIN ] Update Progress: 218/2372 symbols completed. BBAI took 33.8s. Estimated remaining: 4h 38m 40s. Rate: 7.7 symbols/min [2025-09-22T17:28:16.130496] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:28:16.137634] [DEBUG] [LOCAL ] BBDO: Loaded 5129 existing records from primary storage. [2025-09-22T17:28:16.137800] [INFO ] [MAIN ] BBDO: Loaded 5129 existing records. [2025-09-22T17:28:16.317309] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:28:16.317799] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-22T17:28:16.318009] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-22T17:28:16.318381] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-22T17:28:16.318446] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-22T17:28:16.527194] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-22T17:28:16.694717] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T17:28:16.737522] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:28:17.111170] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T17:28:17.322059] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-22T17:28:18.056190] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:28:18.122075] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-22T17:28:18.579401] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T17:28:18.922093] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-22T17:28:19.619559] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-22T17:28:19.722070] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-22T17:28:19.831638] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T17:28:20.522054] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-22T17:28:20.939143] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T17:28:21.197418] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T17:28:21.322063] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-22T17:28:21.703329] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-22T17:28:22.122089] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-22T17:28:22.583597] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T17:28:22.922062] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-22T17:28:23.722075] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-22T17:28:24.146264] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T17:28:24.522086] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-22T17:28:24.948884] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T17:28:25.322060] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-22T17:28:26.060352] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T17:28:26.122036] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-22T17:28:26.748637] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T17:28:26.857701] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T17:28:26.922014] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-22T17:28:27.328622] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-22T17:28:27.722054] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-22T17:28:28.522057] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-22T17:28:28.982324] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-22T17:28:29.190209] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T17:28:29.322075] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-22T17:28:30.122048] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-22T17:28:30.827038] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T17:28:30.922051] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-22T17:28:31.288451] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-22T17:28:31.722076] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-22T17:28:31.849791] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T17:28:32.522081] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-22T17:28:32.898051] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-22T17:28:33.003926] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T17:28:33.322033] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-22T17:28:34.122071] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-22T17:28:34.922062] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-22T17:28:34.983183] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T17:28:34.991800] [INFO ] [REMOTE ] BBAR: Full fetch complete (60496 records). [2025-09-22T17:28:34.991963] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-22T17:28:35.428078] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-22T17:28:35.428164] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-22T17:28:35.428828] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-22T17:28:35.428894] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-22T17:28:35.430176] [DEBUG] [LOCAL ] BBAR: Trimmed 60496 records to 41183 (keeping 200 days of data) [2025-09-22T17:28:35.694356] [DEBUG] [LOCAL ] BBAR: Primary data saved (41183 records). [2025-09-22T17:28:35.694496] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-22T17:28:35.701591] [INFO ] [MAIN ] Update Progress: 219/2372 symbols completed. BBAR took 32.2s. Estimated remaining: 4h 40m 30s. Rate: 7.7 symbols/min [2025-09-22T17:28:35.735936] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-22T17:28:35.905443] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:28:35.930541] [DEBUG] [LOCAL ] BBN: Loaded 18292 existing records from primary storage. [2025-09-22T17:28:35.930751] [INFO ] [MAIN ] BBN: Loaded 18292 existing records. [2025-09-22T17:28:36.160936] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:28:36.167634] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T17:28:36.180215] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-22T17:28:36.180480] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-22T17:28:36.183184] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-22T17:28:36.183257] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-22T17:28:36.304600] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T17:28:36.300878] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T17:28:36.339817] [INFO ] [REMOTE ] BBDO: Full fetch complete (7794 records). [2025-09-22T17:28:36.345787] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-22T17:28:36.531589] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-22T17:28:36.935480] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:28:37.058668] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-22T17:28:37.058785] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-22T17:28:37.059208] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-22T17:28:37.059291] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-22T17:28:37.060480] [DEBUG] [LOCAL ] BBDO: Trimmed 7794 records to 5039 (keeping 200 days of data) [2025-09-22T17:28:37.092619] [DEBUG] [LOCAL ] BBDO: Primary data saved (5039 records). [2025-09-22T17:28:37.092784] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-22T17:28:37.092912] [INFO ] [MAIN ] Update Progress: 220/2372 symbols completed. BBDO took 21.1s. Estimated remaining: 4h 39m 19s. Rate: 7.7 symbols/min [2025-09-22T17:28:37.271316] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:28:37.271554] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-22T17:28:37.271895] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-22T17:28:37.272055] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-22T17:28:37.272104] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-22T17:28:37.272148] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-22T17:28:37.272199] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-22T17:28:37.329802] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-22T17:28:37.658114] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:28:38.122089] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-22T17:28:38.175391] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T17:28:38.562526] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T17:28:38.922087] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-22T17:28:39.039276] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T17:28:39.722100] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-22T17:28:39.939204] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:28:39.939590] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-22T17:28:40.522076] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-22T17:28:40.694541] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T17:28:40.703050] [INFO ] [REMOTE ] BBD: Full fetch complete (77119 records). [2025-09-22T17:28:40.703220] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-22T17:28:40.748600] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:28:40.782366] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-22T17:28:41.119190] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-22T17:28:41.119280] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-22T17:28:41.120129] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-22T17:28:41.120214] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-22T17:28:41.124753] [DEBUG] [LOCAL ] BBD: Trimmed 77119 records to 53179 (keeping 200 days of data) [2025-09-22T17:28:41.337086] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-22T17:28:41.451853] [DEBUG] [LOCAL ] BBD: Primary data saved (53179 records). [2025-09-22T17:28:41.452009] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-22T17:28:41.452744] [INFO ] [MAIN ] Update Progress: 221/2372 symbols completed. BBD took 31.1s. Estimated remaining: 4h 38m 38s. Rate: 7.7 symbols/min [2025-09-22T17:28:41.629605] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:28:41.637115] [DEBUG] [LOCAL ] BBU: Loaded 4115 existing records from primary storage. [2025-09-22T17:28:41.637222] [INFO ] [MAIN ] BBU: Loaded 4115 existing records. [2025-09-22T17:28:41.822586] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:28:41.823224] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-22T17:28:41.823284] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-22T17:28:41.823762] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-22T17:28:41.823824] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-22T17:28:42.127091] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-22T17:28:42.209804] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:28:42.222940] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T17:28:42.922122] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-22T17:28:43.563214] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T17:28:43.588139] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T17:28:43.722060] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-22T17:28:44.522075] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-22T17:28:45.179926] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T17:28:45.248103] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T17:28:45.322015] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-22T17:28:46.122066] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-22T17:28:46.745610] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T17:28:46.821383] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-22T17:28:46.922061] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-22T17:28:47.722070] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-22T17:28:47.951073] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:28:47.951419] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-22T17:28:48.067272] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T17:28:48.073275] [INFO ] [REMOTE ] BBDC: Full fetch complete (48983 records). [2025-09-22T17:28:48.073423] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-22T17:28:48.472237] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-22T17:28:48.472360] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-22T17:28:48.473473] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-22T17:28:48.473590] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-22T17:28:48.475501] [DEBUG] [LOCAL ] BBDC: Trimmed 48983 records to 33253 (keeping 200 days of data) [2025-09-22T17:28:48.539375] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-22T17:28:48.715017] [DEBUG] [LOCAL ] BBDC: Primary data saved (33253 records). [2025-09-22T17:28:48.715430] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-22T17:28:48.715723] [INFO ] [MAIN ] Update Progress: 222/2372 symbols completed. BBDC took 36.6s. Estimated remaining: 4h 38m 25s. Rate: 7.7 symbols/min [2025-09-22T17:28:48.903546] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:28:48.921009] [DEBUG] [LOCAL ] BBUC: Loaded 13440 existing records from primary storage. [2025-09-22T17:28:48.921121] [INFO ] [MAIN ] BBUC: Loaded 13440 existing records. [2025-09-22T17:28:49.096950] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:28:49.097221] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-22T17:28:49.097270] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-22T17:28:49.099289] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-22T17:28:49.099358] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-22T17:28:49.331514] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-22T17:28:49.463103] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:28:49.594958] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T17:28:49.973243] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T17:28:50.122070] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-22T17:28:50.474261] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-22T17:28:50.922053] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-22T17:28:51.129259] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:28:51.129713] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-22T17:28:51.722105] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-22T17:28:52.329767] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T17:28:52.522063] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-22T17:28:52.731200] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:28:52.732216] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-22T17:28:53.322070] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-22T17:28:53.933897] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T17:28:54.122099] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-22T17:28:54.548698] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T17:28:54.922048] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-22T17:28:55.656553] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T17:28:55.722051] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-22T17:28:55.916856] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:28:55.917179] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-22T17:28:56.522054] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-22T17:28:57.322092] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-22T17:28:57.501094] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T17:28:57.568572] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:28:57.568997] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-22T17:28:58.122065] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-22T17:28:58.323518] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:28:58.323874] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-22T17:28:58.922088] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-22T17:28:59.247021] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-22T17:28:59.722076] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-22T17:28:59.920755] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:28:59.921109] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-22T17:29:00.522111] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-22T17:29:01.322069] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-22T17:29:01.791018] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-22T17:29:02.122072] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-22T17:29:02.221025] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T17:29:02.227365] [INFO ] [REMOTE ] BBT: Full fetch complete (4573 records). [2025-09-22T17:29:02.227435] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-22T17:29:02.415802] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 15 unique days, need 200 days [2025-09-22T17:29:02.416854] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:29:02.416923] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:29:02.416971] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-22T17:29:02.417040] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-22T17:29:02.417256] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-22T17:29:02.417332] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-22T17:29:02.417411] [INFO ] [MAIN ] Update Progress: 223/2372 symbols completed. BBT took 25.3s. Estimated remaining: 4h 39m 14s. Rate: 7.7 symbols/min [2025-09-22T17:29:02.587084] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:29:02.610164] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-22T17:29:02.656044] [DEBUG] [LOCAL ] BBVA: Loaded 50331 existing records from primary storage. [2025-09-22T17:29:02.656216] [INFO ] [MAIN ] BBVA: Loaded 50331 existing records. [2025-09-22T17:29:02.834234] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:29:02.834489] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-22T17:29:02.834535] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-22T17:29:02.838221] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-22T17:29:02.838285] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-22T17:29:02.927287] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-22T17:29:03.203783] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:29:03.722026] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-22T17:29:04.071597] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T17:29:04.461944] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-22T17:29:04.522072] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-22T17:29:05.273577] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T17:29:05.322020] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-22T17:29:06.094200] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T17:29:06.095726] [INFO ] [REMOTE ] BBU: Full fetch complete (6063 records). [2025-09-22T17:29:06.095795] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-22T17:29:06.127237] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-22T17:29:06.476513] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-22T17:29:06.476618] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-22T17:29:06.476835] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-22T17:29:06.476888] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-22T17:29:06.477307] [DEBUG] [LOCAL ] BBU: Trimmed 6063 records to 4091 (keeping 200 days of data) [2025-09-22T17:29:06.502388] [DEBUG] [LOCAL ] BBU: Primary data saved (4091 records). [2025-09-22T17:29:06.502460] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-22T17:29:06.502532] [INFO ] [MAIN ] Update Progress: 224/2372 symbols completed. BBU took 25.0s. Estimated remaining: 4h 38m 31s. Rate: 7.7 symbols/min [2025-09-22T17:29:06.682633] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:29:06.711196] [DEBUG] [LOCAL ] BBW: Loaded 26896 existing records from primary storage. [2025-09-22T17:29:06.711342] [INFO ] [MAIN ] BBW: Loaded 26896 existing records. [2025-09-22T17:29:06.894953] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:29:06.895217] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-22T17:29:06.895269] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-22T17:29:06.897587] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-22T17:29:06.897676] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-22T17:29:06.928449] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-22T17:29:07.289576] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:29:07.722074] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-22T17:29:07.926357] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T17:29:07.960471] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T17:29:08.483500] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T17:29:08.522151] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-22T17:29:09.322071] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-22T17:29:09.951161] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T17:29:10.122058] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-22T17:29:10.514612] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T17:29:10.922117] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-22T17:29:11.482456] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T17:29:11.722040] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-22T17:29:11.764525] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T17:29:11.767930] [INFO ] [REMOTE ] BBN: Full fetch complete (26972 records). [2025-09-22T17:29:11.768007] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-22T17:29:12.138179] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-22T17:29:12.138263] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-22T17:29:12.138670] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-22T17:29:12.138732] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-22T17:29:12.139389] [DEBUG] [LOCAL ] BBN: Trimmed 26972 records to 18017 (keeping 200 days of data) [2025-09-22T17:29:12.259506] [DEBUG] [LOCAL ] BBN: Primary data saved (18017 records). [2025-09-22T17:29:12.259673] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-22T17:29:12.259792] [INFO ] [MAIN ] Update Progress: 225/2372 symbols completed. BBN took 36.6s. Estimated remaining: 4h 38m 4s. Rate: 7.7 symbols/min [2025-09-22T17:29:12.438137] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:29:12.448417] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-22T17:29:12.508102] [DEBUG] [LOCAL ] BBWI: Loaded 54354 existing records from primary storage. [2025-09-22T17:29:12.508268] [INFO ] [MAIN ] BBWI: Loaded 54354 existing records. [2025-09-22T17:29:12.528681] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-22T17:29:12.693699] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:29:12.693982] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-22T17:29:12.694069] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-22T17:29:12.697256] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-22T17:29:12.697322] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-22T17:29:13.057809] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:29:13.322058] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-22T17:29:13.526454] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T17:29:14.122060] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-22T17:29:14.724507] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-22T17:29:14.858708] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T17:29:14.922012] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-22T17:29:15.722089] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-22T17:29:16.427454] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T17:29:16.522083] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-22T17:29:16.739313] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T17:29:17.322082] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-22T17:29:18.060830] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T17:29:18.122066] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-22T17:29:18.291286] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T17:29:18.922069] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-22T17:29:19.722061] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-22T17:29:19.846461] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T17:29:20.024018] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T17:29:20.522053] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-22T17:29:21.204680] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T17:29:21.322056] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-22T17:29:21.856605] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T17:29:22.122087] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-22T17:29:22.189222] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T17:29:22.922129] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-22T17:29:23.723189] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-22T17:29:23.726869] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T17:29:23.794320] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T17:29:24.522067] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-22T17:29:25.188502] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-22T17:29:25.190927] [INFO ] [REMOTE ] BBUC: Full fetch complete (17250 records). [2025-09-22T17:29:25.191003] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-22T17:29:25.336396] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-22T17:29:25.576058] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-22T17:29:25.576160] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-22T17:29:25.576486] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-22T17:29:25.576569] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-22T17:29:25.577488] [DEBUG] [LOCAL ] BBUC: Trimmed 17250 records to 13152 (keeping 200 days of data) [2025-09-22T17:29:25.666782] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T17:29:25.697727] [DEBUG] [LOCAL ] BBUC: Primary data saved (13152 records). [2025-09-22T17:29:25.697849] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-22T17:29:25.697926] [INFO ] [MAIN ] Update Progress: 226/2372 symbols completed. BBUC took 37.0s. Estimated remaining: 4h 38m 50s. Rate: 7.7 symbols/min [2025-09-22T17:29:25.867903] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:29:25.923694] [DEBUG] [LOCAL ] BBY: Loaded 54263 existing records from primary storage. [2025-09-22T17:29:25.923869] [INFO ] [MAIN ] BBY: Loaded 54263 existing records. [2025-09-22T17:29:26.103217] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:29:26.103457] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-22T17:29:26.103504] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-22T17:29:26.106677] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-22T17:29:26.106739] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-22T17:29:26.127391] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-22T17:29:26.499408] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:29:26.922026] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-22T17:29:27.326599] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T17:29:27.722112] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-22T17:29:27.934228] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T17:29:28.522097] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-22T17:29:28.724272] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T17:29:29.322064] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-22T17:29:29.752441] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-22T17:29:30.055013] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T17:29:30.122090] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-22T17:29:30.481382] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T17:29:30.922050] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-22T17:29:31.541339] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T17:29:31.722100] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-22T17:29:31.782710] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T17:29:32.522096] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-22T17:29:33.322088] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-22T17:29:33.489500] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T17:29:33.497711] [INFO ] [REMOTE ] BBVA: Full fetch complete (71596 records). [2025-09-22T17:29:33.497836] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-22T17:29:33.839319] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T17:29:33.936143] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-22T17:29:33.936234] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-22T17:29:33.937027] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-22T17:29:33.937094] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-22T17:29:33.938594] [DEBUG] [LOCAL ] BBVA: Trimmed 71596 records to 49550 (keeping 200 days of data) [2025-09-22T17:29:34.132855] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-22T17:29:34.282501] [DEBUG] [LOCAL ] BBVA: Primary data saved (49550 records). [2025-09-22T17:29:34.282733] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-22T17:29:34.282843] [INFO ] [MAIN ] Update Progress: 227/2372 symbols completed. BBVA took 31.9s. Estimated remaining: 4h 38m 50s. Rate: 7.7 symbols/min [2025-09-22T17:29:34.469211] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:29:34.469466] [DEBUG] [LOCAL ] BC: No existing data file found in primary storage. [2025-09-22T17:29:34.469517] [WARN ] [MAIN ] BC: No existing data found, performing full refresh instead. [2025-09-22T17:29:34.469702] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-22T17:29:34.469757] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-22T17:29:34.469802] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-09-22T17:29:34.469836] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-22T17:29:34.838709] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:29:34.922038] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-22T17:29:35.163939] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T17:29:35.178729] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T17:29:35.722069] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-22T17:29:36.251316] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T17:29:36.522094] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-22T17:29:37.322060] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-22T17:29:37.434952] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T17:29:37.682733] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T17:29:38.122061] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-22T17:29:38.922055] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-22T17:29:39.232113] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T17:29:39.722097] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-22T17:29:39.924036] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T17:29:40.441327] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T17:29:40.447232] [INFO ] [REMOTE ] BBW: Full fetch complete (39176 records). [2025-09-22T17:29:40.447408] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-22T17:29:40.527322] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-22T17:29:40.894605] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-22T17:29:40.894776] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-22T17:29:40.895488] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-22T17:29:40.895542] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-22T17:29:40.896507] [DEBUG] [LOCAL ] BBW: Trimmed 39176 records to 26617 (keeping 200 days of data) [2025-09-22T17:29:41.057538] [DEBUG] [LOCAL ] BBW: Primary data saved (26617 records). [2025-09-22T17:29:41.057718] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-22T17:29:41.057818] [INFO ] [MAIN ] Update Progress: 228/2372 symbols completed. BBW took 34.6s. Estimated remaining: 4h 38m 32s. Rate: 7.7 symbols/min [2025-09-22T17:29:41.231250] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:29:41.255803] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:29:41.296442] [DEBUG] [LOCAL ] BCAT: Loaded 35198 existing records from primary storage. [2025-09-22T17:29:41.296595] [INFO ] [MAIN ] BCAT: Loaded 35198 existing records. [2025-09-22T17:29:41.328112] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-22T17:29:41.482055] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:29:41.482383] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-22T17:29:41.482477] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-22T17:29:41.483567] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-22T17:29:41.483630] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-22T17:29:41.858407] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:29:41.994665] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T17:29:42.122057] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-22T17:29:42.922043] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-22T17:29:42.997846] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T17:29:43.722262] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-22T17:29:43.992122] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T17:29:44.314172] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:29:44.522117] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-22T17:29:45.322025] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-22T17:29:45.439489] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T17:29:45.537546] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T17:29:46.122049] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-22T17:29:46.926762] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-22T17:29:46.929371] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T17:29:47.030695] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T17:29:47.722082] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-22T17:29:48.522065] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-22T17:29:48.713151] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T17:29:48.762079] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T17:29:49.322091] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-22T17:29:50.122036] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-22T17:29:50.579301] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-22T17:29:50.640405] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T17:29:50.922050] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-22T17:29:51.722080] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-22T17:29:52.023476] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T17:29:52.031952] [INFO ] [REMOTE ] BBWI: Full fetch complete (77410 records). [2025-09-22T17:29:52.032137] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-22T17:29:52.428745] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-22T17:29:52.428841] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-22T17:29:52.429626] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-22T17:29:52.429709] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-22T17:29:52.431221] [DEBUG] [LOCAL ] BBWI: Trimmed 77410 records to 53576 (keeping 200 days of data) [2025-09-22T17:29:52.522407] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-22T17:29:52.695869] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T17:29:52.819630] [DEBUG] [LOCAL ] BBWI: Primary data saved (53576 records). [2025-09-22T17:29:52.819837] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-22T17:29:52.820682] [INFO ] [MAIN ] Update Progress: 229/2372 symbols completed. BBWI took 40.6s. Estimated remaining: 4h 39m 2s. Rate: 7.7 symbols/min [2025-09-22T17:29:52.992148] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:29:53.025820] [DEBUG] [LOCAL ] BCC: Loaded 28900 existing records from primary storage. [2025-09-22T17:29:53.025971] [INFO ] [MAIN ] BCC: Loaded 28900 existing records. [2025-09-22T17:29:53.211739] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:29:53.212370] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-22T17:29:53.212470] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-22T17:29:53.213677] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-22T17:29:53.213749] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-22T17:29:53.323070] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-22T17:29:53.459167] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T17:29:53.621244] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:29:53.968132] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T17:29:54.122070] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-22T17:29:54.871455] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T17:29:54.922009] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-22T17:29:55.197684] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T17:29:55.722084] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-22T17:29:56.522042] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-22T17:29:56.886564] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T17:29:56.941406] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-22T17:29:57.322061] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-22T17:29:57.773676] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T17:29:58.122089] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-22T17:29:58.817033] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T17:29:58.922043] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-22T17:29:59.157299] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T17:29:59.722059] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-22T17:30:00.191817] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T17:30:00.522075] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-22T17:30:01.331550] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-22T17:30:01.344407] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T17:30:01.352499] [INFO ] [REMOTE ] BC: Full fetch complete (63689 records). [2025-09-22T17:30:01.352699] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-22T17:30:01.800483] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-22T17:30:01.800625] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-22T17:30:01.801613] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-22T17:30:01.801729] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-22T17:30:01.803622] [DEBUG] [LOCAL ] BC: Trimmed 63689 records to 44536 (keeping 200 days of data) [2025-09-22T17:30:02.114472] [DEBUG] [LOCAL ] BC: Primary data saved (44536 records). [2025-09-22T17:30:02.114733] [INFO ] [MAIN ] BC: Full history saved. [2025-09-22T17:30:02.114878] [INFO ] [MAIN ] Update Progress: 230/2372 symbols completed. BC took 27.8s. Estimated remaining: 4h 39m 8s. Rate: 7.7 symbols/min [2025-09-22T17:30:02.150151] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-22T17:30:02.315450] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:30:02.370450] [DEBUG] [LOCAL ] BCE: Loaded 53142 existing records from primary storage. [2025-09-22T17:30:02.370709] [INFO ] [MAIN ] BCE: Loaded 53142 existing records. [2025-09-22T17:30:02.563413] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:30:02.563926] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-22T17:30:02.563990] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-22T17:30:02.565686] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-22T17:30:02.565768] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-22T17:30:02.968800] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:30:02.969239] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-22T17:30:03.093821] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-22T17:30:03.103255] [INFO ] [REMOTE ] BBY: Full fetch complete (77253 records). [2025-09-22T17:30:03.103488] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-22T17:30:03.533241] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-22T17:30:03.533364] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-22T17:30:03.534672] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-22T17:30:03.534853] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-22T17:30:03.537598] [DEBUG] [LOCAL ] BBY: Trimmed 77253 records to 53482 (keeping 200 days of data) [2025-09-22T17:30:03.912627] [DEBUG] [LOCAL ] BBY: Primary data saved (53482 records). [2025-09-22T17:30:03.913063] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-22T17:30:03.913233] [INFO ] [MAIN ] Update Progress: 231/2372 symbols completed. BBY took 38.2s. Estimated remaining: 4h 38m 4s. Rate: 7.7 symbols/min [2025-09-22T17:30:04.118780] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:30:04.157235] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-09-22T17:30:04.165589] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-22T17:30:04.177762] [DEBUG] [LOCAL ] BCH: Loaded 30018 existing records from primary storage. [2025-09-22T17:30:04.177981] [INFO ] [MAIN ] BCH: Loaded 30018 existing records. [2025-09-22T17:30:04.382601] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:30:04.382945] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-22T17:30:04.382999] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-22T17:30:04.384072] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-22T17:30:04.384145] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-22T17:30:04.790746] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:30:04.791380] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-22T17:30:05.162416] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-22T17:30:05.322151] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-22T17:30:05.515682] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T17:30:06.082436] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T17:30:06.122012] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-22T17:30:06.236100] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (3.27 seconds). [2025-09-22T17:30:06.396522] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T17:30:06.925686] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T17:30:06.922113] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-22T17:30:07.722068] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-22T17:30:08.004138] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T17:30:08.522032] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-22T17:30:08.915210] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T17:30:09.322046] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-22T17:30:10.122031] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-22T17:30:10.188417] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-22T17:30:10.270173] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T17:30:10.922043] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-22T17:30:11.571122] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T17:30:11.577044] [INFO ] [REMOTE ] BCAT: Full fetch complete (49871 records). [2025-09-22T17:30:11.577209] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-22T17:30:11.727878] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-22T17:30:11.967735] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-22T17:30:11.967865] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-22T17:30:11.968459] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-22T17:30:11.968501] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-22T17:30:11.969589] [DEBUG] [LOCAL ] BCAT: Trimmed 49871 records to 34509 (keeping 200 days of data) [2025-09-22T17:30:12.191965] [DEBUG] [LOCAL ] BCAT: Primary data saved (34509 records). [2025-09-22T17:30:12.192118] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-22T17:30:12.192208] [INFO ] [MAIN ] Update Progress: 232/2372 symbols completed. BCAT took 31.1s. Estimated remaining: 4h 38m 1s. Rate: 7.7 symbols/min [2025-09-22T17:30:12.370928] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:30:12.393363] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T17:30:12.425004] [DEBUG] [LOCAL ] BCO: Loaded 26929 existing records from primary storage. [2025-09-22T17:30:12.425161] [INFO ] [MAIN ] BCO: Loaded 26929 existing records. [2025-09-22T17:30:12.527347] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-22T17:30:12.613562] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:30:12.613839] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-22T17:30:12.613909] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-22T17:30:12.614632] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-22T17:30:12.614734] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-22T17:30:13.004755] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:30:13.023243] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T17:30:13.322069] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-22T17:30:13.725544] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T17:30:14.122075] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-22T17:30:14.629785] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T17:30:14.922069] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-22T17:30:14.995882] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-22T17:30:15.722063] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-22T17:30:16.459887] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T17:30:16.522156] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-22T17:30:17.322074] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-22T17:30:18.007969] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-22T17:30:18.122064] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-22T17:30:18.771365] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-22T17:30:18.922001] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-22T17:30:19.443827] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T17:30:19.634969] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-22T17:30:19.722074] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-22T17:30:19.919353] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T17:30:20.522094] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-22T17:30:20.791201] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-22T17:30:21.322083] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-22T17:30:22.122081] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-22T17:30:22.338409] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T17:30:22.675838] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T17:30:22.922085] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-22T17:30:23.037168] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-22T17:30:23.722071] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-22T17:30:23.757738] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T17:30:24.522065] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-22T17:30:24.930524] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T17:30:25.322059] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-22T17:30:26.040063] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T17:30:26.047561] [INFO ] [REMOTE ] BCC: Full fetch complete (40118 records). [2025-09-22T17:30:26.047787] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-22T17:30:26.128100] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-22T17:30:26.439131] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-22T17:30:26.439222] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-22T17:30:26.439728] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-22T17:30:26.439789] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-22T17:30:26.440822] [DEBUG] [LOCAL ] BCC: Trimmed 40118 records to 28411 (keeping 200 days of data) [2025-09-22T17:30:26.626794] [DEBUG] [LOCAL ] BCC: Primary data saved (28411 records). [2025-09-22T17:30:26.626943] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-22T17:30:26.630076] [INFO ] [MAIN ] Update Progress: 233/2372 symbols completed. BCC took 33.8s. Estimated remaining: 4h 38m 54s. Rate: 7.7 symbols/min [2025-09-22T17:30:26.813166] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:30:26.879771] [DEBUG] [LOCAL ] BCS: Loaded 54253 existing records from primary storage. [2025-09-22T17:30:26.880015] [INFO ] [MAIN ] BCS: Loaded 54253 existing records. [2025-09-22T17:30:26.937265] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-22T17:30:27.104588] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T17:30:27.111490] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:30:27.122976] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-22T17:30:27.123199] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-22T17:30:27.124763] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-22T17:30:27.124864] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-22T17:30:27.528154] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:30:27.559182] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T17:30:27.722078] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-22T17:30:28.115473] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T17:30:28.120696] [INFO ] [REMOTE ] BCH: Full fetch complete (40864 records). [2025-09-22T17:30:28.120794] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-22T17:30:28.492584] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-22T17:30:28.492696] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-22T17:30:28.493239] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-22T17:30:28.493281] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-22T17:30:28.494415] [DEBUG] [LOCAL ] BCH: Trimmed 40864 records to 29570 (keeping 200 days of data) [2025-09-22T17:30:28.549039] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-22T17:30:28.675267] [DEBUG] [LOCAL ] BCH: Primary data saved (29570 records). [2025-09-22T17:30:28.675404] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-22T17:30:28.675509] [INFO ] [MAIN ] Update Progress: 234/2372 symbols completed. BCH took 24.8s. Estimated remaining: 4h 37m 53s. Rate: 7.7 symbols/min [2025-09-22T17:30:28.843012] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:30:28.872946] [DEBUG] [LOCAL ] BCSF: Loaded 28369 existing records from primary storage. [2025-09-22T17:30:28.873090] [INFO ] [MAIN ] BCSF: Loaded 28369 existing records. [2025-09-22T17:30:29.071533] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:30:29.072046] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-22T17:30:29.072172] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-22T17:30:29.073472] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-22T17:30:29.088523] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-22T17:30:29.136794] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T17:30:29.330468] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-22T17:30:29.457965] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:30:30.122040] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-22T17:30:30.299007] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T17:30:30.649714] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T17:30:30.922064] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-22T17:30:31.045806] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T17:30:31.722060] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-22T17:30:32.328826] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T17:30:32.522081] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-22T17:30:33.322075] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-22T17:30:33.807279] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T17:30:34.049450] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-22T17:30:34.121999] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-22T17:30:34.240218] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T17:30:34.922096] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-22T17:30:35.722132] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-22T17:30:35.952631] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-22T17:30:36.522166] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-22T17:30:36.927394] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-22T17:30:37.038815] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T17:30:37.234550] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T17:30:37.322062] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-22T17:30:38.122061] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-22T17:30:38.242025] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T17:30:38.247589] [INFO ] [REMOTE ] BCO: Full fetch complete (36833 records). [2025-09-22T17:30:38.247725] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-22T17:30:38.626026] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-22T17:30:38.626117] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-22T17:30:38.626617] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-22T17:30:38.626736] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-22T17:30:38.627605] [DEBUG] [LOCAL ] BCO: Trimmed 36833 records to 26483 (keeping 200 days of data) [2025-09-22T17:30:38.804427] [DEBUG] [LOCAL ] BCO: Primary data saved (26483 records). [2025-09-22T17:30:38.804588] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-22T17:30:38.804826] [INFO ] [MAIN ] Update Progress: 235/2372 symbols completed. BCO took 26.6s. Estimated remaining: 4h 38m 7s. Rate: 7.7 symbols/min [2025-09-22T17:30:38.927219] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-22T17:30:38.977976] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:30:39.002871] [DEBUG] [LOCAL ] BCX: Loaded 22297 existing records from primary storage. [2025-09-22T17:30:39.003032] [INFO ] [MAIN ] BCX: Loaded 22297 existing records. [2025-09-22T17:30:39.198329] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:30:39.198874] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-22T17:30:39.198984] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-22T17:30:39.199771] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-22T17:30:39.199843] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-22T17:30:39.355353] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T17:30:39.604835] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:30:39.722112] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-22T17:30:40.522091] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-22T17:30:40.775606] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T17:30:41.017934] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-22T17:30:41.322052] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-22T17:30:42.123562] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-22T17:30:42.136963] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T17:30:42.625770] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T17:30:42.922054] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-22T17:30:43.722052] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-22T17:30:44.092307] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-22T17:30:44.103400] [INFO ] [REMOTE ] BCE: Full fetch complete (76173 records). [2025-09-22T17:30:44.103558] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-22T17:30:44.522140] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-22T17:30:44.545180] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-22T17:30:44.545545] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-22T17:30:44.547582] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-22T17:30:44.547832] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-22T17:30:44.553380] [DEBUG] [LOCAL ] BCE: Trimmed 76173 records to 52370 (keeping 200 days of data) [2025-09-22T17:30:44.649764] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-22T17:30:44.745355] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T17:30:44.980767] [DEBUG] [LOCAL ] BCE: Primary data saved (52370 records). [2025-09-22T17:30:44.980933] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-22T17:30:44.981080] [INFO ] [MAIN ] Update Progress: 236/2372 symbols completed. BCE took 42.9s. Estimated remaining: 4h 37m 44s. Rate: 7.7 symbols/min [2025-09-22T17:30:45.155398] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:30:45.190703] [DEBUG] [LOCAL ] BDC: Loaded 25371 existing records from primary storage. [2025-09-22T17:30:45.190938] [INFO ] [MAIN ] BDC: Loaded 25371 existing records. [2025-09-22T17:30:45.324762] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-22T17:30:45.394913] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:30:45.395342] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-22T17:30:45.395421] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-22T17:30:45.396212] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-22T17:30:45.396305] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-22T17:30:45.780335] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:30:45.797321] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T17:30:46.122209] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-22T17:30:46.929025] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-22T17:30:46.950498] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T17:30:47.007633] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T17:30:47.722019] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-22T17:30:47.747945] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T17:30:48.522060] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-22T17:30:49.322079] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-22T17:30:49.579205] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-22T17:30:49.890341] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T17:30:50.122052] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-22T17:30:50.537257] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T17:30:50.922047] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-22T17:30:51.093102] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T17:30:51.722144] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-22T17:30:51.915174] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T17:30:52.522065] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-22T17:30:52.843831] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T17:30:53.322065] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-22T17:30:53.443251] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T17:30:53.448051] [INFO ] [REMOTE ] BCSF: Full fetch complete (37778 records). [2025-09-22T17:30:53.448152] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-22T17:30:53.852673] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-22T17:30:53.852770] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-22T17:30:53.853293] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-22T17:30:53.853336] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-22T17:30:53.854238] [DEBUG] [LOCAL ] BCSF: Trimmed 37778 records to 27741 (keeping 200 days of data) [2025-09-22T17:30:54.038170] [DEBUG] [LOCAL ] BCSF: Primary data saved (27741 records). [2025-09-22T17:30:54.038311] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-22T17:30:54.038473] [INFO ] [MAIN ] Update Progress: 237/2372 symbols completed. BCSF took 25.4s. Estimated remaining: 4h 37m 48s. Rate: 7.7 symbols/min [2025-09-22T17:30:54.122070] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-22T17:30:54.472069] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T17:30:54.840536] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T17:30:54.922043] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-22T17:30:55.722033] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-22T17:30:56.108971] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T17:30:56.522062] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-22T17:30:57.322090] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-22T17:30:57.566617] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T17:30:57.793507] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T17:30:58.122026] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-22T17:30:58.429322] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T17:30:58.922045] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-22T17:30:59.276486] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-22T17:30:59.722054] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-22T17:31:00.030578] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T17:31:00.033975] [INFO ] [REMOTE ] BCX: Full fetch complete (33977 records). [2025-09-22T17:31:00.034080] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-22T17:31:00.424958] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-22T17:31:00.425045] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-22T17:31:00.425496] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-22T17:31:00.425536] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-22T17:31:00.426366] [DEBUG] [LOCAL ] BCX: Trimmed 33977 records to 21767 (keeping 200 days of data) [2025-09-22T17:31:00.522093] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-22T17:31:00.567033] [DEBUG] [LOCAL ] BCX: Primary data saved (21767 records). [2025-09-22T17:31:00.567157] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-22T17:31:00.567238] [INFO ] [MAIN ] Update Progress: 238/2372 symbols completed. BCX took 21.8s. Estimated remaining: 4h 37m 28s. Rate: 7.7 symbols/min [2025-09-22T17:31:01.677057] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T17:31:01.689318] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-22T17:31:01.709570] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T17:31:02.122085] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-22T17:31:02.946160] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T17:31:02.951885] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-22T17:31:03.499204] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-22T17:31:03.509275] [INFO ] [REMOTE ] BCS: Full fetch complete (77253 records). [2025-09-22T17:31:03.509439] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-22T17:31:03.922952] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-22T17:31:03.923156] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-22T17:31:03.924052] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-22T17:31:03.924148] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-22T17:31:03.939158] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T17:31:03.944378] [DEBUG] [LOCAL ] BCS: Trimmed 77253 records to 53472 (keeping 200 days of data) [2025-09-22T17:31:03.945008] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-22T17:31:04.309676] [DEBUG] [LOCAL ] BCS: Primary data saved (53472 records). [2025-09-22T17:31:04.309833] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-22T17:31:04.310925] [INFO ] [MAIN ] Update Progress: 239/2372 symbols completed. BCS took 37.7s. Estimated remaining: 4h 36m 44s. Rate: 7.7 symbols/min [2025-09-22T17:31:04.863053] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T17:31:04.869753] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-22T17:31:05.737813] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T17:31:05.744483] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-22T17:31:06.964840] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T17:31:06.968820] [INFO ] [REMOTE ] BDC: Full fetch complete (35650 records). [2025-09-22T17:31:06.968923] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-22T17:31:07.370630] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-22T17:31:07.370858] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-22T17:31:07.371715] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-22T17:31:07.371786] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-22T17:31:07.373321] [DEBUG] [LOCAL ] BDC: Trimmed 35650 records to 24906 (keeping 200 days of data) [2025-09-22T17:31:07.559214] [DEBUG] [LOCAL ] BDC: Primary data saved (24906 records). [2025-09-22T17:31:07.559461] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-22T17:31:07.559581] [INFO ] [MAIN ] Update Progress: 240/2372 symbols completed. BDC took 22.6s. Estimated remaining: 4h 35m 56s. Rate: 7.7 symbols/min [2025-09-22T17:31:08.098788] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:31:08.213868] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:31:08.272715] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:31:08.312800] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:31:08.419323] [DEBUG] [LOCAL ] BDJ: Loaded 29626 existing records from primary storage. [2025-09-22T17:31:08.419679] [INFO ] [MAIN ] BDJ: Loaded 29626 existing records. [2025-09-22T17:31:08.556857] [DEBUG] [LOCAL ] BDX: Loaded 53259 existing records from primary storage. [2025-09-22T17:31:08.561913] [DEBUG] [LOCAL ] BDN: Loaded 48364 existing records from primary storage. [2025-09-22T17:31:08.575437] [INFO ] [MAIN ] BDX: Loaded 53259 existing records. [2025-09-22T17:31:08.609528] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-22T17:31:08.577010] [INFO ] [MAIN ] BDN: Loaded 48364 existing records. [2025-09-22T17:31:08.624901] [INFO ] [MAIN ] BE: Loaded 54433 existing records. [2025-09-22T17:31:08.953234] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:31:09.089706] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-22T17:31:09.150829] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:31:09.150611] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-22T17:31:09.199705] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:31:09.200435] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-22T17:31:09.200513] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-22T17:31:09.201312] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-22T17:31:09.201381] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-22T17:31:09.212681] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-22T17:31:09.200153] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-22T17:31:09.221804] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-22T17:31:09.265099] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-22T17:31:09.311745] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:31:09.340552] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-22T17:31:09.345875] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-22T17:31:09.383670] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-22T17:31:09.420678] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-22T17:31:09.375084] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-22T17:31:09.426214] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-22T17:31:10.726262] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:31:10.766206] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-22T17:31:10.815879] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:31:10.838257] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-22T17:31:10.891444] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:31:10.939410] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-22T17:31:10.944382] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:31:10.945517] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-22T17:31:12.202200] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T17:31:12.209830] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-22T17:31:12.252300] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T17:31:12.264061] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-22T17:31:12.571413] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T17:31:12.584625] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-22T17:31:12.964593] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T17:31:12.977225] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-22T17:31:13.544864] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T17:31:13.553586] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-22T17:31:13.631050] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T17:31:13.642948] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-22T17:31:14.169561] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T17:31:14.181255] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-22T17:31:14.614018] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T17:31:14.729548] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T17:31:14.901715] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T17:31:14.922084] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-22T17:31:15.722074] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-22T17:31:15.774261] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T17:31:15.915862] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T17:31:16.522111] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-22T17:31:17.322121] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-22T17:31:17.524492] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T17:31:17.637934] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-22T17:31:18.122069] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-22T17:31:18.922083] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-22T17:31:19.362556] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-22T17:31:19.391727] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T17:31:19.722058] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-22T17:31:20.448399] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:31:20.522096] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-22T17:31:21.328442] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-22T17:31:21.358197] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T17:31:22.122043] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-22T17:31:22.262612] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T17:31:22.866781] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T17:31:22.923671] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-22T17:31:22.925906] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T17:31:23.722057] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-22T17:31:24.522066] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-22T17:31:25.025056] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T17:31:25.075512] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-22T17:31:25.322080] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-22T17:31:26.122110] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-22T17:31:26.577610] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-22T17:31:26.622123] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T17:31:26.922063] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-22T17:31:27.613759] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T17:31:27.722087] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-22T17:31:28.522127] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-22T17:31:28.594018] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T17:31:29.185855] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T17:31:29.322113] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-22T17:31:30.122110] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-22T17:31:30.493353] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-22T17:31:30.922107] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-22T17:31:31.188636] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T17:31:31.713069] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T17:31:31.723141] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-22T17:31:32.522045] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-22T17:31:32.859339] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T17:31:33.322063] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-22T17:31:33.634278] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T17:31:34.128328] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-22T17:31:34.133138] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T17:31:34.141048] [INFO ] [REMOTE ] BDN: Full fetch complete (69253 records). [2025-09-22T17:31:34.141203] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-22T17:31:34.551013] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-22T17:31:34.551104] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-22T17:31:34.551848] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-22T17:31:34.551926] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-22T17:31:34.553354] [DEBUG] [LOCAL ] BDN: Trimmed 69253 records to 47620 (keeping 200 days of data) [2025-09-22T17:31:34.825832] [DEBUG] [LOCAL ] BDN: Primary data saved (47620 records). [2025-09-22T17:31:34.825967] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-22T17:31:34.826061] [INFO ] [MAIN ] Update Progress: 241/2372 symbols completed. BDN took 27.3s. Estimated remaining: 4h 38m 41s. Rate: 7.6 symbols/min [2025-09-22T17:31:34.928444] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-22T17:31:35.002025] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:31:35.002226] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-22T17:31:35.002281] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-22T17:31:35.002426] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-22T17:31:35.002527] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-22T17:31:35.002598] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-22T17:31:35.002634] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-22T17:31:35.375043] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:31:35.531487] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-22T17:31:35.727170] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-22T17:31:35.741872] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T17:31:35.752290] [INFO ] [REMOTE ] BDX: Full fetch complete (75921 records). [2025-09-22T17:31:35.752466] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-22T17:31:36.194846] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-22T17:31:36.194949] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-22T17:31:36.195792] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-22T17:31:36.195865] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-22T17:31:36.197426] [DEBUG] [LOCAL ] BDX: Trimmed 75921 records to 52497 (keeping 200 days of data) [2025-09-22T17:31:36.327026] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T17:31:36.522638] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-22T17:31:36.570571] [DEBUG] [LOCAL ] BDX: Primary data saved (52497 records). [2025-09-22T17:31:36.570748] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-22T17:31:36.572359] [INFO ] [MAIN ] Update Progress: 242/2372 symbols completed. BDX took 29.0s. Estimated remaining: 4h 37m 39s. Rate: 7.7 symbols/min [2025-09-22T17:31:36.752848] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:31:36.814102] [DEBUG] [LOCAL ] BEKE: Loaded 54042 existing records from primary storage. [2025-09-22T17:31:36.814323] [INFO ] [MAIN ] BEKE: Loaded 54042 existing records. [2025-09-22T17:31:37.023409] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-22T17:31:37.030598] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:31:37.032799] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-22T17:31:37.032886] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-22T17:31:37.034598] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-22T17:31:37.034708] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-22T17:31:37.331998] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-22T17:31:37.423789] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:31:37.656062] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T17:31:38.122067] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-22T17:31:38.721778] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T17:31:38.729567] [INFO ] [REMOTE ] BDJ: Full fetch complete (42743 records). [2025-09-22T17:31:38.729766] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-22T17:31:38.927141] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-22T17:31:39.127223] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-22T17:31:39.127347] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-22T17:31:39.127919] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-22T17:31:39.127986] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-22T17:31:39.129327] [DEBUG] [LOCAL ] BDJ: Trimmed 42743 records to 28984 (keeping 200 days of data) [2025-09-22T17:31:39.309368] [DEBUG] [LOCAL ] BDJ: Primary data saved (28984 records). [2025-09-22T17:31:39.309500] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-22T17:31:39.309585] [INFO ] [MAIN ] Update Progress: 243/2372 symbols completed. BDJ took 31.7s. Estimated remaining: 4h 36m 47s. Rate: 7.7 symbols/min [2025-09-22T17:31:39.478170] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:31:39.532563] [DEBUG] [LOCAL ] BEN: Loaded 53847 existing records from primary storage. [2025-09-22T17:31:39.532733] [INFO ] [MAIN ] BEN: Loaded 53847 existing records. [2025-09-22T17:31:39.728756] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-22T17:31:39.736005] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:31:39.737176] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-22T17:31:39.737244] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-22T17:31:39.738511] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-22T17:31:39.738603] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-22T17:31:40.113840] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:31:40.107491] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-22T17:31:40.151157] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-22T17:31:40.522114] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-22T17:31:41.322057] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-22T17:31:41.550366] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-22T17:31:41.559063] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-09-22T17:31:41.559216] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-22T17:31:41.655782] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-22T17:31:41.997584] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-22T17:31:41.997751] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-22T17:31:41.998721] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-22T17:31:41.998802] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-22T17:31:42.001319] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53653 (keeping 200 days of data) [2025-09-22T17:31:42.126449] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-22T17:31:42.151158] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T17:31:42.380815] [DEBUG] [LOCAL ] BE: Primary data saved (53653 records). [2025-09-22T17:31:42.381003] [INFO ] [MAIN ] BE: Full history saved. [2025-09-22T17:31:42.381124] [INFO ] [MAIN ] Update Progress: 244/2372 symbols completed. BE took 34.8s. Estimated remaining: 4h 35m 58s. Rate: 7.7 symbols/min [2025-09-22T17:31:42.556593] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:31:42.598751] [DEBUG] [LOCAL ] BEP: Loaded 39400 existing records from primary storage. [2025-09-22T17:31:42.598924] [INFO ] [MAIN ] BEP: Loaded 39400 existing records. [2025-09-22T17:31:42.688763] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T17:31:42.808793] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:31:42.809094] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-22T17:31:42.809145] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-22T17:31:42.810461] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-22T17:31:42.810525] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-22T17:31:42.927218] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-22T17:31:43.197959] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:31:43.722070] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-22T17:31:44.431552] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T17:31:44.522011] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-22T17:31:45.248949] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T17:31:45.322069] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-22T17:31:46.122122] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-22T17:31:46.368028] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T17:31:46.856785] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:31:46.922009] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-22T17:31:47.495165] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T17:31:47.722046] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-22T17:31:48.434134] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T17:31:48.522067] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-22T17:31:48.921862] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-22T17:31:48.923513] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-22T17:31:49.322072] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-22T17:31:50.122121] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-22T17:31:50.831831] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T17:31:50.922032] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-22T17:31:51.722059] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-22T17:31:52.079259] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-22T17:31:52.083237] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T17:31:52.202752] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-22T17:31:52.522073] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-22T17:31:53.322064] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-22T17:31:53.789533] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T17:31:54.122059] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-22T17:31:54.922073] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-22T17:31:55.242385] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-22T17:31:55.663294] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T17:31:55.722044] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-22T17:31:56.229072] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T17:31:56.522052] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-22T17:31:56.638733] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T17:31:57.322074] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-22T17:31:57.555308] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-22T17:31:58.122075] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-22T17:31:58.273384] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T17:31:58.922074] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-22T17:31:59.277207] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T17:31:59.722052] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-22T17:32:00.522070] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-22T17:32:00.884446] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T17:32:00.952443] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T17:32:01.322090] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-22T17:32:02.122071] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-22T17:32:02.241268] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T17:32:02.565682] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T17:32:02.752395] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T17:32:02.922074] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-22T17:32:03.722119] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-22T17:32:04.348855] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T17:32:04.355077] [INFO ] [REMOTE ] BEP: Full fetch complete (58359 records). [2025-09-22T17:32:04.355213] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-22T17:32:04.527165] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-22T17:32:04.808568] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-22T17:32:04.808727] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-22T17:32:04.809529] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-22T17:32:04.809606] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-22T17:32:04.811073] [DEBUG] [LOCAL ] BEP: Trimmed 58359 records to 38703 (keeping 200 days of data) [2025-09-22T17:32:05.072121] [DEBUG] [LOCAL ] BEP: Primary data saved (38703 records). [2025-09-22T17:32:05.072352] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-22T17:32:05.072478] [INFO ] [MAIN ] Update Progress: 245/2372 symbols completed. BEP took 22.7s. Estimated remaining: 4h 37m 60s. Rate: 7.7 symbols/min [2025-09-22T17:32:05.264545] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:32:05.298238] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T17:32:05.322007] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-22T17:32:05.355421] [DEBUG] [LOCAL ] BEPC: Loaded 47318 existing records from primary storage. [2025-09-22T17:32:05.355568] [INFO ] [MAIN ] BEPC: Loaded 47318 existing records. [2025-09-22T17:32:05.544188] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:32:05.544476] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-22T17:32:05.544526] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-22T17:32:05.545869] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-22T17:32:05.545932] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-22T17:32:05.947610] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:32:06.077081] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T17:32:06.122099] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-22T17:32:06.922099] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-22T17:32:07.201375] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T17:32:07.497984] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-22T17:32:07.499183] [INFO ] [REMOTE ] BEDU: Full fetch complete (1396 records). [2025-09-22T17:32:07.499286] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-22T17:32:07.721207] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-22T17:32:07.721553] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:32:07.721637] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:32:07.721839] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-22T17:32:07.722031] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-22T17:32:07.722278] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-22T17:32:07.723547] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-22T17:32:07.723838] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-22T17:32:07.724010] [INFO ] [MAIN ] Update Progress: 246/2372 symbols completed. BEDU took 32.9s. Estimated remaining: 4h 37m 7s. Rate: 7.7 symbols/min [2025-09-22T17:32:07.889212] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T17:32:07.944814] [INFO ] [REMOTE ] BEN: Full fetch complete (76886 records). [2025-09-22T17:32:07.961987] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-22T17:32:07.985134] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:32:08.113405] [DEBUG] [LOCAL ] BEPH: Loaded 5269 existing records from primary storage. [2025-09-22T17:32:08.123925] [INFO ] [MAIN ] BEPH: Loaded 5269 existing records. [2025-09-22T17:32:08.536621] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-22T17:32:08.568549] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:32:08.575119] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-22T17:32:08.575232] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-22T17:32:08.602821] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-22T17:32:08.614951] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-22T17:32:08.733638] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-22T17:32:08.745499] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-22T17:32:08.766534] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-22T17:32:08.770015] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-22T17:32:08.833290] [DEBUG] [LOCAL ] BEN: Trimmed 76886 records to 53067 (keeping 200 days of data) [2025-09-22T17:32:09.171722] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:32:09.322961] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-22T17:32:09.340860] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T17:32:09.462522] [DEBUG] [LOCAL ] BEN: Primary data saved (53067 records). [2025-09-22T17:32:09.462717] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-22T17:32:09.462843] [INFO ] [MAIN ] Update Progress: 247/2372 symbols completed. BEN took 30.2s. Estimated remaining: 4h 36m 7s. Rate: 7.7 symbols/min [2025-09-22T17:32:09.644959] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:32:09.650691] [DEBUG] [LOCAL ] BEPI: Loaded 3470 existing records from primary storage. [2025-09-22T17:32:09.650821] [INFO ] [MAIN ] BEPI: Loaded 3470 existing records. [2025-09-22T17:32:09.835782] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:32:09.836054] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-22T17:32:09.836102] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-22T17:32:09.836334] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-22T17:32:09.836392] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-22T17:32:10.127166] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-22T17:32:10.265502] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:32:10.267219] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T17:32:10.305169] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T17:32:10.922063] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-22T17:32:11.617315] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-22T17:32:11.689009] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T17:32:11.722060] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-22T17:32:12.127284] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-22T17:32:12.522057] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-22T17:32:13.322070] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-22T17:32:13.727043] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T17:32:14.122066] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-22T17:32:14.804532] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T17:32:14.922058] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-22T17:32:15.569158] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T17:32:15.569848] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T17:32:15.722073] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-22T17:32:16.522081] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-22T17:32:17.322071] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-22T17:32:17.575813] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T17:32:17.584333] [INFO ] [REMOTE ] BEKE: Full fetch complete (77208 records). [2025-09-22T17:32:17.584504] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-22T17:32:17.692710] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-22T17:32:18.010528] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-22T17:32:18.010958] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-22T17:32:18.011934] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-22T17:32:18.012182] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-22T17:32:18.046428] [DEBUG] [LOCAL ] BEKE: Trimmed 77208 records to 53261 (keeping 200 days of data) [2025-09-22T17:32:18.048147] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T17:32:18.126719] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-22T17:32:18.397985] [DEBUG] [LOCAL ] BEKE: Primary data saved (53261 records). [2025-09-22T17:32:18.398140] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-22T17:32:18.399698] [INFO ] [MAIN ] Update Progress: 248/2372 symbols completed. BEKE took 41.8s. Estimated remaining: 4h 36m 9s. Rate: 7.7 symbols/min [2025-09-22T17:32:18.572502] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:32:18.578369] [DEBUG] [LOCAL ] BEPJ: Loaded 3320 existing records from primary storage. [2025-09-22T17:32:18.578482] [INFO ] [MAIN ] BEPJ: Loaded 3320 existing records. [2025-09-22T17:32:18.688064] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T17:32:18.771671] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:32:18.771972] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-22T17:32:18.772040] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-22T17:32:18.772520] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-22T17:32:18.772580] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-22T17:32:18.927248] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-22T17:32:19.145066] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:32:19.630676] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T17:32:19.722045] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-22T17:32:20.263765] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-22T17:32:20.522056] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-22T17:32:20.887435] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-22T17:32:21.322065] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-22T17:32:21.843019] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-22T17:32:22.122072] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-22T17:32:22.796088] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-22T17:32:22.922064] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-22T17:32:23.313594] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-22T17:32:23.722083] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-22T17:32:24.152181] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T17:32:24.522062] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-22T17:32:24.963691] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T17:32:25.322067] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-22T17:32:25.876111] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-22T17:32:25.877136] [INFO ] [REMOTE ] BEPI: Full fetch complete (4971 records). [2025-09-22T17:32:25.877205] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-22T17:32:26.127242] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-22T17:32:26.239608] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-22T17:32:26.239723] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-22T17:32:26.239900] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-22T17:32:26.239942] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-22T17:32:26.240367] [DEBUG] [LOCAL ] BEPI: Trimmed 4971 records to 3415 (keeping 200 days of data) [2025-09-22T17:32:26.262578] [DEBUG] [LOCAL ] BEPI: Primary data saved (3415 records). [2025-09-22T17:32:26.262759] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-22T17:32:26.262860] [INFO ] [MAIN ] Update Progress: 249/2372 symbols completed. BEPI took 16.8s. Estimated remaining: 4h 36m 1s. Rate: 7.7 symbols/min [2025-09-22T17:32:26.433513] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:32:26.469029] [DEBUG] [LOCAL ] BFAM: Loaded 33457 existing records from primary storage. [2025-09-22T17:32:26.469171] [INFO ] [MAIN ] BFAM: Loaded 33457 existing records. [2025-09-22T17:32:26.656535] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:32:26.656847] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-22T17:32:26.656907] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-22T17:32:26.658024] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-22T17:32:26.658085] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-22T17:32:26.772605] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T17:32:26.927178] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-22T17:32:27.039949] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:32:27.336547] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-22T17:32:27.722052] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-22T17:32:28.108453] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-22T17:32:28.522062] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-22T17:32:28.861540] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-22T17:32:29.322103] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-22T17:32:30.122072] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-22T17:32:30.612714] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T17:32:30.772047] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-22T17:32:30.922130] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-22T17:32:31.722111] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-22T17:32:32.299533] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T17:32:32.515987] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T17:32:32.522926] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-22T17:32:33.019915] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-22T17:32:33.322071] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-22T17:32:33.714157] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-22T17:32:34.122101] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-22T17:32:34.922071] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-22T17:32:35.496825] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T17:32:35.733176] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-22T17:32:35.751998] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T17:32:36.216161] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-22T17:32:36.522086] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-22T17:32:37.011542] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-22T17:32:37.322082] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-22T17:32:38.122086] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-22T17:32:38.173916] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T17:32:38.689970] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-22T17:32:38.922169] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-22T17:32:39.722073] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-22T17:32:40.142418] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T17:32:40.247029] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-22T17:32:40.248017] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4547 records). [2025-09-22T17:32:40.248086] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-22T17:32:40.529200] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-22T17:32:40.613528] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-22T17:32:40.613610] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-22T17:32:40.613768] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-22T17:32:40.613828] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-22T17:32:40.614215] [DEBUG] [LOCAL ] BEPJ: Trimmed 4547 records to 3285 (keeping 200 days of data) [2025-09-22T17:32:40.634260] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3285 records). [2025-09-22T17:32:40.634354] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-22T17:32:40.634432] [INFO ] [MAIN ] Update Progress: 250/2372 symbols completed. BEPJ took 22.2s. Estimated remaining: 4h 36m 49s. Rate: 7.7 symbols/min [2025-09-22T17:32:40.804026] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:32:40.864570] [DEBUG] [LOCAL ] BFH: Loaded 42563 existing records from primary storage. [2025-09-22T17:32:40.864766] [INFO ] [MAIN ] BFH: Loaded 42563 existing records. [2025-09-22T17:32:41.079010] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:32:41.079445] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-22T17:32:41.079513] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-22T17:32:41.081219] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-22T17:32:41.081288] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-22T17:32:41.331025] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-22T17:32:41.466207] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:32:42.122076] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-22T17:32:42.282502] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T17:32:42.440998] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T17:32:42.490077] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-22T17:32:42.922107] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-22T17:32:43.722085] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-22T17:32:44.257875] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T17:32:44.522085] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-22T17:32:45.106207] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T17:32:45.113062] [INFO ] [REMOTE ] BEPC: Full fetch complete (68084 records). [2025-09-22T17:32:45.113201] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-22T17:32:45.114093] [FATAL] [VALIDATOR ] BEPC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:32:45.114192] [FATAL] [MAIN ] BEPC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:32:45.114258] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:32:45.114329] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-22T17:32:45.114392] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-09-22T17:32:45.114429] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-09-22T17:32:45.115016] [DEBUG] [LOCAL ] BEPC: Deleted derivative data file. [2025-09-22T17:32:45.115119] [INFO ] [MAIN ] Update Progress: 251/2372 symbols completed. BEPC took 40.0s. Estimated remaining: 4h 36m 13s. Rate: 7.7 symbols/min [2025-09-22T17:32:45.311513] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:32:45.322032] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-22T17:32:45.329560] [DEBUG] [LOCAL ] BFK: Loaded 14286 existing records from primary storage. [2025-09-22T17:32:45.329783] [INFO ] [MAIN ] BFK: Loaded 14286 existing records. [2025-09-22T17:32:45.533903] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:32:45.534248] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-22T17:32:45.534317] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-22T17:32:45.534917] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-22T17:32:45.534986] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-22T17:32:45.915495] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:32:46.122111] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-22T17:32:46.573983] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-22T17:32:46.822299] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T17:32:46.922088] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-22T17:32:47.344018] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T17:32:47.722064] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-22T17:32:48.153978] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T17:32:48.264273] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-22T17:32:48.522075] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-22T17:32:49.278403] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T17:32:49.322046] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-22T17:32:50.122052] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-22T17:32:50.490450] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T17:32:50.895484] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T17:32:50.896924] [INFO ] [REMOTE ] BEPH: Full fetch complete (7525 records). [2025-09-22T17:32:50.897021] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-22T17:32:50.927312] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-22T17:32:51.273063] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-22T17:32:51.273163] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-22T17:32:51.273418] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-22T17:32:51.273520] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-22T17:32:51.274140] [DEBUG] [LOCAL ] BEPH: Trimmed 7525 records to 5153 (keeping 200 days of data) [2025-09-22T17:32:51.311625] [DEBUG] [LOCAL ] BEPH: Primary data saved (5153 records). [2025-09-22T17:32:51.311801] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-22T17:32:51.312020] [INFO ] [MAIN ] Update Progress: 252/2372 symbols completed. BEPH took 43.6s. Estimated remaining: 4h 35m 52s. Rate: 7.7 symbols/min [2025-09-22T17:32:51.507631] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:32:51.589456] [DEBUG] [LOCAL ] BFLY: Loaded 52606 existing records from primary storage. [2025-09-22T17:32:51.589668] [INFO ] [MAIN ] BFLY: Loaded 52606 existing records. [2025-09-22T17:32:51.727205] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-22T17:32:51.797472] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:32:51.797762] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-22T17:32:51.797818] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-22T17:32:51.799170] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-22T17:32:51.799249] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-22T17:32:52.323056] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:32:52.430382] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-22T17:32:52.461151] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:32:52.522092] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-22T17:32:53.322084] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-22T17:32:54.132008] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-22T17:32:54.137965] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T17:32:54.260599] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T17:32:54.922071] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-22T17:32:55.554006] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T17:32:55.722108] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-22T17:32:56.017203] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T17:32:56.522092] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-22T17:32:57.322035] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-22T17:32:57.545770] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T17:32:57.642476] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T17:32:58.122110] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-22T17:32:58.871006] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-22T17:32:58.922003] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-22T17:32:58.974012] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T17:32:59.711001] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T17:32:59.722036] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-22T17:33:00.369575] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-22T17:33:00.522124] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-22T17:33:01.322081] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-22T17:33:02.122072] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-22T17:33:02.524392] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-22T17:33:02.922077] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-22T17:33:03.183397] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T17:33:03.722070] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-22T17:33:04.522080] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-22T17:33:04.775636] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-22T17:33:05.199741] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-22T17:33:05.234385] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T17:33:05.237531] [INFO ] [REMOTE ] BFK: Full fetch complete (19329 records). [2025-09-22T17:33:05.237632] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-22T17:33:05.331255] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-22T17:33:05.620730] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-22T17:33:05.620821] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-22T17:33:05.621215] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-22T17:33:05.621279] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-22T17:33:05.621954] [DEBUG] [LOCAL ] BFK: Trimmed 19329 records to 14045 (keeping 200 days of data) [2025-09-22T17:33:05.718117] [DEBUG] [LOCAL ] BFK: Primary data saved (14045 records). [2025-09-22T17:33:05.718274] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-22T17:33:05.718380] [INFO ] [MAIN ] Update Progress: 253/2372 symbols completed. BFK took 20.6s. Estimated remaining: 4h 36m 39s. Rate: 7.7 symbols/min [2025-09-22T17:33:05.889314] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:33:05.903761] [DEBUG] [LOCAL ] BFS: Loaded 9166 existing records from primary storage. [2025-09-22T17:33:05.904014] [INFO ] [MAIN ] BFS: Loaded 9166 existing records. [2025-09-22T17:33:06.091531] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:33:06.092278] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-22T17:33:06.092352] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-22T17:33:06.102521] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-22T17:33:06.122094] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-22T17:33:06.122206] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-22T17:33:06.218444] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T17:33:06.502029] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:33:06.852065] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T17:33:06.922079] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-22T17:33:07.722069] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-22T17:33:07.949231] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T17:33:08.348601] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T17:33:08.522114] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-22T17:33:09.025960] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-22T17:33:09.322082] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-22T17:33:09.610116] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T17:33:09.618512] [INFO ] [REMOTE ] BFAM: Full fetch complete (47018 records). [2025-09-22T17:33:09.618635] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-22T17:33:10.014358] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-22T17:33:10.014462] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-22T17:33:10.015132] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-22T17:33:10.015201] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-22T17:33:10.016436] [DEBUG] [LOCAL ] BFAM: Trimmed 47018 records to 33000 (keeping 200 days of data) [2025-09-22T17:33:10.122708] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-22T17:33:10.240538] [DEBUG] [LOCAL ] BFAM: Primary data saved (33000 records). [2025-09-22T17:33:10.240714] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-22T17:33:10.240815] [INFO ] [MAIN ] Update Progress: 254/2372 symbols completed. BFAM took 44.0s. Estimated remaining: 4h 36m 4s. Rate: 7.7 symbols/min [2025-09-22T17:33:10.423229] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:33:10.442570] [DEBUG] [LOCAL ] BFZ: Loaded 11653 existing records from primary storage. [2025-09-22T17:33:10.442714] [INFO ] [MAIN ] BFZ: Loaded 11653 existing records. [2025-09-22T17:33:10.623535] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:33:10.623946] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-22T17:33:10.624051] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-22T17:33:10.624831] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-22T17:33:10.625025] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-22T17:33:10.927203] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-22T17:33:10.998558] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T17:33:11.040918] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:33:11.277959] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T17:33:11.525616] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-22T17:33:11.722062] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-22T17:33:12.247438] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-22T17:33:12.522063] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-22T17:33:13.322026] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-22T17:33:13.686283] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T17:33:14.122076] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-22T17:33:14.148404] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T17:33:14.688715] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T17:33:14.922070] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-22T17:33:15.722059] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-22T17:33:15.922870] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T17:33:16.289543] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-22T17:33:16.522066] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-22T17:33:17.153544] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-22T17:33:17.322060] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-22T17:33:18.122055] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-22T17:33:18.922055] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-22T17:33:19.722063] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-22T17:33:20.155504] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-22T17:33:20.163289] [INFO ] [REMOTE ] BFH: Full fetch complete (59556 records). [2025-09-22T17:33:20.163433] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-22T17:33:20.541275] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T17:33:20.595254] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T17:33:20.596614] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-22T17:33:20.596101] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-22T17:33:20.600221] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-22T17:33:20.601200] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-22T17:33:20.601364] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-22T17:33:20.602736] [DEBUG] [LOCAL ] BFH: Trimmed 59556 records to 41822 (keeping 200 days of data) [2025-09-22T17:33:20.883170] [DEBUG] [LOCAL ] BFH: Primary data saved (41822 records). [2025-09-22T17:33:20.883416] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-22T17:33:20.884357] [INFO ] [MAIN ] Update Progress: 255/2372 symbols completed. BFH took 40.2s. Estimated remaining: 4h 36m 20s. Rate: 7.7 symbols/min [2025-09-22T17:33:21.062287] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-22T17:33:21.119209] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:33:21.175572] [DEBUG] [LOCAL ] BG: Loaded 51108 existing records from primary storage. [2025-09-22T17:33:21.175748] [INFO ] [MAIN ] BG: Loaded 51108 existing records. [2025-09-22T17:33:21.329860] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-22T17:33:21.370620] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:33:21.371194] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-22T17:33:21.371277] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-22T17:33:21.373058] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-22T17:33:21.373125] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-22T17:33:21.680719] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T17:33:21.752014] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:33:22.122063] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-22T17:33:22.823426] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T17:33:22.823721] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T17:33:22.922016] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-22T17:33:23.722074] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-22T17:33:24.323773] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-22T17:33:24.522075] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-22T17:33:24.892781] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-22T17:33:24.900966] [INFO ] [REMOTE ] BFLY: Full fetch complete (75206 records). [2025-09-22T17:33:24.901098] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-22T17:33:25.224857] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T17:33:25.329857] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-22T17:33:25.386418] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-22T17:33:25.386527] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-22T17:33:25.387468] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-22T17:33:25.387537] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-22T17:33:25.389434] [DEBUG] [LOCAL ] BFLY: Trimmed 75206 records to 51829 (keeping 200 days of data) [2025-09-22T17:33:25.723658] [DEBUG] [LOCAL ] BFLY: Primary data saved (51829 records). [2025-09-22T17:33:25.723843] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-22T17:33:25.723937] [INFO ] [MAIN ] Update Progress: 256/2372 symbols completed. BFLY took 34.4s. Estimated remaining: 4h 35m 47s. Rate: 7.7 symbols/min [2025-09-22T17:33:25.901930] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:33:25.910505] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T17:33:25.930436] [DEBUG] [LOCAL ] BGB: Loaded 17835 existing records from primary storage. [2025-09-22T17:33:25.930583] [INFO ] [MAIN ] BGB: Loaded 17835 existing records. [2025-09-22T17:33:26.125381] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-22T17:33:26.125759] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:33:26.127309] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-22T17:33:26.127373] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-22T17:33:26.128315] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-22T17:33:26.128382] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-22T17:33:26.528357] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:33:26.922075] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-22T17:33:27.611265] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T17:33:27.722077] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-22T17:33:27.865955] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T17:33:28.522106] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-22T17:33:29.062194] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T17:33:29.322060] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-22T17:33:29.568688] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T17:33:30.122072] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-22T17:33:30.197297] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T17:33:30.199996] [INFO ] [REMOTE ] BFS: Full fetch complete (12430 records). [2025-09-22T17:33:30.200070] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-22T17:33:30.558932] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-22T17:33:30.559008] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-22T17:33:30.559216] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-22T17:33:30.559270] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-22T17:33:30.559807] [DEBUG] [LOCAL ] BFS: Trimmed 12430 records to 8996 (keeping 200 days of data) [2025-09-22T17:33:30.615291] [DEBUG] [LOCAL ] BFS: Primary data saved (8996 records). [2025-09-22T17:33:30.615427] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-22T17:33:30.615533] [INFO ] [MAIN ] Update Progress: 257/2372 symbols completed. BFS took 24.9s. Estimated remaining: 4h 35m 15s. Rate: 7.7 symbols/min [2025-09-22T17:33:30.788008] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:33:30.806080] [DEBUG] [LOCAL ] BGH: Loaded 16671 existing records from primary storage. [2025-09-22T17:33:30.806195] [INFO ] [MAIN ] BGH: Loaded 16671 existing records. [2025-09-22T17:33:30.927235] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-22T17:33:30.987020] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:33:30.987277] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-22T17:33:30.987343] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-22T17:33:30.988008] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-22T17:33:30.988100] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-22T17:33:31.335977] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:33:31.542007] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T17:33:31.722057] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-22T17:33:31.941856] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-22T17:33:32.522065] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-22T17:33:32.568721] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T17:33:33.224044] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T17:33:33.322006] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-22T17:33:34.122059] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-22T17:33:34.590292] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T17:33:34.807972] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T17:33:34.922035] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-22T17:33:35.722035] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-22T17:33:35.847352] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T17:33:36.522060] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-22T17:33:37.133833] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T17:33:37.322097] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-22T17:33:37.475177] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T17:33:37.478316] [INFO ] [REMOTE ] BFZ: Full fetch complete (17838 records). [2025-09-22T17:33:37.478418] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-22T17:33:37.851731] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-22T17:33:37.851814] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-22T17:33:37.852150] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-22T17:33:37.852189] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-22T17:33:37.852743] [DEBUG] [LOCAL ] BFZ: Trimmed 17838 records to 11524 (keeping 200 days of data) [2025-09-22T17:33:37.926664] [DEBUG] [LOCAL ] BFZ: Primary data saved (11524 records). [2025-09-22T17:33:37.926799] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-22T17:33:37.926885] [INFO ] [MAIN ] Update Progress: 258/2372 symbols completed. BFZ took 27.7s. Estimated remaining: 4h 35m 3s. Rate: 7.7 symbols/min [2025-09-22T17:33:38.096181] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:33:38.111729] [DEBUG] [LOCAL ] BGR: Loaded 13798 existing records from primary storage. [2025-09-22T17:33:38.111868] [INFO ] [MAIN ] BGR: Loaded 13798 existing records. [2025-09-22T17:33:38.132376] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-22T17:33:38.296913] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:33:38.297307] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-22T17:33:38.297464] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-22T17:33:38.303980] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-22T17:33:38.313527] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-22T17:33:38.358306] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T17:33:38.711336] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:33:38.922057] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-22T17:33:39.134888] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T17:33:39.688512] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T17:33:39.722106] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-22T17:33:40.522081] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-22T17:33:40.755881] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-22T17:33:41.322715] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T17:33:41.322152] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-22T17:33:42.122060] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-22T17:33:42.922105] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-22T17:33:43.121103] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T17:33:43.191183] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T17:33:43.591589] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T17:33:43.722056] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-22T17:33:44.503668] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T17:33:44.522000] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-22T17:33:45.322068] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-22T17:33:45.475366] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T17:33:45.986400] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T17:33:46.122059] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-22T17:33:46.922079] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-22T17:33:47.012156] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T17:33:47.722063] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-22T17:33:47.848979] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T17:33:48.475502] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-22T17:33:48.522003] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-22T17:33:49.322069] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-22T17:33:49.518047] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T17:33:50.122058] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-22T17:33:50.911027] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T17:33:50.922020] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-22T17:33:51.068128] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T17:33:51.722119] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-22T17:33:51.896040] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-22T17:33:52.348522] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-22T17:33:52.522071] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-22T17:33:53.322061] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-22T17:33:54.122030] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-22T17:33:54.247299] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T17:33:54.338093] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-22T17:33:54.340930] [INFO ] [REMOTE ] BGB: Full fetch complete (26903 records). [2025-09-22T17:33:54.341018] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-22T17:33:54.709291] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-22T17:33:54.709410] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-22T17:33:54.709852] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-22T17:33:54.709912] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-22T17:33:54.710547] [DEBUG] [LOCAL ] BGB: Trimmed 26903 records to 17407 (keeping 200 days of data) [2025-09-22T17:33:54.818585] [DEBUG] [LOCAL ] BGB: Primary data saved (17407 records). [2025-09-22T17:33:54.818739] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-22T17:33:54.818828] [INFO ] [MAIN ] Update Progress: 259/2372 symbols completed. BGB took 29.1s. Estimated remaining: 4h 36m 10s. Rate: 7.7 symbols/min [2025-09-22T17:33:54.923210] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-22T17:33:55.008586] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:33:55.005592] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T17:33:55.063014] [DEBUG] [LOCAL ] BGS: Loaded 51172 existing records from primary storage. [2025-09-22T17:33:55.063156] [INFO ] [MAIN ] BGS: Loaded 51172 existing records. [2025-09-22T17:33:55.238893] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:33:55.239180] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-22T17:33:55.239256] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-22T17:33:55.240934] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-22T17:33:55.240998] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-22T17:33:55.598385] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:33:55.607544] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T17:33:55.722008] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-22T17:33:56.522070] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-22T17:33:57.072375] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T17:33:57.322073] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-22T17:33:57.521313] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T17:33:58.122094] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-22T17:33:58.503748] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T17:33:58.922067] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-22T17:33:58.943512] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-22T17:33:59.722076] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-22T17:34:00.262101] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T17:34:00.480102] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T17:34:00.522005] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-22T17:34:01.322052] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-22T17:34:01.335928] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T17:34:01.339632] [INFO ] [REMOTE ] BGR: Full fetch complete (20311 records). [2025-09-22T17:34:01.339834] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-22T17:34:01.725486] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-22T17:34:01.725567] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-22T17:34:01.726048] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-22T17:34:01.726112] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-22T17:34:01.726734] [DEBUG] [LOCAL ] BGR: Trimmed 20311 records to 13484 (keeping 200 days of data) [2025-09-22T17:34:01.811950] [DEBUG] [LOCAL ] BGR: Primary data saved (13484 records). [2025-09-22T17:34:01.812112] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-22T17:34:01.812205] [INFO ] [MAIN ] Update Progress: 260/2372 symbols completed. BGR took 23.9s. Estimated remaining: 4h 35m 55s. Rate: 7.7 symbols/min [2025-09-22T17:34:01.993244] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:34:02.001633] [DEBUG] [LOCAL ] BGSF: Loaded 6327 existing records from primary storage. [2025-09-22T17:34:02.001798] [INFO ] [MAIN ] BGSF: Loaded 6327 existing records. [2025-09-22T17:34:02.130820] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-22T17:34:02.200283] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:34:02.201983] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T17:34:02.205214] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-22T17:34:02.205374] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-22T17:34:02.205926] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-22T17:34:02.205986] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-22T17:34:02.245546] [INFO ] [REMOTE ] BGH: Full fetch complete (21789 records). [2025-09-22T17:34:02.258402] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-22T17:34:02.933214] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:34:02.933295] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-22T17:34:02.997426] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-22T17:34:02.997505] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-22T17:34:02.998018] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-22T17:34:02.998088] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-22T17:34:02.998889] [DEBUG] [LOCAL ] BGH: Trimmed 21789 records to 16404 (keeping 200 days of data) [2025-09-22T17:34:03.108575] [DEBUG] [LOCAL ] BGH: Primary data saved (16404 records). [2025-09-22T17:34:03.108772] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-22T17:34:03.108879] [INFO ] [MAIN ] Update Progress: 261/2372 symbols completed. BGH took 32.5s. Estimated remaining: 4h 34m 54s. Rate: 7.7 symbols/min [2025-09-22T17:34:03.295051] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:34:03.314131] [DEBUG] [LOCAL ] BGT: Loaded 16885 existing records from primary storage. [2025-09-22T17:34:03.314283] [INFO ] [MAIN ] BGT: Loaded 16885 existing records. [2025-09-22T17:34:03.511839] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:34:03.512104] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-22T17:34:03.512154] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-22T17:34:03.512894] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-22T17:34:03.512958] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-22T17:34:03.723297] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-22T17:34:03.921461] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:34:03.942613] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T17:34:04.522072] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-22T17:34:04.766527] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T17:34:04.783056] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T17:34:05.322062] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-22T17:34:05.639979] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T17:34:05.671593] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-22T17:34:06.122052] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-22T17:34:06.922072] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-22T17:34:07.364944] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T17:34:07.722096] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-22T17:34:07.878808] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T17:34:08.522039] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-22T17:34:08.636942] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T17:34:09.322117] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-22T17:34:09.973905] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-22T17:34:10.122099] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-22T17:34:10.304328] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T17:34:10.448517] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-22T17:34:10.922073] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-22T17:34:11.722072] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-22T17:34:12.148328] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-22T17:34:12.359961] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T17:34:12.522125] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-22T17:34:13.322061] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-22T17:34:14.102032] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T17:34:14.122010] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-22T17:34:14.206081] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T17:34:14.922059] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-22T17:34:15.493098] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T17:34:15.722055] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-22T17:34:16.522101] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-22T17:34:16.585410] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T17:34:16.593764] [INFO ] [REMOTE ] BG: Full fetch complete (72766 records). [2025-09-22T17:34:16.593915] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-22T17:34:17.017389] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-22T17:34:17.017667] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-22T17:34:17.018556] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-22T17:34:17.018674] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-22T17:34:17.020515] [DEBUG] [LOCAL ] BG: Trimmed 72766 records to 50380 (keeping 200 days of data) [2025-09-22T17:34:17.157103] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T17:34:17.322288] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-22T17:34:17.418626] [DEBUG] [LOCAL ] BG: Primary data saved (50380 records). [2025-09-22T17:34:17.418816] [INFO ] [MAIN ] BG: Full history saved. [2025-09-22T17:34:17.419591] [INFO ] [MAIN ] Update Progress: 262/2372 symbols completed. BG took 56.5s. Estimated remaining: 4h 35m 39s. Rate: 7.7 symbols/min [2025-09-22T17:34:17.611619] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:34:17.626235] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T17:34:17.641996] [DEBUG] [LOCAL ] BGX: Loaded 10987 existing records from primary storage. [2025-09-22T17:34:17.642160] [INFO ] [MAIN ] BGX: Loaded 10987 existing records. [2025-09-22T17:34:17.843586] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:34:17.843872] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-22T17:34:17.843923] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-22T17:34:17.844462] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-22T17:34:17.844523] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-22T17:34:18.127276] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-22T17:34:18.247770] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:34:18.922030] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-22T17:34:19.312685] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-22T17:34:19.325835] [INFO ] [REMOTE ] BGS: Full fetch complete (72458 records). [2025-09-22T17:34:19.326077] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-22T17:34:19.656139] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T17:34:19.739743] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-22T17:34:19.763386] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-22T17:34:19.764677] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-22T17:34:19.765612] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-22T17:34:19.765716] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-22T17:34:19.767321] [DEBUG] [LOCAL ] BGS: Trimmed 72458 records to 50448 (keeping 200 days of data) [2025-09-22T17:34:19.948954] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T17:34:20.074176] [DEBUG] [LOCAL ] BGS: Primary data saved (50448 records). [2025-09-22T17:34:20.074388] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-22T17:34:20.074521] [INFO ] [MAIN ] Update Progress: 263/2372 symbols completed. BGS took 25.3s. Estimated remaining: 4h 34m 49s. Rate: 7.7 symbols/min [2025-09-22T17:34:20.245860] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:34:20.268583] [DEBUG] [LOCAL ] BGY: Loaded 23356 existing records from primary storage. [2025-09-22T17:34:20.268753] [INFO ] [MAIN ] BGY: Loaded 23356 existing records. [2025-09-22T17:34:20.449423] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:34:20.449887] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-22T17:34:20.449951] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-22T17:34:20.457144] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T17:34:20.459324] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-22T17:34:20.460168] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-22T17:34:20.527274] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-22T17:34:20.821328] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:34:21.204158] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T17:34:21.322076] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-22T17:34:21.925803] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T17:34:22.122106] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-22T17:34:22.916270] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T17:34:22.921997] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-22T17:34:23.722109] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-22T17:34:23.740887] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T17:34:24.522114] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-22T17:34:24.791875] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-22T17:34:25.322033] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-22T17:34:25.534920] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T17:34:26.122091] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-22T17:34:26.359734] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T17:34:26.922135] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-22T17:34:26.980139] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T17:34:27.679497] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T17:34:27.722010] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-22T17:34:28.522031] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-22T17:34:28.673911] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T17:34:28.676763] [INFO ] [REMOTE ] BGT: Full fetch complete (24405 records). [2025-09-22T17:34:28.676841] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-22T17:34:29.084382] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-22T17:34:29.085363] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T17:34:29.085072] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-22T17:34:29.088883] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-22T17:34:29.088988] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-22T17:34:29.089705] [DEBUG] [LOCAL ] BGT: Trimmed 24405 records to 16570 (keeping 200 days of data) [2025-09-22T17:34:29.192588] [DEBUG] [LOCAL ] BGT: Primary data saved (16570 records). [2025-09-22T17:34:29.192841] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-22T17:34:29.192944] [INFO ] [MAIN ] Update Progress: 264/2372 symbols completed. BGT took 26.1s. Estimated remaining: 4h 34m 52s. Rate: 7.7 symbols/min [2025-09-22T17:34:29.336515] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-22T17:34:29.370343] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:34:29.388503] [DEBUG] [LOCAL ] BH: Loaded 15496 existing records from primary storage. [2025-09-22T17:34:29.388632] [INFO ] [MAIN ] BH: Loaded 15496 existing records. [2025-09-22T17:34:29.568241] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:34:29.568490] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-22T17:34:29.568539] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-22T17:34:29.569184] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-22T17:34:29.569246] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-22T17:34:29.864159] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-22T17:34:29.958059] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:34:30.122089] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-22T17:34:30.922102] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-22T17:34:31.211256] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T17:34:31.629115] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T17:34:31.722080] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-22T17:34:32.204364] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-22T17:34:32.522058] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-22T17:34:33.285938] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T17:34:33.322011] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-22T17:34:33.870236] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T17:34:34.122097] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-22T17:34:34.593680] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-22T17:34:34.922053] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-22T17:34:35.722062] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-22T17:34:36.061063] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T17:34:36.522121] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-22T17:34:36.658071] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T17:34:36.661063] [INFO ] [REMOTE ] BGSF: Full fetch complete (7915 records). [2025-09-22T17:34:36.661131] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-22T17:34:37.023050] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-22T17:34:37.030350] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-22T17:34:37.031008] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-22T17:34:37.031221] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-22T17:34:37.031260] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-22T17:34:37.031706] [DEBUG] [LOCAL ] BGSF: Trimmed 7915 records to 6537 (keeping 200 days of data) [2025-09-22T17:34:37.082596] [DEBUG] [LOCAL ] BGSF: Primary data saved (6537 records). [2025-09-22T17:34:37.082846] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-22T17:34:37.082990] [INFO ] [MAIN ] Update Progress: 265/2372 symbols completed. BGSF took 35.3s. Estimated remaining: 4h 34m 44s. Rate: 7.7 symbols/min [2025-09-22T17:34:37.260382] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:34:37.310892] [DEBUG] [LOCAL ] BHC: Loaded 47463 existing records from primary storage. [2025-09-22T17:34:37.311202] [INFO ] [MAIN ] BHC: Loaded 47463 existing records. [2025-09-22T17:34:37.331967] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-22T17:34:37.491505] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:34:37.491800] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-22T17:34:37.491861] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-22T17:34:37.493331] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-22T17:34:37.493391] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-22T17:34:37.846568] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:34:38.122079] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-22T17:34:38.537717] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T17:34:38.715737] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-22T17:34:38.718175] [INFO ] [REMOTE ] BGX: Full fetch complete (15720 records). [2025-09-22T17:34:38.718250] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-22T17:34:38.928923] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-22T17:34:39.087294] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-22T17:34:39.087370] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-22T17:34:39.087724] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-22T17:34:39.087786] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-22T17:34:39.088293] [DEBUG] [LOCAL ] BGX: Trimmed 15720 records to 10738 (keeping 200 days of data) [2025-09-22T17:34:39.153725] [DEBUG] [LOCAL ] BGX: Primary data saved (10738 records). [2025-09-22T17:34:39.153884] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-22T17:34:39.153972] [INFO ] [MAIN ] Update Progress: 266/2372 symbols completed. BGX took 21.7s. Estimated remaining: 4h 33m 51s. Rate: 7.7 symbols/min [2025-09-22T17:34:39.327342] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:34:39.356104] [DEBUG] [LOCAL ] BHE: Loaded 25840 existing records from primary storage. [2025-09-22T17:34:39.356235] [INFO ] [MAIN ] BHE: Loaded 25840 existing records. [2025-09-22T17:34:39.541412] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:34:39.542227] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-22T17:34:39.542546] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-22T17:34:39.549318] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-22T17:34:39.549703] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-22T17:34:39.555517] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T17:34:39.734623] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-22T17:34:39.935687] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:34:40.522146] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-22T17:34:40.603916] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T17:34:41.322073] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-22T17:34:41.960283] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T17:34:42.122091] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-22T17:34:42.271385] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T17:34:42.922052] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-22T17:34:43.368946] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-22T17:34:43.629518] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T17:34:43.722100] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-22T17:34:44.522056] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-22T17:34:44.839831] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-22T17:34:45.313896] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T17:34:45.322005] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-22T17:34:46.122136] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-22T17:34:46.556930] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T17:34:46.927203] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-22T17:34:46.938227] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T17:34:47.722099] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-22T17:34:47.922614] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T17:34:48.522060] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-22T17:34:49.178184] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T17:34:49.322069] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-22T17:34:50.041637] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T17:34:50.122022] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-22T17:34:50.483311] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T17:34:50.922121] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-22T17:34:51.111938] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-22T17:34:51.722037] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-22T17:34:52.010765] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T17:34:52.488203] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T17:34:52.522114] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-22T17:34:53.322075] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-22T17:34:54.122149] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-22T17:34:54.326072] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T17:34:54.922178] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-22T17:34:54.973746] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T17:34:54.978166] [INFO ] [REMOTE ] BGY: Full fetch complete (33431 records). [2025-09-22T17:34:54.978277] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-22T17:34:55.095172] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T17:34:55.454414] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-22T17:34:55.454503] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-22T17:34:55.455074] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-22T17:34:55.455137] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-22T17:34:55.456013] [DEBUG] [LOCAL ] BGY: Trimmed 33431 records to 22663 (keeping 200 days of data) [2025-09-22T17:34:55.592316] [DEBUG] [LOCAL ] BGY: Primary data saved (22663 records). [2025-09-22T17:34:55.592448] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-22T17:34:55.592531] [INFO ] [MAIN ] Update Progress: 267/2372 symbols completed. BGY took 35.5s. Estimated remaining: 4h 34m 51s. Rate: 7.7 symbols/min [2025-09-22T17:34:55.724385] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-22T17:34:55.777449] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:34:55.805417] [DEBUG] [LOCAL ] BHK: Loaded 22707 existing records from primary storage. [2025-09-22T17:34:55.805597] [INFO ] [MAIN ] BHK: Loaded 22707 existing records. [2025-09-22T17:34:55.978189] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T17:34:56.063465] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:34:56.063805] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-22T17:34:56.063877] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-22T17:34:56.064770] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-22T17:34:56.064858] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-22T17:34:56.423433] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:34:56.522032] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-22T17:34:56.835917] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T17:34:57.322056] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-22T17:34:57.553296] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T17:34:58.122076] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-22T17:34:58.466697] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T17:34:58.858947] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T17:34:58.922010] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-22T17:34:59.650123] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-22T17:34:59.722063] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-22T17:35:00.522117] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-22T17:35:01.101782] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T17:35:01.322080] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-22T17:35:01.583043] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T17:35:02.122101] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-22T17:35:02.475747] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T17:35:02.479012] [INFO ] [REMOTE ] BH: Full fetch complete (19233 records). [2025-09-22T17:35:02.479086] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-22T17:35:02.840528] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-22T17:35:02.840601] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-22T17:35:02.840970] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-22T17:35:02.841030] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-22T17:35:02.841612] [DEBUG] [LOCAL ] BH: Trimmed 19233 records to 15425 (keeping 200 days of data) [2025-09-22T17:35:02.922313] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-22T17:35:02.943274] [DEBUG] [LOCAL ] BH: Primary data saved (15425 records). [2025-09-22T17:35:02.943423] [INFO ] [MAIN ] BH: Full history saved. [2025-09-22T17:35:02.943612] [INFO ] [MAIN ] Update Progress: 268/2372 symbols completed. BH took 33.8s. Estimated remaining: 4h 34m 40s. Rate: 7.7 symbols/min [2025-09-22T17:35:03.143512] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:35:03.159141] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T17:35:03.229310] [DEBUG] [LOCAL ] BHP: Loaded 54166 existing records from primary storage. [2025-09-22T17:35:03.229607] [INFO ] [MAIN ] BHP: Loaded 54166 existing records. [2025-09-22T17:35:03.423879] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:35:03.424177] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-22T17:35:03.424246] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-22T17:35:03.426884] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-22T17:35:03.426949] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-22T17:35:03.727296] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-22T17:35:03.801684] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:35:04.417101] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T17:35:04.522066] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-22T17:35:04.670096] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-22T17:35:05.322060] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-22T17:35:06.122118] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-22T17:35:06.442219] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-22T17:35:06.484039] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T17:35:06.922072] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-22T17:35:07.656442] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T17:35:07.722065] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-22T17:35:07.765701] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T17:35:07.769537] [INFO ] [REMOTE ] BHE: Full fetch complete (36529 records). [2025-09-22T17:35:07.769677] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-22T17:35:08.159568] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-22T17:35:08.159679] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-22T17:35:08.160246] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-22T17:35:08.160309] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-22T17:35:08.161250] [DEBUG] [LOCAL ] BHE: Trimmed 36529 records to 25215 (keeping 200 days of data) [2025-09-22T17:35:08.322159] [DEBUG] [LOCAL ] BHE: Primary data saved (25215 records). [2025-09-22T17:35:08.322300] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-22T17:35:08.322387] [INFO ] [MAIN ] Update Progress: 269/2372 symbols completed. BHE took 29.2s. Estimated remaining: 4h 34m 13s. Rate: 7.7 symbols/min [2025-09-22T17:35:08.490858] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:35:08.512354] [DEBUG] [LOCAL ] BHR: Loaded 21774 existing records from primary storage. [2025-09-22T17:35:08.512513] [INFO ] [MAIN ] BHR: Loaded 21774 existing records. [2025-09-22T17:35:08.527168] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-22T17:35:08.692093] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:35:08.692330] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-22T17:35:08.692430] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-22T17:35:08.693090] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-22T17:35:08.693150] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-22T17:35:09.067079] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:35:09.276068] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T17:35:09.322051] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-22T17:35:10.122063] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-22T17:35:10.286469] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T17:35:10.475805] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T17:35:10.922054] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-22T17:35:11.367630] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T17:35:11.722040] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-22T17:35:12.085358] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T17:35:12.522049] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-22T17:35:12.626247] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T17:35:13.325144] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-22T17:35:13.327478] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-22T17:35:14.122047] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-22T17:35:14.796340] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T17:35:14.922063] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-22T17:35:15.306681] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T17:35:15.722067] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-22T17:35:16.522028] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-22T17:35:16.814840] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T17:35:16.899911] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T17:35:17.255754] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-22T17:35:17.322011] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-22T17:35:18.083156] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-22T17:35:18.122080] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-22T17:35:18.922072] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-22T17:35:19.277721] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T17:35:19.722051] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-22T17:35:20.477853] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T17:35:20.522025] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-22T17:35:20.847103] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T17:35:21.322059] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-22T17:35:22.093025] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T17:35:22.122008] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-22T17:35:22.152559] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T17:35:22.922037] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-22T17:35:23.044202] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T17:35:23.722076] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-22T17:35:24.399755] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T17:35:24.522076] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-22T17:35:24.776250] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T17:35:24.784543] [INFO ] [REMOTE ] BHC: Full fetch complete (66710 records). [2025-09-22T17:35:24.784760] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-22T17:35:25.199409] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-22T17:35:25.199518] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-22T17:35:25.200296] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-22T17:35:25.200388] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-22T17:35:25.201861] [DEBUG] [LOCAL ] BHC: Trimmed 66710 records to 46804 (keeping 200 days of data) [2025-09-22T17:35:25.322441] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-22T17:35:25.491450] [DEBUG] [LOCAL ] BHC: Primary data saved (46804 records). [2025-09-22T17:35:25.491597] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-22T17:35:25.491740] [INFO ] [MAIN ] Update Progress: 270/2372 symbols completed. BHC took 48.4s. Estimated remaining: 4h 35m 18s. Rate: 7.6 symbols/min [2025-09-22T17:35:25.673832] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:35:25.674071] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-22T17:35:25.674117] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-22T17:35:25.674280] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-22T17:35:25.674327] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-22T17:35:25.674369] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-22T17:35:25.674411] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-22T17:35:25.946460] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T17:35:25.984595] [INFO ] [REMOTE ] BHR: Full fetch complete (30521 records). [2025-09-22T17:35:25.990444] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-22T17:35:26.130515] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-22T17:35:26.191791] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:35:26.483732] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-22T17:35:26.483846] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-22T17:35:26.484464] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-22T17:35:26.484559] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-22T17:35:26.488816] [DEBUG] [LOCAL ] BHR: Trimmed 30521 records to 21413 (keeping 200 days of data) [2025-09-22T17:35:26.627391] [DEBUG] [LOCAL ] BHR: Primary data saved (21413 records). [2025-09-22T17:35:26.627525] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-22T17:35:26.627618] [INFO ] [MAIN ] Update Progress: 271/2372 symbols completed. BHR took 18.3s. Estimated remaining: 4h 34m 18s. Rate: 7.7 symbols/min [2025-09-22T17:35:26.803270] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:35:26.860506] [DEBUG] [LOCAL ] BHVN: Loaded 50308 existing records from primary storage. [2025-09-22T17:35:26.860699] [INFO ] [MAIN ] BHVN: Loaded 50308 existing records. [2025-09-22T17:35:26.931880] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-22T17:35:27.058468] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:35:27.058839] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-22T17:35:27.058906] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-22T17:35:27.060298] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-22T17:35:27.060377] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-22T17:35:27.440862] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-22T17:35:27.470330] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T17:35:27.473851] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:35:27.495153] [INFO ] [REMOTE ] BHK: Full fetch complete (29619 records). [2025-09-22T17:35:27.508862] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-22T17:35:27.545830] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-22T17:35:27.729754] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-22T17:35:27.902996] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-22T17:35:27.903083] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-22T17:35:27.903476] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-22T17:35:27.903515] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-22T17:35:27.904282] [DEBUG] [LOCAL ] BHK: Trimmed 29619 records to 22486 (keeping 200 days of data) [2025-09-22T17:35:28.045942] [DEBUG] [LOCAL ] BHK: Primary data saved (22486 records). [2025-09-22T17:35:28.046076] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-22T17:35:28.046187] [INFO ] [MAIN ] Update Progress: 272/2372 symbols completed. BHK took 32.5s. Estimated remaining: 4h 33m 20s. Rate: 7.7 symbols/min [2025-09-22T17:35:28.219437] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:35:28.219950] [DEBUG] [LOCAL ] BILL: No existing data file found in primary storage. [2025-09-22T17:35:28.220005] [WARN ] [MAIN ] BILL: No existing data found, performing full refresh instead. [2025-09-22T17:35:28.220199] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-22T17:35:28.220249] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-22T17:35:28.220291] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-09-22T17:35:28.220323] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-22T17:35:28.532865] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-22T17:35:28.572741] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:35:28.832820] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-22T17:35:29.322084] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-22T17:35:29.572450] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T17:35:29.604281] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-22T17:35:30.122061] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-22T17:35:30.922064] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-22T17:35:31.484213] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T17:35:31.722087] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-22T17:35:32.522138] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-22T17:35:33.031581] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-22T17:35:33.322091] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-22T17:35:33.619887] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T17:35:33.688603] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-22T17:35:34.038331] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T17:35:34.122085] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-22T17:35:34.922059] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-22T17:35:35.715715] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T17:35:35.724081] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-22T17:35:36.522005] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-22T17:35:36.605566] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T17:35:37.322097] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-22T17:35:37.357291] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T17:35:37.820910] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T17:35:37.861489] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T17:35:38.122029] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-22T17:35:38.922106] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-22T17:35:39.599707] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T17:35:39.722051] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-22T17:35:40.091529] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-22T17:35:40.522058] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-22T17:35:40.921366] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T17:35:40.933905] [INFO ] [REMOTE ] BHP: Full fetch complete (77243 records). [2025-09-22T17:35:40.934038] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-22T17:35:41.326746] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-22T17:35:41.346809] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-22T17:35:41.347887] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-22T17:35:41.348729] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-22T17:35:41.348798] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-22T17:35:41.350528] [DEBUG] [LOCAL ] BHP: Trimmed 77243 records to 53385 (keeping 200 days of data) [2025-09-22T17:35:41.683367] [DEBUG] [LOCAL ] BHP: Primary data saved (53385 records). [2025-09-22T17:35:41.683553] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-22T17:35:41.683685] [INFO ] [MAIN ] Update Progress: 273/2372 symbols completed. BHP took 38.7s. Estimated remaining: 4h 33m 57s. Rate: 7.7 symbols/min [2025-09-22T17:35:41.778132] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T17:35:41.865248] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:35:41.896038] [DEBUG] [LOCAL ] BIO: Loaded 26070 existing records from primary storage. [2025-09-22T17:35:41.896172] [INFO ] [MAIN ] BIO: Loaded 26070 existing records. [2025-09-22T17:35:42.081841] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:35:42.082314] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-22T17:35:42.082407] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-22T17:35:42.083578] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-22T17:35:42.083677] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-22T17:35:42.126479] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-22T17:35:42.380930] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T17:35:42.495831] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:35:42.922109] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-22T17:35:43.214059] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-22T17:35:43.413723] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T17:35:43.722060] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-22T17:35:44.522109] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-22T17:35:44.954617] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T17:35:45.322051] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-22T17:35:45.438681] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T17:35:46.122094] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-22T17:35:46.475188] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T17:35:46.922090] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-22T17:35:47.380727] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-22T17:35:47.381639] [INFO ] [REMOTE ] BHV: Full fetch complete (1385 records). [2025-09-22T17:35:47.381731] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-22T17:35:47.564615] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-22T17:35:47.564865] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:35:47.564974] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:35:47.565038] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-22T17:35:47.565106] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-22T17:35:47.565156] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-22T17:35:47.565238] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-22T17:35:47.565319] [INFO ] [MAIN ] Update Progress: 274/2372 symbols completed. BHV took 22.1s. Estimated remaining: 4h 33m 35s. Rate: 7.7 symbols/min [2025-09-22T17:35:47.722034] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-22T17:35:47.749060] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:35:47.807834] [DEBUG] [LOCAL ] BIP: Loaded 40386 existing records from primary storage. [2025-09-22T17:35:47.807969] [INFO ] [MAIN ] BIP: Loaded 40386 existing records. [2025-09-22T17:35:48.006761] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T17:35:48.039122] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:35:48.039769] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-22T17:35:48.040098] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-22T17:35:48.041074] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-22T17:35:48.041134] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-22T17:35:48.402835] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:35:48.522070] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-22T17:35:48.562171] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T17:35:49.322051] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-22T17:35:49.812848] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T17:35:50.122022] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-22T17:35:50.429217] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T17:35:50.922059] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-22T17:35:51.173688] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T17:35:51.722105] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-22T17:35:51.935373] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T17:35:52.522093] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-22T17:35:53.130835] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T17:35:53.322063] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-22T17:35:53.514105] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T17:35:54.122047] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-22T17:35:54.678563] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T17:35:54.922035] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-22T17:35:54.962519] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T17:35:55.722048] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-22T17:35:56.522097] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-22T17:35:56.564105] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T17:35:57.188374] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T17:35:57.322023] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-22T17:35:58.122076] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-22T17:35:58.145078] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-22T17:35:58.491749] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T17:35:58.922130] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-22T17:35:59.609841] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T17:35:59.722067] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-22T17:35:59.856469] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T17:36:00.522084] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-22T17:36:01.066377] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T17:36:01.322066] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-22T17:36:02.122136] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-22T17:36:02.731438] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-22T17:36:02.922072] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-22T17:36:03.722187] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-22T17:36:04.471067] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (3.15 seconds). [2025-09-22T17:36:04.522060] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-22T17:36:04.547188] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-22T17:36:04.550895] [INFO ] [REMOTE ] BIO: Full fetch complete (34213 records). [2025-09-22T17:36:04.550998] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-22T17:36:05.082591] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-22T17:36:05.082845] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-22T17:36:05.083937] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-22T17:36:05.084081] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-22T17:36:05.085975] [DEBUG] [LOCAL ] BIO: Trimmed 34213 records to 25556 (keeping 200 days of data) [2025-09-22T17:36:05.119145] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-22T17:36:05.316217] [DEBUG] [LOCAL ] BIO: Primary data saved (25556 records). [2025-09-22T17:36:05.316454] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-22T17:36:05.316579] [INFO ] [MAIN ] Update Progress: 275/2372 symbols completed. BIO took 23.6s. Estimated remaining: 4h 34m 42s. Rate: 7.6 symbols/min [2025-09-22T17:36:05.351406] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-22T17:36:05.512378] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:36:05.539064] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-22T17:36:05.547366] [INFO ] [REMOTE ] BHVN: Full fetch complete (69267 records). [2025-09-22T17:36:05.547610] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-22T17:36:05.883473] [DEBUG] [LOCAL ] BIPC: Loaded 42343 existing records from primary storage. [2025-09-22T17:36:05.895725] [INFO ] [MAIN ] BIPC: Loaded 42343 existing records. [2025-09-22T17:36:06.125476] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-22T17:36:06.141162] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-22T17:36:06.147271] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-22T17:36:06.161858] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-22T17:36:06.205554] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:36:06.206235] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-22T17:36:06.206615] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-22T17:36:06.232866] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T17:36:06.231568] [DEBUG] [LOCAL ] BHVN: Trimmed 69267 records to 49586 (keeping 200 days of data) [2025-09-22T17:36:06.233010] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-22T17:36:06.242156] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-22T17:36:06.254117] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-22T17:36:06.741709] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:36:06.922272] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-22T17:36:06.939193] [DEBUG] [LOCAL ] BHVN: Primary data saved (49586 records). [2025-09-22T17:36:06.939352] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-22T17:36:06.940351] [INFO ] [MAIN ] Update Progress: 276/2372 symbols completed. BHVN took 40.3s. Estimated remaining: 4h 33m 47s. Rate: 7.7 symbols/min [2025-09-22T17:36:07.127457] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:36:07.133217] [DEBUG] [LOCAL ] BIPH: Loaded 2654 existing records from primary storage. [2025-09-22T17:36:07.133381] [INFO ] [MAIN ] BIPH: Loaded 2654 existing records. [2025-09-22T17:36:07.331872] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:36:07.332258] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-22T17:36:07.332329] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-22T17:36:07.332753] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-22T17:36:07.332878] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-22T17:36:07.495179] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-22T17:36:07.545942] [INFO ] [REMOTE ] BILL: Full fetch complete (75184 records). [2025-09-22T17:36:07.548333] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-22T17:36:07.576319] [FATAL] [VALIDATOR ] BILL: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:36:07.641165] [FATAL] [MAIN ] BILL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:36:07.654442] [WARN ] [MAIN ] BILL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:36:07.659692] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-22T17:36:07.667522] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-09-22T17:36:07.673330] [INFO ] [LOCAL ] BILL: Starting deletion of derivative data. [2025-09-22T17:36:07.685983] [DEBUG] [LOCAL ] BILL: No derivative data file found to delete. [2025-09-22T17:36:07.686130] [INFO ] [MAIN ] Update Progress: 277/2372 symbols completed. BILL took 39.6s. Estimated remaining: 4h 32m 46s. Rate: 7.7 symbols/min [2025-09-22T17:36:07.771166] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:36:07.771494] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-22T17:36:07.901303] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T17:36:08.389741] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T17:36:08.463250] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-22T17:36:08.522063] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-22T17:36:09.322054] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-22T17:36:09.563330] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T17:36:10.122053] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-22T17:36:10.377237] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T17:36:10.922071] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-22T17:36:11.268278] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T17:36:11.501133] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T17:36:11.722051] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-22T17:36:12.522066] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-22T17:36:13.333459] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-22T17:36:13.336122] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T17:36:13.525514] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T17:36:13.806419] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-22T17:36:14.122029] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-22T17:36:14.922143] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-22T17:36:15.540323] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T17:36:15.727692] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-22T17:36:15.739714] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T17:36:15.746417] [INFO ] [REMOTE ] BIP: Full fetch complete (56321 records). [2025-09-22T17:36:15.746522] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-22T17:36:16.124869] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-22T17:36:16.124949] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-22T17:36:16.125588] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-22T17:36:16.125675] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-22T17:36:16.126807] [DEBUG] [LOCAL ] BIP: Trimmed 56321 records to 39680 (keeping 200 days of data) [2025-09-22T17:36:16.372327] [DEBUG] [LOCAL ] BIP: Primary data saved (39680 records). [2025-09-22T17:36:16.372564] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-22T17:36:16.372733] [INFO ] [MAIN ] Update Progress: 278/2372 symbols completed. BIP took 28.8s. Estimated remaining: 4h 32m 45s. Rate: 7.7 symbols/min [2025-09-22T17:36:16.377486] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-22T17:36:16.522015] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-22T17:36:16.912619] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-22T17:36:17.322040] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-22T17:36:17.641746] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-22T17:36:18.122097] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-22T17:36:18.922070] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-22T17:36:19.787779] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-22T17:36:19.789349] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-22T17:36:20.126980] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T17:36:20.161887] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-22T17:36:20.522195] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-22T17:36:21.020341] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-22T17:36:21.021371] [INFO ] [REMOTE ] BIPH: Full fetch complete (4335 records). [2025-09-22T17:36:21.021449] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-22T17:36:21.327183] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-22T17:36:21.387588] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-22T17:36:21.387687] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-22T17:36:21.387852] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-22T17:36:21.387892] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-22T17:36:21.388251] [DEBUG] [LOCAL ] BIPH: Trimmed 4335 records to 2646 (keeping 200 days of data) [2025-09-22T17:36:21.408601] [DEBUG] [LOCAL ] BIPH: Primary data saved (2646 records). [2025-09-22T17:36:21.408787] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-22T17:36:21.408879] [INFO ] [MAIN ] Update Progress: 279/2372 symbols completed. BIPH took 14.5s. Estimated remaining: 4h 32m 16s. Rate: 7.7 symbols/min [2025-09-22T17:36:22.707631] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T17:36:22.717141] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-22T17:36:24.220505] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T17:36:24.229586] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-22T17:36:25.369235] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T17:36:25.377458] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-22T17:36:26.861085] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T17:36:26.871415] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-22T17:36:27.976498] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T17:36:27.985514] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-22T17:36:29.439094] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T17:36:29.445226] [INFO ] [REMOTE ] BIPC: Full fetch complete (59427 records). [2025-09-22T17:36:29.445330] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-22T17:36:29.832739] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-22T17:36:29.832853] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-22T17:36:29.833555] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-22T17:36:29.833598] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-22T17:36:29.834875] [DEBUG] [LOCAL ] BIPC: Trimmed 59427 records to 41711 (keeping 200 days of data) [2025-09-22T17:36:30.093255] [DEBUG] [LOCAL ] BIPC: Primary data saved (41711 records). [2025-09-22T17:36:30.093394] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-22T17:36:30.093479] [INFO ] [MAIN ] Update Progress: 280/2372 symbols completed. BIPC took 24.8s. Estimated remaining: 4h 32m 15s. Rate: 7.7 symbols/min [2025-09-22T17:36:30.743350] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:36:30.799241] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:36:30.774132] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:36:30.800185] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:36:30.809262] [DEBUG] [LOCAL ] BIPJ: Loaded 2913 existing records from primary storage. [2025-09-22T17:36:30.809439] [INFO ] [MAIN ] BIPJ: Loaded 2913 existing records. [2025-09-22T17:36:30.823844] [DEBUG] [LOCAL ] BIPI: Loaded 3466 existing records from primary storage. [2025-09-22T17:36:30.867743] [INFO ] [MAIN ] BIPI: Loaded 3466 existing records. [2025-09-22T17:36:31.032807] [DEBUG] [LOCAL ] BIT: Loaded 22461 existing records from primary storage. [2025-09-22T17:36:31.110869] [INFO ] [MAIN ] BIT: Loaded 22461 existing records. [2025-09-22T17:36:31.232494] [DEBUG] [LOCAL ] BIRK: Loaded 51561 existing records from primary storage. [2025-09-22T17:36:31.285928] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:36:31.324951] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:36:31.295406] [INFO ] [MAIN ] BIRK: Loaded 51561 existing records. [2025-09-22T17:36:31.341005] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-22T17:36:31.346307] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-22T17:36:31.346380] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-22T17:36:31.430019] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-22T17:36:31.384195] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-22T17:36:31.474638] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-22T17:36:31.450896] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-22T17:36:31.561576] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-22T17:36:31.628524] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:36:31.714056] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-22T17:36:31.754579] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-22T17:36:31.817689] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-22T17:36:31.918109] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-22T17:36:31.956174] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:36:32.043609] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-22T17:36:32.123420] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-22T17:36:32.285960] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-22T17:36:32.342033] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-22T17:36:32.559794] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:36:32.751490] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-22T17:36:32.792470] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:36:32.802303] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-22T17:36:33.079345] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:36:33.102202] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-22T17:36:33.195402] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:36:33.195797] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-22T17:36:33.337310] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-22T17:36:33.338933] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-22T17:36:33.661982] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-22T17:36:33.663267] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-22T17:36:33.696112] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T17:36:33.698087] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-22T17:36:33.980301] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T17:36:33.985940] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-22T17:36:33.990009] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-22T17:36:33.991289] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-22T17:36:34.164101] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-22T17:36:34.165582] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-22T17:36:34.474736] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-22T17:36:34.476059] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-22T17:36:34.589506] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:36:34.610076] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T17:36:34.637449] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-22T17:36:34.922064] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-22T17:36:35.187685] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-22T17:36:35.396373] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T17:36:35.722049] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-22T17:36:36.021381] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-22T17:36:36.522070] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-22T17:36:37.322061] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-22T17:36:37.708056] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T17:36:38.019761] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-22T17:36:38.122025] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-22T17:36:38.922093] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-22T17:36:39.291011] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-22T17:36:39.475772] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T17:36:39.722073] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-22T17:36:40.491186] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T17:36:40.522011] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-22T17:36:41.276889] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T17:36:41.322031] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-22T17:36:42.122077] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-22T17:36:42.288777] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T17:36:42.922058] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-22T17:36:43.660840] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T17:36:43.729247] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-22T17:36:43.736248] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T17:36:44.522068] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-22T17:36:45.199326] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T17:36:45.322088] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-22T17:36:45.399438] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T17:36:45.783612] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-22T17:36:46.122128] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-22T17:36:46.922117] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-22T17:36:46.939396] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T17:36:47.227125] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-22T17:36:47.722076] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-22T17:36:48.290089] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T17:36:48.291273] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4317 records). [2025-09-22T17:36:48.291372] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-22T17:36:48.527199] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-22T17:36:48.659003] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-22T17:36:48.659082] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-22T17:36:48.659226] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-22T17:36:48.659264] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-22T17:36:48.659630] [DEBUG] [LOCAL ] BIPJ: Trimmed 4317 records to 2937 (keeping 200 days of data) [2025-09-22T17:36:48.677626] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2937 records). [2025-09-22T17:36:48.677751] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-22T17:36:48.677839] [INFO ] [MAIN ] Update Progress: 281/2372 symbols completed. BIPJ took 18.6s. Estimated remaining: 4h 33m 27s. Rate: 7.6 symbols/min [2025-09-22T17:36:48.855920] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:36:48.918946] [DEBUG] [LOCAL ] BJ: Loaded 52202 existing records from primary storage. [2025-09-22T17:36:48.919104] [INFO ] [MAIN ] BJ: Loaded 52202 existing records. [2025-09-22T17:36:49.097572] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:36:49.097854] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-22T17:36:49.097904] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-22T17:36:49.099362] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-22T17:36:49.099423] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-22T17:36:49.327266] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-22T17:36:49.489607] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:36:50.122063] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-22T17:36:50.277784] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T17:36:50.559570] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T17:36:50.727548] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T17:36:50.922103] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-22T17:36:51.722121] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-22T17:36:52.030042] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-22T17:36:52.264081] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T17:36:52.522110] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-22T17:36:53.322067] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-22T17:36:54.122024] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-22T17:36:54.270219] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T17:36:54.922029] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-22T17:36:54.997724] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T17:36:55.230502] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T17:36:55.236434] [INFO ] [REMOTE ] BIT: Full fetch complete (31029 records). [2025-09-22T17:36:55.236527] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-22T17:36:55.352787] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-22T17:36:55.628155] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-22T17:36:55.628282] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-22T17:36:55.628784] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-22T17:36:55.628847] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-22T17:36:55.629616] [DEBUG] [LOCAL ] BIT: Trimmed 31029 records to 22270 (keeping 200 days of data) [2025-09-22T17:36:55.723639] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-22T17:36:55.767552] [DEBUG] [LOCAL ] BIT: Primary data saved (22270 records). [2025-09-22T17:36:55.767713] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-22T17:36:55.767812] [INFO ] [MAIN ] Update Progress: 282/2372 symbols completed. BIT took 25.7s. Estimated remaining: 4h 33m 14s. Rate: 7.6 symbols/min [2025-09-22T17:36:55.935989] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:36:55.992030] [DEBUG] [LOCAL ] BK: Loaded 54345 existing records from primary storage. [2025-09-22T17:36:55.992206] [INFO ] [MAIN ] BK: Loaded 54345 existing records. [2025-09-22T17:36:56.185876] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:36:56.186146] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-22T17:36:56.186205] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-22T17:36:56.188565] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-22T17:36:56.188663] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-22T17:36:56.523817] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-22T17:36:56.546279] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:36:57.171613] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-22T17:36:57.322045] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-22T17:36:57.486675] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T17:36:58.122056] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-22T17:36:58.922063] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-22T17:36:59.027744] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T17:36:59.722061] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-22T17:36:59.858139] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T17:37:00.283103] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T17:37:00.290894] [INFO ] [REMOTE ] BIRK: Full fetch complete (72694 records). [2025-09-22T17:37:00.291012] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-22T17:37:00.531530] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-22T17:37:00.595539] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T17:37:00.600511] [INFO ] [REMOTE ] BIPI: Full fetch complete (5292 records). [2025-09-22T17:37:00.600849] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-22T17:37:00.847033] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-22T17:37:00.861503] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-22T17:37:00.878317] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-22T17:37:00.889258] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-22T17:37:00.989161] [DEBUG] [LOCAL ] BIRK: Trimmed 72694 records to 50882 (keeping 200 days of data) [2025-09-22T17:37:01.129163] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-22T17:37:01.156619] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-22T17:37:01.156860] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-22T17:37:01.159310] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-22T17:37:01.163088] [DEBUG] [LOCAL ] BIPI: Trimmed 5292 records to 3354 (keeping 200 days of data) [2025-09-22T17:37:01.197244] [DEBUG] [LOCAL ] BIPI: Primary data saved (3354 records). [2025-09-22T17:37:01.197680] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-22T17:37:01.197813] [INFO ] [MAIN ] Update Progress: 283/2372 symbols completed. BIPI took 31.1s. Estimated remaining: 4h 32m 48s. Rate: 7.7 symbols/min [2025-09-22T17:37:01.325736] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-22T17:37:01.386586] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:37:01.536308] [DEBUG] [LOCAL ] BKD: Loaded 50838 existing records from primary storage. [2025-09-22T17:37:01.536718] [INFO ] [MAIN ] BKD: Loaded 50838 existing records. [2025-09-22T17:37:01.795086] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:37:01.796949] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-22T17:37:01.797292] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-22T17:37:01.799824] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-22T17:37:01.800201] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-22T17:37:02.236165] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:37:02.236336] [DEBUG] [LOCAL ] BIRK: Primary data saved (50882 records). [2025-09-22T17:37:02.236804] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-22T17:37:02.237953] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-22T17:37:02.238229] [INFO ] [MAIN ] Update Progress: 284/2372 symbols completed. BIRK took 32.1s. Estimated remaining: 4h 31m 50s. Rate: 7.7 symbols/min [2025-09-22T17:37:02.422052] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:37:02.457202] [DEBUG] [LOCAL ] BKE: Loaded 35441 existing records from primary storage. [2025-09-22T17:37:02.457344] [INFO ] [MAIN ] BKE: Loaded 35441 existing records. [2025-09-22T17:37:02.641991] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:37:02.642342] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-22T17:37:02.642417] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-22T17:37:02.651355] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-22T17:37:02.664440] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-22T17:37:02.741040] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-22T17:37:02.934479] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-22T17:37:03.061316] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:37:03.116459] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T17:37:03.630861] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:37:03.722051] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-22T17:37:04.522086] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-22T17:37:04.851236] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T17:37:05.322070] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-22T17:37:05.610860] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-22T17:37:05.995520] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T17:37:06.122034] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-22T17:37:06.922066] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-22T17:37:07.121524] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T17:37:07.722120] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-22T17:37:07.840870] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T17:37:08.522055] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-22T17:37:09.213267] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-22T17:37:09.322066] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-22T17:37:10.122093] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-22T17:37:10.311160] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-22T17:37:10.425571] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T17:37:10.922064] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-22T17:37:11.202677] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-22T17:37:11.722062] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-22T17:37:12.379123] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-22T17:37:12.522328] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-22T17:37:12.525519] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T17:37:13.101198] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T17:37:13.322057] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-22T17:37:14.089765] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T17:37:14.122060] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-22T17:37:14.727207] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T17:37:14.922067] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-22T17:37:15.722060] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-22T17:37:15.820020] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T17:37:16.522094] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-22T17:37:16.714450] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T17:37:17.322059] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-22T17:37:17.522089] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T17:37:17.963353] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T17:37:18.122081] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-22T17:37:18.922094] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-22T17:37:19.235796] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T17:37:19.722110] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-22T17:37:19.831682] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T17:37:19.926040] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T17:37:20.522126] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-22T17:37:21.185535] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T17:37:21.322060] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-22T17:37:22.122090] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-22T17:37:22.185869] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T17:37:22.194088] [INFO ] [REMOTE ] BJ: Full fetch complete (73697 records). [2025-09-22T17:37:22.194220] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-22T17:37:22.597860] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-22T17:37:22.597991] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-22T17:37:22.599939] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-22T17:37:22.600014] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-22T17:37:22.605252] [DEBUG] [LOCAL ] BJ: Trimmed 73697 records to 51426 (keeping 200 days of data) [2025-09-22T17:37:22.922270] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-22T17:37:22.937342] [DEBUG] [LOCAL ] BJ: Primary data saved (51426 records). [2025-09-22T17:37:22.937452] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-22T17:37:22.937563] [INFO ] [MAIN ] Update Progress: 285/2372 symbols completed. BJ took 34.3s. Estimated remaining: 4h 33m 17s. Rate: 7.6 symbols/min [2025-09-22T17:37:23.149395] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:37:23.154594] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T17:37:23.205144] [DEBUG] [LOCAL ] BKH: Loaded 37246 existing records from primary storage. [2025-09-22T17:37:23.205298] [INFO ] [MAIN ] BKH: Loaded 37246 existing records. [2025-09-22T17:37:23.403785] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:37:23.404380] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-22T17:37:23.404515] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-22T17:37:23.406014] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-22T17:37:23.406077] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-22T17:37:23.540184] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T17:37:23.727174] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-22T17:37:23.825286] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:37:24.522048] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-22T17:37:24.721918] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T17:37:25.322044] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-22T17:37:25.398169] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T17:37:25.936776] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T17:37:26.122079] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-22T17:37:26.922084] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-22T17:37:27.052965] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T17:37:27.261377] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T17:37:27.722076] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-22T17:37:28.256079] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T17:37:28.522078] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-22T17:37:28.654033] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-22T17:37:29.322063] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-22T17:37:30.122150] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-22T17:37:30.672047] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-22T17:37:30.677669] [INFO ] [REMOTE ] BKE: Full fetch complete (50274 records). [2025-09-22T17:37:30.677777] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-22T17:37:30.929467] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-22T17:37:31.113498] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T17:37:31.111977] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-22T17:37:31.121013] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-22T17:37:31.122991] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-22T17:37:31.123509] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-22T17:37:31.124749] [DEBUG] [LOCAL ] BKE: Trimmed 50274 records to 34839 (keeping 200 days of data) [2025-09-22T17:37:31.346934] [DEBUG] [LOCAL ] BKE: Primary data saved (34839 records). [2025-09-22T17:37:31.347085] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-22T17:37:31.349121] [INFO ] [MAIN ] Update Progress: 286/2372 symbols completed. BKE took 29.1s. Estimated remaining: 4h 33m 13s. Rate: 7.6 symbols/min [2025-09-22T17:37:31.525768] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:37:31.565600] [DEBUG] [LOCAL ] BKKT: Loaded 34629 existing records from primary storage. [2025-09-22T17:37:31.565767] [INFO ] [MAIN ] BKKT: Loaded 34629 existing records. [2025-09-22T17:37:31.726405] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-22T17:37:31.758849] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:37:31.759157] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-22T17:37:31.759235] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-22T17:37:31.760355] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-22T17:37:31.760425] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-22T17:37:32.133115] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:37:32.164118] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T17:37:32.536050] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-22T17:37:32.538633] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T17:37:33.290254] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T17:37:33.321999] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-22T17:37:33.927217] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T17:37:33.939818] [INFO ] [REMOTE ] BKD: Full fetch complete (71378 records). [2025-09-22T17:37:33.940037] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-22T17:37:34.128592] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-22T17:37:34.347357] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-22T17:37:34.347444] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-22T17:37:34.348256] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-22T17:37:34.348325] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-22T17:37:34.349996] [DEBUG] [LOCAL ] BKD: Trimmed 71378 records to 50100 (keeping 200 days of data) [2025-09-22T17:37:34.643494] [DEBUG] [LOCAL ] BKD: Primary data saved (50100 records). [2025-09-22T17:37:34.643808] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-22T17:37:34.644010] [INFO ] [MAIN ] Update Progress: 287/2372 symbols completed. BKD took 33.4s. Estimated remaining: 4h 32m 32s. Rate: 7.7 symbols/min [2025-09-22T17:37:34.859804] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:37:34.864374] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T17:37:34.882429] [DEBUG] [LOCAL ] BKN: Loaded 7752 existing records from primary storage. [2025-09-22T17:37:34.882546] [INFO ] [MAIN ] BKN: Loaded 7752 existing records. [2025-09-22T17:37:34.927372] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-22T17:37:35.066356] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:37:35.066611] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-22T17:37:35.066688] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-22T17:37:35.067192] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-22T17:37:35.067271] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-22T17:37:35.417581] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:37:35.722088] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-22T17:37:36.213159] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T17:37:36.299057] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-22T17:37:36.392304] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T17:37:36.522108] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-22T17:37:37.322124] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-22T17:37:38.127096] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-22T17:37:38.128715] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T17:37:38.177090] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T17:37:38.922087] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-22T17:37:39.392438] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T17:37:39.722089] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-22T17:37:40.123894] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T17:37:40.349783] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T17:37:40.522098] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-22T17:37:41.278515] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-22T17:37:41.322031] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-22T17:37:41.856937] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-22T17:37:42.122138] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-22T17:37:42.922153] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-22T17:37:43.325803] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T17:37:43.436179] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-22T17:37:43.722057] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-22T17:37:44.522162] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-22T17:37:45.053455] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T17:37:45.322070] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-22T17:37:45.385529] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T17:37:45.976221] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-22T17:37:46.122039] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-22T17:37:46.647726] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T17:37:46.922068] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-22T17:37:47.544080] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T17:37:47.722105] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-22T17:37:48.522065] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-22T17:37:49.322070] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-22T17:37:49.593933] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T17:37:49.774015] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-22T17:37:49.784409] [INFO ] [REMOTE ] BK: Full fetch complete (77488 records). [2025-09-22T17:37:49.784603] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-22T17:37:50.035886] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T17:37:50.083821] [INFO ] [REMOTE ] BKN: Full fetch complete (11995 records). [2025-09-22T17:37:50.089071] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-22T17:37:50.140551] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-22T17:37:50.359893] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-22T17:37:50.377912] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-22T17:37:50.406992] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-22T17:37:50.418513] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-22T17:37:50.554930] [DEBUG] [LOCAL ] BK: Trimmed 77488 records to 53562 (keeping 200 days of data) [2025-09-22T17:37:50.735120] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-22T17:37:50.736680] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-22T17:37:50.742052] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-22T17:37:50.742136] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-22T17:37:50.760767] [DEBUG] [LOCAL ] BKN: Trimmed 11995 records to 7678 (keeping 200 days of data) [2025-09-22T17:37:50.926550] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-22T17:37:50.934974] [DEBUG] [LOCAL ] BKN: Primary data saved (7678 records). [2025-09-22T17:37:50.936173] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-22T17:37:50.936582] [INFO ] [MAIN ] Update Progress: 288/2372 symbols completed. BKN took 16.3s. Estimated remaining: 4h 33m 25s. Rate: 7.6 symbols/min [2025-09-22T17:37:51.141580] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:37:51.239705] [DEBUG] [LOCAL ] BK: Primary data saved (53562 records). [2025-09-22T17:37:51.239924] [INFO ] [MAIN ] BK: Full history saved. [2025-09-22T17:37:51.240036] [INFO ] [MAIN ] Update Progress: 289/2372 symbols completed. BK took 55.5s. Estimated remaining: 4h 32m 23s. Rate: 7.6 symbols/min [2025-09-22T17:37:51.372211] [DEBUG] [LOCAL ] BKSY: Loaded 49065 existing records from primary storage. [2025-09-22T17:37:51.394536] [INFO ] [MAIN ] BKSY: Loaded 49065 existing records. [2025-09-22T17:37:51.506900] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:37:51.525618] [DEBUG] [LOCAL ] BKT: No existing data file found in primary storage. [2025-09-22T17:37:51.527886] [WARN ] [MAIN ] BKT: No existing data found, performing full refresh instead. [2025-09-22T17:37:51.528315] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-22T17:37:51.533731] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-22T17:37:51.538941] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-09-22T17:37:51.544129] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-22T17:37:51.730205] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:37:51.746951] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-22T17:37:51.757363] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-22T17:37:51.808787] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-22T17:37:51.854017] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-22T17:37:52.192538] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:37:52.246561] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-22T17:37:52.389166] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-22T17:37:52.452636] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:37:52.453401] [INFO ] [REMOTE ] BKH: Full fetch complete (52021 records). [2025-09-22T17:37:52.453574] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-22T17:37:52.524840] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-22T17:37:52.576856] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T17:37:52.866324] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-22T17:37:52.866413] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-22T17:37:52.867033] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-22T17:37:52.867099] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-22T17:37:52.869595] [DEBUG] [LOCAL ] BKH: Trimmed 52021 records to 36644 (keeping 200 days of data) [2025-09-22T17:37:53.130496] [DEBUG] [LOCAL ] BKH: Primary data saved (36644 records). [2025-09-22T17:37:53.130639] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-22T17:37:53.130778] [INFO ] [MAIN ] Update Progress: 290/2372 symbols completed. BKH took 30.2s. Estimated remaining: 4h 31m 32s. Rate: 7.7 symbols/min [2025-09-22T17:37:53.300769] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T17:37:53.320058] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:37:53.322313] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-22T17:37:53.370947] [DEBUG] [LOCAL ] BKU: Loaded 42752 existing records from primary storage. [2025-09-22T17:37:53.371089] [INFO ] [MAIN ] BKU: Loaded 42752 existing records. [2025-09-22T17:37:53.548818] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:37:53.549076] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-22T17:37:53.549123] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-22T17:37:53.550426] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-22T17:37:53.550489] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-22T17:37:53.910959] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:37:54.122023] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-22T17:37:54.152050] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T17:37:54.838131] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T17:37:54.922049] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-22T17:37:55.068042] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T17:37:55.698454] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T17:37:55.722014] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-22T17:37:56.522054] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-22T17:37:56.969352] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-22T17:37:57.322051] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-22T17:37:58.127523] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-22T17:37:58.133230] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T17:37:58.441782] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T17:37:58.922137] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-22T17:37:59.717593] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T17:37:59.726935] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-22T17:38:00.487537] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T17:38:00.522000] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-22T17:38:01.322899] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-22T17:38:01.325752] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T17:38:01.843739] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T17:38:01.969689] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T17:38:02.122055] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-22T17:38:02.922053] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-22T17:38:03.709559] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T17:38:03.716737] [INFO ] [REMOTE ] BKKT: Full fetch complete (49482 records). [2025-09-22T17:38:03.716878] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-22T17:38:03.728867] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-22T17:38:04.113304] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-22T17:38:04.113452] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-22T17:38:04.114522] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-22T17:38:04.114620] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-22T17:38:04.116847] [DEBUG] [LOCAL ] BKKT: Trimmed 49482 records to 34157 (keeping 200 days of data) [2025-09-22T17:38:04.354885] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T17:38:04.384373] [DEBUG] [LOCAL ] BKKT: Primary data saved (34157 records). [2025-09-22T17:38:04.384597] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-22T17:38:04.385769] [INFO ] [MAIN ] Update Progress: 291/2372 symbols completed. BKKT took 33.0s. Estimated remaining: 4h 31m 49s. Rate: 7.7 symbols/min [2025-09-22T17:38:04.533293] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-22T17:38:04.573269] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:38:04.617341] [DEBUG] [LOCAL ] BKV: Loaded 30602 existing records from primary storage. [2025-09-22T17:38:04.617551] [INFO ] [MAIN ] BKV: Loaded 30602 existing records. [2025-09-22T17:38:04.807181] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:38:04.807551] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-22T17:38:04.807603] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-22T17:38:04.808693] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-22T17:38:04.808758] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-22T17:38:05.173532] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:38:05.322049] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-22T17:38:05.872527] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-22T17:38:05.942182] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T17:38:06.122060] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-22T17:38:06.324554] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-22T17:38:06.922107] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-22T17:38:07.353456] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T17:38:07.722059] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-22T17:38:08.522056] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-22T17:38:08.612125] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T17:38:09.044196] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T17:38:09.322064] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-22T17:38:09.508251] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T17:38:10.122095] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-22T17:38:10.615859] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-22T17:38:10.800914] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T17:38:10.922058] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-22T17:38:11.722120] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-22T17:38:12.503980] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T17:38:12.522082] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-22T17:38:12.575695] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T17:38:13.322028] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-22T17:38:13.368223] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T17:38:14.122048] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-22T17:38:14.550097] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T17:38:14.557861] [INFO ] [REMOTE ] BKU: Full fetch complete (59704 records). [2025-09-22T17:38:14.558073] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-22T17:38:14.738508] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T17:38:14.928696] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-22T17:38:14.975133] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-22T17:38:14.975226] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-22T17:38:14.975964] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-22T17:38:14.976031] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-22T17:38:14.977613] [DEBUG] [LOCAL ] BKU: Trimmed 59704 records to 42017 (keeping 200 days of data) [2025-09-22T17:38:15.236112] [DEBUG] [LOCAL ] BKU: Primary data saved (42017 records). [2025-09-22T17:38:15.236282] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-22T17:38:15.236388] [INFO ] [MAIN ] Update Progress: 292/2372 symbols completed. BKU took 22.1s. Estimated remaining: 4h 32m 2s. Rate: 7.6 symbols/min [2025-09-22T17:38:15.412190] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:38:15.453057] [DEBUG] [LOCAL ] BLCO: Loaded 36678 existing records from primary storage. [2025-09-22T17:38:15.453290] [INFO ] [MAIN ] BLCO: Loaded 36678 existing records. [2025-09-22T17:38:15.643868] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:38:15.644185] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-22T17:38:15.644258] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-22T17:38:15.645462] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-22T17:38:15.645524] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-22T17:38:15.727236] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-22T17:38:16.021160] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:38:16.522068] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-22T17:38:16.766630] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T17:38:16.845153] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T17:38:17.322072] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-22T17:38:17.344117] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T17:38:18.122084] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-22T17:38:18.877979] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T17:38:18.922071] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-22T17:38:19.279929] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T17:38:19.283731] [INFO ] [REMOTE ] BKT: Full fetch complete (14898 records). [2025-09-22T17:38:19.283845] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-22T17:38:19.658044] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-22T17:38:19.658119] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-22T17:38:19.658445] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-22T17:38:19.658501] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-22T17:38:19.659084] [DEBUG] [LOCAL ] BKT: Trimmed 14898 records to 10780 (keeping 200 days of data) [2025-09-22T17:38:19.723925] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-22T17:38:19.727200] [DEBUG] [LOCAL ] BKT: Primary data saved (10780 records). [2025-09-22T17:38:19.727358] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-22T17:38:19.727444] [INFO ] [MAIN ] Update Progress: 293/2372 symbols completed. BKT took 28.5s. Estimated remaining: 4h 31m 31s. Rate: 7.7 symbols/min [2025-09-22T17:38:19.897600] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:38:19.927344] [DEBUG] [LOCAL ] BLD: Loaded 28606 existing records from primary storage. [2025-09-22T17:38:19.927478] [INFO ] [MAIN ] BLD: Loaded 28606 existing records. [2025-09-22T17:38:20.107113] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:38:20.107362] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-22T17:38:20.107411] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-22T17:38:20.108243] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-22T17:38:20.108303] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-22T17:38:20.479005] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:38:20.498454] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T17:38:20.522001] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-22T17:38:21.322049] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-22T17:38:21.554279] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T17:38:21.616583] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T17:38:22.122115] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-22T17:38:22.758240] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T17:38:22.922052] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-22T17:38:23.623813] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T17:38:23.722025] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-22T17:38:24.132138] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T17:38:24.522078] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-22T17:38:24.799160] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T17:38:25.322071] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-22T17:38:26.122080] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-22T17:38:26.341107] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-22T17:38:26.467095] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T17:38:26.922064] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-22T17:38:27.242560] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T17:38:27.722058] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-22T17:38:27.871792] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T17:38:28.522102] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-22T17:38:29.136712] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T17:38:29.322026] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-22T17:38:29.541593] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T17:38:30.122116] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-22T17:38:30.908736] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T17:38:30.922007] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-22T17:38:31.341581] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T17:38:31.722058] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-22T17:38:31.945797] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T17:38:32.434001] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T17:38:32.522069] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-22T17:38:33.322061] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-22T17:38:33.677231] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T17:38:33.681432] [INFO ] [REMOTE ] BKV: Full fetch complete (44902 records). [2025-09-22T17:38:33.681541] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-22T17:38:34.104335] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-22T17:38:34.104445] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-22T17:38:34.105122] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-22T17:38:34.105191] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-22T17:38:34.106419] [DEBUG] [LOCAL ] BKV: Trimmed 44902 records to 29866 (keeping 200 days of data) [2025-09-22T17:38:34.159724] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-22T17:38:34.298331] [DEBUG] [LOCAL ] BKV: Primary data saved (29866 records). [2025-09-22T17:38:34.298517] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-22T17:38:34.299356] [INFO ] [MAIN ] Update Progress: 294/2372 symbols completed. BKV took 29.9s. Estimated remaining: 4h 32m 11s. Rate: 7.6 symbols/min [2025-09-22T17:38:34.479557] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:38:34.533755] [DEBUG] [LOCAL ] BLDR: Loaded 52400 existing records from primary storage. [2025-09-22T17:38:34.533918] [INFO ] [MAIN ] BLDR: Loaded 52400 existing records. [2025-09-22T17:38:34.712389] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:38:34.712632] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-22T17:38:34.712713] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-22T17:38:34.714227] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-22T17:38:34.714286] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-22T17:38:34.927329] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-22T17:38:35.075710] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:38:35.277235] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-22T17:38:35.285212] [INFO ] [REMOTE ] BKSY: Full fetch complete (69269 records). [2025-09-22T17:38:35.285327] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-22T17:38:35.583132] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T17:38:35.616201] [INFO ] [REMOTE ] BLCO: Full fetch complete (52577 records). [2025-09-22T17:38:35.626578] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-22T17:38:35.725197] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-22T17:38:35.826827] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-22T17:38:35.838181] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-22T17:38:35.839482] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-22T17:38:35.839985] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-22T17:38:35.904332] [DEBUG] [LOCAL ] BKSY: Trimmed 69269 records to 48277 (keeping 200 days of data) [2025-09-22T17:38:36.236843] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-22T17:38:36.239218] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-22T17:38:36.242709] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-22T17:38:36.243214] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-22T17:38:36.249681] [DEBUG] [LOCAL ] BLCO: Trimmed 52577 records to 35903 (keeping 200 days of data) [2025-09-22T17:38:36.336044] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T17:38:36.527824] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-22T17:38:36.687448] [DEBUG] [LOCAL ] BKSY: Primary data saved (48277 records). [2025-09-22T17:38:36.686222] [DEBUG] [LOCAL ] BLCO: Primary data saved (35903 records). [2025-09-22T17:38:36.687613] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-22T17:38:36.687914] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-22T17:38:36.687842] [INFO ] [MAIN ] Update Progress: 295/2372 symbols completed. BKSY took 45.8s. Estimated remaining: 4h 31m 24s. Rate: 7.7 symbols/min [2025-09-22T17:38:36.688339] [INFO ] [MAIN ] Update Progress: 296/2372 symbols completed. BLCO took 21.5s. Estimated remaining: 4h 30m 21s. Rate: 7.7 symbols/min [2025-09-22T17:38:37.030419] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:38:37.048127] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:38:37.065506] [DEBUG] [LOCAL ] BLE: Loaded 14973 existing records from primary storage. [2025-09-22T17:38:37.065673] [INFO ] [MAIN ] BLE: Loaded 14973 existing records. [2025-09-22T17:38:37.271625] [DEBUG] [LOCAL ] BLK: Loaded 35876 existing records from primary storage. [2025-09-22T17:38:37.275798] [INFO ] [MAIN ] BLK: Loaded 35876 existing records. [2025-09-22T17:38:37.275671] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:38:37.356920] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-22T17:38:37.357017] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-22T17:38:37.380759] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-22T17:38:37.380861] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-22T17:38:37.578681] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:38:37.590552] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-22T17:38:37.601419] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-22T17:38:37.649346] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-22T17:38:37.683516] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-22T17:38:38.076503] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:38:38.116741] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-22T17:38:38.129075] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T17:38:38.211439] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-22T17:38:38.274160] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-22T17:38:38.359895] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:38:38.922066] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-22T17:38:39.099685] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T17:38:39.397302] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T17:38:39.722103] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-22T17:38:40.401381] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T17:38:40.522049] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-22T17:38:40.734584] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T17:38:41.322101] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-22T17:38:41.347694] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T17:38:42.122082] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-22T17:38:42.705793] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T17:38:42.922138] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-22T17:38:43.425344] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T17:38:43.722059] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-22T17:38:44.353974] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T17:38:44.522119] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-22T17:38:45.266958] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T17:38:45.322068] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-22T17:38:45.918024] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T17:38:46.122066] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-22T17:38:46.922115] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-22T17:38:47.265070] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-22T17:38:47.639628] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-22T17:38:47.722047] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-22T17:38:48.043682] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-22T17:38:48.403837] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-22T17:38:48.522053] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-22T17:38:49.322070] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-22T17:38:50.122048] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-22T17:38:50.182044] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T17:38:50.404110] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T17:38:50.911634] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T17:38:50.921992] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-22T17:38:51.491903] [DEBUG] [REMOTE ] BLE: Error fetching primary data for 2025-06: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-09-22T17:38:51.492063] [WARN ] [REMOTE ] BLE: No data returned for month 2025-06 [2025-09-22T17:38:51.722054] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-22T17:38:52.522060] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-22T17:38:53.012778] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T17:38:53.322081] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-22T17:38:54.122069] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-22T17:38:54.362718] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T17:38:54.399733] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T17:38:54.670786] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-22T17:38:54.922061] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-22T17:38:55.722082] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-22T17:38:56.246628] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-22T17:38:56.439589] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T17:38:56.522090] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-22T17:38:57.322072] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-22T17:38:57.780529] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T17:38:58.122063] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-22T17:38:58.195237] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T17:38:58.197785] [INFO ] [REMOTE ] BLE: Full fetch complete (17821 records). [2025-09-22T17:38:58.197857] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-22T17:38:58.381621] [WARN ] [VALIDATOR ] BLE: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-22T17:38:58.381958] [FATAL] [MAIN ] BLE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:38:58.382030] [WARN ] [MAIN ] BLE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:38:58.382103] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-22T17:38:58.382167] [DEBUG] [LOCAL ] BLE: No primary data file found to delete. [2025-09-22T17:38:58.382202] [INFO ] [LOCAL ] BLE: Starting deletion of derivative data. [2025-09-22T17:38:58.382724] [DEBUG] [LOCAL ] BLE: Deleted derivative data file. [2025-09-22T17:38:58.382820] [INFO ] [MAIN ] Update Progress: 297/2372 symbols completed. BLE took 21.7s. Estimated remaining: 4h 31m 51s. Rate: 7.6 symbols/min [2025-09-22T17:38:58.550391] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:38:58.550557] [DEBUG] [LOCAL ] BLND: No existing data file found in primary storage. [2025-09-22T17:38:58.550594] [WARN ] [MAIN ] BLND: No existing data found, performing full refresh instead. [2025-09-22T17:38:58.550762] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-22T17:38:58.550809] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-22T17:38:58.550851] [DEBUG] [LOCAL ] BLND: No primary data file found to delete. [2025-09-22T17:38:58.550890] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-22T17:38:58.905276] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:38:58.922005] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-22T17:38:59.378738] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T17:38:59.383981] [INFO ] [REMOTE ] BLD: Full fetch complete (40420 records). [2025-09-22T17:38:59.384120] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-22T17:38:59.727384] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-22T17:38:59.830984] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-22T17:38:59.831100] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-22T17:38:59.831922] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-22T17:38:59.832003] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-22T17:38:59.833391] [DEBUG] [LOCAL ] BLD: Trimmed 40420 records to 28136 (keeping 200 days of data) [2025-09-22T17:39:00.040727] [DEBUG] [LOCAL ] BLD: Primary data saved (28136 records). [2025-09-22T17:39:00.040896] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-22T17:39:00.040991] [INFO ] [MAIN ] Update Progress: 298/2372 symbols completed. BLD took 40.3s. Estimated remaining: 4h 30m 59s. Rate: 7.7 symbols/min [2025-09-22T17:39:00.291781] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:39:00.292025] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-22T17:39:00.292073] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-22T17:39:00.292262] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-22T17:39:00.292317] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-22T17:39:00.292371] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-22T17:39:00.292416] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-22T17:39:00.527316] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-22T17:39:00.797435] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:39:00.834232] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T17:39:01.322077] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-22T17:39:01.715073] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T17:39:02.122176] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-22T17:39:02.719482] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:39:02.719851] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-22T17:39:02.922053] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-22T17:39:03.357730] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-22T17:39:03.722087] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-22T17:39:04.522115] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-22T17:39:04.746307] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:39:04.746665] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-22T17:39:05.322024] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-22T17:39:05.526063] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:39:05.526378] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-22T17:39:05.850978] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-22T17:39:06.122054] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-22T17:39:06.164842] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (4.04 seconds). [2025-09-22T17:39:06.305935] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T17:39:06.922053] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-22T17:39:07.722065] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-22T17:39:07.986631] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:39:07.987011] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-22T17:39:08.063637] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-22T17:39:08.071959] [INFO ] [REMOTE ] BLDR: Full fetch complete (74197 records). [2025-09-22T17:39:08.072131] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-22T17:39:08.480881] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-22T17:39:08.481065] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-22T17:39:08.482004] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-22T17:39:08.482182] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-22T17:39:08.483885] [DEBUG] [LOCAL ] BLDR: Trimmed 74197 records to 51653 (keeping 200 days of data) [2025-09-22T17:39:08.541118] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-22T17:39:08.605283] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T17:39:08.838758] [DEBUG] [LOCAL ] BLDR: Primary data saved (51653 records). [2025-09-22T17:39:08.838916] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-22T17:39:08.839591] [INFO ] [MAIN ] Update Progress: 299/2372 symbols completed. BLDR took 34.5s. Estimated remaining: 4h 30m 58s. Rate: 7.7 symbols/min [2025-09-22T17:39:09.009789] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:39:09.025993] [DEBUG] [LOCAL ] BLW: Loaded 13093 existing records from primary storage. [2025-09-22T17:39:09.026124] [INFO ] [MAIN ] BLW: Loaded 13093 existing records. [2025-09-22T17:39:09.203253] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:39:09.203511] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-22T17:39:09.203558] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-22T17:39:09.204072] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-22T17:39:09.204133] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-22T17:39:09.327151] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-22T17:39:09.576397] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:39:09.578755] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:39:09.579000] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-22T17:39:10.118245] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T17:39:10.127180] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-22T17:39:10.922055] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-22T17:39:11.559323] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T17:39:11.722054] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-22T17:39:12.387822] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T17:39:12.522004] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-22T17:39:13.160832] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T17:39:13.322055] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-22T17:39:13.918254] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T17:39:14.122058] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-22T17:39:14.308397] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T17:39:14.342694] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:39:14.342955] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-22T17:39:14.922059] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-22T17:39:15.722066] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-22T17:39:15.830832] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T17:39:16.522073] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-22T17:39:17.322068] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-22T17:39:17.544623] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T17:39:17.563783] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:39:17.564051] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-22T17:39:17.845536] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-22T17:39:17.850856] [INFO ] [REMOTE ] BLK: Full fetch complete (53133 records). [2025-09-22T17:39:17.850987] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-22T17:39:18.127172] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-22T17:39:18.243299] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-22T17:39:18.243382] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-22T17:39:18.244066] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-22T17:39:18.244131] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-22T17:39:18.245331] [DEBUG] [LOCAL ] BLK: Trimmed 53133 records to 35027 (keeping 200 days of data) [2025-09-22T17:39:18.477729] [DEBUG] [LOCAL ] BLK: Primary data saved (35027 records). [2025-09-22T17:39:18.477890] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-22T17:39:18.478000] [INFO ] [MAIN ] Update Progress: 300/2372 symbols completed. BLK took 41.8s. Estimated remaining: 4h 31m 3s. Rate: 7.6 symbols/min [2025-09-22T17:39:18.663211] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:39:18.683979] [DEBUG] [LOCAL ] BLX: Loaded 16264 existing records from primary storage. [2025-09-22T17:39:18.684180] [INFO ] [MAIN ] BLX: Loaded 16264 existing records. [2025-09-22T17:39:18.879369] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:39:18.879888] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-22T17:39:18.879966] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-22T17:39:18.880943] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-22T17:39:18.881007] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-22T17:39:18.927340] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-22T17:39:19.189078] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:39:19.190205] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T17:39:19.198561] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-22T17:39:19.306612] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:39:19.722064] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-22T17:39:20.522096] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-22T17:39:21.322074] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-22T17:39:21.615793] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T17:39:22.039314] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T17:39:22.122064] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-22T17:39:22.557203] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T17:39:22.922091] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-22T17:39:23.165385] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T17:39:23.722077] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-22T17:39:24.348136] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T17:39:24.522080] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-22T17:39:25.322075] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-22T17:39:25.560055] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T17:39:26.114491] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-22T17:39:26.122122] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-22T17:39:26.123440] [INFO ] [REMOTE ] BLSH: Full fetch complete (10662 records). [2025-09-22T17:39:26.123511] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-22T17:39:26.333676] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 28 unique days, need 200 days [2025-09-22T17:39:26.334101] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:39:26.334187] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:39:26.334262] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-22T17:39:26.334335] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-22T17:39:26.334373] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-22T17:39:26.334430] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-22T17:39:26.334518] [INFO ] [MAIN ] Update Progress: 301/2372 symbols completed. BLSH took 26.3s. Estimated remaining: 4h 30m 55s. Rate: 7.6 symbols/min [2025-09-22T17:39:26.516455] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:39:26.555172] [DEBUG] [LOCAL ] BMA: Loaded 35145 existing records from primary storage. [2025-09-22T17:39:26.555312] [INFO ] [MAIN ] BMA: Loaded 35145 existing records. [2025-09-22T17:39:26.752361] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:39:26.752956] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-22T17:39:26.753102] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-22T17:39:26.763889] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-22T17:39:26.778095] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-22T17:39:26.829352] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T17:39:26.927175] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-22T17:39:27.164626] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-22T17:39:27.185004] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:39:27.722061] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-22T17:39:28.440368] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T17:39:28.448834] [INFO ] [REMOTE ] BLND: Full fetch complete (72326 records). [2025-09-22T17:39:28.448932] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-22T17:39:28.527213] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-22T17:39:28.848588] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-22T17:39:28.848781] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-22T17:39:28.849620] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-22T17:39:28.849817] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-22T17:39:28.851625] [DEBUG] [LOCAL ] BLND: Trimmed 72326 records to 49488 (keeping 200 days of data) [2025-09-22T17:39:28.957030] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T17:39:29.163268] [DEBUG] [LOCAL ] BLND: Primary data saved (49488 records). [2025-09-22T17:39:29.163409] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-22T17:39:29.163489] [INFO ] [MAIN ] Update Progress: 302/2372 symbols completed. BLND took 30.8s. Estimated remaining: 4h 30m 13s. Rate: 7.7 symbols/min [2025-09-22T17:39:29.335748] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-22T17:39:29.342582] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:39:29.361762] [DEBUG] [LOCAL ] BME: Loaded 11052 existing records from primary storage. [2025-09-22T17:39:29.362013] [INFO ] [MAIN ] BME: Loaded 11052 existing records. [2025-09-22T17:39:29.555393] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:39:29.555641] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-22T17:39:29.555730] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-22T17:39:29.556260] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-22T17:39:29.556320] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-22T17:39:29.803718] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T17:39:29.960690] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:39:30.122085] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-22T17:39:30.250956] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T17:39:30.810324] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-22T17:39:30.922021] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-22T17:39:31.722025] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-22T17:39:31.732013] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T17:39:32.522063] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-22T17:39:33.322050] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-22T17:39:33.352203] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T17:39:33.407891] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T17:39:34.122069] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-22T17:39:34.181681] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T17:39:34.922065] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-22T17:39:34.980524] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T17:39:35.722071] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-22T17:39:36.267101] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T17:39:36.342819] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T17:39:36.522070] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-22T17:39:37.322078] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-22T17:39:37.349608] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T17:39:37.352438] [INFO ] [REMOTE ] BLW: Full fetch complete (18814 records). [2025-09-22T17:39:37.352522] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-22T17:39:37.720893] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-22T17:39:37.720970] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-22T17:39:37.721323] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-22T17:39:37.721361] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-22T17:39:37.721934] [DEBUG] [LOCAL ] BLW: Trimmed 18814 records to 12732 (keeping 200 days of data) [2025-09-22T17:39:37.804703] [DEBUG] [LOCAL ] BLW: Primary data saved (12732 records). [2025-09-22T17:39:37.804884] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-22T17:39:37.805042] [INFO ] [MAIN ] Update Progress: 303/2372 symbols completed. BLW took 29.0s. Estimated remaining: 4h 30m 10s. Rate: 7.7 symbols/min [2025-09-22T17:39:37.974132] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:39:38.002129] [DEBUG] [LOCAL ] BMEZ: Loaded 26566 existing records from primary storage. [2025-09-22T17:39:38.002278] [INFO ] [MAIN ] BMEZ: Loaded 26566 existing records. [2025-09-22T17:39:38.127271] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-22T17:39:38.185475] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:39:38.185731] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-22T17:39:38.185788] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-22T17:39:38.186758] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-22T17:39:38.186819] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-22T17:39:38.540517] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:39:38.551542] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T17:39:38.922075] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-22T17:39:38.976787] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T17:39:39.672452] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T17:39:39.722046] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-22T17:39:40.389849] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-22T17:39:40.522125] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-22T17:39:41.322076] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-22T17:39:42.015262] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T17:39:42.122066] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-22T17:39:42.358417] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T17:39:42.922294] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-22T17:39:43.619845] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T17:39:43.652398] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T17:39:43.722006] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-22T17:39:44.522066] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-22T17:39:45.057983] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-22T17:39:45.092781] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T17:39:45.322051] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-22T17:39:46.071816] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T17:39:46.122062] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-22T17:39:46.693341] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T17:39:46.922069] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-22T17:39:47.542088] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T17:39:47.722088] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-22T17:39:48.522062] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-22T17:39:48.555321] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T17:39:48.558167] [INFO ] [REMOTE ] BLX: Full fetch complete (22748 records). [2025-09-22T17:39:48.558264] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-22T17:39:48.962844] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-22T17:39:48.962987] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-22T17:39:48.963464] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-22T17:39:48.963572] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-22T17:39:48.964325] [DEBUG] [LOCAL ] BLX: Trimmed 22748 records to 15777 (keeping 200 days of data) [2025-09-22T17:39:49.069976] [DEBUG] [LOCAL ] BLX: Primary data saved (15777 records). [2025-09-22T17:39:49.070143] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-22T17:39:49.070329] [INFO ] [MAIN ] Update Progress: 304/2372 symbols completed. BLX took 30.6s. Estimated remaining: 4h 30m 26s. Rate: 7.6 symbols/min [2025-09-22T17:39:49.254582] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:39:49.254854] [DEBUG] [LOCAL ] BMI: No existing data file found in primary storage. [2025-09-22T17:39:49.254912] [WARN ] [MAIN ] BMI: No existing data found, performing full refresh instead. [2025-09-22T17:39:49.255177] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-22T17:39:49.255236] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-22T17:39:49.255281] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-09-22T17:39:49.255324] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-22T17:39:49.326351] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-22T17:39:49.351512] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T17:39:49.635470] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:39:50.122057] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-22T17:39:50.454200] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T17:39:50.922100] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-22T17:39:50.980986] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T17:39:51.722106] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-22T17:39:52.334255] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T17:39:52.522104] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-22T17:39:52.562852] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T17:39:53.322081] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-22T17:39:53.422131] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T17:39:54.122103] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-22T17:39:54.373426] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T17:39:54.922059] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-22T17:39:55.093909] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T17:39:55.096390] [INFO ] [REMOTE ] BME: Full fetch complete (16133 records). [2025-09-22T17:39:55.096467] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-22T17:39:55.460621] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-22T17:39:55.460732] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-22T17:39:55.461063] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-22T17:39:55.461104] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-22T17:39:55.461611] [DEBUG] [LOCAL ] BME: Trimmed 16133 records to 10829 (keeping 200 days of data) [2025-09-22T17:39:55.534662] [DEBUG] [LOCAL ] BME: Primary data saved (10829 records). [2025-09-22T17:39:55.534844] [INFO ] [MAIN ] BME: Full history saved. [2025-09-22T17:39:55.534980] [INFO ] [MAIN ] Update Progress: 305/2372 symbols completed. BME took 26.4s. Estimated remaining: 4h 30m 9s. Rate: 7.7 symbols/min [2025-09-22T17:39:55.703488] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:39:55.710384] [DEBUG] [LOCAL ] BMN: Loaded 2604 existing records from primary storage. [2025-09-22T17:39:55.710479] [INFO ] [MAIN ] BMN: Loaded 2604 existing records. [2025-09-22T17:39:55.731025] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-22T17:39:55.905672] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:39:55.905971] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-22T17:39:55.906166] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-22T17:39:55.906523] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-22T17:39:55.906630] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-22T17:39:56.260666] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T17:39:56.304132] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:39:56.522061] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-22T17:39:56.976429] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-22T17:39:57.004117] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T17:39:57.322075] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-22T17:39:58.002039] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T17:39:58.122053] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-22T17:39:58.503793] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-22T17:39:58.922084] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-22T17:39:59.642515] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T17:39:59.722070] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-22T17:40:00.522106] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-22T17:40:00.841269] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-22T17:40:00.871535] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T17:40:01.322100] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-22T17:40:01.898043] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-22T17:40:02.122081] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-22T17:40:02.922082] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-22T17:40:03.298834] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-22T17:40:03.411884] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T17:40:03.722088] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-22T17:40:04.522105] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-22T17:40:05.131505] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T17:40:05.322067] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-22T17:40:05.623514] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T17:40:06.122114] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-22T17:40:06.493782] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T17:40:06.922075] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-22T17:40:07.509005] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T17:40:07.516893] [INFO ] [REMOTE ] BMA: Full fetch complete (50923 records). [2025-09-22T17:40:07.517015] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-22T17:40:07.727162] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-22T17:40:07.955943] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-22T17:40:07.956168] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-22T17:40:07.957004] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-22T17:40:07.957134] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-22T17:40:07.981764] [DEBUG] [LOCAL ] BMA: Trimmed 50923 records to 34783 (keeping 200 days of data) [2025-09-22T17:40:07.981477] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T17:40:08.224091] [DEBUG] [LOCAL ] BMA: Primary data saved (34783 records). [2025-09-22T17:40:08.224282] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-22T17:40:08.224477] [INFO ] [MAIN ] Update Progress: 306/2372 symbols completed. BMA took 41.9s. Estimated remaining: 4h 30m 34s. Rate: 7.6 symbols/min [2025-09-22T17:40:08.398238] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:40:08.451513] [DEBUG] [LOCAL ] BMO: Loaded 42068 existing records from primary storage. [2025-09-22T17:40:08.451691] [INFO ] [MAIN ] BMO: Loaded 42068 existing records. [2025-09-22T17:40:08.527359] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-22T17:40:08.634606] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:40:08.634939] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-22T17:40:08.634997] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-22T17:40:08.636310] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-22T17:40:08.636386] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-22T17:40:09.012353] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:40:09.074828] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T17:40:09.322104] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-22T17:40:09.433048] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-22T17:40:10.122153] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-22T17:40:10.403927] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T17:40:10.516267] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-22T17:40:10.922061] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-22T17:40:11.375457] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-22T17:40:11.722068] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-22T17:40:12.522083] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-22T17:40:13.097728] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T17:40:13.203144] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T17:40:13.322100] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-22T17:40:13.795758] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-22T17:40:14.122083] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-22T17:40:14.922095] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-22T17:40:14.952582] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T17:40:14.953695] [INFO ] [REMOTE ] BMN: Full fetch complete (3716 records). [2025-09-22T17:40:14.953766] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-22T17:40:15.345476] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-22T17:40:15.345676] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-22T17:40:15.345832] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-22T17:40:15.345874] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-22T17:40:15.346296] [DEBUG] [LOCAL ] BMN: Trimmed 3716 records to 2561 (keeping 200 days of data) [2025-09-22T17:40:15.363887] [DEBUG] [LOCAL ] BMN: Primary data saved (2561 records). [2025-09-22T17:40:15.363976] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-22T17:40:15.364095] [INFO ] [MAIN ] Update Progress: 307/2372 symbols completed. BMN took 19.8s. Estimated remaining: 4h 30m 21s. Rate: 7.6 symbols/min [2025-09-22T17:40:15.554435] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:40:15.629419] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-22T17:40:15.629623] [INFO ] [MAIN ] BMY: Loaded 54537 existing records. [2025-09-22T17:40:15.727157] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-22T17:40:15.819966] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:40:15.820232] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-22T17:40:15.820281] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-22T17:40:15.821640] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-22T17:40:15.821731] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-22T17:40:16.183270] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:40:16.522088] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-22T17:40:17.322093] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-22T17:40:17.377868] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T17:40:17.847891] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (2.93 seconds). [2025-09-22T17:40:17.875850] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T17:40:18.122065] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-22T17:40:18.922102] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-22T17:40:19.077195] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T17:40:19.673441] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T17:40:19.722081] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-22T17:40:20.084552] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T17:40:20.522121] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-22T17:40:20.602865] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T17:40:20.607329] [INFO ] [REMOTE ] BMEZ: Full fetch complete (41037 records). [2025-09-22T17:40:20.607437] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-22T17:40:20.992954] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-22T17:40:20.993043] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-22T17:40:20.993557] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-22T17:40:20.993602] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-22T17:40:20.994796] [DEBUG] [LOCAL ] BMEZ: Trimmed 41037 records to 26103 (keeping 200 days of data) [2025-09-22T17:40:21.183166] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26103 records). [2025-09-22T17:40:21.183572] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-22T17:40:21.183714] [INFO ] [MAIN ] Update Progress: 308/2372 symbols completed. BMEZ took 43.4s. Estimated remaining: 4h 29m 59s. Rate: 7.6 symbols/min [2025-09-22T17:40:21.323778] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-22T17:40:21.356026] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:40:21.417460] [DEBUG] [LOCAL ] BN: Loaded 53777 existing records from primary storage. [2025-09-22T17:40:21.417608] [INFO ] [MAIN ] BN: Loaded 53777 existing records. [2025-09-22T17:40:21.602314] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:40:21.602592] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-22T17:40:21.602668] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-22T17:40:21.605058] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-22T17:40:21.605127] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-22T17:40:22.007309] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:40:22.032598] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T17:40:22.122034] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-22T17:40:22.922075] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-22T17:40:23.302008] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-22T17:40:23.722055] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-22T17:40:23.821778] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T17:40:24.016475] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T17:40:24.021775] [INFO ] [REMOTE ] BMI: Full fetch complete (32604 records). [2025-09-22T17:40:24.021890] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-22T17:40:24.399041] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-22T17:40:24.399135] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-22T17:40:24.399632] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-22T17:40:24.399747] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-22T17:40:24.400604] [DEBUG] [LOCAL ] BMI: Trimmed 32604 records to 24070 (keeping 200 days of data) [2025-09-22T17:40:24.522218] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-22T17:40:24.575375] [DEBUG] [LOCAL ] BMI: Primary data saved (24070 records). [2025-09-22T17:40:24.575599] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-22T17:40:24.575733] [INFO ] [MAIN ] Update Progress: 309/2372 symbols completed. BMI took 35.5s. Estimated remaining: 4h 29m 22s. Rate: 7.7 symbols/min [2025-09-22T17:40:24.753211] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:40:24.789094] [DEBUG] [LOCAL ] BNED: Loaded 30481 existing records from primary storage. [2025-09-22T17:40:24.789276] [INFO ] [MAIN ] BNED: Loaded 30481 existing records. [2025-09-22T17:40:24.966381] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:40:24.966683] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-22T17:40:24.966741] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-22T17:40:24.967495] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-22T17:40:24.967554] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-22T17:40:25.322796] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-22T17:40:25.327599] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:40:25.389866] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T17:40:26.122045] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-22T17:40:26.447787] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-22T17:40:26.737355] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T17:40:26.922055] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-22T17:40:27.722067] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-22T17:40:27.885720] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T17:40:28.010154] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T17:40:28.522064] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-22T17:40:28.885571] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T17:40:29.322064] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-22T17:40:30.034315] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T17:40:30.122023] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-22T17:40:30.702515] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T17:40:30.922024] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-22T17:40:31.340819] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T17:40:31.722058] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-22T17:40:32.270318] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T17:40:32.522088] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-22T17:40:33.014489] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T17:40:33.021281] [INFO ] [REMOTE ] BMO: Full fetch complete (59943 records). [2025-09-22T17:40:33.021419] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-22T17:40:33.327224] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-22T17:40:33.454634] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-22T17:40:33.454748] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-22T17:40:33.455446] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-22T17:40:33.455510] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-22T17:40:33.456739] [DEBUG] [LOCAL ] BMO: Trimmed 59943 records to 41319 (keeping 200 days of data) [2025-09-22T17:40:33.716218] [DEBUG] [LOCAL ] BMO: Primary data saved (41319 records). [2025-09-22T17:40:33.716370] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-22T17:40:33.716478] [INFO ] [MAIN ] Update Progress: 310/2372 symbols completed. BMO took 25.5s. Estimated remaining: 4h 29m 23s. Rate: 7.7 symbols/min [2025-09-22T17:40:33.892194] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:40:33.898828] [DEBUG] [LOCAL ] BNH: Loaded 4881 existing records from primary storage. [2025-09-22T17:40:33.898919] [INFO ] [MAIN ] BNH: Loaded 4881 existing records. [2025-09-22T17:40:34.082904] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:40:34.083136] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-22T17:40:34.083196] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-22T17:40:34.083493] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-22T17:40:34.083552] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-22T17:40:34.138270] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-22T17:40:34.462338] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:40:34.478995] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T17:40:34.621821] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-22T17:40:34.922127] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-22T17:40:35.667194] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-22T17:40:35.722070] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-22T17:40:36.018605] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T17:40:36.122108] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-22T17:40:36.522071] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-22T17:40:37.322086] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-22T17:40:37.923686] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-22T17:40:38.122088] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-22T17:40:38.356124] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T17:40:38.710475] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T17:40:38.922061] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-22T17:40:39.722119] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-22T17:40:40.522098] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-22T17:40:40.620794] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T17:40:41.222915] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T17:40:41.281950] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T17:40:41.322066] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-22T17:40:42.122060] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-22T17:40:42.507253] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-22T17:40:42.922132] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-22T17:40:43.301638] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-22T17:40:43.722098] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-22T17:40:44.308626] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T17:40:44.346001] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-22T17:40:44.522099] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-22T17:40:45.322075] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-22T17:40:46.012381] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T17:40:46.122049] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-22T17:40:46.922088] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-22T17:40:47.369388] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T17:40:47.445318] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T17:40:47.722212] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-22T17:40:48.314460] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T17:40:48.522072] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-22T17:40:49.048079] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T17:40:49.322057] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-22T17:40:49.748708] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T17:40:50.122026] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-22T17:40:50.149858] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T17:40:50.922147] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-22T17:40:51.581869] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T17:40:51.722061] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-22T17:40:51.949521] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T17:40:52.522091] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-22T17:40:53.322064] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-22T17:40:53.568126] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T17:40:53.756209] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T17:40:53.932741] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T17:40:53.941925] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-22T17:40:53.942121] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-22T17:40:54.129268] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-22T17:40:54.360741] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-22T17:40:54.360853] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-22T17:40:54.361718] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-22T17:40:54.361784] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-22T17:40:54.365837] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-09-22T17:40:54.718208] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-22T17:40:54.718410] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-22T17:40:54.718515] [INFO ] [MAIN ] Update Progress: 311/2372 symbols completed. BMY took 39.4s. Estimated remaining: 4h 30m 42s. Rate: 7.6 symbols/min [2025-09-22T17:40:54.919613] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:40:54.922119] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-22T17:40:54.926063] [DEBUG] [LOCAL ] BNJ: Loaded 2658 existing records from primary storage. [2025-09-22T17:40:54.926275] [INFO ] [MAIN ] BNJ: Loaded 2658 existing records. [2025-09-22T17:40:55.134565] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:40:55.134921] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-22T17:40:55.134978] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-22T17:40:55.135351] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-22T17:40:55.135411] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-22T17:40:55.490280] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:40:55.722061] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-22T17:40:55.765627] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T17:40:55.774540] [INFO ] [REMOTE ] BN: Full fetch complete (76616 records). [2025-09-22T17:40:55.774757] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-22T17:40:56.208740] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-22T17:40:56.208856] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-22T17:40:56.209681] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-22T17:40:56.209765] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-22T17:40:56.227677] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T17:40:56.234638] [DEBUG] [LOCAL ] BN: Trimmed 76616 records to 52995 (keeping 200 days of data) [2025-09-22T17:40:56.340927] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-22T17:40:56.541939] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-22T17:40:56.594749] [DEBUG] [LOCAL ] BN: Primary data saved (52995 records). [2025-09-22T17:40:56.594937] [INFO ] [MAIN ] BN: Full history saved. [2025-09-22T17:40:56.596125] [INFO ] [MAIN ] Update Progress: 312/2372 symbols completed. BN took 35.4s. Estimated remaining: 4h 29m 55s. Rate: 7.6 symbols/min [2025-09-22T17:40:56.774074] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:40:56.822159] [DEBUG] [LOCAL ] BNL: Loaded 47607 existing records from primary storage. [2025-09-22T17:40:56.822331] [INFO ] [MAIN ] BNL: Loaded 47607 existing records. [2025-09-22T17:40:57.007133] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:40:57.007441] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-22T17:40:57.007501] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-22T17:40:57.008802] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-22T17:40:57.008867] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-22T17:40:57.119379] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T17:40:57.327128] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-22T17:40:57.389039] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:40:57.707234] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-22T17:40:58.122063] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-22T17:40:58.922083] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-22T17:40:59.340701] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T17:40:59.722080] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-22T17:40:59.780494] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T17:41:00.522068] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-22T17:41:01.108076] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T17:41:01.112584] [INFO ] [REMOTE ] BNED: Full fetch complete (44380 records). [2025-09-22T17:41:01.112768] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-22T17:41:01.331951] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-22T17:41:01.494191] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-22T17:41:01.494267] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-22T17:41:01.494852] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-22T17:41:01.494915] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-22T17:41:01.495895] [DEBUG] [LOCAL ] BNED: Trimmed 44380 records to 30016 (keeping 200 days of data) [2025-09-22T17:41:01.673210] [DEBUG] [LOCAL ] BNED: Primary data saved (30016 records). [2025-09-22T17:41:01.673342] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-22T17:41:01.673427] [INFO ] [MAIN ] Update Progress: 313/2372 symbols completed. BNED took 37.1s. Estimated remaining: 4h 29m 28s. Rate: 7.6 symbols/min [2025-09-22T17:41:01.854941] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:41:01.916120] [DEBUG] [LOCAL ] BNS: Loaded 52257 existing records from primary storage. [2025-09-22T17:41:01.916286] [INFO ] [MAIN ] BNS: Loaded 52257 existing records. [2025-09-22T17:41:02.110046] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:41:02.110361] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-22T17:41:02.110606] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-22T17:41:02.120110] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-22T17:41:02.125438] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-22T17:41:02.135163] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-22T17:41:02.202127] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T17:41:02.442440] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T17:41:02.460495] [INFO ] [REMOTE ] BNH: Full fetch complete (6809 records). [2025-09-22T17:41:02.470915] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-22T17:41:02.578322] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:41:02.642452] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T17:41:02.926675] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-22T17:41:02.926944] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-22T17:41:02.927432] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-22T17:41:02.928449] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-22T17:41:02.928504] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-22T17:41:02.929009] [DEBUG] [LOCAL ] BNH: Trimmed 6809 records to 4822 (keeping 200 days of data) [2025-09-22T17:41:02.961947] [DEBUG] [LOCAL ] BNH: Primary data saved (4822 records). [2025-09-22T17:41:02.962154] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-22T17:41:02.962270] [INFO ] [MAIN ] Update Progress: 314/2372 symbols completed. BNH took 29.2s. Estimated remaining: 4h 28m 38s. Rate: 7.7 symbols/min [2025-09-22T17:41:03.139319] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:41:03.145110] [DEBUG] [LOCAL ] BNT: Loaded 3487 existing records from primary storage. [2025-09-22T17:41:03.145229] [INFO ] [MAIN ] BNT: Loaded 3487 existing records. [2025-09-22T17:41:03.326512] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:41:03.326820] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-22T17:41:03.326894] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-22T17:41:03.327243] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-22T17:41:03.327303] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-22T17:41:03.697129] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:41:03.722024] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-22T17:41:04.208870] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-22T17:41:04.484794] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T17:41:04.522016] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-22T17:41:04.932036] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-22T17:41:05.322051] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-22T17:41:06.122129] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-22T17:41:06.541103] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-22T17:41:06.816948] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T17:41:06.922062] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-22T17:41:07.722076] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-22T17:41:08.257096] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-22T17:41:08.258940] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T17:41:08.522093] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-22T17:41:08.957271] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T17:41:09.322076] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-22T17:41:10.122064] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-22T17:41:10.774193] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T17:41:10.922096] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-22T17:41:11.722090] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-22T17:41:11.846830] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T17:41:11.847410] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T17:41:12.110736] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-22T17:41:12.522061] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-22T17:41:13.322068] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-22T17:41:13.711193] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-22T17:41:14.052002] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:41:14.122089] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-22T17:41:14.922059] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-22T17:41:15.382893] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-22T17:41:15.722114] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-22T17:41:15.842755] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T17:41:16.522087] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-22T17:41:17.210056] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T17:41:17.211724] [INFO ] [REMOTE ] BNJ: Full fetch complete (4436 records). [2025-09-22T17:41:17.211823] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-22T17:41:17.327263] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-22T17:41:17.620667] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-22T17:41:17.620892] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-22T17:41:17.621110] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-22T17:41:17.621227] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-22T17:41:17.621849] [DEBUG] [LOCAL ] BNJ: Trimmed 4436 records to 2577 (keeping 200 days of data) [2025-09-22T17:41:17.638772] [DEBUG] [LOCAL ] BNJ: Primary data saved (2577 records). [2025-09-22T17:41:17.638986] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-22T17:41:17.639084] [INFO ] [MAIN ] Update Progress: 315/2372 symbols completed. BNJ took 22.9s. Estimated remaining: 4h 29m 14s. Rate: 7.6 symbols/min [2025-09-22T17:41:17.763939] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-22T17:41:17.857892] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:41:17.868328] [DEBUG] [LOCAL ] BNY: Loaded 7500 existing records from primary storage. [2025-09-22T17:41:17.868471] [INFO ] [MAIN ] BNY: Loaded 7500 existing records. [2025-09-22T17:41:18.038159] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-22T17:41:18.070930] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:41:18.071177] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-22T17:41:18.071266] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-22T17:41:18.071701] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-22T17:41:18.071761] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-22T17:41:18.127236] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-22T17:41:18.441668] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:41:18.922109] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-22T17:41:19.280091] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-22T17:41:19.722086] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-22T17:41:19.954679] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T17:41:20.489621] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T17:41:20.522055] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-22T17:41:21.322066] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-22T17:41:21.771351] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T17:41:22.115322] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T17:41:22.125619] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-22T17:41:22.472914] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-22T17:41:22.922065] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-22T17:41:23.722066] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-22T17:41:24.230661] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T17:41:24.522084] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-22T17:41:24.922744] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-22T17:41:25.322034] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-22T17:41:25.446889] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T17:41:25.706134] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-22T17:41:26.122110] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-22T17:41:26.792066] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T17:41:26.922089] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-22T17:41:27.722056] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-22T17:41:27.741957] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T17:41:28.316189] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-22T17:41:28.318531] [INFO ] [REMOTE ] BNT: Full fetch complete (4412 records). [2025-09-22T17:41:28.318622] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-22T17:41:28.533308] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-22T17:41:28.745379] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-22T17:41:28.745491] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-22T17:41:28.745774] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-22T17:41:28.745845] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-22T17:41:28.746239] [DEBUG] [LOCAL ] BNT: Trimmed 4412 records to 3407 (keeping 200 days of data) [2025-09-22T17:41:28.768245] [DEBUG] [LOCAL ] BNT: Primary data saved (3407 records). [2025-09-22T17:41:28.768342] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-22T17:41:28.768434] [INFO ] [MAIN ] Update Progress: 316/2372 symbols completed. BNT took 25.8s. Estimated remaining: 4h 29m 28s. Rate: 7.6 symbols/min [2025-09-22T17:41:28.954863] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:41:28.975227] [DEBUG] [LOCAL ] BOC: Loaded 18648 existing records from primary storage. [2025-09-22T17:41:28.975358] [INFO ] [MAIN ] BOC: Loaded 18648 existing records. [2025-09-22T17:41:29.161866] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:41:29.162163] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-22T17:41:29.162219] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-22T17:41:29.162784] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-22T17:41:29.162849] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-22T17:41:29.327866] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-22T17:41:29.551982] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:41:29.826899] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-22T17:41:30.058794] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T17:41:30.122080] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-22T17:41:30.922072] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-22T17:41:30.965815] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T17:41:31.722065] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-22T17:41:32.375394] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T17:41:32.395717] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-22T17:41:32.522045] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-22T17:41:33.322070] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-22T17:41:33.989114] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T17:41:33.996451] [INFO ] [REMOTE ] BNL: Full fetch complete (66588 records). [2025-09-22T17:41:33.996585] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-22T17:41:34.128253] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-22T17:41:34.432526] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-22T17:41:34.432740] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-22T17:41:34.433873] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-22T17:41:34.433980] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-22T17:41:34.444151] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T17:41:34.448876] [DEBUG] [LOCAL ] BNL: Trimmed 66588 records to 46906 (keeping 200 days of data) [2025-09-22T17:41:34.749005] [DEBUG] [LOCAL ] BNL: Primary data saved (46906 records). [2025-09-22T17:41:34.749147] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-22T17:41:34.749848] [INFO ] [MAIN ] Update Progress: 317/2372 symbols completed. BNL took 38.2s. Estimated remaining: 4h 29m 8s. Rate: 7.6 symbols/min [2025-09-22T17:41:34.922115] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-22T17:41:35.722110] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-22T17:41:35.870754] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T17:41:36.389599] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-22T17:41:36.522043] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-22T17:41:36.735326] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T17:41:37.322077] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-22T17:41:38.122119] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-22T17:41:38.350380] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T17:41:38.379562] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T17:41:38.762003] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T17:41:38.922116] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-22T17:41:39.410183] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-22T17:41:39.722055] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-22T17:41:40.522159] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-22T17:41:40.695869] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T17:41:41.322075] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-22T17:41:42.032466] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T17:41:42.122054] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-22T17:41:42.563164] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-22T17:41:42.577153] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-22T17:41:42.580033] [INFO ] [REMOTE ] BNS: Full fetch complete (74209 records). [2025-09-22T17:41:42.580143] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-22T17:41:42.932486] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-22T17:41:42.993838] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-22T17:41:42.993930] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-22T17:41:42.994778] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-22T17:41:42.994881] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-22T17:41:42.996438] [DEBUG] [LOCAL ] BNS: Trimmed 74209 records to 51466 (keeping 200 days of data) [2025-09-22T17:41:43.315635] [DEBUG] [LOCAL ] BNS: Primary data saved (51466 records). [2025-09-22T17:41:43.315848] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-22T17:41:43.315983] [INFO ] [MAIN ] Update Progress: 318/2372 symbols completed. BNS took 41.6s. Estimated remaining: 4h 29m 5s. Rate: 7.6 symbols/min [2025-09-22T17:41:43.722113] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-22T17:41:44.727116] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T17:41:44.731789] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-22T17:41:45.503525] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T17:41:45.508917] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-22T17:41:46.914948] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T17:41:46.918184] [INFO ] [REMOTE ] BOC: Full fetch complete (25821 records). [2025-09-22T17:41:46.918263] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-22T17:41:47.304270] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-22T17:41:47.304373] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-22T17:41:47.304966] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-22T17:41:47.305051] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-22T17:41:47.305991] [DEBUG] [LOCAL ] BOC: Trimmed 25821 records to 18367 (keeping 200 days of data) [2025-09-22T17:41:47.416438] [DEBUG] [LOCAL ] BOC: Primary data saved (18367 records). [2025-09-22T17:41:47.416583] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-22T17:41:47.416694] [INFO ] [MAIN ] Update Progress: 319/2372 symbols completed. BOC took 18.6s. Estimated remaining: 4h 28m 33s. Rate: 7.6 symbols/min [2025-09-22T17:41:47.450289] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (4.52 seconds). [2025-09-22T17:41:47.452974] [INFO ] [REMOTE ] BNY: Full fetch complete (10568 records). [2025-09-22T17:41:47.453123] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-22T17:41:47.827348] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-22T17:41:47.827426] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-22T17:41:47.827693] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-22T17:41:47.827753] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-22T17:41:47.828191] [DEBUG] [LOCAL ] BNY: Trimmed 10568 records to 7446 (keeping 200 days of data) [2025-09-22T17:41:47.872364] [DEBUG] [LOCAL ] BNY: Primary data saved (7446 records). [2025-09-22T17:41:47.872466] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-22T17:41:47.872544] [INFO ] [MAIN ] Update Progress: 320/2372 symbols completed. BNY took 30.2s. Estimated remaining: 4h 27m 37s. Rate: 7.7 symbols/min [2025-09-22T17:41:48.521586] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:41:48.590327] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:41:48.630739] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:41:48.629607] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:41:48.675177] [DEBUG] [LOCAL ] BOE: Loaded 17919 existing records from primary storage. [2025-09-22T17:41:48.692675] [INFO ] [MAIN ] BOE: Loaded 17919 existing records. [2025-09-22T17:41:48.817357] [DEBUG] [LOCAL ] BOH: Loaded 32007 existing records from primary storage. [2025-09-22T17:41:48.833990] [DEBUG] [LOCAL ] BOOT: Loaded 41895 existing records from primary storage. [2025-09-22T17:41:48.833086] [INFO ] [MAIN ] BOH: Loaded 32007 existing records. [2025-09-22T17:41:48.863001] [INFO ] [MAIN ] BOOT: Loaded 41895 existing records. [2025-09-22T17:41:48.832938] [DEBUG] [LOCAL ] BOND: Loaded 32694 existing records from primary storage. [2025-09-22T17:41:48.878610] [INFO ] [MAIN ] BOND: Loaded 32694 existing records. [2025-09-22T17:41:49.121158] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:41:49.160374] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-22T17:41:49.279049] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-22T17:41:49.300257] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-22T17:41:49.369412] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-22T17:41:49.488710] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:41:49.567160] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:41:49.575421] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:41:49.594005] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-22T17:41:49.599504] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-22T17:41:49.599596] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-22T17:41:49.599714] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-22T17:41:49.636528] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-22T17:41:49.636671] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-22T17:41:49.642741] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-22T17:41:49.642692] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-22T17:41:49.653171] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-22T17:41:49.642606] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-22T17:41:49.687671] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-22T17:41:49.764829] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-22T17:41:50.710571] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:41:50.739116] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-22T17:41:50.878572] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:41:50.907634] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-22T17:41:50.963374] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:41:50.985520] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-22T17:41:51.016224] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:41:51.017123] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-22T17:41:51.720277] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T17:41:51.725468] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-22T17:41:52.101636] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T17:41:52.107409] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-22T17:41:52.434728] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-22T17:41:52.441474] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-22T17:41:52.750192] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T17:41:52.758066] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-22T17:41:52.999575] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T17:41:53.004172] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-22T17:41:53.596015] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T17:41:53.603413] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-22T17:41:53.740293] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T17:41:53.866942] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T17:41:53.977335] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T17:41:54.122026] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-22T17:41:54.922013] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-22T17:41:55.207901] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T17:41:55.722052] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-22T17:41:55.737719] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-22T17:41:56.374825] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-22T17:41:56.522065] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-22T17:41:56.642075] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T17:41:57.322060] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-22T17:41:57.398737] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-22T17:41:58.122099] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-22T17:41:58.631230] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T17:41:58.922074] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-22T17:41:59.537074] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T17:41:59.639616] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T17:41:59.722077] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-22T17:42:00.522060] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-22T17:42:01.322078] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-22T17:42:01.750212] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-22T17:42:02.122067] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-22T17:42:02.810934] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-22T17:42:02.922041] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-22T17:42:03.722074] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-22T17:42:03.969179] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-22T17:42:04.522133] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-22T17:42:04.794710] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T17:42:05.322077] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-22T17:42:05.709952] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-22T17:42:06.122045] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-22T17:42:06.266278] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (4.14 seconds). [2025-09-22T17:42:06.732014] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T17:42:06.880164] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-22T17:42:06.922008] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-22T17:42:07.544329] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T17:42:07.722100] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-22T17:42:08.190708] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T17:42:08.522058] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-22T17:42:09.144059] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T17:42:09.322060] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-22T17:42:10.122073] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-22T17:42:10.749954] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-22T17:42:10.922097] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-22T17:42:11.052235] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T17:42:11.118434] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T17:42:11.722103] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-22T17:42:11.855809] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T17:42:12.522065] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-22T17:42:13.197929] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T17:42:13.322062] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-22T17:42:13.720410] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T17:42:14.122097] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-22T17:42:14.735162] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T17:42:14.922078] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-22T17:42:15.722047] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-22T17:42:15.743388] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T17:42:15.749225] [INFO ] [REMOTE ] BOND: Full fetch complete (46326 records). [2025-09-22T17:42:15.749338] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-22T17:42:16.088350] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T17:42:16.137298] [INFO ] [REMOTE ] BOE: Full fetch complete (26780 records). [2025-09-22T17:42:16.154752] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-22T17:42:16.172369] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-22T17:42:16.177969] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-22T17:42:16.206025] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-22T17:42:16.217725] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-22T17:42:16.289182] [DEBUG] [LOCAL ] BOND: Trimmed 46326 records to 32096 (keeping 200 days of data) [2025-09-22T17:42:16.525158] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-22T17:42:16.710028] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-22T17:42:16.710132] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-22T17:42:16.711204] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-22T17:42:16.711287] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-22T17:42:16.714614] [DEBUG] [LOCAL ] BOE: Trimmed 26780 records to 17665 (keeping 200 days of data) [2025-09-22T17:42:16.835841] [DEBUG] [LOCAL ] BOE: Primary data saved (17665 records). [2025-09-22T17:42:16.837452] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-22T17:42:16.838114] [INFO ] [MAIN ] Update Progress: 321/2372 symbols completed. BOE took 29.0s. Estimated remaining: 4h 29m 45s. Rate: 7.6 symbols/min [2025-09-22T17:42:17.046081] [DEBUG] [LOCAL ] BOND: Primary data saved (32096 records). [2025-09-22T17:42:17.056542] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-22T17:42:17.071612] [INFO ] [MAIN ] Update Progress: 322/2372 symbols completed. BOND took 29.2s. Estimated remaining: 4h 28m 48s. Rate: 7.6 symbols/min [2025-09-22T17:42:17.150306] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:42:17.184172] [DEBUG] [LOCAL ] BORR: No existing data file found in primary storage. [2025-09-22T17:42:17.189376] [WARN ] [MAIN ] BORR: No existing data found, performing full refresh instead. [2025-09-22T17:42:17.211592] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-22T17:42:17.211687] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-22T17:42:17.217511] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-09-22T17:42:17.217603] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-22T17:42:17.381789] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:42:17.393182] [DEBUG] [LOCAL ] BOW: No existing data file found in primary storage. [2025-09-22T17:42:17.393556] [WARN ] [MAIN ] BOW: No existing data found, performing full refresh instead. [2025-09-22T17:42:17.419896] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-22T17:42:17.420002] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-22T17:42:17.438280] [DEBUG] [LOCAL ] BOW: No primary data file found to delete. [2025-09-22T17:42:17.443816] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-22T17:42:17.848927] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:42:17.892550] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-22T17:42:18.091868] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:42:18.095371] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-22T17:42:18.122009] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-22T17:42:18.814764] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-22T17:42:18.822233] [INFO ] [REMOTE ] BOH: Full fetch complete (44755 records). [2025-09-22T17:42:18.822347] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-22T17:42:18.930386] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-22T17:42:19.218109] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-22T17:42:19.218194] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-22T17:42:19.218794] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-22T17:42:19.218883] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-22T17:42:19.220077] [DEBUG] [LOCAL ] BOH: Trimmed 44755 records to 31418 (keeping 200 days of data) [2025-09-22T17:42:19.419265] [DEBUG] [LOCAL ] BOH: Primary data saved (31418 records). [2025-09-22T17:42:19.419406] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-22T17:42:19.419524] [INFO ] [MAIN ] Update Progress: 323/2372 symbols completed. BOH took 31.5s. Estimated remaining: 4h 28m 5s. Rate: 7.6 symbols/min [2025-09-22T17:42:19.602448] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:42:19.665322] [DEBUG] [LOCAL ] BOX: Loaded 51127 existing records from primary storage. [2025-09-22T17:42:19.665525] [INFO ] [MAIN ] BOX: Loaded 51127 existing records. [2025-09-22T17:42:19.898344] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:42:19.918506] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-22T17:42:19.919824] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-22T17:42:19.922522] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-22T17:42:19.935923] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-22T17:42:19.937012] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-22T17:42:19.937146] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-22T17:42:20.059272] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T17:42:20.256690] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-22T17:42:20.296388] [INFO ] [REMOTE ] BOOT: Full fetch complete (60344 records). [2025-09-22T17:42:20.302712] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-22T17:42:20.500081] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:42:20.527203] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-22T17:42:20.829827] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-22T17:42:20.830031] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-22T17:42:20.832369] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-22T17:42:20.832486] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-22T17:42:20.838777] [DEBUG] [LOCAL ] BOOT: Trimmed 60344 records to 41054 (keeping 200 days of data) [2025-09-22T17:42:21.104839] [DEBUG] [LOCAL ] BOOT: Primary data saved (41054 records). [2025-09-22T17:42:21.105022] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-22T17:42:21.107788] [INFO ] [MAIN ] Update Progress: 324/2372 symbols completed. BOOT took 33.2s. Estimated remaining: 4h 27m 18s. Rate: 7.7 symbols/min [2025-09-22T17:42:21.296801] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:42:21.322179] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-22T17:42:21.374469] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-22T17:42:21.374705] [INFO ] [MAIN ] BP: Loaded 54491 existing records. [2025-09-22T17:42:21.582141] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:42:21.582500] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-22T17:42:21.582561] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-22T17:42:21.584368] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-22T17:42:21.584442] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-22T17:42:21.986518] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:42:22.031429] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-22T17:42:22.068408] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T17:42:22.122101] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-22T17:42:22.170866] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T17:42:22.922086] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-22T17:42:23.722087] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-22T17:42:24.258779] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-22T17:42:24.522105] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-22T17:42:24.594427] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T17:42:25.322085] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-22T17:42:25.458599] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T17:42:25.575548] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T17:42:26.122065] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-22T17:42:26.445341] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T17:42:26.922078] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-22T17:42:27.064175] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-22T17:42:27.722061] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-22T17:42:28.522088] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-22T17:42:28.674633] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T17:42:28.735531] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T17:42:29.322081] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-22T17:42:30.062165] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T17:42:30.122052] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-22T17:42:30.849527] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T17:42:30.922013] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-22T17:42:31.722116] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-22T17:42:31.950307] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T17:42:32.342159] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T17:42:32.522031] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-22T17:42:32.588133] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T17:42:33.322056] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-22T17:42:34.122046] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-22T17:42:34.887178] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-22T17:42:34.931306] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-22T17:42:34.935680] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T17:42:35.450921] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T17:42:35.656379] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T17:42:35.722085] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-22T17:42:36.522065] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-22T17:42:37.322069] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-22T17:42:37.574759] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T17:42:37.650822] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-22T17:42:38.122055] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-22T17:42:38.571791] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T17:42:38.922083] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-22T17:42:39.722103] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-22T17:42:40.341611] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-22T17:42:40.522051] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-22T17:42:40.593834] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T17:42:40.992792] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T17:42:41.322020] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-22T17:42:41.349772] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T17:42:42.122104] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-22T17:42:42.922032] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-22T17:42:43.129873] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T17:42:43.159697] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T17:42:43.163856] [INFO ] [REMOTE ] BOW: Full fetch complete (31110 records). [2025-09-22T17:42:43.163992] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-22T17:42:43.555629] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-22T17:42:43.555737] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-22T17:42:43.556196] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-22T17:42:43.556253] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-22T17:42:43.557083] [DEBUG] [LOCAL ] BOW: Trimmed 31110 records to 23622 (keeping 200 days of data) [2025-09-22T17:42:43.706510] [DEBUG] [LOCAL ] BOW: Primary data saved (23622 records). [2025-09-22T17:42:43.706671] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-22T17:42:43.706778] [INFO ] [MAIN ] Update Progress: 325/2372 symbols completed. BOW took 26.6s. Estimated remaining: 4h 28m 43s. Rate: 7.6 symbols/min [2025-09-22T17:42:43.727486] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-22T17:42:43.888466] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:42:43.942462] [DEBUG] [LOCAL ] BR: Loaded 35370 existing records from primary storage. [2025-09-22T17:42:43.942630] [INFO ] [MAIN ] BR: Loaded 35370 existing records. [2025-09-22T17:42:44.189058] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:42:44.189589] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-22T17:42:44.189669] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-22T17:42:44.191005] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-22T17:42:44.191066] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-22T17:42:44.528146] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-22T17:42:44.562132] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:42:45.318534] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-22T17:42:45.329819] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-22T17:42:45.646476] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-22T17:42:45.654566] [INFO ] [REMOTE ] BOX: Full fetch complete (72183 records). [2025-09-22T17:42:45.654729] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-22T17:42:46.110000] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-22T17:42:46.110118] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-22T17:42:46.111212] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-22T17:42:46.111326] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-22T17:42:46.124544] [DEBUG] [LOCAL ] BOX: Trimmed 72183 records to 50341 (keeping 200 days of data) [2025-09-22T17:42:46.129866] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-22T17:42:46.147735] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T17:42:46.457293] [DEBUG] [LOCAL ] BOX: Primary data saved (50341 records). [2025-09-22T17:42:46.457447] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-22T17:42:46.457541] [INFO ] [MAIN ] Update Progress: 326/2372 symbols completed. BOX took 27.0s. Estimated remaining: 4h 28m 3s. Rate: 7.6 symbols/min [2025-09-22T17:42:46.646375] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:42:46.703245] [DEBUG] [LOCAL ] BRBR: Loaded 51940 existing records from primary storage. [2025-09-22T17:42:46.704018] [INFO ] [MAIN ] BRBR: Loaded 51940 existing records. [2025-09-22T17:42:46.873539] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T17:42:46.916438] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:42:46.916807] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-22T17:42:46.916865] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-22T17:42:46.918723] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-22T17:42:46.918790] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-22T17:42:46.930343] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-22T17:42:47.294148] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:42:47.722058] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-22T17:42:48.041755] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T17:42:48.422058] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T17:42:48.431193] [INFO ] [REMOTE ] BORR: Full fetch complete (74779 records). [2025-09-22T17:42:48.431370] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-22T17:42:48.530049] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-22T17:42:48.838866] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-22T17:42:48.838956] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-22T17:42:48.839825] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-22T17:42:48.839894] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-22T17:42:48.841474] [DEBUG] [LOCAL ] BORR: Trimmed 74779 records to 51168 (keeping 200 days of data) [2025-09-22T17:42:48.997236] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-22T17:42:49.193208] [DEBUG] [LOCAL ] BORR: Primary data saved (51168 records). [2025-09-22T17:42:49.193360] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-22T17:42:49.193440] [INFO ] [MAIN ] Update Progress: 327/2372 symbols completed. BORR took 32.4s. Estimated remaining: 4h 27m 23s. Rate: 7.6 symbols/min [2025-09-22T17:42:49.332920] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-22T17:42:49.366022] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:42:49.386699] [DEBUG] [LOCAL ] BRC: Loaded 20122 existing records from primary storage. [2025-09-22T17:42:49.386832] [INFO ] [MAIN ] BRC: Loaded 20122 existing records. [2025-09-22T17:42:49.564109] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:42:49.564355] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-22T17:42:49.564404] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-22T17:42:49.565305] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-22T17:42:49.565368] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-22T17:42:49.921712] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:42:50.122057] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-22T17:42:50.451865] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T17:42:50.922061] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-22T17:42:50.985775] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T17:42:51.565501] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T17:42:51.722054] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-22T17:42:51.951328] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T17:42:52.522060] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-22T17:42:53.143628] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T17:42:53.322096] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-22T17:42:53.666560] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T17:42:54.122093] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-22T17:42:54.541932] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T17:42:54.922039] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-22T17:42:55.160875] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T17:42:55.722072] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-22T17:42:56.522062] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-22T17:42:56.809216] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T17:42:57.322024] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-22T17:42:57.346700] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T17:42:57.657192] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T17:42:58.122046] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-22T17:42:58.922030] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-22T17:42:59.283387] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T17:42:59.422632] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-22T17:42:59.722110] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-22T17:43:00.522041] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-22T17:43:00.852414] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T17:43:01.322072] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-22T17:43:01.561901] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T17:43:01.570191] [INFO ] [REMOTE ] BP: Full fetch complete (77762 records). [2025-09-22T17:43:01.570316] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-22T17:43:01.968597] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-22T17:43:01.968855] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-22T17:43:01.969711] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-22T17:43:01.969857] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-22T17:43:01.975222] [DEBUG] [LOCAL ] BP: Trimmed 77762 records to 53711 (keeping 200 days of data) [2025-09-22T17:43:02.099000] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T17:43:02.122094] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-22T17:43:02.352022] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-09-22T17:43:02.352190] [INFO ] [MAIN ] BP: Full history saved. [2025-09-22T17:43:02.352295] [INFO ] [MAIN ] Update Progress: 328/2372 symbols completed. BP took 41.2s. Estimated remaining: 4h 27m 49s. Rate: 7.6 symbols/min [2025-09-22T17:43:02.527413] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:43:02.566800] [DEBUG] [LOCAL ] BRCC: Loaded 41163 existing records from primary storage. [2025-09-22T17:43:02.566963] [INFO ] [MAIN ] BRCC: Loaded 41163 existing records. [2025-09-22T17:43:02.754903] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:43:02.755252] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-22T17:43:02.755452] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-22T17:43:02.756697] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-22T17:43:02.756822] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-22T17:43:02.926443] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-22T17:43:02.974602] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T17:43:03.167790] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:43:03.378271] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T17:43:03.722078] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-22T17:43:03.986066] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T17:43:04.522102] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-22T17:43:04.980687] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T17:43:05.322029] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-22T17:43:05.381778] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T17:43:06.122108] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-22T17:43:06.694924] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T17:43:06.922098] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-22T17:43:07.178390] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T17:43:07.722068] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-22T17:43:08.378430] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T17:43:08.522024] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-22T17:43:09.219804] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T17:43:09.322026] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-22T17:43:10.122067] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-22T17:43:10.182300] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T17:43:10.499055] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T17:43:10.818573] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T17:43:10.922071] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-22T17:43:11.722075] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-22T17:43:11.833990] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-22T17:43:12.522088] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-22T17:43:13.179875] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T17:43:13.322026] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-22T17:43:13.656854] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T17:43:13.662757] [INFO ] [REMOTE ] BR: Full fetch complete (49003 records). [2025-09-22T17:43:13.662869] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-22T17:43:14.075213] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-22T17:43:14.075307] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-22T17:43:14.075967] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-22T17:43:14.076030] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-22T17:43:14.077384] [DEBUG] [LOCAL ] BR: Trimmed 49003 records to 34832 (keeping 200 days of data) [2025-09-22T17:43:14.133871] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-22T17:43:14.306690] [DEBUG] [LOCAL ] BR: Primary data saved (34832 records). [2025-09-22T17:43:14.306899] [INFO ] [MAIN ] BR: Full history saved. [2025-09-22T17:43:14.307010] [INFO ] [MAIN ] Update Progress: 329/2372 symbols completed. BR took 30.6s. Estimated remaining: 4h 28m 6s. Rate: 7.6 symbols/min [2025-09-22T17:43:14.476303] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:43:14.517295] [DEBUG] [LOCAL ] BRFS: Loaded 41644 existing records from primary storage. [2025-09-22T17:43:14.517484] [INFO ] [MAIN ] BRFS: Loaded 41644 existing records. [2025-09-22T17:43:14.704761] [WARN ] [MAIN ] BRFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:43:14.705325] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-22T17:43:14.705440] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-22T17:43:14.714724] [DEBUG] [LOCAL ] BRFS: Deleted primary data file. [2025-09-22T17:43:14.728224] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-22T17:43:14.803804] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T17:43:14.931713] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-22T17:43:15.062190] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T17:43:15.100252] [INFO ] [REMOTE ] BRC: Full fetch complete (29161 records). [2025-09-22T17:43:15.117453] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-22T17:43:15.121244] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:43:15.502763] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-22T17:43:15.502844] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-22T17:43:15.503267] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-22T17:43:15.503306] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-22T17:43:15.504051] [DEBUG] [LOCAL ] BRC: Trimmed 29161 records to 19492 (keeping 200 days of data) [2025-09-22T17:43:15.624556] [DEBUG] [LOCAL ] BRC: Primary data saved (19492 records). [2025-09-22T17:43:15.624912] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-22T17:43:15.625017] [INFO ] [MAIN ] Update Progress: 330/2372 symbols completed. BRC took 26.4s. Estimated remaining: 4h 27m 18s. Rate: 7.6 symbols/min [2025-09-22T17:43:15.727184] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-12. [2025-09-22T17:43:15.802342] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:43:15.861753] [DEBUG] [LOCAL ] BRO: Loaded 52689 existing records from primary storage. [2025-09-22T17:43:15.861914] [INFO ] [MAIN ] BRO: Loaded 52689 existing records. [2025-09-22T17:43:16.041083] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:43:16.041355] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-22T17:43:16.041426] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-22T17:43:16.042944] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-22T17:43:16.043007] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-22T17:43:16.420821] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:43:16.522071] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-22T17:43:16.768763] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T17:43:17.105146] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T17:43:17.322055] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-01. [2025-09-22T17:43:17.940274] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T17:43:18.122069] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-22T17:43:18.615730] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T17:43:18.922059] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-22T17:43:19.333424] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T17:43:19.722118] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-22T17:43:20.429498] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T17:43:20.522119] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-22T17:43:21.045988] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T17:43:21.322052] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-22T17:43:21.858811] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T17:43:22.122071] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-22T17:43:22.767387] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T17:43:22.922086] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-22T17:43:23.572896] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T17:43:23.722017] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-22T17:43:24.357248] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T17:43:24.522070] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-22T17:43:25.130345] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T17:43:25.138535] [INFO ] [REMOTE ] BRBR: Full fetch complete (71661 records). [2025-09-22T17:43:25.138714] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-22T17:43:25.327128] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-22T17:43:25.573891] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-22T17:43:25.574021] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-22T17:43:25.575553] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-22T17:43:25.575778] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-22T17:43:25.578346] [DEBUG] [LOCAL ] BRBR: Trimmed 71661 records to 51236 (keeping 200 days of data) [2025-09-22T17:43:25.696982] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-22T17:43:25.938446] [DEBUG] [LOCAL ] BRBR: Primary data saved (51236 records). [2025-09-22T17:43:25.938707] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-22T17:43:25.938856] [INFO ] [MAIN ] Update Progress: 331/2372 symbols completed. BRBR took 39.5s. Estimated remaining: 4h 27m 25s. Rate: 7.6 symbols/min [2025-09-22T17:43:26.122301] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-22T17:43:26.133929] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:43:26.198089] [DEBUG] [LOCAL ] BROS: Loaded 54061 existing records from primary storage. [2025-09-22T17:43:26.198334] [INFO ] [MAIN ] BROS: Loaded 54061 existing records. [2025-09-22T17:43:26.389564] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:43:26.389953] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-22T17:43:26.390008] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-22T17:43:26.391382] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-22T17:43:26.391444] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-22T17:43:26.785555] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:43:26.922112] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-22T17:43:27.098179] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-22T17:43:27.612996] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T17:43:27.620057] [INFO ] [REMOTE ] BRCC: Full fetch complete (58070 records). [2025-09-22T17:43:27.620162] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-22T17:43:27.724502] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-22T17:43:28.039234] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-22T17:43:28.039387] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-22T17:43:28.040197] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-22T17:43:28.040267] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-22T17:43:28.041696] [DEBUG] [LOCAL ] BRCC: Trimmed 58070 records to 40430 (keeping 200 days of data) [2025-09-22T17:43:28.275504] [DEBUG] [LOCAL ] BRCC: Primary data saved (40430 records). [2025-09-22T17:43:28.275635] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-22T17:43:28.275757] [INFO ] [MAIN ] Update Progress: 332/2372 symbols completed. BRCC took 25.9s. Estimated remaining: 4h 26m 43s. Rate: 7.6 symbols/min [2025-09-22T17:43:28.449471] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:43:28.449765] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-22T17:43:28.449839] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-22T17:43:28.450066] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-22T17:43:28.450298] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-22T17:43:28.450450] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-22T17:43:28.450679] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-22T17:43:28.523592] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-22T17:43:28.861923] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:43:28.866807] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-22T17:43:29.322060] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-22T17:43:29.484115] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T17:43:29.518359] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:43:29.518768] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-22T17:43:30.007056] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T17:43:30.122052] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-22T17:43:30.922071] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-22T17:43:31.722077] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-22T17:43:31.776115] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T17:43:31.953850] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:43:31.954367] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-22T17:43:32.522106] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-22T17:43:32.602530] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T17:43:33.322074] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-22T17:43:33.876999] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T17:43:34.122056] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-22T17:43:34.922131] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-22T17:43:35.089416] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T17:43:35.610588] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T17:43:35.722056] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-22T17:43:36.522101] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-22T17:43:37.002332] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-22T17:43:37.052080] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T17:43:37.322039] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-22T17:43:38.121075] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T17:43:38.131260] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-22T17:43:38.922114] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-22T17:43:39.027965] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T17:43:39.116571] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:43:39.117128] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-22T17:43:39.381791] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T17:43:39.387733] [INFO ] [REMOTE ] BRFS: Full fetch complete (60819 records). [2025-09-22T17:43:39.387884] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-22T17:43:39.734349] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-22T17:43:39.792397] [DEBUG] [VALIDATOR ] BRFS: All expected trading days are present. [2025-09-22T17:43:39.792484] [DEBUG] [VALIDATOR ] BRFS: Primary data validation passed. [2025-09-22T17:43:39.793249] [INFO ] [MAIN ] BRFS: Fetched primary data is valid. [2025-09-22T17:43:39.793317] [DEBUG] [LOCAL ] BRFS: Saving primary data. [2025-09-22T17:43:39.794892] [DEBUG] [LOCAL ] BRFS: Trimmed 60819 records to 41050 (keeping 200 days of data) [2025-09-22T17:43:40.031719] [DEBUG] [LOCAL ] BRFS: Primary data saved (41050 records). [2025-09-22T17:43:40.031862] [INFO ] [MAIN ] BRFS: Full history saved. [2025-09-22T17:43:40.031947] [INFO ] [MAIN ] Update Progress: 333/2372 symbols completed. BRFS took 25.7s. Estimated remaining: 4h 26m 59s. Rate: 7.6 symbols/min [2025-09-22T17:43:40.203407] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:43:40.242538] [DEBUG] [LOCAL ] BRSP: Loaded 37505 existing records from primary storage. [2025-09-22T17:43:40.242712] [INFO ] [MAIN ] BRSP: Loaded 37505 existing records. [2025-09-22T17:43:40.420633] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:43:40.420917] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-22T17:43:40.420966] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-22T17:43:40.422102] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-22T17:43:40.422163] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-22T17:43:40.528268] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-22T17:43:40.791865] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:43:41.322049] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-22T17:43:41.786557] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-22T17:43:42.122101] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-22T17:43:42.805868] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-22T17:43:42.922045] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-22T17:43:43.384126] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-22T17:43:43.722078] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-22T17:43:43.880899] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T17:43:43.918482] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:43:43.918822] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-22T17:43:44.522069] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-22T17:43:44.677462] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T17:43:45.322063] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-22T17:43:45.545933] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:43:45.546234] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-22T17:43:46.122102] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-22T17:43:46.287679] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T17:43:46.388220] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:43:46.388566] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-22T17:43:46.922125] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-22T17:43:47.722113] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-22T17:43:47.925926] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:43:47.926256] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-22T17:43:48.289573] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T17:43:48.522089] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-22T17:43:49.322057] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-22T17:43:50.083609] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T17:43:50.122054] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-22T17:43:50.922081] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-22T17:43:51.219561] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T17:43:51.337928] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T17:43:51.722112] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-22T17:43:52.522063] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-22T17:43:53.049777] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-22T17:43:53.322054] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-22T17:43:53.482578] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T17:43:53.889943] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T17:43:53.898595] [INFO ] [REMOTE ] BRO: Full fetch complete (74140 records). [2025-09-22T17:43:53.898806] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-22T17:43:54.127483] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-22T17:43:54.338615] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-22T17:43:54.338728] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-22T17:43:54.339545] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-22T17:43:54.339589] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-22T17:43:54.341121] [DEBUG] [LOCAL ] BRO: Trimmed 74140 records to 51919 (keeping 200 days of data) [2025-09-22T17:43:54.673163] [DEBUG] [LOCAL ] BRO: Primary data saved (51919 records). [2025-09-22T17:43:54.673424] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-22T17:43:54.675286] [INFO ] [MAIN ] Update Progress: 334/2372 symbols completed. BRO took 39.1s. Estimated remaining: 4h 27m 33s. Rate: 7.6 symbols/min [2025-09-22T17:43:54.844801] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:43:54.856022] [DEBUG] [LOCAL ] BRT: Loaded 4924 existing records from primary storage. [2025-09-22T17:43:54.856205] [INFO ] [MAIN ] BRT: Loaded 4924 existing records. [2025-09-22T17:43:54.937518] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-22T17:43:55.044790] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:43:55.045236] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-22T17:43:55.045400] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-22T17:43:55.045884] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-22T17:43:55.045957] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-22T17:43:55.440580] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:43:55.442975] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-22T17:43:55.681825] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T17:43:55.722004] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-22T17:43:56.125748] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T17:43:56.522052] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-22T17:43:57.322056] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-22T17:43:57.471216] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T17:43:57.480046] [INFO ] [REMOTE ] BROS: Full fetch complete (76958 records). [2025-09-22T17:43:57.480202] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-22T17:43:57.917117] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-22T17:43:57.917322] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-22T17:43:57.918448] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-22T17:43:57.918542] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-22T17:43:57.936221] [DEBUG] [LOCAL ] BROS: Trimmed 76958 records to 53287 (keeping 200 days of data) [2025-09-22T17:43:57.951235] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T17:43:58.058546] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-22T17:43:58.148526] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-22T17:43:58.305416] [DEBUG] [LOCAL ] BROS: Primary data saved (53287 records). [2025-09-22T17:43:58.305601] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-22T17:43:58.305732] [INFO ] [MAIN ] Update Progress: 335/2372 symbols completed. BROS took 32.4s. Estimated remaining: 4h 26m 59s. Rate: 7.6 symbols/min [2025-09-22T17:43:58.473988] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:43:58.493023] [DEBUG] [LOCAL ] BRW: Loaded 19506 existing records from primary storage. [2025-09-22T17:43:58.493212] [INFO ] [MAIN ] BRW: Loaded 19506 existing records. [2025-09-22T17:43:58.668758] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:43:58.669040] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-22T17:43:58.669088] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-22T17:43:58.669781] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-22T17:43:58.669841] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-22T17:43:58.927251] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-22T17:43:59.025746] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:43:59.344129] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T17:43:59.722057] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-22T17:44:00.488415] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T17:44:00.496100] [INFO ] [REMOTE ] BRSL: Full fetch complete (20863 records). [2025-09-22T17:44:00.496207] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-22T17:44:00.527624] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-22T17:44:00.684851] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 57 unique days, need 200 days [2025-09-22T17:44:00.685251] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:44:00.685337] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:44:00.685408] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-22T17:44:00.685474] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-22T17:44:00.685510] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-22T17:44:00.685564] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-22T17:44:00.685673] [INFO ] [MAIN ] Update Progress: 336/2372 symbols completed. BRSL took 32.4s. Estimated remaining: 4h 26m 18s. Rate: 7.6 symbols/min [2025-09-22T17:44:00.854929] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:44:00.910719] [DEBUG] [LOCAL ] BRX: Loaded 52569 existing records from primary storage. [2025-09-22T17:44:00.910931] [INFO ] [MAIN ] BRX: Loaded 52569 existing records. [2025-09-22T17:44:01.101542] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:44:01.119908] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-22T17:44:01.121973] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T17:44:01.120577] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-22T17:44:01.131296] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-22T17:44:01.131465] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-22T17:44:01.332354] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-22T17:44:01.509997] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:44:01.772599] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T17:44:02.067446] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T17:44:02.122071] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-22T17:44:02.922091] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-22T17:44:03.287860] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-22T17:44:03.727126] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-22T17:44:03.746573] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T17:44:04.522059] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-22T17:44:04.963968] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T17:44:05.273216] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T17:44:05.322046] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-22T17:44:06.122146] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-22T17:44:06.303473] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-22T17:44:06.922127] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-22T17:44:07.230703] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T17:44:07.722097] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-22T17:44:08.235869] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T17:44:08.522098] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-22T17:44:09.122710] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T17:44:09.141465] [INFO ] [REMOTE ] BRSP: Full fetch complete (53878 records). [2025-09-22T17:44:09.141900] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T17:44:09.145752] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-22T17:44:09.327170] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-22T17:44:09.600759] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-22T17:44:09.600960] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-22T17:44:09.603163] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-22T17:44:09.603282] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-22T17:44:09.606473] [DEBUG] [LOCAL ] BRSP: Trimmed 53878 records to 36916 (keeping 200 days of data) [2025-09-22T17:44:09.839499] [DEBUG] [LOCAL ] BRSP: Primary data saved (36916 records). [2025-09-22T17:44:09.839694] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-22T17:44:09.839921] [INFO ] [MAIN ] Update Progress: 337/2372 symbols completed. BRSP took 29.8s. Estimated remaining: 4h 26m 18s. Rate: 7.6 symbols/min [2025-09-22T17:44:10.030911] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:44:10.066204] [DEBUG] [LOCAL ] BSAC: Loaded 33535 existing records from primary storage. [2025-09-22T17:44:10.066336] [INFO ] [MAIN ] BSAC: Loaded 33535 existing records. [2025-09-22T17:44:10.128622] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-22T17:44:10.246182] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:44:10.246435] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-22T17:44:10.246482] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-22T17:44:10.247515] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-22T17:44:10.247576] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-22T17:44:10.636073] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:44:10.671893] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T17:44:10.922134] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-22T17:44:10.958330] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T17:44:11.722072] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-22T17:44:12.126303] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-22T17:44:12.188464] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T17:44:12.522060] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-22T17:44:13.322078] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-22T17:44:13.358122] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-22T17:44:14.122072] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-22T17:44:14.263470] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T17:44:14.922057] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-22T17:44:15.722070] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-22T17:44:15.802307] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T17:44:16.037413] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T17:44:16.388933] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-22T17:44:16.522107] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-22T17:44:17.092772] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T17:44:17.322070] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-22T17:44:17.822513] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-22T17:44:18.122058] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-22T17:44:18.922071] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-22T17:44:19.356863] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T17:44:19.722086] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-22T17:44:20.273218] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T17:44:20.522056] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-22T17:44:21.055116] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T17:44:21.322051] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-22T17:44:22.122070] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-22T17:44:22.279271] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T17:44:22.430076] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T17:44:22.922032] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-22T17:44:22.943023] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-22T17:44:23.722060] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-22T17:44:24.266487] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-22T17:44:24.269933] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T17:44:24.522072] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-22T17:44:25.327984] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-22T17:44:25.338544] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T17:44:26.122089] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-22T17:44:26.345952] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T17:44:26.922096] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-22T17:44:27.551864] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T17:44:27.722026] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-22T17:44:28.279757] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T17:44:28.284945] [INFO ] [REMOTE ] BRW: Full fetch complete (29377 records). [2025-09-22T17:44:28.285128] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-22T17:44:28.527239] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-22T17:44:28.702689] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-22T17:44:28.702825] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-22T17:44:28.703519] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-22T17:44:28.703678] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-22T17:44:28.706080] [DEBUG] [LOCAL ] BRW: Trimmed 29377 records to 19139 (keeping 200 days of data) [2025-09-22T17:44:28.859877] [DEBUG] [LOCAL ] BRW: Primary data saved (19139 records). [2025-09-22T17:44:28.860168] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-22T17:44:28.860520] [INFO ] [MAIN ] Update Progress: 338/2372 symbols completed. BRW took 30.6s. Estimated remaining: 4h 27m 18s. Rate: 7.6 symbols/min [2025-09-22T17:44:29.054043] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:44:29.121581] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T17:44:29.147298] [DEBUG] [LOCAL ] BSBR: Loaded 35603 existing records from primary storage. [2025-09-22T17:44:29.147510] [INFO ] [MAIN ] BSBR: Loaded 35603 existing records. [2025-09-22T17:44:29.329900] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-22T17:44:29.337270] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:44:29.338685] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-22T17:44:29.338752] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-22T17:44:29.339756] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-22T17:44:29.339833] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-22T17:44:29.724953] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:44:29.749794] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T17:44:30.122082] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-22T17:44:30.922148] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-22T17:44:30.923490] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T17:44:31.184174] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T17:44:31.196171] [INFO ] [REMOTE ] BRX: Full fetch complete (74952 records). [2025-09-22T17:44:31.196397] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-22T17:44:31.596383] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-22T17:44:31.623590] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-22T17:44:31.623717] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-22T17:44:31.624585] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-22T17:44:31.625085] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-22T17:44:31.626639] [DEBUG] [LOCAL ] BRX: Trimmed 74952 records to 51826 (keeping 200 days of data) [2025-09-22T17:44:31.728811] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-22T17:44:31.958419] [DEBUG] [LOCAL ] BRX: Primary data saved (51826 records). [2025-09-22T17:44:31.958572] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-22T17:44:31.958694] [INFO ] [MAIN ] Update Progress: 339/2372 symbols completed. BRX took 31.3s. Estimated remaining: 4h 26m 41s. Rate: 7.6 symbols/min [2025-09-22T17:44:32.142076] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:44:32.155129] [DEBUG] [LOCAL ] BSL: Loaded 8186 existing records from primary storage. [2025-09-22T17:44:32.155269] [INFO ] [MAIN ] BSL: Loaded 8186 existing records. [2025-09-22T17:44:32.350627] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:44:32.351029] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-22T17:44:32.351089] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-22T17:44:32.351622] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-22T17:44:32.351723] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-22T17:44:32.525807] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-22T17:44:32.752002] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:44:32.974741] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T17:44:32.979883] [INFO ] [REMOTE ] BSAC: Full fetch complete (43276 records). [2025-09-22T17:44:32.979975] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-22T17:44:32.980592] [FATAL] [VALIDATOR ] BSAC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:44:32.980702] [FATAL] [MAIN ] BSAC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:44:32.980762] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:44:32.980825] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-22T17:44:32.980884] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-09-22T17:44:32.980929] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-09-22T17:44:32.981445] [DEBUG] [LOCAL ] BSAC: Deleted derivative data file. [2025-09-22T17:44:32.981581] [INFO ] [MAIN ] Update Progress: 340/2372 symbols completed. BSAC took 23.1s. Estimated remaining: 4h 25m 52s. Rate: 7.6 symbols/min [2025-09-22T17:44:33.153955] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:44:33.156638] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-22T17:44:33.203009] [DEBUG] [LOCAL ] BSM: Loaded 33095 existing records from primary storage. [2025-09-22T17:44:33.203150] [INFO ] [MAIN ] BSM: Loaded 33095 existing records. [2025-09-22T17:44:33.327119] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-22T17:44:33.382834] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:44:33.383046] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-22T17:44:33.383094] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-22T17:44:33.384331] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-22T17:44:33.384391] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-22T17:44:33.746864] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:44:34.122050] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-22T17:44:34.288835] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T17:44:34.922081] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-22T17:44:34.948483] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T17:44:34.949941] [INFO ] [REMOTE ] BRT: Full fetch complete (6760 records). [2025-09-22T17:44:34.950025] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-22T17:44:35.326139] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-22T17:44:35.326466] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-22T17:44:35.326732] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-22T17:44:35.326796] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-22T17:44:35.327523] [DEBUG] [LOCAL ] BRT: Trimmed 6760 records to 4876 (keeping 200 days of data) [2025-09-22T17:44:35.367757] [DEBUG] [LOCAL ] BRT: Primary data saved (4876 records). [2025-09-22T17:44:35.367868] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-22T17:44:35.367964] [INFO ] [MAIN ] Update Progress: 341/2372 symbols completed. BRT took 40.7s. Estimated remaining: 4h 25m 12s. Rate: 7.7 symbols/min [2025-09-22T17:44:35.542607] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:44:35.542839] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-09-22T17:44:35.542881] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-09-22T17:44:35.543086] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-22T17:44:35.543127] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-22T17:44:35.543167] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-22T17:44:35.543198] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-22T17:44:35.727302] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-22T17:44:35.908532] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:44:36.127691] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T17:44:36.522075] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-22T17:44:36.599016] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T17:44:37.322057] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-22T17:44:37.402931] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T17:44:38.122086] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-22T17:44:38.198450] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T17:44:38.922057] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-22T17:44:39.722143] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-22T17:44:39.823305] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T17:44:40.348151] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T17:44:40.494911] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T17:44:40.522116] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-22T17:44:41.322113] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-22T17:44:41.900937] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T17:44:42.122047] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-22T17:44:42.437175] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T17:44:42.922064] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-22T17:44:43.532025] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T17:44:43.722071] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-22T17:44:43.800194] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-22T17:44:44.522062] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-22T17:44:44.842698] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T17:44:45.322059] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-22T17:44:45.891756] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T17:44:46.073719] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T17:44:46.122012] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-22T17:44:46.922053] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-22T17:44:47.437337] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-22T17:44:47.586431] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T17:44:47.722054] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-22T17:44:48.522062] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-22T17:44:48.873203] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-22T17:44:49.281071] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T17:44:49.322053] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-22T17:44:49.720982] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-22T17:44:50.122043] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-22T17:44:50.922061] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-22T17:44:51.139105] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T17:44:51.722027] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-22T17:44:52.034096] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-22T17:44:52.522069] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-22T17:44:53.128077] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T17:44:53.322019] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-22T17:44:53.754112] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T17:44:53.828014] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-22T17:44:53.830811] [INFO ] [REMOTE ] BSL: Full fetch complete (12509 records). [2025-09-22T17:44:53.830896] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-22T17:44:54.127134] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-22T17:44:54.272399] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-22T17:44:54.272480] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-22T17:44:54.272868] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-22T17:44:54.272931] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-22T17:44:54.273442] [DEBUG] [LOCAL ] BSL: Trimmed 12509 records to 7898 (keeping 200 days of data) [2025-09-22T17:44:54.323309] [DEBUG] [LOCAL ] BSL: Primary data saved (7898 records). [2025-09-22T17:44:54.323450] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-22T17:44:54.323541] [INFO ] [MAIN ] Update Progress: 342/2372 symbols completed. BSL took 22.4s. Estimated remaining: 4h 26m 10s. Rate: 7.6 symbols/min [2025-09-22T17:44:54.501917] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:44:54.529488] [DEBUG] [LOCAL ] BSTZ: Loaded 25410 existing records from primary storage. [2025-09-22T17:44:54.529621] [INFO ] [MAIN ] BSTZ: Loaded 25410 existing records. [2025-09-22T17:44:54.709113] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:44:54.709354] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-22T17:44:54.709437] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-22T17:44:54.710400] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-22T17:44:54.710466] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-22T17:44:54.930976] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-22T17:44:55.073247] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:44:55.545284] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T17:44:55.722061] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-22T17:44:56.502423] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T17:44:56.522083] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-22T17:44:56.981206] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T17:44:57.322027] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-22T17:44:57.769494] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T17:44:58.107247] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T17:44:58.122022] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-22T17:44:58.922118] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-22T17:44:59.377751] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T17:44:59.722115] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-22T17:45:00.252006] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T17:45:00.522112] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-22T17:45:01.322088] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-22T17:45:01.414101] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T17:45:02.006419] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T17:45:02.012614] [INFO ] [REMOTE ] BSM: Full fetch complete (47628 records). [2025-09-22T17:45:02.012806] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-22T17:45:02.127165] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-22T17:45:02.440603] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-22T17:45:02.440780] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-22T17:45:02.441633] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-22T17:45:02.441735] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-22T17:45:02.443381] [DEBUG] [LOCAL ] BSM: Trimmed 47628 records to 32330 (keeping 200 days of data) [2025-09-22T17:45:02.648070] [DEBUG] [LOCAL ] BSM: Primary data saved (32330 records). [2025-09-22T17:45:02.648274] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-22T17:45:02.648380] [INFO ] [MAIN ] Update Progress: 343/2372 symbols completed. BSM took 29.7s. Estimated remaining: 4h 26m 5s. Rate: 7.6 symbols/min [2025-09-22T17:45:02.822451] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:45:02.881828] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-22T17:45:02.882067] [INFO ] [MAIN ] BSX: Loaded 54468 existing records. [2025-09-22T17:45:02.928894] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-22T17:45:03.102002] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:45:03.102413] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-22T17:45:03.102488] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-22T17:45:03.104461] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-22T17:45:03.104527] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-22T17:45:03.477040] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:45:03.642708] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-22T17:45:03.722111] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-22T17:45:04.522067] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-22T17:45:05.162121] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-22T17:45:05.243931] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (3.12 seconds). [2025-09-22T17:45:05.322058] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-22T17:45:05.989943] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-22T17:45:06.122016] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-22T17:45:06.619379] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-22T17:45:06.871344] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T17:45:06.877750] [INFO ] [REMOTE ] BSBR: Full fetch complete (50268 records). [2025-09-22T17:45:06.877887] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-22T17:45:06.878619] [FATAL] [VALIDATOR ] BSBR: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:45:06.878731] [FATAL] [MAIN ] BSBR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:45:06.878780] [WARN ] [MAIN ] BSBR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:45:06.878821] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-22T17:45:06.878879] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-09-22T17:45:06.878914] [INFO ] [LOCAL ] BSBR: Starting deletion of derivative data. [2025-09-22T17:45:06.879369] [DEBUG] [LOCAL ] BSBR: Deleted derivative data file. [2025-09-22T17:45:06.879472] [INFO ] [MAIN ] Update Progress: 344/2372 symbols completed. BSBR took 38.0s. Estimated remaining: 4h 25m 35s. Rate: 7.6 symbols/min [2025-09-22T17:45:06.926886] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-22T17:45:07.068630] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:45:07.080362] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T17:45:07.089095] [DEBUG] [LOCAL ] BTA: Loaded 5358 existing records from primary storage. [2025-09-22T17:45:07.089178] [INFO ] [MAIN ] BTA: Loaded 5358 existing records. [2025-09-22T17:45:07.265599] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:45:07.265896] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-22T17:45:07.265944] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-22T17:45:07.266245] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-22T17:45:07.266304] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-22T17:45:07.622768] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:45:07.722075] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-22T17:45:08.522051] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-22T17:45:08.772229] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T17:45:08.919751] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-22T17:45:09.229985] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T17:45:09.322006] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-22T17:45:10.122031] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-22T17:45:10.378013] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T17:45:10.922055] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-22T17:45:11.042419] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T17:45:11.722066] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-22T17:45:12.522071] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-22T17:45:12.543464] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T17:45:12.855981] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-22T17:45:13.194622] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T17:45:13.322062] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-22T17:45:14.122071] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-22T17:45:14.922076] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-22T17:45:15.171357] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T17:45:15.722084] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-22T17:45:15.816474] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-22T17:45:16.522027] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-22T17:45:16.569554] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T17:45:16.833282] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T17:45:17.322064] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-22T17:45:17.824775] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-22T17:45:17.828440] [INFO ] [REMOTE ] BST: Full fetch complete (28769 records). [2025-09-22T17:45:17.828534] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-22T17:45:18.029672] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-22T17:45:18.127131] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-22T17:45:18.215793] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-22T17:45:18.215884] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-22T17:45:18.216361] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-22T17:45:18.216415] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-22T17:45:18.217178] [DEBUG] [LOCAL ] BST: Trimmed 28769 records to 19306 (keeping 200 days of data) [2025-09-22T17:45:18.361172] [DEBUG] [LOCAL ] BST: Primary data saved (19306 records). [2025-09-22T17:45:18.361387] [INFO ] [MAIN ] BST: Full history saved. [2025-09-22T17:45:18.361489] [INFO ] [MAIN ] Update Progress: 345/2372 symbols completed. BST took 43.0s. Estimated remaining: 4h 25m 49s. Rate: 7.6 symbols/min [2025-09-22T17:45:18.532579] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:45:18.548812] [DEBUG] [LOCAL ] BTCM: Loaded 14565 existing records from primary storage. [2025-09-22T17:45:18.548933] [INFO ] [MAIN ] BTCM: Loaded 14565 existing records. [2025-09-22T17:45:18.729515] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:45:18.729891] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-22T17:45:18.729945] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-22T17:45:18.730518] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-22T17:45:18.730578] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-22T17:45:18.845022] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-22T17:45:18.922116] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-22T17:45:19.119412] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:45:19.722079] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-22T17:45:20.175931] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-22T17:45:20.522024] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-22T17:45:20.903293] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-22T17:45:20.985720] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-22T17:45:21.322082] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-22T17:45:22.122052] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-22T17:45:22.922054] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-22T17:45:23.192131] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T17:45:23.347498] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-22T17:45:23.722086] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-22T17:45:23.937709] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T17:45:24.522064] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-22T17:45:25.322052] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-22T17:45:25.364454] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T17:45:25.573434] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T17:45:26.122060] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-22T17:45:26.513918] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T17:45:26.558046] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T17:45:26.922057] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-22T17:45:27.628929] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T17:45:27.722080] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-22T17:45:28.522112] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-22T17:45:29.031442] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-22T17:45:29.322033] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-22T17:45:29.723589] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-22T17:45:29.751408] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T17:45:30.122069] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-22T17:45:30.922082] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-22T17:45:31.552977] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T17:45:31.722023] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-22T17:45:31.758392] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T17:45:32.522064] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-22T17:45:32.924844] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-22T17:45:33.034355] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T17:45:33.038487] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36698 records). [2025-09-22T17:45:33.038579] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-22T17:45:33.327146] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-22T17:45:33.429676] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-22T17:45:33.429780] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-22T17:45:33.430336] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-22T17:45:33.430416] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-22T17:45:33.431580] [DEBUG] [LOCAL ] BSTZ: Trimmed 36698 records to 24927 (keeping 200 days of data) [2025-09-22T17:45:33.586050] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24927 records). [2025-09-22T17:45:33.586190] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-22T17:45:33.586279] [INFO ] [MAIN ] Update Progress: 346/2372 symbols completed. BSTZ took 39.3s. Estimated remaining: 4h 26m 24s. Rate: 7.6 symbols/min [2025-09-22T17:45:33.759969] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:45:33.813533] [DEBUG] [LOCAL ] BTE: Loaded 53527 existing records from primary storage. [2025-09-22T17:45:33.813716] [INFO ] [MAIN ] BTE: Loaded 53527 existing records. [2025-09-22T17:45:33.994307] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:45:33.994623] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-22T17:45:33.994709] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-22T17:45:33.996213] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-22T17:45:33.996278] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-22T17:45:34.127185] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-22T17:45:34.407258] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:45:34.770177] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T17:45:34.771901] [INFO ] [REMOTE ] BTA: Full fetch complete (9499 records). [2025-09-22T17:45:34.771977] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-22T17:45:34.927140] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-22T17:45:35.151175] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-22T17:45:35.151327] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-22T17:45:35.151585] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-22T17:45:35.151627] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-22T17:45:35.152101] [DEBUG] [LOCAL ] BTA: Trimmed 9499 records to 5290 (keeping 200 days of data) [2025-09-22T17:45:35.183399] [DEBUG] [LOCAL ] BTA: Primary data saved (5290 records). [2025-09-22T17:45:35.183517] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-22T17:45:35.183604] [INFO ] [MAIN ] Update Progress: 347/2372 symbols completed. BTA took 28.3s. Estimated remaining: 4h 25m 40s. Rate: 7.6 symbols/min [2025-09-22T17:45:35.361764] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:45:35.390273] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-22T17:45:35.402906] [INFO ] [REMOTE ] BSX: Full fetch complete (77680 records). [2025-09-22T17:45:35.403130] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-22T17:45:35.718470] [DEBUG] [LOCAL ] BTI: Loaded 54332 existing records from primary storage. [2025-09-22T17:45:35.723913] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-22T17:45:35.743571] [INFO ] [MAIN ] BTI: Loaded 54332 existing records. [2025-09-22T17:45:36.039807] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:45:36.040038] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-22T17:45:36.040197] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-22T17:45:36.040308] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-22T17:45:36.040389] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-22T17:45:36.041395] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-22T17:45:36.041479] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-22T17:45:36.041898] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-22T17:45:36.042178] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-22T17:45:36.139310] [DEBUG] [LOCAL ] BSX: Trimmed 77680 records to 53688 (keeping 200 days of data) [2025-09-22T17:45:36.426708] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T17:45:36.529481] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-22T17:45:36.535873] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:45:36.726028] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T17:45:36.832845] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-22T17:45:36.833002] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-22T17:45:36.833092] [INFO ] [MAIN ] Update Progress: 348/2372 symbols completed. BSX took 34.2s. Estimated remaining: 4h 24m 55s. Rate: 7.6 symbols/min [2025-09-22T17:45:37.012468] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:45:37.024774] [DEBUG] [LOCAL ] BTO: Loaded 9175 existing records from primary storage. [2025-09-22T17:45:37.024933] [INFO ] [MAIN ] BTO: Loaded 9175 existing records. [2025-09-22T17:45:37.202341] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:45:37.202609] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-22T17:45:37.202683] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-22T17:45:37.203070] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-22T17:45:37.203128] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-22T17:45:37.327310] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-22T17:45:37.568633] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:45:38.122030] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-22T17:45:38.193756] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T17:45:38.746954] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T17:45:38.767318] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-22T17:45:38.922061] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-22T17:45:39.722081] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-22T17:45:40.154394] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T17:45:40.522060] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-22T17:45:41.169129] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T17:45:41.322060] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-22T17:45:42.099462] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T17:45:42.122108] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-22T17:45:42.259736] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T17:45:42.660357] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-22T17:45:42.922058] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-22T17:45:43.489805] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-22T17:45:43.722074] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-22T17:45:44.344698] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-22T17:45:44.522065] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-22T17:45:45.280611] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T17:45:45.322009] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-22T17:45:45.817811] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-22T17:45:46.122100] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-22T17:45:46.889760] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T17:45:46.922076] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-22T17:45:47.722019] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-22T17:45:47.787397] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T17:45:48.522067] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-22T17:45:48.883209] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T17:45:48.887245] [INFO ] [REMOTE ] BTCM: Full fetch complete (19572 records). [2025-09-22T17:45:48.887348] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-22T17:45:49.286332] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-22T17:45:49.286430] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-22T17:45:49.286891] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-22T17:45:49.286953] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-22T17:45:49.287557] [DEBUG] [LOCAL ] BTCM: Trimmed 19572 records to 14601 (keeping 200 days of data) [2025-09-22T17:45:49.327190] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-22T17:45:49.359315] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T17:45:49.364931] [INFO ] [REMOTE ] BTO: Full fetch complete (13380 records). [2025-09-22T17:45:49.365909] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-22T17:45:49.550519] [DEBUG] [LOCAL ] BTCM: Primary data saved (14601 records). [2025-09-22T17:45:49.568608] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-22T17:45:49.620250] [INFO ] [MAIN ] Update Progress: 349/2372 symbols completed. BTCM took 31.3s. Estimated remaining: 4h 25m 16s. Rate: 7.6 symbols/min [2025-09-22T17:45:49.968989] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:45:49.969333] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-22T17:45:49.969614] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-22T17:45:49.970842] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-22T17:45:49.970951] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-22T17:45:49.972972] [DEBUG] [LOCAL ] BTO: Trimmed 13380 records to 8965 (keeping 200 days of data) [2025-09-22T17:45:50.063100] [DEBUG] [LOCAL ] BTT: Loaded 16323 existing records from primary storage. [2025-09-22T17:45:50.067683] [INFO ] [MAIN ] BTT: Loaded 16323 existing records. [2025-09-22T17:45:50.134636] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-22T17:45:50.167912] [DEBUG] [LOCAL ] BTO: Primary data saved (8965 records). [2025-09-22T17:45:50.179237] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-22T17:45:50.179353] [INFO ] [MAIN ] Update Progress: 350/2372 symbols completed. BTO took 13.3s. Estimated remaining: 4h 24m 26s. Rate: 7.6 symbols/min [2025-09-22T17:45:50.360381] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:45:50.371756] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-22T17:45:50.372173] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-22T17:45:50.393669] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-22T17:45:50.418843] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-22T17:45:50.520040] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:45:50.908039] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:45:50.910264] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-22T17:45:50.910363] [INFO ] [MAIN ] BTU: Loaded 54082 existing records. [2025-09-22T17:45:50.943693] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-22T17:45:51.102034] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:45:51.102335] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-22T17:45:51.102394] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-22T17:45:51.103571] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-22T17:45:51.103633] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-22T17:45:51.469941] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:45:51.498367] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-22T17:45:51.656220] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T17:45:51.722024] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-22T17:45:52.145162] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T17:45:52.522322] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-22T17:45:53.238762] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T17:45:53.322045] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-22T17:45:53.432267] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T17:45:54.122067] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-22T17:45:54.922045] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-22T17:45:55.230520] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T17:45:55.722036] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-22T17:45:55.831180] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T17:45:56.522053] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-22T17:45:56.996132] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-22T17:45:57.322064] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-22T17:45:57.420383] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T17:45:57.440307] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-22T17:45:58.122065] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-22T17:45:58.922061] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-22T17:45:59.056102] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T17:45:59.600208] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-22T17:45:59.722091] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-22T17:46:00.188511] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-22T17:46:00.522056] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-22T17:46:01.255256] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:46:01.322016] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-22T17:46:01.596006] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T17:46:02.122047] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-22T17:46:02.715768] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-22T17:46:02.922078] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-22T17:46:03.080596] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T17:46:03.722075] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-22T17:46:04.449089] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T17:46:04.522068] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-22T17:46:05.322077] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-22T17:46:05.753086] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-22T17:46:06.122048] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-22T17:46:06.349613] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T17:46:06.388001] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T17:46:06.922117] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-22T17:46:07.722078] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-22T17:46:08.042371] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-22T17:46:08.522110] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-22T17:46:08.783879] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T17:46:09.218922] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T17:46:09.322055] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-22T17:46:09.533181] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T17:46:10.122045] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-22T17:46:10.922075] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-22T17:46:11.196153] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T17:46:11.204339] [INFO ] [REMOTE ] BTE: Full fetch complete (75985 records). [2025-09-22T17:46:11.204457] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-22T17:46:11.616740] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-22T17:46:11.616908] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-22T17:46:11.617819] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-22T17:46:11.617936] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-22T17:46:11.620132] [DEBUG] [LOCAL ] BTE: Trimmed 75985 records to 52748 (keeping 200 days of data) [2025-09-22T17:46:11.725739] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-22T17:46:11.767545] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T17:46:11.987078] [DEBUG] [LOCAL ] BTE: Primary data saved (52748 records). [2025-09-22T17:46:11.987290] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-22T17:46:11.987393] [INFO ] [MAIN ] Update Progress: 351/2372 symbols completed. BTE took 38.4s. Estimated remaining: 4h 25m 39s. Rate: 7.6 symbols/min [2025-09-22T17:46:12.160792] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:46:12.161009] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-22T17:46:12.161053] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-22T17:46:12.161201] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-22T17:46:12.161257] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-22T17:46:12.161331] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-22T17:46:12.161367] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-22T17:46:12.531689] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:46:12.528171] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-22T17:46:12.544743] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T17:46:12.701855] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T17:46:13.322057] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-22T17:46:14.122021] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-22T17:46:14.165553] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T17:46:14.289113] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T17:46:14.292233] [INFO ] [REMOTE ] BTT: Full fetch complete (24476 records). [2025-09-22T17:46:14.292315] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-22T17:46:14.664840] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-22T17:46:14.664931] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-22T17:46:14.665378] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-22T17:46:14.665419] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-22T17:46:14.666132] [DEBUG] [LOCAL ] BTT: Trimmed 24476 records to 16021 (keeping 200 days of data) [2025-09-22T17:46:14.766999] [DEBUG] [LOCAL ] BTT: Primary data saved (16021 records). [2025-09-22T17:46:14.767157] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-22T17:46:14.767246] [INFO ] [MAIN ] Update Progress: 352/2372 symbols completed. BTT took 25.1s. Estimated remaining: 4h 25m 1s. Rate: 7.6 symbols/min [2025-09-22T17:46:14.930334] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-22T17:46:14.961581] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:46:14.985442] [DEBUG] [LOCAL ] BTZ: Loaded 23355 existing records from primary storage. [2025-09-22T17:46:14.985568] [INFO ] [MAIN ] BTZ: Loaded 23355 existing records. [2025-09-22T17:46:15.171029] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:46:15.171318] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-22T17:46:15.171369] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-22T17:46:15.172147] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-22T17:46:15.172219] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-22T17:46:15.351513] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:46:15.420367] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-22T17:46:15.535846] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:46:15.722060] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-22T17:46:15.825705] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T17:46:15.932460] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:46:15.932820] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-22T17:46:16.522100] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-22T17:46:17.322047] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-22T17:46:18.122088] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-22T17:46:18.360031] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T17:46:18.583930] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-22T17:46:18.765116] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T17:46:18.922102] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-22T17:46:19.722069] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-22T17:46:19.988157] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T17:46:20.522078] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-22T17:46:21.322070] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-22T17:46:21.369994] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T17:46:21.481205] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T17:46:22.122060] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-22T17:46:22.922110] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-22T17:46:23.092750] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T17:46:23.100615] [INFO ] [REMOTE ] BTI: Full fetch complete (77035 records). [2025-09-22T17:46:23.100835] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-22T17:46:23.101615] [FATAL] [VALIDATOR ] BTI: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:46:23.101750] [FATAL] [MAIN ] BTI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:46:23.101796] [WARN ] [MAIN ] BTI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:46:23.101838] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-22T17:46:23.101899] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-09-22T17:46:23.101935] [INFO ] [LOCAL ] BTI: Starting deletion of derivative data. [2025-09-22T17:46:23.102508] [DEBUG] [LOCAL ] BTI: Deleted derivative data file. [2025-09-22T17:46:23.102612] [INFO ] [MAIN ] Update Progress: 353/2372 symbols completed. BTI took 47.9s. Estimated remaining: 4h 24m 56s. Rate: 7.6 symbols/min [2025-09-22T17:46:23.290545] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:46:23.348928] [DEBUG] [LOCAL ] BUD: Loaded 53535 existing records from primary storage. [2025-09-22T17:46:23.349091] [INFO ] [MAIN ] BUD: Loaded 53535 existing records. [2025-09-22T17:46:23.539689] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:46:23.539935] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-22T17:46:23.539987] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-22T17:46:23.542298] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-22T17:46:23.542362] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-22T17:46:23.736030] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-22T17:46:23.924525] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:46:23.944521] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-22T17:46:24.008382] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T17:46:24.018489] [INFO ] [REMOTE ] BTU: Full fetch complete (76826 records). [2025-09-22T17:46:24.018695] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-22T17:46:24.444427] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-22T17:46:24.444522] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-22T17:46:24.445393] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-22T17:46:24.445461] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-22T17:46:24.449200] [DEBUG] [LOCAL ] BTU: Trimmed 76826 records to 53303 (keeping 200 days of data) [2025-09-22T17:46:24.543337] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-22T17:46:24.784770] [DEBUG] [LOCAL ] BTU: Primary data saved (53303 records). [2025-09-22T17:46:24.784935] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-22T17:46:24.785040] [INFO ] [MAIN ] Update Progress: 354/2372 symbols completed. BTU took 34.6s. Estimated remaining: 4h 24m 13s. Rate: 7.6 symbols/min [2025-09-22T17:46:24.955991] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:46:24.972322] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T17:46:24.987086] [DEBUG] [LOCAL ] BUI: Loaded 11660 existing records from primary storage. [2025-09-22T17:46:24.987214] [INFO ] [MAIN ] BUI: Loaded 11660 existing records. [2025-09-22T17:46:25.163128] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:46:25.163401] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-22T17:46:25.163449] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-22T17:46:25.163947] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-22T17:46:25.164008] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-22T17:46:25.327725] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-22T17:46:25.532491] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:46:26.122068] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-22T17:46:26.323227] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T17:46:26.751585] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-22T17:46:26.922065] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-22T17:46:26.964011] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T17:46:27.722069] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-22T17:46:27.938184] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T17:46:28.281463] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-22T17:46:28.522074] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-22T17:46:29.322070] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-22T17:46:30.108871] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T17:46:30.122009] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-22T17:46:30.152461] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T17:46:30.922096] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-22T17:46:31.414726] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-22T17:46:31.643419] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T17:46:31.722078] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-22T17:46:32.274168] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-22T17:46:32.522061] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-22T17:46:33.322118] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-22T17:46:33.858161] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T17:46:34.122073] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-22T17:46:34.922088] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-22T17:46:35.226711] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T17:46:35.465313] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T17:46:35.469985] [INFO ] [REMOTE ] BTX: Full fetch complete (35060 records). [2025-09-22T17:46:35.470130] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-22T17:46:35.471201] [FATAL] [VALIDATOR ] BTX: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:46:35.471291] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:46:35.471344] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:46:35.471410] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-22T17:46:35.471488] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-22T17:46:35.471544] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-22T17:46:35.471587] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-22T17:46:35.471710] [INFO ] [MAIN ] Update Progress: 355/2372 symbols completed. BTX took 23.5s. Estimated remaining: 4h 24m 21s. Rate: 7.6 symbols/min [2025-09-22T17:46:35.667275] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:46:35.718991] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-22T17:46:35.722148] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-22T17:46:35.743973] [DEBUG] [LOCAL ] BUR: Loaded 45780 existing records from primary storage. [2025-09-22T17:46:35.744164] [INFO ] [MAIN ] BUR: Loaded 45780 existing records. [2025-09-22T17:46:35.949544] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:46:35.949918] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-22T17:46:35.949989] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-22T17:46:35.951439] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-22T17:46:35.951523] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-22T17:46:36.346261] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:46:36.522056] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-22T17:46:36.560734] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T17:46:37.322060] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-22T17:46:37.863678] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T17:46:38.100379] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T17:46:38.122029] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-22T17:46:38.922102] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-22T17:46:38.942549] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T17:46:39.722068] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-22T17:46:40.434178] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T17:46:40.522082] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-22T17:46:41.322077] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-22T17:46:41.651515] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-22T17:46:42.000482] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T17:46:42.122040] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-22T17:46:42.245015] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T17:46:42.922073] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-22T17:46:43.722060] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-22T17:46:43.834464] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T17:46:44.420721] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T17:46:44.501750] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T17:46:44.522025] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-22T17:46:45.322065] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-22T17:46:46.122088] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-22T17:46:46.430003] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-22T17:46:46.673666] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T17:46:46.922085] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-22T17:46:47.391772] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T17:46:47.445465] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-22T17:46:47.722058] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-22T17:46:48.522080] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-22T17:46:49.322036] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-22T17:46:49.366517] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T17:46:49.369347] [INFO ] [REMOTE ] BUI: Full fetch complete (16184 records). [2025-09-22T17:46:49.369448] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-22T17:46:49.773639] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-22T17:46:49.773811] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-22T17:46:49.774510] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-22T17:46:49.774614] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-22T17:46:49.775742] [DEBUG] [LOCAL ] BUI: Trimmed 16184 records to 11478 (keeping 200 days of data) [2025-09-22T17:46:49.806809] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-22T17:46:49.894265] [DEBUG] [LOCAL ] BUI: Primary data saved (11478 records). [2025-09-22T17:46:49.894484] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-22T17:46:49.894660] [INFO ] [MAIN ] Update Progress: 356/2372 symbols completed. BUI took 25.1s. Estimated remaining: 4h 24m 51s. Rate: 7.6 symbols/min [2025-09-22T17:46:50.109524] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:46:50.122061] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-22T17:46:50.185574] [DEBUG] [LOCAL ] BURL: Loaded 47179 existing records from primary storage. [2025-09-22T17:46:50.185829] [INFO ] [MAIN ] BURL: Loaded 47179 existing records. [2025-09-22T17:46:50.378501] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:46:50.378875] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-22T17:46:50.378928] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-22T17:46:50.380111] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-22T17:46:50.380199] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-22T17:46:50.806909] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:46:50.907286] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T17:46:50.922005] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-22T17:46:51.722092] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-22T17:46:51.723951] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T17:46:52.414788] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T17:46:52.444295] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T17:46:52.522054] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-22T17:46:53.322064] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-22T17:46:54.122068] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-22T17:46:54.213061] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T17:46:54.222267] [INFO ] [REMOTE ] BUD: Full fetch complete (76489 records). [2025-09-22T17:46:54.222407] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-22T17:46:54.568978] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T17:46:54.650033] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-22T17:46:54.650126] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-22T17:46:54.651005] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-22T17:46:54.651076] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-22T17:46:54.655599] [DEBUG] [LOCAL ] BUD: Trimmed 76489 records to 52752 (keeping 200 days of data) [2025-09-22T17:46:54.952292] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-22T17:46:55.001126] [DEBUG] [LOCAL ] BUD: Primary data saved (52752 records). [2025-09-22T17:46:55.001289] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-22T17:46:55.001402] [INFO ] [MAIN ] Update Progress: 357/2372 symbols completed. BUD took 31.9s. Estimated remaining: 4h 24m 27s. Rate: 7.6 symbols/min [2025-09-22T17:46:55.722054] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-22T17:46:55.924420] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-22T17:46:56.280613] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T17:46:56.446067] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T17:46:56.522017] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-22T17:46:57.322054] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-22T17:46:57.783028] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T17:46:57.788913] [INFO ] [REMOTE ] BTZ: Full fetch complete (33880 records). [2025-09-22T17:46:57.789010] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-22T17:46:58.127139] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-22T17:46:58.211063] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-22T17:46:58.211157] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-22T17:46:58.211737] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-22T17:46:58.211802] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-22T17:46:58.212767] [DEBUG] [LOCAL ] BTZ: Trimmed 33880 records to 22906 (keeping 200 days of data) [2025-09-22T17:46:58.375727] [DEBUG] [LOCAL ] BTZ: Primary data saved (22906 records). [2025-09-22T17:46:58.375871] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-22T17:46:58.375990] [INFO ] [MAIN ] Update Progress: 358/2372 symbols completed. BTZ took 43.6s. Estimated remaining: 4h 23m 54s. Rate: 7.6 symbols/min [2025-09-22T17:46:58.503036] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T17:46:58.922139] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-22T17:46:59.698575] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T17:46:59.722002] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-22T17:47:00.479425] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T17:47:00.486801] [INFO ] [REMOTE ] BUR: Full fetch complete (63194 records). [2025-09-22T17:47:00.486922] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-22T17:47:00.903496] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-22T17:47:00.903584] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-22T17:47:00.904370] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-22T17:47:00.904438] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-22T17:47:00.905921] [DEBUG] [LOCAL ] BUR: Trimmed 63194 records to 45095 (keeping 200 days of data) [2025-09-22T17:47:01.190585] [DEBUG] [LOCAL ] BUR: Primary data saved (45095 records). [2025-09-22T17:47:01.190750] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-22T17:47:01.190845] [INFO ] [MAIN ] Update Progress: 359/2372 symbols completed. BUR took 25.7s. Estimated remaining: 4h 23m 18s. Rate: 7.6 symbols/min [2025-09-22T17:47:01.344978] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T17:47:01.353874] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-22T17:47:03.320249] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-22T17:47:03.330819] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-22T17:47:04.807277] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T17:47:04.817674] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-22T17:47:06.461087] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T17:47:06.471145] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-22T17:47:08.260582] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T17:47:08.270134] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-22T17:47:09.880963] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T17:47:09.891264] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-22T17:47:11.560688] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T17:47:11.571319] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-22T17:47:13.297838] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T17:47:13.305129] [INFO ] [REMOTE ] BURL: Full fetch complete (65698 records). [2025-09-22T17:47:13.305261] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-22T17:47:13.709942] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-22T17:47:13.710402] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-22T17:47:13.711250] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-22T17:47:13.711316] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-22T17:47:13.712730] [DEBUG] [LOCAL ] BURL: Trimmed 65698 records to 46416 (keeping 200 days of data) [2025-09-22T17:47:13.995349] [DEBUG] [LOCAL ] BURL: Primary data saved (46416 records). [2025-09-22T17:47:13.995501] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-22T17:47:13.995594] [INFO ] [MAIN ] Update Progress: 360/2372 symbols completed. BURL took 24.1s. Estimated remaining: 4h 23m 38s. Rate: 7.6 symbols/min [2025-09-22T17:47:14.527332] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:47:14.690942] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:47:14.714011] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:47:14.743266] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:47:14.772957] [DEBUG] [LOCAL ] BUXX: Loaded 15425 existing records from primary storage. [2025-09-22T17:47:14.773943] [INFO ] [MAIN ] BUXX: Loaded 15425 existing records. [2025-09-22T17:47:14.879689] [DEBUG] [LOCAL ] BW: Loaded 40158 existing records from primary storage. [2025-09-22T17:47:14.896342] [INFO ] [MAIN ] BW: Loaded 40158 existing records. [2025-09-22T17:47:15.183399] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:47:15.195794] [DEBUG] [LOCAL ] BV: Loaded 39305 existing records from primary storage. [2025-09-22T17:47:15.207205] [DEBUG] [LOCAL ] BVN: Loaded 44243 existing records from primary storage. [2025-09-22T17:47:15.225862] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-22T17:47:15.264219] [INFO ] [MAIN ] BVN: Loaded 44243 existing records. [2025-09-22T17:47:15.267434] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:47:15.261694] [INFO ] [MAIN ] BV: Loaded 39305 existing records. [2025-09-22T17:47:15.273027] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-22T17:47:15.278352] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-22T17:47:15.264336] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-22T17:47:15.342574] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-22T17:47:15.342784] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-22T17:47:15.321867] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-22T17:47:15.360471] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-22T17:47:15.890519] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:47:15.947136] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-22T17:47:15.987677] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-22T17:47:15.987784] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:47:16.043985] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-22T17:47:16.080443] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-22T17:47:16.089216] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-22T17:47:16.148300] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-22T17:47:16.250723] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-22T17:47:16.289467] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-22T17:47:16.502761] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:47:16.515805] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:47:16.641327] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-22T17:47:16.648442] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-22T17:47:17.024967] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:47:17.036628] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-22T17:47:17.106523] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:47:17.106837] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-22T17:47:17.530332] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T17:47:17.534357] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-22T17:47:18.068936] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-22T17:47:18.071883] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-22T17:47:18.480902] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T17:47:18.487753] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-22T17:47:18.573490] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-22T17:47:18.582958] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-22T17:47:18.694752] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T17:47:18.704022] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-22T17:47:18.741332] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T17:47:18.744059] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-22T17:47:19.329399] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T17:47:19.332698] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-22T17:47:19.644627] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T17:47:19.651025] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-22T17:47:19.821463] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T17:47:19.829569] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-22T17:47:20.077924] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T17:47:20.082916] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-22T17:47:20.241123] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T17:47:20.251236] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-22T17:47:20.698140] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T17:47:20.702987] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-22T17:47:20.868710] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T17:47:20.876763] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-22T17:47:20.998018] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T17:47:21.006710] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-22T17:47:21.606178] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T17:47:21.614024] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-22T17:47:21.660477] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T17:47:21.664292] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-22T17:47:22.319625] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T17:47:22.323960] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-22T17:47:22.347262] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T17:47:22.573880] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T17:47:22.914915] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-22T17:47:22.921991] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-22T17:47:23.097811] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T17:47:23.722093] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-22T17:47:23.964276] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T17:47:23.966904] [INFO ] [REMOTE ] BUXX: Full fetch complete (20268 records). [2025-09-22T17:47:23.967000] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-22T17:47:24.359152] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-22T17:47:24.359251] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-22T17:47:24.359682] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-22T17:47:24.359754] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-22T17:47:24.360371] [DEBUG] [LOCAL ] BUXX: Trimmed 20268 records to 15166 (keeping 200 days of data) [2025-09-22T17:47:24.451984] [DEBUG] [LOCAL ] BUXX: Primary data saved (15166 records). [2025-09-22T17:47:24.452125] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-22T17:47:24.452211] [INFO ] [MAIN ] Update Progress: 361/2372 symbols completed. BUXX took 10.5s. Estimated remaining: 4h 23m 44s. Rate: 7.6 symbols/min [2025-09-22T17:47:24.527348] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-22T17:47:24.626156] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:47:24.680328] [DEBUG] [LOCAL ] BWA: Loaded 53029 existing records from primary storage. [2025-09-22T17:47:24.680493] [INFO ] [MAIN ] BWA: Loaded 53029 existing records. [2025-09-22T17:47:24.858864] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:47:24.859122] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-22T17:47:24.859194] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-22T17:47:24.860773] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-22T17:47:24.860835] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-22T17:47:25.220039] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:47:25.267748] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T17:47:25.322029] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-22T17:47:25.963497] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T17:47:26.122052] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-22T17:47:26.732522] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T17:47:26.922096] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-22T17:47:27.166073] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-22T17:47:27.722081] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-22T17:47:28.522083] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-22T17:47:28.809785] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T17:47:29.043247] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T17:47:29.322096] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-22T17:47:30.122112] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-22T17:47:30.175985] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T17:47:30.679757] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T17:47:30.922067] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-22T17:47:31.627392] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T17:47:31.722075] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-22T17:47:32.522034] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-22T17:47:32.622668] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T17:47:33.041295] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T17:47:33.322055] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-22T17:47:33.734166] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T17:47:34.122057] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-22T17:47:34.874770] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T17:47:34.922070] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-22T17:47:35.572265] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T17:47:35.722069] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-22T17:47:36.514487] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T17:47:36.522148] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-22T17:47:37.209457] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T17:47:37.322039] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-22T17:47:37.905022] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T17:47:38.122063] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-22T17:47:38.922056] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-22T17:47:39.233246] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T17:47:39.492350] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T17:47:39.722112] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-22T17:47:40.415343] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T17:47:40.427081] [INFO ] [REMOTE ] BVN: Full fetch complete (62663 records). [2025-09-22T17:47:40.427327] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-22T17:47:40.527323] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-22T17:47:40.958135] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-22T17:47:40.958333] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-22T17:47:40.959265] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-22T17:47:40.959382] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-22T17:47:40.981343] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T17:47:40.980107] [DEBUG] [LOCAL ] BVN: Trimmed 62663 records to 43798 (keeping 200 days of data) [2025-09-22T17:47:41.248056] [DEBUG] [LOCAL ] BVN: Primary data saved (43798 records). [2025-09-22T17:47:41.248197] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-22T17:47:41.248285] [INFO ] [MAIN ] Update Progress: 362/2372 symbols completed. BVN took 27.2s. Estimated remaining: 4h 24m 26s. Rate: 7.6 symbols/min [2025-09-22T17:47:41.327127] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-22T17:47:41.420523] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:47:41.434381] [DEBUG] [LOCAL ] BWG: Loaded 12521 existing records from primary storage. [2025-09-22T17:47:41.434558] [INFO ] [MAIN ] BWG: Loaded 12521 existing records. [2025-09-22T17:47:41.613958] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:47:41.614222] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-22T17:47:41.614275] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-22T17:47:41.614785] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-22T17:47:41.614879] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-22T17:47:41.975316] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:47:42.111143] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T17:47:42.117806] [INFO ] [REMOTE ] BV: Full fetch complete (53783 records). [2025-09-22T17:47:42.117919] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-22T17:47:42.129829] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-22T17:47:42.514031] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-22T17:47:42.514122] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-22T17:47:42.514842] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-22T17:47:42.514907] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-22T17:47:42.516185] [DEBUG] [LOCAL ] BV: Trimmed 53783 records to 38631 (keeping 200 days of data) [2025-09-22T17:47:42.753841] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T17:47:42.796926] [DEBUG] [LOCAL ] BV: Primary data saved (38631 records). [2025-09-22T17:47:42.797101] [INFO ] [MAIN ] BV: Full history saved. [2025-09-22T17:47:42.797200] [INFO ] [MAIN ] Update Progress: 363/2372 symbols completed. BV took 28.8s. Estimated remaining: 4h 23m 43s. Rate: 7.6 symbols/min [2025-09-22T17:47:42.924557] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-22T17:47:43.004563] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:47:43.005820] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T17:47:43.049503] [DEBUG] [LOCAL ] BWLP: Loaded 33422 existing records from primary storage. [2025-09-22T17:47:43.049689] [INFO ] [MAIN ] BWLP: Loaded 33422 existing records. [2025-09-22T17:47:43.235962] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:47:43.236258] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-22T17:47:43.236309] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-22T17:47:43.237435] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-22T17:47:43.237499] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-22T17:47:43.629231] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:47:43.722040] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-22T17:47:44.435260] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T17:47:44.522064] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-22T17:47:44.786576] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T17:47:44.794610] [INFO ] [REMOTE ] BW: Full fetch complete (58690 records). [2025-09-22T17:47:44.794778] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-22T17:47:45.179575] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-22T17:47:45.179699] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-22T17:47:45.180485] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-22T17:47:45.180538] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-22T17:47:45.181975] [DEBUG] [LOCAL ] BW: Trimmed 58690 records to 39509 (keeping 200 days of data) [2025-09-22T17:47:45.341678] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-22T17:47:45.390262] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T17:47:45.424633] [DEBUG] [LOCAL ] BW: Primary data saved (39509 records). [2025-09-22T17:47:45.424872] [INFO ] [MAIN ] BW: Full history saved. [2025-09-22T17:47:45.424995] [INFO ] [MAIN ] Update Progress: 364/2372 symbols completed. BW took 31.4s. Estimated remaining: 4h 23m 6s. Rate: 7.6 symbols/min [2025-09-22T17:47:45.599809] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:47:45.609831] [DEBUG] [LOCAL ] BWMX: Loaded 7670 existing records from primary storage. [2025-09-22T17:47:45.609944] [INFO ] [MAIN ] BWMX: Loaded 7670 existing records. [2025-09-22T17:47:45.787865] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:47:45.788151] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-22T17:47:45.788200] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-22T17:47:45.788566] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-22T17:47:45.788625] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-22T17:47:46.140844] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-22T17:47:46.147066] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:47:46.765422] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T17:47:46.922071] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-22T17:47:47.491005] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T17:47:47.722055] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-22T17:47:47.777147] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T17:47:48.350831] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T17:47:48.522062] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-22T17:47:49.322067] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-22T17:47:49.794881] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-22T17:47:50.122045] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-22T17:47:50.415334] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T17:47:50.512534] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-22T17:47:50.922105] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-22T17:47:51.722075] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-22T17:47:52.421678] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T17:47:52.522072] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-22T17:47:53.068445] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-22T17:47:53.322054] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-22T17:47:53.588548] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-22T17:47:54.122087] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-22T17:47:54.458340] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-22T17:47:54.808974] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T17:47:54.922083] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-22T17:47:55.529012] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T17:47:55.722067] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-22T17:47:56.280287] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T17:47:56.522055] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-22T17:47:57.322047] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-22T17:47:57.618972] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T17:47:58.081924] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-22T17:47:58.122013] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-22T17:47:58.922066] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-22T17:47:59.121911] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T17:47:59.722085] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-22T17:48:00.522138] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-22T17:48:00.628212] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-22T17:48:00.803935] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T17:48:00.812882] [INFO ] [REMOTE ] BWA: Full fetch complete (75763 records). [2025-09-22T17:48:00.813114] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-22T17:48:01.269382] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-22T17:48:01.269532] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-22T17:48:01.270483] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-22T17:48:01.270554] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-22T17:48:01.272147] [DEBUG] [LOCAL ] BWA: Trimmed 75763 records to 52257 (keeping 200 days of data) [2025-09-22T17:48:01.331037] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-22T17:48:01.625075] [DEBUG] [LOCAL ] BWA: Primary data saved (52257 records). [2025-09-22T17:48:01.625234] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-22T17:48:01.625328] [INFO ] [MAIN ] Update Progress: 365/2372 symbols completed. BWA took 37.2s. Estimated remaining: 4h 23m 44s. Rate: 7.6 symbols/min [2025-09-22T17:48:01.805305] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:48:01.805672] [DEBUG] [LOCAL ] BWNB: No existing data file found in primary storage. [2025-09-22T17:48:01.805757] [WARN ] [MAIN ] BWNB: No existing data found, performing full refresh instead. [2025-09-22T17:48:01.815571] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T17:48:01.815210] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-22T17:48:01.819081] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-22T17:48:01.819491] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-09-22T17:48:01.819547] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-22T17:48:02.127215] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-22T17:48:02.183951] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:48:02.922104] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-22T17:48:03.722065] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-22T17:48:04.225422] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-22T17:48:04.522035] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-22T17:48:04.555324] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T17:48:05.175914] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (3.05 seconds). [2025-09-22T17:48:05.180507] [INFO ] [REMOTE ] BWG: Full fetch complete (17655 records). [2025-09-22T17:48:05.180665] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-22T17:48:05.329892] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-22T17:48:05.582579] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-22T17:48:05.592939] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-22T17:48:05.594284] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T17:48:05.599147] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-22T17:48:05.599898] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-22T17:48:05.624287] [DEBUG] [LOCAL ] BWG: Trimmed 17655 records to 12327 (keeping 200 days of data) [2025-09-22T17:48:05.624139] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-22T17:48:05.707331] [DEBUG] [LOCAL ] BWG: Primary data saved (12327 records). [2025-09-22T17:48:05.707501] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-22T17:48:05.707603] [INFO ] [MAIN ] Update Progress: 366/2372 symbols completed. BWG took 24.5s. Estimated remaining: 4h 23m 15s. Rate: 7.6 symbols/min [2025-09-22T17:48:05.877779] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:48:05.885273] [DEBUG] [LOCAL ] BWSN: Loaded 5145 existing records from primary storage. [2025-09-22T17:48:05.885384] [INFO ] [MAIN ] BWSN: Loaded 5145 existing records. [2025-09-22T17:48:05.990149] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-22T17:48:06.072695] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:48:06.072977] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-22T17:48:06.073027] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-22T17:48:06.073415] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-22T17:48:06.073475] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-22T17:48:06.127299] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-22T17:48:06.475246] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:48:06.742697] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T17:48:06.922092] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-22T17:48:07.558071] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T17:48:07.559894] [INFO ] [REMOTE ] BWMX: Full fetch complete (10071 records). [2025-09-22T17:48:07.559987] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-22T17:48:07.728780] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-22T17:48:07.958379] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-22T17:48:07.958460] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-22T17:48:07.958804] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-22T17:48:07.958869] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-22T17:48:07.959369] [DEBUG] [LOCAL ] BWMX: Trimmed 10071 records to 7613 (keeping 200 days of data) [2025-09-22T17:48:08.008639] [DEBUG] [LOCAL ] BWMX: Primary data saved (7613 records). [2025-09-22T17:48:08.008838] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-22T17:48:08.008948] [INFO ] [MAIN ] Update Progress: 367/2372 symbols completed. BWMX took 22.6s. Estimated remaining: 4h 22m 37s. Rate: 7.6 symbols/min [2025-09-22T17:48:08.181906] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:48:08.233616] [DEBUG] [LOCAL ] BWXT: Loaded 47373 existing records from primary storage. [2025-09-22T17:48:08.233813] [INFO ] [MAIN ] BWXT: Loaded 47373 existing records. [2025-09-22T17:48:08.411442] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:48:08.411734] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-22T17:48:08.411791] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-22T17:48:08.413283] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-22T17:48:08.413344] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-22T17:48:08.527261] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-22T17:48:08.781247] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:48:09.002559] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T17:48:09.275167] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-22T17:48:09.322007] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-22T17:48:09.747151] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-22T17:48:10.122112] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-22T17:48:10.519523] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-22T17:48:10.922061] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-22T17:48:11.722132] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-22T17:48:12.308450] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:48:12.522090] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-22T17:48:12.962463] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T17:48:13.306862] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T17:48:13.321996] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-22T17:48:14.122100] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-22T17:48:14.782185] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T17:48:14.922097] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-22T17:48:15.722110] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-22T17:48:15.952285] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T17:48:16.070142] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T17:48:16.370064] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T17:48:16.522060] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-22T17:48:16.918322] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-22T17:48:17.322054] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-22T17:48:18.122159] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-22T17:48:18.912453] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T17:48:18.922000] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-22T17:48:19.104135] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-22T17:48:19.460984] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-22T17:48:19.722068] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-22T17:48:20.522056] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-22T17:48:20.972184] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-22T17:48:21.322052] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-22T17:48:21.353131] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T17:48:21.789496] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T17:48:22.122074] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-22T17:48:22.922063] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-22T17:48:23.515066] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-22T17:48:23.722055] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-22T17:48:23.969820] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T17:48:24.126078] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-22T17:48:24.522061] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-22T17:48:24.698484] [DEBUG] [REMOTE ] BWSN: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-22T17:48:24.698860] [WARN ] [REMOTE ] BWSN: No data returned for month 2025-09 [2025-09-22T17:48:24.698962] [INFO ] [REMOTE ] BWSN: Full fetch complete (5871 records). [2025-09-22T17:48:24.699034] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-22T17:48:24.699745] [FATAL] [VALIDATOR ] BWSN: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:48:24.699827] [FATAL] [MAIN ] BWSN: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:48:24.699892] [WARN ] [MAIN ] BWSN: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:48:24.699962] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-22T17:48:24.700040] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-22T17:48:24.700103] [INFO ] [LOCAL ] BWSN: Starting deletion of derivative data. [2025-09-22T17:48:24.700523] [DEBUG] [LOCAL ] BWSN: Deleted derivative data file. [2025-09-22T17:48:24.700619] [INFO ] [MAIN ] Update Progress: 368/2372 symbols completed. BWSN took 19.0s. Estimated remaining: 4h 23m 17s. Rate: 7.6 symbols/min [2025-09-22T17:48:24.869662] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:48:24.928014] [DEBUG] [LOCAL ] BX: Loaded 54281 existing records from primary storage. [2025-09-22T17:48:24.928163] [INFO ] [MAIN ] BX: Loaded 54281 existing records. [2025-09-22T17:48:25.104875] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:48:25.105204] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-22T17:48:25.105267] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-22T17:48:25.107770] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-22T17:48:25.107850] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-22T17:48:25.327260] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-22T17:48:25.510294] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:48:26.122054] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-22T17:48:26.922063] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-22T17:48:27.344618] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-22T17:48:27.722123] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-22T17:48:28.429744] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T17:48:28.527150] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-22T17:48:28.546676] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-22T17:48:29.141930] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T17:48:29.322070] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-22T17:48:29.438187] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T17:48:30.122077] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-22T17:48:30.517636] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T17:48:30.522829] [INFO ] [REMOTE ] BWLP: Full fetch complete (48725 records). [2025-09-22T17:48:30.522930] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-22T17:48:30.727427] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T17:48:30.805824] [INFO ] [REMOTE ] BWNB: Full fetch complete (5755 records). [2025-09-22T17:48:30.831064] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-22T17:48:30.922638] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-22T17:48:31.088068] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-22T17:48:31.091600] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-22T17:48:31.114537] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-22T17:48:31.133337] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-22T17:48:31.226134] [DEBUG] [LOCAL ] BWLP: Trimmed 48725 records to 32842 (keeping 200 days of data) [2025-09-22T17:48:31.402443] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-22T17:48:31.402902] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-22T17:48:31.403414] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-22T17:48:31.403869] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-22T17:48:31.405932] [DEBUG] [LOCAL ] BWNB: Trimmed 5755 records to 4485 (keeping 200 days of data) [2025-09-22T17:48:31.448217] [DEBUG] [LOCAL ] BWNB: Primary data saved (4485 records). [2025-09-22T17:48:31.448995] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-22T17:48:31.449459] [INFO ] [MAIN ] Update Progress: 369/2372 symbols completed. BWNB took 29.8s. Estimated remaining: 4h 23m 3s. Rate: 7.6 symbols/min [2025-09-22T17:48:31.688231] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:48:31.722791] [DEBUG] [LOCAL ] BXC: Loaded 13833 existing records from primary storage. [2025-09-22T17:48:31.724354] [INFO ] [MAIN ] BXC: Loaded 13833 existing records. [2025-09-22T17:48:31.724405] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-22T17:48:31.921494] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:48:31.925102] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-22T17:48:31.925488] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-22T17:48:31.926987] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-22T17:48:31.927059] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-22T17:48:32.022447] [DEBUG] [LOCAL ] BWLP: Primary data saved (32842 records). [2025-09-22T17:48:32.032965] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-22T17:48:32.035011] [INFO ] [MAIN ] Update Progress: 370/2372 symbols completed. BWLP took 49.2s. Estimated remaining: 4h 22m 16s. Rate: 7.6 symbols/min [2025-09-22T17:48:32.400118] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:48:32.472765] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:48:32.520230] [DEBUG] [LOCAL ] BXMT: Loaded 47995 existing records from primary storage. [2025-09-22T17:48:32.520378] [INFO ] [MAIN ] BXMT: Loaded 47995 existing records. [2025-09-22T17:48:32.532091] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-22T17:48:32.709434] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:48:32.709956] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-22T17:48:32.710057] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-22T17:48:32.711516] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-22T17:48:32.711581] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-22T17:48:32.921801] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-22T17:48:33.160524] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:48:33.199476] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T17:48:33.270348] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T17:48:33.322106] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-22T17:48:34.122133] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-22T17:48:34.635108] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-22T17:48:34.922064] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-22T17:48:35.222503] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T17:48:35.722075] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-22T17:48:36.522101] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-22T17:48:37.005267] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-22T17:48:37.030768] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-22T17:48:37.322072] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-22T17:48:37.447944] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T17:48:38.122067] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-22T17:48:38.922084] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-22T17:48:39.274731] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T17:48:39.551942] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T17:48:39.722066] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-22T17:48:39.779565] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T17:48:40.522084] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-22T17:48:40.723720] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T17:48:41.322076] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-22T17:48:42.122071] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-22T17:48:42.468044] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-22T17:48:42.922055] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-22T17:48:43.351469] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T17:48:43.452055] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T17:48:43.606562] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T17:48:43.722050] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-22T17:48:44.522053] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-22T17:48:45.070330] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T17:48:45.322076] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-22T17:48:46.122095] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-22T17:48:46.624769] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-22T17:48:46.928082] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-22T17:48:46.943044] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T17:48:46.954481] [INFO ] [REMOTE ] BWXT: Full fetch complete (66815 records). [2025-09-22T17:48:46.962710] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-22T17:48:46.963695] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T17:48:46.968071] [FATAL] [VALIDATOR ] BWXT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:48:46.968496] [FATAL] [MAIN ] BWXT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:48:46.968576] [WARN ] [MAIN ] BWXT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:48:46.968672] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-22T17:48:46.968775] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-09-22T17:48:46.968830] [INFO ] [LOCAL ] BWXT: Starting deletion of derivative data. [2025-09-22T17:48:46.969280] [DEBUG] [LOCAL ] BWXT: Deleted derivative data file. [2025-09-22T17:48:46.969409] [INFO ] [MAIN ] Update Progress: 371/2372 symbols completed. BWXT took 39.0s. Estimated remaining: 4h 22m 46s. Rate: 7.6 symbols/min [2025-09-22T17:48:47.141218] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:48:47.164574] [DEBUG] [LOCAL ] BXMX: Loaded 19972 existing records from primary storage. [2025-09-22T17:48:47.164730] [INFO ] [MAIN ] BXMX: Loaded 19972 existing records. [2025-09-22T17:48:47.346003] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:48:47.346268] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-22T17:48:47.346317] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-22T17:48:47.347063] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-22T17:48:47.347136] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-22T17:48:47.721364] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:48:47.722006] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-22T17:48:48.522046] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-22T17:48:48.953183] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T17:48:49.020119] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-22T17:48:49.285764] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T17:48:49.322048] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-22T17:48:50.122152] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-22T17:48:50.271971] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T17:48:50.922118] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-22T17:48:51.116312] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T17:48:51.722073] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-22T17:48:52.394833] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T17:48:52.522093] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-22T17:48:53.306101] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T17:48:53.322022] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-22T17:48:54.122090] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-22T17:48:54.196275] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T17:48:54.922065] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-22T17:48:55.036238] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T17:48:55.038603] [INFO ] [REMOTE ] BXC: Full fetch complete (17490 records). [2025-09-22T17:48:55.038707] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-22T17:48:55.039172] [FATAL] [VALIDATOR ] BXC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:48:55.039255] [FATAL] [MAIN ] BXC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:48:55.039299] [WARN ] [MAIN ] BXC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:48:55.039337] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-22T17:48:55.039409] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-09-22T17:48:55.039473] [INFO ] [LOCAL ] BXC: Starting deletion of derivative data. [2025-09-22T17:48:55.039901] [DEBUG] [LOCAL ] BXC: Deleted derivative data file. [2025-09-22T17:48:55.039996] [INFO ] [MAIN ] Update Progress: 372/2372 symbols completed. BXC took 23.6s. Estimated remaining: 4h 22m 39s. Rate: 7.6 symbols/min [2025-09-22T17:48:55.217760] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:48:55.269338] [DEBUG] [LOCAL ] BXP: Loaded 50587 existing records from primary storage. [2025-09-22T17:48:55.269627] [INFO ] [MAIN ] BXP: Loaded 50587 existing records. [2025-09-22T17:48:55.452767] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:48:55.453139] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-22T17:48:55.453207] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-22T17:48:55.454668] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-22T17:48:55.454733] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-22T17:48:55.726581] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-22T17:48:55.803097] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-22T17:48:55.890767] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:48:56.365604] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T17:48:56.522066] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-22T17:48:56.560690] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T17:48:57.322086] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-22T17:48:58.122060] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-22T17:48:58.303520] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T17:48:58.922062] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-22T17:48:59.068154] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T17:48:59.222002] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T17:48:59.722066] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-22T17:49:00.349764] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T17:49:00.522067] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-22T17:49:01.322019] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-22T17:49:01.373119] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T17:49:01.381462] [INFO ] [REMOTE ] BX: Full fetch complete (77402 records). [2025-09-22T17:49:01.381625] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-22T17:49:01.846121] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-22T17:49:01.846219] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-22T17:49:01.847113] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-22T17:49:01.847195] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-22T17:49:01.848857] [DEBUG] [LOCAL ] BX: Trimmed 77402 records to 53501 (keeping 200 days of data) [2025-09-22T17:49:02.153992] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-22T17:49:02.254573] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T17:49:02.266772] [DEBUG] [LOCAL ] BX: Primary data saved (53501 records). [2025-09-22T17:49:02.267081] [INFO ] [MAIN ] BX: Full history saved. [2025-09-22T17:49:02.271147] [INFO ] [MAIN ] Update Progress: 373/2372 symbols completed. BX took 37.6s. Estimated remaining: 4h 22m 28s. Rate: 7.6 symbols/min [2025-09-22T17:49:02.445090] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:49:02.513598] [DEBUG] [LOCAL ] BXSL: Loaded 48143 existing records from primary storage. [2025-09-22T17:49:02.513801] [INFO ] [MAIN ] BXSL: Loaded 48143 existing records. [2025-09-22T17:49:02.708625] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:49:02.709164] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-22T17:49:02.709272] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-22T17:49:02.710508] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-22T17:49:02.710590] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-22T17:49:02.917779] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T17:49:02.934273] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-22T17:49:03.160799] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:49:03.334546] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T17:49:03.722104] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-22T17:49:04.522192] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-22T17:49:04.561754] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T17:49:05.287577] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T17:49:05.322064] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-22T17:49:05.493082] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T17:49:06.122066] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-22T17:49:06.647406] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T17:49:06.655637] [INFO ] [REMOTE ] BXMT: Full fetch complete (69352 records). [2025-09-22T17:49:06.655822] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-22T17:49:06.932410] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-22T17:49:07.079257] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-22T17:49:07.079358] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-22T17:49:07.080327] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-22T17:49:07.080421] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-22T17:49:07.085577] [DEBUG] [LOCAL ] BXMT: Trimmed 69352 records to 47231 (keeping 200 days of data) [2025-09-22T17:49:07.384984] [DEBUG] [LOCAL ] BXMT: Primary data saved (47231 records). [2025-09-22T17:49:07.385117] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-22T17:49:07.385269] [INFO ] [MAIN ] Update Progress: 374/2372 symbols completed. BXMT took 35.3s. Estimated remaining: 4h 22m 5s. Rate: 7.6 symbols/min [2025-09-22T17:49:07.568112] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:49:07.593959] [DEBUG] [LOCAL ] BY: Loaded 21803 existing records from primary storage. [2025-09-22T17:49:07.594129] [INFO ] [MAIN ] BY: Loaded 21803 existing records. [2025-09-22T17:49:07.727546] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-22T17:49:07.799896] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:49:07.800453] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-22T17:49:07.800596] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-22T17:49:07.807504] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-22T17:49:07.815178] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-22T17:49:07.865482] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T17:49:08.182200] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-22T17:49:08.327458] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:49:08.522070] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-22T17:49:09.232322] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T17:49:09.322073] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-22T17:49:09.494252] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T17:49:10.084235] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T17:49:10.121998] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-22T17:49:10.922023] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-22T17:49:11.204580] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T17:49:11.722064] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-22T17:49:12.377121] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T17:49:12.522028] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-22T17:49:12.660607] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T17:49:13.322080] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-22T17:49:14.122063] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-22T17:49:14.174375] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T17:49:14.210788] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T17:49:14.731014] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T17:49:14.922059] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-22T17:49:15.722081] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-22T17:49:15.884599] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T17:49:16.522112] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-22T17:49:16.719213] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-22T17:49:16.722233] [INFO ] [REMOTE ] BXMX: Full fetch complete (28494 records). [2025-09-22T17:49:16.722309] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-22T17:49:16.722800] [FATAL] [VALIDATOR ] BXMX: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:49:16.722884] [FATAL] [MAIN ] BXMX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:49:16.722926] [WARN ] [MAIN ] BXMX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:49:16.722965] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-22T17:49:16.723024] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-09-22T17:49:16.723058] [INFO ] [LOCAL ] BXMX: Starting deletion of derivative data. [2025-09-22T17:49:16.723453] [DEBUG] [LOCAL ] BXMX: Deleted derivative data file. [2025-09-22T17:49:16.723546] [INFO ] [MAIN ] Update Progress: 375/2372 symbols completed. BXMX took 29.8s. Estimated remaining: 4h 22m 5s. Rate: 7.6 symbols/min [2025-09-22T17:49:16.891289] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:49:16.955401] [DEBUG] [LOCAL ] BYD: Loaded 46035 existing records from primary storage. [2025-09-22T17:49:16.955566] [INFO ] [MAIN ] BYD: Loaded 46035 existing records. [2025-09-22T17:49:17.137876] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:49:17.138437] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-22T17:49:17.138495] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-22T17:49:17.139845] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-22T17:49:17.139906] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-22T17:49:17.329733] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-22T17:49:17.499850] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:49:18.122120] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-22T17:49:18.295387] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T17:49:18.922124] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-22T17:49:19.078639] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T17:49:19.123071] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T17:49:19.722082] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-22T17:49:20.221470] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T17:49:20.522072] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-22T17:49:21.322072] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-22T17:49:21.405527] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T17:49:21.435694] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T17:49:22.122058] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-22T17:49:22.922095] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-22T17:49:23.067883] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T17:49:23.076715] [INFO ] [REMOTE ] BXP: Full fetch complete (71137 records). [2025-09-22T17:49:23.076890] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-22T17:49:23.510016] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-22T17:49:23.510287] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-22T17:49:23.511528] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-22T17:49:23.512498] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-22T17:49:23.513538] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T17:49:23.524727] [DEBUG] [LOCAL ] BXP: Trimmed 71137 records to 49824 (keeping 200 days of data) [2025-09-22T17:49:23.722542] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-22T17:49:23.864876] [DEBUG] [LOCAL ] BXP: Primary data saved (49824 records). [2025-09-22T17:49:23.865044] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-22T17:49:23.865141] [INFO ] [MAIN ] Update Progress: 376/2372 symbols completed. BXP took 28.8s. Estimated remaining: 4h 21m 53s. Rate: 7.6 symbols/min [2025-09-22T17:49:24.052967] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:49:24.071954] [DEBUG] [LOCAL ] BYM: Loaded 12414 existing records from primary storage. [2025-09-22T17:49:24.072095] [INFO ] [MAIN ] BYM: Loaded 12414 existing records. [2025-09-22T17:49:24.258126] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:49:24.258419] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-22T17:49:24.258469] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-22T17:49:24.259051] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-22T17:49:24.259114] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-22T17:49:24.524243] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-22T17:49:24.661097] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:49:24.674400] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T17:49:24.707639] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T17:49:25.322060] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-22T17:49:26.122044] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-22T17:49:26.179339] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T17:49:26.282173] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T17:49:26.922038] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-22T17:49:26.943696] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T17:49:26.948144] [INFO ] [REMOTE ] BY: Full fetch complete (28965 records). [2025-09-22T17:49:26.948220] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-22T17:49:27.315358] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-22T17:49:27.315437] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-22T17:49:27.315921] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-22T17:49:27.315984] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-22T17:49:27.316730] [DEBUG] [LOCAL ] BY: Trimmed 28965 records to 21511 (keeping 200 days of data) [2025-09-22T17:49:27.446168] [DEBUG] [LOCAL ] BY: Primary data saved (21511 records). [2025-09-22T17:49:27.446303] [INFO ] [MAIN ] BY: Full history saved. [2025-09-22T17:49:27.446385] [INFO ] [MAIN ] Update Progress: 377/2372 symbols completed. BY took 20.1s. Estimated remaining: 4h 21m 23s. Rate: 7.6 symbols/min [2025-09-22T17:49:27.614830] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:49:27.615031] [DEBUG] [LOCAL ] BZH: No existing data file found in primary storage. [2025-09-22T17:49:27.615073] [WARN ] [MAIN ] BZH: No existing data found, performing full refresh instead. [2025-09-22T17:49:27.615265] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-22T17:49:27.615307] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-22T17:49:27.615348] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-09-22T17:49:27.615423] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-22T17:49:27.724133] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-22T17:49:27.991977] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:49:28.522046] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-22T17:49:28.550703] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T17:49:28.571835] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T17:49:29.322061] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-22T17:49:29.663367] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T17:49:30.122120] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-22T17:49:30.297636] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T17:49:30.870681] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-22T17:49:30.922067] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-22T17:49:31.714173] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T17:49:31.721993] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-22T17:49:32.474175] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T17:49:32.522032] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-22T17:49:33.103376] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T17:49:33.322063] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-22T17:49:34.126352] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-22T17:49:34.128973] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T17:49:34.922094] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-22T17:49:35.108307] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-22T17:49:35.524257] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T17:49:35.722118] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-22T17:49:36.522124] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-22T17:49:37.160018] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T17:49:37.322062] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-22T17:49:38.122120] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-22T17:49:38.445256] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T17:49:38.891125] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T17:49:38.922013] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-22T17:49:39.506399] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T17:49:39.722093] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-22T17:49:39.876447] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T17:49:40.522073] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-22T17:49:40.991960] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T17:49:41.322027] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-22T17:49:41.372276] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T17:49:42.122072] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-22T17:49:42.919849] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T17:49:42.930035] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-22T17:49:43.297306] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T17:49:43.722051] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-22T17:49:43.887161] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T17:49:43.889698] [INFO ] [REMOTE ] BYM: Full fetch complete (17969 records). [2025-09-22T17:49:43.889776] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-22T17:49:44.273139] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-22T17:49:44.273224] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-22T17:49:44.273700] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-22T17:49:44.273788] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-22T17:49:44.274432] [DEBUG] [LOCAL ] BYM: Trimmed 17969 records to 12167 (keeping 200 days of data) [2025-09-22T17:49:44.353929] [DEBUG] [LOCAL ] BYM: Primary data saved (12167 records). [2025-09-22T17:49:44.354077] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-22T17:49:44.354167] [INFO ] [MAIN ] Update Progress: 378/2372 symbols completed. BYM took 20.5s. Estimated remaining: 4h 22m 3s. Rate: 7.6 symbols/min [2025-09-22T17:49:44.530951] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:49:44.527393] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-22T17:49:44.591203] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-22T17:49:44.591369] [INFO ] [MAIN ] C: Loaded 54521 existing records. [2025-09-22T17:49:44.776338] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:49:44.776632] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-22T17:49:44.776752] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-22T17:49:44.778609] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-22T17:49:44.778709] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-22T17:49:45.143025] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:49:45.164238] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T17:49:45.322047] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-22T17:49:45.888638] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T17:49:46.122020] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-22T17:49:46.632708] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T17:49:46.922126] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-22T17:49:47.722065] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-22T17:49:48.161040] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-22T17:49:48.302073] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T17:49:48.522112] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-22T17:49:49.046042] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T17:49:49.322097] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-22T17:49:49.633962] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T17:49:50.122107] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-22T17:49:50.922104] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-22T17:49:51.502925] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-22T17:49:51.718074] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T17:49:51.730340] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-22T17:49:52.151918] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T17:49:52.522078] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-22T17:49:52.865310] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T17:49:52.871109] [INFO ] [REMOTE ] BZH: Full fetch complete (47022 records). [2025-09-22T17:49:52.871230] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-22T17:49:53.276519] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-22T17:49:53.276614] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-22T17:49:53.277282] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-22T17:49:53.277343] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-22T17:49:53.278470] [DEBUG] [LOCAL ] BZH: Trimmed 47022 records to 32788 (keeping 200 days of data) [2025-09-22T17:49:53.330207] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-22T17:49:53.481299] [DEBUG] [LOCAL ] BZH: Primary data saved (32788 records). [2025-09-22T17:49:53.481458] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-22T17:49:53.481539] [INFO ] [MAIN ] Update Progress: 379/2372 symbols completed. BZH took 26.0s. Estimated remaining: 4h 22m 1s. Rate: 7.6 symbols/min [2025-09-22T17:49:53.657848] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:49:53.679016] [DEBUG] [LOCAL ] CAAP: Loaded 19495 existing records from primary storage. [2025-09-22T17:49:53.679152] [INFO ] [MAIN ] CAAP: Loaded 19495 existing records. [2025-09-22T17:49:53.856685] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:49:53.856961] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-22T17:49:53.857010] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-22T17:49:53.857726] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-22T17:49:53.857803] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-22T17:49:54.126765] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-22T17:49:54.242774] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:49:54.276969] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T17:49:54.922087] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-22T17:49:55.061312] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T17:49:55.410333] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T17:49:55.722153] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-22T17:49:56.522072] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-22T17:49:56.712808] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T17:49:56.724373] [INFO ] [REMOTE ] BXSL: Full fetch complete (69151 records). [2025-09-22T17:49:56.724583] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-22T17:49:57.133205] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-22T17:49:57.133465] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-22T17:49:57.134392] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-22T17:49:57.134515] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-22T17:49:57.162997] [DEBUG] [LOCAL ] BXSL: Trimmed 69151 records to 47462 (keeping 200 days of data) [2025-09-22T17:49:57.164797] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T17:49:57.176727] [INFO ] [REMOTE ] BYD: Full fetch complete (64944 records). [2025-09-22T17:49:57.176899] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-22T17:49:57.345247] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-22T17:49:57.710366] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-22T17:49:57.710526] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-22T17:49:57.711901] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-22T17:49:57.712905] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-22T17:49:57.732500] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T17:49:57.731873] [DEBUG] [LOCAL ] BYD: Trimmed 64944 records to 45355 (keeping 200 days of data) [2025-09-22T17:49:58.122506] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-22T17:49:58.181448] [DEBUG] [LOCAL ] BXSL: Primary data saved (47462 records). [2025-09-22T17:49:58.182177] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-22T17:49:58.182577] [INFO ] [MAIN ] Update Progress: 380/2372 symbols completed. BXSL took 55.9s. Estimated remaining: 4h 21m 37s. Rate: 7.6 symbols/min [2025-09-22T17:49:58.368688] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:49:58.416107] [DEBUG] [LOCAL ] CABO: Loaded 17935 existing records from primary storage. [2025-09-22T17:49:58.416836] [INFO ] [MAIN ] CABO: Loaded 17935 existing records. [2025-09-22T17:49:58.534145] [DEBUG] [LOCAL ] BYD: Primary data saved (45355 records). [2025-09-22T17:49:58.550894] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-22T17:49:58.561367] [INFO ] [MAIN ] Update Progress: 381/2372 symbols completed. BYD took 41.8s. Estimated remaining: 4h 20m 50s. Rate: 7.6 symbols/min [2025-09-22T17:49:58.721915] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:49:58.733824] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-22T17:49:58.734184] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-22T17:49:58.787247] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-22T17:49:58.805359] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-22T17:49:58.814324] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:49:59.154892] [DEBUG] [LOCAL ] CACI: Loaded 26262 existing records from primary storage. [2025-09-22T17:49:59.213743] [INFO ] [MAIN ] CACI: Loaded 26262 existing records. [2025-09-22T17:49:59.217301] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:49:59.238956] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-22T17:49:59.362160] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T17:49:59.432384] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:49:59.432803] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-22T17:49:59.432879] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-22T17:49:59.434067] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-22T17:49:59.434161] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-22T17:49:59.724777] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-22T17:49:59.820582] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-22T17:49:59.861065] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:49:59.993711] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-22T17:50:00.413754] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T17:50:00.522060] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-22T17:50:01.322084] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-22T17:50:01.760722] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T17:50:02.122136] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-22T17:50:02.267455] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T17:50:02.922069] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-22T17:50:03.723047] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-22T17:50:03.726354] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T17:50:04.522127] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-22T17:50:05.073589] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-09-22T17:50:05.110175] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T17:50:05.322065] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-22T17:50:06.085128] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T17:50:06.122008] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-22T17:50:06.922051] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-22T17:50:07.627344] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T17:50:07.722089] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-22T17:50:08.009604] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-09-22T17:50:08.529200] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-22T17:50:08.542035] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T17:50:08.858536] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T17:50:09.322067] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-22T17:50:10.122057] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-22T17:50:10.668136] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T17:50:10.869602] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-22T17:50:10.889553] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-22T17:50:10.922007] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-22T17:50:11.722063] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-22T17:50:12.420243] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T17:50:12.522040] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-22T17:50:13.322068] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-22T17:50:13.653671] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T17:50:13.789890] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T17:50:14.122080] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-22T17:50:14.922116] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-22T17:50:15.175375] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T17:50:15.657163] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-22T17:50:15.722032] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-22T17:50:15.913019] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T17:50:16.522137] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-22T17:50:16.797406] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T17:50:17.322070] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-22T17:50:18.017813] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T17:50:18.122074] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-22T17:50:18.302626] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T17:50:18.922050] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-22T17:50:19.722074] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-22T17:50:19.896942] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-22T17:50:20.195205] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-22T17:50:20.522144] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-22T17:50:20.885155] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T17:50:21.322069] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-22T17:50:21.643700] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T17:50:22.122079] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-22T17:50:22.182194] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-22T17:50:22.187275] [INFO ] [REMOTE ] CAAP: Full fetch complete (27561 records). [2025-09-22T17:50:22.187418] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-22T17:50:22.609964] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-22T17:50:22.610068] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-22T17:50:22.610548] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-22T17:50:22.610593] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-22T17:50:22.611614] [DEBUG] [LOCAL ] CAAP: Trimmed 27561 records to 19303 (keeping 200 days of data) [2025-09-22T17:50:22.724632] [DEBUG] [LOCAL ] CAAP: Primary data saved (19303 records). [2025-09-22T17:50:22.724857] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-22T17:50:22.724971] [INFO ] [MAIN ] Update Progress: 382/2372 symbols completed. CAAP took 29.2s. Estimated remaining: 4h 22m 7s. Rate: 7.6 symbols/min [2025-09-22T17:50:22.897410] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:50:22.897593] [DEBUG] [LOCAL ] CADE: No existing data file found in primary storage. [2025-09-22T17:50:22.897631] [WARN ] [MAIN ] CADE: No existing data found, performing full refresh instead. [2025-09-22T17:50:22.897796] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-22T17:50:22.897842] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-22T17:50:22.897932] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-22T17:50:22.897973] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-22T17:50:22.932584] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-22T17:50:23.288136] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:50:23.298367] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T17:50:23.722095] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-22T17:50:24.522070] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-22T17:50:24.865416] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T17:50:24.873837] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-09-22T17:50:24.873986] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-22T17:50:25.272585] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-22T17:50:25.272746] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-22T17:50:25.273574] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-22T17:50:25.273620] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-22T17:50:25.275198] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53741 (keeping 200 days of data) [2025-09-22T17:50:25.334537] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-22T17:50:25.390677] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T17:50:25.400087] [INFO ] [REMOTE ] CACI: Full fetch complete (39032 records). [2025-09-22T17:50:25.401952] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-22T17:50:25.405028] [FATAL] [VALIDATOR ] CACI: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:50:25.405820] [FATAL] [MAIN ] CACI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:50:25.406932] [WARN ] [MAIN ] CACI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:50:25.407034] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-22T17:50:25.407905] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-09-22T17:50:25.408593] [INFO ] [LOCAL ] CACI: Starting deletion of derivative data. [2025-09-22T17:50:25.410424] [DEBUG] [LOCAL ] CACI: Deleted derivative data file. [2025-09-22T17:50:25.410890] [INFO ] [MAIN ] Update Progress: 383/2372 symbols completed. CACI took 26.8s. Estimated remaining: 4h 21m 32s. Rate: 7.6 symbols/min [2025-09-22T17:50:25.490005] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T17:50:25.718936] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:50:25.875460] [DEBUG] [LOCAL ] CAE: Loaded 39492 existing records from primary storage. [2025-09-22T17:50:25.877535] [INFO ] [MAIN ] CAE: Loaded 39492 existing records. [2025-09-22T17:50:26.073941] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:50:26.075894] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-22T17:50:26.076335] [INFO ] [MAIN ] C: Full history saved. [2025-09-22T17:50:26.076423] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-22T17:50:26.076516] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-22T17:50:26.076680] [INFO ] [MAIN ] Update Progress: 384/2372 symbols completed. C took 41.7s. Estimated remaining: 4h 20m 46s. Rate: 7.6 symbols/min [2025-09-22T17:50:26.088588] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-22T17:50:26.132355] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-22T17:50:26.109490] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-22T17:50:26.373032] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:50:26.459060] [DEBUG] [LOCAL ] CAF: Loaded 3481 existing records from primary storage. [2025-09-22T17:50:26.494469] [INFO ] [MAIN ] CAF: Loaded 3481 existing records. [2025-09-22T17:50:26.737085] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T17:50:26.820721] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:50:26.862432] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:50:26.862694] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-22T17:50:26.862753] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-22T17:50:26.862994] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-22T17:50:26.863054] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-22T17:50:26.927225] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-22T17:50:27.283087] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:50:27.639329] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T17:50:27.722019] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-22T17:50:27.850132] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T17:50:27.852775] [INFO ] [REMOTE ] CABO: Full fetch complete (22939 records). [2025-09-22T17:50:27.852883] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-22T17:50:28.256043] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-22T17:50:28.256176] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-22T17:50:28.256727] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-22T17:50:28.256796] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-22T17:50:28.257540] [DEBUG] [LOCAL ] CABO: Trimmed 22939 records to 17506 (keeping 200 days of data) [2025-09-22T17:50:28.375711] [DEBUG] [LOCAL ] CABO: Primary data saved (17506 records). [2025-09-22T17:50:28.375885] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-22T17:50:28.375982] [INFO ] [MAIN ] Update Progress: 385/2372 symbols completed. CABO took 30.2s. Estimated remaining: 4h 20m 10s. Rate: 7.6 symbols/min [2025-09-22T17:50:28.527171] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-22T17:50:28.562368] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:50:28.629358] [DEBUG] [LOCAL ] CAG: Loaded 54438 existing records from primary storage. [2025-09-22T17:50:28.629553] [INFO ] [MAIN ] CAG: Loaded 54438 existing records. [2025-09-22T17:50:28.817179] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:50:28.817721] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-22T17:50:28.817800] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-22T17:50:28.819505] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-22T17:50:28.819572] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-22T17:50:29.090506] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T17:50:29.247489] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:50:29.322046] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-22T17:50:29.330337] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-22T17:50:30.122057] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-22T17:50:30.800391] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T17:50:30.922053] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-22T17:50:31.582488] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-22T17:50:31.722078] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-22T17:50:31.894923] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T17:50:32.522119] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-22T17:50:33.085370] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T17:50:33.322065] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-22T17:50:33.768291] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-22T17:50:33.920304] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T17:50:34.122069] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-22T17:50:34.676239] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-22T17:50:34.922039] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-22T17:50:35.319871] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-22T17:50:35.722062] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-22T17:50:36.522049] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-22T17:50:37.235059] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T17:50:37.322078] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-22T17:50:37.711890] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-22T17:50:38.020353] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T17:50:38.122069] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-22T17:50:38.922075] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-22T17:50:39.479117] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-22T17:50:39.580629] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T17:50:39.722085] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-22T17:50:40.522267] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-22T17:50:41.322040] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-22T17:50:41.372303] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T17:50:41.530072] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T17:50:42.122081] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-22T17:50:42.922053] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-22T17:50:43.089543] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T17:50:43.286272] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T17:50:43.722080] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-22T17:50:44.480858] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T17:50:44.522000] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-22T17:50:45.301306] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T17:50:45.322007] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-22T17:50:46.122037] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-22T17:50:46.313617] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T17:50:46.480396] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-22T17:50:46.922091] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-22T17:50:47.084747] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T17:50:47.722097] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-22T17:50:47.766809] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T17:50:48.522126] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-22T17:50:49.153049] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T17:50:49.322064] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-22T17:50:50.085017] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T17:50:50.086343] [INFO ] [REMOTE ] CAF: Full fetch complete (5825 records). [2025-09-22T17:50:50.086415] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-22T17:50:50.130867] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-22T17:50:50.457987] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-22T17:50:50.458141] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-22T17:50:50.458530] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-22T17:50:50.458631] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-22T17:50:50.459070] [DEBUG] [LOCAL ] CAF: Trimmed 5825 records to 3423 (keeping 200 days of data) [2025-09-22T17:50:50.480474] [DEBUG] [LOCAL ] CAF: Primary data saved (3423 records). [2025-09-22T17:50:50.480575] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-22T17:50:50.480787] [INFO ] [MAIN ] Update Progress: 386/2372 symbols completed. CAF took 24.4s. Estimated remaining: 4h 21m 15s. Rate: 7.6 symbols/min [2025-09-22T17:50:50.657776] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-22T17:50:50.683014] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:50:50.747960] [DEBUG] [LOCAL ] CAH: Loaded 52263 existing records from primary storage. [2025-09-22T17:50:50.748154] [INFO ] [MAIN ] CAH: Loaded 52263 existing records. [2025-09-22T17:50:50.925947] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:50:50.925832] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-22T17:50:50.927031] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-22T17:50:50.927099] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-22T17:50:50.928769] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-22T17:50:50.928836] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-22T17:50:51.302090] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:50:51.683115] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T17:50:51.692376] [INFO ] [REMOTE ] CADE: Full fetch complete (69641 records). [2025-09-22T17:50:51.692562] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-22T17:50:51.727241] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-22T17:50:52.089759] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-22T17:50:52.089849] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-22T17:50:52.090606] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-22T17:50:52.090676] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-22T17:50:52.092181] [DEBUG] [LOCAL ] CADE: Trimmed 69641 records to 48797 (keeping 200 days of data) [2025-09-22T17:50:52.330189] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T17:50:52.430534] [DEBUG] [LOCAL ] CADE: Primary data saved (48797 records). [2025-09-22T17:50:52.430725] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-22T17:50:52.430820] [INFO ] [MAIN ] Update Progress: 387/2372 symbols completed. CADE took 29.7s. Estimated remaining: 4h 20m 37s. Rate: 7.6 symbols/min [2025-09-22T17:50:52.528193] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-22T17:50:52.621037] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:50:52.667720] [DEBUG] [LOCAL ] CAL: Loaded 43947 existing records from primary storage. [2025-09-22T17:50:52.667884] [INFO ] [MAIN ] CAL: Loaded 43947 existing records. [2025-09-22T17:50:52.865015] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:50:52.865310] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-22T17:50:52.865362] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-22T17:50:52.866681] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-22T17:50:52.866745] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-22T17:50:53.255932] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:50:53.324527] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-22T17:50:53.331124] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T17:50:54.122027] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-22T17:50:54.599614] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T17:50:54.663714] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-22T17:50:54.922058] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-22T17:50:55.722124] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-22T17:50:55.891537] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-22T17:50:56.387282] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T17:50:56.522018] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-22T17:50:57.113057] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T17:50:57.322043] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-22T17:50:58.122080] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-22T17:50:58.266300] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T17:50:58.276285] [INFO ] [REMOTE ] CAG: Full fetch complete (77641 records). [2025-09-22T17:50:58.276409] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-22T17:50:58.673396] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-22T17:50:58.673475] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-22T17:50:58.674391] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-22T17:50:58.674459] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-22T17:50:58.676028] [DEBUG] [LOCAL ] CAG: Trimmed 77641 records to 53659 (keeping 200 days of data) [2025-09-22T17:50:58.932928] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-22T17:50:58.938064] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T17:50:59.055665] [DEBUG] [LOCAL ] CAG: Primary data saved (53659 records). [2025-09-22T17:50:59.055816] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-22T17:50:59.055906] [INFO ] [MAIN ] Update Progress: 388/2372 symbols completed. CAG took 30.7s. Estimated remaining: 4h 20m 23s. Rate: 7.6 symbols/min [2025-09-22T17:50:59.234239] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:50:59.277628] [DEBUG] [LOCAL ] CALX: Loaded 39339 existing records from primary storage. [2025-09-22T17:50:59.277873] [INFO ] [MAIN ] CALX: Loaded 39339 existing records. [2025-09-22T17:50:59.415486] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-22T17:50:59.508044] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:50:59.508311] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-22T17:50:59.508367] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-22T17:50:59.509203] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-22T17:50:59.509265] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-22T17:50:59.727255] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-22T17:50:59.877075] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:51:00.522019] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-22T17:51:00.625741] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T17:51:01.322069] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-22T17:51:01.721000] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T17:51:02.122044] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-22T17:51:02.536901] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-22T17:51:02.922109] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-22T17:51:03.722066] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-22T17:51:04.295588] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (2.97 seconds). [2025-09-22T17:51:04.522116] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-22T17:51:05.135294] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-22T17:51:05.322055] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-22T17:51:05.628474] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T17:51:05.685834] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (3.56 seconds). [2025-09-22T17:51:05.712509] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-22T17:51:05.718546] [INFO ] [REMOTE ] CAE: Full fetch complete (55624 records). [2025-09-22T17:51:05.718695] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-22T17:51:06.117392] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-22T17:51:06.117504] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-22T17:51:06.119309] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-22T17:51:06.119390] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-22T17:51:06.121002] [DEBUG] [LOCAL ] CAE: Trimmed 55624 records to 38913 (keeping 200 days of data) [2025-09-22T17:51:06.122135] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-22T17:51:06.362504] [DEBUG] [LOCAL ] CAE: Primary data saved (38913 records). [2025-09-22T17:51:06.362676] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-22T17:51:06.362845] [INFO ] [MAIN ] Update Progress: 389/2372 symbols completed. CAE took 41.0s. Estimated remaining: 4h 20m 12s. Rate: 7.6 symbols/min [2025-09-22T17:51:06.531986] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:51:06.562635] [DEBUG] [LOCAL ] CANG: Loaded 27140 existing records from primary storage. [2025-09-22T17:51:06.562957] [INFO ] [MAIN ] CANG: Loaded 27140 existing records. [2025-09-22T17:51:06.764975] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:51:06.765940] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-22T17:51:06.766067] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-22T17:51:06.774618] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-22T17:51:06.784305] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-22T17:51:06.858731] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T17:51:06.927175] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-22T17:51:07.173900] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:51:07.722076] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-22T17:51:07.964463] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T17:51:08.522150] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-22T17:51:08.665147] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T17:51:09.142283] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T17:51:09.322071] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-22T17:51:10.122097] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-22T17:51:10.307220] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T17:51:10.765755] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T17:51:10.922059] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-22T17:51:11.441207] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T17:51:11.722082] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-22T17:51:12.503429] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T17:51:12.522001] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-22T17:51:13.033858] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T17:51:13.322102] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-22T17:51:14.122073] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-22T17:51:14.436246] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T17:51:14.922079] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-22T17:51:15.644008] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T17:51:15.722026] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-22T17:51:16.004402] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-22T17:51:16.116305] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T17:51:16.522056] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-22T17:51:16.852231] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T17:51:17.322054] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-22T17:51:17.706352] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T17:51:18.122069] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-22T17:51:18.774568] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T17:51:18.922049] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-22T17:51:19.722043] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-22T17:51:20.054560] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T17:51:20.121715] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T17:51:20.522089] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-22T17:51:20.772187] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T17:51:21.322067] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-22T17:51:21.849005] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T17:51:22.122108] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-22T17:51:22.922071] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-22T17:51:23.179057] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T17:51:23.187215] [INFO ] [REMOTE ] CAH: Full fetch complete (74578 records). [2025-09-22T17:51:23.187373] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-22T17:51:23.591226] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-22T17:51:23.591331] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-22T17:51:23.592255] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-22T17:51:23.592319] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-22T17:51:23.594139] [DEBUG] [LOCAL ] CAH: Trimmed 74578 records to 51466 (keeping 200 days of data) [2025-09-22T17:51:23.722480] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-22T17:51:23.773117] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T17:51:23.994294] [DEBUG] [LOCAL ] CAH: Primary data saved (51466 records). [2025-09-22T17:51:23.994527] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-22T17:51:23.994714] [INFO ] [MAIN ] Update Progress: 390/2372 symbols completed. CAH took 33.5s. Estimated remaining: 4h 20m 54s. Rate: 7.6 symbols/min [2025-09-22T17:51:24.179171] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T17:51:24.204288] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:51:24.205280] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-09-22T17:51:24.205342] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-09-22T17:51:24.205985] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-22T17:51:24.206040] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-22T17:51:24.206084] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-09-22T17:51:24.206126] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-22T17:51:24.527184] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-22T17:51:24.569811] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:51:25.322108] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-22T17:51:26.122098] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-22T17:51:26.163409] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T17:51:26.232831] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-22T17:51:26.922065] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-22T17:51:27.722126] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-22T17:51:27.958576] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-22T17:51:28.060941] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-22T17:51:28.522061] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-22T17:51:28.910722] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T17:51:29.214142] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-22T17:51:29.221580] [INFO ] [REMOTE ] CAL: Full fetch complete (61909 records). [2025-09-22T17:51:29.221776] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-22T17:51:29.323327] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-22T17:51:29.400242] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T17:51:29.656958] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-22T17:51:29.657076] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-22T17:51:29.657895] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-22T17:51:29.657961] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-22T17:51:29.659382] [DEBUG] [LOCAL ] CAL: Trimmed 61909 records to 43280 (keeping 200 days of data) [2025-09-22T17:51:29.936917] [DEBUG] [LOCAL ] CAL: Primary data saved (43280 records). [2025-09-22T17:51:29.937051] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-22T17:51:29.938595] [INFO ] [MAIN ] Update Progress: 391/2372 symbols completed. CAL took 37.5s. Estimated remaining: 4h 20m 36s. Rate: 7.6 symbols/min [2025-09-22T17:51:30.117218] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:51:30.122097] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-22T17:51:30.183968] [DEBUG] [LOCAL ] CARR: Loaded 54375 existing records from primary storage. [2025-09-22T17:51:30.185000] [INFO ] [MAIN ] CARR: Loaded 54375 existing records. [2025-09-22T17:51:30.362885] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:51:30.363268] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-22T17:51:30.363326] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-22T17:51:30.364855] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-22T17:51:30.364917] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-22T17:51:30.738391] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T17:51:30.744164] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:51:30.922064] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-22T17:51:31.213331] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T17:51:31.219181] [INFO ] [REMOTE ] CALX: Full fetch complete (54114 records). [2025-09-22T17:51:31.219293] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-22T17:51:31.630240] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-22T17:51:31.630334] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-22T17:51:31.631092] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-22T17:51:31.631164] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-22T17:51:31.635707] [DEBUG] [LOCAL ] CALX: Trimmed 54114 records to 38657 (keeping 200 days of data) [2025-09-22T17:51:31.737164] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-22T17:51:31.893401] [DEBUG] [LOCAL ] CALX: Primary data saved (38657 records). [2025-09-22T17:51:31.893575] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-22T17:51:31.893724] [INFO ] [MAIN ] Update Progress: 392/2372 symbols completed. CALX took 32.8s. Estimated remaining: 4h 19m 58s. Rate: 7.6 symbols/min [2025-09-22T17:51:32.082757] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:51:32.132487] [DEBUG] [LOCAL ] CARS: Loaded 41029 existing records from primary storage. [2025-09-22T17:51:32.132638] [INFO ] [MAIN ] CARS: Loaded 41029 existing records. [2025-09-22T17:51:32.329559] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:51:32.330026] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-22T17:51:32.330160] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-22T17:51:32.331245] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-22T17:51:32.331310] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-22T17:51:32.531971] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-22T17:51:32.821500] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:51:32.825479] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-22T17:51:32.860952] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T17:51:32.867973] [INFO ] [REMOTE ] CANG: Full fetch complete (40539 records). [2025-09-22T17:51:32.868310] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-22T17:51:33.325375] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-22T17:51:33.326218] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T17:51:33.460763] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-22T17:51:33.460899] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-22T17:51:33.462093] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-22T17:51:33.462182] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-22T17:51:33.463794] [DEBUG] [LOCAL ] CANG: Trimmed 40539 records to 26659 (keeping 200 days of data) [2025-09-22T17:51:33.690275] [DEBUG] [LOCAL ] CANG: Primary data saved (26659 records). [2025-09-22T17:51:33.690487] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-22T17:51:33.690705] [INFO ] [MAIN ] Update Progress: 393/2372 symbols completed. CANG took 27.3s. Estimated remaining: 4h 19m 19s. Rate: 7.6 symbols/min [2025-09-22T17:51:33.909552] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:51:33.979419] [DEBUG] [LOCAL ] CAT: Loaded 53709 existing records from primary storage. [2025-09-22T17:51:33.979580] [INFO ] [MAIN ] CAT: Loaded 53709 existing records. [2025-09-22T17:51:34.130752] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-22T17:51:34.173034] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:51:34.173305] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-22T17:51:34.173354] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-22T17:51:34.174718] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-22T17:51:34.174787] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-22T17:51:34.545396] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:51:34.913532] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T17:51:34.922454] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-22T17:51:35.507822] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T17:51:35.722072] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-22T17:51:36.522061] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-22T17:51:36.908088] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-22T17:51:37.043722] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T17:51:37.258396] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T17:51:37.322057] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-22T17:51:37.811538] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-22T17:51:38.122062] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-22T17:51:38.922072] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-22T17:51:39.722071] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-22T17:51:39.775563] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T17:51:40.100183] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-22T17:51:40.522059] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-22T17:51:41.095144] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T17:51:41.270739] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T17:51:41.322012] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-22T17:51:42.122052] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-22T17:51:42.922061] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-22T17:51:43.029774] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T17:51:43.722365] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-22T17:51:43.828757] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T17:51:43.883875] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T17:51:44.522114] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-22T17:51:45.194019] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T17:51:45.322064] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-22T17:51:46.122031] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-22T17:51:46.238768] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T17:51:46.706608] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T17:51:46.771567] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-22T17:51:46.922064] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-22T17:51:47.722062] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-22T17:51:47.953354] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T17:51:48.522085] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-22T17:51:49.322050] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-22T17:51:49.587866] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T17:51:50.004203] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T17:51:50.122022] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-22T17:51:50.248076] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T17:51:50.739239] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T17:51:50.740700] [INFO ] [REMOTE ] CAPL: Full fetch complete (8954 records). [2025-09-22T17:51:50.740770] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-22T17:51:50.927254] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-22T17:51:51.111407] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-22T17:51:51.111511] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-22T17:51:51.111791] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-22T17:51:51.111853] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-22T17:51:51.112271] [DEBUG] [LOCAL ] CAPL: Trimmed 8954 records to 5880 (keeping 200 days of data) [2025-09-22T17:51:51.149220] [DEBUG] [LOCAL ] CAPL: Primary data saved (5880 records). [2025-09-22T17:51:51.149365] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-22T17:51:51.149484] [INFO ] [MAIN ] Update Progress: 394/2372 symbols completed. CAPL took 27.2s. Estimated remaining: 4h 19m 60s. Rate: 7.6 symbols/min [2025-09-22T17:51:51.317872] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:51:51.328386] [DEBUG] [LOCAL ] CATO: Loaded 7531 existing records from primary storage. [2025-09-22T17:51:51.328499] [INFO ] [MAIN ] CATO: Loaded 7531 existing records. [2025-09-22T17:51:51.503224] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:51:51.503455] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-22T17:51:51.503502] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-22T17:51:51.503877] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-22T17:51:51.503936] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-22T17:51:51.731179] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-22T17:51:51.858206] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:51:52.522056] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-22T17:51:52.623018] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T17:51:53.016811] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T17:51:53.322078] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-22T17:51:54.122086] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-22T17:51:54.569578] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T17:51:54.922146] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-22T17:51:55.413152] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-22T17:51:55.476214] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T17:51:55.722141] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-22T17:51:56.522116] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-22T17:51:56.715440] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T17:51:56.799937] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T17:51:56.808742] [INFO ] [REMOTE ] CARR: Full fetch complete (77595 records). [2025-09-22T17:51:56.808929] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-22T17:51:57.207945] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-22T17:51:57.208073] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-22T17:51:57.209124] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-22T17:51:57.209213] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-22T17:51:57.211560] [DEBUG] [LOCAL ] CARR: Trimmed 77595 records to 53596 (keeping 200 days of data) [2025-09-22T17:51:57.323092] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-22T17:51:57.575567] [DEBUG] [LOCAL ] CARR: Primary data saved (53596 records). [2025-09-22T17:51:57.575811] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-22T17:51:57.576665] [INFO ] [MAIN ] Update Progress: 395/2372 symbols completed. CARR took 27.6s. Estimated remaining: 4h 19m 45s. Rate: 7.6 symbols/min [2025-09-22T17:51:57.778587] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:51:57.845372] [DEBUG] [LOCAL ] CAVA: Loaded 54332 existing records from primary storage. [2025-09-22T17:51:57.845611] [INFO ] [MAIN ] CAVA: Loaded 54332 existing records. [2025-09-22T17:51:58.047751] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:51:58.050845] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-22T17:51:58.051060] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-22T17:51:58.050709] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T17:51:58.053835] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-22T17:51:58.054031] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-22T17:51:58.122266] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-22T17:51:58.277717] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T17:51:58.478305] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:51:58.708077] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T17:51:58.922098] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-22T17:51:59.722065] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-22T17:52:00.522061] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-22T17:52:01.322103] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-22T17:52:01.357681] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-22T17:52:01.604770] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T17:52:01.813963] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T17:52:01.850788] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-22T17:52:02.122052] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-22T17:52:02.905499] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T17:52:02.922055] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-22T17:52:03.545852] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T17:52:03.722052] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-22T17:52:04.377072] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T17:52:04.522063] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-22T17:52:05.322054] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-22T17:52:05.833440] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-22T17:52:06.076388] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T17:52:06.122035] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-22T17:52:06.922073] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-22T17:52:07.161525] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T17:52:07.722061] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-22T17:52:08.522114] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-22T17:52:08.790794] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T17:52:09.173277] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-22T17:52:09.322041] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-22T17:52:09.414875] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T17:52:09.417186] [INFO ] [REMOTE ] CATO: Full fetch complete (12204 records). [2025-09-22T17:52:09.417260] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-22T17:52:09.782927] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-22T17:52:09.783022] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-22T17:52:09.783361] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-22T17:52:09.783419] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-22T17:52:09.783919] [DEBUG] [LOCAL ] CATO: Trimmed 12204 records to 7350 (keeping 200 days of data) [2025-09-22T17:52:09.825555] [DEBUG] [LOCAL ] CATO: Primary data saved (7350 records). [2025-09-22T17:52:09.825708] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-22T17:52:09.825809] [INFO ] [MAIN ] Update Progress: 396/2372 symbols completed. CATO took 18.7s. Estimated remaining: 4h 19m 58s. Rate: 7.6 symbols/min [2025-09-22T17:52:09.996748] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:52:10.061494] [DEBUG] [LOCAL ] CB: Loaded 50868 existing records from primary storage. [2025-09-22T17:52:10.061687] [INFO ] [MAIN ] CB: Loaded 50868 existing records. [2025-09-22T17:52:10.128019] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-22T17:52:10.251866] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:52:10.252188] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-22T17:52:10.252245] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-22T17:52:10.253317] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-22T17:52:10.253379] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-22T17:52:10.623705] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:52:10.922094] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-22T17:52:11.502926] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-22T17:52:11.511369] [INFO ] [REMOTE ] CAT: Full fetch complete (76589 records). [2025-09-22T17:52:11.511503] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-22T17:52:11.743020] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-22T17:52:11.924316] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-22T17:52:11.924444] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-22T17:52:11.925327] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-22T17:52:11.925577] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-22T17:52:11.981526] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T17:52:11.989937] [DEBUG] [LOCAL ] CAT: Trimmed 76589 records to 52926 (keeping 200 days of data) [2025-09-22T17:52:11.991235] [INFO ] [REMOTE ] CARS: Full fetch complete (55352 records). [2025-09-22T17:52:11.991370] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-22T17:52:12.528607] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-22T17:52:12.529366] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-22T17:52:12.531284] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-22T17:52:12.534353] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-22T17:52:12.541401] [DEBUG] [LOCAL ] CARS: Trimmed 55352 records to 40297 (keeping 200 days of data) [2025-09-22T17:52:12.920841] [DEBUG] [LOCAL ] CARS: Primary data saved (40297 records). [2025-09-22T17:52:12.922183] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-22T17:52:12.922729] [INFO ] [MAIN ] Update Progress: 397/2372 symbols completed. CARS took 41.0s. Estimated remaining: 4h 19m 27s. Rate: 7.6 symbols/min [2025-09-22T17:52:12.952788] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-22T17:52:12.970145] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-22T17:52:13.070939] [DEBUG] [LOCAL ] CAT: Primary data saved (52926 records). [2025-09-22T17:52:13.071100] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-22T17:52:13.071233] [INFO ] [MAIN ] Update Progress: 398/2372 symbols completed. CAT took 39.4s. Estimated remaining: 4h 18m 40s. Rate: 7.6 symbols/min [2025-09-22T17:52:13.341188] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T17:52:13.351396] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-22T17:52:14.979233] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-22T17:52:14.989523] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-22T17:52:15.221019] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T17:52:15.231973] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-22T17:52:16.937206] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T17:52:16.961759] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-22T17:52:16.993994] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T17:52:17.007000] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-22T17:52:18.739527] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T17:52:18.751837] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-22T17:52:19.126381] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-22T17:52:19.137560] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-22T17:52:20.840988] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T17:52:20.853164] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-22T17:52:20.971638] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-22T17:52:20.983477] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-22T17:52:22.648789] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T17:52:22.659028] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-22T17:52:23.111238] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-22T17:52:23.122079] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-22T17:52:24.491376] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T17:52:24.502372] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-22T17:52:24.978055] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T17:52:24.990497] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-22T17:52:26.181901] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T17:52:26.195256] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-22T17:52:26.816569] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T17:52:26.830400] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-22T17:52:28.088595] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T17:52:28.101871] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-22T17:52:29.017384] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-22T17:52:29.025951] [INFO ] [REMOTE ] CAVA: Full fetch complete (77271 records). [2025-09-22T17:52:29.026128] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-22T17:52:29.426631] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-22T17:52:29.426753] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-22T17:52:29.427598] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-22T17:52:29.427670] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-22T17:52:29.429277] [DEBUG] [LOCAL ] CAVA: Trimmed 77271 records to 53552 (keeping 200 days of data) [2025-09-22T17:52:29.761249] [DEBUG] [LOCAL ] CAVA: Primary data saved (53552 records). [2025-09-22T17:52:29.761518] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-22T17:52:29.762353] [INFO ] [MAIN ] Update Progress: 399/2372 symbols completed. CAVA took 32.2s. Estimated remaining: 4h 19m 16s. Rate: 7.6 symbols/min [2025-09-22T17:52:30.004786] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T17:52:30.012725] [INFO ] [REMOTE ] CB: Full fetch complete (72657 records). [2025-09-22T17:52:30.012854] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-22T17:52:30.409688] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-22T17:52:30.409779] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-22T17:52:30.410573] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-22T17:52:30.410617] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-22T17:52:30.412108] [DEBUG] [LOCAL ] CB: Trimmed 72657 records to 50103 (keeping 200 days of data) [2025-09-22T17:52:30.742749] [DEBUG] [LOCAL ] CB: Primary data saved (50103 records). [2025-09-22T17:52:30.742899] [INFO ] [MAIN ] CB: Full history saved. [2025-09-22T17:52:30.742986] [INFO ] [MAIN ] Update Progress: 400/2372 symbols completed. CB took 20.9s. Estimated remaining: 4h 18m 34s. Rate: 7.6 symbols/min [2025-09-22T17:52:31.360254] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:52:31.413235] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:52:31.436063] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:52:31.472891] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:52:31.473936] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-22T17:52:31.473993] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-22T17:52:31.474124] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-22T17:52:31.474166] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-22T17:52:31.474208] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-22T17:52:31.474272] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-22T17:52:31.574188] [DEBUG] [LOCAL ] CBNA: Loaded 2982 existing records from primary storage. [2025-09-22T17:52:31.601047] [DEBUG] [LOCAL ] CBAN: Loaded 11389 existing records from primary storage. [2025-09-22T17:52:31.590619] [DEBUG] [LOCAL ] CBL: Loaded 17100 existing records from primary storage. [2025-09-22T17:52:31.613996] [INFO ] [MAIN ] CBAN: Loaded 11389 existing records. [2025-09-22T17:52:31.614176] [INFO ] [MAIN ] CBL: Loaded 17100 existing records. [2025-09-22T17:52:31.614094] [INFO ] [MAIN ] CBNA: Loaded 2982 existing records. [2025-09-22T17:52:32.290098] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:52:32.374126] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:52:32.374601] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-22T17:52:32.374328] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:52:32.386194] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-22T17:52:32.391395] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-22T17:52:32.391494] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-22T17:52:32.429508] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-22T17:52:32.429438] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-22T17:52:32.380903] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-22T17:52:32.452761] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-22T17:52:32.455681] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-22T17:52:32.452666] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-22T17:52:32.464762] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:52:32.529313] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-22T17:52:32.567522] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-22T17:52:32.618406] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-22T17:52:32.852634] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:52:32.894327] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-22T17:52:32.900794] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-22T17:52:33.268789] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:52:33.341551] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-22T17:52:33.367538] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-22T17:52:33.524796] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:52:33.541312] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-22T17:52:33.635224] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:52:33.669799] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-22T17:52:33.693896] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:52:33.694297] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-22T17:52:33.703563] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:52:33.704273] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-22T17:52:33.705127] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-22T17:52:34.079162] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-22T17:52:34.080035] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-22T17:52:34.306347] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-22T17:52:34.307242] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-22T17:52:34.354071] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-22T17:52:34.355773] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-22T17:52:34.444725] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T17:52:34.446941] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-22T17:52:34.898891] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-22T17:52:34.913544] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T17:52:34.921998] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-22T17:52:34.992432] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-22T17:52:35.100491] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T17:52:35.242770] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-22T17:52:35.722049] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-22T17:52:36.168614] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-22T17:52:36.522065] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-22T17:52:36.783263] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-22T17:52:37.322062] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-22T17:52:38.122247] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-22T17:52:38.122180] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T17:52:38.428720] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-22T17:52:38.922069] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-22T17:52:39.146821] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-22T17:52:39.722057] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-22T17:52:39.947317] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:52:39.947627] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-22T17:52:40.522051] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-22T17:52:41.178234] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-22T17:52:41.322046] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-22T17:52:42.122056] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-22T17:52:42.276868] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T17:52:42.922067] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-22T17:52:43.048813] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T17:52:43.484239] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T17:52:43.722090] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-22T17:52:44.179250] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:52:44.179589] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-22T17:52:44.179970] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-22T17:52:44.180056] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-22T17:52:44.180903] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:52:44.181000] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:52:44.181088] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:52:44.181198] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-22T17:52:44.181293] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-22T17:52:44.181350] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-22T17:52:44.181407] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-22T17:52:44.181490] [INFO ] [MAIN ] Update Progress: 401/2372 symbols completed. CBO took 13.4s. Estimated remaining: 4h 18m 54s. Rate: 7.6 symbols/min [2025-09-22T17:52:44.359735] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:52:44.418930] [DEBUG] [LOCAL ] CBRE: Loaded 51439 existing records from primary storage. [2025-09-22T17:52:44.419111] [INFO ] [MAIN ] CBRE: Loaded 51439 existing records. [2025-09-22T17:52:44.523304] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-22T17:52:44.606315] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:52:44.606718] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-22T17:52:44.606780] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-22T17:52:44.608396] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-22T17:52:44.608459] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-22T17:52:44.985862] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:52:45.146012] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-22T17:52:45.322046] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-22T17:52:45.999900] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-22T17:52:46.122098] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-22T17:52:46.922038] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-22T17:52:47.007198] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-22T17:52:47.722050] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-22T17:52:48.104549] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-22T17:52:48.187391] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-22T17:52:48.522118] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-22T17:52:49.203985] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T17:52:49.322060] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-22T17:52:50.128495] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-22T17:52:50.136386] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T17:52:50.922081] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-22T17:52:51.518240] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-22T17:52:51.722142] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-22T17:52:51.809238] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T17:52:52.072335] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-22T17:52:52.522096] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-22T17:52:52.969591] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T17:52:52.970638] [INFO ] [REMOTE ] CBNA: Full fetch complete (4721 records). [2025-09-22T17:52:52.970735] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-22T17:52:53.322022] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-22T17:52:53.345070] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-22T17:52:53.345133] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-22T17:52:53.345276] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-22T17:52:53.345316] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-22T17:52:53.345737] [DEBUG] [LOCAL ] CBNA: Trimmed 4721 records to 2901 (keeping 200 days of data) [2025-09-22T17:52:53.363323] [DEBUG] [LOCAL ] CBNA: Primary data saved (2901 records). [2025-09-22T17:52:53.363405] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-22T17:52:53.363484] [INFO ] [MAIN ] Update Progress: 402/2372 symbols completed. CBNA took 22.6s. Estimated remaining: 4h 18m 52s. Rate: 7.6 symbols/min [2025-09-22T17:52:53.532530] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:52:53.571694] [DEBUG] [LOCAL ] CBT: Loaded 31844 existing records from primary storage. [2025-09-22T17:52:53.571855] [INFO ] [MAIN ] CBT: Loaded 31844 existing records. [2025-09-22T17:52:53.770541] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:52:53.770842] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-22T17:52:53.770893] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-22T17:52:53.771899] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-22T17:52:53.771963] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-22T17:52:54.128852] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-22T17:52:54.171070] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:52:54.346638] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T17:52:54.922119] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-22T17:52:55.722056] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-22T17:52:55.873560] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T17:52:55.997556] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T17:52:56.387988] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-22T17:52:56.522098] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-22T17:52:57.322053] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-22T17:52:57.566890] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T17:52:58.122066] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-22T17:52:58.695299] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-22T17:52:58.922070] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-22T17:52:59.057943] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T17:52:59.722069] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-22T17:53:00.213628] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T17:53:00.216664] [INFO ] [REMOTE ] CBL: Full fetch complete (25733 records). [2025-09-22T17:53:00.216763] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-22T17:53:00.527146] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-22T17:53:00.592496] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-22T17:53:00.592572] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-22T17:53:00.593017] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-22T17:53:00.593079] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-22T17:53:00.593839] [DEBUG] [LOCAL ] CBL: Trimmed 25733 records to 16762 (keeping 200 days of data) [2025-09-22T17:53:00.698177] [DEBUG] [LOCAL ] CBL: Primary data saved (16762 records). [2025-09-22T17:53:00.698326] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-22T17:53:00.698415] [INFO ] [MAIN ] Update Progress: 403/2372 symbols completed. CBL took 30.0s. Estimated remaining: 4h 18m 42s. Rate: 7.6 symbols/min [2025-09-22T17:53:00.880516] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:53:00.905427] [DEBUG] [LOCAL ] CBU: Loaded 23402 existing records from primary storage. [2025-09-22T17:53:00.905602] [INFO ] [MAIN ] CBU: Loaded 23402 existing records. [2025-09-22T17:53:01.089270] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:53:01.089534] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-22T17:53:01.089601] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-22T17:53:01.090446] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-22T17:53:01.090506] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-22T17:53:01.293180] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T17:53:01.327139] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-22T17:53:01.376743] [INFO ] [REMOTE ] CBAN: Full fetch complete (16022 records). [2025-09-22T17:53:01.395410] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-22T17:53:01.559131] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:53:01.848250] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-22T17:53:01.925052] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-22T17:53:01.925153] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-22T17:53:01.925514] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-22T17:53:01.925556] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-22T17:53:01.926160] [DEBUG] [LOCAL ] CBAN: Trimmed 16022 records to 11144 (keeping 200 days of data) [2025-09-22T17:53:01.996241] [DEBUG] [LOCAL ] CBAN: Primary data saved (11144 records). [2025-09-22T17:53:01.996377] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-22T17:53:01.996478] [INFO ] [MAIN ] Update Progress: 404/2372 symbols completed. CBAN took 31.3s. Estimated remaining: 4h 18m 2s. Rate: 7.6 symbols/min [2025-09-22T17:53:02.136930] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-22T17:53:02.171421] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:53:02.171572] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-22T17:53:02.171627] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-22T17:53:02.171789] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-22T17:53:02.171833] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-22T17:53:02.172034] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-22T17:53:02.172154] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-22T17:53:02.539320] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:53:02.591107] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T17:53:02.922123] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-22T17:53:03.122558] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:53:03.122922] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-22T17:53:03.722066] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-22T17:53:04.148795] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-22T17:53:04.522076] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-22T17:53:04.719690] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:53:04.720230] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-22T17:53:04.872150] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T17:53:05.322074] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-22T17:53:06.122056] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-22T17:53:06.316524] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:53:06.316882] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-22T17:53:06.843330] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T17:53:06.922057] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-22T17:53:07.124140] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:53:07.124466] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-22T17:53:07.722071] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-22T17:53:08.522070] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-22T17:53:08.742282] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:53:08.742632] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-22T17:53:09.156531] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T17:53:09.322054] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-22T17:53:10.122055] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-22T17:53:10.764841] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-22T17:53:10.922027] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-22T17:53:11.206069] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T17:53:11.722104] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-22T17:53:11.883664] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T17:53:11.999264] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-22T17:53:12.522055] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-22T17:53:12.758581] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-22T17:53:13.322054] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-22T17:53:14.122057] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-22T17:53:14.327331] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:53:14.327632] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-22T17:53:14.922057] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-22T17:53:15.132556] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T17:53:15.722057] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-22T17:53:15.774632] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T17:53:16.074706] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:53:16.075059] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-22T17:53:16.075160] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-22T17:53:16.075231] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-22T17:53:16.075916] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:53:16.075995] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:53:16.076061] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:53:16.076132] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-22T17:53:16.076196] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-22T17:53:16.076231] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-22T17:53:16.076270] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-22T17:53:16.076330] [INFO ] [MAIN ] Update Progress: 405/2372 symbols completed. CBX took 14.1s. Estimated remaining: 4h 18m 24s. Rate: 7.6 symbols/min [2025-09-22T17:53:16.253279] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:53:16.297541] [DEBUG] [LOCAL ] CBZ: Loaded 33900 existing records from primary storage. [2025-09-22T17:53:16.297719] [INFO ] [MAIN ] CBZ: Loaded 33900 existing records. [2025-09-22T17:53:16.476544] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:53:16.476831] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-22T17:53:16.476879] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-22T17:53:16.477987] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-22T17:53:16.478048] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-22T17:53:16.530732] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-22T17:53:16.871072] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:53:17.322047] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-22T17:53:17.988102] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T17:53:18.122120] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-22T17:53:18.239415] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T17:53:18.247675] [INFO ] [REMOTE ] CBRE: Full fetch complete (73939 records). [2025-09-22T17:53:18.247829] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-22T17:53:18.664140] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-22T17:53:18.664224] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-22T17:53:18.665060] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-22T17:53:18.665126] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-22T17:53:18.666589] [DEBUG] [LOCAL ] CBRE: Trimmed 73939 records to 50664 (keeping 200 days of data) [2025-09-22T17:53:18.932983] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-22T17:53:18.979426] [DEBUG] [LOCAL ] CBRE: Primary data saved (50664 records). [2025-09-22T17:53:18.979636] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-22T17:53:18.979955] [INFO ] [MAIN ] Update Progress: 406/2372 symbols completed. CBRE took 34.8s. Estimated remaining: 4h 17m 52s. Rate: 7.6 symbols/min [2025-09-22T17:53:19.167391] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:53:19.186252] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T17:53:19.251829] [DEBUG] [LOCAL ] CC: Loaded 53812 existing records from primary storage. [2025-09-22T17:53:19.252019] [INFO ] [MAIN ] CC: Loaded 53812 existing records. [2025-09-22T17:53:19.450336] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:53:19.450611] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-22T17:53:19.450691] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-22T17:53:19.453313] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-22T17:53:19.453391] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-22T17:53:19.729448] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-22T17:53:19.863432] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:53:20.143302] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T17:53:20.522047] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-22T17:53:20.893603] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T17:53:21.322056] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-22T17:53:21.793164] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T17:53:22.122091] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-22T17:53:22.740972] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T17:53:22.922099] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-22T17:53:23.419008] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T17:53:23.722016] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-22T17:53:24.113600] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T17:53:24.522054] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-22T17:53:25.298605] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T17:53:25.322014] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-22T17:53:25.535711] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T17:53:26.122050] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-22T17:53:26.927179] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-22T17:53:26.944742] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T17:53:27.284325] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T17:53:27.722073] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-22T17:53:28.008532] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T17:53:28.522113] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-22T17:53:29.322034] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-22T17:53:29.414296] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T17:53:29.462796] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T17:53:30.122057] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-22T17:53:30.452849] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T17:53:30.922081] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-22T17:53:31.722030] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-22T17:53:31.943928] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T17:53:32.118071] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T17:53:32.522019] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-22T17:53:32.911678] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T17:53:33.322051] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-22T17:53:34.122061] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-22T17:53:34.416002] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T17:53:34.417476] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T17:53:34.922070] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-22T17:53:35.071491] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T17:53:35.722066] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-22T17:53:36.522017] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-22T17:53:36.676478] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T17:53:36.920738] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T17:53:36.926375] [INFO ] [REMOTE ] CBU: Full fetch complete (32091 records). [2025-09-22T17:53:36.926699] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-22T17:53:37.308499] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-22T17:53:37.308685] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-22T17:53:37.309586] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-22T17:53:37.309716] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-22T17:53:37.312188] [DEBUG] [LOCAL ] CBU: Trimmed 32091 records to 22859 (keeping 200 days of data) [2025-09-22T17:53:37.322172] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-22T17:53:37.479414] [DEBUG] [LOCAL ] CBU: Primary data saved (22859 records). [2025-09-22T17:53:37.479551] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-22T17:53:37.479796] [INFO ] [MAIN ] Update Progress: 407/2372 symbols completed. CBU took 36.8s. Estimated remaining: 4h 18m 36s. Rate: 7.6 symbols/min [2025-09-22T17:53:37.672379] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:53:37.696335] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-22T17:53:37.757818] [DEBUG] [LOCAL ] CCI: Loaded 53934 existing records from primary storage. [2025-09-22T17:53:37.757971] [INFO ] [MAIN ] CCI: Loaded 53934 existing records. [2025-09-22T17:53:37.944981] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:53:37.945346] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-22T17:53:37.945405] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-22T17:53:37.947084] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-22T17:53:37.947155] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-22T17:53:38.136515] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-22T17:53:38.331978] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:53:38.886140] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T17:53:38.922012] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-22T17:53:39.543600] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T17:53:39.722054] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-22T17:53:40.504444] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T17:53:40.522178] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-22T17:53:41.322052] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-22T17:53:41.392251] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T17:53:41.400493] [INFO ] [REMOTE ] CC: Full fetch complete (75421 records). [2025-09-22T17:53:41.400614] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-22T17:53:41.812304] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-22T17:53:41.812401] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-22T17:53:41.813482] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-22T17:53:41.814096] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-22T17:53:41.816039] [DEBUG] [LOCAL ] CC: Trimmed 75421 records to 53028 (keeping 200 days of data) [2025-09-22T17:53:42.134784] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-22T17:53:42.182787] [DEBUG] [LOCAL ] CC: Primary data saved (53028 records). [2025-09-22T17:53:42.186386] [INFO ] [MAIN ] CC: Full history saved. [2025-09-22T17:53:42.186526] [INFO ] [MAIN ] Update Progress: 408/2372 symbols completed. CC took 23.2s. Estimated remaining: 4h 18m 12s. Rate: 7.6 symbols/min [2025-09-22T17:53:42.220499] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T17:53:42.393613] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:53:42.393868] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-22T17:53:42.393925] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-22T17:53:42.394077] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-22T17:53:42.394120] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-22T17:53:42.394197] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-22T17:53:42.394311] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-22T17:53:42.770950] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:53:42.853069] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T17:53:42.922110] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-22T17:53:43.121223] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T17:53:43.722101] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-22T17:53:43.872884] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T17:53:44.131171] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-22T17:53:44.522144] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-22T17:53:45.322048] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-22T17:53:45.597012] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T17:53:45.602097] [INFO ] [REMOTE ] CBT: Full fetch complete (45835 records). [2025-09-22T17:53:45.602212] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-22T17:53:46.034191] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-22T17:53:46.034275] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-22T17:53:46.035063] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-22T17:53:46.035150] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-22T17:53:46.036222] [DEBUG] [LOCAL ] CBT: Trimmed 45835 records to 31131 (keeping 200 days of data) [2025-09-22T17:53:46.140466] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-22T17:53:46.254486] [DEBUG] [LOCAL ] CBT: Primary data saved (31131 records). [2025-09-22T17:53:46.254631] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-22T17:53:46.257147] [INFO ] [MAIN ] Update Progress: 409/2372 symbols completed. CBT took 52.9s. Estimated remaining: 4h 17m 46s. Rate: 7.6 symbols/min [2025-09-22T17:53:46.424484] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:53:46.446145] [DEBUG] [LOCAL ] CCIF: Loaded 15474 existing records from primary storage. [2025-09-22T17:53:46.446301] [INFO ] [MAIN ] CCIF: Loaded 15474 existing records. [2025-09-22T17:53:46.563893] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T17:53:46.643286] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:53:46.643537] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-22T17:53:46.643595] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-22T17:53:46.644188] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-22T17:53:46.644249] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-22T17:53:46.927247] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-22T17:53:47.045148] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:53:47.170185] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T17:53:47.240094] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-22T17:53:47.722091] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-22T17:53:48.345957] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-22T17:53:48.522074] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-22T17:53:49.130270] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T17:53:49.322061] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-22T17:53:50.122093] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-22T17:53:50.922121] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-22T17:53:51.043372] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T17:53:51.256631] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-22T17:53:51.330696] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-22T17:53:51.722077] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-22T17:53:52.522073] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-22T17:53:52.889284] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-22T17:53:53.322041] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-22T17:53:53.571511] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T17:53:53.649978] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-22T17:53:54.122076] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-22T17:53:54.922092] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-22T17:53:55.335376] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-22T17:53:55.571547] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T17:53:55.722125] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-22T17:53:56.522078] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-22T17:53:57.100863] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T17:53:57.322029] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-22T17:53:57.419917] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T17:53:58.122102] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-22T17:53:58.922073] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-22T17:53:59.050678] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T17:53:59.277962] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-22T17:53:59.313266] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-22T17:53:59.722101] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-22T17:54:00.522066] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-22T17:54:01.024033] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-22T17:54:01.322021] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-22T17:54:01.497473] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T17:54:02.122065] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-22T17:54:02.777987] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T17:54:02.778877] [INFO ] [REMOTE ] CCIA: Full fetch complete (2020 records). [2025-09-22T17:54:02.778947] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-22T17:54:02.927368] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-22T17:54:02.996958] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T17:54:02.997198] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:54:02.997260] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:54:02.997326] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-22T17:54:02.997400] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-22T17:54:02.997450] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-22T17:54:02.997531] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-22T17:54:02.997686] [INFO ] [MAIN ] Update Progress: 410/2372 symbols completed. CCIA took 20.8s. Estimated remaining: 4h 18m 21s. Rate: 7.6 symbols/min [2025-09-22T17:54:03.168378] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:54:03.235734] [DEBUG] [LOCAL ] CCJ: Loaded 54455 existing records from primary storage. [2025-09-22T17:54:03.235888] [INFO ] [MAIN ] CCJ: Loaded 54455 existing records. [2025-09-22T17:54:03.413587] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:54:03.413860] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-22T17:54:03.413911] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-22T17:54:03.415384] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-22T17:54:03.415453] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-22T17:54:03.727171] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-22T17:54:03.796475] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:54:04.522025] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-22T17:54:04.914741] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T17:54:05.288696] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (3.17 seconds). [2025-09-22T17:54:05.296384] [INFO ] [REMOTE ] CBZ: Full fetch complete (44605 records). [2025-09-22T17:54:05.296638] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-22T17:54:05.339883] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-22T17:54:05.726774] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-22T17:54:05.726903] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-22T17:54:05.727729] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-22T17:54:05.727798] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-22T17:54:05.729798] [DEBUG] [LOCAL ] CBZ: Trimmed 44605 records to 33453 (keeping 200 days of data) [2025-09-22T17:54:05.951982] [DEBUG] [LOCAL ] CBZ: Primary data saved (33453 records). [2025-09-22T17:54:05.952198] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-22T17:54:05.952322] [INFO ] [MAIN ] Update Progress: 411/2372 symbols completed. CBZ took 49.9s. Estimated remaining: 4h 17m 49s. Rate: 7.6 symbols/min [2025-09-22T17:54:06.142291] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:54:06.203027] [DEBUG] [LOCAL ] CCK: Loaded 47277 existing records from primary storage. [2025-09-22T17:54:06.203272] [INFO ] [MAIN ] CCK: Loaded 47277 existing records. [2025-09-22T17:54:06.394616] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:54:06.427724] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-22T17:54:06.428935] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-22T17:54:06.431164] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-22T17:54:06.442296] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-22T17:54:06.442471] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-22T17:54:06.469622] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-22T17:54:06.521100] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T17:54:06.850094] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:54:06.880686] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-22T17:54:06.922005] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-22T17:54:07.722068] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-22T17:54:07.941920] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T17:54:08.522073] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-22T17:54:08.932521] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-22T17:54:09.322057] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-22T17:54:09.498307] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T17:54:09.588825] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T17:54:10.122048] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-22T17:54:10.922102] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-22T17:54:11.315715] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T17:54:11.348799] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-22T17:54:11.358192] [INFO ] [REMOTE ] CCI: Full fetch complete (76994 records). [2025-09-22T17:54:11.358333] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-22T17:54:11.726355] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-22T17:54:11.782429] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-22T17:54:11.782580] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-22T17:54:11.792975] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-22T17:54:11.794527] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-22T17:54:11.794748] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-22T17:54:11.800539] [DEBUG] [LOCAL ] CCI: Trimmed 76994 records to 53161 (keeping 200 days of data) [2025-09-22T17:54:12.152401] [DEBUG] [LOCAL ] CCI: Primary data saved (53161 records). [2025-09-22T17:54:12.152540] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-22T17:54:12.152636] [INFO ] [MAIN ] Update Progress: 412/2372 symbols completed. CCI took 34.7s. Estimated remaining: 4h 17m 33s. Rate: 7.6 symbols/min [2025-09-22T17:54:12.321630] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:54:12.378006] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-22T17:54:12.378163] [INFO ] [MAIN ] CCL: Loaded 54580 existing records. [2025-09-22T17:54:12.527200] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-22T17:54:12.561550] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:54:12.561794] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-22T17:54:12.561870] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-22T17:54:12.563298] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-22T17:54:12.563366] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-22T17:54:12.930448] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:54:13.103413] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T17:54:13.322044] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-22T17:54:13.505984] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T17:54:14.122070] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-22T17:54:14.922061] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-22T17:54:15.722060] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-22T17:54:16.567074] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T17:54:16.570001] [INFO ] [REMOTE ] CCIF: Full fetch complete (21531 records). [2025-09-22T17:54:16.570082] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-22T17:54:16.969698] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-22T17:54:16.969893] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-22T17:54:16.970463] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-22T17:54:16.971059] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-22T17:54:16.972195] [DEBUG] [LOCAL ] CCIF: Trimmed 21531 records to 15367 (keeping 200 days of data) [2025-09-22T17:54:17.074946] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (3.75 seconds). [2025-09-22T17:54:17.113591] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-22T17:54:17.122003] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (3.00 seconds). [2025-09-22T17:54:17.156054] [DEBUG] [LOCAL ] CCIF: Primary data saved (15367 records). [2025-09-22T17:54:17.156400] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-22T17:54:17.156536] [INFO ] [MAIN ] Update Progress: 413/2372 symbols completed. CCIF took 30.9s. Estimated remaining: 4h 17m 12s. Rate: 7.6 symbols/min [2025-09-22T17:54:17.328848] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:54:17.328972] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-22T17:54:17.384686] [DEBUG] [LOCAL ] CCO: Loaded 48252 existing records from primary storage. [2025-09-22T17:54:17.384894] [INFO ] [MAIN ] CCO: Loaded 48252 existing records. [2025-09-22T17:54:17.568139] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:54:17.568393] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-22T17:54:17.568459] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-22T17:54:17.569602] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-22T17:54:17.569718] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-22T17:54:17.933531] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:54:18.122063] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-22T17:54:18.664560] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-09-22T17:54:18.809980] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T17:54:18.922016] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-22T17:54:19.560782] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T17:54:19.604138] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-22T17:54:19.722113] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-22T17:54:20.345375] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T17:54:20.522051] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-22T17:54:21.322075] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-22T17:54:21.608065] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T17:54:21.779113] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T17:54:22.122069] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-22T17:54:22.799520] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T17:54:22.922046] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-22T17:54:23.491336] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T17:54:23.722082] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-22T17:54:24.382276] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T17:54:24.522114] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-22T17:54:25.322077] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-22T17:54:25.410040] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-22T17:54:25.784540] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-22T17:54:26.122081] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-22T17:54:26.922055] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-22T17:54:27.313834] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T17:54:27.584328] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T17:54:27.592962] [INFO ] [REMOTE ] CCK: Full fetch complete (67817 records). [2025-09-22T17:54:27.593214] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-22T17:54:27.727271] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-22T17:54:28.007837] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-22T17:54:28.007938] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-22T17:54:28.008823] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-22T17:54:28.008894] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-22T17:54:28.010438] [DEBUG] [LOCAL ] CCK: Trimmed 67817 records to 46503 (keeping 200 days of data) [2025-09-22T17:54:28.312614] [DEBUG] [LOCAL ] CCK: Primary data saved (46503 records). [2025-09-22T17:54:28.312853] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-22T17:54:28.312952] [INFO ] [MAIN ] Update Progress: 414/2372 symbols completed. CCK took 22.4s. Estimated remaining: 4h 17m 19s. Rate: 7.6 symbols/min [2025-09-22T17:54:28.481860] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:54:28.496232] [DEBUG] [LOCAL ] CCRD: Loaded 9103 existing records from primary storage. [2025-09-22T17:54:28.496431] [INFO ] [MAIN ] CCRD: Loaded 9103 existing records. [2025-09-22T17:54:28.527852] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-22T17:54:28.676087] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:54:28.676361] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-22T17:54:28.676410] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-22T17:54:28.676803] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-22T17:54:28.676863] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-22T17:54:29.037316] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:54:29.100495] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T17:54:29.322061] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-22T17:54:29.579830] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-22T17:54:30.082143] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T17:54:30.122024] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-22T17:54:30.489337] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T17:54:30.768033] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T17:54:30.922040] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-22T17:54:31.605328] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-22T17:54:31.722025] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-22T17:54:32.130500] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-22T17:54:32.522128] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-22T17:54:32.965622] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-22T17:54:33.322083] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-22T17:54:34.122066] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-22T17:54:34.786727] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T17:54:34.922080] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-22T17:54:35.474772] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-22T17:54:35.722059] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-22T17:54:36.141638] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T17:54:36.381382] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T17:54:36.522052] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-22T17:54:37.322048] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-22T17:54:37.766942] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T17:54:38.012010] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T17:54:38.122060] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-22T17:54:38.922063] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-22T17:54:39.673074] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T17:54:39.722037] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-22T17:54:40.522101] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-22T17:54:41.322020] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-22T17:54:41.383740] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-22T17:54:41.490465] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T17:54:41.510094] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T17:54:42.122069] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-22T17:54:42.922122] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-22T17:54:43.216777] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T17:54:43.722135] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-22T17:54:44.279502] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-22T17:54:44.492524] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T17:54:44.494890] [INFO ] [REMOTE ] CCRD: Full fetch complete (12088 records). [2025-09-22T17:54:44.494967] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-22T17:54:44.528915] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-22T17:54:44.902500] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-22T17:54:44.910556] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-22T17:54:44.924378] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-22T17:54:44.925402] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-22T17:54:44.925288] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T17:54:44.934719] [INFO ] [REMOTE ] CCO: Full fetch complete (66028 records). [2025-09-22T17:54:44.934908] [DEBUG] [LOCAL ] CCRD: Trimmed 12088 records to 8988 (keeping 200 days of data) [2025-09-22T17:54:44.935777] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-22T17:54:45.163578] [DEBUG] [LOCAL ] CCRD: Primary data saved (8988 records). [2025-09-22T17:54:45.179559] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-22T17:54:45.181414] [INFO ] [MAIN ] Update Progress: 415/2372 symbols completed. CCRD took 16.9s. Estimated remaining: 4h 17m 54s. Rate: 7.6 symbols/min [2025-09-22T17:54:45.329452] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-22T17:54:45.607531] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-22T17:54:45.607700] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-22T17:54:45.608693] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-22T17:54:45.608783] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-22T17:54:45.607365] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:54:45.610758] [DEBUG] [LOCAL ] CCO: Trimmed 66028 records to 47602 (keeping 200 days of data) [2025-09-22T17:54:45.725395] [DEBUG] [LOCAL ] CCS: Loaded 31164 existing records from primary storage. [2025-09-22T17:54:45.727049] [INFO ] [MAIN ] CCS: Loaded 31164 existing records. [2025-09-22T17:54:45.944622] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:54:45.946571] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-22T17:54:45.947012] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-22T17:54:45.949784] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-22T17:54:45.950421] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-22T17:54:46.483728] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:54:46.487057] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-22T17:54:46.549705] [DEBUG] [LOCAL ] CCO: Primary data saved (47602 records). [2025-09-22T17:54:46.549882] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-22T17:54:46.550626] [INFO ] [MAIN ] Update Progress: 416/2372 symbols completed. CCO took 29.4s. Estimated remaining: 4h 17m 15s. Rate: 7.6 symbols/min [2025-09-22T17:54:46.732528] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:54:46.800085] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-22T17:54:46.797805] [DEBUG] [LOCAL ] CCU: Loaded 24340 existing records from primary storage. [2025-09-22T17:54:46.811579] [INFO ] [MAIN ] CCU: Loaded 24340 existing records. [2025-09-22T17:54:46.925520] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-22T17:54:47.014377] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:54:47.014762] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-22T17:54:47.014854] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-22T17:54:47.015571] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-22T17:54:47.015635] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-22T17:54:47.407094] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:54:47.515244] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T17:54:47.722082] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-22T17:54:47.851789] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-22T17:54:48.522110] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-22T17:54:48.942955] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T17:54:49.143462] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-22T17:54:49.322101] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-22T17:54:49.962597] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T17:54:50.122176] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-22T17:54:50.640631] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-22T17:54:50.922117] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-22T17:54:50.998274] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T17:54:51.722140] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-22T17:54:52.522169] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-22T17:54:52.686437] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T17:54:53.322046] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-22T17:54:53.387584] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-22T17:54:53.396177] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-22T17:54:53.396334] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-22T17:54:53.795108] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-22T17:54:53.795238] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-22T17:54:53.796519] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-22T17:54:53.796666] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-22T17:54:53.816580] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-09-22T17:54:53.818366] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T17:54:54.122340] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-22T17:54:54.180528] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-09-22T17:54:54.180782] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-22T17:54:54.180933] [INFO ] [MAIN ] Update Progress: 417/2372 symbols completed. CCL took 42.0s. Estimated remaining: 4h 17m 6s. Rate: 7.6 symbols/min [2025-09-22T17:54:54.364480] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:54:54.364775] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-22T17:54:54.364883] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-22T17:54:54.365107] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-22T17:54:54.365163] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-22T17:54:54.365209] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-22T17:54:54.365243] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-22T17:54:54.756749] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:54:54.922087] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-22T17:54:55.270995] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T17:54:55.731181] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-22T17:54:55.738910] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-22T17:54:55.777955] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T17:54:56.522057] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-22T17:54:56.667161] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-22T17:54:57.322033] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-22T17:54:57.629219] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T17:54:58.122065] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-22T17:54:58.425947] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T17:54:58.922035] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-22T17:54:59.076079] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T17:54:59.722075] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-22T17:54:59.957271] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-22T17:55:00.522096] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-22T17:55:00.913184] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-22T17:55:01.322078] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-22T17:55:02.130638] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-22T17:55:02.133230] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-22T17:55:02.142033] [INFO ] [REMOTE ] CCJ: Full fetch complete (77682 records). [2025-09-22T17:55:02.142145] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-22T17:55:02.547514] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-22T17:55:02.547709] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T17:55:02.548792] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-22T17:55:02.549634] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-22T17:55:02.555673] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-22T17:55:02.567538] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T17:55:02.575625] [DEBUG] [LOCAL ] CCJ: Trimmed 77682 records to 53675 (keeping 200 days of data) [2025-09-22T17:55:02.894331] [DEBUG] [LOCAL ] CCJ: Primary data saved (53675 records). [2025-09-22T17:55:02.894470] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-22T17:55:02.894557] [INFO ] [MAIN ] Update Progress: 418/2372 symbols completed. CCJ took 59.9s. Estimated remaining: 4h 17m 2s. Rate: 7.6 symbols/min [2025-09-22T17:55:02.927206] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-22T17:55:03.069465] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:55:03.122294] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-22T17:55:03.122446] [INFO ] [MAIN ] CDE: Loaded 54421 existing records. [2025-09-22T17:55:03.306544] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:55:03.306885] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-22T17:55:03.306942] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-22T17:55:03.308242] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-22T17:55:03.308301] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-22T17:55:03.666841] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:55:03.722005] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-22T17:55:04.177146] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T17:55:04.522061] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-22T17:55:05.322043] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-22T17:55:05.520357] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T17:55:05.935120] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T17:55:06.092997] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T17:55:06.122003] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-22T17:55:06.922071] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-22T17:55:07.040481] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T17:55:07.043841] [INFO ] [REMOTE ] CCU: Full fetch complete (33231 records). [2025-09-22T17:55:07.043919] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-22T17:55:07.181393] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-22T17:55:07.451966] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-22T17:55:07.452061] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-22T17:55:07.452673] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-22T17:55:07.452739] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-22T17:55:07.453628] [DEBUG] [LOCAL ] CCU: Trimmed 33231 records to 23817 (keeping 200 days of data) [2025-09-22T17:55:07.597271] [DEBUG] [LOCAL ] CCU: Primary data saved (23817 records). [2025-09-22T17:55:07.597412] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-22T17:55:07.597512] [INFO ] [MAIN ] Update Progress: 419/2372 symbols completed. CCU took 21.0s. Estimated remaining: 4h 16m 39s. Rate: 7.6 symbols/min [2025-09-22T17:55:07.737623] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-22T17:55:07.771362] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:55:07.782582] [DEBUG] [LOCAL ] CDLR: Loaded 10376 existing records from primary storage. [2025-09-22T17:55:07.782741] [INFO ] [MAIN ] CDLR: Loaded 10376 existing records. [2025-09-22T17:55:07.972776] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:55:07.973048] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-22T17:55:07.973099] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-22T17:55:07.973502] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-22T17:55:07.973564] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-22T17:55:08.351861] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:55:08.522061] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-22T17:55:08.779291] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T17:55:09.322072] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-22T17:55:09.379431] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T17:55:10.122090] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-22T17:55:10.811173] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T17:55:10.922033] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-22T17:55:11.506126] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T17:55:11.513846] [INFO ] [REMOTE ] CCS: Full fetch complete (44733 records). [2025-09-22T17:55:11.513968] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-22T17:55:11.734309] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-22T17:55:11.898612] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-22T17:55:11.898719] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-22T17:55:11.899295] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-22T17:55:11.899338] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-22T17:55:11.900283] [DEBUG] [LOCAL ] CCS: Trimmed 44733 records to 30741 (keeping 200 days of data) [2025-09-22T17:55:12.088752] [DEBUG] [LOCAL ] CCS: Primary data saved (30741 records). [2025-09-22T17:55:12.088890] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-22T17:55:12.088991] [INFO ] [MAIN ] Update Progress: 420/2372 symbols completed. CCS took 26.9s. Estimated remaining: 4h 16m 16s. Rate: 7.6 symbols/min [2025-09-22T17:55:12.164003] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T17:55:12.284962] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:55:12.329460] [DEBUG] [LOCAL ] CDP: Loaded 43402 existing records from primary storage. [2025-09-22T17:55:12.329630] [INFO ] [MAIN ] CDP: Loaded 43402 existing records. [2025-09-22T17:55:12.523919] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-22T17:55:12.524328] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:55:12.526105] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-22T17:55:12.526207] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-22T17:55:12.527448] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-22T17:55:12.527527] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-22T17:55:12.756666] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-22T17:55:12.958692] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:55:13.049786] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-22T17:55:13.322066] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-22T17:55:13.658093] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-22T17:55:14.122077] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-22T17:55:14.918205] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T17:55:14.921992] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-22T17:55:15.722031] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-22T17:55:15.863277] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-22T17:55:16.051616] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-22T17:55:16.522097] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-22T17:55:16.816887] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:55:16.817261] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-22T17:55:17.322070] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-22T17:55:17.627247] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-22T17:55:18.122085] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-22T17:55:18.922056] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-22T17:55:19.722027] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-22T17:55:19.794316] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T17:55:19.856103] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T17:55:19.985037] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-22T17:55:20.522066] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-22T17:55:20.915757] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-22T17:55:20.916607] [INFO ] [REMOTE ] CCZ: Full fetch complete (135 records). [2025-09-22T17:55:20.916710] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-22T17:55:20.917121] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:55:20.917209] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:55:20.917254] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:55:20.917294] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-22T17:55:20.917578] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-22T17:55:20.917930] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-22T17:55:20.918037] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-22T17:55:20.918201] [INFO ] [MAIN ] Update Progress: 421/2372 symbols completed. CCZ took 26.7s. Estimated remaining: 4h 16m 12s. Rate: 7.6 symbols/min [2025-09-22T17:55:21.088348] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:55:21.116483] [DEBUG] [LOCAL ] CDRE: Loaded 25538 existing records from primary storage. [2025-09-22T17:55:21.116627] [INFO ] [MAIN ] CDRE: Loaded 25538 existing records. [2025-09-22T17:55:21.292937] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:55:21.293223] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-22T17:55:21.293274] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-22T17:55:21.294068] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-22T17:55:21.294131] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-22T17:55:21.327359] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-22T17:55:21.655732] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:55:22.122066] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-22T17:55:22.591536] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T17:55:22.922065] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-22T17:55:23.097432] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T17:55:23.722069] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-22T17:55:24.430003] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T17:55:24.522017] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-22T17:55:24.823855] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T17:55:25.322063] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-22T17:55:25.613230] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T17:55:26.122069] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-22T17:55:26.193937] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T17:55:26.922082] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-22T17:55:27.076832] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T17:55:27.722058] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-22T17:55:28.522010] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-22T17:55:28.579719] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T17:55:28.607767] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T17:55:29.322063] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-22T17:55:29.348110] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T17:55:30.122078] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-22T17:55:30.922055] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-22T17:55:31.300890] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T17:55:31.728799] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-22T17:55:31.747449] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T17:55:31.957253] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T17:55:32.522094] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-22T17:55:33.319271] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T17:55:33.329079] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-22T17:55:33.516254] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T17:55:34.090999] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T17:55:34.122022] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-22T17:55:34.922061] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-22T17:55:35.690815] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T17:55:35.722006] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-22T17:55:35.794018] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T17:55:35.796382] [INFO ] [REMOTE ] CDLR: Full fetch complete (13146 records). [2025-09-22T17:55:35.796455] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-22T17:55:36.182086] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-22T17:55:36.182198] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-22T17:55:36.182663] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-22T17:55:36.182742] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-22T17:55:36.183571] [DEBUG] [LOCAL ] CDLR: Trimmed 13146 records to 9845 (keeping 200 days of data) [2025-09-22T17:55:36.254915] [DEBUG] [LOCAL ] CDLR: Primary data saved (9845 records). [2025-09-22T17:55:36.255075] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-22T17:55:36.255168] [INFO ] [MAIN ] Update Progress: 422/2372 symbols completed. CDLR took 28.7s. Estimated remaining: 4h 16m 39s. Rate: 7.6 symbols/min [2025-09-22T17:55:36.447013] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:55:36.511529] [DEBUG] [LOCAL ] CE: Loaded 52344 existing records from primary storage. [2025-09-22T17:55:36.511732] [INFO ] [MAIN ] CE: Loaded 52344 existing records. [2025-09-22T17:55:36.527294] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-22T17:55:36.754234] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:55:36.754495] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-22T17:55:36.754546] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-22T17:55:36.756067] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-22T17:55:36.756130] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-22T17:55:37.176316] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:55:37.322062] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-22T17:55:37.705899] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-22T17:55:38.122091] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-22T17:55:38.186160] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T17:55:38.922108] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-22T17:55:38.976244] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T17:55:39.231756] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T17:55:39.722074] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-22T17:55:40.473208] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T17:55:40.522077] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-22T17:55:41.090744] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T17:55:41.322062] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-22T17:55:41.556776] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T17:55:42.122057] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-22T17:55:42.922022] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-22T17:55:43.187030] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T17:55:43.317081] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T17:55:43.722074] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-22T17:55:44.045869] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T17:55:44.522095] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-22T17:55:44.829969] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T17:55:45.322081] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-22T17:55:46.122114] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-22T17:55:46.180877] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T17:55:46.293061] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T17:55:46.922077] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-22T17:55:47.722066] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-22T17:55:48.058888] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-22T17:55:48.072287] [INFO ] [REMOTE ] CDE: Full fetch complete (77574 records). [2025-09-22T17:55:48.072501] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-22T17:55:48.503547] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-22T17:55:48.503706] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-22T17:55:48.504567] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-22T17:55:48.504687] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-22T17:55:48.508672] [DEBUG] [LOCAL ] CDE: Trimmed 77574 records to 53641 (keeping 200 days of data) [2025-09-22T17:55:48.522273] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-22T17:55:48.767784] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T17:55:48.802786] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T17:55:48.809708] [INFO ] [REMOTE ] CDRE: Full fetch complete (35436 records). [2025-09-22T17:55:48.810388] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-22T17:55:48.813855] [FATAL] [VALIDATOR ] CDRE: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:55:48.814700] [FATAL] [MAIN ] CDRE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:55:48.815993] [WARN ] [MAIN ] CDRE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:55:48.816940] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-22T17:55:48.817346] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-09-22T17:55:48.817697] [INFO ] [LOCAL ] CDRE: Starting deletion of derivative data. [2025-09-22T17:55:48.818936] [DEBUG] [LOCAL ] CDRE: Deleted derivative data file. [2025-09-22T17:55:48.819934] [INFO ] [MAIN ] Update Progress: 423/2372 symbols completed. CDRE took 27.9s. Estimated remaining: 4h 16m 52s. Rate: 7.6 symbols/min [2025-09-22T17:55:49.072517] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:55:49.109734] [DEBUG] [LOCAL ] CEE: Loaded 7099 existing records from primary storage. [2025-09-22T17:55:49.110978] [INFO ] [MAIN ] CEE: Loaded 7099 existing records. [2025-09-22T17:55:49.332579] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-22T17:55:49.341366] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:55:49.343177] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-22T17:55:49.343525] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-22T17:55:49.345418] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-22T17:55:49.345792] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-22T17:55:49.394890] [DEBUG] [LOCAL ] CDE: Primary data saved (53641 records). [2025-09-22T17:55:49.422247] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-22T17:55:49.433574] [INFO ] [MAIN ] Update Progress: 424/2372 symbols completed. CDE took 46.5s. Estimated remaining: 4h 16m 11s. Rate: 7.6 symbols/min [2025-09-22T17:55:49.827882] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:55:49.930445] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:55:49.970041] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T17:55:49.988581] [DEBUG] [LOCAL ] CEPU: Loaded 26208 existing records from primary storage. [2025-09-22T17:55:49.988799] [INFO ] [MAIN ] CEPU: Loaded 26208 existing records. [2025-09-22T17:55:50.127117] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-22T17:55:50.187468] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:55:50.187767] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-22T17:55:50.187825] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-22T17:55:50.188487] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-22T17:55:50.188558] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-22T17:55:50.576915] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:55:50.922116] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-22T17:55:51.176382] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T17:55:51.470529] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-22T17:55:51.722073] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-22T17:55:51.834977] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T17:55:51.842734] [INFO ] [REMOTE ] CDP: Full fetch complete (61797 records). [2025-09-22T17:55:51.842890] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-22T17:55:52.246966] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-22T17:55:52.247076] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-22T17:55:52.247929] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-22T17:55:52.248023] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-22T17:55:52.249786] [DEBUG] [LOCAL ] CDP: Trimmed 61797 records to 42674 (keeping 200 days of data) [2025-09-22T17:55:52.370933] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T17:55:52.526951] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-22T17:55:52.538411] [DEBUG] [LOCAL ] CDP: Primary data saved (42674 records). [2025-09-22T17:55:52.538528] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-22T17:55:52.538625] [INFO ] [MAIN ] Update Progress: 425/2372 symbols completed. CDP took 40.4s. Estimated remaining: 4h 15m 41s. Rate: 7.6 symbols/min [2025-09-22T17:55:52.717334] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:55:52.783735] [DEBUG] [LOCAL ] CF: Loaded 53014 existing records from primary storage. [2025-09-22T17:55:52.783937] [INFO ] [MAIN ] CF: Loaded 53014 existing records. [2025-09-22T17:55:52.961488] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:55:52.961828] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-22T17:55:52.961885] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-22T17:55:52.963548] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-22T17:55:52.963620] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-22T17:55:53.322950] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-22T17:55:53.326323] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:55:53.337064] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T17:55:54.122068] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-22T17:55:54.401223] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T17:55:54.922107] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-22T17:55:55.727361] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-22T17:55:55.741085] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T17:55:55.907564] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-22T17:55:56.522055] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-22T17:55:56.879416] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T17:55:57.322059] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-22T17:55:57.801055] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-22T17:55:58.122117] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-22T17:55:58.320950] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T17:55:58.922065] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-22T17:55:59.722073] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-22T17:55:59.768863] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T17:56:00.522118] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-22T17:56:00.793635] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T17:56:01.128796] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T17:56:01.185536] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T17:56:01.322067] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-22T17:56:02.122056] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-22T17:56:02.901210] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T17:56:02.922017] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-22T17:56:03.116969] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T17:56:03.583172] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T17:56:03.722095] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-22T17:56:04.329041] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T17:56:04.522066] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-22T17:56:05.231398] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T17:56:05.233363] [INFO ] [REMOTE ] CEE: Full fetch complete (10232 records). [2025-09-22T17:56:05.233493] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-22T17:56:05.327263] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-22T17:56:05.651213] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-22T17:56:05.651312] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-22T17:56:05.651563] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-22T17:56:05.651605] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-22T17:56:05.652165] [DEBUG] [LOCAL ] CEE: Trimmed 10232 records to 6839 (keeping 200 days of data) [2025-09-22T17:56:05.692918] [DEBUG] [LOCAL ] CEE: Primary data saved (6839 records). [2025-09-22T17:56:05.693071] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-22T17:56:05.693177] [INFO ] [MAIN ] Update Progress: 426/2372 symbols completed. CEE took 16.9s. Estimated remaining: 4h 15m 57s. Rate: 7.6 symbols/min [2025-09-22T17:56:05.864111] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:56:05.946494] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-22T17:56:05.947568] [INFO ] [MAIN ] CFG: Loaded 54404 existing records. [2025-09-22T17:56:06.123915] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-22T17:56:06.128006] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:56:06.129701] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-22T17:56:06.129763] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-22T17:56:06.132300] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-22T17:56:06.132365] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-22T17:56:06.486713] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:56:06.922070] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-22T17:56:07.151199] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T17:56:07.722076] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-22T17:56:08.180673] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-22T17:56:08.336480] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T17:56:08.522054] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-22T17:56:09.118861] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T17:56:09.322068] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-22T17:56:10.122070] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-22T17:56:10.243947] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T17:56:10.922084] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-22T17:56:11.042314] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T17:56:11.054744] [INFO ] [REMOTE ] CE: Full fetch complete (74886 records). [2025-09-22T17:56:11.055031] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-22T17:56:11.502003] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-22T17:56:11.502187] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-22T17:56:11.503333] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-22T17:56:11.503427] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-22T17:56:11.505874] [DEBUG] [LOCAL ] CE: Trimmed 74886 records to 51561 (keeping 200 days of data) [2025-09-22T17:56:11.725591] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-22T17:56:11.814017] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T17:56:11.932808] [DEBUG] [LOCAL ] CE: Primary data saved (51561 records). [2025-09-22T17:56:11.933026] [INFO ] [MAIN ] CE: Full history saved. [2025-09-22T17:56:11.933162] [INFO ] [MAIN ] Update Progress: 427/2372 symbols completed. CE took 35.7s. Estimated remaining: 4h 15m 42s. Rate: 7.6 symbols/min [2025-09-22T17:56:12.124275] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:56:12.124621] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-22T17:56:12.124746] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-22T17:56:12.125299] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-22T17:56:12.125569] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-22T17:56:12.125932] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-22T17:56:12.126026] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-22T17:56:12.527198] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-22T17:56:12.529600] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T17:56:12.545923] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:56:12.760272] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T17:56:13.322063] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-22T17:56:14.032096] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T17:56:14.122075] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-22T17:56:14.922077] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-22T17:56:15.093428] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T17:56:15.122134] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:56:15.122419] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-22T17:56:15.722048] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-22T17:56:15.774566] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T17:56:16.522079] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-22T17:56:16.740739] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:56:16.741097] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-22T17:56:17.322043] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-22T17:56:17.572159] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:56:17.572473] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-22T17:56:17.778801] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-22T17:56:18.122056] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-22T17:56:18.922099] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-22T17:56:19.722149] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-22T17:56:19.762461] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T17:56:19.809769] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T17:56:20.031597] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:56:20.032180] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-22T17:56:20.522086] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-22T17:56:21.322049] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-22T17:56:22.122043] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-22T17:56:22.225583] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T17:56:22.256969] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-22T17:56:22.922096] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-22T17:56:23.150202] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:56:23.150616] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-22T17:56:23.696523] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T17:56:23.722019] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-22T17:56:24.522065] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-22T17:56:25.322067] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-22T17:56:25.616982] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T17:56:25.625294] [INFO ] [REMOTE ] CF: Full fetch complete (75135 records). [2025-09-22T17:56:25.625450] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-22T17:56:26.022881] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-22T17:56:26.022995] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-22T17:56:26.023905] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-22T17:56:26.023974] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-22T17:56:26.025635] [DEBUG] [LOCAL ] CF: Trimmed 75135 records to 52233 (keeping 200 days of data) [2025-09-22T17:56:26.122119] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-22T17:56:26.345776] [DEBUG] [LOCAL ] CF: Primary data saved (52233 records). [2025-09-22T17:56:26.345934] [INFO ] [MAIN ] CF: Full history saved. [2025-09-22T17:56:26.348484] [INFO ] [MAIN ] Update Progress: 428/2372 symbols completed. CF took 33.8s. Estimated remaining: 4h 16m 4s. Rate: 7.6 symbols/min [2025-09-22T17:56:26.521143] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:56:26.525438] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:56:26.525614] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-22T17:56:26.542883] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T17:56:26.582320] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-22T17:56:26.627123] [DEBUG] [LOCAL ] CFR: Loaded 34170 existing records from primary storage. [2025-09-22T17:56:26.627264] [INFO ] [MAIN ] CFR: Loaded 34170 existing records. [2025-09-22T17:56:26.813372] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:56:26.813688] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-22T17:56:26.813758] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-22T17:56:26.815134] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-22T17:56:26.815195] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-22T17:56:26.927304] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-22T17:56:27.174530] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:56:27.202361] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:56:27.202758] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-22T17:56:27.722069] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-22T17:56:28.522053] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-22T17:56:28.727068] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:56:28.727392] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-22T17:56:29.004286] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-22T17:56:29.322051] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-22T17:56:29.424362] [DEBUG] [REMOTE ] CFG: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-22T17:56:29.424720] [WARN ] [REMOTE ] CFG: No data returned for month 2025-08 [2025-09-22T17:56:30.122056] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-22T17:56:30.922062] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-22T17:56:31.189985] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T17:56:31.722041] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-22T17:56:32.039216] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T17:56:32.522072] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-22T17:56:33.161614] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T17:56:33.283602] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T17:56:33.291953] [INFO ] [REMOTE ] CFG: Full fetch complete (69391 records). [2025-09-22T17:56:33.292069] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-22T17:56:33.327170] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-22T17:56:33.500175] [WARN ] [VALIDATOR ] CFG: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-22T17:56:33.501073] [FATAL] [MAIN ] CFG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:56:33.501153] [WARN ] [MAIN ] CFG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:56:33.501219] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-22T17:56:33.501329] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-09-22T17:56:33.501410] [INFO ] [LOCAL ] CFG: Starting deletion of derivative data. [2025-09-22T17:56:33.501944] [DEBUG] [LOCAL ] CFG: Deleted derivative data file. [2025-09-22T17:56:33.502047] [INFO ] [MAIN ] Update Progress: 429/2372 symbols completed. CFG took 27.8s. Estimated remaining: 4h 15m 52s. Rate: 7.6 symbols/min [2025-09-22T17:56:33.678664] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:56:33.719461] [DEBUG] [LOCAL ] CGAU: Loaded 43183 existing records from primary storage. [2025-09-22T17:56:33.719602] [INFO ] [MAIN ] CGAU: Loaded 43183 existing records. [2025-09-22T17:56:33.897519] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:56:33.897797] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-22T17:56:33.897866] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-22T17:56:33.898833] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-22T17:56:33.898901] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-22T17:56:34.130224] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-22T17:56:34.268129] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:56:34.282531] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T17:56:34.922073] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-22T17:56:35.280844] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T17:56:35.567734] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-22T17:56:35.569327] [INFO ] [REMOTE ] CFND: Full fetch complete (2486 records). [2025-09-22T17:56:35.569396] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-22T17:56:35.722030] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-22T17:56:35.757112] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 32 unique days, need 200 days [2025-09-22T17:56:35.757315] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:56:35.757419] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:56:35.757526] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-22T17:56:35.757602] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-22T17:56:35.757659] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-22T17:56:35.757744] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-22T17:56:35.757826] [INFO ] [MAIN ] Update Progress: 430/2372 symbols completed. CFND took 23.8s. Estimated remaining: 4h 15m 19s. Rate: 7.6 symbols/min [2025-09-22T17:56:35.936733] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:56:35.936938] [DEBUG] [LOCAL ] CGV: No existing data file found in primary storage. [2025-09-22T17:56:35.936992] [WARN ] [MAIN ] CGV: No existing data found, performing full refresh instead. [2025-09-22T17:56:35.937138] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-22T17:56:35.937180] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-22T17:56:35.937221] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-09-22T17:56:35.937252] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-22T17:56:36.309525] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:56:36.522063] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-22T17:56:36.853110] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T17:56:37.322103] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-22T17:56:37.926721] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T17:56:37.932613] [INFO ] [REMOTE ] CEPU: Full fetch complete (39604 records). [2025-09-22T17:56:37.932795] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-22T17:56:38.128871] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-22T17:56:38.405912] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-22T17:56:38.406025] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-22T17:56:38.406607] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-22T17:56:38.406678] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-22T17:56:38.407706] [DEBUG] [LOCAL ] CEPU: Trimmed 39604 records to 25921 (keeping 200 days of data) [2025-09-22T17:56:38.570026] [DEBUG] [LOCAL ] CEPU: Primary data saved (25921 records). [2025-09-22T17:56:38.570169] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-22T17:56:38.570270] [INFO ] [MAIN ] Update Progress: 431/2372 symbols completed. CEPU took 49.1s. Estimated remaining: 4h 14m 48s. Rate: 7.6 symbols/min [2025-09-22T17:56:38.657773] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-22T17:56:38.754752] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:56:38.779824] [DEBUG] [LOCAL ] CHCT: Loaded 24496 existing records from primary storage. [2025-09-22T17:56:38.779974] [INFO ] [MAIN ] CHCT: Loaded 24496 existing records. [2025-09-22T17:56:38.930033] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-22T17:56:38.982408] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:56:38.983308] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-22T17:56:38.983560] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-22T17:56:38.994670] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-22T17:56:39.011105] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-22T17:56:39.079551] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T17:56:39.391355] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:56:39.722055] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-22T17:56:40.522120] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-22T17:56:40.580214] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T17:56:40.676228] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T17:56:41.322075] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-22T17:56:41.931957] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T17:56:42.122054] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-22T17:56:42.494943] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T17:56:42.922062] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-22T17:56:43.126785] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T17:56:43.645347] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T17:56:43.722072] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-22T17:56:44.522195] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-22T17:56:44.786033] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T17:56:45.322086] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-22T17:56:45.501446] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T17:56:46.098344] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T17:56:46.122001] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-22T17:56:46.922073] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-22T17:56:46.971002] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-22T17:56:47.722091] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-22T17:56:48.227892] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-22T17:56:48.444590] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T17:56:48.522149] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-22T17:56:48.917574] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-22T17:56:49.322052] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-22T17:56:50.122075] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-22T17:56:50.531246] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T17:56:50.922040] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-22T17:56:51.533132] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T17:56:51.722040] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-22T17:56:51.785693] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T17:56:52.522064] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-22T17:56:52.975904] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-22T17:56:53.067043] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T17:56:53.322062] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-22T17:56:53.753349] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T17:56:54.122057] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-22T17:56:54.922058] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-22T17:56:55.727229] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-22T17:56:55.752028] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T17:56:56.001712] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T17:56:56.009017] [INFO ] [REMOTE ] CFR: Full fetch complete (48449 records). [2025-09-22T17:56:56.009136] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-22T17:56:56.120867] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-22T17:56:56.413054] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-22T17:56:56.413152] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-22T17:56:56.413792] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-22T17:56:56.413862] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-22T17:56:56.415281] [DEBUG] [LOCAL ] CFR: Trimmed 48449 records to 33601 (keeping 200 days of data) [2025-09-22T17:56:56.523084] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-22T17:56:56.641523] [DEBUG] [LOCAL ] CFR: Primary data saved (33601 records). [2025-09-22T17:56:56.641717] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-22T17:56:56.641825] [INFO ] [MAIN ] Update Progress: 432/2372 symbols completed. CFR took 30.3s. Estimated remaining: 4h 15m 26s. Rate: 7.6 symbols/min [2025-09-22T17:56:56.815948] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:56:56.873108] [DEBUG] [LOCAL ] CHD: Loaded 52750 existing records from primary storage. [2025-09-22T17:56:56.873306] [INFO ] [MAIN ] CHD: Loaded 52750 existing records. [2025-09-22T17:56:57.085315] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:56:57.085625] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-22T17:56:57.085709] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-22T17:56:57.087119] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-22T17:56:57.087184] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-22T17:56:57.331077] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-22T17:56:57.463479] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:56:57.505309] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-22T17:56:57.822222] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-22T17:56:58.122102] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-22T17:56:58.565073] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-22T17:56:58.922070] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-22T17:56:59.375956] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-22T17:56:59.722058] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-22T17:57:00.094720] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-22T17:57:00.095756] [INFO ] [REMOTE ] CGV: Full fetch complete (2277 records). [2025-09-22T17:57:00.095830] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-22T17:57:00.466536] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-22T17:57:00.466702] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-22T17:57:00.466851] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-22T17:57:00.466897] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-22T17:57:00.467328] [DEBUG] [LOCAL ] CGV: Trimmed 2277 records to 1425 (keeping 200 days of data) [2025-09-22T17:57:00.477436] [DEBUG] [LOCAL ] CGV: Primary data saved (1425 records). [2025-09-22T17:57:00.477542] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-22T17:57:00.477626] [INFO ] [MAIN ] Update Progress: 433/2372 symbols completed. CGV took 24.7s. Estimated remaining: 4h 15m 0s. Rate: 7.6 symbols/min [2025-09-22T17:57:00.527367] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-22T17:57:00.660679] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:57:00.680693] [DEBUG] [LOCAL ] CHE: Loaded 14825 existing records from primary storage. [2025-09-22T17:57:00.680919] [INFO ] [MAIN ] CHE: Loaded 14825 existing records. [2025-09-22T17:57:00.878629] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:57:00.879063] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-22T17:57:00.879121] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-22T17:57:00.879855] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-22T17:57:00.879921] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-22T17:57:01.282415] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:57:01.322062] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-22T17:57:02.122090] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-22T17:57:02.922043] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-22T17:57:03.347751] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-22T17:57:03.522771] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-22T17:57:03.722027] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-22T17:57:04.522065] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-22T17:57:04.951557] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-22T17:57:05.137897] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-22T17:57:05.322066] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-22T17:57:05.570186] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-22T17:57:05.608021] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T17:57:06.122115] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-22T17:57:06.596003] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T17:57:06.599715] [INFO ] [REMOTE ] CHCT: Full fetch complete (35049 records). [2025-09-22T17:57:06.599793] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-22T17:57:06.927289] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-22T17:57:06.975075] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-22T17:57:06.975155] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-22T17:57:06.975774] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-22T17:57:06.975838] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-22T17:57:06.976626] [DEBUG] [LOCAL ] CHCT: Trimmed 35049 records to 24051 (keeping 200 days of data) [2025-09-22T17:57:07.124188] [DEBUG] [LOCAL ] CHCT: Primary data saved (24051 records). [2025-09-22T17:57:07.124321] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-22T17:57:07.124403] [INFO ] [MAIN ] Update Progress: 434/2372 symbols completed. CHCT took 28.6s. Estimated remaining: 4h 14m 47s. Rate: 7.6 symbols/min [2025-09-22T17:57:07.299130] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:57:07.347379] [DEBUG] [LOCAL ] CHGG: Loaded 48526 existing records from primary storage. [2025-09-22T17:57:07.347561] [INFO ] [MAIN ] CHGG: Loaded 48526 existing records. [2025-09-22T17:57:07.529809] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:57:07.530098] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-22T17:57:07.530155] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-22T17:57:07.531201] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-22T17:57:07.531264] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-22T17:57:07.732515] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T17:57:07.725770] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-22T17:57:07.912315] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:57:07.939844] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T17:57:08.522057] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-22T17:57:08.929057] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T17:57:09.322043] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-22T17:57:10.122037] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-22T17:57:10.143163] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T17:57:10.431673] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T17:57:10.922071] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-22T17:57:11.604451] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-22T17:57:11.643915] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T17:57:11.722013] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-22T17:57:12.522085] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-22T17:57:13.322055] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-22T17:57:13.375487] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T17:57:13.481794] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T17:57:14.122122] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-22T17:57:14.922077] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-22T17:57:15.227602] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-22T17:57:15.448370] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T17:57:15.722133] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-22T17:57:16.522076] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-22T17:57:17.322133] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-22T17:57:17.636078] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-22T17:57:18.106026] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-09-22T17:57:18.134958] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-22T17:57:18.154759] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T17:57:18.444069] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T17:57:18.922132] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-22T17:57:19.461787] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T17:57:19.518921] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-22T17:57:19.722058] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-22T17:57:20.522058] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-22T17:57:21.322024] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-22T17:57:21.468229] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T17:57:21.629137] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T17:57:21.632414] [INFO ] [REMOTE ] CHE: Full fetch complete (19469 records). [2025-09-22T17:57:21.632497] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-22T17:57:22.008775] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-22T17:57:22.008899] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-22T17:57:22.009478] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-22T17:57:22.009525] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-22T17:57:22.010603] [DEBUG] [LOCAL ] CHE: Trimmed 19469 records to 14666 (keeping 200 days of data) [2025-09-22T17:57:22.114027] [DEBUG] [LOCAL ] CHE: Primary data saved (14666 records). [2025-09-22T17:57:22.114252] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-22T17:57:22.114366] [INFO ] [MAIN ] Update Progress: 435/2372 symbols completed. CHE took 21.6s. Estimated remaining: 4h 15m 10s. Rate: 7.6 symbols/min [2025-09-22T17:57:22.127546] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-22T17:57:22.308407] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:57:22.363901] [DEBUG] [LOCAL ] CHH: Loaded 32806 existing records from primary storage. [2025-09-22T17:57:22.364134] [INFO ] [MAIN ] CHH: Loaded 32806 existing records. [2025-09-22T17:57:22.565899] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:57:22.566253] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-22T17:57:22.566305] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-22T17:57:22.567346] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-22T17:57:22.567408] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-22T17:57:22.926816] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-22T17:57:23.017211] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:57:23.020576] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T17:57:23.029355] [INFO ] [REMOTE ] CGAU: Full fetch complete (60439 records). [2025-09-22T17:57:23.029485] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-22T17:57:23.428500] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-22T17:57:23.428595] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-22T17:57:23.429470] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-22T17:57:23.429538] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-22T17:57:23.430996] [DEBUG] [LOCAL ] CGAU: Trimmed 60439 records to 42655 (keeping 200 days of data) [2025-09-22T17:57:23.702235] [DEBUG] [LOCAL ] CGAU: Primary data saved (42655 records). [2025-09-22T17:57:23.702398] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-22T17:57:23.702501] [INFO ] [MAIN ] Update Progress: 436/2372 symbols completed. CGAU took 50.2s. Estimated remaining: 4h 14m 34s. Rate: 7.6 symbols/min [2025-09-22T17:57:23.746972] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-22T17:57:23.879329] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:57:23.902059] [DEBUG] [LOCAL ] CHMI: Loaded 22354 existing records from primary storage. [2025-09-22T17:57:23.902198] [INFO ] [MAIN ] CHMI: Loaded 22354 existing records. [2025-09-22T17:57:24.087796] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:57:24.088214] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-22T17:57:24.088337] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-22T17:57:24.089161] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-22T17:57:24.089228] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-22T17:57:24.505257] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:57:24.510235] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-22T17:57:24.522880] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-22T17:57:24.582940] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T17:57:24.907184] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T17:57:25.322058] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-22T17:57:25.752960] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T17:57:26.122060] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-22T17:57:26.738555] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T17:57:26.922072] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-22T17:57:27.612137] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T17:57:27.722042] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-22T17:57:28.522112] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-22T17:57:28.724495] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T17:57:28.734622] [INFO ] [REMOTE ] CHD: Full fetch complete (74345 records). [2025-09-22T17:57:28.734864] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-22T17:57:29.137372] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-22T17:57:29.137501] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-22T17:57:29.138398] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-22T17:57:29.138487] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-22T17:57:29.140564] [DEBUG] [LOCAL ] CHD: Trimmed 74345 records to 52034 (keeping 200 days of data) [2025-09-22T17:57:29.256255] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T17:57:29.356508] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-22T17:57:29.504865] [DEBUG] [LOCAL ] CHD: Primary data saved (52034 records). [2025-09-22T17:57:29.505026] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-22T17:57:29.508423] [INFO ] [MAIN ] Update Progress: 437/2372 symbols completed. CHD took 32.9s. Estimated remaining: 4h 14m 17s. Rate: 7.6 symbols/min [2025-09-22T17:57:29.912403] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T17:57:30.122051] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-22T17:57:30.922063] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-22T17:57:31.831249] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-22T17:57:31.839313] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-22T17:57:32.314182] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T17:57:32.467886] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-22T17:57:32.522018] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-22T17:57:32.897137] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T17:57:33.322091] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-22T17:57:34.122182] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-22T17:57:34.481690] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T17:57:34.514572] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T17:57:34.922091] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-22T17:57:35.318968] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T17:57:35.722062] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-22T17:57:36.522206] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-22T17:57:36.560439] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T17:57:36.964906] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T17:57:37.322075] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-22T17:57:37.730463] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T17:57:38.122078] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-22T17:57:38.759109] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T17:57:38.922053] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-22T17:57:39.312311] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T17:57:39.722159] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-22T17:57:40.522076] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-22T17:57:40.800738] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T17:57:40.808847] [INFO ] [REMOTE ] CHGG: Full fetch complete (70697 records). [2025-09-22T17:57:40.809082] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-22T17:57:40.821162] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T17:57:41.247777] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-22T17:57:41.247895] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-22T17:57:41.248833] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-22T17:57:41.248905] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-22T17:57:41.253862] [DEBUG] [LOCAL ] CHGG: Trimmed 70697 records to 47754 (keeping 200 days of data) [2025-09-22T17:57:41.343121] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-22T17:57:41.536792] [DEBUG] [LOCAL ] CHGG: Primary data saved (47754 records). [2025-09-22T17:57:41.536931] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-22T17:57:41.537082] [INFO ] [MAIN ] Update Progress: 438/2372 symbols completed. CHGG took 34.4s. Estimated remaining: 4h 14m 28s. Rate: 7.6 symbols/min [2025-09-22T17:57:42.107560] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-22T17:57:42.121998] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-22T17:57:42.442240] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T17:57:42.922071] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-22T17:57:43.234393] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T17:57:43.722021] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-22T17:57:44.172012] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T17:57:44.423115] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-22T17:57:44.522099] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-22T17:57:45.322084] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-22T17:57:45.858546] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T17:57:45.862440] [INFO ] [REMOTE ] CHMI: Full fetch complete (31595 records). [2025-09-22T17:57:45.862548] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-22T17:57:46.255956] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-22T17:57:46.256103] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-22T17:57:46.256959] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-22T17:57:46.257060] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-22T17:57:46.257994] [DEBUG] [LOCAL ] CHMI: Trimmed 31595 records to 22078 (keeping 200 days of data) [2025-09-22T17:57:46.399153] [DEBUG] [LOCAL ] CHMI: Primary data saved (22078 records). [2025-09-22T17:57:46.399283] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-22T17:57:46.399411] [INFO ] [MAIN ] Update Progress: 439/2372 symbols completed. CHMI took 22.7s. Estimated remaining: 4h 14m 6s. Rate: 7.6 symbols/min [2025-09-22T17:57:46.708999] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T17:57:46.713904] [INFO ] [REMOTE ] CHH: Full fetch complete (46160 records). [2025-09-22T17:57:46.714011] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-22T17:57:47.093398] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-22T17:57:47.093475] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-22T17:57:47.094109] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-22T17:57:47.094172] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-22T17:57:47.095311] [DEBUG] [LOCAL ] CHH: Trimmed 46160 records to 32240 (keeping 200 days of data) [2025-09-22T17:57:47.308367] [DEBUG] [LOCAL ] CHH: Primary data saved (32240 records). [2025-09-22T17:57:47.308508] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-22T17:57:47.308633] [INFO ] [MAIN ] Update Progress: 440/2372 symbols completed. CHH took 25.2s. Estimated remaining: 4h 13m 28s. Rate: 7.6 symbols/min [2025-09-22T17:57:47.908110] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:57:47.956450] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:57:47.989558] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:57:48.051836] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:57:48.072153] [DEBUG] [LOCAL ] CHT: Loaded 19987 existing records from primary storage. [2025-09-22T17:57:48.072430] [INFO ] [MAIN ] CHT: Loaded 19987 existing records. [2025-09-22T17:57:48.151872] [DEBUG] [LOCAL ] CHN: Loaded 4871 existing records from primary storage. [2025-09-22T17:57:48.169749] [INFO ] [MAIN ] CHN: Loaded 4871 existing records. [2025-09-22T17:57:48.414255] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:57:48.510471] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-22T17:57:48.532592] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-22T17:57:48.527267] [DEBUG] [LOCAL ] CHPT: Loaded 50321 existing records from primary storage. [2025-09-22T17:57:48.562590] [INFO ] [MAIN ] CHPT: Loaded 50321 existing records. [2025-09-22T17:57:48.590767] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:57:48.587629] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-22T17:57:48.611584] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-22T17:57:48.666274] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-22T17:57:48.672323] [DEBUG] [LOCAL ] CHWY: Loaded 54405 existing records from primary storage. [2025-09-22T17:57:48.715330] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-22T17:57:48.720596] [INFO ] [MAIN ] CHWY: Loaded 54405 existing records. [2025-09-22T17:57:48.771742] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-22T17:57:48.854411] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-22T17:57:49.192766] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:57:49.302028] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-22T17:57:49.311723] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-22T17:57:49.396313] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-22T17:57:49.482006] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-22T17:57:49.524762] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:57:49.649473] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-22T17:57:49.723343] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-22T17:57:49.782417] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-22T17:57:49.831374] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-22T17:57:49.815873] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:57:49.907759] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-22T17:57:50.066931] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:57:50.105330] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-22T17:57:50.395995] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:57:50.412858] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-22T17:57:50.514188] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:57:50.514529] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-22T17:57:50.924758] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-22T17:57:50.926631] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-22T17:57:51.231780] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T17:57:51.236070] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-22T17:57:51.348383] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T17:57:51.350514] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-22T17:57:51.835211] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-22T17:57:51.837165] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-22T17:57:51.923832] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-22T17:57:52.200283] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-22T17:57:52.300813] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T17:57:52.522072] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-22T17:57:52.902945] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-22T17:57:53.322080] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-22T17:57:53.877963] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T17:57:54.122067] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-22T17:57:54.345442] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T17:57:54.922096] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-22T17:57:55.412316] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-22T17:57:55.722064] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-22T17:57:56.068053] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T17:57:56.522067] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-22T17:57:56.603462] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T17:57:57.322058] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-22T17:57:58.122014] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-22T17:57:58.439318] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T17:57:58.614509] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-22T17:57:58.922089] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-22T17:57:59.507184] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T17:57:59.722075] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-22T17:57:59.899809] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-22T17:58:00.522071] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-22T17:58:01.322092] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-22T17:58:01.429669] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T17:58:02.023128] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T17:58:02.122057] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-22T17:58:02.697981] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-22T17:58:02.922065] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-22T17:58:03.691882] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T17:58:03.722003] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-22T17:58:04.384942] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T17:58:04.386794] [INFO ] [REMOTE ] CHN: Full fetch complete (7576 records). [2025-09-22T17:58:04.386866] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-22T17:58:04.529674] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-22T17:58:04.770099] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-22T17:58:04.770187] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-22T17:58:04.770378] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-22T17:58:04.770417] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-22T17:58:04.770876] [DEBUG] [LOCAL ] CHN: Trimmed 7576 records to 4800 (keeping 200 days of data) [2025-09-22T17:58:04.802390] [DEBUG] [LOCAL ] CHN: Primary data saved (4800 records). [2025-09-22T17:58:04.802476] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-22T17:58:04.802568] [INFO ] [MAIN ] Update Progress: 441/2372 symbols completed. CHN took 17.5s. Estimated remaining: 4h 14m 2s. Rate: 7.6 symbols/min [2025-09-22T17:58:04.975752] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:58:05.062201] [DEBUG] [LOCAL ] CI: Loaded 50689 existing records from primary storage. [2025-09-22T17:58:05.062369] [INFO ] [MAIN ] CI: Loaded 50689 existing records. [2025-09-22T17:58:05.244034] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:58:05.244314] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-22T17:58:05.244368] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-22T17:58:05.245810] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-22T17:58:05.245875] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-22T17:58:05.327176] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-22T17:58:05.620124] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:58:06.122112] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-22T17:58:06.394616] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T17:58:06.661138] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T17:58:06.821169] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (6.30 seconds). [2025-09-22T17:58:06.922019] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-22T17:58:07.727252] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-22T17:58:07.732861] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T17:58:08.522104] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-22T17:58:09.105544] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-22T17:58:09.322110] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-22T17:58:09.507094] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T17:58:10.122103] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-22T17:58:10.360639] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T17:58:10.530489] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-22T17:58:10.922079] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-22T17:58:11.722016] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-22T17:58:12.207103] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-22T17:58:12.522094] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-22T17:58:13.024822] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-22T17:58:13.126706] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T17:58:13.322016] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-22T17:58:14.122079] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-22T17:58:14.397564] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T17:58:14.922114] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-22T17:58:15.104401] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T17:58:15.722045] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-22T17:58:15.803295] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T17:58:15.913152] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T17:58:16.522075] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-22T17:58:17.322082] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-22T17:58:18.131088] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-22T17:58:18.155264] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-22T17:58:18.182013] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T17:58:18.647271] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-22T17:58:18.922122] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-22T17:58:19.722077] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-22T17:58:19.738502] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T17:58:19.741769] [INFO ] [REMOTE ] CHT: Full fetch complete (27206 records). [2025-09-22T17:58:19.741916] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-22T17:58:19.742489] [FATAL] [VALIDATOR ] CHT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T17:58:19.742590] [FATAL] [MAIN ] CHT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:58:19.742633] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:58:19.742714] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-22T17:58:19.742804] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-09-22T17:58:19.742861] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-09-22T17:58:19.743446] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-09-22T17:58:19.743581] [INFO ] [MAIN ] Update Progress: 442/2372 symbols completed. CHT took 32.4s. Estimated remaining: 4h 14m 25s. Rate: 7.6 symbols/min [2025-09-22T17:58:19.921477] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:58:19.941621] [DEBUG] [LOCAL ] CIA: Loaded 17081 existing records from primary storage. [2025-09-22T17:58:19.941777] [INFO ] [MAIN ] CIA: Loaded 17081 existing records. [2025-09-22T17:58:20.121325] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:58:20.121633] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-22T17:58:20.121846] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-22T17:58:20.122500] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-22T17:58:20.122567] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-22T17:58:20.535768] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-22T17:58:20.533853] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:58:20.527684] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-22T17:58:21.322074] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-22T17:58:21.502400] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T17:58:22.122040] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-22T17:58:22.302195] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T17:58:22.418885] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T17:58:22.427280] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-22T17:58:22.427404] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-22T17:58:22.821732] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-22T17:58:22.821830] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-22T17:58:22.822679] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-22T17:58:22.822753] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-22T17:58:22.825503] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 53654 (keeping 200 days of data) [2025-09-22T17:58:22.923323] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-22T17:58:23.144931] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-09-22T17:58:23.145077] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-22T17:58:23.147464] [INFO ] [MAIN ] Update Progress: 443/2372 symbols completed. CHWY took 35.8s. Estimated remaining: 4h 13m 57s. Rate: 7.6 symbols/min [2025-09-22T17:58:23.316711] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:58:23.353004] [DEBUG] [LOCAL ] CIB: Loaded 31593 existing records from primary storage. [2025-09-22T17:58:23.353160] [INFO ] [MAIN ] CIB: Loaded 31593 existing records. [2025-09-22T17:58:23.539346] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:58:23.539673] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-22T17:58:23.539750] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-22T17:58:23.540821] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-22T17:58:23.540884] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-22T17:58:23.728440] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-22T17:58:23.944907] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:58:23.976492] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T17:58:24.389979] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-22T17:58:24.454737] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T17:58:24.463531] [INFO ] [REMOTE ] CHPT: Full fetch complete (73542 records). [2025-09-22T17:58:24.463743] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-22T17:58:24.527232] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-22T17:58:24.881866] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-22T17:58:24.881966] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-22T17:58:24.882798] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-22T17:58:24.882866] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-22T17:58:24.884350] [DEBUG] [LOCAL ] CHPT: Trimmed 73542 records to 49427 (keeping 200 days of data) [2025-09-22T17:58:25.185670] [DEBUG] [LOCAL ] CHPT: Primary data saved (49427 records). [2025-09-22T17:58:25.185873] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-22T17:58:25.185991] [INFO ] [MAIN ] Update Progress: 444/2372 symbols completed. CHPT took 37.9s. Estimated remaining: 4h 13m 24s. Rate: 7.6 symbols/min [2025-09-22T17:58:25.327071] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-22T17:58:25.358374] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:58:25.358496] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-22T17:58:25.358533] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-22T17:58:25.358715] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-22T17:58:25.358767] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-22T17:58:25.358810] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-22T17:58:25.358842] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-22T17:58:25.713294] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:58:25.939780] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T17:58:26.122118] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-22T17:58:26.289931] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T17:58:26.922088] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-22T17:58:27.518706] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T17:58:27.722063] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-22T17:58:27.917192] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-22T17:58:28.522068] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-22T17:58:28.871013] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T17:58:29.322064] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-22T17:58:30.122137] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-22T17:58:30.467592] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T17:58:30.633249] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T17:58:30.661608] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-22T17:58:30.922063] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-22T17:58:31.722097] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-22T17:58:32.522071] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-22T17:58:32.739226] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T17:58:33.133638] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T17:58:33.322011] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-22T17:58:33.341587] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T17:58:34.122072] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-22T17:58:34.769566] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T17:58:34.861423] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T17:58:34.922107] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-22T17:58:35.722090] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-22T17:58:36.522025] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-22T17:58:36.679189] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T17:58:36.707347] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T17:58:36.715550] [INFO ] [REMOTE ] CI: Full fetch complete (72508 records). [2025-09-22T17:58:36.715784] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-22T17:58:36.905109] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-22T17:58:37.135260] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-22T17:58:37.135346] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-22T17:58:37.136155] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-22T17:58:37.136224] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-22T17:58:37.137725] [DEBUG] [LOCAL ] CI: Trimmed 72508 records to 49924 (keeping 200 days of data) [2025-09-22T17:58:37.329469] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-22T17:58:37.470681] [DEBUG] [LOCAL ] CI: Primary data saved (49924 records). [2025-09-22T17:58:37.470927] [INFO ] [MAIN ] CI: Full history saved. [2025-09-22T17:58:37.472366] [INFO ] [MAIN ] Update Progress: 445/2372 symbols completed. CI took 32.7s. Estimated remaining: 4h 13m 35s. Rate: 7.6 symbols/min [2025-09-22T17:58:37.655350] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:58:37.717230] [DEBUG] [LOCAL ] CIEN: Loaded 52866 existing records from primary storage. [2025-09-22T17:58:37.717455] [INFO ] [MAIN ] CIEN: Loaded 52866 existing records. [2025-09-22T17:58:37.920570] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:58:37.920923] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-22T17:58:37.920977] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-22T17:58:37.922413] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-22T17:58:37.922474] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-22T17:58:38.130778] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-22T17:58:38.298711] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T17:58:38.377198] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:58:38.922076] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-22T17:58:39.573671] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T17:58:39.722077] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-22T17:58:39.881753] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T17:58:40.522097] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-22T17:58:41.176957] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T17:58:41.322046] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-22T17:58:41.503057] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-22T17:58:41.505747] [INFO ] [REMOTE ] CIA: Full fetch complete (23203 records). [2025-09-22T17:58:41.505859] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-22T17:58:41.875340] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-22T17:58:41.875421] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-22T17:58:41.875867] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-22T17:58:41.875929] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-22T17:58:41.876605] [DEBUG] [LOCAL ] CIA: Trimmed 23203 records to 16947 (keeping 200 days of data) [2025-09-22T17:58:41.975359] [DEBUG] [LOCAL ] CIA: Primary data saved (16947 records). [2025-09-22T17:58:41.975520] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-22T17:58:41.975612] [INFO ] [MAIN ] Update Progress: 446/2372 symbols completed. CIA took 22.2s. Estimated remaining: 4h 13m 13s. Rate: 7.6 symbols/min [2025-09-22T17:58:42.127161] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-22T17:58:42.154231] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:58:42.163563] [DEBUG] [LOCAL ] CIF: Loaded 4566 existing records from primary storage. [2025-09-22T17:58:42.163825] [INFO ] [MAIN ] CIF: Loaded 4566 existing records. [2025-09-22T17:58:42.349806] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:58:42.350146] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-22T17:58:42.350204] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-22T17:58:42.350540] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-22T17:58:42.350601] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-22T17:58:42.732015] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:58:42.922110] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-22T17:58:43.022162] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T17:58:43.316069] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-22T17:58:43.396186] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T17:58:43.722073] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-22T17:58:44.522036] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-22T17:58:44.692408] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T17:58:45.165740] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T17:58:45.322047] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-22T17:58:45.701192] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-22T17:58:46.122059] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-22T17:58:46.589379] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-22T17:58:46.922105] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-22T17:58:47.722071] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-22T17:58:48.202539] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T17:58:48.221020] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T17:58:48.522073] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-22T17:58:49.159346] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T17:58:49.322077] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-22T17:58:50.122114] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-22T17:58:50.429045] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T17:58:50.435821] [INFO ] [REMOTE ] CIB: Full fetch complete (44239 records). [2025-09-22T17:58:50.436052] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-22T17:58:50.833161] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-22T17:58:50.834105] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-22T17:58:50.834322] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-22T17:58:50.835329] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-22T17:58:50.837258] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-22T17:58:50.839128] [DEBUG] [LOCAL ] CIB: Trimmed 44239 records to 31043 (keeping 200 days of data) [2025-09-22T17:58:50.929300] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-22T17:58:51.031976] [DEBUG] [LOCAL ] CIB: Primary data saved (31043 records). [2025-09-22T17:58:51.032151] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-22T17:58:51.032255] [INFO ] [MAIN ] Update Progress: 447/2372 symbols completed. CIB took 27.9s. Estimated remaining: 4h 13m 10s. Rate: 7.6 symbols/min [2025-09-22T17:58:51.213158] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:58:51.217179] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-22T17:58:51.263780] [DEBUG] [LOCAL ] CIG: Loaded 44306 existing records from primary storage. [2025-09-22T17:58:51.263964] [INFO ] [MAIN ] CIG: Loaded 44306 existing records. [2025-09-22T17:58:51.441582] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:58:51.441864] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-22T17:58:51.441914] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-22T17:58:51.443256] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-22T17:58:51.443317] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-22T17:58:51.727319] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-22T17:58:51.854694] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:58:52.174918] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T17:58:52.522162] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-22T17:58:53.322104] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-22T17:58:54.033638] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T17:58:54.122057] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-22T17:58:54.862791] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T17:58:54.922091] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-22T17:58:55.668952] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T17:58:55.684081] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-22T17:58:55.722097] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-22T17:58:56.522114] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-22T17:58:57.177115] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T17:58:57.178380] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T17:58:57.322067] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-22T17:58:58.054394] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T17:58:58.122070] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-22T17:58:58.821925] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T17:58:58.922061] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-22T17:58:59.341331] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T17:58:59.722070] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-22T17:59:00.522098] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-22T17:59:00.953350] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T17:59:00.958202] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T17:59:01.322094] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-22T17:59:01.643480] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-22T17:59:02.122122] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-22T17:59:02.922112] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-22T17:59:03.228670] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T17:59:03.533871] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T17:59:03.535138] [INFO ] [REMOTE ] CIF: Full fetch complete (6585 records). [2025-09-22T17:59:03.535211] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-22T17:59:03.729218] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-22T17:59:03.901050] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-22T17:59:03.901131] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-22T17:59:03.901312] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-22T17:59:03.901352] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-22T17:59:03.901785] [DEBUG] [LOCAL ] CIF: Trimmed 6585 records to 4421 (keeping 200 days of data) [2025-09-22T17:59:03.928680] [DEBUG] [LOCAL ] CIF: Primary data saved (4421 records). [2025-09-22T17:59:03.928782] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-22T17:59:03.928870] [INFO ] [MAIN ] Update Progress: 448/2372 symbols completed. CIF took 22.0s. Estimated remaining: 4h 13m 24s. Rate: 7.6 symbols/min [2025-09-22T17:59:04.095577] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:59:04.117250] [DEBUG] [LOCAL ] CII: Loaded 16086 existing records from primary storage. [2025-09-22T17:59:04.117518] [INFO ] [MAIN ] CII: Loaded 16086 existing records. [2025-09-22T17:59:04.294169] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T17:59:04.300162] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:59:04.301745] [INFO ] [REMOTE ] CICB: Full fetch complete (2145 records). [2025-09-22T17:59:04.302216] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-22T17:59:04.301969] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-22T17:59:04.307951] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-22T17:59:04.380403] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-22T17:59:04.403180] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-22T17:59:04.534081] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-22T17:59:04.630477] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-22T17:59:04.631374] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T17:59:04.636895] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T17:59:04.652348] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-22T17:59:04.700562] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-22T17:59:04.702731] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-22T17:59:04.765458] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-22T17:59:04.792382] [INFO ] [MAIN ] Update Progress: 449/2372 symbols completed. CICB took 39.6s. Estimated remaining: 4h 12m 45s. Rate: 7.6 symbols/min [2025-09-22T17:59:05.055705] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:59:05.079965] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:59:05.121846] [DEBUG] [LOCAL ] CIM: Loaded 37728 existing records from primary storage. [2025-09-22T17:59:05.121983] [INFO ] [MAIN ] CIM: Loaded 37728 existing records. [2025-09-22T17:59:05.297854] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:59:05.298156] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-22T17:59:05.298213] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-22T17:59:05.299022] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-22T17:59:05.299082] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-22T17:59:05.329530] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-22T17:59:05.656577] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:59:06.122086] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-22T17:59:06.716248] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-22T17:59:06.922094] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-22T17:59:07.098329] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T17:59:07.333232] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T17:59:07.722130] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-22T17:59:08.527191] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-22T17:59:08.541686] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T17:59:08.683725] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T17:59:09.322076] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-22T17:59:09.787370] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T17:59:10.122075] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-22T17:59:10.720357] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T17:59:10.922048] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-22T17:59:11.149625] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T17:59:11.722061] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-22T17:59:12.468132] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T17:59:12.522049] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-22T17:59:13.322059] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-22T17:59:13.561776] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T17:59:14.085797] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T17:59:14.122022] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-22T17:59:14.677463] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T17:59:14.922057] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-22T17:59:15.628518] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T17:59:15.722012] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-22T17:59:16.160737] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-22T17:59:16.522072] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-22T17:59:17.071218] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T17:59:17.078255] [INFO ] [REMOTE ] CIG: Full fetch complete (60754 records). [2025-09-22T17:59:17.078396] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-22T17:59:17.329143] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-22T17:59:17.469716] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-22T17:59:17.469799] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-22T17:59:17.470483] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-22T17:59:17.470524] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-22T17:59:17.471761] [DEBUG] [LOCAL ] CIG: Trimmed 60754 records to 43600 (keeping 200 days of data) [2025-09-22T17:59:17.700164] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T17:59:17.760748] [DEBUG] [LOCAL ] CIG: Primary data saved (43600 records). [2025-09-22T17:59:17.760893] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-22T17:59:17.760977] [INFO ] [MAIN ] Update Progress: 450/2372 symbols completed. CIG took 26.7s. Estimated remaining: 4h 12m 59s. Rate: 7.6 symbols/min [2025-09-22T17:59:17.935597] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:59:17.940023] [DEBUG] [LOCAL ] CIMN: Loaded 2690 existing records from primary storage. [2025-09-22T17:59:17.940121] [INFO ] [MAIN ] CIMN: Loaded 2690 existing records. [2025-09-22T17:59:18.129959] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:59:18.130504] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-22T17:59:18.130622] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-22T17:59:18.130212] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-22T17:59:18.131929] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-22T17:59:18.132020] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-22T17:59:18.490054] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T17:59:18.519265] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:59:18.922115] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-22T17:59:19.437901] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-22T17:59:19.685417] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T17:59:19.722049] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-22T17:59:20.522127] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-22T17:59:21.030876] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T17:59:21.322073] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-22T17:59:21.516738] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T17:59:22.122077] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-22T17:59:22.513530] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T17:59:22.922101] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-22T17:59:23.317490] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T17:59:23.722065] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-22T17:59:23.974052] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T17:59:24.448416] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T17:59:24.522065] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-22T17:59:25.291325] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T17:59:25.322004] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-22T17:59:25.896831] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T17:59:26.122067] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-22T17:59:26.810629] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T17:59:26.922032] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-22T17:59:27.722139] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-22T17:59:28.522094] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-22T17:59:28.664822] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T17:59:28.845381] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-22T17:59:29.065683] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T17:59:29.071600] [INFO ] [REMOTE ] CIM: Full fetch complete (54402 records). [2025-09-22T17:59:29.071746] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-22T17:59:29.327261] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-22T17:59:29.471363] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-22T17:59:29.471445] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-22T17:59:29.472180] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-22T17:59:29.472246] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-22T17:59:29.473426] [DEBUG] [LOCAL ] CIM: Trimmed 54402 records to 37152 (keeping 200 days of data) [2025-09-22T17:59:29.707980] [DEBUG] [LOCAL ] CIM: Primary data saved (37152 records). [2025-09-22T17:59:29.708180] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-22T17:59:29.708282] [INFO ] [MAIN ] Update Progress: 451/2372 symbols completed. CIM took 24.9s. Estimated remaining: 4h 13m 9s. Rate: 7.6 symbols/min [2025-09-22T17:59:29.881459] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:59:29.881608] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-22T17:59:29.881670] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-22T17:59:29.881821] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-22T17:59:29.881877] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-22T17:59:29.881948] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-22T17:59:29.882018] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-22T17:59:30.127210] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-22T17:59:30.247983] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:59:30.256563] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T17:59:30.922115] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-22T17:59:31.722080] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-22T17:59:31.877426] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T17:59:31.885620] [INFO ] [REMOTE ] CIEN: Full fetch complete (75524 records). [2025-09-22T17:59:31.885783] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-22T17:59:32.218192] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-22T17:59:32.259125] [INFO ] [REMOTE ] CII: Full fetch complete (23132 records). [2025-09-22T17:59:32.295812] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-22T17:59:32.299682] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-22T17:59:32.299830] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-22T17:59:32.300993] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-22T17:59:32.306548] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-22T17:59:32.394168] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T17:59:32.409378] [DEBUG] [LOCAL ] CIEN: Trimmed 75524 records to 52090 (keeping 200 days of data) [2025-09-22T17:59:32.528660] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-22T17:59:32.796402] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-22T17:59:32.797314] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-22T17:59:32.798639] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-22T17:59:32.799055] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-22T17:59:32.802798] [DEBUG] [LOCAL ] CII: Trimmed 23132 records to 15615 (keeping 200 days of data) [2025-09-22T17:59:32.911485] [DEBUG] [LOCAL ] CII: Primary data saved (15615 records). [2025-09-22T17:59:32.912441] [INFO ] [MAIN ] CII: Full history saved. [2025-09-22T17:59:32.912821] [INFO ] [MAIN ] Update Progress: 452/2372 symbols completed. CII took 29.0s. Estimated remaining: 4h 12m 41s. Rate: 7.6 symbols/min [2025-09-22T17:59:33.182838] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:59:33.185505] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-22T17:59:33.186687] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-22T17:59:33.190045] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-22T17:59:33.190125] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-22T17:59:33.193638] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-22T17:59:33.193723] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-22T17:59:33.300413] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T17:59:33.324122] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-22T17:59:33.647622] [DEBUG] [LOCAL ] CIEN: Primary data saved (52090 records). [2025-09-22T17:59:33.649667] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-22T17:59:33.651058] [INFO ] [MAIN ] Update Progress: 453/2372 symbols completed. CIEN took 56.2s. Estimated remaining: 4h 12m 3s. Rate: 7.6 symbols/min [2025-09-22T17:59:33.705161] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:59:33.753426] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T17:59:33.850426] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:59:33.870561] [DEBUG] [LOCAL ] CINT: Loaded 18486 existing records from primary storage. [2025-09-22T17:59:33.870753] [INFO ] [MAIN ] CINT: Loaded 18486 existing records. [2025-09-22T17:59:34.061913] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:59:34.062146] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-22T17:59:34.062206] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-22T17:59:34.062839] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-22T17:59:34.062900] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-22T17:59:34.127377] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-22T17:59:34.418027] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:59:34.524001] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-22T17:59:34.922073] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-22T17:59:35.555974] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-22T17:59:35.722077] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-22T17:59:35.917017] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:59:35.917534] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-22T17:59:36.522143] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-22T17:59:37.279517] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T17:59:37.322051] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-22T17:59:37.778910] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T17:59:38.122054] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-22T17:59:38.335180] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:59:38.335624] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-22T17:59:38.922075] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-22T17:59:39.479162] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T17:59:39.722080] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-22T17:59:40.187603] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-22T17:59:40.522069] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-22T17:59:41.005002] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-22T17:59:41.322085] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-22T17:59:42.122052] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-22T17:59:42.315231] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T17:59:42.693334] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-22T17:59:42.922064] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-22T17:59:43.390153] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T17:59:43.722109] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-22T17:59:44.365610] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-22T17:59:44.522022] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-22T17:59:45.322042] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-22T17:59:45.562233] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T17:59:45.743775] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-22T17:59:46.122064] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-22T17:59:46.466385] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-22T17:59:46.922099] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-22T17:59:47.722082] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-22T17:59:48.059904] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T17:59:48.149088] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-22T17:59:48.522061] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-22T17:59:49.322083] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-22T17:59:49.495479] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-22T17:59:49.651855] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-22T17:59:50.122054] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-22T17:59:50.740681] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T17:59:50.922010] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-22T17:59:51.722060] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-22T17:59:51.953732] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-22T17:59:52.102984] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-22T17:59:52.522058] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-22T17:59:52.719995] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:59:52.720280] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-22T17:59:53.322037] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-22T17:59:53.522527] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:59:53.522896] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-22T17:59:54.122059] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-22T17:59:54.922037] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-22T17:59:55.288046] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-22T17:59:55.289032] [INFO ] [REMOTE ] CIMN: Full fetch complete (3903 records). [2025-09-22T17:59:55.289145] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-22T17:59:55.406161] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T17:59:55.431859] [INFO ] [REMOTE ] CINT: Full fetch complete (25865 records). [2025-09-22T17:59:55.450625] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-22T17:59:55.724178] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-22T17:59:55.960764] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-22T17:59:55.976062] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:59:55.969579] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-22T17:59:55.992695] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-22T17:59:55.992862] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-22T17:59:55.992455] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-22T17:59:55.994220] [DEBUG] [LOCAL ] CIMN: Trimmed 3903 records to 2667 (keeping 200 days of data) [2025-09-22T17:59:56.076082] [DEBUG] [LOCAL ] CIMN: Primary data saved (2667 records). [2025-09-22T17:59:56.088673] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-22T17:59:56.090760] [INFO ] [MAIN ] Update Progress: 454/2372 symbols completed. CIMN took 38.3s. Estimated remaining: 4h 12m 56s. Rate: 7.6 symbols/min [2025-09-22T17:59:56.204285] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-22T17:59:56.209545] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-22T17:59:56.220724] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-22T17:59:56.231495] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-22T17:59:56.259055] [DEBUG] [LOCAL ] CINT: Trimmed 25865 records to 18299 (keeping 200 days of data) [2025-09-22T17:59:56.366588] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:59:56.418816] [DEBUG] [LOCAL ] CIO: Loaded 20269 existing records from primary storage. [2025-09-22T17:59:56.419869] [INFO ] [MAIN ] CIO: Loaded 20269 existing records. [2025-09-22T17:59:56.523998] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-22T17:59:56.621951] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:59:56.624371] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-22T17:59:56.624772] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-22T17:59:56.626962] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-22T17:59:56.627342] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-22T17:59:56.743220] [DEBUG] [LOCAL ] CINT: Primary data saved (18299 records). [2025-09-22T17:59:56.759596] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:59:56.765143] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-22T17:59:56.765287] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-22T17:59:56.783401] [INFO ] [MAIN ] Update Progress: 455/2372 symbols completed. CINT took 23.1s. Estimated remaining: 4h 12m 18s. Rate: 7.6 symbols/min [2025-09-22T17:59:57.167164] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T17:59:57.188631] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:59:57.220730] [DEBUG] [LOCAL ] CION: Loaded 29804 existing records from primary storage. [2025-09-22T17:59:57.220877] [INFO ] [MAIN ] CION: Loaded 29804 existing records. [2025-09-22T17:59:57.327211] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-22T17:59:57.417626] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T17:59:57.418246] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-22T17:59:57.418351] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-22T17:59:57.419294] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-22T17:59:57.419370] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-22T17:59:57.643583] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:59:57.700419] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-22T17:59:57.779675] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T17:59:58.122067] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-22T17:59:58.922073] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-22T17:59:59.130156] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T17:59:59.130478] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-22T17:59:59.317984] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T17:59:59.722069] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-22T18:00:00.522123] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-22T18:00:00.755122] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:00:00.755446] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-22T18:00:00.801185] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T18:00:01.322073] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-22T18:00:02.122114] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-22T18:00:02.922103] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-22T18:00:03.319032] [INFO ] [REMOTE ] CIMP: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T18:00:03.321052] [INFO ] [REMOTE ] CIMP: Full fetch complete (537 records). [2025-09-22T18:00:03.321178] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-22T18:00:03.527908] [WARN ] [VALIDATOR ] CIMP: Validation failed - insufficient historical data. Have 3 unique days, need 200 days [2025-09-22T18:00:03.528213] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:00:03.528317] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:00:03.528401] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-22T18:00:03.528479] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-22T18:00:03.528534] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-22T18:00:03.528622] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-22T18:00:03.528780] [INFO ] [MAIN ] Update Progress: 456/2372 symbols completed. CIMP took 30.6s. Estimated remaining: 4h 12m 5s. Rate: 7.6 symbols/min [2025-09-22T18:00:03.714095] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:00:03.714325] [DEBUG] [LOCAL ] CIVI: No existing data file found in primary storage. [2025-09-22T18:00:03.714382] [WARN ] [MAIN ] CIVI: No existing data found, performing full refresh instead. [2025-09-22T18:00:03.714531] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-22T18:00:03.714598] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-22T18:00:03.714661] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-09-22T18:00:03.714733] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-22T18:00:03.754442] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-22T18:00:04.086904] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:00:04.522117] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-22T18:00:05.426400] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-22T18:00:05.430342] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-22T18:00:06.103755] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-22T18:00:06.105138] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (3.98 seconds). [2025-09-22T18:00:06.122000] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-22T18:00:06.345890] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-22T18:00:06.570177] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-22T18:00:06.922068] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-22T18:00:07.299401] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T18:00:07.722065] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-22T18:00:08.522052] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-22T18:00:08.867296] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T18:00:09.054736] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-22T18:00:09.056426] [INFO ] [REMOTE ] CIMO: Full fetch complete (5488 records). [2025-09-22T18:00:09.056498] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-22T18:00:09.265414] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T18:00:09.265863] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:00:09.266023] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:00:09.266442] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-22T18:00:09.266612] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-22T18:00:09.266797] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-22T18:00:09.272777] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-22T18:00:09.281367] [INFO ] [MAIN ] Update Progress: 457/2372 symbols completed. CIMO took 39.6s. Estimated remaining: 4h 11m 48s. Rate: 7.6 symbols/min [2025-09-22T18:00:09.286230] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T18:00:09.327481] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-22T18:00:09.493064] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:00:09.573077] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-22T18:00:09.573252] [INFO ] [MAIN ] CL: Loaded 54424 existing records. [2025-09-22T18:00:09.780025] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:00:09.780340] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-22T18:00:09.780399] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-22T18:00:09.783454] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-22T18:00:09.783545] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-22T18:00:10.127253] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-22T18:00:10.169018] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:00:10.721150] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T18:00:10.922071] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-22T18:00:11.617064] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T18:00:11.722057] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-22T18:00:12.316218] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T18:00:12.522075] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-22T18:00:13.279842] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T18:00:13.322016] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-22T18:00:14.122094] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-22T18:00:14.197271] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T18:00:14.240624] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T18:00:14.922119] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-22T18:00:15.722066] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-22T18:00:16.061097] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-22T18:00:16.406436] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T18:00:16.522065] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-22T18:00:17.093805] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T18:00:17.305902] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-22T18:00:17.322019] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-22T18:00:18.122064] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-22T18:00:18.922137] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-22T18:00:19.191301] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T18:00:19.722070] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-22T18:00:20.057479] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T18:00:20.522063] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-22T18:00:21.149740] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-22T18:00:21.322066] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-22T18:00:21.773022] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T18:00:22.122059] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-22T18:00:22.541862] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T18:00:22.717885] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-09-22T18:00:22.922052] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-22T18:00:23.719338] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T18:00:23.725922] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-22T18:00:24.450338] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T18:00:24.522096] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-22T18:00:25.322075] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-22T18:00:25.828179] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-22T18:00:26.122039] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-22T18:00:26.271050] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T18:00:26.381845] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T18:00:26.922082] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-22T18:00:27.366091] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T18:00:27.370130] [INFO ] [REMOTE ] CIO: Full fetch complete (28980 records). [2025-09-22T18:00:27.370271] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-22T18:00:27.727377] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-22T18:00:27.800247] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-22T18:00:27.800412] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-22T18:00:27.801103] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-22T18:00:27.801203] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-22T18:00:27.802225] [DEBUG] [LOCAL ] CIO: Trimmed 28980 records to 20042 (keeping 200 days of data) [2025-09-22T18:00:27.940531] [DEBUG] [LOCAL ] CIO: Primary data saved (20042 records). [2025-09-22T18:00:27.940700] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-22T18:00:27.940833] [INFO ] [MAIN ] Update Progress: 458/2372 symbols completed. CIO took 31.8s. Estimated remaining: 4h 12m 25s. Rate: 7.6 symbols/min [2025-09-22T18:00:28.118616] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:00:28.160375] [DEBUG] [LOCAL ] CLB: Loaded 33774 existing records from primary storage. [2025-09-22T18:00:28.160543] [INFO ] [MAIN ] CLB: Loaded 33774 existing records. [2025-09-22T18:00:28.344204] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:00:28.344519] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-22T18:00:28.344571] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-22T18:00:28.346029] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-22T18:00:28.346093] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-22T18:00:28.525551] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-22T18:00:28.713302] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:00:28.870095] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T18:00:29.097400] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T18:00:29.322046] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-22T18:00:30.122028] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-22T18:00:30.334501] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-22T18:00:30.343365] [INFO ] [REMOTE ] CIVI: Full fetch complete (75440 records). [2025-09-22T18:00:30.343549] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-22T18:00:30.779578] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-22T18:00:30.779713] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-22T18:00:30.780573] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-22T18:00:30.780621] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-22T18:00:30.783613] [DEBUG] [LOCAL ] CIVI: Trimmed 75440 records to 52582 (keeping 200 days of data) [2025-09-22T18:00:30.923431] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-22T18:00:31.131750] [DEBUG] [LOCAL ] CIVI: Primary data saved (52582 records). [2025-09-22T18:00:31.132139] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-22T18:00:31.132240] [INFO ] [MAIN ] Update Progress: 459/2372 symbols completed. CIVI took 27.6s. Estimated remaining: 4h 11m 58s. Rate: 7.6 symbols/min [2025-09-22T18:00:31.313164] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:00:31.328810] [DEBUG] [LOCAL ] CLCO: Loaded 13627 existing records from primary storage. [2025-09-22T18:00:31.328957] [INFO ] [MAIN ] CLCO: Loaded 13627 existing records. [2025-09-22T18:00:31.513271] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:00:31.513815] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-22T18:00:31.513928] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-22T18:00:31.530998] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-22T18:00:31.536225] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-22T18:00:31.644315] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-22T18:00:31.726830] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-22T18:00:31.879185] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T18:00:31.945888] [INFO ] [REMOTE ] CION: Full fetch complete (41316 records). [2025-09-22T18:00:31.950308] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-22T18:00:32.072054] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:00:32.294776] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T18:00:32.456981] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-22T18:00:32.457058] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-22T18:00:32.457572] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-22T18:00:32.457613] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-22T18:00:32.458507] [DEBUG] [LOCAL ] CION: Trimmed 41316 records to 29391 (keeping 200 days of data) [2025-09-22T18:00:32.530176] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-22T18:00:32.649357] [DEBUG] [LOCAL ] CION: Primary data saved (29391 records). [2025-09-22T18:00:32.649513] [INFO ] [MAIN ] CION: Full history saved. [2025-09-22T18:00:32.649629] [INFO ] [MAIN ] Update Progress: 460/2372 symbols completed. CION took 35.9s. Estimated remaining: 4h 11m 23s. Rate: 7.6 symbols/min [2025-09-22T18:00:32.817839] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:00:32.844069] [DEBUG] [LOCAL ] CLDT: Loaded 26615 existing records from primary storage. [2025-09-22T18:00:32.844218] [INFO ] [MAIN ] CLDT: Loaded 26615 existing records. [2025-09-22T18:00:33.018814] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:00:33.019042] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-22T18:00:33.019089] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-22T18:00:33.019928] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-22T18:00:33.019988] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-22T18:00:33.329936] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-22T18:00:33.374522] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:00:34.122080] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-22T18:00:34.293098] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-22T18:00:34.922252] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-22T18:00:35.138151] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-22T18:00:35.275262] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T18:00:35.294930] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T18:00:35.722080] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-22T18:00:36.486549] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T18:00:36.522038] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-22T18:00:36.568873] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T18:00:37.322067] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-22T18:00:38.118084] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T18:00:38.128701] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-22T18:00:38.375498] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T18:00:38.922118] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-22T18:00:39.144384] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T18:00:39.722102] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-22T18:00:40.067759] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-22T18:00:40.522114] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-22T18:00:41.322042] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-22T18:00:41.625293] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T18:00:41.637936] [INFO ] [REMOTE ] CL: Full fetch complete (77616 records). [2025-09-22T18:00:41.638173] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-22T18:00:42.076629] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-22T18:00:42.076772] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-22T18:00:42.077807] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-22T18:00:42.077907] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-22T18:00:42.079837] [DEBUG] [LOCAL ] CL: Trimmed 77616 records to 53644 (keeping 200 days of data) [2025-09-22T18:00:42.103427] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T18:00:42.168898] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-22T18:00:42.457120] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T18:00:42.487106] [DEBUG] [LOCAL ] CL: Primary data saved (53644 records). [2025-09-22T18:00:42.487268] [INFO ] [MAIN ] CL: Full history saved. [2025-09-22T18:00:42.487358] [INFO ] [MAIN ] Update Progress: 461/2372 symbols completed. CL took 33.2s. Estimated remaining: 4h 11m 24s. Rate: 7.6 symbols/min [2025-09-22T18:00:42.671356] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:00:42.671553] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-09-22T18:00:42.671593] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-09-22T18:00:42.671764] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-22T18:00:42.671824] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-22T18:00:42.671893] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-09-22T18:00:42.671930] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-22T18:00:42.927184] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-22T18:00:43.031233] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:00:43.049230] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T18:00:43.722072] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-22T18:00:44.094199] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-22T18:00:44.522076] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-22T18:00:45.121930] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T18:00:45.322047] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-22T18:00:46.122097] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-22T18:00:46.323070] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T18:00:46.351751] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T18:00:46.895408] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-22T18:00:46.922021] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-22T18:00:47.722066] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-22T18:00:48.148229] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T18:00:48.522076] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-22T18:00:48.562964] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T18:00:49.322077] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-22T18:00:50.127936] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-22T18:00:50.134403] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T18:00:50.388957] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T18:00:50.922068] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-22T18:00:50.987309] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T18:00:51.722078] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-22T18:00:52.335428] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T18:00:52.522080] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-22T18:00:52.823974] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T18:00:53.322049] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-22T18:00:54.066136] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-22T18:00:54.122012] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-22T18:00:54.218797] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T18:00:54.922092] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-22T18:00:55.592703] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T18:00:55.722007] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-22T18:00:56.522075] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-22T18:00:56.756925] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T18:00:57.110971] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-22T18:00:57.131990] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T18:00:57.138012] [INFO ] [REMOTE ] CLB: Full fetch complete (46205 records). [2025-09-22T18:00:57.138125] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-22T18:00:57.328249] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-22T18:00:57.549551] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-22T18:00:57.549639] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-22T18:00:57.550343] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-22T18:00:57.550413] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-22T18:00:57.551547] [DEBUG] [LOCAL ] CLB: Trimmed 46205 records to 33100 (keeping 200 days of data) [2025-09-22T18:00:57.767420] [DEBUG] [LOCAL ] CLB: Primary data saved (33100 records). [2025-09-22T18:00:57.767664] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-22T18:00:57.767779] [INFO ] [MAIN ] Update Progress: 462/2372 symbols completed. CLB took 29.8s. Estimated remaining: 4h 11m 46s. Rate: 7.6 symbols/min [2025-09-22T18:00:57.943105] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:00:57.943332] [DEBUG] [LOCAL ] CLH: No existing data file found in primary storage. [2025-09-22T18:00:57.943387] [WARN ] [MAIN ] CLH: No existing data found, performing full refresh instead. [2025-09-22T18:00:57.943531] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-22T18:00:57.943573] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-22T18:00:57.943614] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-09-22T18:00:57.943671] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-22T18:00:58.130813] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-22T18:00:58.299786] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:00:58.922057] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-22T18:00:59.349302] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T18:00:59.532113] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-22T18:00:59.722055] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-22T18:01:00.312685] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T18:01:00.522084] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-22T18:01:00.673678] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T18:01:01.126146] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-22T18:01:01.322069] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-22T18:01:02.122058] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-22T18:01:02.922101] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-22T18:01:03.107979] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T18:01:03.335605] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T18:01:03.339778] [INFO ] [REMOTE ] CLDT: Full fetch complete (37055 records). [2025-09-22T18:01:03.339904] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-22T18:01:03.734009] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-22T18:01:03.751346] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-22T18:01:03.751473] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-22T18:01:03.752288] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-22T18:01:03.752490] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-22T18:01:03.753826] [DEBUG] [LOCAL ] CLDT: Trimmed 37055 records to 25898 (keeping 200 days of data) [2025-09-22T18:01:03.850875] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T18:01:03.869746] [INFO ] [REMOTE ] CLCO: Full fetch complete (23250 records). [2025-09-22T18:01:03.873387] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-22T18:01:04.060682] [DEBUG] [LOCAL ] CLDT: Primary data saved (25898 records). [2025-09-22T18:01:04.079387] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-22T18:01:04.079901] [INFO ] [MAIN ] Update Progress: 463/2372 symbols completed. CLDT took 31.4s. Estimated remaining: 4h 11m 32s. Rate: 7.6 symbols/min [2025-09-22T18:01:04.500119] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:01:04.512337] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-22T18:01:04.512451] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-22T18:01:04.512938] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-22T18:01:04.513101] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-22T18:01:04.513922] [DEBUG] [LOCAL ] CLCO: Trimmed 23250 records to 12942 (keeping 200 days of data) [2025-09-22T18:01:04.543197] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-22T18:01:04.582982] [DEBUG] [LOCAL ] CLPR: Loaded 11738 existing records from primary storage. [2025-09-22T18:01:04.583779] [INFO ] [MAIN ] CLPR: Loaded 11738 existing records. [2025-09-22T18:01:04.724432] [DEBUG] [LOCAL ] CLCO: Primary data saved (12942 records). [2025-09-22T18:01:04.742741] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-22T18:01:04.747990] [INFO ] [MAIN ] Update Progress: 464/2372 symbols completed. CLCO took 33.6s. Estimated remaining: 4h 10m 54s. Rate: 7.6 symbols/min [2025-09-22T18:01:04.797358] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:01:04.850834] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-22T18:01:04.862373] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-22T18:01:04.888692] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-22T18:01:04.888803] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-22T18:01:05.110143] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:01:05.363562] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:01:05.363947] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-22T18:01:05.386973] [DEBUG] [LOCAL ] CLS: Loaded 54422 existing records from primary storage. [2025-09-22T18:01:05.387139] [INFO ] [MAIN ] CLS: Loaded 54422 existing records. [2025-09-22T18:01:05.568374] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:01:05.568627] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-22T18:01:05.568711] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-22T18:01:05.570109] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-22T18:01:05.570173] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-22T18:01:05.936162] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:01:05.973130] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T18:01:05.994820] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-22T18:01:06.122018] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-22T18:01:06.508973] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T18:01:06.922068] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-22T18:01:07.314331] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T18:01:07.638509] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T18:01:07.722083] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-22T18:01:08.522130] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-22T18:01:09.322029] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-22T18:01:09.386217] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T18:01:09.754140] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-22T18:01:10.122087] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-22T18:01:10.916365] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T18:01:10.921996] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-22T18:01:11.452092] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-22T18:01:11.722042] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-22T18:01:11.979282] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T18:01:12.522058] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-22T18:01:13.322045] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-22T18:01:13.810862] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-22T18:01:14.092178] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T18:01:14.122005] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-22T18:01:14.379325] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T18:01:14.839313] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T18:01:14.922062] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-22T18:01:15.722049] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-22T18:01:16.522054] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-22T18:01:16.796483] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-22T18:01:16.821572] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T18:01:16.829901] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-09-22T18:01:16.830035] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-22T18:01:17.232471] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-22T18:01:17.232615] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-22T18:01:17.233465] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-22T18:01:17.233519] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-22T18:01:17.235055] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-09-22T18:01:17.323741] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-22T18:01:17.550017] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-09-22T18:01:17.550153] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-22T18:01:17.550230] [INFO ] [MAIN ] Update Progress: 465/2372 symbols completed. CLF took 35.1s. Estimated remaining: 4h 11m 6s. Rate: 7.6 symbols/min [2025-09-22T18:01:17.726119] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:01:17.797577] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-22T18:01:17.798579] [DEBUG] [LOCAL ] CLVT: Loaded 52761 existing records from primary storage. [2025-09-22T18:01:17.798938] [INFO ] [MAIN ] CLVT: Loaded 52761 existing records. [2025-09-22T18:01:17.989925] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:01:17.990257] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-22T18:01:17.990317] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-22T18:01:17.991611] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-22T18:01:17.991715] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-22T18:01:18.129336] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-22T18:01:18.349550] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:01:18.922041] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-22T18:01:18.996271] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T18:01:19.332960] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-22T18:01:19.722055] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-22T18:01:20.297049] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T18:01:20.522072] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-22T18:01:20.541665] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T18:01:20.543381] [INFO ] [REMOTE ] CLPR: Full fetch complete (17807 records). [2025-09-22T18:01:20.543453] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-22T18:01:20.919589] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-22T18:01:20.919702] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-22T18:01:20.920113] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-22T18:01:20.920157] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-22T18:01:20.920763] [DEBUG] [LOCAL ] CLPR: Trimmed 17807 records to 11586 (keeping 200 days of data) [2025-09-22T18:01:20.992596] [DEBUG] [LOCAL ] CLPR: Primary data saved (11586 records). [2025-09-22T18:01:20.992774] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-22T18:01:20.992876] [INFO ] [MAIN ] Update Progress: 466/2372 symbols completed. CLPR took 16.9s. Estimated remaining: 4h 10m 40s. Rate: 7.6 symbols/min [2025-09-22T18:01:21.176372] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:01:21.176577] [DEBUG] [LOCAL ] CLW: No existing data file found in primary storage. [2025-09-22T18:01:21.176816] [WARN ] [MAIN ] CLW: No existing data found, performing full refresh instead. [2025-09-22T18:01:21.176971] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-22T18:01:21.177017] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-22T18:01:21.177059] [DEBUG] [LOCAL ] CLW: No primary data file found to delete. [2025-09-22T18:01:21.177091] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-22T18:01:21.328444] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-22T18:01:21.609748] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:01:22.122071] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-22T18:01:22.268230] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T18:01:22.651366] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T18:01:22.922071] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-22T18:01:23.130957] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T18:01:23.722079] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-22T18:01:24.233737] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T18:01:24.522059] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-22T18:01:25.046438] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T18:01:25.322039] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-22T18:01:25.814298] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T18:01:26.122029] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-22T18:01:26.745799] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T18:01:26.893270] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T18:01:26.922124] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-22T18:01:27.722149] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-22T18:01:27.998128] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T18:01:28.522103] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-22T18:01:29.322097] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-22T18:01:29.462171] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T18:01:30.122056] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-22T18:01:30.318404] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-22T18:01:30.642970] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-22T18:01:30.922108] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-22T18:01:31.722027] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-22T18:01:31.887141] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T18:01:32.096549] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T18:01:32.522087] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-22T18:01:32.903019] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T18:01:33.322080] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-22T18:01:34.122086] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-22T18:01:34.915259] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-22T18:01:34.925973] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-22T18:01:35.073601] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T18:01:35.176850] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T18:01:35.722103] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-22T18:01:36.195717] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T18:01:36.522117] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-22T18:01:37.322041] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-22T18:01:37.779958] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-22T18:01:38.122066] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-22T18:01:38.459308] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T18:01:38.485184] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T18:01:38.492048] [INFO ] [REMOTE ] CLH: Full fetch complete (41778 records). [2025-09-22T18:01:38.492227] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-22T18:01:38.913956] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-22T18:01:38.914107] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-22T18:01:38.914857] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-22T18:01:38.914927] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-22T18:01:38.918905] [DEBUG] [LOCAL ] CLH: Trimmed 41778 records to 28259 (keeping 200 days of data) [2025-09-22T18:01:38.922105] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-22T18:01:39.105894] [DEBUG] [LOCAL ] CLH: Primary data saved (28259 records). [2025-09-22T18:01:39.106066] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-22T18:01:39.106210] [INFO ] [MAIN ] Update Progress: 467/2372 symbols completed. CLH took 41.3s. Estimated remaining: 4h 11m 14s. Rate: 7.6 symbols/min [2025-09-22T18:01:39.285964] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:01:39.345713] [DEBUG] [LOCAL ] CLX: Loaded 52158 existing records from primary storage. [2025-09-22T18:01:39.345926] [INFO ] [MAIN ] CLX: Loaded 52158 existing records. [2025-09-22T18:01:39.539105] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:01:39.539524] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-22T18:01:39.539593] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-22T18:01:39.542170] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-22T18:01:39.542234] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-22T18:01:39.727479] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-22T18:01:39.935967] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:01:40.028981] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-22T18:01:40.522074] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-22T18:01:40.773810] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T18:01:40.813747] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T18:01:41.322043] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-22T18:01:42.122109] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-22T18:01:42.866843] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-22T18:01:42.922063] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-22T18:01:43.019871] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T18:01:43.432585] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T18:01:43.440345] [INFO ] [REMOTE ] CLVT: Full fetch complete (74853 records). [2025-09-22T18:01:43.440508] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-22T18:01:43.441408] [FATAL] [VALIDATOR ] CLVT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:01:43.441522] [FATAL] [MAIN ] CLVT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:01:43.441599] [WARN ] [MAIN ] CLVT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:01:43.441707] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-22T18:01:43.441784] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-09-22T18:01:43.441820] [INFO ] [LOCAL ] CLVT: Starting deletion of derivative data. [2025-09-22T18:01:43.442369] [DEBUG] [LOCAL ] CLVT: Deleted derivative data file. [2025-09-22T18:01:43.442471] [INFO ] [MAIN ] Update Progress: 468/2372 symbols completed. CLVT took 25.9s. Estimated remaining: 4h 10m 51s. Rate: 7.6 symbols/min [2025-09-22T18:01:43.613864] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:01:43.614108] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-09-22T18:01:43.614152] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-09-22T18:01:43.614300] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-22T18:01:43.614342] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-22T18:01:43.614384] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-22T18:01:43.614529] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-22T18:01:43.727200] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-22T18:01:43.985059] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:01:44.522118] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-22T18:01:45.122968] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T18:01:45.322056] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-22T18:01:45.363328] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-22T18:01:45.835579] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T18:01:46.122040] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-22T18:01:46.485944] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T18:01:46.922059] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-22T18:01:47.636553] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T18:01:47.722038] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-22T18:01:48.396481] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-22T18:01:48.404454] [INFO ] [REMOTE ] CLS: Full fetch complete (77063 records). [2025-09-22T18:01:48.404603] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-22T18:01:48.405395] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:01:48.405485] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:01:48.405546] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:01:48.405636] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-22T18:01:48.405793] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-09-22T18:01:48.405860] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-09-22T18:01:48.406360] [DEBUG] [LOCAL ] CLS: Deleted derivative data file. [2025-09-22T18:01:48.406480] [INFO ] [MAIN ] Update Progress: 469/2372 symbols completed. CLS took 43.7s. Estimated remaining: 4h 10m 32s. Rate: 7.6 symbols/min [2025-09-22T18:01:48.522471] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-22T18:01:48.585419] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:01:48.646412] [DEBUG] [LOCAL ] CMA: Loaded 51012 existing records from primary storage. [2025-09-22T18:01:48.646553] [INFO ] [MAIN ] CMA: Loaded 51012 existing records. [2025-09-22T18:01:48.833465] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:01:48.833802] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-22T18:01:48.833879] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-22T18:01:48.835432] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-22T18:01:48.835497] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-22T18:01:49.075558] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T18:01:49.139879] [INFO ] [REMOTE ] CLW: Full fetch complete (35173 records). [2025-09-22T18:01:49.145606] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-22T18:01:49.325010] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-22T18:01:49.330476] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:01:49.624522] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-22T18:01:49.624671] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-22T18:01:49.625302] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-22T18:01:49.625366] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-22T18:01:49.626465] [DEBUG] [LOCAL ] CLW: Trimmed 35173 records to 21949 (keeping 200 days of data) [2025-09-22T18:01:49.760099] [DEBUG] [LOCAL ] CLW: Primary data saved (21949 records). [2025-09-22T18:01:49.760231] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-22T18:01:49.760349] [INFO ] [MAIN ] Update Progress: 470/2372 symbols completed. CLW took 28.8s. Estimated remaining: 4h 9m 57s. Rate: 7.6 symbols/min [2025-09-22T18:01:49.965956] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:01:49.962672] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T18:01:49.996119] [DEBUG] [LOCAL ] CMBT: Loaded 21759 existing records from primary storage. [2025-09-22T18:01:49.996250] [INFO ] [MAIN ] CMBT: Loaded 21759 existing records. [2025-09-22T18:01:50.127184] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-22T18:01:50.180988] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:01:50.181215] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-22T18:01:50.181265] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-22T18:01:50.181830] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-22T18:01:50.181892] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-22T18:01:50.563932] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:01:50.922078] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-22T18:01:51.068225] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T18:01:51.722033] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-22T18:01:51.760715] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T18:01:52.509690] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T18:01:52.522005] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-22T18:01:52.601241] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T18:01:53.322057] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-22T18:01:54.122062] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-22T18:01:54.234860] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T18:01:54.928482] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-22T18:01:54.948802] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T18:01:55.722054] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-22T18:01:55.885263] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T18:01:56.492337] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T18:01:56.522013] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-22T18:01:57.297606] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T18:01:57.322056] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-22T18:01:58.110975] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T18:01:58.122004] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-22T18:01:58.922089] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-22T18:01:59.195481] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-22T18:01:59.473065] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:01:59.557988] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T18:01:59.722080] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-22T18:02:00.513395] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T18:02:00.521991] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-22T18:02:01.322086] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-22T18:02:01.556412] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T18:02:02.122067] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-22T18:02:02.922040] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-22T18:02:03.071270] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T18:02:03.722080] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-22T18:02:03.907927] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T18:02:04.512090] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T18:02:04.522017] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-22T18:02:04.726244] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T18:02:05.300790] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-22T18:02:05.322008] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-22T18:02:06.095736] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T18:02:06.122015] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-22T18:02:06.922045] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-22T18:02:07.286039] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T18:02:07.722072] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-22T18:02:08.352450] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T18:02:08.522101] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-22T18:02:09.322055] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-22T18:02:09.507923] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T18:02:10.122112] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-22T18:02:10.339431] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T18:02:10.722049] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T18:02:10.922034] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-22T18:02:11.722057] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-22T18:02:11.906086] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T18:02:12.229927] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T18:02:12.240457] [INFO ] [REMOTE ] CM: Full fetch complete (69042 records). [2025-09-22T18:02:12.240677] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-22T18:02:12.243627] [FATAL] [VALIDATOR ] CM: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:02:12.243803] [FATAL] [MAIN ] CM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:02:12.243903] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:02:12.244082] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-22T18:02:12.244205] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-22T18:02:12.244311] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-09-22T18:02:12.244392] [DEBUG] [LOCAL ] CM: No derivative data file found to delete. [2025-09-22T18:02:12.244515] [INFO ] [MAIN ] Update Progress: 471/2372 symbols completed. CM took 28.8s. Estimated remaining: 4h 10m 48s. Rate: 7.6 symbols/min [2025-09-22T18:02:12.425369] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:02:12.481603] [DEBUG] [LOCAL ] CMC: Loaded 46515 existing records from primary storage. [2025-09-22T18:02:12.481811] [INFO ] [MAIN ] CMC: Loaded 46515 existing records. [2025-09-22T18:02:12.527469] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-22T18:02:12.668490] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:02:12.668756] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-22T18:02:12.668810] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-22T18:02:12.670067] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-22T18:02:12.670138] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-22T18:02:13.056827] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:02:13.077744] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T18:02:13.322048] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-22T18:02:14.120339] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T18:02:14.129190] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-22T18:02:14.922070] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-22T18:02:15.049430] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T18:02:15.722057] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-22T18:02:16.221381] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-22T18:02:16.229459] [INFO ] [REMOTE ] CMBT: Full fetch complete (28858 records). [2025-09-22T18:02:16.229571] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-22T18:02:16.528177] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-22T18:02:16.629087] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-22T18:02:16.629166] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-22T18:02:16.629633] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-22T18:02:16.629751] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-22T18:02:16.630602] [DEBUG] [LOCAL ] CMBT: Trimmed 28858 records to 21739 (keeping 200 days of data) [2025-09-22T18:02:16.777723] [DEBUG] [LOCAL ] CMBT: Primary data saved (21739 records). [2025-09-22T18:02:16.777944] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-22T18:02:16.778364] [INFO ] [MAIN ] Update Progress: 472/2372 symbols completed. CMBT took 27.0s. Estimated remaining: 4h 10m 27s. Rate: 7.6 symbols/min [2025-09-22T18:02:16.928313] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-22T18:02:17.008941] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:02:17.016100] [DEBUG] [LOCAL ] CMCM: Loaded 4718 existing records from primary storage. [2025-09-22T18:02:17.016218] [INFO ] [MAIN ] CMCM: Loaded 4718 existing records. [2025-09-22T18:02:17.218355] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:02:17.218853] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-22T18:02:17.219073] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-22T18:02:17.219556] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-22T18:02:17.219786] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-22T18:02:17.329639] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-22T18:02:17.590769] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T18:02:17.702030] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:02:17.967212] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T18:02:18.122100] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-22T18:02:18.922104] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-22T18:02:19.294815] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-22T18:02:19.307198] [INFO ] [REMOTE ] CLX: Full fetch complete (72817 records). [2025-09-22T18:02:19.307365] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-22T18:02:19.722746] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-22T18:02:19.743784] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-22T18:02:19.745580] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-22T18:02:19.746512] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-22T18:02:19.746604] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-22T18:02:19.748733] [DEBUG] [LOCAL ] CLX: Trimmed 72817 records to 51429 (keeping 200 days of data) [2025-09-22T18:02:19.893545] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T18:02:20.131970] [DEBUG] [LOCAL ] CLX: Primary data saved (51429 records). [2025-09-22T18:02:20.132126] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-22T18:02:20.132213] [INFO ] [MAIN ] Update Progress: 473/2372 symbols completed. CLX took 41.0s. Estimated remaining: 4h 10m 1s. Rate: 7.6 symbols/min [2025-09-22T18:02:20.309268] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:02:20.309463] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-22T18:02:20.309501] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-22T18:02:20.309713] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-22T18:02:20.309765] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-22T18:02:20.309806] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-22T18:02:20.309848] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-22T18:02:20.461195] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-22T18:02:20.522544] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-22T18:02:20.719093] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:02:20.760834] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T18:02:21.322091] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-22T18:02:22.122067] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-22T18:02:22.326462] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:02:22.326838] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-22T18:02:22.530719] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-22T18:02:22.538829] [INFO ] [REMOTE ] CMA: Full fetch complete (73353 records). [2025-09-22T18:02:22.539054] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-22T18:02:22.927778] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-22T18:02:23.047091] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-22T18:02:23.047211] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-22T18:02:23.048061] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-22T18:02:23.048222] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-22T18:02:23.051346] [DEBUG] [LOCAL ] CMA: Trimmed 73353 records to 50210 (keeping 200 days of data) [2025-09-22T18:02:23.177508] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T18:02:23.281533] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:02:23.291061] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-22T18:02:23.426624] [DEBUG] [LOCAL ] CMA: Primary data saved (50210 records). [2025-09-22T18:02:23.426819] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-22T18:02:23.426916] [INFO ] [MAIN ] Update Progress: 474/2372 symbols completed. CMA took 35.0s. Estimated remaining: 4h 9m 34s. Rate: 7.6 symbols/min [2025-09-22T18:02:23.599299] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:02:23.599523] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-09-22T18:02:23.599579] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-09-22T18:02:23.599751] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-22T18:02:23.599801] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-22T18:02:23.599843] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-09-22T18:02:23.599876] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-22T18:02:23.727208] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-22T18:02:23.987912] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:02:24.522074] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-22T18:02:24.721984] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:02:24.722305] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-22T18:02:25.324190] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-22T18:02:25.329810] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T18:02:26.122101] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-22T18:02:26.702452] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T18:02:26.922067] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-22T18:02:27.160597] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:02:27.161107] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-22T18:02:27.462417] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-22T18:02:27.722054] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-22T18:02:28.522095] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-22T18:02:29.256860] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T18:02:29.322016] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-22T18:02:30.122194] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-22T18:02:30.546285] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T18:02:30.662257] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-22T18:02:30.787408] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T18:02:30.922072] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-22T18:02:31.722079] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-22T18:02:31.966067] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:02:31.966398] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-22T18:02:32.152809] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T18:02:32.522056] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-22T18:02:33.322086] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-22T18:02:33.798247] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T18:02:34.122086] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-22T18:02:34.437043] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T18:02:34.922079] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-22T18:02:35.421217] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-22T18:02:35.722059] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-22T18:02:35.855618] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T18:02:35.863414] [INFO ] [REMOTE ] CMC: Full fetch complete (66858 records). [2025-09-22T18:02:35.863542] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-22T18:02:36.260520] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-22T18:02:36.260622] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-22T18:02:36.261395] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-22T18:02:36.261452] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-22T18:02:36.262816] [DEBUG] [LOCAL ] CMC: Trimmed 66858 records to 45757 (keeping 200 days of data) [2025-09-22T18:02:36.533911] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-22T18:02:36.555849] [DEBUG] [LOCAL ] CMC: Primary data saved (45757 records). [2025-09-22T18:02:36.556035] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-22T18:02:36.556125] [INFO ] [MAIN ] Update Progress: 475/2372 symbols completed. CMC took 24.3s. Estimated remaining: 4h 9m 47s. Rate: 7.6 symbols/min [2025-09-22T18:02:36.728941] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:02:36.748271] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T18:02:36.785390] [DEBUG] [LOCAL ] CMI: Loaded 42606 existing records from primary storage. [2025-09-22T18:02:36.785543] [INFO ] [MAIN ] CMI: Loaded 42606 existing records. [2025-09-22T18:02:36.970535] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:02:36.970873] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-22T18:02:36.970941] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-22T18:02:36.972070] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-22T18:02:36.972130] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-22T18:02:37.262851] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T18:02:37.341416] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-22T18:02:37.347897] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:02:38.122076] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-22T18:02:38.176776] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T18:02:38.922062] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-22T18:02:39.580014] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T18:02:39.722109] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-22T18:02:39.829985] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-22T18:02:40.040482] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-22T18:02:40.522086] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-22T18:02:41.322053] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-22T18:02:42.009578] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T18:02:42.012108] [INFO ] [REMOTE ] CMDB: Full fetch complete (10609 records). [2025-09-22T18:02:42.012194] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-22T18:02:42.127127] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-22T18:02:42.201184] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 95 unique days, need 200 days [2025-09-22T18:02:42.201479] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:02:42.201552] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:02:42.201631] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-22T18:02:42.201738] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-22T18:02:42.201782] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-22T18:02:42.201841] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-22T18:02:42.201935] [INFO ] [MAIN ] Update Progress: 476/2372 symbols completed. CMDB took 22.1s. Estimated remaining: 4h 9m 30s. Rate: 7.6 symbols/min [2025-09-22T18:02:42.375221] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:02:42.416777] [DEBUG] [LOCAL ] CMP: Loaded 37120 existing records from primary storage. [2025-09-22T18:02:42.416936] [INFO ] [MAIN ] CMP: Loaded 37120 existing records. [2025-09-22T18:02:42.593751] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:02:42.594013] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-22T18:02:42.594062] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-22T18:02:42.594953] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-22T18:02:42.595014] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-22T18:02:42.924027] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-22T18:02:42.968734] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:02:43.000249] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-22T18:02:43.495298] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T18:02:43.544544] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-22T18:02:43.722063] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-22T18:02:44.522066] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-22T18:02:45.322022] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-22T18:02:45.831572] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-22T18:02:45.964556] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T18:02:46.078098] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T18:02:46.122090] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-22T18:02:46.922087] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-22T18:02:47.698916] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T18:02:47.722002] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-22T18:02:48.486089] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T18:02:48.522034] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-22T18:02:49.322107] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-22T18:02:49.468450] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T18:02:49.922298] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T18:02:50.122081] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-22T18:02:50.922115] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-22T18:02:51.559769] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-22T18:02:51.653280] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-22T18:02:51.727188] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-22T18:02:51.741232] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T18:02:52.522069] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-22T18:02:53.190517] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-22T18:02:53.192696] [INFO ] [REMOTE ] CMCM: Full fetch complete (7035 records). [2025-09-22T18:02:53.192770] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-22T18:02:53.334704] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-22T18:02:53.562478] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-22T18:02:53.562560] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-22T18:02:53.562764] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-22T18:02:53.562836] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-22T18:02:53.563250] [DEBUG] [LOCAL ] CMCM: Trimmed 7035 records to 4698 (keeping 200 days of data) [2025-09-22T18:02:53.588968] [DEBUG] [LOCAL ] CMCM: Primary data saved (4698 records). [2025-09-22T18:02:53.589045] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-22T18:02:53.589123] [INFO ] [MAIN ] Update Progress: 477/2372 symbols completed. CMCM took 36.8s. Estimated remaining: 4h 9m 36s. Rate: 7.6 symbols/min [2025-09-22T18:02:53.936908] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-22T18:02:54.122062] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-22T18:02:54.785304] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T18:02:54.922079] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-22T18:02:55.722055] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-22T18:02:55.994988] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T18:02:56.322073] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T18:02:56.522148] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-22T18:02:57.328600] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-22T18:02:57.359272] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T18:02:57.965880] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T18:02:58.122065] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-22T18:02:58.922101] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-22T18:02:59.240291] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-22T18:02:59.722124] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-22T18:02:59.883238] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T18:03:00.522063] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-22T18:03:00.650842] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T18:03:01.322067] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-22T18:03:01.965922] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T18:03:02.132990] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-22T18:03:02.141301] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-22T18:03:02.922119] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-22T18:03:03.461968] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-22T18:03:03.722051] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-22T18:03:04.554491] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-22T18:03:04.563178] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-22T18:03:05.760677] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-22T18:03:05.768622] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-22T18:03:06.149872] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-22T18:03:06.156557] [INFO ] [REMOTE ] CMI: Full fetch complete (59532 records). [2025-09-22T18:03:06.156767] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-22T18:03:06.157497] [FATAL] [VALIDATOR ] CMI: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:03:06.157628] [FATAL] [MAIN ] CMI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:03:06.157708] [WARN ] [MAIN ] CMI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:03:06.157780] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-22T18:03:06.157847] [DEBUG] [LOCAL ] CMI: No primary data file found to delete. [2025-09-22T18:03:06.157884] [INFO ] [LOCAL ] CMI: Starting deletion of derivative data. [2025-09-22T18:03:06.158368] [DEBUG] [LOCAL ] CMI: Deleted derivative data file. [2025-09-22T18:03:06.158472] [INFO ] [MAIN ] Update Progress: 478/2372 symbols completed. CMI took 29.6s. Estimated remaining: 4h 9m 47s. Rate: 7.6 symbols/min [2025-09-22T18:03:06.457450] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (3.54 seconds). [2025-09-22T18:03:06.465378] [INFO ] [REMOTE ] CMG: Full fetch complete (77404 records). [2025-09-22T18:03:06.465525] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-22T18:03:06.466565] [FATAL] [VALIDATOR ] CMG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:03:06.466684] [FATAL] [MAIN ] CMG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:03:06.466742] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:03:06.466823] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-22T18:03:06.466903] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-09-22T18:03:06.466949] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-09-22T18:03:06.467044] [DEBUG] [LOCAL ] CMG: No derivative data file found to delete. [2025-09-22T18:03:06.467134] [INFO ] [MAIN ] Update Progress: 479/2372 symbols completed. CMG took 43.0s. Estimated remaining: 4h 9m 9s. Rate: 7.6 symbols/min [2025-09-22T18:03:06.670291] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T18:03:06.674776] [INFO ] [REMOTE ] CMP: Full fetch complete (53005 records). [2025-09-22T18:03:06.674903] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-22T18:03:06.675603] [FATAL] [VALIDATOR ] CMP: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:03:06.675719] [FATAL] [MAIN ] CMP: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:03:06.675792] [WARN ] [MAIN ] CMP: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:03:06.675866] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-22T18:03:06.675938] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-22T18:03:06.675975] [INFO ] [LOCAL ] CMP: Starting deletion of derivative data. [2025-09-22T18:03:06.676444] [DEBUG] [LOCAL ] CMP: Deleted derivative data file. [2025-09-22T18:03:06.676541] [INFO ] [MAIN ] Update Progress: 480/2372 symbols completed. CMP took 24.5s. Estimated remaining: 4h 8m 31s. Rate: 7.6 symbols/min [2025-09-22T18:03:07.361342] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:03:07.381919] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:03:07.428983] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:03:07.429899] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:03:07.441328] [DEBUG] [LOCAL ] CMSA: Loaded 3404 existing records from primary storage. [2025-09-22T18:03:07.444874] [INFO ] [MAIN ] CMSA: Loaded 3404 existing records. [2025-09-22T18:03:07.444585] [DEBUG] [LOCAL ] CMSC: Loaded 5184 existing records from primary storage. [2025-09-22T18:03:07.445002] [INFO ] [MAIN ] CMSC: Loaded 5184 existing records. [2025-09-22T18:03:07.821880] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:03:07.843506] [DEBUG] [LOCAL ] CMRE: Loaded 36224 existing records from primary storage. [2025-09-22T18:03:07.871896] [INFO ] [MAIN ] CMRE: Loaded 36224 existing records. [2025-09-22T18:03:07.927759] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:03:07.937446] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-22T18:03:07.972280] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-22T18:03:07.971875] [DEBUG] [LOCAL ] CMS: Loaded 53419 existing records from primary storage. [2025-09-22T18:03:07.977837] [INFO ] [MAIN ] CMS: Loaded 53419 existing records. [2025-09-22T18:03:07.972462] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-22T18:03:08.013725] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-22T18:03:08.004139] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-22T18:03:08.048002] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-22T18:03:08.048136] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-22T18:03:08.058728] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-22T18:03:08.363118] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:03:08.438859] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-22T18:03:08.449580] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-22T18:03:08.486348] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-22T18:03:08.520567] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-22T18:03:08.706335] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:03:08.823669] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-22T18:03:08.981669] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-22T18:03:09.042795] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-22T18:03:09.069277] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-22T18:03:09.360967] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:03:09.374733] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:03:09.405090] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-22T18:03:09.393285] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-22T18:03:09.668835] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:03:09.722983] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-22T18:03:09.876133] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:03:09.876488] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-22T18:03:10.019917] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-22T18:03:10.022185] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-22T18:03:10.252316] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T18:03:10.253979] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-22T18:03:10.618499] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T18:03:10.821582] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T18:03:10.876835] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T18:03:10.922025] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-22T18:03:11.237285] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-22T18:03:11.548302] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T18:03:11.722053] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-22T18:03:12.522050] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-22T18:03:12.987173] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-22T18:03:13.332026] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-22T18:03:13.337662] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T18:03:13.879419] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T18:03:14.122090] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-22T18:03:14.922141] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-22T18:03:15.401957] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-22T18:03:15.499342] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T18:03:15.722082] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-22T18:03:16.522104] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-22T18:03:17.075441] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T18:03:17.164513] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T18:03:17.322034] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-22T18:03:17.702792] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-22T18:03:18.122072] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-22T18:03:18.922067] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-22T18:03:19.643519] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T18:03:19.700049] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T18:03:19.722016] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-22T18:03:20.522056] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-22T18:03:21.322046] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-22T18:03:21.653111] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T18:03:21.989964] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T18:03:22.122054] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-22T18:03:22.279277] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-22T18:03:22.501810] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-22T18:03:22.922087] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-22T18:03:23.722077] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-22T18:03:24.034694] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-22T18:03:24.522082] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-22T18:03:24.658587] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T18:03:25.103875] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-22T18:03:25.104999] [INFO ] [REMOTE ] CMSA: Full fetch complete (5035 records). [2025-09-22T18:03:25.105068] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-22T18:03:25.327132] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-22T18:03:25.475308] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-22T18:03:25.475383] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-22T18:03:25.475540] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-22T18:03:25.475579] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-22T18:03:25.476002] [DEBUG] [LOCAL ] CMSA: Trimmed 5035 records to 3375 (keeping 200 days of data) [2025-09-22T18:03:25.499058] [DEBUG] [LOCAL ] CMSA: Primary data saved (3375 records). [2025-09-22T18:03:25.499125] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-22T18:03:25.499199] [INFO ] [MAIN ] Update Progress: 481/2372 symbols completed. CMSA took 18.8s. Estimated remaining: 4h 9m 6s. Rate: 7.6 symbols/min [2025-09-22T18:03:25.669542] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:03:25.679452] [DEBUG] [LOCAL ] CMSD: Loaded 8242 existing records from primary storage. [2025-09-22T18:03:25.679560] [INFO ] [MAIN ] CMSD: Loaded 8242 existing records. [2025-09-22T18:03:25.870162] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:03:25.870917] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-22T18:03:25.872951] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-22T18:03:25.873037] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-22T18:03:25.873423] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-22T18:03:25.873482] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-22T18:03:26.127174] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-22T18:03:26.245221] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:03:26.922074] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-22T18:03:27.621025] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-22T18:03:27.722127] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-22T18:03:27.926795] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T18:03:28.285398] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-22T18:03:28.522109] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-22T18:03:29.322056] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-22T18:03:29.720577] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-22T18:03:30.010931] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T18:03:30.122061] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-22T18:03:30.922151] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-22T18:03:31.476328] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:03:31.722166] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-22T18:03:32.467055] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T18:03:32.522049] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-22T18:03:32.577678] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T18:03:33.047602] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-22T18:03:33.322069] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-22T18:03:34.122151] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-22T18:03:34.837615] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T18:03:34.922158] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-22T18:03:34.998856] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T18:03:35.722123] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-22T18:03:36.404373] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T18:03:36.522165] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-22T18:03:36.797909] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T18:03:37.322095] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-22T18:03:38.056375] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T18:03:38.122094] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-22T18:03:38.227009] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T18:03:38.457906] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-22T18:03:38.922066] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-22T18:03:39.722036] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-22T18:03:40.173851] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T18:03:40.182624] [INFO ] [REMOTE ] CMRE: Full fetch complete (49382 records). [2025-09-22T18:03:40.182808] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-22T18:03:40.529459] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-22T18:03:40.568325] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-22T18:03:40.568677] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-22T18:03:40.569399] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-22T18:03:40.572507] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-22T18:03:40.576251] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-22T18:03:40.579563] [DEBUG] [LOCAL ] CMRE: Trimmed 49382 records to 35472 (keeping 200 days of data) [2025-09-22T18:03:40.788597] [DEBUG] [LOCAL ] CMRE: Primary data saved (35472 records). [2025-09-22T18:03:40.788764] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-22T18:03:40.788858] [INFO ] [MAIN ] Update Progress: 482/2372 symbols completed. CMRE took 34.1s. Estimated remaining: 4h 9m 27s. Rate: 7.6 symbols/min [2025-09-22T18:03:40.962088] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:03:41.006770] [DEBUG] [LOCAL ] CMTG: Loaded 38290 existing records from primary storage. [2025-09-22T18:03:41.006931] [INFO ] [MAIN ] CMTG: Loaded 38290 existing records. [2025-09-22T18:03:41.112784] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-22T18:03:41.134817] [INFO ] [REMOTE ] CMSC: Full fetch complete (7150 records). [2025-09-22T18:03:41.153304] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-22T18:03:41.286712] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:03:41.297961] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-22T18:03:41.303618] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-22T18:03:41.325135] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-22T18:03:41.319976] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-22T18:03:41.351469] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-22T18:03:41.858743] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-22T18:03:41.869601] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-22T18:03:41.879281] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-22T18:03:41.881867] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-22T18:03:41.888000] [DEBUG] [LOCAL ] CMSC: Trimmed 7150 records to 5089 (keeping 200 days of data) [2025-09-22T18:03:41.985731] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:03:41.994105] [DEBUG] [LOCAL ] CMSC: Primary data saved (5089 records). [2025-09-22T18:03:41.994174] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-22T18:03:41.994243] [INFO ] [MAIN ] Update Progress: 483/2372 symbols completed. CMSC took 35.3s. Estimated remaining: 4h 8m 53s. Rate: 7.6 symbols/min [2025-09-22T18:03:42.132764] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-22T18:03:42.167007] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:03:42.177996] [DEBUG] [LOCAL ] CMU: Loaded 7451 existing records from primary storage. [2025-09-22T18:03:42.178112] [INFO ] [MAIN ] CMU: Loaded 7451 existing records. [2025-09-22T18:03:42.362245] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:03:42.362479] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-22T18:03:42.362527] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-22T18:03:42.362829] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-22T18:03:42.362913] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-22T18:03:42.750588] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:03:42.843759] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T18:03:42.922018] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-22T18:03:43.190569] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T18:03:43.722078] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-22T18:03:44.451575] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T18:03:44.504030] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T18:03:44.522007] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-22T18:03:45.322062] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-22T18:03:46.122039] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-22T18:03:46.210130] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-22T18:03:46.645823] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T18:03:46.703517] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T18:03:46.922078] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-22T18:03:47.722119] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-22T18:03:48.450064] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T18:03:48.522134] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-22T18:03:48.852415] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T18:03:48.861075] [INFO ] [REMOTE ] CMS: Full fetch complete (76045 records). [2025-09-22T18:03:48.861225] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-22T18:03:49.266874] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-22T18:03:49.266959] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-22T18:03:49.267829] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-22T18:03:49.267895] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-22T18:03:49.269779] [DEBUG] [LOCAL ] CMS: Trimmed 76045 records to 52636 (keeping 200 days of data) [2025-09-22T18:03:49.328349] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-22T18:03:49.604436] [DEBUG] [LOCAL ] CMS: Primary data saved (52636 records). [2025-09-22T18:03:49.604580] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-22T18:03:49.604697] [INFO ] [MAIN ] Update Progress: 484/2372 symbols completed. CMS took 42.9s. Estimated remaining: 4h 8m 44s. Rate: 7.6 symbols/min [2025-09-22T18:03:49.718617] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T18:03:49.756169] [INFO ] [REMOTE ] CMSD: Full fetch complete (12523 records). [2025-09-22T18:03:49.770106] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-22T18:03:49.787884] [FATAL] [VALIDATOR ] CMSD: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:03:49.789414] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:03:49.789617] [FATAL] [MAIN ] CMSD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:03:49.790066] [WARN ] [MAIN ] CMSD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:03:49.790143] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-22T18:03:49.790218] [DEBUG] [LOCAL ] CMSD: No primary data file found to delete. [2025-09-22T18:03:49.790256] [INFO ] [LOCAL ] CMSD: Starting deletion of derivative data. [2025-09-22T18:03:49.790815] [DEBUG] [LOCAL ] CMSD: Deleted derivative data file. [2025-09-22T18:03:49.791040] [INFO ] [MAIN ] Update Progress: 485/2372 symbols completed. CMSD took 24.3s. Estimated remaining: 4h 8m 6s. Rate: 7.6 symbols/min [2025-09-22T18:03:49.976777] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:03:49.980928] [DEBUG] [LOCAL ] CNC: No existing data file found in primary storage. [2025-09-22T18:03:49.981078] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T18:03:49.983042] [WARN ] [MAIN ] CNC: No existing data found, performing full refresh instead. [2025-09-22T18:03:49.983199] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-22T18:03:49.983248] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-22T18:03:49.983842] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-09-22T18:03:49.983975] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-22T18:03:50.065741] [DEBUG] [LOCAL ] CNA: Loaded 33238 existing records from primary storage. [2025-09-22T18:03:50.094688] [INFO ] [MAIN ] CNA: Loaded 33238 existing records. [2025-09-22T18:03:50.129707] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-22T18:03:50.489450] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:03:50.493056] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-22T18:03:50.498557] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-22T18:03:50.543587] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-22T18:03:50.554269] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-22T18:03:50.575730] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:03:50.929249] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-22T18:03:50.929179] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:03:51.628258] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T18:03:51.722009] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-22T18:03:52.522057] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-22T18:03:52.788160] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T18:03:52.929952] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T18:03:53.322079] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-22T18:03:53.334421] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T18:03:54.122092] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-22T18:03:54.922085] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-22T18:03:54.997111] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T18:03:55.443461] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T18:03:55.722056] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-22T18:03:55.907881] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T18:03:56.522076] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-22T18:03:56.955113] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T18:03:57.322064] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-22T18:03:57.898322] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T18:03:58.122076] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-22T18:03:58.410409] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T18:03:58.922061] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-22T18:03:59.376487] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T18:03:59.722061] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-22T18:04:00.425401] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T18:04:00.522055] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-22T18:04:01.230413] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T18:04:01.322057] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-22T18:04:01.362426] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T18:04:02.122080] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-22T18:04:02.922041] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-22T18:04:03.325982] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T18:04:03.634193] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T18:04:03.722018] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-22T18:04:04.269094] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T18:04:04.522058] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-22T18:04:04.873692] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T18:04:05.322061] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-22T18:04:05.746154] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T18:04:06.122055] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-22T18:04:06.922037] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-22T18:04:07.002096] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T18:04:07.271530] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-22T18:04:07.716689] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T18:04:07.722030] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-22T18:04:08.349073] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-22T18:04:08.522139] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-22T18:04:09.322091] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-22T18:04:10.122128] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-22T18:04:10.418259] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-22T18:04:10.697542] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T18:04:10.922048] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-22T18:04:11.148770] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T18:04:11.722063] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-22T18:04:12.412014] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T18:04:12.476978] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T18:04:12.478519] [INFO ] [REMOTE ] CMU: Full fetch complete (9663 records). [2025-09-22T18:04:12.478609] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-22T18:04:12.527240] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-22T18:04:12.876169] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-22T18:04:12.876258] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-22T18:04:12.876576] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-22T18:04:12.876635] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-22T18:04:12.877138] [DEBUG] [LOCAL ] CMU: Trimmed 9663 records to 7353 (keeping 200 days of data) [2025-09-22T18:04:12.923273] [DEBUG] [LOCAL ] CMU: Primary data saved (7353 records). [2025-09-22T18:04:12.923400] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-22T18:04:12.923482] [INFO ] [MAIN ] Update Progress: 486/2372 symbols completed. CMU took 30.9s. Estimated remaining: 4h 8m 57s. Rate: 7.6 symbols/min [2025-09-22T18:04:13.096247] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:04:13.108900] [DEBUG] [LOCAL ] CNF: Loaded 10887 existing records from primary storage. [2025-09-22T18:04:13.109099] [INFO ] [MAIN ] CNF: Loaded 10887 existing records. [2025-09-22T18:04:13.304177] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:04:13.304494] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-22T18:04:13.304571] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-22T18:04:13.305198] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-22T18:04:13.305261] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-22T18:04:13.327265] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-22T18:04:13.687736] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:04:14.122085] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-22T18:04:14.599101] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T18:04:14.604787] [INFO ] [REMOTE ] CMTG: Full fetch complete (53022 records). [2025-09-22T18:04:14.604972] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-22T18:04:14.926892] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-22T18:04:15.013088] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-22T18:04:15.013265] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-22T18:04:15.014177] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-22T18:04:15.014280] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-22T18:04:15.015205] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T18:04:15.020688] [DEBUG] [LOCAL ] CMTG: Trimmed 53022 records to 37558 (keeping 200 days of data) [2025-09-22T18:04:15.260918] [DEBUG] [LOCAL ] CMTG: Primary data saved (37558 records). [2025-09-22T18:04:15.261160] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-22T18:04:15.261431] [INFO ] [MAIN ] Update Progress: 487/2372 symbols completed. CMTG took 34.5s. Estimated remaining: 4h 8m 28s. Rate: 7.6 symbols/min [2025-09-22T18:04:15.453066] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:04:15.453396] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-09-22T18:04:15.453467] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-09-22T18:04:15.453803] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-22T18:04:15.453876] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-22T18:04:15.453992] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-09-22T18:04:15.454117] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-22T18:04:15.676668] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-09-22T18:04:15.726457] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-22T18:04:15.883024] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:04:16.374733] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T18:04:16.522072] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-22T18:04:16.886299] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T18:04:17.322087] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-22T18:04:17.779341] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-22T18:04:18.122078] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-22T18:04:18.476487] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T18:04:18.922095] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-22T18:04:19.722112] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-22T18:04:20.037397] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-22T18:04:20.411370] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T18:04:20.519881] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T18:04:20.522380] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-22T18:04:21.322053] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-22T18:04:21.903826] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-22T18:04:22.005796] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T18:04:22.122075] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-22T18:04:22.922121] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-22T18:04:23.694812] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T18:04:23.722000] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-22T18:04:23.859447] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T18:04:23.864456] [INFO ] [REMOTE ] CNA: Full fetch complete (45504 records). [2025-09-22T18:04:23.864575] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-22T18:04:24.291454] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-22T18:04:24.291563] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-22T18:04:24.292267] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-22T18:04:24.292360] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-22T18:04:24.293543] [DEBUG] [LOCAL ] CNA: Trimmed 45504 records to 32761 (keeping 200 days of data) [2025-09-22T18:04:24.517226] [DEBUG] [LOCAL ] CNA: Primary data saved (32761 records). [2025-09-22T18:04:24.517397] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-22T18:04:24.517616] [INFO ] [MAIN ] Update Progress: 488/2372 symbols completed. CNA took 34.9s. Estimated remaining: 4h 8m 25s. Rate: 7.6 symbols/min [2025-09-22T18:04:24.523355] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-22T18:04:24.719106] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:04:24.785724] [DEBUG] [LOCAL ] CNI: Loaded 52411 existing records from primary storage. [2025-09-22T18:04:24.785905] [INFO ] [MAIN ] CNI: Loaded 52411 existing records. [2025-09-22T18:04:24.975960] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:04:24.976251] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-22T18:04:24.976300] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-22T18:04:24.978844] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-22T18:04:24.978916] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-22T18:04:25.326440] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-22T18:04:25.349438] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:04:25.478112] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T18:04:25.934733] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T18:04:26.122074] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-22T18:04:26.642991] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-22T18:04:26.653732] [INFO ] [REMOTE ] CNC: Full fetch complete (77670 records). [2025-09-22T18:04:26.653900] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-22T18:04:26.930988] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-22T18:04:27.075928] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-22T18:04:27.076031] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-22T18:04:27.077031] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-22T18:04:27.077108] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-22T18:04:27.079374] [DEBUG] [LOCAL ] CNC: Trimmed 77670 records to 53733 (keeping 200 days of data) [2025-09-22T18:04:27.420238] [DEBUG] [LOCAL ] CNC: Primary data saved (53733 records). [2025-09-22T18:04:27.420388] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-22T18:04:27.420539] [INFO ] [MAIN ] Update Progress: 489/2372 symbols completed. CNC took 37.6s. Estimated remaining: 4h 7m 58s. Rate: 7.6 symbols/min [2025-09-22T18:04:27.599629] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:04:27.636830] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T18:04:27.698339] [DEBUG] [LOCAL ] CNK: Loaded 53688 existing records from primary storage. [2025-09-22T18:04:27.698510] [INFO ] [MAIN ] CNK: Loaded 53688 existing records. [2025-09-22T18:04:27.728978] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-22T18:04:27.881157] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:04:27.881406] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-22T18:04:27.881453] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-22T18:04:27.882991] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-22T18:04:27.883074] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-22T18:04:28.064332] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T18:04:28.267252] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:04:28.522128] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-22T18:04:29.322061] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-22T18:04:29.631102] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-22T18:04:29.787706] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-22T18:04:29.876831] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T18:04:30.122105] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-22T18:04:30.922043] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-22T18:04:31.711716] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T18:04:31.721996] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-22T18:04:32.522075] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-22T18:04:32.690076] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T18:04:33.024408] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T18:04:33.322057] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-22T18:04:34.122086] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-22T18:04:34.321457] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T18:04:34.922066] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-22T18:04:35.093216] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T18:04:35.726737] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-22T18:04:35.732850] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T18:04:36.522136] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-22T18:04:36.753123] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T18:04:37.322139] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-22T18:04:37.632276] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T18:04:37.925285] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T18:04:38.122070] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-22T18:04:38.888927] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T18:04:38.922030] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-22T18:04:39.722107] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-22T18:04:39.935090] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T18:04:40.522141] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-22T18:04:40.638401] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T18:04:40.647946] [INFO ] [REMOTE ] CNH: Full fetch complete (77536 records). [2025-09-22T18:04:40.648172] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-22T18:04:41.068251] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-22T18:04:41.068380] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-22T18:04:41.069326] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-22T18:04:41.069398] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-22T18:04:41.071071] [DEBUG] [LOCAL ] CNH: Trimmed 77536 records to 53562 (keeping 200 days of data) [2025-09-22T18:04:41.339020] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-22T18:04:41.428856] [DEBUG] [LOCAL ] CNH: Primary data saved (53562 records). [2025-09-22T18:04:41.429481] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-22T18:04:41.429788] [INFO ] [MAIN ] Update Progress: 490/2372 symbols completed. CNH took 26.2s. Estimated remaining: 4h 8m 13s. Rate: 7.6 symbols/min [2025-09-22T18:04:41.669087] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:04:41.703968] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T18:04:41.771215] [DEBUG] [LOCAL ] CNM: Loaded 51723 existing records from primary storage. [2025-09-22T18:04:41.771379] [INFO ] [MAIN ] CNM: Loaded 51723 existing records. [2025-09-22T18:04:41.970226] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:04:41.970610] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-22T18:04:41.970715] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-22T18:04:41.972156] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-22T18:04:41.972220] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-22T18:04:42.125717] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-22T18:04:42.200894] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T18:04:42.426594] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:04:42.428502] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T18:04:42.922066] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-22T18:04:43.381152] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T18:04:43.722071] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-22T18:04:44.522035] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-22T18:04:44.593933] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T18:04:45.068299] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T18:04:45.322060] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-22T18:04:46.122118] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-22T18:04:46.392788] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T18:04:46.900152] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T18:04:46.922006] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-22T18:04:46.939056] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T18:04:46.941532] [INFO ] [REMOTE ] CNF: Full fetch complete (12611 records). [2025-09-22T18:04:46.941609] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-22T18:04:47.309612] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-22T18:04:47.309717] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-22T18:04:47.310005] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-22T18:04:47.310044] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-22T18:04:47.310526] [DEBUG] [LOCAL ] CNF: Trimmed 12611 records to 10809 (keeping 200 days of data) [2025-09-22T18:04:47.377210] [DEBUG] [LOCAL ] CNF: Primary data saved (10809 records). [2025-09-22T18:04:47.377679] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-22T18:04:47.377804] [INFO ] [MAIN ] Update Progress: 491/2372 symbols completed. CNF took 34.5s. Estimated remaining: 4h 7m 58s. Rate: 7.6 symbols/min [2025-09-22T18:04:47.551055] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:04:47.599240] [DEBUG] [LOCAL ] CNMD: Loaded 33083 existing records from primary storage. [2025-09-22T18:04:47.599382] [INFO ] [MAIN ] CNMD: Loaded 33083 existing records. [2025-09-22T18:04:47.727216] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-22T18:04:47.782474] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:04:47.782872] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-22T18:04:47.782959] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-22T18:04:47.784738] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-22T18:04:47.784816] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-22T18:04:48.153902] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:04:48.212166] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T18:04:48.522074] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-22T18:04:49.322061] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-22T18:04:49.563771] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T18:04:49.894237] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T18:04:50.122015] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-22T18:04:50.537691] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T18:04:50.922103] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-22T18:04:51.573525] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T18:04:51.722036] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-22T18:04:52.220064] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T18:04:52.522051] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-22T18:04:53.146726] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T18:04:53.322097] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-22T18:04:54.122072] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-22T18:04:54.474032] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-22T18:04:54.922035] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-22T18:04:55.317465] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T18:04:55.325583] [INFO ] [REMOTE ] CNI: Full fetch complete (74680 records). [2025-09-22T18:04:55.325735] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-22T18:04:55.723039] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-22T18:04:55.727093] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-22T18:04:55.727283] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-22T18:04:55.729218] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-22T18:04:55.729309] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-22T18:04:55.731342] [DEBUG] [LOCAL ] CNI: Trimmed 74680 records to 51660 (keeping 200 days of data) [2025-09-22T18:04:55.851369] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T18:04:56.088532] [DEBUG] [LOCAL ] CNI: Primary data saved (51660 records). [2025-09-22T18:04:56.088703] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-22T18:04:56.088803] [INFO ] [MAIN ] Update Progress: 492/2372 symbols completed. CNI took 31.6s. Estimated remaining: 4h 7m 53s. Rate: 7.6 symbols/min [2025-09-22T18:04:56.263279] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:04:56.300704] [DEBUG] [LOCAL ] CNNE: Loaded 37488 existing records from primary storage. [2025-09-22T18:04:56.300846] [INFO ] [MAIN ] CNNE: Loaded 37488 existing records. [2025-09-22T18:04:56.483955] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:04:56.484489] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-22T18:04:56.484615] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-22T18:04:56.493037] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-22T18:04:56.493127] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-22T18:04:56.537419] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-22T18:04:56.564205] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T18:04:56.629487] [INFO ] [REMOTE ] CNK: Full fetch complete (75618 records). [2025-09-22T18:04:56.650394] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-22T18:04:57.185323] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:04:57.321270] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-22T18:04:57.321418] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-22T18:04:57.322471] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-22T18:04:57.322379] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-22T18:04:57.323420] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-22T18:04:57.325206] [DEBUG] [LOCAL ] CNK: Trimmed 75618 records to 52908 (keeping 200 days of data) [2025-09-22T18:04:57.465948] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T18:04:57.687534] [DEBUG] [LOCAL ] CNK: Primary data saved (52908 records). [2025-09-22T18:04:57.687714] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-22T18:04:57.687820] [INFO ] [MAIN ] Update Progress: 493/2372 symbols completed. CNK took 30.3s. Estimated remaining: 4h 7m 21s. Rate: 7.6 symbols/min [2025-09-22T18:04:57.863581] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:04:57.885294] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T18:04:57.928454] [DEBUG] [LOCAL ] CNO: Loaded 42229 existing records from primary storage. [2025-09-22T18:04:57.928605] [INFO ] [MAIN ] CNO: Loaded 42229 existing records. [2025-09-22T18:04:58.106845] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:04:58.107090] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-22T18:04:58.107951] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-22T18:04:58.109252] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-22T18:04:58.109313] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-22T18:04:58.127287] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-22T18:04:58.476552] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:04:58.506458] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T18:04:58.922060] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-22T18:04:59.722128] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-22T18:04:59.922513] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T18:05:00.447460] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-22T18:05:00.522049] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-22T18:05:01.322022] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-22T18:05:01.413777] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T18:05:02.122100] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-22T18:05:02.244891] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T18:05:02.922684] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-22T18:05:02.925350] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T18:05:03.722031] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-22T18:05:03.746212] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T18:05:04.292005] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T18:05:04.522071] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-22T18:05:05.256373] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T18:05:05.322010] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-22T18:05:05.788428] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T18:05:06.122112] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-22T18:05:06.803207] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T18:05:06.922054] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-22T18:05:07.213525] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T18:05:07.722068] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-22T18:05:08.332972] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T18:05:08.522025] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-22T18:05:09.188527] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T18:05:09.322003] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-22T18:05:10.122053] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-22T18:05:10.231392] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T18:05:10.256951] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T18:05:10.922113] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-22T18:05:11.190312] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T18:05:11.722082] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-22T18:05:12.130738] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T18:05:12.522063] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-22T18:05:12.664550] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-22T18:05:13.322067] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-22T18:05:13.895531] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T18:05:14.122067] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-22T18:05:14.927141] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-22T18:05:14.942798] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T18:05:14.951441] [INFO ] [REMOTE ] CNM: Full fetch complete (73627 records). [2025-09-22T18:05:14.951602] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-22T18:05:15.367453] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-22T18:05:15.367548] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-22T18:05:15.368449] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-22T18:05:15.368519] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-22T18:05:15.370086] [DEBUG] [LOCAL ] CNM: Trimmed 73627 records to 50963 (keeping 200 days of data) [2025-09-22T18:05:15.667071] [DEBUG] [LOCAL ] CNM: Primary data saved (50963 records). [2025-09-22T18:05:15.667211] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-22T18:05:15.668477] [INFO ] [MAIN ] Update Progress: 494/2372 symbols completed. CNM took 34.2s. Estimated remaining: 4h 7m 51s. Rate: 7.6 symbols/min [2025-09-22T18:05:15.731897] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-22T18:05:15.879164] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:05:15.880903] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T18:05:15.881044] [DEBUG] [LOCAL ] CNP: No existing data file found in primary storage. [2025-09-22T18:05:15.888888] [WARN ] [MAIN ] CNP: No existing data found, performing full refresh instead. [2025-09-22T18:05:15.889440] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-22T18:05:15.889503] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-22T18:05:15.889599] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-09-22T18:05:15.890014] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-22T18:05:16.255751] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:05:16.522104] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-22T18:05:16.620394] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T18:05:17.194764] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T18:05:17.322061] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-22T18:05:17.990021] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T18:05:18.122065] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-22T18:05:18.813717] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T18:05:18.922013] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-22T18:05:19.440060] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T18:05:19.722104] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-22T18:05:20.282093] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T18:05:20.522144] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-22T18:05:20.995304] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T18:05:21.003284] [INFO ] [REMOTE ] CNMD: Full fetch complete (46864 records). [2025-09-22T18:05:21.003508] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-22T18:05:21.327358] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-22T18:05:21.573724] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-22T18:05:21.573841] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-22T18:05:21.574808] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-22T18:05:21.574941] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-22T18:05:21.576572] [DEBUG] [LOCAL ] CNMD: Trimmed 46864 records to 32447 (keeping 200 days of data) [2025-09-22T18:05:21.816467] [DEBUG] [LOCAL ] CNMD: Primary data saved (32447 records). [2025-09-22T18:05:21.816669] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-22T18:05:21.816797] [INFO ] [MAIN ] Update Progress: 495/2372 symbols completed. CNMD took 34.4s. Estimated remaining: 4h 7m 37s. Rate: 7.6 symbols/min [2025-09-22T18:05:21.983175] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T18:05:22.051326] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:05:22.118289] [DEBUG] [LOCAL ] CNQ: Loaded 54362 existing records from primary storage. [2025-09-22T18:05:22.118492] [INFO ] [MAIN ] CNQ: Loaded 54362 existing records. [2025-09-22T18:05:22.133994] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-22T18:05:22.364977] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:05:22.365279] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-22T18:05:22.365331] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-22T18:05:22.366786] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-22T18:05:22.366850] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-22T18:05:22.747392] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:05:22.770444] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T18:05:22.922097] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-22T18:05:23.722079] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-22T18:05:23.855295] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T18:05:24.301640] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T18:05:24.307526] [INFO ] [REMOTE ] CNNE: Full fetch complete (48822 records). [2025-09-22T18:05:24.307720] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-22T18:05:24.308487] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:05:24.308600] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:05:24.308668] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:05:24.308732] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-22T18:05:24.308794] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-09-22T18:05:24.308831] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-09-22T18:05:24.309296] [DEBUG] [LOCAL ] CNNE: Deleted derivative data file. [2025-09-22T18:05:24.309411] [INFO ] [MAIN ] Update Progress: 496/2372 symbols completed. CNNE took 28.2s. Estimated remaining: 4h 7m 8s. Rate: 7.6 symbols/min [2025-09-22T18:05:24.483324] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:05:24.483505] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-22T18:05:24.483546] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-22T18:05:24.483731] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-22T18:05:24.483785] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-22T18:05:24.483831] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-22T18:05:24.483870] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-22T18:05:24.527213] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-22T18:05:24.872548] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:05:25.322029] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-22T18:05:25.435083] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T18:05:26.102045] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T18:05:26.122013] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-22T18:05:26.896199] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T18:05:26.906460] [INFO ] [REMOTE ] CNO: Full fetch complete (60594 records). [2025-09-22T18:05:26.906636] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-22T18:05:26.927218] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-22T18:05:27.331250] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-22T18:05:27.331329] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-22T18:05:27.332125] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-22T18:05:27.332193] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-22T18:05:27.333556] [DEBUG] [LOCAL ] CNO: Trimmed 60594 records to 41486 (keeping 200 days of data) [2025-09-22T18:05:27.602605] [DEBUG] [LOCAL ] CNO: Primary data saved (41486 records). [2025-09-22T18:05:27.602827] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-22T18:05:27.602948] [INFO ] [MAIN ] Update Progress: 497/2372 symbols completed. CNO took 29.9s. Estimated remaining: 4h 6m 43s. Rate: 7.6 symbols/min [2025-09-22T18:05:27.722333] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-22T18:05:27.806736] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:05:27.830714] [DEBUG] [LOCAL ] CNS: Loaded 21458 existing records from primary storage. [2025-09-22T18:05:27.830857] [INFO ] [MAIN ] CNS: Loaded 21458 existing records. [2025-09-22T18:05:28.060314] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:05:28.063845] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:05:28.064340] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-22T18:05:28.064744] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-22T18:05:28.064637] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-22T18:05:28.066025] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-22T18:05:28.066089] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-22T18:05:28.369494] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-22T18:05:28.497123] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:05:28.522004] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-22T18:05:28.931010] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-22T18:05:29.322069] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-22T18:05:29.788549] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T18:05:30.122070] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-22T18:05:30.922067] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-22T18:05:31.199406] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-22T18:05:31.530562] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T18:05:31.722056] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-22T18:05:32.328609] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T18:05:32.522095] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-22T18:05:33.322065] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-22T18:05:33.426611] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T18:05:33.945688] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T18:05:34.122020] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-22T18:05:34.153767] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T18:05:34.922123] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-22T18:05:35.722140] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-22T18:05:36.005594] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T18:05:36.434622] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T18:05:36.522067] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-22T18:05:37.322084] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-22T18:05:37.696941] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-22T18:05:38.122146] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-22T18:05:38.408551] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T18:05:38.538604] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T18:05:38.922088] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-22T18:05:39.162786] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-22T18:05:39.722051] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-22T18:05:40.522093] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-22T18:05:40.809564] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T18:05:40.818170] [INFO ] [REMOTE ] CNP: Full fetch complete (77360 records). [2025-09-22T18:05:40.818332] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-22T18:05:41.221118] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-22T18:05:41.221219] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-22T18:05:41.222052] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-22T18:05:41.222116] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-22T18:05:41.223575] [DEBUG] [LOCAL ] CNP: Trimmed 77360 records to 53469 (keeping 200 days of data) [2025-09-22T18:05:41.323852] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-22T18:05:41.569905] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-09-22T18:05:41.570174] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-22T18:05:41.570385] [INFO ] [MAIN ] Update Progress: 498/2372 symbols completed. CNP took 25.9s. Estimated remaining: 4h 6m 58s. Rate: 7.6 symbols/min [2025-09-22T18:05:41.719999] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T18:05:41.772860] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-22T18:05:41.833419] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:05:41.884456] [DEBUG] [LOCAL ] CNX: Loaded 52136 existing records from primary storage. [2025-09-22T18:05:41.884606] [INFO ] [MAIN ] CNX: Loaded 52136 existing records. [2025-09-22T18:05:42.069631] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:05:42.069926] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-22T18:05:42.069989] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-22T18:05:42.071272] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-22T18:05:42.071344] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-22T18:05:42.129884] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-22T18:05:42.451699] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:05:42.922031] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-22T18:05:43.051275] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T18:05:43.364373] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T18:05:43.722115] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-22T18:05:44.366124] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T18:05:44.522060] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-22T18:05:45.066189] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T18:05:45.322049] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-22T18:05:45.544872] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-22T18:05:46.122064] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-22T18:05:46.894215] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T18:05:46.922009] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-22T18:05:47.257695] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T18:05:47.722068] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-22T18:05:48.522071] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-22T18:05:48.701262] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T18:05:49.251431] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T18:05:49.322045] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-22T18:05:49.385615] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T18:05:50.122069] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-22T18:05:50.922019] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T18:05:50.922106] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-22T18:05:51.168103] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T18:05:51.722097] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-22T18:05:52.423586] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T18:05:52.522088] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-22T18:05:52.921638] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T18:05:52.925522] [INFO ] [REMOTE ] CNS: Full fetch complete (29742 records). [2025-09-22T18:05:52.925634] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-22T18:05:53.304784] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-22T18:05:53.304889] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-22T18:05:53.305413] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-22T18:05:53.305455] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-22T18:05:53.306267] [DEBUG] [LOCAL ] CNS: Trimmed 29742 records to 20981 (keeping 200 days of data) [2025-09-22T18:05:53.364245] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-22T18:05:53.451808] [DEBUG] [LOCAL ] CNS: Primary data saved (20981 records). [2025-09-22T18:05:53.452021] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-22T18:05:53.452135] [INFO ] [MAIN ] Update Progress: 499/2372 symbols completed. CNS took 25.8s. Estimated remaining: 4h 7m 5s. Rate: 7.6 symbols/min [2025-09-22T18:05:53.646494] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:05:53.693631] [DEBUG] [LOCAL ] CODI: Loaded 40123 existing records from primary storage. [2025-09-22T18:05:53.693906] [INFO ] [MAIN ] CODI: Loaded 40123 existing records. [2025-09-22T18:05:53.895319] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:05:53.895871] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-22T18:05:53.895933] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-22T18:05:53.897198] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-22T18:05:53.897264] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-22T18:05:54.151739] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-22T18:05:54.294680] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:05:54.307302] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T18:05:54.830195] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T18:05:54.922073] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-22T18:05:55.722109] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-22T18:05:56.111268] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T18:05:56.522125] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-22T18:05:56.755246] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T18:05:57.306079] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T18:05:57.312852] [INFO ] [REMOTE ] CNR: Full fetch complete (55535 records). [2025-09-22T18:05:57.313019] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-22T18:05:57.327195] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-22T18:05:57.526333] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-09-22T18:05:57.526947] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:05:57.527022] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:05:57.527098] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-22T18:05:57.527170] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-22T18:05:57.527208] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-22T18:05:57.527248] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-22T18:05:57.527329] [INFO ] [MAIN ] Update Progress: 500/2372 symbols completed. CNR took 33.2s. Estimated remaining: 4h 6m 43s. Rate: 7.6 symbols/min [2025-09-22T18:05:57.716498] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:05:57.734741] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T18:05:57.800418] [DEBUG] [LOCAL ] COF: Loaded 54390 existing records from primary storage. [2025-09-22T18:05:57.800569] [INFO ] [MAIN ] COF: Loaded 54390 existing records. [2025-09-22T18:05:57.981249] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:05:57.981579] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-22T18:05:57.981668] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-22T18:05:57.985077] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-22T18:05:57.985164] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-22T18:05:58.132136] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-22T18:05:58.355374] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:05:58.922074] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-22T18:05:59.294983] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T18:05:59.374165] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-22T18:05:59.384224] [INFO ] [REMOTE ] CNQ: Full fetch complete (77542 records). [2025-09-22T18:05:59.384517] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-22T18:05:59.731435] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-22T18:05:59.875942] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-22T18:05:59.876072] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-22T18:05:59.877140] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-22T18:05:59.877217] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-22T18:05:59.879759] [DEBUG] [LOCAL ] CNQ: Trimmed 77542 records to 53582 (keeping 200 days of data) [2025-09-22T18:06:00.240887] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-09-22T18:06:00.241055] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-22T18:06:00.241152] [INFO ] [MAIN ] Update Progress: 501/2372 symbols completed. CNQ took 38.4s. Estimated remaining: 4h 6m 15s. Rate: 7.6 symbols/min [2025-09-22T18:06:00.410824] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:06:00.466199] [DEBUG] [LOCAL ] COHR: Loaded 54145 existing records from primary storage. [2025-09-22T18:06:00.466413] [INFO ] [MAIN ] COHR: Loaded 54145 existing records. [2025-09-22T18:06:00.576513] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-22T18:06:00.672919] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:06:00.673458] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-22T18:06:00.673708] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-22T18:06:00.675308] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-22T18:06:00.675473] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-22T18:06:00.827171] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T18:06:01.110618] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:06:01.130239] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T18:06:01.322064] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-22T18:06:02.122080] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-22T18:06:02.791320] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-22T18:06:02.922076] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-22T18:06:03.425235] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-22T18:06:03.722137] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-22T18:06:04.522083] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-22T18:06:04.866278] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-22T18:06:05.259296] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T18:06:05.322006] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-22T18:06:05.542845] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-22T18:06:06.122054] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-22T18:06:06.800377] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T18:06:06.922049] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-22T18:06:06.966135] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-22T18:06:07.722059] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-22T18:06:08.005864] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-22T18:06:08.298745] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T18:06:08.522156] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-22T18:06:09.270959] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T18:06:09.322008] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-22T18:06:10.122020] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-22T18:06:10.591100] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-22T18:06:10.922028] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-22T18:06:10.988305] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T18:06:11.722082] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-22T18:06:11.853199] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T18:06:12.522086] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-22T18:06:12.733563] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T18:06:13.309251] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T18:06:13.322011] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-22T18:06:14.122096] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-22T18:06:14.312123] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T18:06:14.922100] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-22T18:06:15.722081] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-22T18:06:16.094517] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-22T18:06:16.522061] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-22T18:06:16.948812] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T18:06:17.317622] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (3.20 seconds). [2025-09-22T18:06:17.328305] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-22T18:06:17.738581] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T18:06:18.122106] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-22T18:06:18.663691] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T18:06:18.669465] [INFO ] [REMOTE ] CODI: Full fetch complete (49757 records). [2025-09-22T18:06:18.669591] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-22T18:06:18.670507] [FATAL] [VALIDATOR ] CODI: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:06:18.670613] [FATAL] [MAIN ] CODI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:06:18.670716] [WARN ] [MAIN ] CODI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:06:18.670809] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-22T18:06:18.670905] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-09-22T18:06:18.670964] [INFO ] [LOCAL ] CODI: Starting deletion of derivative data. [2025-09-22T18:06:18.671417] [DEBUG] [LOCAL ] CODI: Deleted derivative data file. [2025-09-22T18:06:18.671519] [INFO ] [MAIN ] Update Progress: 502/2372 symbols completed. CODI took 25.2s. Estimated remaining: 4h 6m 47s. Rate: 7.6 symbols/min [2025-09-22T18:06:18.850205] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:06:18.912208] [DEBUG] [LOCAL ] COLD: Loaded 52669 existing records from primary storage. [2025-09-22T18:06:18.912368] [INFO ] [MAIN ] COLD: Loaded 52669 existing records. [2025-09-22T18:06:18.934588] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-22T18:06:19.113952] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:06:19.114456] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-22T18:06:19.114542] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-22T18:06:19.126060] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-22T18:06:19.142140] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-22T18:06:19.228244] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-22T18:06:19.555402] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:06:19.645738] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T18:06:19.722061] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-22T18:06:20.381513] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T18:06:20.389819] [INFO ] [REMOTE ] CNX: Full fetch complete (74758 records). [2025-09-22T18:06:20.389971] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-22T18:06:20.530824] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-22T18:06:20.802392] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-22T18:06:20.802510] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-22T18:06:20.804320] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-22T18:06:20.804410] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-22T18:06:20.806150] [DEBUG] [LOCAL ] CNX: Trimmed 74758 records to 51393 (keeping 200 days of data) [2025-09-22T18:06:21.127365] [DEBUG] [LOCAL ] CNX: Primary data saved (51393 records). [2025-09-22T18:06:21.127508] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-22T18:06:21.127667] [INFO ] [MAIN ] Update Progress: 503/2372 symbols completed. CNX took 39.6s. Estimated remaining: 4h 6m 19s. Rate: 7.6 symbols/min [2025-09-22T18:06:21.304531] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:06:21.304780] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-09-22T18:06:21.304854] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-09-22T18:06:21.305015] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-22T18:06:21.305069] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-22T18:06:21.305136] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-09-22T18:06:21.305171] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-22T18:06:21.337163] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-22T18:06:21.751874] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:06:22.038224] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-22T18:06:22.122029] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-22T18:06:22.262213] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T18:06:22.803428] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T18:06:22.922084] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-22T18:06:23.722042] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-22T18:06:23.801603] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T18:06:24.522082] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-22T18:06:24.791681] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T18:06:25.322110] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-22T18:06:25.704754] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-22T18:06:26.122081] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-22T18:06:26.473142] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-22T18:06:26.481367] [INFO ] [REMOTE ] COF: Full fetch complete (77384 records). [2025-09-22T18:06:26.481500] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-22T18:06:26.900096] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-22T18:06:26.900256] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-22T18:06:26.901133] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-22T18:06:26.901298] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-22T18:06:26.903225] [DEBUG] [LOCAL ] COF: Trimmed 77384 records to 53611 (keeping 200 days of data) [2025-09-22T18:06:26.969892] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-22T18:06:27.050069] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T18:06:27.293928] [DEBUG] [LOCAL ] COF: Primary data saved (53611 records). [2025-09-22T18:06:27.294125] [INFO ] [MAIN ] COF: Full history saved. [2025-09-22T18:06:27.294312] [INFO ] [MAIN ] Update Progress: 504/2372 symbols completed. COF took 29.8s. Estimated remaining: 4h 6m 4s. Rate: 7.6 symbols/min [2025-09-22T18:06:27.468959] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:06:27.514276] [DEBUG] [LOCAL ] CON: Loaded 39527 existing records from primary storage. [2025-09-22T18:06:27.514434] [INFO ] [MAIN ] CON: Loaded 39527 existing records. [2025-09-22T18:06:27.694140] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:06:27.694397] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-22T18:06:27.694453] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-22T18:06:27.695348] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-22T18:06:27.695407] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-22T18:06:27.727172] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-22T18:06:28.076179] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:06:28.113280] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-22T18:06:28.522071] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-22T18:06:29.136525] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-22T18:06:29.322093] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-22T18:06:30.122069] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-22T18:06:30.365605] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-22T18:06:30.922058] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-22T18:06:31.074325] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-22T18:06:31.722040] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-22T18:06:31.857353] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-22T18:06:32.522037] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-22T18:06:32.574513] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T18:06:32.642780] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-22T18:06:33.053024] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T18:06:33.322076] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-22T18:06:34.122085] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-22T18:06:34.197962] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T18:06:34.922077] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-22T18:06:35.224992] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-22T18:06:35.543042] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T18:06:35.722089] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-22T18:06:36.439386] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T18:06:36.522062] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-22T18:06:37.246909] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T18:06:37.322009] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-22T18:06:37.661385] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T18:06:38.122117] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-22T18:06:38.662945] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T18:06:38.922069] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-22T18:06:39.722063] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-22T18:06:40.080062] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T18:06:40.476984] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T18:06:40.522036] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-22T18:06:41.233805] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T18:06:41.322009] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-22T18:06:42.122027] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-22T18:06:42.200768] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T18:06:42.258362] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T18:06:42.922124] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-22T18:06:43.531211] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T18:06:43.722091] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-22T18:06:44.522123] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-22T18:06:44.710544] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T18:06:45.322047] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-22T18:06:45.647580] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T18:06:45.656935] [INFO ] [REMOTE ] COLD: Full fetch complete (74039 records). [2025-09-22T18:06:45.657094] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-22T18:06:46.074165] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-22T18:06:46.074261] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-22T18:06:46.075148] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-22T18:06:46.075236] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-22T18:06:46.076798] [DEBUG] [LOCAL ] COLD: Trimmed 74039 records to 51973 (keeping 200 days of data) [2025-09-22T18:06:46.141433] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-22T18:06:46.220898] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T18:06:46.437552] [DEBUG] [LOCAL ] COLD: Primary data saved (51973 records). [2025-09-22T18:06:46.437731] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-22T18:06:46.437864] [INFO ] [MAIN ] Update Progress: 505/2372 symbols completed. COLD took 27.8s. Estimated remaining: 4h 6m 38s. Rate: 7.6 symbols/min [2025-09-22T18:06:46.616101] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:06:46.641730] [DEBUG] [LOCAL ] COOK: Loaded 24488 existing records from primary storage. [2025-09-22T18:06:46.641866] [INFO ] [MAIN ] COOK: Loaded 24488 existing records. [2025-09-22T18:06:46.820938] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:06:46.821248] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-22T18:06:46.821296] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-22T18:06:46.821989] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-22T18:06:46.822061] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-22T18:06:46.923012] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-22T18:06:47.182228] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:06:47.286803] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T18:06:47.722082] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-22T18:06:48.025793] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T18:06:48.499533] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-22T18:06:48.507978] [INFO ] [REMOTE ] COHR: Full fetch complete (77084 records). [2025-09-22T18:06:48.508113] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-22T18:06:48.530364] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-22T18:06:48.907976] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-22T18:06:48.908142] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-22T18:06:48.909017] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-22T18:06:48.909184] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-22T18:06:48.924518] [DEBUG] [LOCAL ] COHR: Trimmed 77084 records to 53366 (keeping 200 days of data) [2025-09-22T18:06:48.925299] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T18:06:49.262281] [DEBUG] [LOCAL ] COHR: Primary data saved (53366 records). [2025-09-22T18:06:49.262734] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-22T18:06:49.262831] [INFO ] [MAIN ] Update Progress: 506/2372 symbols completed. COHR took 49.0s. Estimated remaining: 4h 6m 11s. Rate: 7.6 symbols/min [2025-09-22T18:06:49.327163] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-22T18:06:49.436172] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:06:49.493718] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-09-22T18:06:49.493871] [INFO ] [MAIN ] COP: Loaded 54507 existing records. [2025-09-22T18:06:49.674378] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:06:49.674720] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-22T18:06:49.674777] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-22T18:06:49.676375] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-22T18:06:49.676437] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-22T18:06:50.037637] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:06:50.122051] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-22T18:06:50.266110] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T18:06:50.274619] [INFO ] [REMOTE ] COMP: Full fetch complete (77065 records). [2025-09-22T18:06:50.274790] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-22T18:06:50.699783] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-22T18:06:50.699934] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-22T18:06:50.700866] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-22T18:06:50.701064] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-22T18:06:50.704221] [DEBUG] [LOCAL ] COMP: Trimmed 77065 records to 53384 (keeping 200 days of data) [2025-09-22T18:06:50.923768] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-22T18:06:50.955723] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T18:06:51.076093] [DEBUG] [LOCAL ] COMP: Primary data saved (53384 records). [2025-09-22T18:06:51.076277] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-22T18:06:51.076375] [INFO ] [MAIN ] Update Progress: 507/2372 symbols completed. COMP took 29.9s. Estimated remaining: 4h 5m 41s. Rate: 7.6 symbols/min [2025-09-22T18:06:51.250253] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:06:51.306872] [DEBUG] [LOCAL ] COR: Loaded 48035 existing records from primary storage. [2025-09-22T18:06:51.307037] [INFO ] [MAIN ] COR: Loaded 48035 existing records. [2025-09-22T18:06:51.485106] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:06:51.485335] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-22T18:06:51.485382] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-22T18:06:51.486582] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-22T18:06:51.486674] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-22T18:06:51.727372] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-22T18:06:51.873467] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:06:51.978637] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T18:06:52.327682] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-22T18:06:52.522074] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-22T18:06:53.119085] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T18:06:53.126079] [INFO ] [REMOTE ] CON: Full fetch complete (57240 records). [2025-09-22T18:06:53.126178] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-22T18:06:53.329706] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-22T18:06:53.516561] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-22T18:06:53.516639] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-22T18:06:53.517329] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-22T18:06:53.517371] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-22T18:06:53.519462] [DEBUG] [LOCAL ] CON: Trimmed 57240 records to 38793 (keeping 200 days of data) [2025-09-22T18:06:53.758448] [DEBUG] [LOCAL ] CON: Primary data saved (38793 records). [2025-09-22T18:06:53.758612] [INFO ] [MAIN ] CON: Full history saved. [2025-09-22T18:06:53.758750] [INFO ] [MAIN ] Update Progress: 508/2372 symbols completed. CON took 26.5s. Estimated remaining: 4h 5m 14s. Rate: 7.6 symbols/min [2025-09-22T18:06:53.927790] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:06:53.982539] [DEBUG] [LOCAL ] COTY: Loaded 54037 existing records from primary storage. [2025-09-22T18:06:53.982709] [INFO ] [MAIN ] COTY: Loaded 54037 existing records. [2025-09-22T18:06:54.132191] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-22T18:06:54.164085] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:06:54.164470] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-22T18:06:54.164634] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-22T18:06:54.165913] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-22T18:06:54.165977] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-22T18:06:54.534422] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-22T18:06:54.577902] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:06:54.705981] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T18:06:54.922066] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-22T18:06:55.432622] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-22T18:06:55.722071] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-22T18:06:56.522071] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-22T18:06:56.766077] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T18:06:57.322060] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-22T18:06:57.455222] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T18:06:58.122061] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-22T18:06:58.448538] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-22T18:06:58.922028] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-22T18:06:59.098845] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T18:06:59.722057] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-22T18:06:59.913062] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T18:07:00.522058] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-22T18:07:01.097193] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-22T18:07:01.237119] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T18:07:01.322077] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-22T18:07:02.104352] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T18:07:02.122074] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-22T18:07:02.402299] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T18:07:02.922091] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-22T18:07:03.216916] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T18:07:03.722084] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-22T18:07:04.522085] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-22T18:07:04.931921] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-22T18:07:05.322024] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-22T18:07:05.535040] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T18:07:05.647790] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T18:07:06.122066] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-22T18:07:06.779743] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T18:07:06.922057] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-22T18:07:07.533520] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T18:07:07.722048] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-22T18:07:08.311168] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T18:07:08.522154] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-22T18:07:09.322093] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-22T18:07:09.551169] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T18:07:10.011077] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T18:07:10.067408] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T18:07:10.122068] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-22T18:07:10.922045] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-22T18:07:11.281409] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T18:07:11.722080] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-22T18:07:12.169142] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T18:07:12.522084] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-22T18:07:13.322080] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-22T18:07:13.394216] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T18:07:13.872959] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T18:07:13.877536] [INFO ] [REMOTE ] COOK: Full fetch complete (32972 records). [2025-09-22T18:07:13.877662] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-22T18:07:14.129152] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-22T18:07:14.260857] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-22T18:07:14.260948] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-22T18:07:14.261448] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-22T18:07:14.261495] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-22T18:07:14.262461] [DEBUG] [LOCAL ] COOK: Trimmed 32972 records to 24380 (keeping 200 days of data) [2025-09-22T18:07:14.401891] [DEBUG] [LOCAL ] COOK: Primary data saved (24380 records). [2025-09-22T18:07:14.402077] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-22T18:07:14.402212] [INFO ] [MAIN ] Update Progress: 509/2372 symbols completed. COOK took 28.0s. Estimated remaining: 4h 5m 52s. Rate: 7.6 symbols/min [2025-09-22T18:07:14.580081] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:07:14.580246] [DEBUG] [LOCAL ] COUR: No existing data file found in primary storage. [2025-09-22T18:07:14.580284] [WARN ] [MAIN ] COUR: No existing data found, performing full refresh instead. [2025-09-22T18:07:14.580467] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-22T18:07:14.580548] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-22T18:07:14.580617] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-09-22T18:07:14.580681] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-22T18:07:14.935822] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:07:14.930905] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-22T18:07:15.235711] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-22T18:07:15.243043] [INFO ] [REMOTE ] COR: Full fetch complete (68859 records). [2025-09-22T18:07:15.243157] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-22T18:07:15.633320] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-22T18:07:15.633420] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-22T18:07:15.634206] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-22T18:07:15.634271] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-22T18:07:15.635689] [DEBUG] [LOCAL ] COR: Trimmed 68859 records to 47281 (keeping 200 days of data) [2025-09-22T18:07:15.726437] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-22T18:07:15.938374] [DEBUG] [LOCAL ] COR: Primary data saved (47281 records). [2025-09-22T18:07:15.938534] [INFO ] [MAIN ] COR: Full history saved. [2025-09-22T18:07:15.940287] [INFO ] [MAIN ] Update Progress: 510/2372 symbols completed. COR took 24.9s. Estimated remaining: 4h 5m 21s. Rate: 7.6 symbols/min [2025-09-22T18:07:16.087785] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-22T18:07:16.169363] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:07:16.227094] [DEBUG] [LOCAL ] CP: Loaded 54068 existing records from primary storage. [2025-09-22T18:07:16.227239] [INFO ] [MAIN ] CP: Loaded 54068 existing records. [2025-09-22T18:07:16.408299] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:07:16.408610] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-22T18:07:16.408696] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-22T18:07:16.409903] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-22T18:07:16.409963] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-22T18:07:16.527230] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-22T18:07:16.773195] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:07:16.802821] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-22T18:07:17.322026] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-22T18:07:17.723406] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-22T18:07:18.122076] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-22T18:07:18.662236] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-22T18:07:18.922125] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-22T18:07:19.087851] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T18:07:19.722036] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-22T18:07:19.915505] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T18:07:20.522166] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-22T18:07:21.081134] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-22T18:07:21.169103] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T18:07:21.322022] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-22T18:07:22.122095] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-22T18:07:22.309633] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T18:07:22.922080] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-22T18:07:23.001478] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T18:07:23.722116] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-22T18:07:24.066997] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T18:07:24.217037] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T18:07:24.522079] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-22T18:07:25.322017] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-22T18:07:25.525018] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T18:07:25.533320] [INFO ] [REMOTE ] COTY: Full fetch complete (77094 records). [2025-09-22T18:07:25.533462] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-22T18:07:25.940959] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-22T18:07:25.941061] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-22T18:07:25.941926] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-22T18:07:25.942008] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-22T18:07:25.943925] [DEBUG] [LOCAL ] COTY: Trimmed 77094 records to 53252 (keeping 200 days of data) [2025-09-22T18:07:26.057327] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T18:07:26.145766] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-22T18:07:26.292298] [DEBUG] [LOCAL ] COTY: Primary data saved (53252 records). [2025-09-22T18:07:26.292475] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-22T18:07:26.292573] [INFO ] [MAIN ] Update Progress: 511/2372 symbols completed. COTY took 32.5s. Estimated remaining: 4h 5m 22s. Rate: 7.6 symbols/min [2025-09-22T18:07:26.524009] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:07:26.557108] [DEBUG] [LOCAL ] CPA: Loaded 29453 existing records from primary storage. [2025-09-22T18:07:26.557269] [INFO ] [MAIN ] CPA: Loaded 29453 existing records. [2025-09-22T18:07:26.745193] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:07:26.745518] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-22T18:07:26.745575] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-22T18:07:26.746449] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-22T18:07:26.746510] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-22T18:07:26.945073] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-22T18:07:27.108294] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:07:27.137473] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T18:07:27.722063] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-22T18:07:27.802625] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T18:07:27.811264] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-22T18:07:27.811459] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-22T18:07:28.214521] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-22T18:07:28.214621] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-22T18:07:28.215552] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-22T18:07:28.215623] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-22T18:07:28.217218] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-09-22T18:07:28.538303] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-22T18:07:28.565951] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-22T18:07:28.566111] [INFO ] [MAIN ] COP: Full history saved. [2025-09-22T18:07:28.566204] [INFO ] [MAIN ] Update Progress: 512/2372 symbols completed. COP took 39.3s. Estimated remaining: 4h 4m 54s. Rate: 7.6 symbols/min [2025-09-22T18:07:28.738504] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:07:28.738814] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-22T18:07:28.738883] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-22T18:07:28.739379] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-22T18:07:28.739670] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-22T18:07:28.739978] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-22T18:07:28.740128] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-22T18:07:29.114771] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:07:29.146202] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-22T18:07:29.205328] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T18:07:29.322041] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-22T18:07:30.122110] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-22T18:07:30.202747] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T18:07:30.345913] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T18:07:30.922073] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-22T18:07:31.722056] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-22T18:07:32.169018] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-22T18:07:32.305676] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T18:07:32.315893] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-22T18:07:32.522099] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-22T18:07:32.840937] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-22T18:07:33.322063] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-22T18:07:34.122062] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-22T18:07:34.749938] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T18:07:34.922090] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-22T18:07:35.482505] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T18:07:35.722077] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-22T18:07:36.202798] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-22T18:07:36.522088] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-22T18:07:37.322040] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-22T18:07:37.456861] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T18:07:37.690610] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-22T18:07:38.122045] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-22T18:07:38.402605] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-22T18:07:38.404339] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T18:07:38.922106] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-22T18:07:39.722061] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-22T18:07:40.522058] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-22T18:07:40.639428] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T18:07:40.955077] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T18:07:41.267919] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T18:07:41.322090] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-22T18:07:41.672299] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-22T18:07:42.122084] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-22T18:07:42.622469] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-22T18:07:42.922070] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-22T18:07:43.722066] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-22T18:07:44.521120] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T18:07:44.531834] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-22T18:07:45.032149] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T18:07:45.041105] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-22T18:07:45.322058] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-22T18:07:45.677472] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-22T18:07:46.122042] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-22T18:07:46.922112] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-22T18:07:47.722030] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-22T18:07:47.805751] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T18:07:47.951905] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T18:07:48.203639] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-22T18:07:48.204509] [INFO ] [REMOTE ] CPAC: Full fetch complete (1903 records). [2025-09-22T18:07:48.204576] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-22T18:07:48.383273] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T18:07:48.383477] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:07:48.383566] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:07:48.383681] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-22T18:07:48.383775] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-22T18:07:48.383832] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-22T18:07:48.383876] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-22T18:07:48.383940] [INFO ] [MAIN ] Update Progress: 513/2372 symbols completed. CPAC took 19.8s. Estimated remaining: 4h 5m 29s. Rate: 7.6 symbols/min [2025-09-22T18:07:48.528493] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-22T18:07:48.555224] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:07:48.555390] [DEBUG] [LOCAL ] CPAY: No existing data file found in primary storage. [2025-09-22T18:07:48.555444] [WARN ] [MAIN ] CPAY: No existing data found, performing full refresh instead. [2025-09-22T18:07:48.555634] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-22T18:07:48.555717] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-22T18:07:48.555767] [DEBUG] [LOCAL ] CPAY: No primary data file found to delete. [2025-09-22T18:07:48.555802] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-22T18:07:48.950241] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:07:49.322053] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-22T18:07:50.122072] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-22T18:07:50.222744] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T18:07:50.420149] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T18:07:50.428961] [INFO ] [REMOTE ] COUR: Full fetch complete (70879 records). [2025-09-22T18:07:50.429130] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-22T18:07:50.823972] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-22T18:07:50.824076] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-22T18:07:50.824992] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-22T18:07:50.825063] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-22T18:07:50.826711] [DEBUG] [LOCAL ] COUR: Trimmed 70879 records to 48918 (keeping 200 days of data) [2025-09-22T18:07:50.922199] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-22T18:07:51.125178] [DEBUG] [LOCAL ] COUR: Primary data saved (48918 records). [2025-09-22T18:07:51.125395] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-22T18:07:51.125530] [INFO ] [MAIN ] Update Progress: 514/2372 symbols completed. COUR took 36.7s. Estimated remaining: 4h 5m 2s. Rate: 7.6 symbols/min [2025-09-22T18:07:51.304987] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:07:51.323499] [DEBUG] [LOCAL ] CPF: Loaded 15847 existing records from primary storage. [2025-09-22T18:07:51.323669] [INFO ] [MAIN ] CPF: Loaded 15847 existing records. [2025-09-22T18:07:51.518170] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:07:51.518429] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-22T18:07:51.518480] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-22T18:07:51.519072] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-22T18:07:51.519135] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-22T18:07:51.736608] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-22T18:07:51.910528] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:07:52.037389] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T18:07:52.289143] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T18:07:52.293834] [INFO ] [REMOTE ] CPA: Full fetch complete (42163 records). [2025-09-22T18:07:52.293937] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-22T18:07:52.527401] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-22T18:07:52.716633] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-22T18:07:52.716741] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-22T18:07:52.717387] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-22T18:07:52.717450] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-22T18:07:52.718521] [DEBUG] [LOCAL ] CPA: Trimmed 42163 records to 28894 (keeping 200 days of data) [2025-09-22T18:07:52.917035] [DEBUG] [LOCAL ] CPA: Primary data saved (28894 records). [2025-09-22T18:07:52.917175] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-22T18:07:52.917273] [INFO ] [MAIN ] Update Progress: 515/2372 symbols completed. CPA took 26.6s. Estimated remaining: 4h 4m 32s. Rate: 7.6 symbols/min [2025-09-22T18:07:53.096110] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:07:53.115966] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T18:07:53.135168] [DEBUG] [LOCAL ] CPK: Loaded 13398 existing records from primary storage. [2025-09-22T18:07:53.135302] [INFO ] [MAIN ] CPK: Loaded 13398 existing records. [2025-09-22T18:07:53.315618] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:07:53.315923] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-22T18:07:53.315976] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-22T18:07:53.316578] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-22T18:07:53.316637] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-22T18:07:53.327770] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-22T18:07:53.681706] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:07:54.069037] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T18:07:54.122014] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-22T18:07:54.585440] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T18:07:54.922075] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-22T18:07:55.722095] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-22T18:07:55.985498] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T18:07:56.016899] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T18:07:56.499795] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T18:07:56.522020] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-22T18:07:57.322099] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-22T18:07:57.513117] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T18:07:58.122072] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-22T18:07:58.857521] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T18:07:58.922068] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-22T18:07:59.059896] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T18:07:59.068507] [INFO ] [REMOTE ] CP: Full fetch complete (77136 records). [2025-09-22T18:07:59.068627] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-22T18:07:59.460176] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-22T18:07:59.460289] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-22T18:07:59.461125] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-22T18:07:59.461188] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-22T18:07:59.462709] [DEBUG] [LOCAL ] CP: Trimmed 77136 records to 53286 (keeping 200 days of data) [2025-09-22T18:07:59.743989] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-22T18:07:59.791153] [DEBUG] [LOCAL ] CP: Primary data saved (53286 records). [2025-09-22T18:07:59.791259] [INFO ] [MAIN ] CP: Full history saved. [2025-09-22T18:07:59.793933] [INFO ] [MAIN ] Update Progress: 516/2372 symbols completed. CP took 43.9s. Estimated remaining: 4h 4m 21s. Rate: 7.6 symbols/min [2025-09-22T18:07:59.968297] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:07:59.996202] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T18:08:00.057340] [DEBUG] [LOCAL ] CPNG: Loaded 54451 existing records from primary storage. [2025-09-22T18:08:00.057547] [INFO ] [MAIN ] CPNG: Loaded 54451 existing records. [2025-09-22T18:08:00.234687] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:08:00.234999] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-22T18:08:00.235060] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-22T18:08:00.236263] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-22T18:08:00.236324] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-22T18:08:00.527199] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-22T18:08:00.601123] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:08:00.674947] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-22T18:08:01.322069] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-22T18:08:01.579807] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T18:08:02.122097] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-22T18:08:02.560528] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T18:08:02.665213] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-22T18:08:02.922070] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-22T18:08:03.722070] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-22T18:08:03.765868] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T18:08:04.522059] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-22T18:08:05.105043] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T18:08:05.322058] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-22T18:08:06.122057] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-22T18:08:06.412471] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T18:08:06.898275] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T18:08:06.922146] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-22T18:08:07.008105] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-22T18:08:07.722089] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-22T18:08:07.812765] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T18:08:08.522106] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-22T18:08:08.739260] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T18:08:09.322027] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-22T18:08:09.435154] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-22T18:08:10.122059] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-22T18:08:10.252431] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T18:08:10.789292] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-22T18:08:10.922075] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-22T18:08:11.722079] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-22T18:08:12.522024] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-22T18:08:12.699562] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-22T18:08:12.702764] [INFO ] [REMOTE ] CPF: Full fetch complete (24221 records). [2025-09-22T18:08:12.702845] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-22T18:08:13.090679] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-22T18:08:13.090793] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-22T18:08:13.091330] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-22T18:08:13.091405] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-22T18:08:13.092545] [DEBUG] [LOCAL ] CPF: Trimmed 24221 records to 15454 (keeping 200 days of data) [2025-09-22T18:08:13.192082] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-22T18:08:13.234199] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T18:08:13.247240] [DEBUG] [LOCAL ] CPF: Primary data saved (15454 records). [2025-09-22T18:08:13.247356] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-22T18:08:13.247452] [INFO ] [MAIN ] Update Progress: 517/2372 symbols completed. CPF took 22.1s. Estimated remaining: 4h 4m 33s. Rate: 7.6 symbols/min [2025-09-22T18:08:13.322009] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-22T18:08:14.122075] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-22T18:08:14.352465] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T18:08:14.922065] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-22T18:08:15.441315] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T18:08:15.722104] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-22T18:08:16.522106] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-22T18:08:17.027919] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T18:08:17.216234] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-22T18:08:17.237967] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T18:08:17.322060] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-22T18:08:18.122066] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-22T18:08:18.511147] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T18:08:18.849202] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T18:08:18.851696] [INFO ] [REMOTE ] CPK: Full fetch complete (17566 records). [2025-09-22T18:08:18.851789] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-22T18:08:18.929790] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-22T18:08:19.252702] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-22T18:08:19.252832] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-22T18:08:19.253423] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-22T18:08:19.253532] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-22T18:08:19.254731] [DEBUG] [LOCAL ] CPK: Trimmed 17566 records to 13280 (keeping 200 days of data) [2025-09-22T18:08:19.355967] [DEBUG] [LOCAL ] CPK: Primary data saved (13280 records). [2025-09-22T18:08:19.356123] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-22T18:08:19.356272] [INFO ] [MAIN ] Update Progress: 518/2372 symbols completed. CPK took 26.4s. Estimated remaining: 4h 4m 19s. Rate: 7.6 symbols/min [2025-09-22T18:08:19.722143] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-22T18:08:20.663171] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-22T18:08:20.669875] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-22T18:08:21.282283] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-22T18:08:21.322037] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-22T18:08:21.754815] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T18:08:21.759848] [INFO ] [REMOTE ] CPAY: Full fetch complete (45350 records). [2025-09-22T18:08:21.759940] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-22T18:08:22.142701] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-22T18:08:22.142805] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-22T18:08:22.143423] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-22T18:08:22.143470] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-22T18:08:22.144598] [DEBUG] [LOCAL ] CPAY: Trimmed 45350 records to 31224 (keeping 200 days of data) [2025-09-22T18:08:22.357321] [DEBUG] [LOCAL ] CPAY: Primary data saved (31224 records). [2025-09-22T18:08:22.357689] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-22T18:08:22.357956] [INFO ] [MAIN ] Update Progress: 519/2372 symbols completed. CPAY took 34.0s. Estimated remaining: 4h 3m 53s. Rate: 7.6 symbols/min [2025-09-22T18:08:23.155249] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T18:08:23.167058] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-22T18:08:25.494087] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-22T18:08:25.506050] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-22T18:08:27.583205] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-22T18:08:27.595325] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-22T18:08:30.175588] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-22T18:08:30.188819] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-22T18:08:32.519145] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-22T18:08:32.532356] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-22T18:08:34.533181] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T18:08:34.541680] [INFO ] [REMOTE ] CPNG: Full fetch complete (77668 records). [2025-09-22T18:08:34.541833] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-22T18:08:34.999762] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-22T18:08:34.999868] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-22T18:08:35.001252] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-22T18:08:35.001319] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-22T18:08:35.004984] [DEBUG] [LOCAL ] CPNG: Trimmed 77668 records to 53671 (keeping 200 days of data) [2025-09-22T18:08:35.344046] [DEBUG] [LOCAL ] CPNG: Primary data saved (53671 records). [2025-09-22T18:08:35.344200] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-22T18:08:35.345178] [INFO ] [MAIN ] Update Progress: 520/2372 symbols completed. CPNG took 35.6s. Estimated remaining: 4h 4m 3s. Rate: 7.6 symbols/min [2025-09-22T18:08:36.005267] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:08:36.014001] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:08:36.074634] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:08:36.108187] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:08:36.109590] [DEBUG] [LOCAL ] CPRI: No existing data file found in primary storage. [2025-09-22T18:08:36.109698] [WARN ] [MAIN ] CPRI: No existing data found, performing full refresh instead. [2025-09-22T18:08:36.109979] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-22T18:08:36.110024] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-22T18:08:36.110067] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-09-22T18:08:36.110099] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-22T18:08:36.286774] [DEBUG] [LOCAL ] CQP: Loaded 20282 existing records from primary storage. [2025-09-22T18:08:36.378481] [DEBUG] [LOCAL ] CPS: Loaded 26671 existing records from primary storage. [2025-09-22T18:08:36.347190] [INFO ] [MAIN ] CQP: Loaded 20282 existing records. [2025-09-22T18:08:36.419424] [INFO ] [MAIN ] CPS: Loaded 26671 existing records. [2025-09-22T18:08:36.656025] [DEBUG] [LOCAL ] CPT: Loaded 45047 existing records from primary storage. [2025-09-22T18:08:36.676781] [INFO ] [MAIN ] CPT: Loaded 45047 existing records. [2025-09-22T18:08:36.858386] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:08:36.950490] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-22T18:08:36.950015] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:08:37.034124] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-22T18:08:37.079576] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-22T18:08:37.125230] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:08:37.142630] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-22T18:08:37.170332] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-22T18:08:37.170431] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-22T18:08:37.169908] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:08:37.170679] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-22T18:08:37.205573] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-22T18:08:37.218331] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-22T18:08:37.223505] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-22T18:08:37.223787] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-22T18:08:37.231958] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-22T18:08:37.264224] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-22T18:08:38.172294] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:08:38.194761] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-22T18:08:38.336961] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:08:38.344245] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-22T18:08:38.343902] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:08:38.345342] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-22T18:08:38.897456] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T18:08:38.908520] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-22T18:08:39.055784] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-22T18:08:39.060010] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-22T18:08:39.449504] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-22T18:08:39.457725] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-22T18:08:39.534506] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T18:08:39.543419] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-22T18:08:40.100034] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T18:08:40.105365] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-22T18:08:40.507986] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T18:08:40.519822] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-22T18:08:40.557386] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T18:08:40.564076] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-22T18:08:40.704881] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T18:08:40.713903] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-22T18:08:41.369266] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T18:08:41.375479] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-22T18:08:41.506620] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T18:08:41.512310] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-22T18:08:41.862386] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T18:08:41.878066] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-22T18:08:42.185479] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T18:08:42.194619] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-22T18:08:42.419560] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T18:08:42.428672] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-22T18:08:42.476007] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T18:08:42.482693] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-22T18:08:43.452464] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T18:08:43.460028] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-22T18:08:43.521445] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T18:08:43.525834] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-22T18:08:43.675934] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T18:08:43.687199] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-22T18:08:44.062972] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T18:08:44.072803] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-22T18:08:44.300091] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T18:08:44.305315] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-22T18:08:44.843101] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T18:08:44.850567] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-22T18:08:45.317028] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-22T18:08:45.325207] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-22T18:08:45.452013] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T18:08:45.672140] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T18:08:45.731713] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T18:08:46.102962] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T18:08:46.122010] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-22T18:08:46.922059] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-22T18:08:47.669975] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T18:08:47.722005] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-22T18:08:47.765214] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T18:08:48.522143] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-22T18:08:48.940397] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T18:08:49.322084] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-22T18:08:49.378431] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T18:08:50.122149] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-22T18:08:50.318098] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T18:08:50.922082] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-22T18:08:51.298814] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T18:08:51.302828] [INFO ] [REMOTE ] CPS: Full fetch complete (36247 records). [2025-09-22T18:08:51.302970] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-22T18:08:51.689940] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-22T18:08:51.690027] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-22T18:08:51.690605] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-22T18:08:51.690701] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-22T18:08:51.691557] [DEBUG] [LOCAL ] CPS: Trimmed 36247 records to 26249 (keeping 200 days of data) [2025-09-22T18:08:51.748023] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-22T18:08:51.860478] [DEBUG] [LOCAL ] CPS: Primary data saved (26249 records). [2025-09-22T18:08:51.860617] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-22T18:08:51.860746] [INFO ] [MAIN ] Update Progress: 521/2372 symbols completed. CPS took 16.5s. Estimated remaining: 4h 4m 26s. Rate: 7.6 symbols/min [2025-09-22T18:08:52.039467] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:08:52.073848] [DEBUG] [LOCAL ] CR: Loaded 25083 existing records from primary storage. [2025-09-22T18:08:52.074618] [INFO ] [MAIN ] CR: Loaded 25083 existing records. [2025-09-22T18:08:52.252970] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:08:52.253450] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-22T18:08:52.253506] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-22T18:08:52.254816] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-22T18:08:52.254895] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-22T18:08:52.528434] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-22T18:08:52.620298] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:08:52.682324] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T18:08:52.709818] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T18:08:52.713722] [INFO ] [REMOTE ] CQP: Full fetch complete (30896 records). [2025-09-22T18:08:52.713854] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-22T18:08:53.094170] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-22T18:08:53.094248] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-22T18:08:53.094677] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-22T18:08:53.094737] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-22T18:08:53.095517] [DEBUG] [LOCAL ] CQP: Trimmed 30896 records to 19936 (keeping 200 days of data) [2025-09-22T18:08:53.222276] [DEBUG] [LOCAL ] CQP: Primary data saved (19936 records). [2025-09-22T18:08:53.222425] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-22T18:08:53.222509] [INFO ] [MAIN ] Update Progress: 522/2372 symbols completed. CQP took 17.9s. Estimated remaining: 4h 3m 55s. Rate: 7.6 symbols/min [2025-09-22T18:08:53.327709] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-22T18:08:53.404767] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:08:53.404999] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-09-22T18:08:53.405057] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-09-22T18:08:53.405234] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-22T18:08:53.405312] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-22T18:08:53.405396] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-22T18:08:53.405456] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-22T18:08:53.778928] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:08:54.122130] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-22T18:08:54.204491] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T18:08:54.929804] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-22T18:08:54.949084] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T18:08:55.383825] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T18:08:55.722124] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-22T18:08:55.828954] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T18:08:56.522110] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-22T18:08:57.276366] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T18:08:57.327214] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-22T18:08:57.328133] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T18:08:58.122051] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-22T18:08:58.922136] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-22T18:08:59.068767] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T18:08:59.389314] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T18:08:59.668055] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-22T18:08:59.722069] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-22T18:09:00.522149] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-22T18:09:00.987157] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T18:09:01.322105] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-22T18:09:02.122077] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-22T18:09:02.402907] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T18:09:02.410715] [INFO ] [REMOTE ] CPT: Full fetch complete (63470 records). [2025-09-22T18:09:02.410919] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-22T18:09:02.836125] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-22T18:09:02.836264] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-22T18:09:02.837285] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-22T18:09:02.837352] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-22T18:09:02.839321] [DEBUG] [LOCAL ] CPT: Trimmed 63470 records to 44347 (keeping 200 days of data) [2025-09-22T18:09:02.939394] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-22T18:09:03.136582] [DEBUG] [LOCAL ] CPT: Primary data saved (44347 records). [2025-09-22T18:09:03.136755] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-22T18:09:03.136853] [INFO ] [MAIN ] Update Progress: 523/2372 symbols completed. CPT took 27.8s. Estimated remaining: 4h 3m 54s. Rate: 7.6 symbols/min [2025-09-22T18:09:03.326095] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:09:03.380674] [DEBUG] [LOCAL ] CRBG: Loaded 53112 existing records from primary storage. [2025-09-22T18:09:03.380865] [INFO ] [MAIN ] CRBG: Loaded 53112 existing records. [2025-09-22T18:09:03.559184] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:09:03.559462] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-22T18:09:03.559529] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-22T18:09:03.561078] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-22T18:09:03.561140] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-22T18:09:03.929782] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:09:03.930234] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-22T18:09:03.944548] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-22T18:09:04.522129] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-22T18:09:04.615815] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T18:09:05.322032] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-22T18:09:05.480132] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T18:09:05.662278] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T18:09:06.035275] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (3.91 seconds). [2025-09-22T18:09:06.045429] [INFO ] [REMOTE ] CPRI: Full fetch complete (76170 records). [2025-09-22T18:09:06.045598] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-22T18:09:06.123010] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-22T18:09:06.226517] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-22T18:09:06.468850] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-22T18:09:06.468934] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-22T18:09:06.469763] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-22T18:09:06.469826] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-22T18:09:06.471404] [DEBUG] [LOCAL ] CPRI: Trimmed 76170 records to 52583 (keeping 200 days of data) [2025-09-22T18:09:06.798152] [DEBUG] [LOCAL ] CPRI: Primary data saved (52583 records). [2025-09-22T18:09:06.798323] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-22T18:09:06.798418] [INFO ] [MAIN ] Update Progress: 524/2372 symbols completed. CPRI took 31.5s. Estimated remaining: 4h 3m 31s. Rate: 7.6 symbols/min [2025-09-22T18:09:06.927202] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-22T18:09:06.976584] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:09:06.976822] [DEBUG] [LOCAL ] CRC: No existing data file found in primary storage. [2025-09-22T18:09:06.976877] [WARN ] [MAIN ] CRC: No existing data found, performing full refresh instead. [2025-09-22T18:09:06.977023] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-22T18:09:06.977066] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-22T18:09:06.977106] [DEBUG] [LOCAL ] CRC: No primary data file found to delete. [2025-09-22T18:09:06.977138] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-22T18:09:07.350197] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:09:07.369727] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T18:09:07.681104] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T18:09:07.722041] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-22T18:09:08.231615] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T18:09:08.522121] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-22T18:09:09.322077] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-22T18:09:09.627183] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T18:09:10.122060] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-22T18:09:10.159277] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T18:09:10.922027] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-22T18:09:11.042503] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T18:09:11.722096] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-22T18:09:12.277077] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T18:09:12.522065] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-22T18:09:12.604726] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T18:09:13.283990] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T18:09:13.285745] [INFO ] [REMOTE ] CRBD: Full fetch complete (15423 records). [2025-09-22T18:09:13.285816] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-22T18:09:13.327182] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-22T18:09:13.471589] [WARN ] [VALIDATOR ] CRBD: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-22T18:09:13.471941] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:09:13.472012] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:09:13.472087] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-22T18:09:13.472157] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-22T18:09:13.472194] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-22T18:09:13.472241] [DEBUG] [LOCAL ] CRBD: No derivative data file found to delete. [2025-09-22T18:09:13.472308] [INFO ] [MAIN ] Update Progress: 525/2372 symbols completed. CRBD took 20.2s. Estimated remaining: 4h 3m 19s. Rate: 7.6 symbols/min [2025-09-22T18:09:13.653451] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:09:13.653639] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-22T18:09:13.653719] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-22T18:09:13.653910] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-22T18:09:13.653966] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-22T18:09:13.654012] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-22T18:09:13.654046] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-22T18:09:14.038981] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:09:14.122076] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-22T18:09:14.922128] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-22T18:09:15.570968] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:09:15.571385] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-22T18:09:15.722102] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-22T18:09:15.869617] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-22T18:09:16.082834] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:09:16.083173] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-22T18:09:16.522076] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-22T18:09:17.097088] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-22T18:09:17.322062] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-22T18:09:18.122081] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-22T18:09:18.320215] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:09:18.320520] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-22T18:09:18.484031] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T18:09:18.571407] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-22T18:09:18.922110] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-22T18:09:19.722144] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-22T18:09:19.912357] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T18:09:20.522060] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-22T18:09:21.064420] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T18:09:21.322046] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-22T18:09:21.520215] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:09:21.520442] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-22T18:09:21.605826] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-22T18:09:22.122073] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-22T18:09:22.922095] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-22T18:09:23.351469] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T18:09:23.357984] [INFO ] [REMOTE ] CR: Full fetch complete (34938 records). [2025-09-22T18:09:23.358162] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-22T18:09:23.727143] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-22T18:09:23.770453] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-22T18:09:23.770558] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-22T18:09:23.771167] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-22T18:09:23.771345] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-22T18:09:23.772454] [DEBUG] [LOCAL ] CR: Trimmed 34938 records to 24776 (keeping 200 days of data) [2025-09-22T18:09:23.942368] [DEBUG] [LOCAL ] CR: Primary data saved (24776 records). [2025-09-22T18:09:23.942561] [INFO ] [MAIN ] CR: Full history saved. [2025-09-22T18:09:23.942697] [INFO ] [MAIN ] Update Progress: 526/2372 symbols completed. CR took 32.1s. Estimated remaining: 4h 3m 20s. Rate: 7.6 symbols/min [2025-09-22T18:09:24.119890] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:09:24.178435] [DEBUG] [LOCAL ] CRGY: Loaded 53297 existing records from primary storage. [2025-09-22T18:09:24.178622] [INFO ] [MAIN ] CRGY: Loaded 53297 existing records. [2025-09-22T18:09:24.374543] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:09:24.374979] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-22T18:09:24.375097] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-22T18:09:24.376567] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-22T18:09:24.376636] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-22T18:09:24.527995] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-22T18:09:24.665903] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T18:09:24.808711] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:09:24.844101] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:09:24.844444] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-22T18:09:25.322055] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-22T18:09:25.528428] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T18:09:26.122057] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-22T18:09:26.346874] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:09:26.347188] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-22T18:09:26.922043] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-22T18:09:27.071782] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T18:09:27.722080] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-22T18:09:28.522066] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-22T18:09:29.322077] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-22T18:09:29.419007] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-22T18:09:30.122135] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-22T18:09:30.387366] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T18:09:30.590916] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-09-22T18:09:30.922062] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-22T18:09:31.356374] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-22T18:09:31.401140] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T18:09:31.722116] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-22T18:09:32.522136] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-22T18:09:32.568324] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T18:09:33.101142] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T18:09:33.322061] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-22T18:09:34.122148] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-22T18:09:34.922104] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-22T18:09:35.536158] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-22T18:09:35.671548] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-22T18:09:35.722059] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-22T18:09:35.931391] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T18:09:36.486392] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T18:09:36.522093] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-22T18:09:37.322061] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-22T18:09:38.079970] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T18:09:38.122084] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-22T18:09:38.432771] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-22T18:09:38.726160] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T18:09:38.740364] [INFO ] [REMOTE ] CRC: Full fetch complete (62095 records). [2025-09-22T18:09:38.740565] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-22T18:09:38.930511] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-22T18:09:39.126582] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-22T18:09:39.126689] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-22T18:09:39.127412] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-22T18:09:39.127456] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-22T18:09:39.128902] [DEBUG] [LOCAL ] CRC: Trimmed 62095 records to 44421 (keeping 200 days of data) [2025-09-22T18:09:39.404258] [DEBUG] [LOCAL ] CRC: Primary data saved (44421 records). [2025-09-22T18:09:39.404401] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-22T18:09:39.404492] [INFO ] [MAIN ] Update Progress: 527/2372 symbols completed. CRC took 32.6s. Estimated remaining: 4h 3m 39s. Rate: 7.6 symbols/min [2025-09-22T18:09:39.587903] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:09:39.645594] [DEBUG] [LOCAL ] CRH: Loaded 54250 existing records from primary storage. [2025-09-22T18:09:39.645773] [INFO ] [MAIN ] CRH: Loaded 54250 existing records. [2025-09-22T18:09:39.728815] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-22T18:09:39.840356] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:09:39.840631] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-22T18:09:39.840719] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-22T18:09:39.842336] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-22T18:09:39.842400] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-22T18:09:40.238273] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:09:40.274688] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-22T18:09:40.522062] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-22T18:09:40.732477] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T18:09:41.322070] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-22T18:09:42.122128] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-22T18:09:42.475585] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T18:09:42.861100] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-09-22T18:09:42.869249] [INFO ] [REMOTE ] CRCL: Full fetch complete (29049 records). [2025-09-22T18:09:42.869339] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-22T18:09:42.928922] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-22T18:09:43.075449] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 75 unique days, need 200 days [2025-09-22T18:09:43.076149] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:09:43.076338] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:09:43.076560] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-22T18:09:43.076701] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-22T18:09:43.076779] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-22T18:09:43.076968] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-22T18:09:43.077177] [INFO ] [MAIN ] Update Progress: 528/2372 symbols completed. CRCL took 29.6s. Estimated remaining: 4h 3m 16s. Rate: 7.6 symbols/min [2025-09-22T18:09:43.252707] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:09:43.283913] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T18:09:43.346362] [DEBUG] [LOCAL ] CRI: Loaded 50689 existing records from primary storage. [2025-09-22T18:09:43.346547] [INFO ] [MAIN ] CRI: Loaded 50689 existing records. [2025-09-22T18:09:43.530976] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:09:43.531281] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-22T18:09:43.531368] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-22T18:09:43.533309] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-22T18:09:43.533374] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-22T18:09:43.734071] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-22T18:09:43.969545] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:09:44.000460] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T18:09:44.522079] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-22T18:09:44.608922] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T18:09:45.263886] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T18:09:45.322024] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-22T18:09:46.122082] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-22T18:09:46.342493] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T18:09:46.922103] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-22T18:09:47.187613] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-22T18:09:47.722076] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-22T18:09:47.774962] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T18:09:47.783483] [INFO ] [REMOTE ] CRBG: Full fetch complete (75327 records). [2025-09-22T18:09:47.783737] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-22T18:09:47.784805] [FATAL] [VALIDATOR ] CRBG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:09:47.784940] [FATAL] [MAIN ] CRBG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:09:47.785034] [WARN ] [MAIN ] CRBG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:09:47.785147] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-22T18:09:47.785271] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-09-22T18:09:47.785347] [INFO ] [LOCAL ] CRBG: Starting deletion of derivative data. [2025-09-22T18:09:47.785936] [DEBUG] [LOCAL ] CRBG: Deleted derivative data file. [2025-09-22T18:09:47.786076] [INFO ] [MAIN ] Update Progress: 529/2372 symbols completed. CRBG took 44.6s. Estimated remaining: 4h 2m 57s. Rate: 7.6 symbols/min [2025-09-22T18:09:47.960181] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:09:48.014958] [DEBUG] [LOCAL ] CRK: Loaded 52887 existing records from primary storage. [2025-09-22T18:09:48.015134] [INFO ] [MAIN ] CRK: Loaded 52887 existing records. [2025-09-22T18:09:48.192718] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:09:48.192972] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-22T18:09:48.193020] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-22T18:09:48.194943] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-22T18:09:48.195032] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-22T18:09:48.528503] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-22T18:09:48.559980] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:09:48.709925] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T18:09:49.322542] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-22T18:09:49.331503] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T18:09:50.122083] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-22T18:09:50.493904] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-22T18:09:50.922074] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-22T18:09:51.129066] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T18:09:51.711738] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T18:09:51.721995] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-22T18:09:52.522052] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-22T18:09:53.000902] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-22T18:09:53.322054] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-22T18:09:53.415359] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T18:09:54.122047] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-22T18:09:54.586146] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-22T18:09:54.595194] [INFO ] [REMOTE ] CRGY: Full fetch complete (75936 records). [2025-09-22T18:09:54.595349] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-22T18:09:54.924388] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-22T18:09:55.065853] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-22T18:09:55.066054] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-22T18:09:55.067095] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-22T18:09:55.067235] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-22T18:09:55.069081] [DEBUG] [LOCAL ] CRGY: Trimmed 75936 records to 52511 (keeping 200 days of data) [2025-09-22T18:09:55.335837] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T18:09:55.474567] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T18:09:55.477884] [DEBUG] [LOCAL ] CRGY: Primary data saved (52511 records). [2025-09-22T18:09:55.488614] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-22T18:09:55.488807] [INFO ] [MAIN ] Update Progress: 530/2372 symbols completed. CRGY took 31.5s. Estimated remaining: 4h 2m 48s. Rate: 7.6 symbols/min [2025-09-22T18:09:55.661853] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:09:55.662058] [DEBUG] [LOCAL ] CRL: No existing data file found in primary storage. [2025-09-22T18:09:55.662112] [WARN ] [MAIN ] CRL: No existing data found, performing full refresh instead. [2025-09-22T18:09:55.662257] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-22T18:09:55.662300] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-22T18:09:55.662340] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-09-22T18:09:55.662372] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-22T18:09:55.727276] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-22T18:09:56.023695] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:09:56.412108] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T18:09:56.522047] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-22T18:09:57.322050] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-22T18:09:57.559088] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T18:09:57.889928] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T18:09:58.122053] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-22T18:09:58.831704] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T18:09:58.922013] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-22T18:09:59.722043] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-22T18:09:59.762675] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T18:10:00.522064] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-22T18:10:00.687367] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T18:10:01.322065] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-22T18:10:01.729622] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-22T18:10:02.044173] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T18:10:02.122123] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-22T18:10:02.922070] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-22T18:10:03.046297] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T18:10:03.722089] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-22T18:10:03.802600] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T18:10:04.522124] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-22T18:10:04.578252] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T18:10:05.322033] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-22T18:10:05.384596] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T18:10:06.122063] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-22T18:10:06.373772] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T18:10:06.922038] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-22T18:10:07.018427] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T18:10:07.717711] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T18:10:07.727737] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-22T18:10:08.522130] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-22T18:10:08.666168] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T18:10:08.679123] [INFO ] [REMOTE ] CRH: Full fetch complete (77298 records). [2025-09-22T18:10:08.679504] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-22T18:10:09.293744] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-22T18:10:09.293876] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-22T18:10:09.295003] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-22T18:10:09.295096] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-22T18:10:09.297248] [DEBUG] [LOCAL ] CRH: Trimmed 77298 records to 53472 (keeping 200 days of data) [2025-09-22T18:10:09.380855] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-22T18:10:09.396433] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T18:10:09.689078] [DEBUG] [LOCAL ] CRH: Primary data saved (53472 records). [2025-09-22T18:10:09.689244] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-22T18:10:09.689354] [INFO ] [MAIN ] Update Progress: 531/2372 symbols completed. CRH took 30.3s. Estimated remaining: 4h 3m 2s. Rate: 7.6 symbols/min [2025-09-22T18:10:09.857392] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:10:09.912488] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-22T18:10:09.912633] [INFO ] [MAIN ] CRM: Loaded 54550 existing records. [2025-09-22T18:10:10.092090] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:10:10.092323] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-22T18:10:10.092399] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-22T18:10:10.093948] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-22T18:10:10.094012] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-22T18:10:10.127188] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-22T18:10:10.416735] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T18:10:10.500342] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:10:10.820102] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T18:10:10.922057] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-22T18:10:11.722035] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-22T18:10:11.773116] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T18:10:11.780937] [INFO ] [REMOTE ] CRI: Full fetch complete (70810 records). [2025-09-22T18:10:11.781043] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-22T18:10:12.163163] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-22T18:10:12.163241] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-22T18:10:12.163979] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-22T18:10:12.164043] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-22T18:10:12.165417] [DEBUG] [LOCAL ] CRI: Trimmed 70810 records to 49968 (keeping 200 days of data) [2025-09-22T18:10:12.473397] [DEBUG] [LOCAL ] CRI: Primary data saved (49968 records). [2025-09-22T18:10:12.473543] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-22T18:10:12.476286] [INFO ] [MAIN ] Update Progress: 532/2372 symbols completed. CRI took 29.4s. Estimated remaining: 4h 2m 36s. Rate: 7.6 symbols/min [2025-09-22T18:10:12.539946] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-22T18:10:12.649150] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:10:12.701994] [DEBUG] [LOCAL ] CRS: Loaded 44213 existing records from primary storage. [2025-09-22T18:10:12.702146] [INFO ] [MAIN ] CRS: Loaded 44213 existing records. [2025-09-22T18:10:12.879989] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:10:12.880242] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-22T18:10:12.880300] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-22T18:10:12.881567] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-22T18:10:12.881628] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-22T18:10:13.242915] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:10:13.328602] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-22T18:10:13.348600] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-22T18:10:13.747199] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-22T18:10:14.122030] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-22T18:10:14.588632] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T18:10:14.738815] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T18:10:14.922063] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-22T18:10:15.722072] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-22T18:10:15.966371] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T18:10:16.522049] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-22T18:10:16.625574] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T18:10:17.112585] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T18:10:17.322061] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-22T18:10:18.122105] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-22T18:10:18.922152] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-22T18:10:19.020422] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-22T18:10:19.722046] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-22T18:10:19.763381] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T18:10:20.099306] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-09-22T18:10:20.107501] [INFO ] [REMOTE ] CRK: Full fetch complete (75486 records). [2025-09-22T18:10:20.107633] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-22T18:10:20.524629] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-22T18:10:20.526115] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-22T18:10:20.526487] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-22T18:10:20.527754] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-22T18:10:20.550483] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-22T18:10:20.553109] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T18:10:20.563806] [DEBUG] [LOCAL ] CRK: Trimmed 75486 records to 52118 (keeping 200 days of data) [2025-09-22T18:10:20.876793] [DEBUG] [LOCAL ] CRK: Primary data saved (52118 records). [2025-09-22T18:10:20.876990] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-22T18:10:20.877192] [INFO ] [MAIN ] Update Progress: 533/2372 symbols completed. CRK took 33.1s. Estimated remaining: 4h 2m 30s. Rate: 7.6 symbols/min [2025-09-22T18:10:21.056056] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:10:21.063572] [DEBUG] [LOCAL ] CRT: Loaded 4969 existing records from primary storage. [2025-09-22T18:10:21.063730] [INFO ] [MAIN ] CRT: Loaded 4969 existing records. [2025-09-22T18:10:21.245586] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:10:21.245862] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-22T18:10:21.245913] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-22T18:10:21.246218] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-22T18:10:21.246280] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-22T18:10:21.327161] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-22T18:10:21.625302] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:10:21.885983] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-22T18:10:22.122054] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-22T18:10:22.302591] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T18:10:22.922081] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-22T18:10:23.071139] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T18:10:23.355370] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-22T18:10:23.722064] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-22T18:10:24.342593] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-22T18:10:24.522069] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-22T18:10:25.317516] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T18:10:25.325607] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-22T18:10:25.971097] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T18:10:26.122061] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-22T18:10:26.696326] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T18:10:26.886803] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-22T18:10:26.922067] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-22T18:10:27.722061] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-22T18:10:28.522105] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-22T18:10:29.322037] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-22T18:10:29.378159] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-22T18:10:29.801011] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-22T18:10:30.003428] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-22T18:10:30.111873] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T18:10:30.119453] [INFO ] [REMOTE ] CRL: Full fetch complete (62673 records). [2025-09-22T18:10:30.119596] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-22T18:10:30.127110] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-22T18:10:30.511626] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-22T18:10:30.511740] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-22T18:10:30.512461] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-22T18:10:30.512524] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-22T18:10:30.514125] [DEBUG] [LOCAL ] CRL: Trimmed 62673 records to 43362 (keeping 200 days of data) [2025-09-22T18:10:30.793659] [DEBUG] [LOCAL ] CRL: Primary data saved (43362 records). [2025-09-22T18:10:30.794004] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-22T18:10:30.794273] [INFO ] [MAIN ] Update Progress: 534/2372 symbols completed. CRL took 35.3s. Estimated remaining: 4h 2m 29s. Rate: 7.6 symbols/min [2025-09-22T18:10:30.937747] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-22T18:10:30.974442] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:10:31.018682] [DEBUG] [LOCAL ] CSAN: Loaded 42602 existing records from primary storage. [2025-09-22T18:10:31.018828] [INFO ] [MAIN ] CSAN: Loaded 42602 existing records. [2025-09-22T18:10:31.196708] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:10:31.197010] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-22T18:10:31.197065] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-22T18:10:31.198006] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-22T18:10:31.198084] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-22T18:10:31.573856] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:10:31.722105] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-22T18:10:32.522091] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-22T18:10:32.585183] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-22T18:10:32.700046] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T18:10:32.978184] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T18:10:33.280401] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-22T18:10:33.322038] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-22T18:10:33.916396] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-22T18:10:34.122052] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-22T18:10:34.512526] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-22T18:10:34.922070] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-22T18:10:35.722085] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-22T18:10:36.522069] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-22T18:10:36.908498] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T18:10:37.124801] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T18:10:37.322030] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-22T18:10:37.494205] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-22T18:10:38.122064] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-22T18:10:38.472867] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T18:10:38.754253] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-22T18:10:38.922106] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-22T18:10:39.722054] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-22T18:10:39.735124] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T18:10:39.736844] [INFO ] [REMOTE ] CRT: Full fetch complete (7587 records). [2025-09-22T18:10:39.736967] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-22T18:10:40.128502] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-22T18:10:40.128584] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-22T18:10:40.128856] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-22T18:10:40.128942] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-22T18:10:40.129381] [DEBUG] [LOCAL ] CRT: Trimmed 7587 records to 4932 (keeping 200 days of data) [2025-09-22T18:10:40.160742] [DEBUG] [LOCAL ] CRT: Primary data saved (4932 records). [2025-09-22T18:10:40.160873] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-22T18:10:40.160992] [INFO ] [MAIN ] Update Progress: 535/2372 symbols completed. CRT took 19.3s. Estimated remaining: 4h 2m 26s. Rate: 7.6 symbols/min [2025-09-22T18:10:40.349601] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:10:40.349826] [DEBUG] [LOCAL ] CSL: No existing data file found in primary storage. [2025-09-22T18:10:40.349898] [WARN ] [MAIN ] CSL: No existing data found, performing full refresh instead. [2025-09-22T18:10:40.350118] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-22T18:10:40.350189] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-22T18:10:40.350262] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-09-22T18:10:40.350338] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-22T18:10:40.524456] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-22T18:10:40.733126] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:10:41.101730] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T18:10:41.322048] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-22T18:10:42.122061] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-22T18:10:42.922033] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-22T18:10:42.971934] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T18:10:43.125700] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-22T18:10:43.610569] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T18:10:43.722026] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-22T18:10:44.026855] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T18:10:44.522110] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-22T18:10:45.310209] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T18:10:45.322012] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-22T18:10:46.122072] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-22T18:10:46.922062] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-22T18:10:47.171890] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T18:10:47.215800] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-22T18:10:47.224325] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-22T18:10:47.224465] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-22T18:10:47.638912] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T18:10:47.736990] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-22T18:10:47.732973] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-22T18:10:47.737117] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-22T18:10:47.738146] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-22T18:10:47.739193] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-22T18:10:47.740880] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-09-22T18:10:48.108281] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-09-22T18:10:48.108434] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-22T18:10:48.108569] [INFO ] [MAIN ] Update Progress: 536/2372 symbols completed. CRM took 38.4s. Estimated remaining: 4h 2m 18s. Rate: 7.6 symbols/min [2025-09-22T18:10:48.282451] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:10:48.306362] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T18:10:48.321763] [DEBUG] [LOCAL ] CSR: Loaded 12588 existing records from primary storage. [2025-09-22T18:10:48.321873] [INFO ] [MAIN ] CSR: Loaded 12588 existing records. [2025-09-22T18:10:48.499122] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:10:48.499421] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-22T18:10:48.499467] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-22T18:10:48.500013] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-22T18:10:48.500077] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-22T18:10:48.531397] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-22T18:10:48.917487] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:10:49.322055] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-22T18:10:49.580808] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T18:10:49.587499] [INFO ] [REMOTE ] CRS: Full fetch complete (62458 records). [2025-09-22T18:10:49.587602] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-22T18:10:50.001413] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T18:10:50.032946] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-22T18:10:50.033089] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-22T18:10:50.034210] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-22T18:10:50.034635] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-22T18:10:50.036960] [DEBUG] [LOCAL ] CRS: Trimmed 62458 records to 43444 (keeping 200 days of data) [2025-09-22T18:10:50.150727] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-22T18:10:50.339330] [DEBUG] [LOCAL ] CRS: Primary data saved (43444 records). [2025-09-22T18:10:50.339538] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-22T18:10:50.340554] [INFO ] [MAIN ] Update Progress: 537/2372 symbols completed. CRS took 37.9s. Estimated remaining: 4h 1m 51s. Rate: 7.6 symbols/min [2025-09-22T18:10:50.521664] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:10:50.518671] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T18:10:50.585902] [DEBUG] [LOCAL ] CSTM: Loaded 48510 existing records from primary storage. [2025-09-22T18:10:50.586035] [INFO ] [MAIN ] CSTM: Loaded 48510 existing records. [2025-09-22T18:10:50.765560] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:10:50.765843] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-22T18:10:50.765903] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-22T18:10:50.767122] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-22T18:10:50.767185] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-22T18:10:50.927136] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-22T18:10:51.136806] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:10:51.722014] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-22T18:10:51.747047] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T18:10:51.873306] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T18:10:52.522103] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-22T18:10:53.310317] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T18:10:53.322008] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-22T18:10:53.798183] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T18:10:54.122052] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-22T18:10:54.903630] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T18:10:54.922014] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-22T18:10:55.605020] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-22T18:10:55.657083] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T18:10:55.722066] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-22T18:10:56.522058] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-22T18:10:57.198568] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T18:10:57.322052] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-22T18:10:58.082813] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T18:10:58.122029] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-22T18:10:58.881259] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T18:10:58.888221] [INFO ] [REMOTE ] CSAN: Full fetch complete (60791 records). [2025-09-22T18:10:58.888333] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-22T18:10:58.927161] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-22T18:10:59.305795] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-22T18:10:59.305878] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-22T18:10:59.306631] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-22T18:10:59.306712] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-22T18:10:59.309286] [DEBUG] [LOCAL ] CSAN: Trimmed 60791 records to 42137 (keeping 200 days of data) [2025-09-22T18:10:59.556671] [DEBUG] [LOCAL ] CSAN: Primary data saved (42137 records). [2025-09-22T18:10:59.556853] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-22T18:10:59.556964] [INFO ] [MAIN ] Update Progress: 538/2372 symbols completed. CSAN took 28.8s. Estimated remaining: 4h 1m 47s. Rate: 7.6 symbols/min [2025-09-22T18:10:59.730460] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-22T18:10:59.767417] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:10:59.796608] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T18:10:59.816055] [DEBUG] [LOCAL ] CSV: Loaded 13335 existing records from primary storage. [2025-09-22T18:10:59.816173] [INFO ] [MAIN ] CSV: Loaded 13335 existing records. [2025-09-22T18:10:59.997253] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:10:59.997509] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-22T18:10:59.997575] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-22T18:10:59.998102] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-22T18:10:59.998161] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-22T18:11:00.200772] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T18:11:00.402995] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:11:00.522044] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-22T18:11:01.251766] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T18:11:01.322023] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-22T18:11:01.724579] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T18:11:02.122109] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-22T18:11:02.676243] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:11:02.922061] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-22T18:11:03.107627] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T18:11:03.722078] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-22T18:11:04.354691] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T18:11:04.372835] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T18:11:04.522052] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-22T18:11:05.322073] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-22T18:11:05.864028] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T18:11:06.122029] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-22T18:11:06.922068] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-22T18:11:06.949340] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T18:11:07.015459] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-22T18:11:07.722061] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-22T18:11:08.275671] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-22T18:11:08.522051] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-22T18:11:08.662618] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T18:11:09.322066] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-22T18:11:09.404353] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T18:11:10.122065] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-22T18:11:10.283693] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T18:11:10.922059] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-22T18:11:11.544413] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T18:11:11.722050] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-22T18:11:12.522068] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-22T18:11:12.635862] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T18:11:12.642046] [INFO ] [REMOTE ] CSL: Full fetch complete (44946 records). [2025-09-22T18:11:12.642211] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-22T18:11:13.030844] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-22T18:11:13.030935] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-22T18:11:13.031526] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-22T18:11:13.031580] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-22T18:11:13.032585] [DEBUG] [LOCAL ] CSL: Trimmed 44946 records to 31486 (keeping 200 days of data) [2025-09-22T18:11:13.245507] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T18:11:13.271530] [DEBUG] [LOCAL ] CSL: Primary data saved (31486 records). [2025-09-22T18:11:13.271726] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-22T18:11:13.271839] [INFO ] [MAIN ] Update Progress: 539/2372 symbols completed. CSL took 33.1s. Estimated remaining: 4h 1m 59s. Rate: 7.6 symbols/min [2025-09-22T18:11:13.328416] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-22T18:11:13.453893] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:11:13.454201] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-22T18:11:13.454266] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-22T18:11:13.454541] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-22T18:11:13.454605] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-22T18:11:13.454725] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-22T18:11:13.454793] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-22T18:11:13.823978] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-22T18:11:13.857009] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:11:14.122105] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-22T18:11:14.327234] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:14.327577] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-22T18:11:14.511747] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T18:11:14.514321] [INFO ] [REMOTE ] CSR: Full fetch complete (17369 records). [2025-09-22T18:11:14.514398] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-22T18:11:14.876132] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-22T18:11:14.876207] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-22T18:11:14.876581] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-22T18:11:14.876619] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-22T18:11:14.877195] [DEBUG] [LOCAL ] CSR: Trimmed 17369 records to 12483 (keeping 200 days of data) [2025-09-22T18:11:14.933609] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-22T18:11:14.957048] [DEBUG] [LOCAL ] CSR: Primary data saved (12483 records). [2025-09-22T18:11:14.957156] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-22T18:11:14.957238] [INFO ] [MAIN ] Update Progress: 540/2372 symbols completed. CSR took 26.8s. Estimated remaining: 4h 1m 30s. Rate: 7.6 symbols/min [2025-09-22T18:11:15.129342] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:11:15.138451] [DEBUG] [LOCAL ] CTBB: Loaded 7337 existing records from primary storage. [2025-09-22T18:11:15.138579] [INFO ] [MAIN ] CTBB: Loaded 7337 existing records. [2025-09-22T18:11:15.314244] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:11:15.314526] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-22T18:11:15.314573] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-22T18:11:15.314935] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-22T18:11:15.314994] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-22T18:11:15.672715] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:11:15.722040] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-22T18:11:16.522182] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-22T18:11:16.778704] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T18:11:16.809471] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T18:11:17.301384] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T18:11:17.322024] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-22T18:11:18.048115] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T18:11:18.122125] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-22T18:11:18.922042] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-22T18:11:19.028546] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-22T18:11:19.620581] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T18:11:19.722065] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-22T18:11:20.522909] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-22T18:11:20.526499] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T18:11:21.322079] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-22T18:11:21.841795] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-22T18:11:22.122068] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-22T18:11:22.166504] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T18:11:22.343366] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:22.343712] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-22T18:11:22.922061] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-22T18:11:23.538874] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T18:11:23.722071] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-22T18:11:24.339385] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T18:11:24.522049] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-22T18:11:25.322055] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-22T18:11:25.911479] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T18:11:25.919075] [INFO ] [REMOTE ] CSTM: Full fetch complete (68952 records). [2025-09-22T18:11:25.919238] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-22T18:11:26.129393] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-22T18:11:26.213967] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T18:11:26.333224] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-22T18:11:26.333318] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-22T18:11:26.334104] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-22T18:11:26.334173] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-22T18:11:26.335726] [DEBUG] [LOCAL ] CSTM: Trimmed 68952 records to 47773 (keeping 200 days of data) [2025-09-22T18:11:26.395935] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:26.422270] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-22T18:11:26.620688] [DEBUG] [LOCAL ] CSTM: Primary data saved (47773 records). [2025-09-22T18:11:26.620834] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-22T18:11:26.622019] [INFO ] [MAIN ] Update Progress: 541/2372 symbols completed. CSTM took 36.3s. Estimated remaining: 4h 1m 35s. Rate: 7.6 symbols/min [2025-09-22T18:11:26.795809] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:11:26.806699] [DEBUG] [LOCAL ] CTDD: Loaded 5937 existing records from primary storage. [2025-09-22T18:11:26.806828] [INFO ] [MAIN ] CTDD: Loaded 5937 existing records. [2025-09-22T18:11:26.927255] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-22T18:11:26.998607] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:11:26.998913] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-22T18:11:26.998971] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-22T18:11:26.999370] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-22T18:11:26.999432] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-22T18:11:27.380113] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:11:27.722080] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-22T18:11:27.817196] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T18:11:28.522141] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-22T18:11:28.566841] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T18:11:29.322069] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-22T18:11:29.405086] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T18:11:29.407781] [INFO ] [REMOTE ] CSV: Full fetch complete (19432 records). [2025-09-22T18:11:29.407866] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-22T18:11:29.791775] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-22T18:11:29.791947] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-22T18:11:29.792370] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-22T18:11:29.798036] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-22T18:11:29.797757] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-22T18:11:29.801067] [DEBUG] [LOCAL ] CSV: Trimmed 19432 records to 13038 (keeping 200 days of data) [2025-09-22T18:11:29.884162] [DEBUG] [LOCAL ] CSV: Primary data saved (13038 records). [2025-09-22T18:11:29.884321] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-22T18:11:29.884413] [INFO ] [MAIN ] Update Progress: 542/2372 symbols completed. CSV took 30.3s. Estimated remaining: 4h 1m 11s. Rate: 7.6 symbols/min [2025-09-22T18:11:30.059334] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:11:30.059546] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-22T18:11:30.059603] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-22T18:11:30.059856] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-22T18:11:30.059909] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-22T18:11:30.059951] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-22T18:11:30.059983] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-22T18:11:30.127193] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-22T18:11:30.426288] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:11:30.754004] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-22T18:11:30.922039] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-22T18:11:31.290325] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:31.290673] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-22T18:11:31.722062] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-22T18:11:32.223426] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-22T18:11:32.522071] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-22T18:11:32.976572] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-22T18:11:33.322060] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-22T18:11:34.103135] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T18:11:34.122006] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-22T18:11:34.778428] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T18:11:34.780064] [INFO ] [REMOTE ] CTBB: Full fetch complete (11044 records). [2025-09-22T18:11:34.780133] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-22T18:11:34.929519] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-22T18:11:35.141798] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-22T18:11:35.141875] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-22T18:11:35.142134] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-22T18:11:35.142171] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-22T18:11:35.142636] [DEBUG] [LOCAL ] CTBB: Trimmed 11044 records to 7179 (keeping 200 days of data) [2025-09-22T18:11:35.189472] [DEBUG] [LOCAL ] CTBB: Primary data saved (7179 records). [2025-09-22T18:11:35.189589] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-22T18:11:35.189703] [INFO ] [MAIN ] Update Progress: 543/2372 symbols completed. CTBB took 20.2s. Estimated remaining: 4h 0m 55s. Rate: 7.6 symbols/min [2025-09-22T18:11:35.361157] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:11:35.361356] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-22T18:11:35.361393] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-22T18:11:35.361543] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-22T18:11:35.361586] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-22T18:11:35.361697] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-22T18:11:35.361764] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-22T18:11:35.472713] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-22T18:11:35.735531] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-22T18:11:35.741485] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:11:35.962365] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:35.962712] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-22T18:11:36.522120] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-22T18:11:36.991631] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-22T18:11:37.322055] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-22T18:11:37.731624] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:37.732003] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-22T18:11:38.122072] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-22T18:11:38.653196] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-22T18:11:38.922083] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-22T18:11:39.537383] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T18:11:39.722073] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-22T18:11:40.217202] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-22T18:11:40.522070] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-22T18:11:40.707929] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:40.708238] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-22T18:11:41.322095] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-22T18:11:41.596125] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:41.596508] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-22T18:11:42.122066] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-22T18:11:42.311399] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:42.311819] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-22T18:11:42.922071] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-22T18:11:43.722062] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-22T18:11:43.765613] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T18:11:44.407223] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T18:11:44.522075] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-22T18:11:44.776010] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:44.776363] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-22T18:11:45.322071] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-22T18:11:45.714041] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-22T18:11:46.122064] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-22T18:11:46.416436] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:46.416786] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-22T18:11:46.922061] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-22T18:11:47.722074] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-22T18:11:47.816798] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T18:11:47.943618] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:47.943978] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-22T18:11:48.522061] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-22T18:11:48.747470] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:48.747842] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-22T18:11:49.322060] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-22T18:11:50.122070] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-22T18:11:50.361344] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T18:11:50.731189] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T18:11:50.922058] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-22T18:11:51.178353] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-22T18:11:51.722056] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-22T18:11:52.522057] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-22T18:11:52.709460] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T18:11:53.066609] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-22T18:11:53.322054] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-22T18:11:53.563584] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-22T18:11:54.122069] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-22T18:11:54.330030] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:54.330481] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-22T18:11:54.922064] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-22T18:11:55.711273] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T18:11:55.722037] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-22T18:11:56.522108] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-22T18:11:56.804286] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T18:11:57.322177] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-22T18:11:57.428724] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T18:11:57.430458] [INFO ] [REMOTE ] CTDD: Full fetch complete (8563 records). [2025-09-22T18:11:57.430583] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-22T18:11:57.803093] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-22T18:11:57.803199] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-22T18:11:57.803534] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-22T18:11:57.803599] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-22T18:11:57.804066] [DEBUG] [LOCAL ] CTDD: Trimmed 8563 records to 5837 (keeping 200 days of data) [2025-09-22T18:11:57.844495] [DEBUG] [LOCAL ] CTDD: Primary data saved (5837 records). [2025-09-22T18:11:57.844634] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-22T18:11:57.844761] [INFO ] [MAIN ] Update Progress: 544/2372 symbols completed. CTDD took 31.2s. Estimated remaining: 4h 1m 36s. Rate: 7.6 symbols/min [2025-09-22T18:11:58.024362] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:11:58.058364] [DEBUG] [LOCAL ] CTO: Loaded 28928 existing records from primary storage. [2025-09-22T18:11:58.058501] [INFO ] [MAIN ] CTO: Loaded 28928 existing records. [2025-09-22T18:11:58.127151] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-22T18:11:58.239707] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:11:58.240028] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-22T18:11:58.240085] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-22T18:11:58.241010] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-22T18:11:58.241072] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-22T18:11:58.578271] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T18:11:58.617431] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:11:58.879486] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:11:58.879849] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-22T18:11:58.879950] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-22T18:11:58.880063] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-22T18:11:58.880704] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:11:58.880782] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:11:58.880847] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:11:58.880918] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-22T18:11:58.880982] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-22T18:11:58.881017] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-22T18:11:58.881055] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-22T18:11:58.881111] [INFO ] [MAIN ] Update Progress: 545/2372 symbols completed. CTEST took 29.0s. Estimated remaining: 4h 1m 5s. Rate: 7.6 symbols/min [2025-09-22T18:11:58.927138] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-22T18:11:59.057162] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:11:59.057358] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-09-22T18:11:59.057396] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-09-22T18:11:59.057541] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-22T18:11:59.057582] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-22T18:11:59.057622] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-09-22T18:11:59.057685] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-22T18:11:59.440497] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:11:59.722087] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-22T18:11:59.826858] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-22T18:12:00.522059] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-22T18:12:01.040726] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T18:12:01.322050] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-22T18:12:01.505474] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-22T18:12:01.508561] [INFO ] [REMOTE ] CSW: Full fetch complete (7865 records). [2025-09-22T18:12:01.508661] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-22T18:12:01.695777] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 73 unique days, need 200 days [2025-09-22T18:12:01.696040] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:12:01.696109] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:12:01.696160] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-22T18:12:01.696240] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-22T18:12:01.696296] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-22T18:12:01.696356] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-22T18:12:01.696435] [INFO ] [MAIN ] Update Progress: 546/2372 symbols completed. CSW took 48.4s. Estimated remaining: 4h 0m 40s. Rate: 7.6 symbols/min [2025-09-22T18:12:01.866515] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:12:01.926399] [DEBUG] [LOCAL ] CTRA: Loaded 54429 existing records from primary storage. [2025-09-22T18:12:01.926566] [INFO ] [MAIN ] CTRA: Loaded 54429 existing records. [2025-09-22T18:12:02.119668] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:12:02.119962] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-22T18:12:02.120018] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-22T18:12:02.121636] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-22T18:12:02.121725] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-22T18:12:02.133061] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-22T18:12:02.503994] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:12:02.868926] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T18:12:02.922008] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-22T18:12:03.722117] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-22T18:12:04.524220] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-22T18:12:04.525231] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-22T18:12:04.988781] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-22T18:12:05.322059] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-22T18:12:06.081949] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-22T18:12:06.122002] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-22T18:12:06.470943] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T18:12:06.819460] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T18:12:06.922047] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-22T18:12:07.255360] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-22T18:12:07.719728] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-22T18:12:07.722201] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-22T18:12:07.722832] [INFO ] [REMOTE ] CTEV: Full fetch complete (13402 records). [2025-09-22T18:12:07.723679] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-22T18:12:07.921722] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 142 unique days, need 200 days [2025-09-22T18:12:07.922035] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:12:07.922104] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:12:07.922152] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-22T18:12:07.922210] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-22T18:12:07.922246] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-22T18:12:07.922307] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-22T18:12:07.922403] [INFO ] [MAIN ] Update Progress: 547/2372 symbols completed. CTEV took 32.7s. Estimated remaining: 4h 0m 27s. Rate: 7.6 symbols/min [2025-09-22T18:12:08.092597] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:12:08.142996] [DEBUG] [LOCAL ] CTRE: Loaded 49948 existing records from primary storage. [2025-09-22T18:12:08.143150] [INFO ] [MAIN ] CTRE: Loaded 49948 existing records. [2025-09-22T18:12:08.317932] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:12:08.318189] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-22T18:12:08.318245] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-22T18:12:08.320349] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-22T18:12:08.320411] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-22T18:12:08.527140] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-22T18:12:08.675919] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:12:09.110147] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T18:12:09.322071] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-22T18:12:10.127581] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-22T18:12:10.139769] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T18:12:10.922063] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-22T18:12:11.340681] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T18:12:11.722074] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-22T18:12:11.757856] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T18:12:12.522118] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-22T18:12:12.635534] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T18:12:12.787987] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T18:12:13.322068] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-22T18:12:14.122083] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-22T18:12:14.151421] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T18:12:14.922074] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-22T18:12:15.069446] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T18:12:15.137765] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T18:12:15.722073] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-22T18:12:16.159809] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T18:12:16.522071] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-22T18:12:17.234678] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T18:12:17.322042] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-22T18:12:17.953876] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T18:12:18.122075] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-22T18:12:18.922061] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-22T18:12:19.722060] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-22T18:12:20.242595] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-22T18:12:20.432335] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-22T18:12:20.522077] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-22T18:12:20.740383] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T18:12:21.077755] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T18:12:21.322062] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-22T18:12:22.122087] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-22T18:12:22.535469] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-22T18:12:22.577505] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T18:12:22.583886] [INFO ] [REMOTE ] CTOS: Full fetch complete (53345 records). [2025-09-22T18:12:22.584175] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-22T18:12:22.927267] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-22T18:12:22.992308] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-22T18:12:22.992399] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-22T18:12:22.993121] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-22T18:12:22.993186] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-22T18:12:22.994371] [DEBUG] [LOCAL ] CTOS: Trimmed 53345 records to 36886 (keeping 200 days of data) [2025-09-22T18:12:23.213625] [DEBUG] [LOCAL ] CTOS: Primary data saved (36886 records). [2025-09-22T18:12:23.213814] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-22T18:12:23.213898] [INFO ] [MAIN ] Update Progress: 548/2372 symbols completed. CTOS took 24.3s. Estimated remaining: 4h 0m 44s. Rate: 7.6 symbols/min [2025-09-22T18:12:23.389490] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:12:23.428994] [DEBUG] [LOCAL ] CTRI: Loaded 38053 existing records from primary storage. [2025-09-22T18:12:23.429146] [INFO ] [MAIN ] CTRI: Loaded 38053 existing records. [2025-09-22T18:12:23.614794] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:12:23.615075] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-22T18:12:23.615139] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-22T18:12:23.616364] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-22T18:12:23.616425] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-22T18:12:23.722956] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-22T18:12:24.007822] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:12:24.028341] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T18:12:24.067716] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T18:12:24.522064] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-22T18:12:25.327259] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-22T18:12:25.350889] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T18:12:25.559201] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T18:12:26.122072] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-22T18:12:26.927162] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-22T18:12:26.941009] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-22T18:12:27.132289] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T18:12:27.722054] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-22T18:12:28.522047] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-22T18:12:28.955518] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-22T18:12:29.126598] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T18:12:29.322098] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-22T18:12:30.123001] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-22T18:12:30.126316] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T18:12:30.922069] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-22T18:12:31.223607] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T18:12:31.586525] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T18:12:31.722078] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-22T18:12:32.511299] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T18:12:32.522067] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-22T18:12:33.322078] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-22T18:12:33.615598] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T18:12:33.954366] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T18:12:34.122071] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-22T18:12:34.706796] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T18:12:34.922111] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-22T18:12:35.170697] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T18:12:35.175685] [INFO ] [REMOTE ] CTO: Full fetch complete (41643 records). [2025-09-22T18:12:35.175851] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-22T18:12:35.176612] [FATAL] [VALIDATOR ] CTO: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:12:35.176733] [FATAL] [MAIN ] CTO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:12:35.176778] [WARN ] [MAIN ] CTO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:12:35.176818] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-22T18:12:35.176890] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-09-22T18:12:35.176947] [INFO ] [LOCAL ] CTO: Starting deletion of derivative data. [2025-09-22T18:12:35.177553] [DEBUG] [LOCAL ] CTO: Deleted derivative data file. [2025-09-22T18:12:35.177682] [INFO ] [MAIN ] Update Progress: 549/2372 symbols completed. CTO took 37.3s. Estimated remaining: 4h 0m 49s. Rate: 7.6 symbols/min [2025-09-22T18:12:35.354012] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:12:35.376320] [DEBUG] [LOCAL ] CTS: Loaded 19657 existing records from primary storage. [2025-09-22T18:12:35.376448] [INFO ] [MAIN ] CTS: Loaded 19657 existing records. [2025-09-22T18:12:35.561495] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:12:35.561794] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-22T18:12:35.561848] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-22T18:12:35.562504] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-22T18:12:35.562569] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-22T18:12:35.722993] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-22T18:12:35.935333] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:12:36.522074] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-22T18:12:36.837660] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T18:12:37.322033] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-22T18:12:37.516459] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T18:12:37.796451] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-22T18:12:37.808176] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-09-22T18:12:37.808350] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-22T18:12:38.127260] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-22T18:12:38.254073] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-22T18:12:38.254221] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-22T18:12:38.255335] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-22T18:12:38.255604] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-22T18:12:38.257352] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 53649 (keeping 200 days of data) [2025-09-22T18:12:38.626869] [DEBUG] [LOCAL ] CTRA: Primary data saved (53649 records). [2025-09-22T18:12:38.627190] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-22T18:12:38.627490] [INFO ] [MAIN ] Update Progress: 550/2372 symbols completed. CTRA took 36.9s. Estimated remaining: 4h 0m 26s. Rate: 7.6 symbols/min [2025-09-22T18:12:38.805978] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:12:38.806219] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-09-22T18:12:38.806288] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-09-22T18:12:38.806452] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-22T18:12:38.806497] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-22T18:12:38.806539] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-09-22T18:12:38.806581] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-22T18:12:38.927313] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-22T18:12:39.180725] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:12:39.204464] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T18:12:39.213836] [INFO ] [REMOTE ] CTRE: Full fetch complete (71083 records). [2025-09-22T18:12:39.214059] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-22T18:12:39.622792] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-22T18:12:39.622975] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-22T18:12:39.625548] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-22T18:12:39.625680] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-22T18:12:39.628009] [DEBUG] [LOCAL ] CTRE: Trimmed 71083 records to 49213 (keeping 200 days of data) [2025-09-22T18:12:39.744712] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-22T18:12:39.746200] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T18:12:39.966426] [DEBUG] [LOCAL ] CTRE: Primary data saved (49213 records). [2025-09-22T18:12:39.966595] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-22T18:12:39.966741] [INFO ] [MAIN ] Update Progress: 551/2372 symbols completed. CTRE took 32.0s. Estimated remaining: 3h 59m 57s. Rate: 7.6 symbols/min [2025-09-22T18:12:40.146795] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:12:40.147197] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-22T18:12:40.147258] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-22T18:12:40.147408] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-22T18:12:40.147452] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-22T18:12:40.147494] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-22T18:12:40.147527] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-22T18:12:40.474456] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T18:12:40.529076] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-22T18:12:40.560572] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:12:41.322060] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-22T18:12:41.589378] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T18:12:41.932432] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T18:12:42.122066] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-22T18:12:42.214016] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T18:12:42.922123] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-22T18:12:43.626799] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T18:12:43.722012] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-22T18:12:43.745124] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T18:12:44.522091] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-22T18:12:45.281899] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T18:12:45.322037] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-22T18:12:45.688531] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-22T18:12:46.033255] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T18:12:46.122022] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-22T18:12:46.436133] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-22T18:12:46.922097] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-22T18:12:47.722068] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-22T18:12:47.951401] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T18:12:48.522101] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-22T18:12:49.301898] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T18:12:49.309590] [INFO ] [REMOTE ] CTRI: Full fetch complete (50754 records). [2025-09-22T18:12:49.309716] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-22T18:12:49.331556] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-22T18:12:49.710209] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-22T18:12:49.710369] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-22T18:12:49.711102] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-22T18:12:49.711185] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-22T18:12:49.730864] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T18:12:49.730077] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-22T18:12:49.732323] [DEBUG] [LOCAL ] CTRI: Trimmed 50754 records to 37728 (keeping 200 days of data) [2025-09-22T18:12:49.967604] [DEBUG] [LOCAL ] CTRI: Primary data saved (37728 records). [2025-09-22T18:12:49.967814] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-22T18:12:49.968019] [INFO ] [MAIN ] Update Progress: 552/2372 symbols completed. CTRI took 26.8s. Estimated remaining: 3h 59m 56s. Rate: 7.6 symbols/min [2025-09-22T18:12:50.130594] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-22T18:12:50.153829] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:12:50.213819] [DEBUG] [LOCAL ] CUBE: Loaded 51502 existing records from primary storage. [2025-09-22T18:12:50.213974] [INFO ] [MAIN ] CUBE: Loaded 51502 existing records. [2025-09-22T18:12:50.398123] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:12:50.398390] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-22T18:12:50.398458] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-22T18:12:50.399684] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-22T18:12:50.399758] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-22T18:12:50.765694] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:12:50.922051] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-22T18:12:51.714358] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T18:12:51.723846] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-22T18:12:52.522056] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-22T18:12:52.547169] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T18:12:52.733401] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T18:12:52.856479] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-22T18:12:53.322060] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-22T18:12:53.660683] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-22T18:12:54.122092] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-22T18:12:54.922100] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-22T18:12:55.715516] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T18:12:55.722008] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-22T18:12:55.936475] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T18:12:56.493571] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T18:12:56.522063] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-22T18:12:57.322076] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-22T18:12:57.543374] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T18:12:58.122077] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-22T18:12:58.505862] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-22T18:12:58.922091] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-22T18:12:59.105511] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T18:12:59.148469] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-22T18:12:59.722107] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-22T18:13:00.075751] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-22T18:13:00.522073] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-22T18:13:01.322045] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-22T18:13:01.661856] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T18:13:01.666559] [INFO ] [REMOTE ] CTS: Full fetch complete (26507 records). [2025-09-22T18:13:01.666744] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-22T18:13:02.119020] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-22T18:13:02.119121] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-22T18:13:02.119620] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-22T18:13:02.119700] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-22T18:13:02.120528] [DEBUG] [LOCAL ] CTS: Trimmed 26507 records to 19390 (keeping 200 days of data) [2025-09-22T18:13:02.122061] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-22T18:13:02.251919] [DEBUG] [LOCAL ] CTS: Primary data saved (19390 records). [2025-09-22T18:13:02.252069] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-22T18:13:02.252241] [INFO ] [MAIN ] Update Progress: 553/2372 symbols completed. CTS took 27.1s. Estimated remaining: 4h 0m 2s. Rate: 7.6 symbols/min [2025-09-22T18:13:02.406494] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-22T18:13:02.434101] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:13:02.461947] [DEBUG] [LOCAL ] CUBI: Loaded 27721 existing records from primary storage. [2025-09-22T18:13:02.462083] [INFO ] [MAIN ] CUBI: Loaded 27721 existing records. [2025-09-22T18:13:02.651262] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:13:02.651552] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-22T18:13:02.651604] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-22T18:13:02.652478] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-22T18:13:02.652542] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-22T18:13:02.928903] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-22T18:13:03.028019] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:13:03.084269] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T18:13:03.457476] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-22T18:13:03.458257] [INFO ] [REMOTE ] CUBB: Full fetch complete (926 records). [2025-09-22T18:13:03.458338] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-22T18:13:03.458723] [FATAL] [VALIDATOR ] CUBB: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:13:03.458805] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:13:03.458846] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:13:03.458908] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-22T18:13:03.458970] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-22T18:13:03.459004] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-22T18:13:03.459058] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-22T18:13:03.459134] [INFO ] [MAIN ] Update Progress: 554/2372 symbols completed. CUBB took 23.5s. Estimated remaining: 3h 59m 32s. Rate: 7.6 symbols/min [2025-09-22T18:13:03.636501] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:13:03.705952] [DEBUG] [LOCAL ] CUK: Loaded 51795 existing records from primary storage. [2025-09-22T18:13:03.706095] [INFO ] [MAIN ] CUK: Loaded 51795 existing records. [2025-09-22T18:13:03.727224] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-22T18:13:03.889374] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:13:03.889842] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-22T18:13:03.889898] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-22T18:13:03.891433] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-22T18:13:03.891495] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-22T18:13:04.244245] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:13:04.522142] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-22T18:13:05.248307] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T18:13:05.322067] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-22T18:13:05.801940] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-22T18:13:06.122054] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-22T18:13:06.922062] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-22T18:13:07.040518] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T18:13:07.467279] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:13:07.722110] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-22T18:13:08.303753] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T18:13:08.522103] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-22T18:13:09.215295] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T18:13:09.322160] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-22T18:13:09.690220] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T18:13:10.122114] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-22T18:13:10.885625] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T18:13:10.922036] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-22T18:13:11.336507] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T18:13:11.722057] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-22T18:13:12.522086] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-22T18:13:12.760392] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T18:13:13.322051] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-22T18:13:13.572246] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T18:13:14.122037] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-22T18:13:14.150800] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T18:13:14.319907] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T18:13:14.922091] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-22T18:13:15.722066] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-22T18:13:16.022612] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T18:13:16.522070] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-22T18:13:16.868283] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-22T18:13:16.876096] [INFO ] [REMOTE ] CTVA: Full fetch complete (76543 records). [2025-09-22T18:13:16.876218] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-22T18:13:16.876990] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:13:16.877079] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:13:16.877143] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:13:16.877215] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-22T18:13:16.877299] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-09-22T18:13:16.877356] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-09-22T18:13:16.877400] [DEBUG] [LOCAL ] CTVA: No derivative data file found to delete. [2025-09-22T18:13:16.877460] [INFO ] [MAIN ] Update Progress: 555/2372 symbols completed. CTVA took 38.2s. Estimated remaining: 3h 59m 42s. Rate: 7.6 symbols/min [2025-09-22T18:13:17.063401] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:13:17.068511] [DEBUG] [LOCAL ] CULP: Loaded 3165 existing records from primary storage. [2025-09-22T18:13:17.068596] [INFO ] [MAIN ] CULP: Loaded 3165 existing records. [2025-09-22T18:13:17.257070] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:13:17.257420] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-22T18:13:17.257589] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-22T18:13:17.257944] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-22T18:13:17.258106] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-22T18:13:17.327625] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-22T18:13:17.406930] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T18:13:17.649148] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:13:18.122146] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-22T18:13:18.565868] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-22T18:13:18.762567] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T18:13:18.922026] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-22T18:13:19.222032] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T18:13:19.722170] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-22T18:13:20.383208] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-22T18:13:20.528433] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-22T18:13:20.534257] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T18:13:21.322050] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-22T18:13:21.886692] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-22T18:13:22.122051] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-22T18:13:22.922086] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-22T18:13:23.001303] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T18:13:23.185069] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T18:13:23.570050] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T18:13:23.722055] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-22T18:13:24.522062] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-22T18:13:25.322060] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-22T18:13:25.653277] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T18:13:25.709833] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T18:13:25.714966] [INFO ] [REMOTE ] CUBI: Full fetch complete (39211 records). [2025-09-22T18:13:25.715056] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-22T18:13:25.964252] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T18:13:26.120595] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-22T18:13:26.120726] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-22T18:13:26.121362] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-22T18:13:26.121421] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-22T18:13:26.122148] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-22T18:13:26.123954] [DEBUG] [LOCAL ] CUBI: Trimmed 39211 records to 27251 (keeping 200 days of data) [2025-09-22T18:13:26.286833] [DEBUG] [LOCAL ] CUBI: Primary data saved (27251 records). [2025-09-22T18:13:26.286969] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-22T18:13:26.287055] [INFO ] [MAIN ] Update Progress: 556/2372 symbols completed. CUBI took 24.0s. Estimated remaining: 3h 59m 39s. Rate: 7.6 symbols/min [2025-09-22T18:13:26.472140] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:13:26.511759] [DEBUG] [LOCAL ] CURB: Loaded 33552 existing records from primary storage. [2025-09-22T18:13:26.511927] [INFO ] [MAIN ] CURB: Loaded 33552 existing records. [2025-09-22T18:13:26.697706] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:13:26.697969] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-22T18:13:26.698019] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-22T18:13:26.699693] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-22T18:13:26.699778] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-22T18:13:26.814097] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-22T18:13:26.928633] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-22T18:13:27.088631] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:13:27.722055] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-22T18:13:28.442268] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T18:13:28.522056] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-22T18:13:29.157953] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T18:13:29.322054] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-22T18:13:30.122021] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-22T18:13:30.268729] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T18:13:30.583108] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T18:13:30.594633] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T18:13:30.922077] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-22T18:13:31.722058] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-22T18:13:32.196334] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T18:13:32.522064] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-22T18:13:32.745816] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T18:13:33.322077] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-22T18:13:33.720622] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T18:13:33.794913] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-22T18:13:34.122104] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-22T18:13:34.922079] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-22T18:13:35.722087] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-22T18:13:36.091819] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-22T18:13:36.273024] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-22T18:13:36.522141] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-22T18:13:36.672281] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T18:13:37.322122] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-22T18:13:37.766204] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T18:13:37.995129] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T18:13:38.122056] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-22T18:13:38.922127] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-22T18:13:39.632803] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T18:13:39.722128] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-22T18:13:40.522082] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-22T18:13:40.769591] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T18:13:40.777588] [INFO ] [REMOTE ] CUK: Full fetch complete (73679 records). [2025-09-22T18:13:40.777745] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-22T18:13:41.229359] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-22T18:13:41.229602] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-22T18:13:41.230784] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-22T18:13:41.230876] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-22T18:13:41.233071] [DEBUG] [LOCAL ] CUK: Trimmed 73679 records to 51015 (keeping 200 days of data) [2025-09-22T18:13:41.326718] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-22T18:13:41.364097] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T18:13:41.585332] [DEBUG] [LOCAL ] CUK: Primary data saved (51015 records). [2025-09-22T18:13:41.585483] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-22T18:13:41.585572] [INFO ] [MAIN ] Update Progress: 557/2372 symbols completed. CUK took 38.1s. Estimated remaining: 3h 59m 55s. Rate: 7.6 symbols/min [2025-09-22T18:13:41.819429] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T18:13:42.049308] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-22T18:13:42.050440] [INFO ] [REMOTE ] CULP: Full fetch complete (4764 records). [2025-09-22T18:13:42.050509] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-22T18:13:42.127325] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-22T18:13:42.416578] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-22T18:13:42.416683] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-22T18:13:42.416853] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-22T18:13:42.416893] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-22T18:13:42.417258] [DEBUG] [LOCAL ] CULP: Trimmed 4764 records to 3114 (keeping 200 days of data) [2025-09-22T18:13:42.434363] [DEBUG] [LOCAL ] CULP: Primary data saved (3114 records). [2025-09-22T18:13:42.434438] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-22T18:13:42.434514] [INFO ] [MAIN ] Update Progress: 558/2372 symbols completed. CULP took 25.6s. Estimated remaining: 3h 59m 24s. Rate: 7.6 symbols/min [2025-09-22T18:13:42.922061] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-22T18:13:43.733496] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T18:13:43.743098] [INFO ] [REMOTE ] CUBE: Full fetch complete (72987 records). [2025-09-22T18:13:43.743230] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-22T18:13:44.131727] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-22T18:13:44.131851] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-22T18:13:44.132727] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-22T18:13:44.132791] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-22T18:13:44.134207] [DEBUG] [LOCAL ] CUBE: Trimmed 72987 records to 50744 (keeping 200 days of data) [2025-09-22T18:13:44.268483] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:13:44.279994] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-22T18:13:44.477295] [DEBUG] [LOCAL ] CUBE: Primary data saved (50744 records). [2025-09-22T18:13:44.477458] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-22T18:13:44.477547] [INFO ] [MAIN ] Update Progress: 559/2372 symbols completed. CUBE took 54.5s. Estimated remaining: 3h 58m 57s. Rate: 7.6 symbols/min [2025-09-22T18:13:45.728826] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T18:13:45.736449] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-22T18:13:47.228015] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T18:13:47.235885] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-22T18:13:48.205059] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T18:13:48.210938] [INFO ] [REMOTE ] CURB: Full fetch complete (47202 records). [2025-09-22T18:13:48.211060] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-22T18:13:48.584961] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-22T18:13:48.585039] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-22T18:13:48.585623] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-22T18:13:48.585697] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-22T18:13:48.586743] [DEBUG] [LOCAL ] CURB: Trimmed 47202 records to 32976 (keeping 200 days of data) [2025-09-22T18:13:48.787415] [DEBUG] [LOCAL ] CURB: Primary data saved (32976 records). [2025-09-22T18:13:48.787552] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-22T18:13:48.787632] [INFO ] [MAIN ] Update Progress: 560/2372 symbols completed. CURB took 22.5s. Estimated remaining: 3h 58m 38s. Rate: 7.6 symbols/min [2025-09-22T18:13:49.402271] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:13:49.507972] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:13:49.559121] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:13:49.558140] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:13:49.578075] [DEBUG] [LOCAL ] CVEO: Loaded 15767 existing records from primary storage. [2025-09-22T18:13:49.578278] [INFO ] [MAIN ] CVEO: Loaded 15767 existing records. [2025-09-22T18:13:49.739956] [DEBUG] [LOCAL ] CURV: Loaded 27076 existing records from primary storage. [2025-09-22T18:13:49.764941] [INFO ] [MAIN ] CURV: Loaded 27076 existing records. [2025-09-22T18:13:49.867366] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:13:49.926464] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-22T18:13:49.941841] [DEBUG] [LOCAL ] CVE: Loaded 54337 existing records from primary storage. [2025-09-22T18:13:49.955703] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-22T18:13:49.956140] [INFO ] [MAIN ] CVE: Loaded 54337 existing records. [2025-09-22T18:13:49.962086] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-22T18:13:49.956878] [DEBUG] [LOCAL ] CUZ: Loaded 50074 existing records from primary storage. [2025-09-22T18:13:49.967854] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-22T18:13:49.979420] [INFO ] [MAIN ] CUZ: Loaded 50074 existing records. [2025-09-22T18:13:50.309240] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:13:50.354916] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-22T18:13:50.360689] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-22T18:13:50.479390] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-22T18:13:50.493830] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-22T18:13:50.723185] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:13:50.692711] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:13:50.758537] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-22T18:13:50.802311] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-22T18:13:50.793865] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-22T18:13:50.816344] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-22T18:13:50.827193] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-22T18:13:50.832946] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-22T18:13:50.832890] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-22T18:13:50.848625] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-22T18:13:51.241759] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:13:51.276341] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-22T18:13:51.595735] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:13:51.601298] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-22T18:13:51.852163] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:13:51.863511] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-22T18:13:51.931838] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:13:51.932139] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-22T18:13:52.083122] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-22T18:13:52.086040] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-22T18:13:52.806997] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T18:13:52.816329] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-22T18:13:52.862406] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T18:13:52.864737] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-22T18:13:53.321620] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T18:13:53.332759] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-22T18:13:53.615421] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T18:13:53.616710] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T18:13:53.632269] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-22T18:13:53.631890] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-22T18:13:53.695488] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T18:13:54.122086] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-22T18:13:54.322049] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T18:13:54.927157] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-22T18:13:54.943239] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T18:13:55.170672] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T18:13:55.326635] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T18:13:55.722063] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-22T18:13:55.945052] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-22T18:13:56.319518] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-22T18:13:56.522097] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-22T18:13:57.322072] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-22T18:13:57.652128] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T18:13:58.122083] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-22T18:13:58.798739] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T18:13:58.831390] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T18:13:58.922018] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-22T18:13:59.722132] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-22T18:14:00.314838] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T18:14:00.522055] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-22T18:14:00.874320] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T18:14:01.322059] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-22T18:14:01.645143] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T18:14:02.016713] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T18:14:02.122132] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-22T18:14:02.922111] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-22T18:14:03.722029] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-22T18:14:03.901533] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-22T18:14:04.016692] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T18:14:04.522119] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-22T18:14:05.322037] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-22T18:14:05.429444] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T18:14:05.865543] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T18:14:06.122066] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-22T18:14:06.256533] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T18:14:06.259132] [INFO ] [REMOTE ] CVEO: Full fetch complete (20169 records). [2025-09-22T18:14:06.259210] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-22T18:14:06.629111] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-22T18:14:06.629254] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-22T18:14:06.629707] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-22T18:14:06.629768] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-22T18:14:06.630432] [DEBUG] [LOCAL ] CVEO: Trimmed 20169 records to 15262 (keeping 200 days of data) [2025-09-22T18:14:06.717849] [DEBUG] [LOCAL ] CVEO: Primary data saved (15262 records). [2025-09-22T18:14:06.717995] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-22T18:14:06.718095] [INFO ] [MAIN ] Update Progress: 561/2372 symbols completed. CVEO took 17.9s. Estimated remaining: 3h 59m 2s. Rate: 7.6 symbols/min [2025-09-22T18:14:06.888776] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:14:06.922085] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-22T18:14:06.940830] [DEBUG] [LOCAL ] CVI: Loaded 47141 existing records from primary storage. [2025-09-22T18:14:06.940966] [INFO ] [MAIN ] CVI: Loaded 47141 existing records. [2025-09-22T18:14:07.120607] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:14:07.120872] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-22T18:14:07.120918] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-22T18:14:07.122694] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-22T18:14:07.122757] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-22T18:14:07.488098] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:14:07.507843] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T18:14:07.722006] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-22T18:14:08.522120] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-22T18:14:08.681504] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T18:14:09.310452] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T18:14:09.322006] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-22T18:14:10.122052] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-22T18:14:10.367207] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T18:14:10.681048] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T18:14:10.922121] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-22T18:14:11.440297] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T18:14:11.722115] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-22T18:14:12.011875] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T18:14:12.522060] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-22T18:14:13.322065] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-22T18:14:13.624130] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T18:14:13.798005] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T18:14:14.122073] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-22T18:14:14.636070] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T18:14:14.922059] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-22T18:14:15.722091] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-22T18:14:16.121690] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-22T18:14:16.148962] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T18:14:16.154889] [INFO ] [REMOTE ] CURV: Full fetch complete (39660 records). [2025-09-22T18:14:16.155019] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-22T18:14:16.155705] [FATAL] [VALIDATOR ] CURV: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:14:16.155812] [FATAL] [MAIN ] CURV: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:14:16.155889] [WARN ] [MAIN ] CURV: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:14:16.156012] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-22T18:14:16.156097] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-09-22T18:14:16.156135] [INFO ] [LOCAL ] CURV: Starting deletion of derivative data. [2025-09-22T18:14:16.156670] [DEBUG] [LOCAL ] CURV: Deleted derivative data file. [2025-09-22T18:14:16.156771] [INFO ] [MAIN ] Update Progress: 562/2372 symbols completed. CURV took 27.4s. Estimated remaining: 3h 58m 59s. Rate: 7.6 symbols/min [2025-09-22T18:14:16.336634] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:14:16.357831] [DEBUG] [LOCAL ] CVLG: Loaded 15662 existing records from primary storage. [2025-09-22T18:14:16.357976] [INFO ] [MAIN ] CVLG: Loaded 15662 existing records. [2025-09-22T18:14:16.522472] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-22T18:14:16.547790] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:14:16.548087] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-22T18:14:16.548149] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-22T18:14:16.548721] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-22T18:14:16.548783] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-22T18:14:16.915108] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:14:17.322070] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-22T18:14:17.533130] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T18:14:18.122117] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-22T18:14:18.277999] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T18:14:18.922126] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-22T18:14:19.225781] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-22T18:14:19.729757] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-22T18:14:19.753533] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T18:14:19.768555] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T18:14:19.768218] [INFO ] [REMOTE ] CUZ: Full fetch complete (70745 records). [2025-09-22T18:14:19.770453] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-22T18:14:20.171351] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-22T18:14:20.171444] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-22T18:14:20.172258] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-22T18:14:20.172327] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-22T18:14:20.173839] [DEBUG] [LOCAL ] CUZ: Trimmed 70745 records to 49416 (keeping 200 days of data) [2025-09-22T18:14:20.478846] [DEBUG] [LOCAL ] CUZ: Primary data saved (49416 records). [2025-09-22T18:14:20.478977] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-22T18:14:20.479065] [INFO ] [MAIN ] Update Progress: 563/2372 symbols completed. CUZ took 31.7s. Estimated remaining: 3h 58m 40s. Rate: 7.6 symbols/min [2025-09-22T18:14:20.534062] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-22T18:14:20.654148] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:14:20.709504] [DEBUG] [LOCAL ] CVNA: Loaded 53831 existing records from primary storage. [2025-09-22T18:14:20.709671] [INFO ] [MAIN ] CVNA: Loaded 53831 existing records. [2025-09-22T18:14:20.893929] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:14:20.894227] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-22T18:14:20.894296] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-22T18:14:20.895713] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-22T18:14:20.895777] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-22T18:14:21.252800] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:14:21.322005] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-22T18:14:21.647350] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T18:14:22.035122] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T18:14:22.122052] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-22T18:14:22.922075] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-22T18:14:23.312929] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-22T18:14:23.722074] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-22T18:14:23.911759] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T18:14:24.522044] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-22T18:14:24.615132] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T18:14:25.322080] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-22T18:14:25.419722] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T18:14:25.936577] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T18:14:26.122119] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-22T18:14:26.380302] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T18:14:26.389257] [INFO ] [REMOTE ] CVE: Full fetch complete (77538 records). [2025-09-22T18:14:26.389455] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-22T18:14:26.796242] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T18:14:26.822450] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-22T18:14:26.822540] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-22T18:14:26.823501] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-22T18:14:26.823575] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-22T18:14:26.826937] [DEBUG] [LOCAL ] CVE: Trimmed 77538 records to 53557 (keeping 200 days of data) [2025-09-22T18:14:26.926424] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-22T18:14:27.168817] [DEBUG] [LOCAL ] CVE: Primary data saved (53557 records). [2025-09-22T18:14:27.169079] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-22T18:14:27.169178] [INFO ] [MAIN ] Update Progress: 564/2372 symbols completed. CVE took 38.4s. Estimated remaining: 3h 58m 28s. Rate: 7.6 symbols/min [2025-09-22T18:14:27.347454] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:14:27.347673] [DEBUG] [LOCAL ] CVS: No existing data file found in primary storage. [2025-09-22T18:14:27.347731] [WARN ] [MAIN ] CVS: No existing data found, performing full refresh instead. [2025-09-22T18:14:27.347906] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-22T18:14:27.347966] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-22T18:14:27.348039] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-09-22T18:14:27.348077] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-22T18:14:27.711552] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:14:27.722025] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-22T18:14:28.522089] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-22T18:14:28.941958] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-22T18:14:29.322032] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-22T18:14:29.376450] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T18:14:29.729246] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-22T18:14:30.122064] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-22T18:14:30.693575] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T18:14:30.922112] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-22T18:14:31.722078] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-22T18:14:32.088285] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-22T18:14:32.522087] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-22T18:14:32.745753] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T18:14:33.322049] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-22T18:14:33.418941] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T18:14:33.796093] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T18:14:34.122054] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-22T18:14:34.922050] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-22T18:14:35.561329] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-22T18:14:35.625146] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-22T18:14:35.667694] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T18:14:35.722015] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-22T18:14:36.522078] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-22T18:14:37.322075] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-22T18:14:37.707954] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T18:14:38.122059] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-22T18:14:38.782934] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-22T18:14:38.922068] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-22T18:14:39.093808] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T18:14:39.722116] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-22T18:14:40.166921] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-22T18:14:40.522077] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-22T18:14:40.807917] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T18:14:41.211067] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T18:14:41.218699] [INFO ] [REMOTE ] CVI: Full fetch complete (67253 records). [2025-09-22T18:14:41.218860] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-22T18:14:41.327535] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-22T18:14:41.617481] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-22T18:14:41.617570] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-22T18:14:41.618357] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-22T18:14:41.618420] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-22T18:14:41.619789] [DEBUG] [LOCAL ] CVI: Trimmed 67253 records to 46417 (keeping 200 days of data) [2025-09-22T18:14:41.890019] [DEBUG] [LOCAL ] CVI: Primary data saved (46417 records). [2025-09-22T18:14:41.890157] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-22T18:14:41.892492] [INFO ] [MAIN ] Update Progress: 565/2372 symbols completed. CVI took 35.2s. Estimated remaining: 3h 58m 42s. Rate: 7.6 symbols/min [2025-09-22T18:14:42.067631] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:14:42.122163] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-22T18:14:42.142861] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-22T18:14:42.143040] [INFO ] [MAIN ] CVX: Loaded 54540 existing records. [2025-09-22T18:14:42.330442] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:14:42.330945] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-22T18:14:42.331073] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-22T18:14:42.332840] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-22T18:14:42.332906] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-22T18:14:42.532443] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T18:14:42.544028] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T18:14:42.767362] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:14:42.922034] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-22T18:14:43.722105] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-22T18:14:44.307116] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-22T18:14:44.522114] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-22T18:14:45.297092] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-22T18:14:45.322004] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-22T18:14:45.610014] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T18:14:46.122080] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-22T18:14:46.421311] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T18:14:46.922087] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-22T18:14:47.561851] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-22T18:14:47.722050] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-22T18:14:48.149794] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-22T18:14:48.522054] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-22T18:14:48.806940] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T18:14:48.815274] [INFO ] [REMOTE ] CVNA: Full fetch complete (76670 records). [2025-09-22T18:14:48.815443] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-22T18:14:49.235044] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-22T18:14:49.235132] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-22T18:14:49.236108] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-22T18:14:49.236176] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-22T18:14:49.238838] [DEBUG] [LOCAL ] CVNA: Trimmed 76670 records to 53029 (keeping 200 days of data) [2025-09-22T18:14:49.333481] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-22T18:14:49.573562] [DEBUG] [LOCAL ] CVNA: Primary data saved (53029 records). [2025-09-22T18:14:49.573749] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-22T18:14:49.573856] [INFO ] [MAIN ] Update Progress: 566/2372 symbols completed. CVNA took 29.1s. Estimated remaining: 3h 58m 33s. Rate: 7.6 symbols/min [2025-09-22T18:14:49.755572] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:14:49.766727] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-09-22T18:14:49.767143] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-09-22T18:14:49.769257] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T18:14:49.769372] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-22T18:14:49.773485] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-22T18:14:49.774003] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-22T18:14:49.774242] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-22T18:14:50.147275] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:14:50.141604] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-22T18:14:50.177429] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-22T18:14:50.922040] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-22T18:14:50.983208] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T18:14:51.398217] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-22T18:14:51.722057] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-22T18:14:52.522059] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-22T18:14:52.746479] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T18:14:53.183590] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-22T18:14:53.322036] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-22T18:14:54.122092] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-22T18:14:54.607422] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-22T18:14:54.616077] [INFO ] [REMOTE ] CVS: Full fetch complete (77815 records). [2025-09-22T18:14:54.616240] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-22T18:14:54.922900] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-22T18:14:55.030006] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T18:14:55.056914] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-22T18:14:55.057119] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-22T18:14:55.058818] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-22T18:14:55.058924] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-22T18:14:55.057067] [INFO ] [REMOTE ] CVLG: Full fetch complete (20631 records). [2025-09-22T18:14:55.059161] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-22T18:14:55.174829] [DEBUG] [LOCAL ] CVS: Trimmed 77815 records to 53698 (keeping 200 days of data) [2025-09-22T18:14:55.602553] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-22T18:14:55.602764] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-22T18:14:55.603473] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-22T18:14:55.603547] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-22T18:14:55.708862] [DEBUG] [LOCAL ] CVLG: Trimmed 20631 records to 15573 (keeping 200 days of data) [2025-09-22T18:14:55.857919] [DEBUG] [LOCAL ] CVLG: Primary data saved (15573 records). [2025-09-22T18:14:55.863243] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-22T18:14:55.865114] [INFO ] [MAIN ] Update Progress: 567/2372 symbols completed. CVLG took 39.7s. Estimated remaining: 3h 58m 20s. Rate: 7.6 symbols/min [2025-09-22T18:14:56.088203] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-22T18:14:56.169045] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-22T18:14:56.271986] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:14:56.315816] [DEBUG] [LOCAL ] CVS: Primary data saved (53698 records). [2025-09-22T18:14:56.318217] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T18:14:56.318409] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-22T18:14:56.325003] [INFO ] [MAIN ] Update Progress: 568/2372 symbols completed. CVS took 29.2s. Estimated remaining: 3h 57m 48s. Rate: 7.6 symbols/min [2025-09-22T18:14:56.522714] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-22T18:14:56.638320] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:14:56.642677] [DEBUG] [LOCAL ] CWAN: Loaded 53159 existing records from primary storage. [2025-09-22T18:14:56.643789] [INFO ] [MAIN ] CWAN: Loaded 53159 existing records. [2025-09-22T18:14:56.896157] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:14:56.912295] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-22T18:14:56.913504] [DEBUG] [LOCAL ] CWEN: Loaded 45721 existing records from primary storage. [2025-09-22T18:14:56.913695] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-22T18:14:56.913803] [INFO ] [MAIN ] CWEN: Loaded 45721 existing records. [2025-09-22T18:14:56.980772] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-22T18:14:57.004902] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-22T18:14:57.295528] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:14:57.315957] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-22T18:14:57.316917] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-22T18:14:57.324874] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-22T18:14:57.334920] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-22T18:14:57.758436] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:14:57.796435] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-22T18:14:57.922423] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:14:57.939130] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T18:14:58.122117] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-22T18:14:58.424113] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-22T18:14:58.922016] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-22T18:14:59.214545] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T18:14:59.313926] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T18:14:59.722100] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-22T18:15:00.522057] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-22T18:15:01.322186] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-22T18:15:01.503624] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T18:15:01.761105] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-22T18:15:02.122100] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-22T18:15:02.365035] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T18:15:02.922121] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-22T18:15:03.722099] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-22T18:15:05.661086] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (3.54 seconds). [2025-09-22T18:15:05.670356] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-22T18:15:05.708814] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (4.39 seconds). [2025-09-22T18:15:05.719933] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-22T18:15:05.737829] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-22T18:15:06.122061] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-22T18:15:06.591185] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-22T18:15:06.922098] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-22T18:15:07.163064] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T18:15:07.340510] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T18:15:07.432008] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T18:15:07.722148] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-22T18:15:08.522040] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-22T18:15:08.956890] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T18:15:09.322048] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-22T18:15:09.488912] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T18:15:10.122073] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-22T18:15:10.202062] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T18:15:10.922094] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-22T18:15:11.722141] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-22T18:15:11.800033] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T18:15:11.894601] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-22T18:15:11.903004] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-22T18:15:11.903138] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-22T18:15:12.322694] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-22T18:15:12.323066] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-22T18:15:12.324105] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-22T18:15:12.324187] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-22T18:15:12.356717] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-22T18:15:12.355120] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-09-22T18:15:12.562176] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-22T18:15:12.723812] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-22T18:15:12.723953] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-22T18:15:12.725067] [INFO ] [MAIN ] Update Progress: 569/2372 symbols completed. CVX took 30.8s. Estimated remaining: 3h 58m 7s. Rate: 7.6 symbols/min [2025-09-22T18:15:12.904363] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:15:12.968842] [DEBUG] [LOCAL ] CWH: Loaded 52176 existing records from primary storage. [2025-09-22T18:15:12.969002] [INFO ] [MAIN ] CWH: Loaded 52176 existing records. [2025-09-22T18:15:13.151364] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:15:13.152001] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-22T18:15:13.152117] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-22T18:15:13.153271] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-22T18:15:13.153350] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-22T18:15:13.325217] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-22T18:15:13.443988] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T18:15:13.559176] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:15:14.122070] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-22T18:15:14.383144] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T18:15:14.463142] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-22T18:15:14.922046] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-22T18:15:15.722064] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-22T18:15:16.522072] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-22T18:15:16.679690] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-22T18:15:16.833964] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-22T18:15:16.837483] [INFO ] [REMOTE ] CW: Full fetch complete (33574 records). [2025-09-22T18:15:16.837575] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-22T18:15:17.217331] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-22T18:15:17.217418] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-22T18:15:17.217984] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-22T18:15:17.218050] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-22T18:15:17.218957] [DEBUG] [LOCAL ] CW: Trimmed 33574 records to 22575 (keeping 200 days of data) [2025-09-22T18:15:17.334227] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-22T18:15:17.387847] [DEBUG] [LOCAL ] CW: Primary data saved (22575 records). [2025-09-22T18:15:17.387991] [INFO ] [MAIN ] CW: Full history saved. [2025-09-22T18:15:17.388071] [INFO ] [MAIN ] Update Progress: 570/2372 symbols completed. CW took 27.8s. Estimated remaining: 3h 57m 49s. Rate: 7.6 symbols/min [2025-09-22T18:15:17.566200] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:15:17.617171] [DEBUG] [LOCAL ] CWK: Loaded 50153 existing records from primary storage. [2025-09-22T18:15:17.617324] [INFO ] [MAIN ] CWK: Loaded 50153 existing records. [2025-09-22T18:15:17.794948] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:15:17.795219] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-22T18:15:17.795269] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-22T18:15:17.796415] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-22T18:15:17.796476] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-22T18:15:18.160153] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:15:18.160692] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-22T18:15:18.288287] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-22T18:15:18.564571] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-22T18:15:18.605632] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T18:15:18.922074] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-22T18:15:19.519941] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T18:15:19.722101] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-22T18:15:20.144938] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T18:15:20.522064] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-22T18:15:21.101835] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T18:15:21.322049] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-22T18:15:22.122042] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-22T18:15:22.211109] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T18:15:22.922060] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-22T18:15:23.217714] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T18:15:23.713571] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T18:15:23.723678] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-22T18:15:24.507115] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T18:15:24.522004] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-22T18:15:25.322077] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-22T18:15:25.460718] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T18:15:25.836602] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T18:15:26.122087] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-22T18:15:26.678941] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T18:15:26.922040] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-22T18:15:27.722065] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-22T18:15:27.871796] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T18:15:28.522044] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-22T18:15:28.732105] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T18:15:29.192764] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T18:15:29.202689] [INFO ] [REMOTE ] CWAN: Full fetch complete (75105 records). [2025-09-22T18:15:29.202876] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-22T18:15:29.327241] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-22T18:15:29.598312] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-22T18:15:29.598402] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-22T18:15:29.599248] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-22T18:15:29.599315] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-22T18:15:29.600921] [DEBUG] [LOCAL ] CWAN: Trimmed 75105 records to 52393 (keeping 200 days of data) [2025-09-22T18:15:29.913558] [DEBUG] [LOCAL ] CWAN: Primary data saved (52393 records). [2025-09-22T18:15:29.913727] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-22T18:15:29.913827] [INFO ] [MAIN ] Update Progress: 571/2372 symbols completed. CWAN took 34.0s. Estimated remaining: 3h 57m 56s. Rate: 7.6 symbols/min [2025-09-22T18:15:30.100733] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:15:30.122035] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-22T18:15:30.134144] [DEBUG] [LOCAL ] CWT: Loaded 28363 existing records from primary storage. [2025-09-22T18:15:30.134298] [INFO ] [MAIN ] CWT: Loaded 28363 existing records. [2025-09-22T18:15:30.324395] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:15:30.324734] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-22T18:15:30.324793] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-22T18:15:30.325771] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-22T18:15:30.325836] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-22T18:15:30.712198] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:15:30.741798] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-22T18:15:30.816139] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T18:15:30.922019] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-22T18:15:31.585585] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T18:15:31.593298] [INFO ] [REMOTE ] CWEN: Full fetch complete (64366 records). [2025-09-22T18:15:31.593486] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-22T18:15:31.727251] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-22T18:15:32.033751] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-22T18:15:32.033867] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-22T18:15:32.034753] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-22T18:15:32.034823] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-22T18:15:32.036294] [DEBUG] [LOCAL ] CWEN: Trimmed 64366 records to 45071 (keeping 200 days of data) [2025-09-22T18:15:32.315659] [DEBUG] [LOCAL ] CWEN: Primary data saved (45071 records). [2025-09-22T18:15:32.315798] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-22T18:15:32.315902] [INFO ] [MAIN ] Update Progress: 572/2372 symbols completed. CWEN took 36.0s. Estimated remaining: 3h 57m 31s. Rate: 7.6 symbols/min [2025-09-22T18:15:32.492972] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:15:32.522714] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-22T18:15:32.526370] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T18:15:32.585582] [DEBUG] [LOCAL ] CX: Loaded 53611 existing records from primary storage. [2025-09-22T18:15:32.585764] [INFO ] [MAIN ] CX: Loaded 53611 existing records. [2025-09-22T18:15:32.774428] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:15:32.774768] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-22T18:15:32.774836] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-22T18:15:32.776361] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-22T18:15:32.776422] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-22T18:15:33.138360] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:15:33.293874] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T18:15:33.322064] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-22T18:15:33.910110] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T18:15:34.122059] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-22T18:15:34.922060] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-22T18:15:35.113943] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T18:15:35.722089] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-22T18:15:35.975241] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T18:15:36.409517] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T18:15:36.522043] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-22T18:15:37.112850] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T18:15:37.322050] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-22T18:15:38.003894] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T18:15:38.122058] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-22T18:15:38.922059] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-22T18:15:39.155164] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T18:15:39.412366] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T18:15:39.722056] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-22T18:15:40.319209] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T18:15:40.522052] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-22T18:15:41.322065] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-22T18:15:41.487558] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T18:15:41.834663] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T18:15:42.122042] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-22T18:15:42.577793] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-22T18:15:42.922065] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-22T18:15:43.722032] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-22T18:15:43.772245] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T18:15:44.244965] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T18:15:44.522122] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-22T18:15:45.169350] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T18:15:45.177038] [INFO ] [REMOTE ] CWH: Full fetch complete (72692 records). [2025-09-22T18:15:45.177158] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-22T18:15:45.332233] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-22T18:15:45.588998] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-22T18:15:45.589101] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-22T18:15:45.589953] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-22T18:15:45.590029] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-22T18:15:45.591561] [DEBUG] [LOCAL ] CWH: Trimmed 72692 records to 51418 (keeping 200 days of data) [2025-09-22T18:15:45.835721] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-22T18:15:45.941957] [DEBUG] [LOCAL ] CWH: Primary data saved (51418 records). [2025-09-22T18:15:45.942104] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-22T18:15:45.942190] [INFO ] [MAIN ] Update Progress: 573/2372 symbols completed. CWH took 33.2s. Estimated remaining: 3h 57m 41s. Rate: 7.6 symbols/min [2025-09-22T18:15:46.115626] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:15:46.125048] [DEBUG] [LOCAL ] CXE: Loaded 7323 existing records from primary storage. [2025-09-22T18:15:46.125172] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-22T18:15:46.125556] [INFO ] [MAIN ] CXE: Loaded 7323 existing records. [2025-09-22T18:15:46.315777] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:15:46.316097] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-22T18:15:46.316149] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-22T18:15:46.316568] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-22T18:15:46.316629] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-22T18:15:46.681897] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:15:46.922037] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-22T18:15:47.137376] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T18:15:47.722034] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-22T18:15:47.871857] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-22T18:15:48.052387] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T18:15:48.060367] [INFO ] [REMOTE ] CWK: Full fetch complete (70822 records). [2025-09-22T18:15:48.060544] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-22T18:15:48.470284] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-22T18:15:48.470372] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-22T18:15:48.471183] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-22T18:15:48.471248] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-22T18:15:48.472598] [DEBUG] [LOCAL ] CWK: Trimmed 70822 records to 49391 (keeping 200 days of data) [2025-09-22T18:15:48.524468] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-22T18:15:48.773258] [DEBUG] [LOCAL ] CWK: Primary data saved (49391 records). [2025-09-22T18:15:48.773402] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-22T18:15:48.773488] [INFO ] [MAIN ] Update Progress: 574/2372 symbols completed. CWK took 31.4s. Estimated remaining: 3h 57m 17s. Rate: 7.6 symbols/min [2025-09-22T18:15:48.955945] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:15:48.962491] [DEBUG] [LOCAL ] CXH: Loaded 4458 existing records from primary storage. [2025-09-22T18:15:48.962616] [INFO ] [MAIN ] CXH: Loaded 4458 existing records. [2025-09-22T18:15:49.117433] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T18:15:49.208743] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:15:49.209071] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-22T18:15:49.209129] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-22T18:15:49.209419] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-22T18:15:49.209482] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-22T18:15:49.327211] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-22T18:15:49.702356] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:15:49.985871] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T18:15:50.122087] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-22T18:15:50.350125] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T18:15:50.756734] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-22T18:15:50.922055] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-22T18:15:51.722047] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-22T18:15:52.068380] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T18:15:52.522103] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-22T18:15:53.313991] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T18:15:53.322009] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-22T18:15:53.767087] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T18:15:53.914419] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T18:15:54.122062] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-22T18:15:54.775517] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-22T18:15:54.922072] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-22T18:15:55.722053] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-22T18:15:56.177351] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T18:15:56.522087] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-22T18:15:56.710506] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T18:15:57.322063] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-22T18:15:57.701502] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T18:15:58.050006] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T18:15:58.122074] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-22T18:15:58.922056] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-22T18:15:59.022965] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T18:15:59.027939] [INFO ] [REMOTE ] CWT: Full fetch complete (40255 records). [2025-09-22T18:15:59.028105] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-22T18:15:59.434403] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-22T18:15:59.434499] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-22T18:15:59.435135] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-22T18:15:59.435203] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-22T18:15:59.436386] [DEBUG] [LOCAL ] CWT: Trimmed 40255 records to 27803 (keeping 200 days of data) [2025-09-22T18:15:59.604368] [DEBUG] [LOCAL ] CWT: Primary data saved (27803 records). [2025-09-22T18:15:59.604509] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-22T18:15:59.604596] [INFO ] [MAIN ] Update Progress: 575/2372 symbols completed. CWT took 29.7s. Estimated remaining: 3h 57m 18s. Rate: 7.6 symbols/min [2025-09-22T18:15:59.713968] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T18:15:59.724460] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-22T18:15:59.789993] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:15:59.837862] [DEBUG] [LOCAL ] CXM: Loaded 48705 existing records from primary storage. [2025-09-22T18:15:59.838028] [INFO ] [MAIN ] CXM: Loaded 48705 existing records. [2025-09-22T18:16:00.023992] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:16:00.024280] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-22T18:16:00.024331] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-22T18:16:00.025719] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-22T18:16:00.025784] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-22T18:16:00.312997] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T18:16:00.421080] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:16:00.522063] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-22T18:16:01.223991] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-22T18:16:01.322068] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-22T18:16:02.122070] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-22T18:16:02.922083] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-22T18:16:02.990495] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T18:16:03.549142] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-22T18:16:03.722032] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-22T18:16:03.812077] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T18:16:03.819965] [INFO ] [REMOTE ] CX: Full fetch complete (75973 records). [2025-09-22T18:16:03.820088] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-22T18:16:03.821723] [FATAL] [VALIDATOR ] CX: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:16:03.821816] [FATAL] [MAIN ] CX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:16:03.821858] [WARN ] [MAIN ] CX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:16:03.821897] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-22T18:16:03.821955] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-09-22T18:16:03.821989] [INFO ] [LOCAL ] CX: Starting deletion of derivative data. [2025-09-22T18:16:03.822388] [DEBUG] [LOCAL ] CX: Deleted derivative data file. [2025-09-22T18:16:03.822489] [INFO ] [MAIN ] Update Progress: 576/2372 symbols completed. CX took 31.5s. Estimated remaining: 3h 56m 58s. Rate: 7.6 symbols/min [2025-09-22T18:16:03.999105] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:16:04.032432] [DEBUG] [LOCAL ] CXT: Loaded 31548 existing records from primary storage. [2025-09-22T18:16:04.032585] [INFO ] [MAIN ] CXT: Loaded 31548 existing records. [2025-09-22T18:16:04.218772] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:16:04.219200] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-22T18:16:04.219289] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-22T18:16:04.222480] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T18:16:04.223867] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-22T18:16:04.223928] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-22T18:16:04.527167] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-22T18:16:04.586478] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:16:05.322065] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-22T18:16:06.131612] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-22T18:16:06.134598] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T18:16:06.702808] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T18:16:06.770497] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T18:16:06.922098] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-22T18:16:07.544623] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T18:16:07.722074] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-22T18:16:08.522084] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-22T18:16:08.682298] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T18:16:09.322076] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-22T18:16:09.611714] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T18:16:10.040913] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-22T18:16:10.042851] [INFO ] [REMOTE ] CXE: Full fetch complete (11871 records). [2025-09-22T18:16:10.042935] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-22T18:16:10.127234] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-22T18:16:10.446114] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-22T18:16:10.446198] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-22T18:16:10.446577] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-22T18:16:10.446626] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-22T18:16:10.447326] [DEBUG] [LOCAL ] CXE: Trimmed 11871 records to 7246 (keeping 200 days of data) [2025-09-22T18:16:10.494370] [DEBUG] [LOCAL ] CXE: Primary data saved (7246 records). [2025-09-22T18:16:10.494514] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-22T18:16:10.494604] [INFO ] [MAIN ] Update Progress: 577/2372 symbols completed. CXE took 24.6s. Estimated remaining: 3h 56m 47s. Rate: 7.6 symbols/min [2025-09-22T18:16:10.673354] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:16:10.719132] [DEBUG] [LOCAL ] CXW: Loaded 45182 existing records from primary storage. [2025-09-22T18:16:10.719306] [INFO ] [MAIN ] CXW: Loaded 45182 existing records. [2025-09-22T18:16:10.832254] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T18:16:10.924040] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-22T18:16:10.924429] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:16:10.926271] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-22T18:16:10.926352] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-22T18:16:10.927928] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-22T18:16:10.928016] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-22T18:16:11.334236] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:16:11.643584] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T18:16:11.722111] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-22T18:16:12.430309] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T18:16:12.522111] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-22T18:16:13.322101] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-22T18:16:13.952722] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T18:16:14.122061] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-22T18:16:14.922136] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-22T18:16:15.104459] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T18:16:15.726006] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-22T18:16:15.732214] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T18:16:15.858599] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T18:16:16.522059] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-22T18:16:16.552881] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T18:16:17.322056] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-22T18:16:18.122088] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-22T18:16:18.260799] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T18:16:18.457419] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T18:16:18.922062] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-22T18:16:18.966150] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T18:16:18.967608] [INFO ] [REMOTE ] CXH: Full fetch complete (5514 records). [2025-09-22T18:16:18.967702] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-22T18:16:19.333376] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-22T18:16:19.333487] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-22T18:16:19.333688] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-22T18:16:19.333750] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-22T18:16:19.334156] [DEBUG] [LOCAL ] CXH: Trimmed 5514 records to 4404 (keeping 200 days of data) [2025-09-22T18:16:19.359983] [DEBUG] [LOCAL ] CXH: Primary data saved (4404 records). [2025-09-22T18:16:19.360098] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-22T18:16:19.360182] [INFO ] [MAIN ] Update Progress: 578/2372 symbols completed. CXH took 30.6s. Estimated remaining: 3h 56m 42s. Rate: 7.6 symbols/min [2025-09-22T18:16:19.532789] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:16:19.562950] [DEBUG] [LOCAL ] CYD: Loaded 27385 existing records from primary storage. [2025-09-22T18:16:19.563112] [INFO ] [MAIN ] CYD: Loaded 27385 existing records. [2025-09-22T18:16:19.733628] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-22T18:16:19.748418] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:16:19.748695] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-22T18:16:19.748758] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-22T18:16:19.749556] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-22T18:16:19.749623] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-22T18:16:20.139496] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:16:20.340077] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T18:16:20.522150] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-22T18:16:21.322072] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-22T18:16:21.648586] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T18:16:22.122114] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-22T18:16:22.179406] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T18:16:22.735681] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T18:16:22.922120] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-22T18:16:23.010243] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T18:16:23.722072] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-22T18:16:24.297763] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T18:16:24.522061] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-22T18:16:24.589943] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T18:16:25.322084] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-22T18:16:25.823047] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T18:16:26.122044] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-22T18:16:26.156076] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T18:16:26.922063] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-22T18:16:27.644959] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T18:16:27.722090] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-22T18:16:28.288011] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T18:16:28.522057] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-22T18:16:29.322060] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-22T18:16:29.463873] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T18:16:29.581153] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T18:16:30.122060] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-22T18:16:30.922034] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-22T18:16:31.108002] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T18:16:31.712435] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T18:16:31.722401] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-22T18:16:32.349540] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T18:16:32.522056] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-22T18:16:33.093241] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T18:16:33.322059] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-22T18:16:34.122138] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-22T18:16:34.162213] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T18:16:34.918372] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T18:16:34.927295] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-22T18:16:35.484608] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T18:16:35.722055] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-22T18:16:36.211138] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-22T18:16:36.522060] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-22T18:16:37.322050] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-22T18:16:37.411745] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T18:16:37.418328] [INFO ] [REMOTE ] CXW: Full fetch complete (64976 records). [2025-09-22T18:16:37.418452] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-22T18:16:37.817019] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-22T18:16:37.817225] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-22T18:16:37.818179] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-22T18:16:37.818268] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-22T18:16:37.832262] [DEBUG] [LOCAL ] CXW: Trimmed 64976 records to 44413 (keeping 200 days of data) [2025-09-22T18:16:37.842139] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-22T18:16:37.906143] [INFO ] [REMOTE ] CXM: Full fetch complete (69105 records). [2025-09-22T18:16:37.933419] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-22T18:16:38.134632] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-22T18:16:38.456235] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-22T18:16:38.456411] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-22T18:16:38.485427] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-22T18:16:38.486107] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-22T18:16:38.492300] [DEBUG] [LOCAL ] CXM: Trimmed 69105 records to 47973 (keeping 200 days of data) [2025-09-22T18:16:38.571038] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T18:16:38.672843] [DEBUG] [LOCAL ] CXW: Primary data saved (44413 records). [2025-09-22T18:16:38.675747] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-22T18:16:38.676161] [INFO ] [MAIN ] Update Progress: 579/2372 symbols completed. CXW took 28.2s. Estimated remaining: 3h 57m 9s. Rate: 7.6 symbols/min [2025-09-22T18:16:38.913379] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:16:38.922221] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-22T18:16:39.008492] [DEBUG] [LOCAL ] CYH: Loaded 48687 existing records from primary storage. [2025-09-22T18:16:39.009351] [INFO ] [MAIN ] CYH: Loaded 48687 existing records. [2025-09-22T18:16:39.238949] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:16:39.241812] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-22T18:16:39.242231] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-22T18:16:39.243751] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-22T18:16:39.244699] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-22T18:16:39.358128] [DEBUG] [LOCAL ] CXM: Primary data saved (47973 records). [2025-09-22T18:16:39.358304] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-22T18:16:39.358607] [INFO ] [MAIN ] Update Progress: 580/2372 symbols completed. CXM took 39.8s. Estimated remaining: 3h 56m 39s. Rate: 7.6 symbols/min [2025-09-22T18:16:39.644579] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T18:16:39.720022] [INFO ] [REMOTE ] CXT: Full fetch complete (44776 records). [2025-09-22T18:16:39.757362] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-22T18:16:39.757253] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:16:39.855162] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:16:39.866954] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-22T18:16:40.199970] [DEBUG] [LOCAL ] D: Loaded 54427 existing records from primary storage. [2025-09-22T18:16:40.269571] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:16:40.251556] [INFO ] [MAIN ] D: Loaded 54427 existing records. [2025-09-22T18:16:40.286722] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-22T18:16:40.301062] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-22T18:16:40.310903] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-22T18:16:40.316896] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-22T18:16:40.381902] [DEBUG] [LOCAL ] CXT: Trimmed 44776 records to 31010 (keeping 200 days of data) [2025-09-22T18:16:40.543686] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-22T18:16:40.586386] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:16:40.587576] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-22T18:16:40.587942] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-22T18:16:40.589324] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-22T18:16:40.589672] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-22T18:16:41.006680] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:16:41.081913] [DEBUG] [LOCAL ] CXT: Primary data saved (31010 records). [2025-09-22T18:16:41.082126] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-22T18:16:41.082223] [INFO ] [MAIN ] Update Progress: 581/2372 symbols completed. CXT took 37.3s. Estimated remaining: 3h 56m 12s. Rate: 7.6 symbols/min [2025-09-22T18:16:41.260554] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:16:41.275158] [DEBUG] [LOCAL ] DAC: Loaded 12959 existing records from primary storage. [2025-09-22T18:16:41.275285] [INFO ] [MAIN ] DAC: Loaded 12959 existing records. [2025-09-22T18:16:41.332529] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-22T18:16:41.461471] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:16:41.462282] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-22T18:16:41.462413] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-22T18:16:41.463145] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-22T18:16:41.463207] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-22T18:16:41.841914] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:16:41.890437] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T18:16:41.898206] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-22T18:16:42.122050] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-22T18:16:42.922032] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-22T18:16:43.043766] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T18:16:43.410500] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T18:16:43.722055] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-22T18:16:44.266787] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T18:16:44.522084] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-22T18:16:44.729714] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T18:16:45.322056] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-22T18:16:45.697045] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T18:16:46.122055] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-22T18:16:46.922050] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-22T18:16:47.216704] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-22T18:16:47.255072] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T18:16:47.260055] [INFO ] [REMOTE ] CYD: Full fetch complete (31826 records). [2025-09-22T18:16:47.260165] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-22T18:16:47.637945] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-22T18:16:47.638044] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-22T18:16:47.638552] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-22T18:16:47.638621] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-22T18:16:47.649477] [DEBUG] [LOCAL ] CYD: Trimmed 31826 records to 26609 (keeping 200 days of data) [2025-09-22T18:16:47.651549] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T18:16:47.741840] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-22T18:16:47.821816] [DEBUG] [LOCAL ] CYD: Primary data saved (26609 records). [2025-09-22T18:16:47.821970] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-22T18:16:47.822063] [INFO ] [MAIN ] Update Progress: 582/2372 symbols completed. CYD took 28.5s. Estimated remaining: 3h 56m 0s. Rate: 7.6 symbols/min [2025-09-22T18:16:47.994819] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:16:48.047173] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-22T18:16:48.047381] [INFO ] [MAIN ] DAL: Loaded 54533 existing records. [2025-09-22T18:16:48.251595] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:16:48.251899] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-22T18:16:48.251946] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-22T18:16:48.253423] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-22T18:16:48.253484] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-22T18:16:48.530180] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-22T18:16:48.630502] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:16:49.322058] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-22T18:16:49.681805] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-22T18:16:49.888760] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T18:16:50.122051] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-22T18:16:50.922056] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-22T18:16:51.428610] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-22T18:16:51.515497] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-22T18:16:51.722092] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-22T18:16:51.939602] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-22T18:16:52.522061] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-22T18:16:53.322074] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-22T18:16:53.505636] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T18:16:53.843254] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T18:16:54.122049] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-22T18:16:54.233432] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T18:16:54.922069] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-22T18:16:55.273813] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T18:16:55.722074] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-22T18:16:56.522122] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-22T18:16:56.631188] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T18:16:56.679366] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T18:16:57.322066] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-22T18:16:58.122189] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-22T18:16:58.136282] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T18:16:58.177153] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T18:16:58.922102] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-22T18:16:59.722055] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-22T18:16:59.881350] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T18:17:00.522052] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-22T18:17:01.322067] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-22T18:17:01.446802] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T18:17:01.509385] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-22T18:17:01.701638] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T18:17:02.122027] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-22T18:17:02.316838] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T18:17:02.922059] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-22T18:17:03.722319] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-22T18:17:04.381281] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T18:17:04.456331] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-22T18:17:04.539233] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-22T18:17:04.580525] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-22T18:17:05.322072] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-22T18:17:05.960887] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T18:17:05.962988] [INFO ] [REMOTE ] DAC: Full fetch complete (19952 records). [2025-09-22T18:17:05.963063] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-22T18:17:06.123683] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-22T18:17:06.361880] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-22T18:17:06.362064] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-22T18:17:06.362574] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-22T18:17:06.362670] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-22T18:17:06.363756] [DEBUG] [LOCAL ] DAC: Trimmed 19952 records to 12616 (keeping 200 days of data) [2025-09-22T18:17:06.478451] [DEBUG] [LOCAL ] DAC: Primary data saved (12616 records). [2025-09-22T18:17:06.478684] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-22T18:17:06.478852] [INFO ] [MAIN ] Update Progress: 583/2372 symbols completed. DAC took 25.4s. Estimated remaining: 3h 56m 25s. Rate: 7.6 symbols/min [2025-09-22T18:17:06.562883] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-22T18:17:06.681424] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:17:06.738423] [DEBUG] [LOCAL ] DAN: Loaded 49741 existing records from primary storage. [2025-09-22T18:17:06.738619] [INFO ] [MAIN ] DAN: Loaded 49741 existing records. [2025-09-22T18:17:06.920618] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:17:06.920954] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-22T18:17:06.921016] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-22T18:17:06.922062] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-22T18:17:06.924103] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-22T18:17:06.924178] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-22T18:17:07.279467] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:17:07.722070] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-22T18:17:08.240507] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-22T18:17:08.522129] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-22T18:17:08.589862] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T18:17:09.322061] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-22T18:17:09.498301] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T18:17:10.122104] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-22T18:17:10.487299] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T18:17:10.922021] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-22T18:17:11.374637] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-22T18:17:11.722099] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-22T18:17:12.324430] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T18:17:12.386926] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-22T18:17:12.395322] [INFO ] [REMOTE ] D: Full fetch complete (77266 records). [2025-09-22T18:17:12.395530] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-22T18:17:12.396973] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:17:12.397114] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:17:12.397210] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:17:12.397301] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-22T18:17:12.397423] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-09-22T18:17:12.397486] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-09-22T18:17:12.397896] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-09-22T18:17:12.398068] [INFO ] [MAIN ] Update Progress: 584/2372 symbols completed. D took 33.0s. Estimated remaining: 3h 56m 11s. Rate: 7.6 symbols/min [2025-09-22T18:17:12.527201] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-22T18:17:12.583150] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:17:12.607082] [DEBUG] [LOCAL ] DAO: Loaded 21932 existing records from primary storage. [2025-09-22T18:17:12.607224] [INFO ] [MAIN ] DAO: Loaded 21932 existing records. [2025-09-22T18:17:12.800700] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:17:12.801001] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-22T18:17:12.801058] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-22T18:17:12.801721] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-22T18:17:12.801791] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-22T18:17:13.181016] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:17:13.322089] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-22T18:17:13.871246] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-22T18:17:13.944785] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T18:17:14.122032] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-22T18:17:14.737725] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T18:17:14.748271] [INFO ] [REMOTE ] CYH: Full fetch complete (70452 records). [2025-09-22T18:17:14.748449] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-22T18:17:14.922953] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-22T18:17:15.181482] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-22T18:17:15.181571] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-22T18:17:15.182504] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-22T18:17:15.182608] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-22T18:17:15.189145] [DEBUG] [LOCAL ] CYH: Trimmed 70452 records to 47883 (keeping 200 days of data) [2025-09-22T18:17:15.471832] [DEBUG] [LOCAL ] CYH: Primary data saved (47883 records). [2025-09-22T18:17:15.471986] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-22T18:17:15.472105] [INFO ] [MAIN ] Update Progress: 585/2372 symbols completed. CYH took 36.8s. Estimated remaining: 3h 55m 48s. Rate: 7.6 symbols/min [2025-09-22T18:17:15.668418] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:17:15.688400] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T18:17:15.729134] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-22T18:17:15.752988] [DEBUG] [LOCAL ] DAR: Loaded 52611 existing records from primary storage. [2025-09-22T18:17:15.753140] [INFO ] [MAIN ] DAR: Loaded 52611 existing records. [2025-09-22T18:17:15.933795] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:17:15.934044] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-22T18:17:15.934099] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-22T18:17:15.935321] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-22T18:17:15.935391] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-22T18:17:16.291977] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T18:17:16.320661] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:17:16.522008] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-22T18:17:17.322096] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-22T18:17:17.485343] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T18:17:18.122109] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-22T18:17:18.312265] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T18:17:18.922038] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-22T18:17:19.142824] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T18:17:19.332636] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-22T18:17:19.722120] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-22T18:17:20.522101] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-22T18:17:20.598181] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T18:17:21.096394] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T18:17:21.322066] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-22T18:17:22.122110] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-22T18:17:22.278162] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T18:17:22.922031] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-22T18:17:22.923996] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T18:17:23.722059] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-22T18:17:24.290601] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-22T18:17:24.299439] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-22T18:17:24.299635] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-22T18:17:24.527208] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-22T18:17:24.736808] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-22T18:17:24.737070] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-22T18:17:24.738024] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-22T18:17:24.738121] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-22T18:17:24.767506] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-09-22T18:17:24.769749] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T18:17:25.118078] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-22T18:17:25.118223] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-22T18:17:25.118331] [INFO ] [MAIN ] Update Progress: 586/2372 symbols completed. DAL took 37.3s. Estimated remaining: 3h 55m 46s. Rate: 7.6 symbols/min [2025-09-22T18:17:25.309194] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:17:25.322057] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-22T18:17:25.353709] [DEBUG] [LOCAL ] DAVA: Loaded 41022 existing records from primary storage. [2025-09-22T18:17:25.353845] [INFO ] [MAIN ] DAVA: Loaded 41022 existing records. [2025-09-22T18:17:25.541789] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:17:25.542344] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-22T18:17:25.542553] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-22T18:17:25.553839] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-22T18:17:25.571990] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-22T18:17:25.606599] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T18:17:25.933168] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T18:17:25.975268] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:17:26.122024] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-22T18:17:26.922057] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-22T18:17:26.957756] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T18:17:27.412263] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T18:17:27.722065] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-22T18:17:28.491051] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T18:17:28.522056] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-22T18:17:28.568943] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-22T18:17:29.322061] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-22T18:17:29.834608] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T18:17:30.122076] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-22T18:17:30.922065] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-22T18:17:31.051733] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-22T18:17:31.133052] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T18:17:31.722057] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-22T18:17:32.402048] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T18:17:32.522050] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-22T18:17:33.057039] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T18:17:33.322052] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-22T18:17:33.761614] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T18:17:33.769752] [INFO ] [REMOTE ] DAN: Full fetch complete (70888 records). [2025-09-22T18:17:33.769922] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-22T18:17:34.122605] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-22T18:17:34.187217] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-22T18:17:34.187501] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-22T18:17:34.188505] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-22T18:17:34.188683] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-22T18:17:34.190398] [DEBUG] [LOCAL ] DAN: Trimmed 70888 records to 49005 (keeping 200 days of data) [2025-09-22T18:17:34.315120] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T18:17:34.524491] [DEBUG] [LOCAL ] DAN: Primary data saved (49005 records). [2025-09-22T18:17:34.524632] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-22T18:17:34.524781] [INFO ] [MAIN ] Update Progress: 587/2372 symbols completed. DAN took 28.0s. Estimated remaining: 3h 55m 42s. Rate: 7.6 symbols/min [2025-09-22T18:17:34.694533] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:17:34.750017] [DEBUG] [LOCAL ] DAY: Loaded 50756 existing records from primary storage. [2025-09-22T18:17:34.750194] [INFO ] [MAIN ] DAY: Loaded 50756 existing records. [2025-09-22T18:17:34.928534] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-22T18:17:34.934503] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:17:34.935589] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-22T18:17:34.935664] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-22T18:17:34.936822] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-22T18:17:34.936881] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-22T18:17:35.302182] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:17:35.466215] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T18:17:35.722043] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-22T18:17:36.522054] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-22T18:17:36.631008] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-22T18:17:36.719476] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T18:17:37.322061] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-22T18:17:37.858795] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T18:17:38.122022] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-22T18:17:38.454845] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T18:17:38.922056] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-22T18:17:39.700402] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T18:17:39.722011] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-22T18:17:40.523771] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-22T18:17:40.529449] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T18:17:41.322056] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-22T18:17:41.421474] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T18:17:42.129847] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-22T18:17:42.134722] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T18:17:42.922055] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-22T18:17:43.082699] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T18:17:43.090941] [INFO ] [REMOTE ] DAR: Full fetch complete (74561 records). [2025-09-22T18:17:43.091075] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-22T18:17:43.485200] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-22T18:17:43.485296] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-22T18:17:43.486144] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-22T18:17:43.486213] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-22T18:17:43.487767] [DEBUG] [LOCAL ] DAR: Trimmed 74561 records to 51861 (keeping 200 days of data) [2025-09-22T18:17:43.722269] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-22T18:17:43.801112] [DEBUG] [LOCAL ] DAR: Primary data saved (51861 records). [2025-09-22T18:17:43.801257] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-22T18:17:43.801344] [INFO ] [MAIN ] Update Progress: 588/2372 symbols completed. DAR took 28.3s. Estimated remaining: 3h 55m 38s. Rate: 7.6 symbols/min [2025-09-22T18:17:43.975024] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:17:44.019180] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T18:17:44.021414] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T18:17:44.083146] [DEBUG] [LOCAL ] DB: Loaded 53423 existing records from primary storage. [2025-09-22T18:17:44.083295] [INFO ] [MAIN ] DB: Loaded 53423 existing records. [2025-09-22T18:17:44.268233] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:17:44.268501] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-22T18:17:44.268567] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-22T18:17:44.270090] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-22T18:17:44.270154] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-22T18:17:44.528797] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-22T18:17:44.656476] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:17:44.900388] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T18:17:45.322055] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-22T18:17:46.122065] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-22T18:17:46.296346] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T18:17:46.922065] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-22T18:17:47.013029] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T18:17:47.114815] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-22T18:17:47.118923] [INFO ] [REMOTE ] DAO: Full fetch complete (32558 records). [2025-09-22T18:17:47.119037] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-22T18:17:47.515851] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-22T18:17:47.515970] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-22T18:17:47.516728] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-22T18:17:47.516813] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-22T18:17:47.518159] [DEBUG] [LOCAL ] DAO: Trimmed 32558 records to 21421 (keeping 200 days of data) [2025-09-22T18:17:47.663257] [DEBUG] [LOCAL ] DAO: Primary data saved (21421 records). [2025-09-22T18:17:47.663473] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-22T18:17:47.663592] [INFO ] [MAIN ] Update Progress: 589/2372 symbols completed. DAO took 35.3s. Estimated remaining: 3h 55m 18s. Rate: 7.6 symbols/min [2025-09-22T18:17:47.734261] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-22T18:17:47.856146] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:17:47.856559] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-22T18:17:47.856617] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-22T18:17:47.856819] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-22T18:17:47.856864] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-22T18:17:47.856904] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-22T18:17:47.856938] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-22T18:17:48.240248] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:17:48.386734] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T18:17:48.522042] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-22T18:17:49.322111] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-22T18:17:49.567523] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T18:17:50.122050] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-22T18:17:50.149831] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T18:17:50.922031] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-22T18:17:50.984165] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T18:17:51.449834] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T18:17:51.722058] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-22T18:17:52.522114] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-22T18:17:52.594724] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T18:17:52.936881] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T18:17:53.188927] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T18:17:53.322074] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-22T18:17:54.122075] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-22T18:17:54.922084] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-22T18:17:55.079047] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T18:17:55.722040] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-22T18:17:56.163960] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T18:17:56.206680] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-22T18:17:56.522115] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-22T18:17:57.296770] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-22T18:17:57.322096] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-22T18:17:57.558980] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T18:17:57.569922] [INFO ] [REMOTE ] DAY: Full fetch complete (71752 records). [2025-09-22T18:17:57.570102] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-22T18:17:58.122477] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-22T18:17:58.187590] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-22T18:17:58.187841] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-22T18:17:58.188950] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-22T18:17:58.189034] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-22T18:17:58.190787] [DEBUG] [LOCAL ] DAY: Trimmed 71752 records to 49932 (keeping 200 days of data) [2025-09-22T18:17:58.526444] [DEBUG] [LOCAL ] DAY: Primary data saved (49932 records). [2025-09-22T18:17:58.526609] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-22T18:17:58.526726] [INFO ] [MAIN ] Update Progress: 590/2372 symbols completed. DAY took 24.0s. Estimated remaining: 3h 55m 19s. Rate: 7.6 symbols/min [2025-09-22T18:17:58.702764] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:17:58.744594] [DEBUG] [LOCAL ] DBI: Loaded 45867 existing records from primary storage. [2025-09-22T18:17:58.744955] [INFO ] [MAIN ] DBI: Loaded 45867 existing records. [2025-09-22T18:17:58.925092] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-22T18:17:58.925321] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:17:58.927080] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-22T18:17:58.927150] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-22T18:17:58.928239] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-22T18:17:58.928304] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-22T18:17:59.295052] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:17:59.393837] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-22T18:17:59.722059] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-22T18:17:59.771255] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T18:17:59.859862] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-22T18:18:00.522052] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-22T18:18:01.322107] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-22T18:18:01.783700] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-22T18:18:02.122096] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-22T18:18:02.747490] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-22T18:18:02.755150] [INFO ] [REMOTE ] DAVA: Full fetch complete (55198 records). [2025-09-22T18:18:02.755294] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-22T18:18:02.927631] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-22T18:18:03.166850] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-22T18:18:03.166951] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-22T18:18:03.167618] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-22T18:18:03.167734] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-22T18:18:03.168968] [DEBUG] [LOCAL ] DAVA: Trimmed 55198 records to 40440 (keeping 200 days of data) [2025-09-22T18:18:03.410845] [DEBUG] [LOCAL ] DAVA: Primary data saved (40440 records). [2025-09-22T18:18:03.410979] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-22T18:18:03.411061] [INFO ] [MAIN ] Update Progress: 591/2372 symbols completed. DAVA took 38.3s. Estimated remaining: 3h 55m 2s. Rate: 7.6 symbols/min [2025-09-22T18:18:03.589739] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:18:03.601021] [DEBUG] [LOCAL ] DBL: Loaded 9154 existing records from primary storage. [2025-09-22T18:18:03.601127] [INFO ] [MAIN ] DBL: Loaded 9154 existing records. [2025-09-22T18:18:03.786329] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:18:03.786619] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-22T18:18:03.786701] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-22T18:18:03.787548] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-22T18:18:03.787610] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-22T18:18:04.158339] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:18:04.158696] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-22T18:18:05.150886] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (3.83 seconds). [2025-09-22T18:18:05.160960] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-22T18:18:05.220945] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (3.10 seconds). [2025-09-22T18:18:05.274475] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T18:18:05.322051] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-22T18:18:05.902992] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T18:18:05.935233] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (3.01 seconds). [2025-09-22T18:18:06.122095] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-22T18:18:06.380481] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T18:18:06.922069] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-22T18:18:07.368369] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T18:18:07.430151] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-22T18:18:07.722056] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-22T18:18:08.522023] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-22T18:18:08.815238] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T18:18:09.322071] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-22T18:18:10.122049] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-22T18:18:10.452456] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T18:18:10.501710] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T18:18:10.535151] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-22T18:18:10.922060] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-22T18:18:11.722056] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-22T18:18:12.144028] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T18:18:12.522078] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-22T18:18:13.322021] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-22T18:18:13.586419] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T18:18:13.773408] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T18:18:14.122053] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-22T18:18:14.922068] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-22T18:18:15.102751] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T18:18:15.722070] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-22T18:18:15.787756] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T18:18:16.522021] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-22T18:18:16.521968] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-22T18:18:16.531749] [INFO ] [REMOTE ] DB: Full fetch complete (74063 records). [2025-09-22T18:18:16.532014] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-22T18:18:16.950811] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-22T18:18:16.950935] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-22T18:18:16.951893] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-22T18:18:16.951963] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-22T18:18:16.953541] [DEBUG] [LOCAL ] DB: Trimmed 74063 records to 52637 (keeping 200 days of data) [2025-09-22T18:18:17.280696] [DEBUG] [LOCAL ] DB: Primary data saved (52637 records). [2025-09-22T18:18:17.280843] [INFO ] [MAIN ] DB: Full history saved. [2025-09-22T18:18:17.280932] [INFO ] [MAIN ] Update Progress: 592/2372 symbols completed. DB took 33.5s. Estimated remaining: 3h 55m 12s. Rate: 7.6 symbols/min [2025-09-22T18:18:17.327546] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-22T18:18:17.471220] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:18:17.526980] [DEBUG] [LOCAL ] DBRG: Loaded 50570 existing records from primary storage. [2025-09-22T18:18:17.527154] [INFO ] [MAIN ] DBRG: Loaded 50570 existing records. [2025-09-22T18:18:17.710357] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:18:17.710624] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-22T18:18:17.710703] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-22T18:18:17.711824] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-22T18:18:17.711883] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-22T18:18:18.167386] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:18:18.162196] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-22T18:18:18.167831] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-22T18:18:18.185582] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T18:18:18.557515] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T18:18:18.922052] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-22T18:18:19.713354] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T18:18:19.723120] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-22T18:18:20.200080] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T18:18:20.522092] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-22T18:18:20.867288] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T18:18:20.871198] [INFO ] [REMOTE ] DBD: Full fetch complete (30315 records). [2025-09-22T18:18:20.871309] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-22T18:18:20.871979] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:18:20.872082] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:18:20.872160] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:18:20.872278] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-22T18:18:20.872370] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-22T18:18:20.872425] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-22T18:18:20.872494] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-22T18:18:20.872584] [INFO ] [MAIN ] Update Progress: 593/2372 symbols completed. DBD took 33.2s. Estimated remaining: 3h 54m 51s. Rate: 7.6 symbols/min [2025-09-22T18:18:21.055198] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:18:21.056276] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-22T18:18:21.107723] [DEBUG] [LOCAL ] DCI: Loaded 38302 existing records from primary storage. [2025-09-22T18:18:21.107871] [INFO ] [MAIN ] DCI: Loaded 38302 existing records. [2025-09-22T18:18:21.285240] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:18:21.285531] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-22T18:18:21.285585] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-22T18:18:21.286630] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-22T18:18:21.286727] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-22T18:18:21.327164] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-22T18:18:21.651995] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:18:22.122061] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-22T18:18:22.922047] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-22T18:18:23.015884] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T18:18:23.584033] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T18:18:23.722044] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-22T18:18:24.142399] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T18:18:24.522041] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-22T18:18:24.625932] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-22T18:18:25.322055] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-22T18:18:25.957591] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T18:18:26.122047] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-22T18:18:26.922116] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-22T18:18:27.030269] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T18:18:27.732813] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-22T18:18:27.736316] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T18:18:28.302286] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-22T18:18:28.328766] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T18:18:28.522079] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-22T18:18:29.322070] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-22T18:18:29.671927] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-22T18:18:30.122060] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-22T18:18:30.760973] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T18:18:30.922094] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-22T18:18:31.492598] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T18:18:31.722110] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-22T18:18:32.386918] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T18:18:32.522071] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-22T18:18:32.661947] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T18:18:33.322067] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-22T18:18:33.956770] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T18:18:34.122050] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-22T18:18:34.904472] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T18:18:34.922022] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-22T18:18:35.722061] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-22T18:18:35.779527] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T18:18:36.449094] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T18:18:36.522134] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-22T18:18:36.532614] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T18:18:36.534585] [INFO ] [REMOTE ] DBL: Full fetch complete (12429 records). [2025-09-22T18:18:36.534685] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-22T18:18:36.911083] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-22T18:18:36.911173] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-22T18:18:36.911530] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-22T18:18:36.911592] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-22T18:18:36.912122] [DEBUG] [LOCAL ] DBL: Trimmed 12429 records to 9064 (keeping 200 days of data) [2025-09-22T18:18:36.970072] [DEBUG] [LOCAL ] DBL: Primary data saved (9064 records). [2025-09-22T18:18:36.970245] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-22T18:18:36.970358] [INFO ] [MAIN ] Update Progress: 594/2372 symbols completed. DBL took 33.6s. Estimated remaining: 3h 55m 8s. Rate: 7.6 symbols/min [2025-09-22T18:18:37.154807] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:18:37.171563] [DEBUG] [LOCAL ] DCO: Loaded 13827 existing records from primary storage. [2025-09-22T18:18:37.171728] [INFO ] [MAIN ] DCO: Loaded 13827 existing records. [2025-09-22T18:18:37.327249] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-22T18:18:37.366262] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:18:37.366501] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-22T18:18:37.366550] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-22T18:18:37.367092] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-22T18:18:37.367174] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-22T18:18:37.762727] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:18:38.036461] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T18:18:38.122067] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-22T18:18:38.627911] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T18:18:38.922067] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-22T18:18:39.722067] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-22T18:18:39.943477] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-22T18:18:39.950926] [INFO ] [REMOTE ] DBI: Full fetch complete (66551 records). [2025-09-22T18:18:39.951052] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-22T18:18:40.343393] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T18:18:40.371181] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-22T18:18:40.371261] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-22T18:18:40.372033] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-22T18:18:40.372100] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-22T18:18:40.373471] [DEBUG] [LOCAL ] DBI: Trimmed 66551 records to 45104 (keeping 200 days of data) [2025-09-22T18:18:40.546484] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-22T18:18:40.648557] [DEBUG] [LOCAL ] DBI: Primary data saved (45104 records). [2025-09-22T18:18:40.648726] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-22T18:18:40.648821] [INFO ] [MAIN ] Update Progress: 595/2372 symbols completed. DBI took 42.1s. Estimated remaining: 3h 54m 47s. Rate: 7.6 symbols/min [2025-09-22T18:18:40.822867] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:18:40.874378] [DEBUG] [LOCAL ] DD: Loaded 53571 existing records from primary storage. [2025-09-22T18:18:40.874522] [INFO ] [MAIN ] DD: Loaded 53571 existing records. [2025-09-22T18:18:41.056607] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:18:41.057112] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-22T18:18:41.057307] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-22T18:18:41.059058] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-22T18:18:41.059127] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-22T18:18:41.244581] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T18:18:41.323500] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-22T18:18:41.481323] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:18:41.489181] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T18:18:42.122069] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-22T18:18:42.606990] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T18:18:42.613090] [INFO ] [REMOTE ] DCI: Full fetch complete (54432 records). [2025-09-22T18:18:42.613192] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-22T18:18:42.927196] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-22T18:18:43.000253] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-22T18:18:43.000360] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-22T18:18:43.001338] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-22T18:18:43.001402] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-22T18:18:43.002546] [DEBUG] [LOCAL ] DCI: Trimmed 54432 records to 37609 (keeping 200 days of data) [2025-09-22T18:18:43.235323] [DEBUG] [LOCAL ] DCI: Primary data saved (37609 records). [2025-09-22T18:18:43.235471] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-22T18:18:43.235570] [INFO ] [MAIN ] Update Progress: 596/2372 symbols completed. DCI took 22.4s. Estimated remaining: 3h 54m 23s. Rate: 7.6 symbols/min [2025-09-22T18:18:43.430141] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:18:43.482699] [DEBUG] [LOCAL ] DDD: Loaded 51576 existing records from primary storage. [2025-09-22T18:18:43.482927] [INFO ] [MAIN ] DDD: Loaded 51576 existing records. [2025-09-22T18:18:43.673983] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:18:43.674435] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-22T18:18:43.674599] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-22T18:18:43.676251] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-22T18:18:43.676320] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-22T18:18:43.722796] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-22T18:18:43.896983] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T18:18:44.005068] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T18:18:44.130153] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:18:44.522068] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-22T18:18:45.322049] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-22T18:18:45.525686] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T18:18:46.122047] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-22T18:18:46.517679] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-22T18:18:46.868299] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T18:18:46.922013] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-22T18:18:47.418478] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-22T18:18:47.425668] [INFO ] [REMOTE ] DBRG: Full fetch complete (71836 records). [2025-09-22T18:18:47.425782] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-22T18:18:47.426574] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:18:47.426705] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:18:47.426756] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:18:47.426796] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-22T18:18:47.426864] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-09-22T18:18:47.426907] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-09-22T18:18:47.427442] [DEBUG] [LOCAL ] DBRG: Deleted derivative data file. [2025-09-22T18:18:47.427539] [INFO ] [MAIN ] Update Progress: 597/2372 symbols completed. DBRG took 30.1s. Estimated remaining: 3h 54m 4s. Rate: 7.6 symbols/min [2025-09-22T18:18:47.722062] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-22T18:18:48.522030] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-22T18:18:48.621513] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T18:18:48.654207] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T18:18:49.322051] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-22T18:18:49.924287] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T18:18:49.948451] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-22T18:18:50.122053] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-22T18:18:50.922107] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-22T18:18:51.626924] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T18:18:51.722121] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-22T18:18:52.531182] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-22T18:18:52.551770] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T18:18:53.322031] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-22T18:18:53.352235] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T18:18:53.394469] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T18:18:54.122083] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-22T18:18:54.922048] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-22T18:18:55.232012] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T18:18:55.722085] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-22T18:18:55.885901] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T18:18:55.924954] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T18:18:56.522078] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-22T18:18:57.322114] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-22T18:18:57.504182] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T18:18:58.122129] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-22T18:18:58.384999] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-22T18:18:58.449520] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T18:18:58.922084] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-22T18:18:59.722080] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-22T18:19:00.034883] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T18:19:00.527194] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-22T18:19:00.534272] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T18:19:00.863804] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-22T18:19:01.322061] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-22T18:19:02.122163] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-22T18:19:02.192101] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T18:19:02.922080] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-22T18:19:03.040110] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T18:19:03.181768] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T18:19:03.184877] [INFO ] [REMOTE ] DCO: Full fetch complete (19641 records). [2025-09-22T18:19:03.184955] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-22T18:19:03.563702] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-22T18:19:03.563816] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-22T18:19:03.564279] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-22T18:19:03.564322] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-22T18:19:03.565035] [DEBUG] [LOCAL ] DCO: Trimmed 19641 records to 13666 (keeping 200 days of data) [2025-09-22T18:19:03.648876] [DEBUG] [LOCAL ] DCO: Primary data saved (13666 records). [2025-09-22T18:19:03.649032] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-22T18:19:03.649120] [INFO ] [MAIN ] Update Progress: 598/2372 symbols completed. DCO took 26.7s. Estimated remaining: 3h 54m 21s. Rate: 7.6 symbols/min [2025-09-22T18:19:03.722057] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-22T18:19:04.562718] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T18:19:04.573963] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-22T18:19:05.528162] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-22T18:19:05.536636] [INFO ] [REMOTE ] DD: Full fetch complete (76249 records). [2025-09-22T18:19:05.536829] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-22T18:19:05.933384] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-22T18:19:05.933476] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-22T18:19:05.934340] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-22T18:19:05.934408] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-22T18:19:05.936010] [DEBUG] [LOCAL ] DD: Trimmed 76249 records to 52821 (keeping 200 days of data) [2025-09-22T18:19:06.281477] [DEBUG] [LOCAL ] DD: Primary data saved (52821 records). [2025-09-22T18:19:06.281708] [INFO ] [MAIN ] DD: Full history saved. [2025-09-22T18:19:06.281973] [INFO ] [MAIN ] Update Progress: 599/2372 symbols completed. DD took 25.6s. Estimated remaining: 3h 53m 57s. Rate: 7.6 symbols/min [2025-09-22T18:19:06.882119] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-22T18:19:06.893156] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-22T18:19:08.915544] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-22T18:19:08.925312] [INFO ] [REMOTE ] DDD: Full fetch complete (73292 records). [2025-09-22T18:19:08.925488] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-22T18:19:08.926525] [FATAL] [VALIDATOR ] DDD: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:19:08.926630] [FATAL] [MAIN ] DDD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:19:08.926733] [WARN ] [MAIN ] DDD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:19:08.926843] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-22T18:19:08.926992] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-09-22T18:19:08.927081] [INFO ] [LOCAL ] DDD: Starting deletion of derivative data. [2025-09-22T18:19:08.927632] [DEBUG] [LOCAL ] DDD: Deleted derivative data file. [2025-09-22T18:19:08.927792] [INFO ] [MAIN ] Update Progress: 600/2372 symbols completed. DDD took 25.7s. Estimated remaining: 3h 53m 34s. Rate: 7.6 symbols/min [2025-09-22T18:19:09.540907] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:19:09.593353] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:19:09.657579] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:19:09.683393] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:19:09.694680] [DEBUG] [LOCAL ] DDT: Loaded 2112 existing records from primary storage. [2025-09-22T18:19:09.695020] [INFO ] [MAIN ] DDT: Loaded 2112 existing records. [2025-09-22T18:19:09.792460] [DEBUG] [LOCAL ] DDS: Loaded 13658 existing records from primary storage. [2025-09-22T18:19:09.807429] [INFO ] [MAIN ] DDS: Loaded 13658 existing records. [2025-09-22T18:19:10.038328] [DEBUG] [LOCAL ] DE: Loaded 48509 existing records from primary storage. [2025-09-22T18:19:10.067430] [DEBUG] [LOCAL ] DDL: Loaded 36967 existing records from primary storage. [2025-09-22T18:19:10.094105] [INFO ] [MAIN ] DE: Loaded 48509 existing records. [2025-09-22T18:19:10.088857] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:19:10.116851] [INFO ] [MAIN ] DDL: Loaded 36967 existing records. [2025-09-22T18:19:10.186545] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-22T18:19:10.250546] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-22T18:19:10.267263] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:19:10.297686] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-22T18:19:10.330840] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-22T18:19:10.345362] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-22T18:19:10.382951] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-22T18:19:10.499555] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-22T18:19:10.582598] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-22T18:19:10.662519] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:19:10.663077] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:19:10.705008] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-22T18:19:10.730057] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-22T18:19:10.768774] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-22T18:19:10.822005] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-22T18:19:10.835719] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-22T18:19:10.870979] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-22T18:19:10.871212] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-22T18:19:10.863038] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-22T18:19:11.528407] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:19:11.580832] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-22T18:19:11.671145] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:19:11.737342] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-22T18:19:12.125218] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:19:12.144370] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-22T18:19:12.144148] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:19:12.145399] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-22T18:19:12.402521] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-22T18:19:12.403687] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-22T18:19:12.808460] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T18:19:12.811879] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-22T18:19:12.857778] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T18:19:12.859039] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-22T18:19:13.214355] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-22T18:19:13.215633] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-22T18:19:13.375297] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T18:19:13.384204] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-22T18:19:13.651447] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-22T18:19:13.652871] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-22T18:19:13.662001] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T18:19:14.120853] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-22T18:19:14.130353] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-22T18:19:14.316820] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-22T18:19:14.769490] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T18:19:14.785248] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T18:19:14.922101] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-22T18:19:15.722077] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-22T18:19:15.982580] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T18:19:16.522048] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-22T18:19:16.742859] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-22T18:19:16.979398] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-22T18:19:17.322057] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-22T18:19:18.122088] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-22T18:19:18.741247] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T18:19:18.922051] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-22T18:19:19.412406] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-22T18:19:19.722073] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-22T18:19:20.119237] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-22T18:19:20.464556] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T18:19:20.522109] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-22T18:19:21.322054] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-22T18:19:21.371189] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T18:19:22.122066] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-22T18:19:22.618090] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-22T18:19:22.901610] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T18:19:22.922003] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-22T18:19:23.722111] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-22T18:19:24.522029] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-22T18:19:24.639876] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T18:19:25.134491] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-22T18:19:25.166784] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T18:19:25.322077] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-22T18:19:26.122084] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-22T18:19:26.922081] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-22T18:19:27.091103] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T18:19:27.127430] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T18:19:27.722106] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-22T18:19:28.522025] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-22T18:19:28.666203] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T18:19:28.821913] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-22T18:19:29.067383] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:19:29.322060] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-22T18:19:30.122065] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-22T18:19:30.922078] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-22T18:19:31.285576] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T18:19:31.333629] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T18:19:31.722039] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-22T18:19:31.762107] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T18:19:32.522097] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-22T18:19:32.552590] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T18:19:33.322038] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-22T18:19:33.608185] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T18:19:33.610760] [INFO ] [REMOTE ] DDS: Full fetch complete (19223 records). [2025-09-22T18:19:33.610854] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-22T18:19:33.990824] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-22T18:19:33.990910] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-22T18:19:33.991347] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-22T18:19:33.991407] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-22T18:19:33.992184] [DEBUG] [LOCAL ] DDS: Trimmed 19223 records to 13317 (keeping 200 days of data) [2025-09-22T18:19:34.085253] [DEBUG] [LOCAL ] DDS: Primary data saved (13317 records). [2025-09-22T18:19:34.085421] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-22T18:19:34.085544] [INFO ] [MAIN ] Update Progress: 601/2372 symbols completed. DDS took 25.2s. Estimated remaining: 3h 54m 17s. Rate: 7.6 symbols/min [2025-09-22T18:19:34.128465] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-22T18:19:34.259190] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:19:34.305295] [DEBUG] [LOCAL ] DEA: Loaded 42365 existing records from primary storage. [2025-09-22T18:19:34.305439] [INFO ] [MAIN ] DEA: Loaded 42365 existing records. [2025-09-22T18:19:34.491021] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:19:34.491756] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-22T18:19:34.491818] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-22T18:19:34.493397] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-22T18:19:34.493481] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-22T18:19:34.856347] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:19:34.859196] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T18:19:34.860452] [INFO ] [REMOTE ] DDT: Full fetch complete (2906 records). [2025-09-22T18:19:34.860659] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-22T18:19:34.925784] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-22T18:19:35.047469] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T18:19:35.261129] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-22T18:19:35.261218] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-22T18:19:35.261361] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-22T18:19:35.261455] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-22T18:19:35.261872] [DEBUG] [LOCAL ] DDT: Trimmed 2906 records to 2092 (keeping 200 days of data) [2025-09-22T18:19:35.276959] [DEBUG] [LOCAL ] DDT: Primary data saved (2092 records). [2025-09-22T18:19:35.277039] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-22T18:19:35.277161] [INFO ] [MAIN ] Update Progress: 602/2372 symbols completed. DDT took 26.3s. Estimated remaining: 3h 53m 49s. Rate: 7.6 symbols/min [2025-09-22T18:19:35.458796] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:19:35.511550] [DEBUG] [LOCAL ] DEC: Loaded 31645 existing records from primary storage. [2025-09-22T18:19:35.511752] [INFO ] [MAIN ] DEC: Loaded 31645 existing records. [2025-09-22T18:19:35.695503] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:19:35.695857] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-22T18:19:35.695913] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-22T18:19:35.697141] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-22T18:19:35.697202] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-22T18:19:35.727209] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-22T18:19:36.057264] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:19:36.522147] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-22T18:19:36.605246] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T18:19:37.322076] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-22T18:19:37.654077] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T18:19:38.122113] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-22T18:19:38.205771] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T18:19:38.547409] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T18:19:38.922081] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-22T18:19:39.597594] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T18:19:39.604271] [INFO ] [REMOTE ] DDL: Full fetch complete (53042 records). [2025-09-22T18:19:39.604400] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-22T18:19:39.605353] [FATAL] [VALIDATOR ] DDL: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:19:39.605478] [FATAL] [MAIN ] DDL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:19:39.605522] [WARN ] [MAIN ] DDL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:19:39.605561] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-22T18:19:39.605632] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-09-22T18:19:39.605729] [INFO ] [LOCAL ] DDL: Starting deletion of derivative data. [2025-09-22T18:19:39.606881] [DEBUG] [LOCAL ] DDL: Deleted derivative data file. [2025-09-22T18:19:39.606990] [INFO ] [MAIN ] Update Progress: 603/2372 symbols completed. DDL took 30.7s. Estimated remaining: 3h 53m 31s. Rate: 7.6 symbols/min [2025-09-22T18:19:39.727238] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-22T18:19:39.780933] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:19:39.848848] [DEBUG] [LOCAL ] DECK: Loaded 54084 existing records from primary storage. [2025-09-22T18:19:39.849028] [INFO ] [MAIN ] DECK: Loaded 54084 existing records. [2025-09-22T18:19:40.030222] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:19:40.030474] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-22T18:19:40.030522] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-22T18:19:40.033634] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-22T18:19:40.033720] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-22T18:19:40.389325] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:19:40.510962] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T18:19:40.522002] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-22T18:19:41.322071] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-22T18:19:41.511784] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T18:19:41.520184] [INFO ] [REMOTE ] DE: Full fetch complete (69612 records). [2025-09-22T18:19:41.520412] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-22T18:19:41.914760] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-22T18:19:41.914882] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-22T18:19:41.915880] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-22T18:19:41.915967] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-22T18:19:41.917799] [DEBUG] [LOCAL ] DE: Trimmed 69612 records to 47776 (keeping 200 days of data) [2025-09-22T18:19:42.059552] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T18:19:42.149897] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-22T18:19:42.275025] [DEBUG] [LOCAL ] DE: Primary data saved (47776 records). [2025-09-22T18:19:42.275203] [INFO ] [MAIN ] DE: Full history saved. [2025-09-22T18:19:42.275306] [INFO ] [MAIN ] Update Progress: 604/2372 symbols completed. DE took 33.3s. Estimated remaining: 3h 53m 7s. Rate: 7.6 symbols/min [2025-09-22T18:19:42.444851] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:19:42.498080] [DEBUG] [LOCAL ] DEI: Loaded 49247 existing records from primary storage. [2025-09-22T18:19:42.498255] [INFO ] [MAIN ] DEI: Loaded 49247 existing records. [2025-09-22T18:19:42.673329] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:19:42.673596] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-22T18:19:42.673675] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-22T18:19:42.675068] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-22T18:19:42.675128] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-22T18:19:42.927293] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-22T18:19:43.034551] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:19:43.266267] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-22T18:19:43.649697] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T18:19:43.722088] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-22T18:19:43.847150] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T18:19:44.522075] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-22T18:19:45.322096] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-22T18:19:45.558697] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T18:19:45.871848] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T18:19:46.122054] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-22T18:19:46.922109] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-22T18:19:46.994567] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T18:19:47.722170] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-22T18:19:47.963744] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T18:19:48.028003] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-22T18:19:48.522069] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-22T18:19:49.142447] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T18:19:49.322111] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-22T18:19:49.632165] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T18:19:50.122092] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-22T18:19:50.922039] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-22T18:19:51.253274] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T18:19:51.407524] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-22T18:19:51.722094] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-22T18:19:52.112368] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T18:19:52.522039] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-22T18:19:53.322091] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-22T18:19:53.919417] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-22T18:19:54.000506] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T18:19:54.122079] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-22T18:19:54.492120] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T18:19:54.922106] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-22T18:19:55.722036] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-22T18:19:56.268125] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-22T18:19:56.315318] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T18:19:56.522039] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-22T18:19:57.272086] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T18:19:57.322055] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-22T18:19:57.847733] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T18:19:58.122059] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-22T18:19:58.490804] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T18:19:58.922140] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-22T18:19:59.722088] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-22T18:19:59.843695] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T18:19:59.946213] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T18:20:00.522052] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-22T18:20:01.322063] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-22T18:20:02.031677] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T18:20:02.122068] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-22T18:20:02.193445] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-22T18:20:02.761249] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T18:20:02.767803] [INFO ] [REMOTE ] DEA: Full fetch complete (63150 records). [2025-09-22T18:20:02.767979] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-22T18:20:02.927354] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-22T18:20:03.200979] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-22T18:20:03.201094] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-22T18:20:03.201996] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-22T18:20:03.202079] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-22T18:20:03.203579] [DEBUG] [LOCAL ] DEA: Trimmed 63150 records to 41546 (keeping 200 days of data) [2025-09-22T18:20:03.457799] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T18:20:03.486123] [DEBUG] [LOCAL ] DEA: Primary data saved (41546 records). [2025-09-22T18:20:03.486266] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-22T18:20:03.486349] [INFO ] [MAIN ] Update Progress: 605/2372 symbols completed. DEA took 29.4s. Estimated remaining: 3h 53m 38s. Rate: 7.6 symbols/min [2025-09-22T18:20:03.681599] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:20:03.733527] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-22T18:20:03.735694] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-22T18:20:03.736082] [INFO ] [MAIN ] DELL: Loaded 54515 existing records. [2025-09-22T18:20:03.925808] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:20:03.926096] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-22T18:20:03.926168] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-22T18:20:03.927893] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-22T18:20:03.927970] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-22T18:20:04.340074] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:20:04.456261] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T18:20:04.522041] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-22T18:20:05.322057] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-22T18:20:05.362835] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T18:20:05.370864] [INFO ] [REMOTE ] DEC: Full fetch complete (42872 records). [2025-09-22T18:20:05.371101] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-22T18:20:05.792763] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-22T18:20:05.792884] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-22T18:20:05.793894] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-22T18:20:05.793964] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-22T18:20:05.795502] [DEBUG] [LOCAL ] DEC: Trimmed 42872 records to 30832 (keeping 200 days of data) [2025-09-22T18:20:06.003904] [DEBUG] [LOCAL ] DEC: Primary data saved (30832 records). [2025-09-22T18:20:06.004112] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-22T18:20:06.004225] [INFO ] [MAIN ] Update Progress: 606/2372 symbols completed. DEC took 30.7s. Estimated remaining: 3h 53m 14s. Rate: 7.6 symbols/min [2025-09-22T18:20:06.125053] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-22T18:20:06.196844] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:20:06.197304] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-09-22T18:20:06.197417] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-09-22T18:20:06.197778] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-22T18:20:06.197930] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-22T18:20:06.198101] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-09-22T18:20:06.198234] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-22T18:20:06.545700] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-22T18:20:06.645925] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:20:06.922065] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-22T18:20:07.563521] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-22T18:20:07.722102] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-22T18:20:08.455029] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-22T18:20:08.522024] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-22T18:20:08.869330] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T18:20:09.322096] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-22T18:20:09.888134] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-22T18:20:10.122016] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-22T18:20:10.312895] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T18:20:10.922106] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-22T18:20:10.967882] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T18:20:11.722106] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-22T18:20:12.497566] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-22T18:20:12.522008] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-22T18:20:13.069289] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-22T18:20:13.077353] [INFO ] [REMOTE ] DECK: Full fetch complete (76196 records). [2025-09-22T18:20:13.077487] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-22T18:20:13.078258] [FATAL] [VALIDATOR ] DECK: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:20:13.078381] [FATAL] [MAIN ] DECK: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:20:13.078448] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:20:13.078536] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-22T18:20:13.078638] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-09-22T18:20:13.078742] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-09-22T18:20:13.079234] [DEBUG] [LOCAL ] DECK: Deleted derivative data file. [2025-09-22T18:20:13.079347] [INFO ] [MAIN ] Update Progress: 607/2372 symbols completed. DECK took 33.5s. Estimated remaining: 3h 53m 4s. Rate: 7.6 symbols/min [2025-09-22T18:20:13.252627] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:20:13.286742] [DEBUG] [LOCAL ] DFH: Loaded 33560 existing records from primary storage. [2025-09-22T18:20:13.286882] [INFO ] [MAIN ] DFH: Loaded 33560 existing records. [2025-09-22T18:20:13.329892] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-22T18:20:13.471124] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:20:13.471532] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-22T18:20:13.471604] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-22T18:20:13.472445] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-22T18:20:13.472507] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-22T18:20:13.856234] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:20:13.858849] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-22T18:20:13.867154] [INFO ] [REMOTE ] DEI: Full fetch complete (69502 records). [2025-09-22T18:20:13.867329] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-22T18:20:14.130223] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-22T18:20:14.275510] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-22T18:20:14.275630] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-22T18:20:14.276525] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-22T18:20:14.276577] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-22T18:20:14.278143] [DEBUG] [LOCAL ] DEI: Trimmed 69502 records to 48508 (keeping 200 days of data) [2025-09-22T18:20:14.545744] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-22T18:20:14.623253] [DEBUG] [LOCAL ] DEI: Primary data saved (48508 records). [2025-09-22T18:20:14.623411] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-22T18:20:14.623500] [INFO ] [MAIN ] Update Progress: 608/2372 symbols completed. DEI took 32.3s. Estimated remaining: 3h 52m 38s. Rate: 7.6 symbols/min [2025-09-22T18:20:14.796374] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:20:14.821865] [DEBUG] [LOCAL ] DFIN: Loaded 23906 existing records from primary storage. [2025-09-22T18:20:14.822028] [INFO ] [MAIN ] DFIN: Loaded 23906 existing records. [2025-09-22T18:20:14.928210] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-22T18:20:15.016330] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:20:15.016676] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-22T18:20:15.016738] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-22T18:20:15.017539] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-22T18:20:15.017605] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-22T18:20:15.385263] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:20:15.419465] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-22T18:20:15.722061] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-22T18:20:16.353168] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-22T18:20:16.522111] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-22T18:20:17.322122] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-22T18:20:17.386290] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-22T18:20:17.520954] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T18:20:18.122128] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-22T18:20:18.614488] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T18:20:18.932765] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-22T18:20:18.939749] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (3.22 seconds). [2025-09-22T18:20:19.075247] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T18:20:19.722066] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-22T18:20:20.522077] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-22T18:20:20.669628] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T18:20:21.138382] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-22T18:20:21.322055] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-22T18:20:22.025710] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T18:20:22.122105] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-22T18:20:22.746896] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T18:20:22.922070] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-22T18:20:23.231824] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T18:20:23.722056] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-22T18:20:24.527115] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-22T18:20:24.547414] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T18:20:25.001727] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T18:20:25.322024] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-22T18:20:25.421427] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T18:20:26.122059] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-22T18:20:26.554931] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T18:20:26.922065] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-22T18:20:27.722077] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-22T18:20:28.211837] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T18:20:28.269052] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-22T18:20:28.522065] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-22T18:20:29.322032] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-22T18:20:29.429070] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T18:20:29.988829] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T18:20:30.122101] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-22T18:20:30.922079] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-22T18:20:31.114269] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T18:20:31.706422] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-22T18:20:31.721994] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-22T18:20:32.522045] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-22T18:20:32.799605] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T18:20:33.322079] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-22T18:20:33.605998] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T18:20:33.823144] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T18:20:34.122092] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-22T18:20:34.693582] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T18:20:34.922103] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-22T18:20:35.305404] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T18:20:35.312473] [INFO ] [REMOTE ] DFH: Full fetch complete (49180 records). [2025-09-22T18:20:35.312618] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-22T18:20:35.712862] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-22T18:20:35.712987] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-22T18:20:35.713696] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-22T18:20:35.713763] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-22T18:20:35.715113] [DEBUG] [LOCAL ] DFH: Trimmed 49180 records to 32971 (keeping 200 days of data) [2025-09-22T18:20:35.722062] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-22T18:20:35.915892] [DEBUG] [LOCAL ] DFH: Primary data saved (32971 records). [2025-09-22T18:20:35.916040] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-22T18:20:35.916126] [INFO ] [MAIN ] Update Progress: 609/2372 symbols completed. DFH took 22.8s. Estimated remaining: 3h 53m 8s. Rate: 7.6 symbols/min [2025-09-22T18:20:36.096868] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:20:36.112686] [DEBUG] [LOCAL ] DFP: Loaded 11926 existing records from primary storage. [2025-09-22T18:20:36.112846] [INFO ] [MAIN ] DFP: Loaded 11926 existing records. [2025-09-22T18:20:36.316267] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:20:36.316555] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-22T18:20:36.316610] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-22T18:20:36.317211] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-22T18:20:36.317273] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-22T18:20:36.542877] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-22T18:20:36.707825] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:20:37.322031] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-22T18:20:37.366207] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-22T18:20:37.377616] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-09-22T18:20:37.377833] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-22T18:20:37.797314] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-22T18:20:37.797732] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-22T18:20:37.798794] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-22T18:20:37.811504] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-22T18:20:37.812841] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T18:20:37.820199] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53735 (keeping 200 days of data) [2025-09-22T18:20:37.946811] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-22T18:20:37.970871] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-22T18:20:38.122097] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-22T18:20:38.218899] [DEBUG] [LOCAL ] DELL: Primary data saved (53735 records). [2025-09-22T18:20:38.219063] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-22T18:20:38.219149] [INFO ] [MAIN ] Update Progress: 610/2372 symbols completed. DELL took 34.7s. Estimated remaining: 3h 52m 44s. Rate: 7.6 symbols/min [2025-09-22T18:20:38.386584] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:20:38.439287] [DEBUG] [LOCAL ] DG: Loaded 54085 existing records from primary storage. [2025-09-22T18:20:38.439522] [INFO ] [MAIN ] DG: Loaded 54085 existing records. [2025-09-22T18:20:38.613915] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:20:38.614177] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-22T18:20:38.614225] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-22T18:20:38.615557] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-22T18:20:38.615621] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-22T18:20:38.743181] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T18:20:38.927156] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-22T18:20:39.007163] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:20:39.722057] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-22T18:20:40.522062] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-22T18:20:41.023553] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-22T18:20:41.293206] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T18:20:41.322089] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-22T18:20:41.611900] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T18:20:42.122054] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-22T18:20:42.880406] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T18:20:42.922158] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T18:20:42.922235] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-22T18:20:43.722050] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-22T18:20:44.522052] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-22T18:20:44.850948] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-22T18:20:45.207606] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T18:20:45.215857] [INFO ] [REMOTE ] DEO: Full fetch complete (71477 records). [2025-09-22T18:20:45.216032] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-22T18:20:45.327487] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-22T18:20:45.629348] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-22T18:20:45.629500] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-22T18:20:45.630355] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-22T18:20:45.630437] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-22T18:20:45.642821] [DEBUG] [LOCAL ] DEO: Trimmed 71477 records to 49009 (keeping 200 days of data) [2025-09-22T18:20:45.643827] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T18:20:45.956010] [DEBUG] [LOCAL ] DEO: Primary data saved (49009 records). [2025-09-22T18:20:45.956167] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-22T18:20:45.956253] [INFO ] [MAIN ] Update Progress: 611/2372 symbols completed. DEO took 40.0s. Estimated remaining: 3h 52m 36s. Rate: 7.6 symbols/min [2025-09-22T18:20:46.124564] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:20:46.123097] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-22T18:20:46.178756] [DEBUG] [LOCAL ] DGX: Loaded 46056 existing records from primary storage. [2025-09-22T18:20:46.178902] [INFO ] [MAIN ] DGX: Loaded 46056 existing records. [2025-09-22T18:20:46.356185] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:20:46.356474] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-22T18:20:46.356528] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-22T18:20:46.357795] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-22T18:20:46.357854] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-22T18:20:46.713687] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:20:46.754388] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-22T18:20:46.891794] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T18:20:46.922021] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-22T18:20:47.722089] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-22T18:20:48.522102] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-22T18:20:48.629756] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T18:20:48.814451] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T18:20:49.322067] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-22T18:20:49.426471] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T18:20:50.122074] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-22T18:20:50.852360] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T18:20:50.922002] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-22T18:20:51.225575] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-22T18:20:51.229469] [INFO ] [REMOTE ] DFIN: Full fetch complete (33313 records). [2025-09-22T18:20:51.229550] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-22T18:20:51.595692] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-22T18:20:51.595774] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-22T18:20:51.596206] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-22T18:20:51.596249] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-22T18:20:51.597054] [DEBUG] [LOCAL ] DFIN: Trimmed 33313 records to 23411 (keeping 200 days of data) [2025-09-22T18:20:51.723402] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-22T18:20:51.736683] [DEBUG] [LOCAL ] DFIN: Primary data saved (23411 records). [2025-09-22T18:20:51.736778] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-22T18:20:51.736863] [INFO ] [MAIN ] Update Progress: 612/2372 symbols completed. DFIN took 37.1s. Estimated remaining: 3h 52m 22s. Rate: 7.6 symbols/min [2025-09-22T18:20:51.905785] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:20:51.906000] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-09-22T18:20:51.906056] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-09-22T18:20:51.906299] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-22T18:20:51.906366] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-22T18:20:51.906434] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-09-22T18:20:51.906469] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-22T18:20:52.270231] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:20:52.368514] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T18:20:52.521166] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T18:20:52.523613] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-22T18:20:53.322073] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-22T18:20:54.123311] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-22T18:20:54.126433] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-22T18:20:54.224732] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T18:20:54.922025] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-22T18:20:54.936479] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-22T18:20:55.722059] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-22T18:20:55.793632] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T18:20:56.522060] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-22T18:20:57.322138] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-22T18:20:57.464431] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T18:20:57.988162] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T18:20:58.122148] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-22T18:20:58.431365] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-22T18:20:58.922123] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-22T18:20:59.722069] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-22T18:20:59.916372] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T18:20:59.981122] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T18:21:00.522094] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-22T18:21:01.322071] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-22T18:21:01.768864] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T18:21:01.772120] [INFO ] [REMOTE ] DFP: Full fetch complete (16222 records). [2025-09-22T18:21:01.772265] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-22T18:21:02.129289] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-22T18:21:02.168845] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-22T18:21:02.168967] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-22T18:21:02.169452] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-22T18:21:02.169557] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-22T18:21:02.170436] [DEBUG] [LOCAL ] DFP: Trimmed 16222 records to 11675 (keeping 200 days of data) [2025-09-22T18:21:02.262706] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-22T18:21:02.285546] [DEBUG] [LOCAL ] DFP: Primary data saved (11675 records). [2025-09-22T18:21:02.285698] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-22T18:21:02.285811] [INFO ] [MAIN ] Update Progress: 613/2372 symbols completed. DFP took 26.4s. Estimated remaining: 3h 52m 21s. Rate: 7.6 symbols/min [2025-09-22T18:21:02.459940] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:21:02.460187] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-09-22T18:21:02.460239] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-09-22T18:21:02.460426] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-22T18:21:02.460482] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-22T18:21:02.460540] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-22T18:21:02.460586] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-22T18:21:02.858764] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:21:02.922022] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-22T18:21:03.722068] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-22T18:21:03.793054] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-22T18:21:04.522088] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-22T18:21:05.619762] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-22T18:21:05.630315] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-22T18:21:05.678192] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (3.55 seconds). [2025-09-22T18:21:05.755829] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T18:21:06.122047] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-22T18:21:06.261390] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (3.34 seconds). [2025-09-22T18:21:06.927146] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-22T18:21:06.933991] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T18:21:07.338257] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T18:21:07.722069] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-22T18:21:08.522097] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-22T18:21:08.744053] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T18:21:09.054358] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-22T18:21:09.322051] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-22T18:21:10.070108] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T18:21:10.122019] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-22T18:21:10.260388] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T18:21:10.922066] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-22T18:21:11.310287] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T18:21:11.722058] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-22T18:21:12.522072] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-22T18:21:12.814046] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T18:21:13.291705] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T18:21:13.322092] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-22T18:21:13.966555] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T18:21:14.122061] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-22T18:21:14.335419] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-22T18:21:14.338540] [INFO ] [REMOTE ] DHF: Full fetch complete (29604 records). [2025-09-22T18:21:14.338634] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-22T18:21:14.710350] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-22T18:21:14.710429] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-22T18:21:14.710938] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-22T18:21:14.711019] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-22T18:21:14.711819] [DEBUG] [LOCAL ] DHF: Trimmed 29604 records to 20893 (keeping 200 days of data) [2025-09-22T18:21:14.849707] [DEBUG] [LOCAL ] DHF: Primary data saved (20893 records). [2025-09-22T18:21:14.850034] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-22T18:21:14.850350] [INFO ] [MAIN ] Update Progress: 614/2372 symbols completed. DHF took 23.1s. Estimated remaining: 3h 52m 27s. Rate: 7.6 symbols/min [2025-09-22T18:21:14.928571] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-22T18:21:15.030260] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:21:15.096471] [DEBUG] [LOCAL ] DHR: Loaded 54147 existing records from primary storage. [2025-09-22T18:21:15.096619] [INFO ] [MAIN ] DHR: Loaded 54147 existing records. [2025-09-22T18:21:15.286002] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:21:15.286284] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-22T18:21:15.286332] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-22T18:21:15.287831] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-22T18:21:15.287910] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-22T18:21:15.651078] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:21:15.722015] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-22T18:21:15.951341] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T18:21:16.522101] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-22T18:21:17.322065] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-22T18:21:18.030491] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (3.10 seconds). [2025-09-22T18:21:18.122013] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-22T18:21:18.455242] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-22T18:21:18.680594] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-22T18:21:18.687470] [INFO ] [REMOTE ] DGX: Full fetch complete (65141 records). [2025-09-22T18:21:18.687585] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-22T18:21:18.945057] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-22T18:21:19.079933] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-22T18:21:19.080010] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-22T18:21:19.080776] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-22T18:21:19.080929] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-22T18:21:19.082499] [DEBUG] [LOCAL ] DGX: Trimmed 65141 records to 45280 (keeping 200 days of data) [2025-09-22T18:21:19.385216] [DEBUG] [LOCAL ] DGX: Primary data saved (45280 records). [2025-09-22T18:21:19.385360] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-22T18:21:19.385511] [INFO ] [MAIN ] Update Progress: 615/2372 symbols completed. DGX took 33.4s. Estimated remaining: 3h 52m 9s. Rate: 7.6 symbols/min [2025-09-22T18:21:19.566321] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:21:19.566578] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-09-22T18:21:19.566704] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-09-22T18:21:19.567047] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-22T18:21:19.567300] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-22T18:21:19.567670] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-22T18:21:19.568174] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-22T18:21:19.764771] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-22T18:21:19.844824] [INFO ] [REMOTE ] DG: Full fetch complete (76848 records). [2025-09-22T18:21:19.861727] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-22T18:21:19.913295] [FATAL] [VALIDATOR ] DG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:21:19.925438] [FATAL] [MAIN ] DG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:21:19.930709] [WARN ] [MAIN ] DG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:21:19.930983] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-22T18:21:19.936297] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-09-22T18:21:19.942700] [INFO ] [LOCAL ] DG: Starting deletion of derivative data. [2025-09-22T18:21:19.955099] [DEBUG] [LOCAL ] DG: Deleted derivative data file. [2025-09-22T18:21:19.955950] [INFO ] [MAIN ] Update Progress: 616/2372 symbols completed. DG took 41.7s. Estimated remaining: 3h 51m 40s. Rate: 7.6 symbols/min [2025-09-22T18:21:20.151555] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:21:20.167329] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-22T18:21:20.223518] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:21:20.223777] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-09-22T18:21:20.223871] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-09-22T18:21:20.224300] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-22T18:21:20.224393] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-22T18:21:20.224552] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-22T18:21:20.224787] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-22T18:21:20.365029] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-22T18:21:20.530193] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-22T18:21:20.641195] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:21:20.893317] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T18:21:21.322087] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-22T18:21:21.697802] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-22T18:21:22.122068] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-22T18:21:22.749827] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-22T18:21:22.922038] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-22T18:21:22.999685] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T18:21:23.029881] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T18:21:23.722121] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-22T18:21:24.427633] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T18:21:24.522075] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-22T18:21:24.849014] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-22T18:21:25.262620] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T18:21:25.322037] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-22T18:21:26.122129] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-22T18:21:26.300300] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T18:21:26.922044] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-22T18:21:27.722022] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-22T18:21:27.787606] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T18:21:28.422274] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-22T18:21:28.522076] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-22T18:21:29.322064] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-22T18:21:29.921073] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-22T18:21:30.002463] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T18:21:30.122031] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-22T18:21:30.183063] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T18:21:30.922058] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-22T18:21:31.531931] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T18:21:31.722082] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-22T18:21:31.941369] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T18:21:32.522070] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-22T18:21:33.322056] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-22T18:21:33.412074] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-22T18:21:33.597888] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T18:21:34.122119] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-22T18:21:34.922055] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-22T18:21:35.298900] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-22T18:21:35.307456] [INFO ] [REMOTE ] DHI: Full fetch complete (77215 records). [2025-09-22T18:21:35.307681] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-22T18:21:35.714237] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-22T18:21:35.714406] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-22T18:21:35.715343] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-22T18:21:35.715421] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-22T18:21:35.716994] [DEBUG] [LOCAL ] DHI: Trimmed 77215 records to 53377 (keeping 200 days of data) [2025-09-22T18:21:35.722095] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-22T18:21:36.086735] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T18:21:36.122103] [DEBUG] [LOCAL ] DHI: Primary data saved (53377 records). [2025-09-22T18:21:36.122230] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-22T18:21:36.122301] [INFO ] [MAIN ] Update Progress: 617/2372 symbols completed. DHI took 33.8s. Estimated remaining: 3h 51m 56s. Rate: 7.6 symbols/min [2025-09-22T18:21:36.298381] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:21:36.298594] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-09-22T18:21:36.298674] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-09-22T18:21:36.298826] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-22T18:21:36.298870] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-22T18:21:36.298911] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-22T18:21:36.298943] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-22T18:21:36.485883] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T18:21:36.527270] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-22T18:21:36.697792] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:21:36.786790] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T18:21:37.322032] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-22T18:21:38.090947] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T18:21:38.094792] [INFO ] [REMOTE ] DHX: Full fetch complete (20875 records). [2025-09-22T18:21:38.094915] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-22T18:21:38.095582] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:21:38.095756] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:21:38.095800] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:21:38.095844] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-22T18:21:38.095931] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-22T18:21:38.095991] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-09-22T18:21:38.096051] [DEBUG] [LOCAL ] DHX: No derivative data file found to delete. [2025-09-22T18:21:38.096138] [INFO ] [MAIN ] Update Progress: 618/2372 symbols completed. DHX took 18.1s. Estimated remaining: 3h 51m 31s. Rate: 7.6 symbols/min [2025-09-22T18:21:38.129151] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-22T18:21:38.282261] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:21:38.313875] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T18:21:38.371235] [DEBUG] [LOCAL ] DIN: Loaded 38019 existing records from primary storage. [2025-09-22T18:21:38.371397] [INFO ] [MAIN ] DIN: Loaded 38019 existing records. [2025-09-22T18:21:38.568274] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:21:38.568578] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-22T18:21:38.568629] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-22T18:21:38.570513] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-22T18:21:38.570578] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-22T18:21:38.924311] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-22T18:21:38.960348] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T18:21:38.959435] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:21:39.722073] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-22T18:21:40.522071] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-22T18:21:40.907715] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-22T18:21:41.019265] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T18:21:41.325532] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-22T18:21:41.327897] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T18:21:42.122062] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-22T18:21:42.922050] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-22T18:21:43.265446] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T18:21:43.341273] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T18:21:43.714161] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T18:21:43.722023] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-22T18:21:44.515361] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T18:21:44.522014] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-22T18:21:45.322094] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-22T18:21:46.023477] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T18:21:46.122050] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-22T18:21:46.923205] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-22T18:21:46.929845] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T18:21:46.961732] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-22T18:21:47.722064] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-22T18:21:48.054226] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T18:21:48.511220] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T18:21:48.522004] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-22T18:21:49.301906] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T18:21:49.321996] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-22T18:21:49.886145] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T18:21:50.122055] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-22T18:21:50.922100] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-22T18:21:51.613495] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T18:21:51.722111] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-22T18:21:52.522136] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-22T18:21:52.670212] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T18:21:53.322073] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-22T18:21:53.793850] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-22T18:21:54.006169] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T18:21:54.122054] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-22T18:21:54.710468] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T18:21:54.922072] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-22T18:21:55.454551] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-22T18:21:55.722041] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-22T18:21:56.108320] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-22T18:21:56.522133] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-22T18:21:57.091549] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T18:21:57.322072] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-22T18:21:58.122064] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-22T18:21:58.244282] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T18:21:58.412898] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T18:21:58.922086] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-22T18:21:59.089569] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T18:21:59.092514] [INFO ] [REMOTE ] DIAX: Full fetch complete (17176 records). [2025-09-22T18:21:59.092604] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-22T18:21:59.468072] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-22T18:21:59.468180] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-22T18:21:59.468611] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-22T18:21:59.468696] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-22T18:21:59.469276] [DEBUG] [LOCAL ] DIAX: Trimmed 17176 records to 12386 (keeping 200 days of data) [2025-09-22T18:21:59.547025] [DEBUG] [LOCAL ] DIAX: Primary data saved (12386 records). [2025-09-22T18:21:59.547167] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-22T18:21:59.547249] [INFO ] [MAIN ] Update Progress: 619/2372 symbols completed. DIAX took 23.4s. Estimated remaining: 3h 52m 1s. Rate: 7.6 symbols/min [2025-09-22T18:21:59.724270] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:21:59.722622] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-22T18:21:59.781870] [DEBUG] [LOCAL ] DINO: Loaded 53743 existing records from primary storage. [2025-09-22T18:21:59.782020] [INFO ] [MAIN ] DINO: Loaded 53743 existing records. [2025-09-22T18:21:59.965504] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:21:59.965828] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-22T18:21:59.965894] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-22T18:21:59.967421] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-22T18:21:59.967482] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-22T18:22:00.324185] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:00.522078] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-22T18:22:00.871248] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-22T18:22:00.879292] [INFO ] [REMOTE ] DHR: Full fetch complete (76885 records). [2025-09-22T18:22:00.879439] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-22T18:22:00.880296] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:22:00.880394] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:22:00.880437] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:22:00.880476] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-22T18:22:00.880533] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-22T18:22:00.880569] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-09-22T18:22:00.880985] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-09-22T18:22:00.881101] [INFO ] [MAIN ] Update Progress: 620/2372 symbols completed. DHR took 46.0s. Estimated remaining: 3h 51m 35s. Rate: 7.6 symbols/min [2025-09-22T18:22:01.057287] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:22:01.122192] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-22T18:22:01.122352] [INFO ] [MAIN ] DIS: Loaded 54568 existing records. [2025-09-22T18:22:01.302637] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:22:01.302908] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-22T18:22:01.302963] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-22T18:22:01.304436] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-22T18:22:01.304497] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-22T18:22:01.335970] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-22T18:22:01.724897] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:01.746096] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-22T18:22:01.755761] [INFO ] [REMOTE ] DHT: Full fetch complete (70115 records). [2025-09-22T18:22:01.755905] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-22T18:22:02.135007] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-22T18:22:02.159482] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-22T18:22:02.159574] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-22T18:22:02.160390] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-22T18:22:02.160468] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-22T18:22:02.161967] [DEBUG] [LOCAL ] DHT: Trimmed 70115 records to 47958 (keeping 200 days of data) [2025-09-22T18:22:02.424826] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-22T18:22:02.508479] [DEBUG] [LOCAL ] DHT: Primary data saved (47958 records). [2025-09-22T18:22:02.508617] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-22T18:22:02.508724] [INFO ] [MAIN ] Update Progress: 621/2372 symbols completed. DHT took 43.1s. Estimated remaining: 3h 51m 9s. Rate: 7.6 symbols/min [2025-09-22T18:22:02.685569] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:22:02.685802] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-22T18:22:02.685854] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-22T18:22:02.685999] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-22T18:22:02.686044] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-22T18:22:02.686087] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-22T18:22:02.686119] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-22T18:22:02.928725] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-22T18:22:03.060489] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:03.084113] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T18:22:03.722085] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-22T18:22:04.060242] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-22T18:22:04.373726] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-22T18:22:04.522029] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-22T18:22:04.662923] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T18:22:05.322116] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-22T18:22:06.122110] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-22T18:22:06.572716] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T18:22:06.730356] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T18:22:06.767928] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-22T18:22:06.766137] [INFO ] [REMOTE ] DIN: Full fetch complete (54986 records). [2025-09-22T18:22:06.768160] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-22T18:22:06.928463] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-22T18:22:07.237761] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-22T18:22:07.237847] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-22T18:22:07.238551] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-22T18:22:07.238592] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-22T18:22:07.239748] [DEBUG] [LOCAL ] DIN: Trimmed 54986 records to 37289 (keeping 200 days of data) [2025-09-22T18:22:07.473852] [DEBUG] [LOCAL ] DIN: Primary data saved (37289 records). [2025-09-22T18:22:07.474005] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-22T18:22:07.474089] [INFO ] [MAIN ] Update Progress: 622/2372 symbols completed. DIN took 29.4s. Estimated remaining: 3h 50m 53s. Rate: 7.6 symbols/min [2025-09-22T18:22:07.642794] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:22:07.693017] [DEBUG] [LOCAL ] DK: Loaded 50194 existing records from primary storage. [2025-09-22T18:22:07.693186] [INFO ] [MAIN ] DK: Loaded 50194 existing records. [2025-09-22T18:22:07.727302] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-22T18:22:07.878620] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:22:07.878903] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-22T18:22:07.878952] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-22T18:22:07.880671] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-22T18:22:07.880733] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-22T18:22:08.184941] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-22T18:22:08.242613] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:08.522061] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-22T18:22:08.992446] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-22T18:22:09.322055] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-22T18:22:09.786804] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T18:22:09.843815] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T18:22:10.122089] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-22T18:22:10.922086] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-22T18:22:11.722060] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-22T18:22:12.039013] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-22T18:22:12.168387] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-22T18:22:12.465257] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-22T18:22:12.522074] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-22T18:22:13.322071] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-22T18:22:14.122104] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-22T18:22:14.922037] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-22T18:22:15.099918] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-22T18:22:15.203511] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-22T18:22:15.281054] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T18:22:15.449014] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T18:22:15.722057] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-22T18:22:16.522076] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-22T18:22:17.322087] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-22T18:22:17.464199] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T18:22:18.122055] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-22T18:22:18.151603] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T18:22:18.922067] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-22T18:22:19.415186] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-22T18:22:19.428780] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T18:22:19.547184] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T18:22:19.722072] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-22T18:22:20.522120] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-22T18:22:21.322051] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-22T18:22:21.526439] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T18:22:22.122056] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-22T18:22:22.477416] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-22T18:22:22.510938] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T18:22:22.922081] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-22T18:22:23.268258] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-22T18:22:23.280956] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-22T18:22:23.722055] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-22T18:22:24.522064] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-22T18:22:24.905953] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-22T18:22:24.906901] [INFO ] [REMOTE ] DIVY: Full fetch complete (1713 records). [2025-09-22T18:22:24.906973] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-22T18:22:25.112114] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T18:22:25.112491] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:22:25.112637] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:22:25.112876] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-22T18:22:25.113146] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-22T18:22:25.113224] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-22T18:22:25.113323] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-22T18:22:25.113623] [INFO ] [MAIN ] Update Progress: 623/2372 symbols completed. DIVY took 22.6s. Estimated remaining: 3h 51m 12s. Rate: 7.6 symbols/min [2025-09-22T18:22:25.299155] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:22:25.326442] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-22T18:22:25.333255] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T18:22:25.357628] [DEBUG] [LOCAL ] DKL: Loaded 19705 existing records from primary storage. [2025-09-22T18:22:25.357786] [INFO ] [MAIN ] DKL: Loaded 19705 existing records. [2025-09-22T18:22:25.546251] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:22:25.546484] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-22T18:22:25.546534] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-22T18:22:25.547214] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-22T18:22:25.547275] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-22T18:22:25.913084] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:26.122057] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-22T18:22:26.922079] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-22T18:22:27.338558] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T18:22:27.527867] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-22T18:22:27.722058] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-22T18:22:28.522078] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-22T18:22:28.895028] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T18:22:29.145233] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T18:22:29.322047] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-22T18:22:29.707261] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-22T18:22:30.122056] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-22T18:22:30.922057] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-22T18:22:31.101355] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T18:22:31.680401] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T18:22:31.722015] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-22T18:22:32.522075] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-22T18:22:33.054414] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-22T18:22:33.063176] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-22T18:22:33.063321] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-22T18:22:33.322390] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-22T18:22:33.492594] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-22T18:22:33.492754] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-22T18:22:33.493777] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-22T18:22:33.493938] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-22T18:22:33.522923] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T18:22:33.521951] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 53788 (keeping 200 days of data) [2025-09-22T18:22:33.810444] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T18:22:33.901503] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-22T18:22:33.901682] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-22T18:22:33.901788] [INFO ] [MAIN ] Update Progress: 624/2372 symbols completed. DIS took 33.0s. Estimated remaining: 3h 51m 7s. Rate: 7.6 symbols/min [2025-09-22T18:22:34.075359] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:22:34.127337] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-22T18:22:34.130790] [DEBUG] [LOCAL ] DKS: Loaded 50730 existing records from primary storage. [2025-09-22T18:22:34.131058] [INFO ] [MAIN ] DKS: Loaded 50730 existing records. [2025-09-22T18:22:34.315722] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:22:34.315950] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-22T18:22:34.315998] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-22T18:22:34.317467] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-22T18:22:34.317529] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-22T18:22:34.671800] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:34.922009] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-22T18:22:35.266405] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-22T18:22:35.274924] [INFO ] [REMOTE ] DINO: Full fetch complete (76655 records). [2025-09-22T18:22:35.275048] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-22T18:22:35.587560] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T18:22:35.691146] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-22T18:22:35.691224] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-22T18:22:35.692069] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-22T18:22:35.692134] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-22T18:22:35.693553] [DEBUG] [LOCAL ] DINO: Trimmed 76655 records to 52964 (keeping 200 days of data) [2025-09-22T18:22:35.751092] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-22T18:22:36.021956] [DEBUG] [LOCAL ] DINO: Primary data saved (52964 records). [2025-09-22T18:22:36.022133] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-22T18:22:36.022231] [INFO ] [MAIN ] Update Progress: 625/2372 symbols completed. DINO took 36.5s. Estimated remaining: 3h 50m 42s. Rate: 7.6 symbols/min [2025-09-22T18:22:36.193433] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:22:36.227459] [DEBUG] [LOCAL ] DLB: Loaded 32772 existing records from primary storage. [2025-09-22T18:22:36.227596] [INFO ] [MAIN ] DLB: Loaded 32772 existing records. [2025-09-22T18:22:36.417882] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:22:36.418414] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-22T18:22:36.418517] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-22T18:22:36.419764] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-22T18:22:36.419842] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-22T18:22:36.552246] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-22T18:22:36.561022] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T18:22:36.825335] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:37.250415] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T18:22:37.322029] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-22T18:22:38.122066] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-22T18:22:38.304480] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T18:22:38.846079] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T18:22:38.922061] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-22T18:22:39.682091] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T18:22:39.722032] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-22T18:22:39.781428] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T18:22:40.522069] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-22T18:22:41.289933] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T18:22:41.322025] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-22T18:22:41.480149] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T18:22:42.122071] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-22T18:22:42.319061] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T18:22:42.922084] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-22T18:22:43.651439] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T18:22:43.722058] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-22T18:22:43.974550] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T18:22:44.522129] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-22T18:22:45.322096] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-22T18:22:45.397454] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T18:22:45.655381] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T18:22:45.663424] [INFO ] [REMOTE ] DK: Full fetch complete (70253 records). [2025-09-22T18:22:45.663583] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-22T18:22:45.664527] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:22:45.664632] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:22:45.664718] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:22:45.664766] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-22T18:22:45.664828] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-22T18:22:45.664894] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-09-22T18:22:45.665378] [DEBUG] [LOCAL ] DK: Deleted derivative data file. [2025-09-22T18:22:45.665504] [INFO ] [MAIN ] Update Progress: 626/2372 symbols completed. DK took 38.2s. Estimated remaining: 3h 50m 39s. Rate: 7.6 symbols/min [2025-09-22T18:22:45.841086] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:22:45.850805] [DEBUG] [LOCAL ] DLNG: Loaded 6395 existing records from primary storage. [2025-09-22T18:22:45.850912] [INFO ] [MAIN ] DLNG: Loaded 6395 existing records. [2025-09-22T18:22:46.028001] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:22:46.028318] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-22T18:22:46.028377] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-22T18:22:46.028703] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-22T18:22:46.028763] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-22T18:22:46.128428] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-22T18:22:46.387552] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:46.922077] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-22T18:22:47.062032] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T18:22:47.082269] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T18:22:47.722081] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-22T18:22:47.966785] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T18:22:48.476322] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T18:22:48.479066] [INFO ] [REMOTE ] DKL: Full fetch complete (29525 records). [2025-09-22T18:22:48.479150] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-22T18:22:48.532232] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-22T18:22:48.873378] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-22T18:22:48.873470] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-22T18:22:48.874150] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-22T18:22:48.874226] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-22T18:22:48.875113] [DEBUG] [LOCAL ] DKL: Trimmed 29525 records to 19282 (keeping 200 days of data) [2025-09-22T18:22:49.001053] [DEBUG] [LOCAL ] DKL: Primary data saved (19282 records). [2025-09-22T18:22:49.001207] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-22T18:22:49.001294] [INFO ] [MAIN ] Update Progress: 627/2372 symbols completed. DKL took 23.9s. Estimated remaining: 3h 50m 19s. Rate: 7.6 symbols/min [2025-09-22T18:22:49.179791] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:22:49.250775] [DEBUG] [LOCAL ] DLR: Loaded 51987 existing records from primary storage. [2025-09-22T18:22:49.250969] [INFO ] [MAIN ] DLR: Loaded 51987 existing records. [2025-09-22T18:22:49.327209] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-22T18:22:49.452596] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:22:49.452914] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-22T18:22:49.452971] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-22T18:22:49.454026] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-22T18:22:49.454085] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-22T18:22:49.856520] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:50.122105] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-22T18:22:50.228984] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T18:22:50.246116] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T18:22:50.922110] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-22T18:22:51.722116] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-22T18:22:52.072303] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T18:22:52.174560] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-22T18:22:52.400422] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T18:22:52.522103] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-22T18:22:53.322169] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-22T18:22:53.897943] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T18:22:54.122060] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-22T18:22:54.922096] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-22T18:22:55.244003] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T18:22:55.609587] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T18:22:55.722051] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-22T18:22:56.522072] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-22T18:22:56.652683] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T18:22:56.805791] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T18:22:56.811253] [INFO ] [REMOTE ] DLB: Full fetch complete (46749 records). [2025-09-22T18:22:56.811380] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-22T18:22:56.811989] [FATAL] [VALIDATOR ] DLB: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:22:56.812076] [FATAL] [MAIN ] DLB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:22:56.812163] [WARN ] [MAIN ] DLB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:22:56.812242] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-22T18:22:56.812307] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-09-22T18:22:56.812343] [INFO ] [LOCAL ] DLB: Starting deletion of derivative data. [2025-09-22T18:22:56.812787] [DEBUG] [LOCAL ] DLB: Deleted derivative data file. [2025-09-22T18:22:56.812898] [INFO ] [MAIN ] Update Progress: 628/2372 symbols completed. DLB took 20.8s. Estimated remaining: 3h 50m 10s. Rate: 7.6 symbols/min [2025-09-22T18:22:56.988354] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:22:57.021246] [DEBUG] [LOCAL ] DLX: Loaded 29746 existing records from primary storage. [2025-09-22T18:22:57.021368] [INFO ] [MAIN ] DLX: Loaded 29746 existing records. [2025-09-22T18:22:57.202378] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:22:57.202702] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-22T18:22:57.202772] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-22T18:22:57.203592] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-22T18:22:57.203695] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-22T18:22:57.327166] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-22T18:22:57.570175] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:22:58.053835] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T18:22:58.071976] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T18:22:58.122004] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-22T18:22:58.867426] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-22T18:22:58.922089] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-22T18:22:59.722054] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-22T18:23:00.522074] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-22T18:23:00.735693] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T18:23:00.989246] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T18:23:01.322008] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-22T18:23:01.403300] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-22T18:23:02.122113] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-22T18:23:02.922077] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-22T18:23:03.722087] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-22T18:23:03.801839] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T18:23:04.522063] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-22T18:23:05.223813] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T18:23:05.322057] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-22T18:23:05.911458] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (4.59 seconds). [2025-09-22T18:23:05.933976] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-22T18:23:06.088286] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (3.17 seconds). [2025-09-22T18:23:06.122160] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-22T18:23:06.283835] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T18:23:06.922062] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-22T18:23:07.710695] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T18:23:07.721978] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-22T18:23:08.466794] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T18:23:08.522035] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-22T18:23:09.298374] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T18:23:09.306067] [INFO ] [REMOTE ] DKS: Full fetch complete (71254 records). [2025-09-22T18:23:09.306286] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-22T18:23:09.307131] [FATAL] [VALIDATOR ] DKS: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:23:09.307232] [FATAL] [MAIN ] DKS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:23:09.307276] [WARN ] [MAIN ] DKS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:23:09.307315] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-22T18:23:09.307393] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-09-22T18:23:09.307451] [INFO ] [LOCAL ] DKS: Starting deletion of derivative data. [2025-09-22T18:23:09.308011] [DEBUG] [LOCAL ] DKS: Deleted derivative data file. [2025-09-22T18:23:09.308116] [INFO ] [MAIN ] Update Progress: 629/2372 symbols completed. DKS took 35.4s. Estimated remaining: 3h 50m 15s. Rate: 7.6 symbols/min [2025-09-22T18:23:09.329218] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-22T18:23:09.486104] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:23:09.508587] [DEBUG] [LOCAL ] DLY: Loaded 19696 existing records from primary storage. [2025-09-22T18:23:09.508743] [INFO ] [MAIN ] DLY: Loaded 19696 existing records. [2025-09-22T18:23:09.683667] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:23:09.683940] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-22T18:23:09.683993] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-22T18:23:09.684595] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-22T18:23:09.684688] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-22T18:23:10.041273] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:23:10.122078] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-22T18:23:10.339433] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T18:23:10.777158] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T18:23:10.922070] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-22T18:23:10.978505] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T18:23:11.722060] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-22T18:23:11.796512] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-22T18:23:12.522068] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-22T18:23:13.157046] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T18:23:13.322043] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-22T18:23:13.923605] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T18:23:13.974974] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T18:23:14.122026] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-22T18:23:14.922062] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-22T18:23:15.029620] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T18:23:15.722109] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-22T18:23:16.503717] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T18:23:16.521999] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-22T18:23:17.322038] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-22T18:23:17.445252] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T18:23:17.497149] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T18:23:18.122051] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-22T18:23:18.265476] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-22T18:23:18.922050] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-22T18:23:19.126794] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T18:23:19.722060] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-22T18:23:19.924110] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-22T18:23:20.522052] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-22T18:23:20.910812] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-22T18:23:21.041751] [DEBUG] [REMOTE ] DLR: Error fetching primary data for 2025-07: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-22T18:23:21.041905] [WARN ] [REMOTE ] DLR: No data returned for month 2025-07 [2025-09-22T18:23:21.322059] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-22T18:23:22.122102] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-22T18:23:22.212898] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T18:23:22.568862] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T18:23:22.570306] [INFO ] [REMOTE ] DLNG: Full fetch complete (12064 records). [2025-09-22T18:23:22.570376] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-22T18:23:22.931941] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-22T18:23:22.942714] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-22T18:23:22.942806] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-22T18:23:22.943188] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-22T18:23:22.943253] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-22T18:23:22.943883] [DEBUG] [LOCAL ] DLNG: Trimmed 12064 records to 6220 (keeping 200 days of data) [2025-09-22T18:23:22.983697] [DEBUG] [LOCAL ] DLNG: Primary data saved (6220 records). [2025-09-22T18:23:22.983857] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-22T18:23:22.983959] [INFO ] [MAIN ] Update Progress: 630/2372 symbols completed. DLNG took 37.3s. Estimated remaining: 3h 50m 23s. Rate: 7.6 symbols/min [2025-09-22T18:23:23.162201] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:23:23.168427] [DEBUG] [LOCAL ] DMA: Loaded 4603 existing records from primary storage. [2025-09-22T18:23:23.168521] [INFO ] [MAIN ] DMA: Loaded 4603 existing records. [2025-09-22T18:23:23.386350] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:23:23.386720] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-22T18:23:23.386791] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-22T18:23:23.387115] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-22T18:23:23.387174] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-22T18:23:23.727184] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-22T18:23:23.770738] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:23:24.522139] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-22T18:23:24.807959] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T18:23:24.927300] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T18:23:25.089936] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T18:23:25.322052] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-22T18:23:26.122054] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-22T18:23:26.681682] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-22T18:23:26.922041] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-22T18:23:27.092939] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T18:23:27.103411] [INFO ] [REMOTE ] DLR: Full fetch complete (66287 records). [2025-09-22T18:23:27.103574] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-22T18:23:27.310173] [WARN ] [VALIDATOR ] DLR: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-22T18:23:27.310893] [FATAL] [MAIN ] DLR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:23:27.310985] [WARN ] [MAIN ] DLR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:23:27.311062] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-22T18:23:27.311132] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-09-22T18:23:27.311168] [INFO ] [LOCAL ] DLR: Starting deletion of derivative data. [2025-09-22T18:23:27.311745] [DEBUG] [LOCAL ] DLR: Deleted derivative data file. [2025-09-22T18:23:27.311864] [INFO ] [MAIN ] Update Progress: 631/2372 symbols completed. DLR took 38.3s. Estimated remaining: 3h 50m 5s. Rate: 7.6 symbols/min [2025-09-22T18:23:27.488854] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:23:27.502047] [DEBUG] [LOCAL ] DMB: Loaded 10260 existing records from primary storage. [2025-09-22T18:23:27.502179] [INFO ] [MAIN ] DMB: Loaded 10260 existing records. [2025-09-22T18:23:27.710148] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:23:27.720622] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-22T18:23:27.720780] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-22T18:23:27.721864] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-22T18:23:27.722012] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-22T18:23:27.725793] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-22T18:23:27.725505] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-22T18:23:28.092387] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:23:28.522123] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-22T18:23:28.944500] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T18:23:28.950000] [INFO ] [REMOTE ] DLX: Full fetch complete (41187 records). [2025-09-22T18:23:28.950212] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-22T18:23:29.324472] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-22T18:23:29.355029] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T18:23:29.399407] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-22T18:23:29.399546] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-22T18:23:29.401258] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-22T18:23:29.401408] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-22T18:23:29.406683] [DEBUG] [LOCAL ] DLX: Trimmed 41187 records to 29127 (keeping 200 days of data) [2025-09-22T18:23:29.616561] [DEBUG] [LOCAL ] DLX: Primary data saved (29127 records). [2025-09-22T18:23:29.616797] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-22T18:23:29.616988] [INFO ] [MAIN ] Update Progress: 632/2372 symbols completed. DLX took 32.8s. Estimated remaining: 3h 49m 42s. Rate: 7.6 symbols/min [2025-09-22T18:23:29.797877] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:23:29.798252] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-09-22T18:23:29.798306] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-09-22T18:23:29.798477] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-22T18:23:29.798523] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-22T18:23:29.798564] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-22T18:23:29.798632] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-22T18:23:30.049352] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T18:23:30.127187] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-22T18:23:30.230376] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:23:30.700432] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-22T18:23:30.922025] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-22T18:23:31.629349] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T18:23:31.722073] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-22T18:23:32.320396] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T18:23:32.522075] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-22T18:23:33.238668] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T18:23:33.322068] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-22T18:23:34.122077] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-22T18:23:34.200115] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T18:23:34.922068] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-22T18:23:35.135898] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T18:23:35.715018] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T18:23:35.721990] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-22T18:23:36.336893] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T18:23:36.522057] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-22T18:23:37.322063] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-22T18:23:37.539064] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T18:23:38.118691] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-22T18:23:38.122016] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-22T18:23:38.885678] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-22T18:23:38.922109] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-22T18:23:39.722114] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-22T18:23:39.766850] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-22T18:23:40.225590] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-22T18:23:40.522078] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-22T18:23:41.297959] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-22T18:23:41.322014] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-22T18:23:41.783527] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-22T18:23:42.122064] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-22T18:23:42.919269] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T18:23:42.921994] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-22T18:23:43.567788] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-22T18:23:43.722069] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-22T18:23:44.522104] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-22T18:23:44.936976] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T18:23:44.941448] [INFO ] [REMOTE ] DLY: Full fetch complete (28173 records). [2025-09-22T18:23:44.941576] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-22T18:23:45.324704] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-22T18:23:45.355480] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-22T18:23:45.355561] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-22T18:23:45.356089] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-22T18:23:45.356163] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-22T18:23:45.356983] [DEBUG] [LOCAL ] DLY: Trimmed 28173 records to 19427 (keeping 200 days of data) [2025-09-22T18:23:45.492555] [DEBUG] [LOCAL ] DLY: Primary data saved (19427 records). [2025-09-22T18:23:45.492742] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-22T18:23:45.492909] [INFO ] [MAIN ] Update Progress: 633/2372 symbols completed. DLY took 36.2s. Estimated remaining: 3h 49m 56s. Rate: 7.6 symbols/min [2025-09-22T18:23:45.649387] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T18:23:45.687103] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:23:45.748223] [DEBUG] [LOCAL ] DNA: Loaded 49205 existing records from primary storage. [2025-09-22T18:23:45.748410] [INFO ] [MAIN ] DNA: Loaded 49205 existing records. [2025-09-22T18:23:45.842051] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-22T18:23:45.931675] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:23:45.931938] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-22T18:23:45.932026] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-22T18:23:45.932992] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-22T18:23:45.933068] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-22T18:23:46.128438] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-22T18:23:46.346790] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:23:46.859976] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T18:23:46.922074] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-22T18:23:47.414264] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-22T18:23:47.722078] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-22T18:23:48.514928] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T18:23:48.521994] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-22T18:23:49.318053] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-22T18:23:49.321995] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-22T18:23:50.122098] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-22T18:23:50.244796] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T18:23:50.809128] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T18:23:50.922058] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-22T18:23:51.605243] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T18:23:51.722076] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-22T18:23:52.522076] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-22T18:23:53.207122] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T18:23:53.208777] [INFO ] [REMOTE ] DMA: Full fetch complete (6511 records). [2025-09-22T18:23:53.208849] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-22T18:23:53.325466] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-22T18:23:53.603744] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-22T18:23:53.603928] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-22T18:23:53.604162] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-22T18:23:53.604273] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-22T18:23:53.614994] [DEBUG] [LOCAL ] DMA: Trimmed 6511 records to 4495 (keeping 200 days of data) [2025-09-22T18:23:53.645867] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-22T18:23:53.672968] [DEBUG] [LOCAL ] DMA: Primary data saved (4495 records). [2025-09-22T18:23:53.673119] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-22T18:23:53.673265] [INFO ] [MAIN ] Update Progress: 634/2372 symbols completed. DMA took 30.7s. Estimated remaining: 3h 49m 48s. Rate: 7.6 symbols/min [2025-09-22T18:23:53.845861] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:23:53.911693] [DEBUG] [LOCAL ] DNOW: Loaded 44148 existing records from primary storage. [2025-09-22T18:23:53.912039] [INFO ] [MAIN ] DNOW: Loaded 44148 existing records. [2025-09-22T18:23:54.094901] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:23:54.095284] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-22T18:23:54.095343] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-22T18:23:54.096921] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-22T18:23:54.096991] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-22T18:23:54.128303] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-22T18:23:54.466575] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:23:54.508496] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T18:23:54.511067] [INFO ] [REMOTE ] DMB: Full fetch complete (15057 records). [2025-09-22T18:23:54.511141] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-22T18:23:54.880967] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-22T18:23:54.881092] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-22T18:23:54.881479] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-22T18:23:54.881521] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-22T18:23:54.882673] [DEBUG] [LOCAL ] DMB: Trimmed 15057 records to 10109 (keeping 200 days of data) [2025-09-22T18:23:54.932293] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-22T18:23:54.951309] [DEBUG] [LOCAL ] DMB: Primary data saved (10109 records). [2025-09-22T18:23:54.951447] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-22T18:23:54.951532] [INFO ] [MAIN ] Update Progress: 635/2372 symbols completed. DMB took 27.6s. Estimated remaining: 3h 49m 22s. Rate: 7.6 symbols/min [2025-09-22T18:23:55.121612] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:23:55.168135] [DEBUG] [LOCAL ] DNP: Loaded 33926 existing records from primary storage. [2025-09-22T18:23:55.168279] [INFO ] [MAIN ] DNP: Loaded 33926 existing records. [2025-09-22T18:23:55.351769] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:23:55.352041] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-22T18:23:55.352089] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-22T18:23:55.353052] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-22T18:23:55.353111] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-22T18:23:55.707624] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:23:55.722007] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-22T18:23:55.961840] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T18:23:56.069238] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T18:23:56.522061] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-22T18:23:57.212848] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T18:23:57.322064] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-22T18:23:58.122066] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-22T18:23:58.547607] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-22T18:23:58.702210] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T18:23:58.922069] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-22T18:23:59.591559] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T18:23:59.722127] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-22T18:24:00.522087] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-22T18:24:00.968064] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T18:24:00.970383] [INFO ] [REMOTE ] DMO: Full fetch complete (14468 records). [2025-09-22T18:24:00.970475] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-22T18:24:01.336047] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-22T18:24:01.371046] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-22T18:24:01.371935] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-22T18:24:01.372342] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-22T18:24:01.372493] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-22T18:24:01.401722] [DEBUG] [LOCAL ] DMO: Trimmed 14468 records to 9863 (keeping 200 days of data) [2025-09-22T18:24:01.404093] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-22T18:24:01.488787] [DEBUG] [LOCAL ] DMO: Primary data saved (9863 records). [2025-09-22T18:24:01.488941] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-22T18:24:01.489021] [INFO ] [MAIN ] Update Progress: 636/2372 symbols completed. DMO took 31.9s. Estimated remaining: 3h 49m 11s. Rate: 7.6 symbols/min [2025-09-22T18:24:01.689592] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:24:01.751327] [DEBUG] [LOCAL ] DOC: Loaded 54313 existing records from primary storage. [2025-09-22T18:24:01.751503] [INFO ] [MAIN ] DOC: Loaded 54313 existing records. [2025-09-22T18:24:01.933777] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:24:01.934083] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-22T18:24:01.934133] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-22T18:24:01.935980] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-22T18:24:01.936044] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-22T18:24:02.148960] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-22T18:24:02.309592] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:24:02.560489] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-22T18:24:02.922058] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-22T18:24:03.722104] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-22T18:24:04.653845] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (3.32 seconds). [2025-09-22T18:24:04.662674] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-22T18:24:06.311245] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (3.39 seconds). [2025-09-22T18:24:06.318707] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-22T18:24:06.384099] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T18:24:06.393536] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-22T18:24:06.429022] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (4.28 seconds). [2025-09-22T18:24:06.672371] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-09-22T18:24:06.922064] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-22T18:24:07.722085] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-22T18:24:08.001688] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T18:24:08.128133] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T18:24:08.391580] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T18:24:08.522084] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-22T18:24:09.322060] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-22T18:24:09.557241] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T18:24:09.868747] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T18:24:10.122071] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-22T18:24:10.840005] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T18:24:10.922028] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-22T18:24:11.722113] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-22T18:24:11.908368] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T18:24:12.522076] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-22T18:24:12.878678] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T18:24:13.044953] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T18:24:13.322070] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-22T18:24:14.117784] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T18:24:14.127953] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-22T18:24:14.922064] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-22T18:24:15.722114] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-22T18:24:16.597614] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-22T18:24:16.607097] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-22T18:24:16.754363] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (3.43 seconds). [2025-09-22T18:24:17.224594] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-22T18:24:17.322062] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-22T18:24:17.680155] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T18:24:17.982001] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T18:24:18.122071] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-22T18:24:18.922117] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-22T18:24:18.989447] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T18:24:19.722120] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-22T18:24:20.119121] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T18:24:20.126928] [INFO ] [REMOTE ] DNA: Full fetch complete (70994 records). [2025-09-22T18:24:20.127086] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-22T18:24:20.527552] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-22T18:24:20.529766] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-22T18:24:20.529827] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-22T18:24:20.530813] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-22T18:24:20.530973] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-22T18:24:20.532600] [DEBUG] [LOCAL ] DNA: Trimmed 70994 records to 48411 (keeping 200 days of data) [2025-09-22T18:24:20.661912] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T18:24:20.853332] [DEBUG] [LOCAL ] DNA: Primary data saved (48411 records). [2025-09-22T18:24:20.853476] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-22T18:24:20.853563] [INFO ] [MAIN ] Update Progress: 637/2372 symbols completed. DNA took 35.4s. Estimated remaining: 3h 49m 34s. Rate: 7.6 symbols/min [2025-09-22T18:24:20.967035] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T18:24:21.322069] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-22T18:24:22.105507] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T18:24:22.122004] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-22T18:24:22.612841] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T18:24:22.922071] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-22T18:24:23.722066] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-22T18:24:24.092421] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T18:24:24.500869] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T18:24:24.508362] [INFO ] [REMOTE ] DNOW: Full fetch complete (62302 records). [2025-09-22T18:24:24.508508] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-22T18:24:24.542472] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-22T18:24:24.908844] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-22T18:24:24.909071] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-22T18:24:24.910171] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-22T18:24:24.910278] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-22T18:24:24.925806] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T18:24:24.930774] [DEBUG] [LOCAL ] DNOW: Trimmed 62302 records to 43495 (keeping 200 days of data) [2025-09-22T18:24:24.931789] [INFO ] [REMOTE ] DNP: Full fetch complete (49213 records). [2025-09-22T18:24:24.932226] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-22T18:24:24.932992] [FATAL] [VALIDATOR ] DNP: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:24:24.933087] [FATAL] [MAIN ] DNP: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:24:24.933132] [WARN ] [MAIN ] DNP: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:24:24.933223] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-22T18:24:24.933307] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-09-22T18:24:24.933348] [INFO ] [LOCAL ] DNP: Starting deletion of derivative data. [2025-09-22T18:24:24.933842] [DEBUG] [LOCAL ] DNP: Deleted derivative data file. [2025-09-22T18:24:24.933950] [INFO ] [MAIN ] Update Progress: 638/2372 symbols completed. DNP took 30.0s. Estimated remaining: 3h 49m 15s. Rate: 7.6 symbols/min [2025-09-22T18:24:25.197341] [DEBUG] [LOCAL ] DNOW: Primary data saved (43495 records). [2025-09-22T18:24:25.197480] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-22T18:24:25.197563] [INFO ] [MAIN ] Update Progress: 639/2372 symbols completed. DNOW took 31.5s. Estimated remaining: 3h 48m 47s. Rate: 7.6 symbols/min [2025-09-22T18:24:26.430546] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T18:24:26.443493] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-22T18:24:28.494301] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-22T18:24:28.502351] [INFO ] [REMOTE ] DOC: Full fetch complete (76977 records). [2025-09-22T18:24:28.502484] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-22T18:24:28.503322] [FATAL] [VALIDATOR ] DOC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:24:28.503427] [FATAL] [MAIN ] DOC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:24:28.503505] [WARN ] [MAIN ] DOC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:24:28.503598] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-22T18:24:28.503719] [DEBUG] [LOCAL ] DOC: No primary data file found to delete. [2025-09-22T18:24:28.503772] [INFO ] [LOCAL ] DOC: Starting deletion of derivative data. [2025-09-22T18:24:28.504182] [DEBUG] [LOCAL ] DOC: Deleted derivative data file. [2025-09-22T18:24:28.504280] [INFO ] [MAIN ] Update Progress: 640/2372 symbols completed. DOC took 27.0s. Estimated remaining: 3h 48m 26s. Rate: 7.6 symbols/min [2025-09-22T18:24:29.057180] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:24:29.209983] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:24:29.211354] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:24:29.209084] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:24:29.212244] [DEBUG] [LOCAL ] DOLE: No existing data file found in primary storage. [2025-09-22T18:24:29.212360] [WARN ] [MAIN ] DOLE: No existing data found, performing full refresh instead. [2025-09-22T18:24:29.213166] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-22T18:24:29.214583] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-22T18:24:29.214961] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-09-22T18:24:29.215023] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-22T18:24:29.447058] [DEBUG] [LOCAL ] DOUG: Loaded 35374 existing records from primary storage. [2025-09-22T18:24:29.447460] [INFO ] [MAIN ] DOUG: Loaded 35374 existing records. [2025-09-22T18:24:29.585481] [DEBUG] [LOCAL ] DOCS: Loaded 52104 existing records from primary storage. [2025-09-22T18:24:29.644527] [DEBUG] [LOCAL ] DOCN: Loaded 51180 existing records from primary storage. [2025-09-22T18:24:29.635067] [INFO ] [MAIN ] DOCS: Loaded 52104 existing records. [2025-09-22T18:24:29.708029] [INFO ] [MAIN ] DOCN: Loaded 51180 existing records. [2025-09-22T18:24:29.903427] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:24:29.998708] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-22T18:24:30.052397] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-22T18:24:30.088394] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-22T18:24:30.138831] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-22T18:24:30.149458] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:24:30.187224] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:24:30.221507] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-22T18:24:30.245901] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-22T18:24:30.279594] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-22T18:24:30.355496] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:24:30.366479] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-22T18:24:30.371839] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-22T18:24:30.366687] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-22T18:24:30.377044] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-22T18:24:30.425589] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-22T18:24:30.481151] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-22T18:24:30.960854] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:24:31.014279] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-22T18:24:31.363104] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:24:31.369420] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-22T18:24:31.391880] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:24:31.392220] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-22T18:24:31.831817] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T18:24:31.838962] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-22T18:24:32.466871] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T18:24:32.476279] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-22T18:24:32.978740] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T18:24:32.991278] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-22T18:24:33.078596] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T18:24:33.088197] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-22T18:24:33.478179] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T18:24:33.485788] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-22T18:24:33.551763] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T18:24:33.559232] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-22T18:24:34.273411] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T18:24:34.286595] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-22T18:24:34.720783] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T18:24:34.722553] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T18:24:34.795818] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T18:24:34.922004] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-22T18:24:35.722065] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-22T18:24:35.885192] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T18:24:36.338771] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T18:24:36.522023] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-22T18:24:37.147290] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T18:24:37.322048] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-22T18:24:38.127180] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-22T18:24:38.140314] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T18:24:38.787795] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T18:24:38.922109] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-22T18:24:39.728076] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-22T18:24:39.746332] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T18:24:40.522129] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-22T18:24:40.729844] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T18:24:41.229908] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T18:24:41.322030] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-22T18:24:41.435380] [DEBUG] [REMOTE ] DOLE: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-22T18:24:41.435725] [WARN ] [REMOTE ] DOLE: No data returned for month 2025-06 [2025-09-22T18:24:42.122037] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-22T18:24:42.203333] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T18:24:42.922089] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-22T18:24:43.722069] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-22T18:24:44.043856] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T18:24:44.522116] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-22T18:24:44.869932] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T18:24:45.038885] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T18:24:45.322042] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-22T18:24:46.122100] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-22T18:24:46.444146] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-22T18:24:46.735893] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T18:24:46.922027] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-22T18:24:47.645359] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T18:24:47.722005] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-22T18:24:48.273512] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:24:48.522068] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-22T18:24:49.177493] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T18:24:49.322066] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-22T18:24:50.122173] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-22T18:24:50.257968] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T18:24:50.889998] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T18:24:50.897146] [INFO ] [REMOTE ] DOLE: Full fetch complete (47640 records). [2025-09-22T18:24:50.897322] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-22T18:24:50.898222] [FATAL] [VALIDATOR ] DOLE: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:24:50.898342] [FATAL] [MAIN ] DOLE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:24:50.898398] [WARN ] [MAIN ] DOLE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:24:50.898448] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-22T18:24:50.898550] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-09-22T18:24:50.898626] [INFO ] [LOCAL ] DOLE: Starting deletion of derivative data. [2025-09-22T18:24:50.898765] [DEBUG] [LOCAL ] DOLE: No derivative data file found to delete. [2025-09-22T18:24:50.898887] [INFO ] [MAIN ] Update Progress: 641/2372 symbols completed. DOLE took 22.4s. Estimated remaining: 3h 48m 58s. Rate: 7.6 symbols/min [2025-09-22T18:24:50.934498] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-22T18:24:51.173597] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:24:51.225137] [DEBUG] [LOCAL ] DOV: Loaded 46479 existing records from primary storage. [2025-09-22T18:24:51.225327] [INFO ] [MAIN ] DOV: Loaded 46479 existing records. [2025-09-22T18:24:51.436254] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:24:51.436766] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-22T18:24:51.436855] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-22T18:24:51.438704] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-22T18:24:51.438792] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-22T18:24:51.635566] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T18:24:51.727223] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-22T18:24:51.989929] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:24:52.447703] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T18:24:52.522100] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-22T18:24:53.322084] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-22T18:24:53.668397] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T18:24:54.122074] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-22T18:24:54.167257] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T18:24:54.673031] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T18:24:54.922068] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-22T18:24:55.722107] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-22T18:24:55.874270] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T18:24:56.384072] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T18:24:56.522033] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-22T18:24:57.211839] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T18:24:57.217141] [INFO ] [REMOTE ] DOUG: Full fetch complete (51682 records). [2025-09-22T18:24:57.217239] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-22T18:24:57.327134] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-22T18:24:57.607713] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-22T18:24:57.607804] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-22T18:24:57.608470] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-22T18:24:57.608512] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-22T18:24:57.609669] [DEBUG] [LOCAL ] DOUG: Trimmed 51682 records to 34760 (keeping 200 days of data) [2025-09-22T18:24:57.810113] [DEBUG] [LOCAL ] DOUG: Primary data saved (34760 records). [2025-09-22T18:24:57.810265] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-22T18:24:57.810353] [INFO ] [MAIN ] Update Progress: 642/2372 symbols completed. DOUG took 29.3s. Estimated remaining: 3h 48m 47s. Rate: 7.6 symbols/min [2025-09-22T18:24:57.988557] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:24:58.024188] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T18:24:58.033532] [INFO ] [REMOTE ] DOCS: Full fetch complete (74231 records). [2025-09-22T18:24:58.033884] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-22T18:24:58.125553] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-22T18:24:58.226486] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-22T18:24:58.246622] [INFO ] [MAIN ] DOW: Loaded 54513 existing records. [2025-09-22T18:24:58.649314] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:24:58.670888] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-22T18:24:58.670986] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-22T18:24:58.671125] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-22T18:24:58.671201] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-22T18:24:58.672183] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-22T18:24:58.672267] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-22T18:24:58.673941] [DEBUG] [LOCAL ] DOCS: Trimmed 74231 records to 51285 (keeping 200 days of data) [2025-09-22T18:24:58.674401] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-22T18:24:58.674479] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-22T18:24:59.170233] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:24:59.173480] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-22T18:24:59.376723] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-22T18:24:59.391182] [INFO ] [REMOTE ] DOCN: Full fetch complete (71113 records). [2025-09-22T18:24:59.392760] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-22T18:24:59.396973] [DEBUG] [LOCAL ] DOCS: Primary data saved (51285 records). [2025-09-22T18:24:59.431438] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-22T18:24:59.443688] [INFO ] [MAIN ] Update Progress: 643/2372 symbols completed. DOCS took 30.9s. Estimated remaining: 3h 48m 22s. Rate: 7.6 symbols/min [2025-09-22T18:24:59.869268] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:24:59.895901] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-09-22T18:24:59.919722] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-09-22T18:24:59.920264] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-22T18:24:59.920345] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-22T18:24:59.920443] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-22T18:24:59.920541] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-22T18:25:00.143568] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-22T18:25:00.144468] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-22T18:25:00.150944] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-22T18:25:00.198453] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-22T18:25:00.347458] [DEBUG] [LOCAL ] DOCN: Trimmed 71113 records to 50462 (keeping 200 days of data) [2025-09-22T18:25:00.384307] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-22T18:25:00.469370] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-22T18:25:00.575212] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:25:00.580278] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-22T18:25:00.773426] [DEBUG] [LOCAL ] DOCN: Primary data saved (50462 records). [2025-09-22T18:25:00.773555] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-22T18:25:00.773638] [INFO ] [MAIN ] Update Progress: 644/2372 symbols completed. DOCN took 32.3s. Estimated remaining: 3h 47m 56s. Rate: 7.6 symbols/min [2025-09-22T18:25:00.955485] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:25:01.001301] [DEBUG] [LOCAL ] DQ: Loaded 43775 existing records from primary storage. [2025-09-22T18:25:01.001474] [INFO ] [MAIN ] DQ: Loaded 43775 existing records. [2025-09-22T18:25:01.196885] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:25:01.197238] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-22T18:25:01.197311] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-22T18:25:01.198757] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-22T18:25:01.198848] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-22T18:25:01.459583] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-22T18:25:01.481906] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T18:25:01.522089] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-22T18:25:01.654942] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:25:01.756339] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T18:25:02.122106] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-22T18:25:02.470596] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T18:25:02.922127] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-22T18:25:03.579165] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T18:25:03.722070] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-22T18:25:03.876406] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T18:25:04.407252] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-22T18:25:04.522151] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-22T18:25:05.322055] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-22T18:25:05.561868] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T18:25:06.122115] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-22T18:25:06.922056] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-22T18:25:07.276475] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T18:25:07.588589] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T18:25:07.722113] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-22T18:25:07.790628] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T18:25:08.522055] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-22T18:25:09.250710] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T18:25:09.279117] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T18:25:09.322059] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-22T18:25:10.079404] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T18:25:10.122014] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-22T18:25:10.828720] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T18:25:10.922032] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-22T18:25:11.722060] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-22T18:25:12.522081] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-22T18:25:12.704084] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T18:25:13.279370] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T18:25:13.322024] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-22T18:25:14.122056] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-22T18:25:14.241831] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T18:25:14.244277] [INFO ] [REMOTE ] DPG: Full fetch complete (18881 records). [2025-09-22T18:25:14.244352] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-22T18:25:14.620825] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-22T18:25:14.621060] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-22T18:25:14.621577] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-22T18:25:14.621674] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-22T18:25:14.646288] [DEBUG] [LOCAL ] DPG: Trimmed 18881 records to 13309 (keeping 200 days of data) [2025-09-22T18:25:14.648400] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-22T18:25:14.737974] [DEBUG] [LOCAL ] DPG: Primary data saved (13309 records). [2025-09-22T18:25:14.738122] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-22T18:25:14.738200] [INFO ] [MAIN ] Update Progress: 645/2372 symbols completed. DPG took 15.3s. Estimated remaining: 3h 48m 5s. Rate: 7.6 symbols/min [2025-09-22T18:25:14.924693] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-22T18:25:14.926219] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:25:14.966115] [DEBUG] [LOCAL ] DRD: Loaded 37026 existing records from primary storage. [2025-09-22T18:25:14.966253] [INFO ] [MAIN ] DRD: Loaded 37026 existing records. [2025-09-22T18:25:15.141418] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:25:15.141674] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-22T18:25:15.141733] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-22T18:25:15.142843] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-22T18:25:15.142904] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-22T18:25:15.495792] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:25:15.722042] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-22T18:25:16.067209] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-22T18:25:16.484996] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T18:25:16.522006] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-22T18:25:17.322043] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-22T18:25:17.378725] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T18:25:18.122092] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-22T18:25:18.241027] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T18:25:18.922066] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-22T18:25:19.168172] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T18:25:19.286546] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T18:25:19.722070] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-22T18:25:20.102251] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T18:25:20.522102] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-22T18:25:21.322069] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-22T18:25:21.699247] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T18:25:21.890357] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-22T18:25:22.122068] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-22T18:25:22.536191] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T18:25:22.922070] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-22T18:25:23.722125] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-22T18:25:24.221351] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-22T18:25:24.265034] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T18:25:24.522113] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-22T18:25:25.148342] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T18:25:25.322030] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-22T18:25:26.092920] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T18:25:26.122044] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-22T18:25:26.922069] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-22T18:25:27.540713] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-22T18:25:27.578837] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T18:25:27.722055] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-22T18:25:28.522072] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-22T18:25:28.576838] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T18:25:29.322072] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-22T18:25:29.499146] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T18:25:30.122049] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-22T18:25:30.170819] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T18:25:30.922088] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-22T18:25:31.072897] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T18:25:31.081467] [INFO ] [REMOTE ] DQ: Full fetch complete (62550 records). [2025-09-22T18:25:31.081674] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-22T18:25:31.082458] [FATAL] [VALIDATOR ] DQ: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:25:31.082555] [FATAL] [MAIN ] DQ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:25:31.082599] [WARN ] [MAIN ] DQ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:25:31.082662] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-22T18:25:31.082763] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-09-22T18:25:31.082820] [INFO ] [LOCAL ] DQ: Starting deletion of derivative data. [2025-09-22T18:25:31.083295] [DEBUG] [LOCAL ] DQ: Deleted derivative data file. [2025-09-22T18:25:31.083402] [INFO ] [MAIN ] Update Progress: 646/2372 symbols completed. DQ took 30.3s. Estimated remaining: 3h 48m 19s. Rate: 7.6 symbols/min [2025-09-22T18:25:31.252798] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:25:31.301044] [DEBUG] [LOCAL ] DRH: Loaded 51192 existing records from primary storage. [2025-09-22T18:25:31.301215] [INFO ] [MAIN ] DRH: Loaded 51192 existing records. [2025-09-22T18:25:31.477156] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:25:31.477419] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-22T18:25:31.477467] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-22T18:25:31.478569] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-22T18:25:31.478629] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-22T18:25:31.727131] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-22T18:25:31.832106] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:25:32.228827] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-22T18:25:32.237972] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-22T18:25:32.238113] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-22T18:25:32.524614] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-22T18:25:32.686565] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T18:25:32.685342] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-22T18:25:32.693368] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-22T18:25:32.694717] [INFO ] [REMOTE ] DOV: Full fetch complete (64811 records). [2025-09-22T18:25:32.694561] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-22T18:25:32.694851] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-22T18:25:32.694962] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-22T18:25:32.805749] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-09-22T18:25:33.199283] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-22T18:25:33.200271] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-22T18:25:33.202038] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-22T18:25:33.204302] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-22T18:25:33.225845] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T18:25:33.233116] [DEBUG] [LOCAL ] DOV: Trimmed 64811 records to 45742 (keeping 200 days of data) [2025-09-22T18:25:33.334371] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-22T18:25:33.727481] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-09-22T18:25:33.728637] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-22T18:25:33.729046] [INFO ] [MAIN ] Update Progress: 647/2372 symbols completed. DOW took 35.9s. Estimated remaining: 3h 47m 57s. Rate: 7.6 symbols/min [2025-09-22T18:25:33.922018] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:25:33.971460] [DEBUG] [LOCAL ] DOV: Primary data saved (45742 records). [2025-09-22T18:25:33.983821] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-22T18:25:33.984031] [INFO ] [MAIN ] Update Progress: 648/2372 symbols completed. DOV took 43.1s. Estimated remaining: 3h 47m 29s. Rate: 7.6 symbols/min [2025-09-22T18:25:34.144159] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T18:25:34.163801] [DEBUG] [LOCAL ] DRI: Loaded 48576 existing records from primary storage. [2025-09-22T18:25:34.176479] [INFO ] [MAIN ] DRI: Loaded 48576 existing records. [2025-09-22T18:25:34.177349] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-22T18:25:34.307969] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:25:34.473011] [DEBUG] [LOCAL ] DRLL: Loaded 10151 existing records from primary storage. [2025-09-22T18:25:34.472586] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:25:34.473217] [INFO ] [MAIN ] DRLL: Loaded 10151 existing records. [2025-09-22T18:25:34.505942] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-22T18:25:34.518484] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-22T18:25:34.575258] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-22T18:25:34.578813] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-22T18:25:34.803903] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:25:34.851932] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-22T18:25:34.868698] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-22T18:25:34.896014] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T18:25:34.894681] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-22T18:25:34.941021] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-22T18:25:34.988117] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-22T18:25:35.247527] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:25:35.493883] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:25:35.722066] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-22T18:25:35.797388] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T18:25:36.522038] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-22T18:25:36.603330] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T18:25:36.625972] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T18:25:37.322045] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-22T18:25:37.795282] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T18:25:38.122049] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-22T18:25:38.661264] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-22T18:25:38.922123] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-22T18:25:39.665237] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T18:25:39.725707] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-22T18:25:39.730128] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T18:25:40.522069] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-22T18:25:41.080750] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T18:25:41.322073] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-22T18:25:42.112096] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T18:25:42.122008] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-22T18:25:42.904126] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T18:25:42.922020] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-22T18:25:43.165389] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T18:25:43.419600] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-22T18:25:43.722123] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-22T18:25:44.522128] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-22T18:25:45.313415] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T18:25:45.321992] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-22T18:25:46.122054] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-22T18:25:46.211474] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T18:25:46.922073] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-22T18:25:47.113010] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T18:25:47.120857] [INFO ] [REMOTE ] DRD: Full fetch complete (48213 records). [2025-09-22T18:25:47.120992] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-22T18:25:47.121616] [FATAL] [VALIDATOR ] DRD: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:25:47.121743] [FATAL] [MAIN ] DRD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:25:47.121795] [WARN ] [MAIN ] DRD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:25:47.121879] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-22T18:25:47.121951] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-22T18:25:47.121990] [INFO ] [LOCAL ] DRD: Starting deletion of derivative data. [2025-09-22T18:25:47.122393] [DEBUG] [LOCAL ] DRD: Deleted derivative data file. [2025-09-22T18:25:47.122496] [INFO ] [MAIN ] Update Progress: 649/2372 symbols completed. DRD took 32.4s. Estimated remaining: 3h 47m 35s. Rate: 7.6 symbols/min [2025-09-22T18:25:47.308876] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:25:47.339668] [DEBUG] [LOCAL ] DSL: Loaded 28666 existing records from primary storage. [2025-09-22T18:25:47.339808] [INFO ] [MAIN ] DSL: Loaded 28666 existing records. [2025-09-22T18:25:47.541172] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:25:47.541530] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-22T18:25:47.541590] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-22T18:25:47.543048] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-22T18:25:47.543122] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-22T18:25:47.725763] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-22T18:25:47.943124] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:25:47.954093] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T18:25:47.998975] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T18:25:48.522126] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-22T18:25:49.322068] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-22T18:25:49.624778] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T18:25:49.875228] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T18:25:49.992386] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T18:25:50.122116] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-22T18:25:50.922073] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-22T18:25:51.603747] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T18:25:51.722040] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-22T18:25:52.473453] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T18:25:52.522009] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-22T18:25:53.322066] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-22T18:25:53.373558] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T18:25:54.122099] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-22T18:25:54.186590] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T18:25:54.590346] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T18:25:54.922064] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-22T18:25:55.680197] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T18:25:55.722077] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-22T18:25:56.435133] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-22T18:25:56.443237] [INFO ] [REMOTE ] DRH: Full fetch complete (71845 records). [2025-09-22T18:25:56.443358] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-22T18:25:56.527142] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-22T18:25:56.842545] [DEBUG] [REMOTE ] DRLL: Error fetching primary data for 2025-06: Server request status code is 503. [2025-09-22T18:25:56.846569] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-22T18:25:56.846754] [WARN ] [REMOTE ] DRLL: No data returned for month 2025-06 [2025-09-22T18:25:56.847374] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-22T18:25:56.848345] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-22T18:25:56.848418] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-22T18:25:56.849994] [DEBUG] [LOCAL ] DRH: Trimmed 71845 records to 50454 (keeping 200 days of data) [2025-09-22T18:25:57.147463] [DEBUG] [LOCAL ] DRH: Primary data saved (50454 records). [2025-09-22T18:25:57.147601] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-22T18:25:57.147713] [INFO ] [MAIN ] Update Progress: 650/2372 symbols completed. DRH took 26.1s. Estimated remaining: 3h 47m 32s. Rate: 7.6 symbols/min [2025-09-22T18:25:57.328226] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:25:57.326636] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-22T18:25:57.346618] [DEBUG] [LOCAL ] DSM: Loaded 16018 existing records from primary storage. [2025-09-22T18:25:57.346845] [INFO ] [MAIN ] DSM: Loaded 16018 existing records. [2025-09-22T18:25:57.532805] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:25:57.533054] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-22T18:25:57.533106] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-22T18:25:57.533834] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-22T18:25:57.533933] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-22T18:25:57.723448] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T18:25:57.942610] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:25:58.122038] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-22T18:25:58.610230] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T18:25:58.922096] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-22T18:25:59.006526] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T18:25:59.722079] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-22T18:26:00.530696] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-22T18:26:00.555172] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T18:26:00.760813] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T18:26:01.322016] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-22T18:26:01.491105] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T18:26:02.122109] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-22T18:26:02.922043] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-22T18:26:02.948202] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T18:26:03.005316] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T18:26:03.722100] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-22T18:26:04.340567] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T18:26:04.522084] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-22T18:26:05.322044] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-22T18:26:05.414719] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T18:26:05.441574] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T18:26:06.122106] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-22T18:26:06.214898] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-22T18:26:06.922086] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-22T18:26:07.234469] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T18:26:07.696398] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T18:26:07.722048] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-22T18:26:08.522084] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-22T18:26:08.902616] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T18:26:09.322070] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-22T18:26:10.076581] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T18:26:10.122011] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-22T18:26:10.592420] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T18:26:10.922078] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-22T18:26:11.468497] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-22T18:26:11.470473] [INFO ] [REMOTE ] DRLL: Full fetch complete (14750 records). [2025-09-22T18:26:11.470609] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-22T18:26:11.672637] [WARN ] [VALIDATOR ] DRLL: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-22T18:26:11.673085] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:26:11.673223] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:26:11.673455] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-22T18:26:11.673720] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-09-22T18:26:11.673781] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-09-22T18:26:11.674471] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-09-22T18:26:11.674670] [INFO ] [MAIN ] Update Progress: 651/2372 symbols completed. DRLL took 37.7s. Estimated remaining: 3h 47m 42s. Rate: 7.6 symbols/min [2025-09-22T18:26:11.731027] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-22T18:26:11.859106] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:26:11.863628] [DEBUG] [LOCAL ] DSMC: Loaded 2049 existing records from primary storage. [2025-09-22T18:26:11.863762] [INFO ] [MAIN ] DSMC: Loaded 2049 existing records. [2025-09-22T18:26:12.008955] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T18:26:12.063421] [INFO ] [REMOTE ] DRI: Full fetch complete (69523 records). [2025-09-22T18:26:12.097840] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-22T18:26:12.097447] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:26:12.098709] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-22T18:26:12.098796] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-22T18:26:12.099041] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-22T18:26:12.099121] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-22T18:26:12.522528] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-22T18:26:12.876508] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:26:12.915537] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-22T18:26:12.915632] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-22T18:26:12.916551] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-22T18:26:12.916638] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-22T18:26:12.920468] [DEBUG] [LOCAL ] DRI: Trimmed 69523 records to 47858 (keeping 200 days of data) [2025-09-22T18:26:13.164426] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T18:26:13.173000] [INFO ] [REMOTE ] DSL: Full fetch complete (41339 records). [2025-09-22T18:26:13.173726] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-22T18:26:13.330981] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-22T18:26:13.641372] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-22T18:26:13.641825] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-22T18:26:13.643062] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-22T18:26:13.643146] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-22T18:26:13.646614] [DEBUG] [LOCAL ] DSL: Trimmed 41339 records to 28194 (keeping 200 days of data) [2025-09-22T18:26:13.818958] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-22T18:26:13.854096] [DEBUG] [LOCAL ] DRI: Primary data saved (47858 records). [2025-09-22T18:26:13.854261] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-22T18:26:13.856425] [INFO ] [MAIN ] Update Progress: 652/2372 symbols completed. DRI took 40.1s. Estimated remaining: 3h 47m 19s. Rate: 7.6 symbols/min [2025-09-22T18:26:13.989141] [DEBUG] [LOCAL ] DSL: Primary data saved (28194 records). [2025-09-22T18:26:14.006283] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-22T18:26:14.006491] [INFO ] [MAIN ] Update Progress: 653/2372 symbols completed. DSL took 26.9s. Estimated remaining: 3h 46m 50s. Rate: 7.6 symbols/min [2025-09-22T18:26:14.072888] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T18:26:14.131594] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-22T18:26:14.223565] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:26:14.300211] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:26:14.319845] [DEBUG] [LOCAL ] DSU: Loaded 22088 existing records from primary storage. [2025-09-22T18:26:14.320275] [INFO ] [MAIN ] DSU: Loaded 22088 existing records. [2025-09-22T18:26:14.494559] [DEBUG] [LOCAL ] DSX: Loaded 25050 existing records from primary storage. [2025-09-22T18:26:14.502075] [INFO ] [MAIN ] DSX: Loaded 25050 existing records. [2025-09-22T18:26:14.523481] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:26:14.601817] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-22T18:26:14.617851] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-22T18:26:14.634371] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-22T18:26:14.639581] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-22T18:26:14.725148] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-22T18:26:14.836865] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:26:14.878395] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-22T18:26:14.879359] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-22T18:26:14.904143] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-22T18:26:14.928451] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-22T18:26:14.955259] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-22T18:26:15.251502] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:26:15.366124] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T18:26:15.464908] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:26:15.722027] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-22T18:26:16.522062] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-22T18:26:17.235454] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T18:26:17.321998] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-22T18:26:17.756225] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T18:26:18.122020] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-22T18:26:18.502279] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T18:26:18.617218] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-22T18:26:18.922058] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-22T18:26:19.722062] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-22T18:26:19.999867] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T18:26:20.522037] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-22T18:26:20.641616] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T18:26:21.322066] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-22T18:26:21.494622] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T18:26:22.122057] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-22T18:26:22.194550] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T18:26:22.922052] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-22T18:26:22.984909] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T18:26:23.659036] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-22T18:26:23.722038] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-22T18:26:24.522063] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-22T18:26:24.877387] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T18:26:25.322058] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-22T18:26:25.331849] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-22T18:26:26.122076] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-22T18:26:26.601077] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-22T18:26:26.777129] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-22T18:26:26.922052] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-22T18:26:27.722052] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-22T18:26:27.997205] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T18:26:28.144714] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-22T18:26:28.522068] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-22T18:26:29.322039] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-22T18:26:29.613387] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T18:26:29.625823] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-22T18:26:30.122058] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-22T18:26:30.858761] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T18:26:30.861516] [INFO ] [REMOTE ] DSM: Full fetch complete (24744 records). [2025-09-22T18:26:30.861610] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-22T18:26:30.927128] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-22T18:26:31.236211] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-22T18:26:31.236297] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-22T18:26:31.236770] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-22T18:26:31.236841] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-22T18:26:31.237576] [DEBUG] [LOCAL ] DSM: Trimmed 24744 records to 15726 (keeping 200 days of data) [2025-09-22T18:26:31.337857] [DEBUG] [LOCAL ] DSM: Primary data saved (15726 records). [2025-09-22T18:26:31.338000] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-22T18:26:31.338156] [INFO ] [MAIN ] Update Progress: 654/2372 symbols completed. DSM took 34.2s. Estimated remaining: 3h 47m 7s. Rate: 7.6 symbols/min [2025-09-22T18:26:31.516095] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:26:31.578339] [DEBUG] [LOCAL ] DT: Loaded 53726 existing records from primary storage. [2025-09-22T18:26:31.578498] [INFO ] [MAIN ] DT: Loaded 53726 existing records. [2025-09-22T18:26:31.728309] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-22T18:26:31.759690] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:26:31.760036] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-22T18:26:31.760105] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-22T18:26:31.761409] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-22T18:26:31.761485] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-22T18:26:32.070576] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T18:26:32.160966] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:26:32.522062] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-22T18:26:32.954047] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T18:26:33.322059] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-22T18:26:33.708633] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T18:26:34.122055] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-22T18:26:34.838383] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T18:26:34.922005] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-22T18:26:35.035239] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T18:26:35.722059] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-22T18:26:36.054394] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-22T18:26:36.086037] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T18:26:36.092154] [INFO ] [REMOTE ] DSX: Full fetch complete (37430 records). [2025-09-22T18:26:36.092305] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-22T18:26:36.479688] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-22T18:26:36.479851] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-22T18:26:36.480402] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-22T18:26:36.480449] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-22T18:26:36.481277] [DEBUG] [LOCAL ] DSX: Trimmed 37430 records to 24550 (keeping 200 days of data) [2025-09-22T18:26:36.531073] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-22T18:26:36.628028] [DEBUG] [LOCAL ] DSX: Primary data saved (24550 records). [2025-09-22T18:26:36.628170] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-22T18:26:36.628296] [INFO ] [MAIN ] Update Progress: 655/2372 symbols completed. DSX took 22.6s. Estimated remaining: 3h 46m 52s. Rate: 7.6 symbols/min [2025-09-22T18:26:36.796123] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:26:36.803455] [DEBUG] [LOCAL ] DTB: Loaded 4777 existing records from primary storage. [2025-09-22T18:26:36.803573] [INFO ] [MAIN ] DTB: Loaded 4777 existing records. [2025-09-22T18:26:36.979846] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:26:36.980237] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-22T18:26:36.980313] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-22T18:26:36.980713] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-22T18:26:36.980781] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-22T18:26:37.338927] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-22T18:26:37.345340] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:26:37.765076] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-22T18:26:37.894921] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T18:26:38.122119] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-22T18:26:38.922138] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-22T18:26:39.477630] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-22T18:26:39.722122] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-22T18:26:39.830547] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T18:26:40.239738] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-22T18:26:40.522132] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-22T18:26:41.322095] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-22T18:26:41.406123] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T18:26:41.799982] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T18:26:42.122085] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-22T18:26:42.635114] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-22T18:26:42.922096] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-22T18:26:43.464206] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-22T18:26:43.465777] [INFO ] [REMOTE ] DSMC: Full fetch complete (2875 records). [2025-09-22T18:26:43.465866] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-22T18:26:43.732177] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-22T18:26:43.867985] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-22T18:26:43.868065] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-22T18:26:43.868183] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-22T18:26:43.868222] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-22T18:26:43.868567] [DEBUG] [LOCAL ] DSMC: Trimmed 2875 records to 1965 (keeping 200 days of data) [2025-09-22T18:26:43.880890] [DEBUG] [LOCAL ] DSMC: Primary data saved (1965 records). [2025-09-22T18:26:43.880950] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-22T18:26:43.881019] [INFO ] [MAIN ] Update Progress: 656/2372 symbols completed. DSMC took 32.2s. Estimated remaining: 3h 46m 43s. Rate: 7.6 symbols/min [2025-09-22T18:26:44.048470] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:26:44.121351] [DEBUG] [LOCAL ] DTE: Loaded 48671 existing records from primary storage. [2025-09-22T18:26:44.122161] [INFO ] [MAIN ] DTE: Loaded 48671 existing records. [2025-09-22T18:26:44.301063] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:26:44.301431] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-22T18:26:44.301488] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-22T18:26:44.304065] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-22T18:26:44.304134] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-22T18:26:44.534080] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-22T18:26:44.660602] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:26:45.240034] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T18:26:45.322082] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-22T18:26:46.122102] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-22T18:26:46.922076] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-22T18:26:47.646539] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-22T18:26:47.722075] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-22T18:26:47.799204] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-22T18:26:47.894310] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T18:26:47.932479] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T18:26:48.052068] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-22T18:26:48.522084] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-22T18:26:49.072170] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-22T18:26:49.322064] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-22T18:26:50.122055] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-22T18:26:50.922036] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-22T18:26:51.028759] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T18:26:51.352186] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T18:26:51.722129] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-22T18:26:52.082480] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T18:26:52.522108] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-22T18:26:52.871978] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T18:26:53.199473] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T18:26:53.322101] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-22T18:26:54.122092] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-22T18:26:54.484156] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T18:26:54.489589] [INFO ] [REMOTE ] DSU: Full fetch complete (32125 records). [2025-09-22T18:26:54.490076] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-22T18:26:54.928387] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-22T18:26:54.930602] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-22T18:26:54.930765] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-22T18:26:54.931745] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-22T18:26:54.931972] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-22T18:26:54.933342] [DEBUG] [LOCAL ] DSU: Trimmed 32125 records to 21791 (keeping 200 days of data) [2025-09-22T18:26:55.089708] [DEBUG] [LOCAL ] DSU: Primary data saved (21791 records). [2025-09-22T18:26:55.089899] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-22T18:26:55.090012] [INFO ] [MAIN ] Update Progress: 657/2372 symbols completed. DSU took 41.2s. Estimated remaining: 3h 46m 43s. Rate: 7.6 symbols/min [2025-09-22T18:26:55.280902] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:26:55.281198] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-22T18:26:55.281257] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-22T18:26:55.281410] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-22T18:26:55.281465] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-22T18:26:55.281534] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-22T18:26:55.281570] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-22T18:26:55.654688] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T18:26:55.654272] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:26:55.711395] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T18:26:55.722007] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-22T18:26:56.522143] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-22T18:26:57.160510] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T18:26:57.322081] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-22T18:26:57.419333] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T18:26:58.122088] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-22T18:26:58.661598] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-22T18:26:58.769435] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T18:26:58.922087] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-22T18:26:59.722055] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-22T18:27:00.522142] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-22T18:27:01.183910] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T18:27:01.322072] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-22T18:27:01.586960] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-22T18:27:01.908781] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T18:27:01.910408] [INFO ] [REMOTE ] DTB: Full fetch complete (6781 records). [2025-09-22T18:27:01.910477] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-22T18:27:02.127215] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-22T18:27:02.271952] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-22T18:27:02.272028] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-22T18:27:02.272202] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-22T18:27:02.272257] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-22T18:27:02.272723] [DEBUG] [LOCAL ] DTB: Trimmed 6781 records to 4724 (keeping 200 days of data) [2025-09-22T18:27:02.301321] [DEBUG] [LOCAL ] DTB: Primary data saved (4724 records). [2025-09-22T18:27:02.301445] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-22T18:27:02.301529] [INFO ] [MAIN ] Update Progress: 658/2372 symbols completed. DTB took 25.7s. Estimated remaining: 3h 46m 33s. Rate: 7.6 symbols/min [2025-09-22T18:27:02.481204] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:27:02.490170] [DEBUG] [LOCAL ] DTG: Loaded 5979 existing records from primary storage. [2025-09-22T18:27:02.490301] [INFO ] [MAIN ] DTG: Loaded 5979 existing records. [2025-09-22T18:27:02.678215] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:27:02.678462] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-22T18:27:02.678511] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-22T18:27:02.678877] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-22T18:27:02.678938] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-22T18:27:02.930046] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-22T18:27:03.048494] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:27:03.722024] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-22T18:27:03.851077] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T18:27:03.852575] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-22T18:27:04.510406] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-22T18:27:04.522080] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-22T18:27:04.924228] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-22T18:27:04.982322] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T18:27:05.322091] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-22T18:27:06.122061] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-22T18:27:06.721433] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-22T18:27:06.825129] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T18:27:06.922108] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-22T18:27:07.653404] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-22T18:27:07.722075] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-22T18:27:08.314997] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-22T18:27:08.522070] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-22T18:27:08.979387] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T18:27:09.322082] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-22T18:27:09.795338] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T18:27:10.122091] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-22T18:27:10.563833] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-22T18:27:10.922092] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-22T18:27:11.318603] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-22T18:27:11.722107] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-22T18:27:12.195458] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T18:27:12.522081] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-22T18:27:13.322069] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-22T18:27:14.122097] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-22T18:27:14.261293] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T18:27:14.396673] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-22T18:27:14.695295] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T18:27:14.922077] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-22T18:27:15.347920] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-22T18:27:15.722065] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-22T18:27:16.522122] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-22T18:27:17.277539] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T18:27:17.322036] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-22T18:27:17.650334] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T18:27:17.659248] [INFO ] [REMOTE ] DT: Full fetch complete (76644 records). [2025-09-22T18:27:17.659405] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-22T18:27:18.089509] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-22T18:27:18.089762] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-22T18:27:18.095865] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-22T18:27:18.096524] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-22T18:27:18.096800] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T18:27:18.100746] [DEBUG] [LOCAL ] DT: Trimmed 76644 records to 52947 (keeping 200 days of data) [2025-09-22T18:27:18.156596] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-22T18:27:18.436676] [DEBUG] [LOCAL ] DT: Primary data saved (52947 records). [2025-09-22T18:27:18.436830] [INFO ] [MAIN ] DT: Full history saved. [2025-09-22T18:27:18.436919] [INFO ] [MAIN ] Update Progress: 659/2372 symbols completed. DT took 47.1s. Estimated remaining: 3h 46m 47s. Rate: 7.6 symbols/min [2025-09-22T18:27:18.614075] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:27:18.614358] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-22T18:27:18.614451] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-22T18:27:18.614568] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-22T18:27:18.614609] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-22T18:27:18.614682] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-22T18:27:18.614736] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-22T18:27:18.927220] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-22T18:27:19.007376] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:27:19.413974] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T18:27:19.722067] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-22T18:27:19.892382] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T18:27:19.918712] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:19.919036] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-22T18:27:20.522082] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-22T18:27:20.975505] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T18:27:20.976446] [INFO ] [REMOTE ] DTF: Full fetch complete (2171 records). [2025-09-22T18:27:20.976532] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-22T18:27:20.976962] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:27:20.977088] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:27:20.977175] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:27:20.977267] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-22T18:27:20.977336] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-22T18:27:20.977375] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-22T18:27:20.977445] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-22T18:27:20.977525] [INFO ] [MAIN ] Update Progress: 660/2372 symbols completed. DTF took 25.9s. Estimated remaining: 3h 46m 25s. Rate: 7.6 symbols/min [2025-09-22T18:27:21.165959] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:27:21.219146] [DEBUG] [LOCAL ] DTM: Loaded 45355 existing records from primary storage. [2025-09-22T18:27:21.219321] [INFO ] [MAIN ] DTM: Loaded 45355 existing records. [2025-09-22T18:27:21.327151] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-22T18:27:21.395959] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:27:21.396219] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-22T18:27:21.396266] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-22T18:27:21.398037] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-22T18:27:21.398100] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-22T18:27:21.751696] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:27:22.003190] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T18:27:22.004922] [INFO ] [REMOTE ] DTG: Full fetch complete (9032 records). [2025-09-22T18:27:22.004999] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-22T18:27:22.127184] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-09-22T18:27:22.383512] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-22T18:27:22.383601] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-22T18:27:22.383882] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-22T18:27:22.383943] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-22T18:27:22.384399] [DEBUG] [LOCAL ] DTG: Trimmed 9032 records to 5902 (keeping 200 days of data) [2025-09-22T18:27:22.411801] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:22.413273] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-09-22T18:27:22.424103] [DEBUG] [LOCAL ] DTG: Primary data saved (5902 records). [2025-09-22T18:27:22.424265] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-22T18:27:22.424358] [INFO ] [MAIN ] Update Progress: 661/2372 symbols completed. DTG took 20.1s. Estimated remaining: 3h 46m 0s. Rate: 7.6 symbols/min [2025-09-22T18:27:22.591948] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:27:22.599374] [DEBUG] [LOCAL ] DTW: Loaded 4977 existing records from primary storage. [2025-09-22T18:27:22.599492] [INFO ] [MAIN ] DTW: Loaded 4977 existing records. [2025-09-22T18:27:22.778069] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:27:22.778374] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-22T18:27:22.778493] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-22T18:27:22.778879] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-22T18:27:22.778937] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-22T18:27:22.927192] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-22T18:27:23.133167] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:27:23.722065] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-22T18:27:24.522069] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-22T18:27:24.938778] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T18:27:25.322047] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-02. [2025-09-22T18:27:25.555487] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:25.555842] [WARN ] [REMOTE ] DTK: No data returned for month 2025-02 [2025-09-22T18:27:25.634279] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-22T18:27:25.641491] [INFO ] [REMOTE ] DTE: Full fetch complete (69299 records). [2025-09-22T18:27:25.641600] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-22T18:27:26.034157] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-22T18:27:26.034269] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-22T18:27:26.035131] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-22T18:27:26.035202] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-22T18:27:26.036624] [DEBUG] [LOCAL ] DTE: Trimmed 69299 records to 48004 (keeping 200 days of data) [2025-09-22T18:27:26.132098] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-03. [2025-09-22T18:27:26.326754] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:26.341825] [WARN ] [REMOTE ] DTK: No data returned for month 2025-03 [2025-09-22T18:27:26.385800] [DEBUG] [LOCAL ] DTE: Primary data saved (48004 records). [2025-09-22T18:27:26.386191] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-22T18:27:26.387719] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T18:27:26.386751] [INFO ] [MAIN ] Update Progress: 662/2372 symbols completed. DTE took 42.5s. Estimated remaining: 3h 45m 42s. Rate: 7.6 symbols/min [2025-09-22T18:27:26.564265] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:27:26.618535] [DEBUG] [LOCAL ] DUK: Loaded 54250 existing records from primary storage. [2025-09-22T18:27:26.618742] [INFO ] [MAIN ] DUK: Loaded 54250 existing records. [2025-09-22T18:27:26.797068] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:27:26.797310] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-22T18:27:26.797358] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-22T18:27:26.800131] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-22T18:27:26.800194] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-22T18:27:26.927209] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-22T18:27:27.188760] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:27:27.722089] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-04. [2025-09-22T18:27:27.933282] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:27.933694] [WARN ] [REMOTE ] DTK: No data returned for month 2025-04 [2025-09-22T18:27:28.522042] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-05. [2025-09-22T18:27:28.657891] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T18:27:28.727093] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:28.727475] [WARN ] [REMOTE ] DTK: No data returned for month 2025-05 [2025-09-22T18:27:29.322065] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-22T18:27:30.122068] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-06. [2025-09-22T18:27:30.309537] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:30.309965] [WARN ] [REMOTE ] DTK: No data returned for month 2025-06 [2025-09-22T18:27:30.922070] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-22T18:27:31.562261] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-22T18:27:31.722093] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-07. [2025-09-22T18:27:31.936972] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:31.937390] [WARN ] [REMOTE ] DTK: No data returned for month 2025-07 [2025-09-22T18:27:32.203301] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T18:27:32.522054] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-08. [2025-09-22T18:27:32.739408] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:32.739774] [WARN ] [REMOTE ] DTK: No data returned for month 2025-08 [2025-09-22T18:27:33.322057] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-09. [2025-09-22T18:27:33.538159] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:27:33.538494] [WARN ] [REMOTE ] DTK: No data returned for month 2025-09 [2025-09-22T18:27:33.538595] [INFO ] [REMOTE ] DTK: Full fetch complete (0 records). [2025-09-22T18:27:33.538638] [DEBUG] [VALIDATOR ] DTK: Validating primary data. [2025-09-22T18:27:33.538727] [WARN ] [VALIDATOR ] DTK: No data provided for validation! [2025-09-22T18:27:33.538791] [FATAL] [MAIN ] DTK: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:27:33.538853] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:27:33.538929] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-22T18:27:33.538994] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-22T18:27:33.539029] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-22T18:27:33.539143] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-22T18:27:33.539218] [INFO ] [MAIN ] Update Progress: 663/2372 symbols completed. DTK took 15.1s. Estimated remaining: 3h 45m 32s. Rate: 7.6 symbols/min [2025-09-22T18:27:33.723595] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:27:33.733220] [DEBUG] [LOCAL ] DUKB: Loaded 6504 existing records from primary storage. [2025-09-22T18:27:33.733355] [INFO ] [MAIN ] DUKB: Loaded 6504 existing records. [2025-09-22T18:27:33.926844] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:27:33.927124] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-22T18:27:33.927181] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-22T18:27:33.927552] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-22T18:27:33.927612] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-22T18:27:34.127245] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-22T18:27:34.290638] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:27:34.922054] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-22T18:27:35.722107] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-22T18:27:36.056028] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-22T18:27:36.228074] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T18:27:36.259084] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-22T18:27:36.522054] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-22T18:27:37.322049] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-22T18:27:37.961719] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T18:27:38.122055] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-22T18:27:38.331438] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T18:27:38.684833] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T18:27:38.922110] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-22T18:27:39.512738] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-22T18:27:39.722044] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-22T18:27:40.313463] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T18:27:40.522065] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-22T18:27:41.081166] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T18:27:41.322062] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-22T18:27:42.056599] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T18:27:42.122116] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-22T18:27:42.922129] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-22T18:27:43.043632] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-22T18:27:43.725110] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-22T18:27:43.730034] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T18:27:44.458856] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T18:27:44.522045] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-22T18:27:45.207427] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T18:27:45.322069] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-22T18:27:46.122119] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-22T18:27:46.646874] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-22T18:27:46.922083] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-22T18:27:46.990575] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T18:27:47.649458] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-22T18:27:47.722075] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-22T18:27:48.267892] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-22T18:27:48.269439] [INFO ] [REMOTE ] DUKB: Full fetch complete (9560 records). [2025-09-22T18:27:48.269537] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-22T18:27:48.527203] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-22T18:27:48.677107] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-22T18:27:48.677192] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-22T18:27:48.677444] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-22T18:27:48.677487] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-22T18:27:48.677993] [DEBUG] [LOCAL ] DUKB: Trimmed 9560 records to 6388 (keeping 200 days of data) [2025-09-22T18:27:48.719188] [DEBUG] [LOCAL ] DUKB: Primary data saved (6388 records). [2025-09-22T18:27:48.719341] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-22T18:27:48.719432] [INFO ] [MAIN ] Update Progress: 664/2372 symbols completed. DUKB took 15.2s. Estimated remaining: 3h 45m 43s. Rate: 7.6 symbols/min [2025-09-22T18:27:48.891328] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:27:48.947904] [DEBUG] [LOCAL ] DV: Loaded 52057 existing records from primary storage. [2025-09-22T18:27:48.948050] [INFO ] [MAIN ] DV: Loaded 52057 existing records. [2025-09-22T18:27:49.126627] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:27:49.126887] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-22T18:27:49.126938] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-22T18:27:49.128310] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-22T18:27:49.128375] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-22T18:27:49.353312] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T18:27:49.331755] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-22T18:27:49.506226] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:27:50.122064] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-22T18:27:50.922026] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-22T18:27:51.278751] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T18:27:51.500497] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T18:27:51.722114] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-22T18:27:52.046215] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T18:27:52.253074] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T18:27:52.522057] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-22T18:27:53.103823] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T18:27:53.322086] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-22T18:27:53.800316] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-22T18:27:53.801712] [INFO ] [REMOTE ] DTW: Full fetch complete (7808 records). [2025-09-22T18:27:53.801804] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-22T18:27:54.130456] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-22T18:27:54.175277] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-22T18:27:54.175364] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-22T18:27:54.175871] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-22T18:27:54.175936] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-22T18:27:54.176359] [DEBUG] [LOCAL ] DTW: Trimmed 7808 records to 4901 (keeping 200 days of data) [2025-09-22T18:27:54.211570] [DEBUG] [LOCAL ] DTW: Primary data saved (4901 records). [2025-09-22T18:27:54.211792] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-22T18:27:54.211911] [INFO ] [MAIN ] Update Progress: 665/2372 symbols completed. DTW took 31.8s. Estimated remaining: 3h 45m 29s. Rate: 7.6 symbols/min [2025-09-22T18:27:54.390267] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:27:54.441824] [DEBUG] [LOCAL ] DVA: Loaded 42344 existing records from primary storage. [2025-09-22T18:27:54.441967] [INFO ] [MAIN ] DVA: Loaded 42344 existing records. [2025-09-22T18:27:54.624597] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:27:54.624928] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-22T18:27:54.624985] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-22T18:27:54.626131] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-22T18:27:54.626195] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-22T18:27:54.927172] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-22T18:27:54.997189] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:27:55.380115] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-22T18:27:55.722072] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-22T18:27:56.282051] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:27:56.522093] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-22T18:27:57.322102] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-22T18:27:57.430091] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T18:27:58.122069] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-22T18:27:58.450821] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T18:27:58.622590] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-22T18:27:58.922078] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-22T18:27:59.441216] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T18:27:59.722076] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-22T18:28:00.164560] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T18:28:00.522060] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-22T18:28:00.969491] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T18:28:01.322094] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-22T18:28:02.122094] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-22T18:28:02.391792] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T18:28:02.667617] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T18:28:02.922070] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-22T18:28:03.643364] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T18:28:03.722055] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-22T18:28:04.522082] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-22T18:28:04.579288] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T18:28:05.322071] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-22T18:28:05.496166] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T18:28:05.503369] [INFO ] [REMOTE ] DTM: Full fetch complete (64922 records). [2025-09-22T18:28:05.503535] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-22T18:28:05.903358] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-22T18:28:05.903458] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-22T18:28:05.904298] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-22T18:28:05.904439] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-22T18:28:05.906551] [DEBUG] [LOCAL ] DTM: Trimmed 64922 records to 44544 (keeping 200 days of data) [2025-09-22T18:28:05.931231] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T18:28:06.124371] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-22T18:28:06.227396] [DEBUG] [LOCAL ] DTM: Primary data saved (44544 records). [2025-09-22T18:28:06.227524] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-22T18:28:06.227603] [INFO ] [MAIN ] Update Progress: 666/2372 symbols completed. DTM took 45.2s. Estimated remaining: 3h 45m 31s. Rate: 7.6 symbols/min [2025-09-22T18:28:06.397383] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:28:06.449247] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-22T18:28:06.449399] [INFO ] [MAIN ] DVN: Loaded 54479 existing records. [2025-09-22T18:28:06.632265] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:28:06.632568] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-22T18:28:06.632630] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-22T18:28:06.633952] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-22T18:28:06.634013] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-22T18:28:06.927223] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-22T18:28:06.990937] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:28:07.267083] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T18:28:07.722054] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-22T18:28:07.872708] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T18:28:08.518125] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T18:28:08.527989] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-22T18:28:09.322055] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-22T18:28:09.898710] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-22T18:28:10.122059] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-22T18:28:10.315957] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T18:28:10.922064] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-22T18:28:11.067117] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T18:28:11.596022] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T18:28:11.722072] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-22T18:28:12.522108] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-22T18:28:12.788209] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T18:28:13.175882] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T18:28:13.322051] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-22T18:28:14.122121] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-22T18:28:14.494607] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T18:28:14.609069] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T18:28:14.922055] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-22T18:28:15.490308] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T18:28:15.722057] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-22T18:28:16.522069] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-22T18:28:17.089508] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-22T18:28:17.323022] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-22T18:28:17.325939] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T18:28:18.122045] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-22T18:28:18.503279] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-22T18:28:18.922036] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-22T18:28:19.158726] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T18:28:19.167732] [INFO ] [REMOTE ] DV: Full fetch complete (73199 records). [2025-09-22T18:28:19.167913] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-22T18:28:19.585554] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-22T18:28:19.585661] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-22T18:28:19.586500] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-22T18:28:19.586547] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-22T18:28:19.588066] [DEBUG] [LOCAL ] DV: Trimmed 73199 records to 51276 (keeping 200 days of data) [2025-09-22T18:28:19.720180] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T18:28:19.729346] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-22T18:28:19.930448] [DEBUG] [LOCAL ] DV: Primary data saved (51276 records). [2025-09-22T18:28:19.930635] [INFO ] [MAIN ] DV: Full history saved. [2025-09-22T18:28:19.930763] [INFO ] [MAIN ] Update Progress: 667/2372 symbols completed. DV took 31.2s. Estimated remaining: 3h 45m 38s. Rate: 7.6 symbols/min [2025-09-22T18:28:20.101729] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:28:20.154531] [DEBUG] [LOCAL ] DX: Loaded 53245 existing records from primary storage. [2025-09-22T18:28:20.154712] [INFO ] [MAIN ] DX: Loaded 53245 existing records. [2025-09-22T18:28:20.332462] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:28:20.332837] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-22T18:28:20.332970] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-22T18:28:20.334375] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-22T18:28:20.334438] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-22T18:28:20.522786] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-22T18:28:20.707345] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:28:20.739507] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T18:28:21.322076] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-22T18:28:21.595769] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T18:28:21.604013] [INFO ] [REMOTE ] DUK: Full fetch complete (77017 records). [2025-09-22T18:28:21.604184] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-22T18:28:21.605182] [FATAL] [VALIDATOR ] DUK: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:28:21.605278] [FATAL] [MAIN ] DUK: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:28:21.605324] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:28:21.605394] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-22T18:28:21.605512] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-09-22T18:28:21.605574] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-09-22T18:28:21.606147] [DEBUG] [LOCAL ] DUK: Deleted derivative data file. [2025-09-22T18:28:21.606251] [INFO ] [MAIN ] Update Progress: 668/2372 symbols completed. DUK took 55.2s. Estimated remaining: 3h 45m 14s. Rate: 7.6 symbols/min [2025-09-22T18:28:21.794964] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:28:21.847961] [DEBUG] [LOCAL ] DXC: Loaded 50193 existing records from primary storage. [2025-09-22T18:28:21.848180] [INFO ] [MAIN ] DXC: Loaded 50193 existing records. [2025-09-22T18:28:22.046751] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:28:22.047562] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-22T18:28:22.047775] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-22T18:28:22.054833] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-22T18:28:22.054953] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-22T18:28:22.133557] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T18:28:22.133669] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-22T18:28:22.183094] [INFO ] [REMOTE ] DVA: Full fetch complete (59428 records). [2025-09-22T18:28:22.198987] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-22T18:28:22.244370] [FATAL] [VALIDATOR ] DVA: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:28:22.310487] [FATAL] [MAIN ] DVA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:28:22.344112] [WARN ] [MAIN ] DVA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:28:22.371687] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-22T18:28:22.372263] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-09-22T18:28:22.377744] [INFO ] [LOCAL ] DVA: Starting deletion of derivative data. [2025-09-22T18:28:22.416736] [DEBUG] [LOCAL ] DVA: Deleted derivative data file. [2025-09-22T18:28:22.453824] [INFO ] [MAIN ] Update Progress: 669/2372 symbols completed. DVA took 28.2s. Estimated remaining: 3h 44m 48s. Rate: 7.6 symbols/min [2025-09-22T18:28:22.457728] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:28:22.650275] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:28:22.689140] [DEBUG] [LOCAL ] DXYZ: Loaded 37323 existing records from primary storage. [2025-09-22T18:28:22.689297] [INFO ] [MAIN ] DXYZ: Loaded 37323 existing records. [2025-09-22T18:28:22.887584] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:28:22.887911] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-22T18:28:22.887965] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-22T18:28:22.889959] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-22T18:28:22.890025] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-22T18:28:22.936580] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-22T18:28:23.286868] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:28:23.534014] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-22T18:28:23.605616] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T18:28:23.722034] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-22T18:28:24.522025] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-22T18:28:24.553023] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T18:28:25.285866] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T18:28:25.322025] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-22T18:28:26.122062] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-22T18:28:26.911925] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-22T18:28:26.923004] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-22T18:28:27.016371] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T18:28:27.722035] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-22T18:28:28.137605] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-22T18:28:28.393874] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T18:28:28.522059] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-22T18:28:29.272308] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T18:28:29.322051] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-22T18:28:29.861872] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T18:28:30.122072] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-22T18:28:30.922051] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-22T18:28:31.271495] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T18:28:31.722059] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-22T18:28:32.221445] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T18:28:32.456100] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-22T18:28:32.522019] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-22T18:28:33.322090] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-22T18:28:33.638710] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T18:28:34.122165] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-22T18:28:34.304918] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-22T18:28:34.922041] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-22T18:28:35.390867] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-22T18:28:35.722061] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-22T18:28:35.840176] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T18:28:36.349953] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T18:28:36.522086] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-22T18:28:37.109030] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T18:28:37.322077] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-22T18:28:38.122022] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-22T18:28:38.646475] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-22T18:28:38.922072] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-22T18:28:39.460936] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-22T18:28:39.526330] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-22T18:28:39.722068] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-22T18:28:40.522135] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-22T18:28:40.767790] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T18:28:40.776901] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-22T18:28:40.777078] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-22T18:28:41.204431] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-22T18:28:41.204540] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-22T18:28:41.205592] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-22T18:28:41.205685] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-22T18:28:41.207413] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 53699 (keeping 200 days of data) [2025-09-22T18:28:41.323315] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-22T18:28:41.553848] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T18:28:41.592267] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-09-22T18:28:41.593260] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-22T18:28:41.593594] [INFO ] [MAIN ] Update Progress: 670/2372 symbols completed. DVN took 35.4s. Estimated remaining: 3h 45m 9s. Rate: 7.6 symbols/min [2025-09-22T18:28:41.774350] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:28:41.809156] [DEBUG] [LOCAL ] DY: Loaded 30563 existing records from primary storage. [2025-09-22T18:28:41.827615] [INFO ] [MAIN ] DY: Loaded 30563 existing records. [2025-09-22T18:28:41.954702] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T18:28:42.046585] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:28:42.046885] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-22T18:28:42.046936] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-22T18:28:42.047773] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-22T18:28:42.047834] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-22T18:28:42.127217] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-22T18:28:42.451459] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:28:42.922103] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-22T18:28:43.241252] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T18:28:43.672013] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T18:28:43.722066] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-22T18:28:44.522140] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-22T18:28:44.942785] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-22T18:28:45.277967] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T18:28:45.322064] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-22T18:28:45.886008] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T18:28:46.122101] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-22T18:28:46.829259] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T18:28:46.922100] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-22T18:28:47.475545] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T18:28:47.722066] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-22T18:28:48.522077] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-22T18:28:48.902769] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-22T18:28:48.911055] [INFO ] [REMOTE ] DX: Full fetch complete (75256 records). [2025-09-22T18:28:48.911184] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-22T18:28:49.322815] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-22T18:28:49.322564] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-22T18:28:49.323128] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-22T18:28:49.324233] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-22T18:28:49.325430] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-22T18:28:49.327150] [DEBUG] [LOCAL ] DX: Trimmed 75256 records to 52475 (keeping 200 days of data) [2025-09-22T18:28:49.588445] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T18:28:49.702748] [DEBUG] [LOCAL ] DX: Primary data saved (52475 records). [2025-09-22T18:28:49.702900] [INFO ] [MAIN ] DX: Full history saved. [2025-09-22T18:28:49.702987] [INFO ] [MAIN ] Update Progress: 671/2372 symbols completed. DX took 29.8s. Estimated remaining: 3h 45m 1s. Rate: 7.6 symbols/min [2025-09-22T18:28:49.873574] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:28:49.909112] [DEBUG] [LOCAL ] E: Loaded 34114 existing records from primary storage. [2025-09-22T18:28:49.909341] [INFO ] [MAIN ] E: Loaded 34114 existing records. [2025-09-22T18:28:50.096357] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:28:50.097028] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-22T18:28:50.097101] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-22T18:28:50.105022] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-22T18:28:50.118020] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-22T18:28:50.130258] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-22T18:28:50.131355] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T18:28:50.205183] [INFO ] [REMOTE ] DXC: Full fetch complete (68439 records). [2025-09-22T18:28:50.217600] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-22T18:28:50.815096] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:28:50.922314] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-22T18:28:50.942120] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-22T18:28:50.942228] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-22T18:28:50.943278] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-22T18:28:50.943671] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-22T18:28:50.967455] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T18:28:50.974174] [DEBUG] [LOCAL ] DXC: Trimmed 68439 records to 49606 (keeping 200 days of data) [2025-09-22T18:28:51.289432] [DEBUG] [LOCAL ] DXC: Primary data saved (49606 records). [2025-09-22T18:28:51.289579] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-22T18:28:51.289750] [INFO ] [MAIN ] Update Progress: 672/2372 symbols completed. DXC took 29.7s. Estimated remaining: 3h 44m 37s. Rate: 7.6 symbols/min [2025-09-22T18:28:51.458590] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:28:51.458788] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-09-22T18:28:51.458831] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-09-22T18:28:51.458973] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-22T18:28:51.459016] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-22T18:28:51.459055] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-09-22T18:28:51.459086] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-22T18:28:51.732812] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-22T18:28:51.850856] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:28:52.100037] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-22T18:28:52.507708] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T18:28:52.521995] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-22T18:28:53.204132] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T18:28:53.322077] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-22T18:28:53.636536] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-22T18:28:54.122099] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-22T18:28:54.922090] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-22T18:28:54.978568] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T18:28:55.247006] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T18:28:55.722085] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-22T18:28:56.131193] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T18:28:56.522056] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-22T18:28:56.811202] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T18:28:57.322016] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-22T18:28:57.585401] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T18:28:58.122060] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-22T18:28:58.615069] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T18:28:58.922114] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-22T18:28:59.405057] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T18:28:59.722053] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-22T18:29:00.083566] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T18:29:00.522118] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-22T18:29:01.001178] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T18:29:01.322094] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-22T18:29:02.122064] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-22T18:29:02.184398] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T18:29:02.191052] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58265 records). [2025-09-22T18:29:02.191208] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-22T18:29:02.603115] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-22T18:29:02.603237] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-22T18:29:02.604043] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-22T18:29:02.604132] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-22T18:29:02.607965] [DEBUG] [LOCAL ] DXYZ: Trimmed 58265 records to 36760 (keeping 200 days of data) [2025-09-22T18:29:02.834685] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36760 records). [2025-09-22T18:29:02.834839] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-22T18:29:02.834986] [INFO ] [MAIN ] Update Progress: 673/2372 symbols completed. DXYZ took 40.4s. Estimated remaining: 3h 44m 38s. Rate: 7.6 symbols/min [2025-09-22T18:29:02.927219] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-22T18:29:03.009810] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:29:03.033610] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T18:29:03.043998] [DEBUG] [LOCAL ] EAI: Loaded 4060 existing records from primary storage. [2025-09-22T18:29:03.044279] [INFO ] [MAIN ] EAI: Loaded 4060 existing records. [2025-09-22T18:29:03.220233] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:29:03.220509] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-22T18:29:03.220574] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-22T18:29:03.220897] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-22T18:29:03.220998] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-22T18:29:03.611838] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:29:03.614099] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T18:29:03.722007] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-22T18:29:04.248154] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T18:29:04.432991] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-22T18:29:04.522004] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-22T18:29:05.100340] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T18:29:05.322073] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-22T18:29:06.122074] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-22T18:29:06.674192] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T18:29:06.794376] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T18:29:06.922069] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-22T18:29:07.722061] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-22T18:29:07.919995] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T18:29:08.522065] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-22T18:29:09.101165] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-22T18:29:09.276206] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T18:29:09.322011] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-22T18:29:10.122095] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-22T18:29:10.594401] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T18:29:10.599461] [INFO ] [REMOTE ] DY: Full fetch complete (44999 records). [2025-09-22T18:29:10.599572] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-22T18:29:10.927273] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-22T18:29:11.005216] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-22T18:29:11.005299] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-22T18:29:11.005969] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-22T18:29:11.006033] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-22T18:29:11.006999] [DEBUG] [LOCAL ] DY: Trimmed 44999 records to 29922 (keeping 200 days of data) [2025-09-22T18:29:11.220345] [DEBUG] [LOCAL ] DY: Primary data saved (29922 records). [2025-09-22T18:29:11.220776] [INFO ] [MAIN ] DY: Full history saved. [2025-09-22T18:29:11.220963] [INFO ] [MAIN ] Update Progress: 674/2372 symbols completed. DY took 29.6s. Estimated remaining: 3h 44m 32s. Rate: 7.6 symbols/min [2025-09-22T18:29:11.402149] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:29:11.420096] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-09-22T18:29:11.421973] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T18:29:11.422115] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-09-22T18:29:11.429626] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-22T18:29:11.429868] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-22T18:29:11.429935] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-09-22T18:29:11.429971] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-22T18:29:11.607475] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-22T18:29:11.726025] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-22T18:29:11.818158] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:29:12.340795] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T18:29:12.522068] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-22T18:29:13.322074] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-22T18:29:14.058041] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T18:29:14.122076] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-22T18:29:14.778231] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T18:29:14.835630] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T18:29:14.840555] [INFO ] [REMOTE ] E: Full fetch complete (48502 records). [2025-09-22T18:29:14.840684] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-22T18:29:14.927285] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-22T18:29:15.230162] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-22T18:29:15.230271] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-22T18:29:15.231023] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-22T18:29:15.231092] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-22T18:29:15.232341] [DEBUG] [LOCAL ] E: Trimmed 48502 records to 33511 (keeping 200 days of data) [2025-09-22T18:29:15.446729] [DEBUG] [LOCAL ] E: Primary data saved (33511 records). [2025-09-22T18:29:15.446876] [INFO ] [MAIN ] E: Full history saved. [2025-09-22T18:29:15.446983] [INFO ] [MAIN ] Update Progress: 675/2372 symbols completed. E took 25.7s. Estimated remaining: 3h 44m 14s. Rate: 7.6 symbols/min [2025-09-22T18:29:15.637268] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T18:29:15.638941] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:29:15.698256] [DEBUG] [LOCAL ] EAT: Loaded 50594 existing records from primary storage. [2025-09-22T18:29:15.698431] [INFO ] [MAIN ] EAT: Loaded 50594 existing records. [2025-09-22T18:29:15.727590] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-22T18:29:15.885866] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:29:15.886237] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-22T18:29:15.886304] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-22T18:29:15.887480] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-22T18:29:15.887541] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-22T18:29:16.241040] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:29:16.522062] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-22T18:29:16.866387] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-22T18:29:17.158263] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T18:29:17.322065] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-22T18:29:17.930550] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T18:29:17.931855] [INFO ] [REMOTE ] EAI: Full fetch complete (6159 records). [2025-09-22T18:29:17.931925] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-22T18:29:18.128393] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-22T18:29:18.325042] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-22T18:29:18.325126] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-22T18:29:18.325337] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-22T18:29:18.325375] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-22T18:29:18.325937] [DEBUG] [LOCAL ] EAI: Trimmed 6159 records to 3977 (keeping 200 days of data) [2025-09-22T18:29:18.358970] [DEBUG] [LOCAL ] EAI: Primary data saved (3977 records). [2025-09-22T18:29:18.359181] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-22T18:29:18.359318] [INFO ] [MAIN ] Update Progress: 676/2372 symbols completed. EAI took 15.5s. Estimated remaining: 3h 43m 54s. Rate: 7.6 symbols/min [2025-09-22T18:29:18.537353] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:29:18.582214] [DEBUG] [LOCAL ] EB: Loaded 38768 existing records from primary storage. [2025-09-22T18:29:18.582358] [INFO ] [MAIN ] EB: Loaded 38768 existing records. [2025-09-22T18:29:18.776994] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:29:18.777307] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-22T18:29:18.777358] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-22T18:29:18.778516] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-22T18:29:18.778579] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-22T18:29:18.927211] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-22T18:29:19.144632] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:29:19.722062] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-22T18:29:19.815966] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T18:29:20.366469] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T18:29:20.522099] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-22T18:29:21.322105] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-22T18:29:21.388837] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T18:29:22.122084] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-22T18:29:22.418390] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T18:29:22.447848] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-22T18:29:22.922117] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-22T18:29:23.241940] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T18:29:23.722058] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-22T18:29:24.522082] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-22T18:29:24.557941] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T18:29:25.233859] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T18:29:25.322089] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-22T18:29:26.122089] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-22T18:29:26.346348] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T18:29:26.631559] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T18:29:26.922071] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-22T18:29:27.722042] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-22T18:29:27.789285] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T18:29:28.527186] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-22T18:29:28.545267] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T18:29:29.163820] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T18:29:29.322051] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-22T18:29:29.865409] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T18:29:30.122039] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-22T18:29:30.922030] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-22T18:29:31.308033] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T18:29:31.708035] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T18:29:31.722014] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-22T18:29:32.166526] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T18:29:32.522140] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-22T18:29:33.322110] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-22T18:29:33.497428] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T18:29:33.938280] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T18:29:34.122112] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-22T18:29:34.696573] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T18:29:34.922052] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-22T18:29:35.722042] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-22T18:29:35.882167] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T18:29:36.497842] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T18:29:36.522004] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-22T18:29:36.566436] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T18:29:37.322070] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-22T18:29:37.349397] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T18:29:38.122114] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-22T18:29:38.922242] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-22T18:29:38.978982] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T18:29:39.371557] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T18:29:39.376119] [INFO ] [REMOTE ] EAF: Full fetch complete (64997 records). [2025-09-22T18:29:39.376211] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-22T18:29:39.722441] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-22T18:29:39.761424] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-22T18:29:39.761494] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-22T18:29:39.762264] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-22T18:29:39.762327] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-22T18:29:39.763583] [DEBUG] [LOCAL ] EAF: Trimmed 64997 records to 43968 (keeping 200 days of data) [2025-09-22T18:29:40.012110] [DEBUG] [LOCAL ] EAF: Primary data saved (43968 records). [2025-09-22T18:29:40.012247] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-22T18:29:40.012321] [INFO ] [MAIN ] Update Progress: 677/2372 symbols completed. EAF took 48.7s. Estimated remaining: 3h 44m 20s. Rate: 7.6 symbols/min [2025-09-22T18:29:40.089100] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T18:29:40.522061] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-22T18:29:41.322099] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-22T18:29:41.697198] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-22T18:29:41.924481] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T18:29:41.928416] [INFO ] [REMOTE ] EARN: Full fetch complete (46651 records). [2025-09-22T18:29:41.928504] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-22T18:29:42.149529] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-22T18:29:42.307779] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-22T18:29:42.307855] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-22T18:29:42.308511] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-22T18:29:42.308573] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-22T18:29:42.309590] [DEBUG] [LOCAL ] EARN: Trimmed 46651 records to 30462 (keeping 200 days of data) [2025-09-22T18:29:42.483360] [DEBUG] [LOCAL ] EARN: Primary data saved (30462 records). [2025-09-22T18:29:42.483494] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-22T18:29:42.483568] [INFO ] [MAIN ] Update Progress: 678/2372 symbols completed. EARN took 31.3s. Estimated remaining: 3h 43m 59s. Rate: 7.6 symbols/min [2025-09-22T18:29:42.771899] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T18:29:42.922066] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-22T18:29:43.973961] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-22T18:29:43.981346] [INFO ] [REMOTE ] EAT: Full fetch complete (71336 records). [2025-09-22T18:29:43.981461] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-22T18:29:43.982271] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:29:43.982367] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:29:43.982410] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:29:43.982458] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-22T18:29:43.982541] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-22T18:29:43.982635] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-09-22T18:29:43.983114] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-09-22T18:29:43.983206] [INFO ] [MAIN ] Update Progress: 679/2372 symbols completed. EAT took 28.5s. Estimated remaining: 3h 43m 35s. Rate: 7.6 symbols/min [2025-09-22T18:29:44.205774] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T18:29:44.213158] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-22T18:29:45.473212] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T18:29:45.481959] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-22T18:29:46.896533] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T18:29:46.905011] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-22T18:29:48.240089] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T18:29:48.245696] [INFO ] [REMOTE ] EB: Full fetch complete (57131 records). [2025-09-22T18:29:48.245811] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-22T18:29:48.635051] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-22T18:29:48.635138] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-22T18:29:48.636585] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-22T18:29:48.636670] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-22T18:29:48.637875] [DEBUG] [LOCAL ] EB: Trimmed 57131 records to 37957 (keeping 200 days of data) [2025-09-22T18:29:48.846819] [DEBUG] [LOCAL ] EB: Primary data saved (37957 records). [2025-09-22T18:29:48.846981] [INFO ] [MAIN ] EB: Full history saved. [2025-09-22T18:29:48.847076] [INFO ] [MAIN ] Update Progress: 680/2372 symbols completed. EB took 30.5s. Estimated remaining: 3h 43m 19s. Rate: 7.6 symbols/min [2025-09-22T18:29:49.518316] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:29:49.482903] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:29:49.546234] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:29:49.562616] [DEBUG] [LOCAL ] EBR: No existing data file found in primary storage. [2025-09-22T18:29:49.600704] [WARN ] [MAIN ] EBR: No existing data found, performing full refresh instead. [2025-09-22T18:29:49.626193] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:29:49.626522] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-22T18:29:49.626859] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-22T18:29:49.627450] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-09-22T18:29:49.627504] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-22T18:29:49.724361] [DEBUG] [LOCAL ] EBF: Loaded 19927 existing records from primary storage. [2025-09-22T18:29:49.764355] [INFO ] [MAIN ] EBF: Loaded 19927 existing records. [2025-09-22T18:29:50.058460] [DEBUG] [LOCAL ] EC: Loaded 50191 existing records from primary storage. [2025-09-22T18:29:50.059163] [DEBUG] [LOCAL ] EBS: Loaded 47661 existing records from primary storage. [2025-09-22T18:29:50.128309] [INFO ] [MAIN ] EC: Loaded 50191 existing records. [2025-09-22T18:29:50.144809] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:29:50.144695] [INFO ] [MAIN ] EBS: Loaded 47661 existing records. [2025-09-22T18:29:50.251625] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-22T18:29:50.251790] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-22T18:29:50.393941] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-22T18:29:50.399351] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-22T18:29:50.683372] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:29:50.723972] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-22T18:29:50.728063] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:29:50.771234] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-22T18:29:50.791817] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-22T18:29:50.833195] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-22T18:29:50.833300] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:29:50.838574] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-22T18:29:50.870179] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-22T18:29:50.879741] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-22T18:29:50.951252] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-22T18:29:51.052816] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-22T18:29:51.610477] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:29:51.626584] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-22T18:29:51.826208] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:29:51.859210] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-22T18:29:51.981243] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:29:51.981596] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-22T18:29:52.176710] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T18:29:52.188024] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-22T18:29:52.884569] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T18:29:52.888291] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-22T18:29:53.431591] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T18:29:53.441586] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-22T18:29:53.472935] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T18:29:53.482953] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-22T18:29:53.570414] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T18:29:53.574207] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-22T18:29:53.761428] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T18:29:53.770465] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-22T18:29:54.600132] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T18:29:54.604499] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-22T18:29:54.962755] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T18:29:54.971805] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-22T18:29:55.114535] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T18:29:55.195671] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T18:29:55.722080] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-22T18:29:55.857684] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-22T18:29:56.306508] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T18:29:56.522079] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-22T18:29:57.317036] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T18:29:57.326293] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-22T18:29:57.705294] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T18:29:58.122068] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-22T18:29:58.841637] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T18:29:58.922054] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-22T18:29:59.411218] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T18:29:59.722066] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-22T18:30:00.530520] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-22T18:30:00.549831] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T18:30:00.625634] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T18:30:01.322053] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-22T18:30:02.122105] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-22T18:30:02.574354] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-22T18:30:02.922115] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-22T18:30:03.722086] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-22T18:30:03.959319] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-22T18:30:04.522069] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-22T18:30:05.247991] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (3.13 seconds). [2025-09-22T18:30:05.322068] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-22T18:30:06.664039] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T18:30:06.668921] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-22T18:30:06.825604] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-22T18:30:06.864606] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (3.14 seconds). [2025-09-22T18:30:06.903492] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (3.98 seconds). [2025-09-22T18:30:06.922006] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-22T18:30:07.390614] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T18:30:07.722072] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-22T18:30:08.391327] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T18:30:08.522061] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-22T18:30:08.940814] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T18:30:09.322073] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-22T18:30:09.842410] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T18:30:10.122084] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-22T18:30:10.786883] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T18:30:10.790123] [INFO ] [REMOTE ] EBF: Full fetch complete (27317 records). [2025-09-22T18:30:10.790200] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-22T18:30:10.923444] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-22T18:30:11.184768] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-22T18:30:11.184896] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-22T18:30:11.185551] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-22T18:30:11.185634] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-22T18:30:11.186918] [DEBUG] [LOCAL ] EBF: Trimmed 27317 records to 19545 (keeping 200 days of data) [2025-09-22T18:30:11.311284] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T18:30:11.355013] [DEBUG] [LOCAL ] EBF: Primary data saved (19545 records). [2025-09-22T18:30:11.355173] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-22T18:30:11.355268] [INFO ] [MAIN ] Update Progress: 681/2372 symbols completed. EBF took 22.5s. Estimated remaining: 3h 43m 48s. Rate: 7.6 symbols/min [2025-09-22T18:30:11.524524] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:30:11.524737] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-09-22T18:30:11.524784] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-09-22T18:30:11.524976] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-22T18:30:11.525023] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-22T18:30:11.525064] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-09-22T18:30:11.525095] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-22T18:30:11.727162] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-22T18:30:11.887716] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:30:12.522054] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-22T18:30:13.327211] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-22T18:30:13.343047] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-22T18:30:14.122111] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-22T18:30:14.522804] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-22T18:30:14.704680] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-09-22T18:30:14.922063] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-22T18:30:15.722060] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-22T18:30:15.832714] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-22T18:30:15.833929] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T18:30:15.914706] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T18:30:15.921713] [INFO ] [REMOTE ] EBS: Full fetch complete (67036 records). [2025-09-22T18:30:15.921864] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-22T18:30:15.922639] [FATAL] [VALIDATOR ] EBS: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:30:15.922776] [FATAL] [MAIN ] EBS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:30:15.922820] [WARN ] [MAIN ] EBS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:30:15.922861] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-22T18:30:15.922920] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-09-22T18:30:15.922956] [INFO ] [LOCAL ] EBS: Starting deletion of derivative data. [2025-09-22T18:30:15.923414] [DEBUG] [LOCAL ] EBS: Deleted derivative data file. [2025-09-22T18:30:15.923514] [INFO ] [MAIN ] Update Progress: 682/2372 symbols completed. EBS took 27.1s. Estimated remaining: 3h 43m 31s. Rate: 7.6 symbols/min [2025-09-22T18:30:16.095260] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:30:16.141116] [DEBUG] [LOCAL ] ECC: Loaded 44039 existing records from primary storage. [2025-09-22T18:30:16.141290] [INFO ] [MAIN ] ECC: Loaded 44039 existing records. [2025-09-22T18:30:16.319374] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:30:16.319674] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-22T18:30:16.319731] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-22T18:30:16.320936] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-22T18:30:16.320998] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-22T18:30:16.533698] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-22T18:30:16.688556] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:30:17.049628] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T18:30:17.056194] [INFO ] [REMOTE ] EBR: Full fetch complete (62494 records). [2025-09-22T18:30:17.056305] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-22T18:30:17.056990] [FATAL] [VALIDATOR ] EBR: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:30:17.057097] [FATAL] [MAIN ] EBR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:30:17.057165] [WARN ] [MAIN ] EBR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:30:17.057236] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-22T18:30:17.057303] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-09-22T18:30:17.057338] [INFO ] [LOCAL ] EBR: Starting deletion of derivative data. [2025-09-22T18:30:17.057376] [DEBUG] [LOCAL ] EBR: No derivative data file found to delete. [2025-09-22T18:30:17.057441] [INFO ] [MAIN ] Update Progress: 683/2372 symbols completed. EBR took 28.2s. Estimated remaining: 3h 43m 6s. Rate: 7.6 symbols/min [2025-09-22T18:30:17.230309] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:30:17.230501] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-22T18:30:17.230540] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-22T18:30:17.230719] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-22T18:30:17.230770] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-22T18:30:17.230812] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-22T18:30:17.230843] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-22T18:30:17.327192] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-22T18:30:17.624463] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:30:17.641672] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T18:30:18.122084] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-22T18:30:18.922069] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-22T18:30:19.032286] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T18:30:19.722063] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-22T18:30:19.844303] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T18:30:20.041527] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T18:30:20.522078] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-22T18:30:21.322055] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-22T18:30:21.786807] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T18:30:21.804629] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-22T18:30:22.124572] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-22T18:30:22.128036] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-22T18:30:22.922051] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-22T18:30:23.127372] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T18:30:23.722047] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-22T18:30:24.201288] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T18:30:24.522065] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-22T18:30:24.938720] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T18:30:25.322056] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-22T18:30:25.553939] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T18:30:25.655317] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-22T18:30:26.122058] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-22T18:30:26.922063] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-22T18:30:27.559361] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T18:30:27.722052] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-22T18:30:28.407739] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T18:30:28.522089] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-22T18:30:29.322083] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-22T18:30:29.548403] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T18:30:29.557204] [INFO ] [REMOTE ] EC: Full fetch complete (71965 records). [2025-09-22T18:30:29.557500] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-22T18:30:29.865752] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T18:30:29.991533] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-22T18:30:29.991623] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-22T18:30:29.992490] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-22T18:30:29.992592] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-22T18:30:29.994077] [DEBUG] [LOCAL ] EC: Trimmed 71965 records to 49397 (keeping 200 days of data) [2025-09-22T18:30:30.122307] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-22T18:30:30.304174] [DEBUG] [LOCAL ] EC: Primary data saved (49397 records). [2025-09-22T18:30:30.304440] [INFO ] [MAIN ] EC: Full history saved. [2025-09-22T18:30:30.304569] [INFO ] [MAIN ] Update Progress: 684/2372 symbols completed. EC took 41.5s. Estimated remaining: 3h 43m 12s. Rate: 7.6 symbols/min [2025-09-22T18:30:30.480559] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:30:30.480793] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-22T18:30:30.480850] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-22T18:30:30.480995] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-22T18:30:30.481038] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-22T18:30:30.481081] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-22T18:30:30.481133] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-22T18:30:30.589378] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T18:30:30.883837] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:30:30.922121] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-22T18:30:30.979076] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T18:30:31.229959] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-22T18:30:31.722083] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-22T18:30:32.522113] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-22T18:30:33.067379] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T18:30:33.322092] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-22T18:30:33.830750] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T18:30:33.987721] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T18:30:34.122046] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-22T18:30:34.922112] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-22T18:30:35.333730] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-22T18:30:35.671020] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T18:30:35.722010] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-22T18:30:36.522059] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-22T18:30:36.781416] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-22T18:30:37.322060] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-22T18:30:37.445266] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T18:30:37.927839] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T18:30:38.122058] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-22T18:30:38.740204] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T18:30:38.922111] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-22T18:30:39.369040] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-22T18:30:39.722097] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-22T18:30:40.284161] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T18:30:40.522082] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-22T18:30:40.850671] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-22T18:30:41.322077] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-22T18:30:41.769865] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-22T18:30:42.122063] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-22T18:30:42.575196] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T18:30:42.576210] [INFO ] [REMOTE ] ECCC: Full fetch complete (1292 records). [2025-09-22T18:30:42.576309] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-22T18:30:42.776190] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-22T18:30:42.776444] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:30:42.776516] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:30:42.776607] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-22T18:30:42.776714] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-22T18:30:42.776769] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-22T18:30:42.776827] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-22T18:30:42.776907] [INFO ] [MAIN ] Update Progress: 685/2372 symbols completed. ECCC took 25.7s. Estimated remaining: 3h 43m 15s. Rate: 7.6 symbols/min [2025-09-22T18:30:42.922038] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-22T18:30:42.957819] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:30:42.958022] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-22T18:30:42.958065] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-22T18:30:42.958211] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-22T18:30:42.958255] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-22T18:30:42.958296] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-22T18:30:42.958328] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-22T18:30:43.321997] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:30:43.722065] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-22T18:30:44.522100] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-22T18:30:44.754299] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T18:30:44.854736] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-22T18:30:44.912447] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T18:30:44.918001] [INFO ] [REMOTE ] ECAT: Full fetch complete (42467 records). [2025-09-22T18:30:44.918105] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-22T18:30:45.300526] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-22T18:30:45.300618] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-22T18:30:45.301245] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-22T18:30:45.301302] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-22T18:30:45.302310] [DEBUG] [LOCAL ] ECAT: Trimmed 42467 records to 29793 (keeping 200 days of data) [2025-09-22T18:30:45.355935] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-22T18:30:45.490074] [DEBUG] [LOCAL ] ECAT: Primary data saved (29793 records). [2025-09-22T18:30:45.490298] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-22T18:30:45.490388] [INFO ] [MAIN ] Update Progress: 686/2372 symbols completed. ECAT took 34.1s. Estimated remaining: 3h 42m 54s. Rate: 7.6 symbols/min [2025-09-22T18:30:45.671217] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:30:45.671432] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-22T18:30:45.671480] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-22T18:30:45.671630] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-22T18:30:45.671711] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-22T18:30:45.671764] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-22T18:30:45.671798] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-22T18:30:45.970205] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-22T18:30:46.053138] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:30:46.122044] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-22T18:30:46.472817] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-22T18:30:46.922067] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-22T18:30:47.431849] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-22T18:30:47.722070] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-22T18:30:48.522098] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-22T18:30:48.838549] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-22T18:30:49.073115] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T18:30:49.322064] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-22T18:30:49.842712] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-22T18:30:50.122066] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-22T18:30:50.573243] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-22T18:30:50.922095] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-22T18:30:51.296491] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-22T18:30:51.722059] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-22T18:30:52.237400] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-22T18:30:52.522058] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-22T18:30:53.322072] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-22T18:30:53.702915] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-22T18:30:53.889468] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T18:30:54.122043] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-22T18:30:54.637665] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-22T18:30:54.638587] [INFO ] [REMOTE ] ECCU: Full fetch complete (4402 records). [2025-09-22T18:30:54.638691] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-22T18:30:54.639082] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:30:54.639165] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:30:54.639208] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:30:54.639274] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-22T18:30:54.639353] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-22T18:30:54.639409] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-22T18:30:54.639466] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-22T18:30:54.639544] [INFO ] [MAIN ] Update Progress: 687/2372 symbols completed. ECCU took 24.3s. Estimated remaining: 3h 42m 49s. Rate: 7.6 symbols/min [2025-09-22T18:30:54.807913] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:30:54.846256] [DEBUG] [LOCAL ] ECG: Loaded 35132 existing records from primary storage. [2025-09-22T18:30:54.846421] [INFO ] [MAIN ] ECG: Loaded 35132 existing records. [2025-09-22T18:30:54.927148] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-22T18:30:55.031898] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:30:55.032182] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-22T18:30:55.032233] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-22T18:30:55.033291] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-22T18:30:55.033354] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-22T18:30:55.327822] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-22T18:30:55.406321] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:30:55.722128] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-22T18:30:56.522144] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-22T18:30:56.853703] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-22T18:30:57.322071] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-22T18:30:57.506516] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T18:30:57.513051] [INFO ] [REMOTE ] ECC: Full fetch complete (60716 records). [2025-09-22T18:30:57.513185] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-22T18:30:57.513920] [FATAL] [VALIDATOR ] ECC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:30:57.514008] [FATAL] [MAIN ] ECC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:30:57.514052] [WARN ] [MAIN ] ECC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:30:57.514119] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-22T18:30:57.514186] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-09-22T18:30:57.514224] [INFO ] [LOCAL ] ECC: Starting deletion of derivative data. [2025-09-22T18:30:57.514563] [DEBUG] [LOCAL ] ECC: Deleted derivative data file. [2025-09-22T18:30:57.514682] [INFO ] [MAIN ] Update Progress: 688/2372 symbols completed. ECC took 41.6s. Estimated remaining: 3h 42m 29s. Rate: 7.6 symbols/min [2025-09-22T18:30:57.617957] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-22T18:30:57.686838] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:30:57.735612] [DEBUG] [LOCAL ] ECL: Loaded 47444 existing records from primary storage. [2025-09-22T18:30:57.735803] [INFO ] [MAIN ] ECL: Loaded 47444 existing records. [2025-09-22T18:30:57.913280] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:30:57.913549] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-22T18:30:57.913608] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-22T18:30:57.915745] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-22T18:30:57.915807] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-22T18:30:58.127155] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-22T18:30:58.277620] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:30:58.494324] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-22T18:30:58.922080] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-22T18:30:59.722051] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-22T18:31:00.522065] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-22T18:31:00.706042] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T18:31:01.290295] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T18:31:01.322030] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-22T18:31:01.805164] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-22T18:31:02.003385] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T18:31:02.004357] [INFO ] [REMOTE ] ECCX: Full fetch complete (1475 records). [2025-09-22T18:31:02.004430] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-22T18:31:02.004833] [FATAL] [VALIDATOR ] ECCX: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:31:02.004966] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:31:02.005048] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:31:02.005162] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-22T18:31:02.005274] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-22T18:31:02.005353] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-22T18:31:02.005448] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-22T18:31:02.005569] [INFO ] [MAIN ] Update Progress: 689/2372 symbols completed. ECCX took 16.5s. Estimated remaining: 3h 42m 13s. Rate: 7.6 symbols/min [2025-09-22T18:31:02.127174] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-22T18:31:02.197866] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:31:02.221112] [DEBUG] [LOCAL ] ECO: Loaded 18901 existing records from primary storage. [2025-09-22T18:31:02.221238] [INFO ] [MAIN ] ECO: Loaded 18901 existing records. [2025-09-22T18:31:02.399880] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:31:02.400128] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-22T18:31:02.400177] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-22T18:31:02.401088] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-22T18:31:02.401153] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-22T18:31:02.744853] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T18:31:02.805352] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:31:02.922072] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-22T18:31:03.722142] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-22T18:31:04.150420] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T18:31:04.522060] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-22T18:31:04.976582] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-22T18:31:05.322062] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-22T18:31:05.547950] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T18:31:06.122072] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-22T18:31:06.662186] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T18:31:06.922105] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-22T18:31:07.367996] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-22T18:31:07.722064] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-22T18:31:07.836204] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T18:31:07.998092] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-22T18:31:08.522061] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-22T18:31:09.322056] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-22T18:31:09.672546] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-22T18:31:09.793822] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T18:31:10.122064] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-22T18:31:10.922091] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-22T18:31:11.633049] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T18:31:11.722038] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-22T18:31:12.279191] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T18:31:12.522062] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-22T18:31:13.109393] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-22T18:31:13.322059] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-22T18:31:13.485943] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T18:31:14.122068] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-22T18:31:14.314843] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T18:31:14.922068] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-22T18:31:15.369041] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T18:31:15.370292] [INFO ] [REMOTE ] ECCW: Full fetch complete (1415 records). [2025-09-22T18:31:15.370392] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-22T18:31:15.580062] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-22T18:31:15.580441] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:31:15.580554] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:31:15.580793] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-22T18:31:15.580909] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-22T18:31:15.581047] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-22T18:31:15.581127] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-22T18:31:15.581222] [INFO ] [MAIN ] Update Progress: 690/2372 symbols completed. ECCW took 32.8s. Estimated remaining: 3h 42m 18s. Rate: 7.6 symbols/min [2025-09-22T18:31:15.727065] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-22T18:31:15.761875] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:31:15.812134] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T18:31:15.837125] [DEBUG] [LOCAL ] ECVT: Loaded 43818 existing records from primary storage. [2025-09-22T18:31:15.837268] [INFO ] [MAIN ] ECVT: Loaded 43818 existing records. [2025-09-22T18:31:16.016046] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:31:16.016314] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-22T18:31:16.016374] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-22T18:31:16.018278] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-22T18:31:16.018343] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-22T18:31:16.380778] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:31:16.522059] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-22T18:31:17.322057] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-22T18:31:17.464600] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T18:31:17.651061] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T18:31:18.107912] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T18:31:18.122028] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-22T18:31:18.922068] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-22T18:31:19.433529] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T18:31:19.722037] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-22T18:31:20.078382] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T18:31:20.522094] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-22T18:31:21.280198] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T18:31:21.322059] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-22T18:31:22.122044] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-22T18:31:22.159624] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T18:31:22.820609] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T18:31:22.922073] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-22T18:31:23.024915] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T18:31:23.722042] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-22T18:31:24.522025] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-22T18:31:24.554457] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T18:31:24.605953] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T18:31:25.322063] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-22T18:31:25.732815] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T18:31:26.122066] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-22T18:31:26.922053] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-22T18:31:27.039536] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T18:31:27.354185] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T18:31:27.722022] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-22T18:31:28.522163] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-22T18:31:28.636440] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T18:31:28.710574] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T18:31:29.322038] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-22T18:31:29.387373] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-22T18:31:30.122084] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-22T18:31:30.889359] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T18:31:30.922068] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-22T18:31:31.613974] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T18:31:31.622066] [INFO ] [REMOTE ] ECL: Full fetch complete (67544 records). [2025-09-22T18:31:31.622239] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-22T18:31:31.727916] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-22T18:31:32.052348] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-22T18:31:32.052458] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-22T18:31:32.053318] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-22T18:31:32.053570] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-22T18:31:32.065804] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T18:31:32.070422] [DEBUG] [LOCAL ] ECL: Trimmed 67544 records to 46762 (keeping 200 days of data) [2025-09-22T18:31:32.386691] [DEBUG] [LOCAL ] ECL: Primary data saved (46762 records). [2025-09-22T18:31:32.386841] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-22T18:31:32.386970] [INFO ] [MAIN ] Update Progress: 691/2372 symbols completed. ECL took 34.9s. Estimated remaining: 3h 42m 32s. Rate: 7.6 symbols/min [2025-09-22T18:31:32.530399] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-22T18:31:32.566340] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:31:32.566581] [DEBUG] [LOCAL ] ED: No existing data file found in primary storage. [2025-09-22T18:31:32.566638] [WARN ] [MAIN ] ED: No existing data found, performing full refresh instead. [2025-09-22T18:31:32.566996] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-22T18:31:32.567040] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-22T18:31:32.567083] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-09-22T18:31:32.567119] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-22T18:31:32.951482] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:31:33.220020] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T18:31:33.322061] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-22T18:31:33.835713] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T18:31:34.122065] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-22T18:31:34.663864] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T18:31:34.922126] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-22T18:31:35.492829] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T18:31:35.722049] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-22T18:31:36.522086] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-22T18:31:37.005040] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T18:31:37.011162] [INFO ] [REMOTE ] ECG: Full fetch complete (51696 records). [2025-09-22T18:31:37.011381] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-22T18:31:37.324106] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-22T18:31:37.419745] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-22T18:31:37.476872] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-22T18:31:37.476955] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-22T18:31:37.477862] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-22T18:31:37.478420] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-22T18:31:37.479899] [DEBUG] [LOCAL ] ECG: Trimmed 51696 records to 34377 (keeping 200 days of data) [2025-09-22T18:31:37.684912] [DEBUG] [LOCAL ] ECG: Primary data saved (34377 records). [2025-09-22T18:31:37.685122] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-22T18:31:37.685251] [INFO ] [MAIN ] Update Progress: 692/2372 symbols completed. ECG took 43.0s. Estimated remaining: 3h 42m 18s. Rate: 7.6 symbols/min [2025-09-22T18:31:37.862951] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:31:37.873209] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T18:31:37.877131] [INFO ] [REMOTE ] ECO: Full fetch complete (29518 records). [2025-09-22T18:31:37.877306] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-22T18:31:38.109108] [DEBUG] [LOCAL ] EDD: Loaded 27679 existing records from primary storage. [2025-09-22T18:31:38.142276] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-22T18:31:38.142174] [INFO ] [MAIN ] EDD: Loaded 27679 existing records. [2025-09-22T18:31:38.523534] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-22T18:31:38.541526] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-22T18:31:38.542298] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-22T18:31:38.542915] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-22T18:31:38.547297] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:31:38.548188] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-22T18:31:38.548268] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-22T18:31:38.548575] [DEBUG] [LOCAL ] ECO: Trimmed 29518 records to 18495 (keeping 200 days of data) [2025-09-22T18:31:38.549367] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-22T18:31:38.549496] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-22T18:31:38.822716] [DEBUG] [LOCAL ] ECO: Primary data saved (18495 records). [2025-09-22T18:31:38.828885] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-22T18:31:38.839488] [INFO ] [MAIN ] Update Progress: 693/2372 symbols completed. ECO took 36.8s. Estimated remaining: 3h 41m 53s. Rate: 7.6 symbols/min [2025-09-22T18:31:39.281302] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:31:39.312370] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:31:39.313036] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-22T18:31:39.350340] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T18:31:39.364571] [DEBUG] [LOCAL ] EDF: Loaded 13744 existing records from primary storage. [2025-09-22T18:31:39.365151] [INFO ] [MAIN ] EDF: Loaded 13744 existing records. [2025-09-22T18:31:39.594861] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:31:39.595821] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-22T18:31:39.595923] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-22T18:31:39.596852] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-22T18:31:39.597007] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-22T18:31:39.727304] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-22T18:31:40.010373] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:31:40.015789] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T18:31:40.522149] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-22T18:31:40.753397] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T18:31:41.113600] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T18:31:41.120847] [INFO ] [REMOTE ] ECVT: Full fetch complete (59871 records). [2025-09-22T18:31:41.121031] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-22T18:31:41.327141] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-22T18:31:41.538546] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-22T18:31:41.538723] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-22T18:31:41.539517] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-22T18:31:41.539668] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-22T18:31:41.543440] [DEBUG] [LOCAL ] ECVT: Trimmed 59871 records to 43080 (keeping 200 days of data) [2025-09-22T18:31:41.820493] [DEBUG] [LOCAL ] ECVT: Primary data saved (43080 records). [2025-09-22T18:31:41.820637] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-22T18:31:41.820787] [INFO ] [MAIN ] Update Progress: 694/2372 symbols completed. ECVT took 26.2s. Estimated remaining: 3h 41m 33s. Rate: 7.6 symbols/min [2025-09-22T18:31:41.994566] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:31:42.015928] [DEBUG] [LOCAL ] EDN: Loaded 18158 existing records from primary storage. [2025-09-22T18:31:42.016075] [INFO ] [MAIN ] EDN: Loaded 18158 existing records. [2025-09-22T18:31:42.127143] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-22T18:31:42.200923] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:31:42.201168] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-22T18:31:42.201217] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-22T18:31:42.201994] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-22T18:31:42.202054] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-22T18:31:42.602635] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:31:42.617917] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T18:31:42.655624] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-22T18:31:42.922064] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-22T18:31:43.234750] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-22T18:31:43.602991] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T18:31:43.722070] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-22T18:31:44.522066] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-22T18:31:44.935709] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T18:31:45.322076] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-22T18:31:46.122016] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-22T18:31:46.160966] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T18:31:46.516339] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T18:31:46.922089] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-22T18:31:47.422397] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T18:31:47.722106] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-22T18:31:48.522018] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-22T18:31:48.693346] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T18:31:48.735477] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T18:31:49.322052] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-22T18:31:49.707300] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T18:31:50.122123] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-22T18:31:50.393934] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T18:31:50.922122] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-22T18:31:51.647369] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T18:31:51.722059] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-22T18:31:52.452421] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T18:31:52.487929] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T18:31:52.522107] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-22T18:31:53.322070] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-22T18:31:53.592576] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T18:31:54.066989] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T18:31:54.122097] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-22T18:31:54.877744] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-22T18:31:54.922047] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-22T18:31:55.722075] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-22T18:31:55.897149] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-22T18:31:56.522037] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-22T18:31:56.591282] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T18:31:57.329506] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-22T18:31:57.332982] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T18:31:58.122084] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-22T18:31:58.315882] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T18:31:58.922051] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-22T18:31:59.628472] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T18:31:59.722010] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-22T18:32:00.245985] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T18:32:00.522071] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-22T18:32:01.322073] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-22T18:32:01.669898] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T18:32:01.796313] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T18:32:02.122063] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-22T18:32:02.187698] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-22T18:32:02.922109] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-22T18:32:03.722100] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-22T18:32:03.913525] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T18:32:03.958910] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T18:32:04.522095] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-22T18:32:04.845745] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T18:32:05.322051] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-22T18:32:06.122067] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-22T18:32:06.145133] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T18:32:06.153927] [INFO ] [REMOTE ] ED: Full fetch complete (76363 records). [2025-09-22T18:32:06.154074] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-22T18:32:06.549976] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-22T18:32:06.550074] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-22T18:32:06.550934] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-22T18:32:06.551033] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-22T18:32:06.554433] [DEBUG] [LOCAL ] ED: Trimmed 76363 records to 52808 (keeping 200 days of data) [2025-09-22T18:32:06.679365] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T18:32:06.685700] [INFO ] [REMOTE ] EDD: Full fetch complete (39081 records). [2025-09-22T18:32:06.686050] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-22T18:32:06.687893] [FATAL] [VALIDATOR ] EDD: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:32:06.687999] [FATAL] [MAIN ] EDD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:32:06.689573] [WARN ] [MAIN ] EDD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:32:06.690232] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-22T18:32:06.693326] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-09-22T18:32:06.698077] [INFO ] [LOCAL ] EDD: Starting deletion of derivative data. [2025-09-22T18:32:06.699170] [DEBUG] [LOCAL ] EDD: Deleted derivative data file. [2025-09-22T18:32:06.699515] [INFO ] [MAIN ] Update Progress: 695/2372 symbols completed. EDD took 29.0s. Estimated remaining: 3h 42m 6s. Rate: 7.6 symbols/min [2025-09-22T18:32:06.889319] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:32:06.890243] [DEBUG] [LOCAL ] EDU: No existing data file found in primary storage. [2025-09-22T18:32:06.891607] [WARN ] [MAIN ] EDU: No existing data found, performing full refresh instead. [2025-09-22T18:32:06.893310] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-22T18:32:06.893602] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-22T18:32:06.896287] [DEBUG] [LOCAL ] EDU: No primary data file found to delete. [2025-09-22T18:32:06.896399] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-22T18:32:06.987565] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-22T18:32:07.339855] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T18:32:07.409808] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:32:07.506424] [DEBUG] [LOCAL ] ED: Primary data saved (52808 records). [2025-09-22T18:32:07.506572] [INFO ] [MAIN ] ED: Full history saved. [2025-09-22T18:32:07.506689] [INFO ] [MAIN ] Update Progress: 696/2372 symbols completed. ED took 35.1s. Estimated remaining: 3h 41m 41s. Rate: 7.6 symbols/min [2025-09-22T18:32:07.712372] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:32:07.722019] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-22T18:32:07.749029] [DEBUG] [LOCAL ] EE: Loaded 33025 existing records from primary storage. [2025-09-22T18:32:07.749301] [INFO ] [MAIN ] EE: Loaded 33025 existing records. [2025-09-22T18:32:07.888540] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-22T18:32:07.946898] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:32:07.947163] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-22T18:32:07.947210] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-22T18:32:07.948268] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-22T18:32:07.948329] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-22T18:32:08.391603] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:32:08.522059] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-22T18:32:09.002985] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T18:32:09.008990] [INFO ] [REMOTE ] EDN: Full fetch complete (30601 records). [2025-09-22T18:32:09.009148] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-22T18:32:09.327182] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-22T18:32:09.406746] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-22T18:32:09.406855] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-22T18:32:09.407371] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-22T18:32:09.407427] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-22T18:32:09.408284] [DEBUG] [LOCAL ] EDN: Trimmed 30601 records to 18016 (keeping 200 days of data) [2025-09-22T18:32:09.516665] [DEBUG] [LOCAL ] EDN: Primary data saved (18016 records). [2025-09-22T18:32:09.516829] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-22T18:32:09.516919] [INFO ] [MAIN ] Update Progress: 697/2372 symbols completed. EDN took 27.7s. Estimated remaining: 3h 41m 19s. Rate: 7.6 symbols/min [2025-09-22T18:32:09.716976] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:32:09.721937] [DEBUG] [LOCAL ] EEA: Loaded 2853 existing records from primary storage. [2025-09-22T18:32:09.722027] [INFO ] [MAIN ] EEA: Loaded 2853 existing records. [2025-09-22T18:32:09.931956] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:32:09.932487] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-22T18:32:09.932572] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-22T18:32:09.932876] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-22T18:32:09.932937] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-22T18:32:10.127748] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-22T18:32:10.351979] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T18:32:10.357080] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:32:10.784147] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T18:32:10.922053] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-22T18:32:11.019325] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T18:32:11.722055] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-22T18:32:11.989563] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T18:32:12.522016] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-22T18:32:12.752605] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-22T18:32:12.755242] [INFO ] [REMOTE ] EDF: Full fetch complete (21019 records). [2025-09-22T18:32:12.755320] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-22T18:32:12.755911] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:32:12.756000] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:32:12.756050] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:32:12.756137] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-22T18:32:12.756222] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-09-22T18:32:12.756275] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-09-22T18:32:12.756807] [DEBUG] [LOCAL ] EDF: Deleted derivative data file. [2025-09-22T18:32:12.756941] [INFO ] [MAIN ] Update Progress: 698/2372 symbols completed. EDF took 33.9s. Estimated remaining: 3h 40m 60s. Rate: 7.6 symbols/min [2025-09-22T18:32:12.935547] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:32:12.935789] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-09-22T18:32:12.935845] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-09-22T18:32:12.935992] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-22T18:32:12.936055] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-22T18:32:12.936138] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-09-22T18:32:12.936183] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-22T18:32:13.313931] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:32:13.322030] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-22T18:32:14.127199] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-22T18:32:14.140571] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T18:32:14.757871] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T18:32:14.923437] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-22T18:32:14.925388] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T18:32:15.722054] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-22T18:32:16.527299] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-22T18:32:16.529766] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T18:32:16.696586] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T18:32:17.322098] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-22T18:32:17.632171] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T18:32:18.032587] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T18:32:18.122063] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-22T18:32:18.922057] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-22T18:32:19.573792] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T18:32:19.722011] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-22T18:32:20.109177] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T18:32:20.376589] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-22T18:32:20.522064] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-22T18:32:21.019614] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-22T18:32:21.322126] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-22T18:32:22.122065] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-22T18:32:22.521719] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-22T18:32:22.761989] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T18:32:22.922060] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-22T18:32:23.728423] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-22T18:32:23.732595] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T18:32:24.522060] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-22T18:32:25.322076] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-22T18:32:25.691334] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T18:32:25.952100] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T18:32:26.122024] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-22T18:32:26.292759] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T18:32:26.922104] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-22T18:32:27.583141] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T18:32:27.625999] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T18:32:27.722068] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-22T18:32:28.455970] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T18:32:28.522076] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-22T18:32:29.072011] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-22T18:32:29.322056] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-22T18:32:30.122055] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-22T18:32:30.801184] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T18:32:30.922057] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-22T18:32:31.535152] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T18:32:31.722061] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-22T18:32:31.955294] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T18:32:32.522123] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-22T18:32:33.322065] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-22T18:32:34.122125] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-22T18:32:34.455985] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T18:32:34.460839] [INFO ] [REMOTE ] EE: Full fetch complete (43496 records). [2025-09-22T18:32:34.460933] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-22T18:32:34.567949] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-09-22T18:32:34.850754] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-22T18:32:34.850843] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-22T18:32:34.851435] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-22T18:32:34.851476] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-22T18:32:34.852462] [DEBUG] [LOCAL ] EE: Trimmed 43496 records to 32535 (keeping 200 days of data) [2025-09-22T18:32:34.943876] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-22T18:32:35.061297] [DEBUG] [LOCAL ] EE: Primary data saved (32535 records). [2025-09-22T18:32:35.061458] [INFO ] [MAIN ] EE: Full history saved. [2025-09-22T18:32:35.061550] [INFO ] [MAIN ] Update Progress: 699/2372 symbols completed. EE took 27.6s. Estimated remaining: 3h 41m 26s. Rate: 7.6 symbols/min [2025-09-22T18:32:35.247040] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:32:35.293505] [DEBUG] [LOCAL ] EFC: Loaded 46929 existing records from primary storage. [2025-09-22T18:32:35.293704] [INFO ] [MAIN ] EFC: Loaded 46929 existing records. [2025-09-22T18:32:35.473630] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:32:35.477786] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-22T18:32:35.477931] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-22T18:32:35.478156] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-22T18:32:35.481099] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-22T18:32:35.481162] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-22T18:32:35.728726] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-22T18:32:35.771725] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-22T18:32:35.789759] [INFO ] [REMOTE ] EEX: Full fetch complete (20137 records). [2025-09-22T18:32:35.819566] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-22T18:32:35.838263] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:32:35.859900] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:32:35.859810] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:32:35.860014] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:32:35.860177] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-22T18:32:35.860557] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-09-22T18:32:35.860617] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-09-22T18:32:35.860709] [DEBUG] [LOCAL ] EEX: No derivative data file found to delete. [2025-09-22T18:32:35.860796] [INFO ] [MAIN ] Update Progress: 700/2372 symbols completed. EEX took 23.1s. Estimated remaining: 3h 41m 1s. Rate: 7.6 symbols/min [2025-09-22T18:32:36.043085] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:32:36.062822] [DEBUG] [LOCAL ] EFR: Loaded 14298 existing records from primary storage. [2025-09-22T18:32:36.062976] [INFO ] [MAIN ] EFR: Loaded 14298 existing records. [2025-09-22T18:32:36.228352] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-22T18:32:36.260942] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:32:36.261185] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-22T18:32:36.261233] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-22T18:32:36.262044] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-22T18:32:36.262105] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-22T18:32:36.532267] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-22T18:32:36.623527] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:32:36.973003] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-22T18:32:37.260579] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T18:32:37.322047] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-22T18:32:38.122104] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-22T18:32:38.248369] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T18:32:38.570481] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-22T18:32:38.922119] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-22T18:32:39.722113] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-22T18:32:39.810892] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T18:32:40.522130] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-22T18:32:41.144448] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T18:32:41.241299] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T18:32:41.322023] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-22T18:32:42.122065] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-22T18:32:42.599292] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-22T18:32:42.867695] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T18:32:42.922064] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-22T18:32:43.722122] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-22T18:32:44.522210] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-22T18:32:44.528638] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T18:32:44.796631] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T18:32:45.322067] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-22T18:32:45.827345] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T18:32:45.896946] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T18:32:45.897855] [INFO ] [REMOTE ] EEA: Full fetch complete (3982 records). [2025-09-22T18:32:45.897924] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-22T18:32:46.127177] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-22T18:32:46.255975] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-22T18:32:46.256054] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-22T18:32:46.256181] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-22T18:32:46.256219] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-22T18:32:46.256581] [DEBUG] [LOCAL ] EEA: Trimmed 3982 records to 2752 (keeping 200 days of data) [2025-09-22T18:32:46.273256] [DEBUG] [LOCAL ] EEA: Primary data saved (2752 records). [2025-09-22T18:32:46.273331] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-22T18:32:46.273405] [INFO ] [MAIN ] Update Progress: 701/2372 symbols completed. EEA took 36.8s. Estimated remaining: 3h 40m 59s. Rate: 7.6 symbols/min [2025-09-22T18:32:46.448559] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:32:46.463205] [DEBUG] [LOCAL ] EFT: Loaded 12640 existing records from primary storage. [2025-09-22T18:32:46.463330] [INFO ] [MAIN ] EFT: Loaded 12640 existing records. [2025-09-22T18:32:46.644554] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:32:46.644914] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-22T18:32:46.644976] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-22T18:32:46.645524] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-22T18:32:46.645586] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-22T18:32:46.925894] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-22T18:32:47.014162] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:32:47.022966] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T18:32:47.722069] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-22T18:32:48.522076] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-22T18:32:48.756391] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T18:32:48.782854] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T18:32:49.326212] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-22T18:32:49.328801] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T18:32:50.122074] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-22T18:32:50.141623] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-22T18:32:50.922051] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-22T18:32:51.367230] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T18:32:51.377435] [INFO ] [REMOTE ] EDU: Full fetch complete (66626 records). [2025-09-22T18:32:51.377615] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-22T18:32:51.694365] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T18:32:51.736774] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-22T18:32:51.794794] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-22T18:32:51.794918] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-22T18:32:51.795759] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-22T18:32:51.795827] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-22T18:32:51.800285] [DEBUG] [LOCAL ] EDU: Trimmed 66626 records to 45124 (keeping 200 days of data) [2025-09-22T18:32:52.068972] [DEBUG] [LOCAL ] EDU: Primary data saved (45124 records). [2025-09-22T18:32:52.069106] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-22T18:32:52.069180] [INFO ] [MAIN ] Update Progress: 702/2372 symbols completed. EDU took 45.4s. Estimated remaining: 3h 40m 46s. Rate: 7.6 symbols/min [2025-09-22T18:32:52.236485] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:32:52.291609] [DEBUG] [LOCAL ] EFX: Loaded 45687 existing records from primary storage. [2025-09-22T18:32:52.291794] [INFO ] [MAIN ] EFX: Loaded 45687 existing records. [2025-09-22T18:32:52.478023] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T18:32:52.483583] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:32:52.487294] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-22T18:32:52.487351] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-22T18:32:52.488769] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-22T18:32:52.488831] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-22T18:32:52.527283] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-22T18:32:52.845663] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:32:53.202409] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T18:32:53.322005] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-22T18:32:54.122097] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-22T18:32:54.927614] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-22T18:32:54.932797] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T18:32:55.390831] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T18:32:55.544426] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T18:32:55.722103] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-22T18:32:56.522111] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-22T18:32:57.259284] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T18:32:57.322058] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-22T18:32:57.477806] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T18:32:57.480590] [INFO ] [REMOTE ] EFR: Full fetch complete (18482 records). [2025-09-22T18:32:57.480737] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-22T18:32:57.855263] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-22T18:32:57.855402] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-22T18:32:57.855883] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-22T18:32:57.855945] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-22T18:32:57.856501] [DEBUG] [LOCAL ] EFR: Trimmed 18482 records to 14225 (keeping 200 days of data) [2025-09-22T18:32:57.942786] [DEBUG] [LOCAL ] EFR: Primary data saved (14225 records). [2025-09-22T18:32:57.942931] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-22T18:32:57.943016] [INFO ] [MAIN ] Update Progress: 703/2372 symbols completed. EFR took 22.1s. Estimated remaining: 3h 40m 34s. Rate: 7.6 symbols/min [2025-09-22T18:32:58.123419] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-22T18:32:58.126686] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:32:58.129072] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T18:32:58.167116] [DEBUG] [LOCAL ] EFXT: Loaded 30115 existing records from primary storage. [2025-09-22T18:32:58.167247] [INFO ] [MAIN ] EFXT: Loaded 30115 existing records. [2025-09-22T18:32:58.350855] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:32:58.351163] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-22T18:32:58.351220] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-22T18:32:58.352389] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-22T18:32:58.352449] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-22T18:32:58.704725] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:32:58.922032] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-22T18:32:59.620612] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T18:32:59.722060] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-22T18:33:00.432287] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T18:33:00.522016] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-22T18:33:01.296546] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T18:33:01.322052] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-22T18:33:02.107031] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T18:33:02.122010] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-22T18:33:02.922066] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-22T18:33:03.559545] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-22T18:33:03.722042] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-22T18:33:04.510237] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T18:33:04.522004] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-22T18:33:05.193946] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (3.07 seconds). [2025-09-22T18:33:05.322063] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-22T18:33:05.444792] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T18:33:05.645633] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-09-22T18:33:06.122073] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-22T18:33:06.178986] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T18:33:06.922071] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-22T18:33:07.722044] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-22T18:33:07.778830] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T18:33:08.071076] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-22T18:33:08.338538] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T18:33:08.522072] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-22T18:33:09.230144] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T18:33:09.232531] [INFO ] [REMOTE ] EFT: Full fetch complete (17306 records). [2025-09-22T18:33:09.232631] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-22T18:33:09.233165] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:33:09.233252] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:33:09.233297] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:33:09.233339] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-22T18:33:09.233398] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-22T18:33:09.233435] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-09-22T18:33:09.233968] [DEBUG] [LOCAL ] EFT: Deleted derivative data file. [2025-09-22T18:33:09.234068] [INFO ] [MAIN ] Update Progress: 704/2372 symbols completed. EFT took 23.0s. Estimated remaining: 3h 40m 34s. Rate: 7.6 symbols/min [2025-09-22T18:33:09.327151] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-22T18:33:09.418494] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:33:09.448692] [DEBUG] [LOCAL ] EG: Loaded 29471 existing records from primary storage. [2025-09-22T18:33:09.448831] [INFO ] [MAIN ] EG: Loaded 29471 existing records. [2025-09-22T18:33:09.632157] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:33:09.632411] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-22T18:33:09.632471] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-22T18:33:09.633286] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-22T18:33:09.633346] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-22T18:33:09.993372] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:33:10.122054] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-22T18:33:10.742917] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T18:33:10.922063] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-22T18:33:11.643802] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T18:33:11.722102] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-22T18:33:12.522052] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-22T18:33:13.232381] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-22T18:33:13.322051] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-22T18:33:13.987670] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-22T18:33:14.122107] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-22T18:33:14.768367] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T18:33:14.809177] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-22T18:33:14.922062] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-22T18:33:15.137147] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-22T18:33:15.722104] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-22T18:33:16.517451] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T18:33:16.526423] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-22T18:33:17.070011] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T18:33:17.322055] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-22T18:33:17.726403] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T18:33:18.122023] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-22T18:33:18.587776] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T18:33:18.922076] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-22T18:33:19.674170] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T18:33:19.722058] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-22T18:33:20.401184] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T18:33:20.408952] [INFO ] [REMOTE ] EFC: Full fetch complete (66038 records). [2025-09-22T18:33:20.409119] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-22T18:33:20.531714] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-22T18:33:20.835568] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-22T18:33:20.835687] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-22T18:33:20.836528] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-22T18:33:20.836577] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-22T18:33:20.838080] [DEBUG] [LOCAL ] EFC: Trimmed 66038 records to 46187 (keeping 200 days of data) [2025-09-22T18:33:21.152241] [DEBUG] [LOCAL ] EFC: Primary data saved (46187 records). [2025-09-22T18:33:21.152421] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-22T18:33:21.152536] [INFO ] [MAIN ] Update Progress: 705/2372 symbols completed. EFC took 46.1s. Estimated remaining: 3h 40m 35s. Rate: 7.6 symbols/min [2025-09-22T18:33:21.331807] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:33:21.328046] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-22T18:33:21.372361] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T18:33:21.435360] [DEBUG] [LOCAL ] EGO: Loaded 52165 existing records from primary storage. [2025-09-22T18:33:21.435551] [INFO ] [MAIN ] EGO: Loaded 52165 existing records. [2025-09-22T18:33:21.647048] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:33:21.648493] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T18:33:21.648721] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-22T18:33:21.654852] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-22T18:33:21.656391] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-22T18:33:21.656462] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-22T18:33:22.019022] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:33:22.122057] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-22T18:33:22.565000] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-22T18:33:22.922062] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-22T18:33:23.722049] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-22T18:33:24.527201] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-22T18:33:24.544447] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-22T18:33:25.322112] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-22T18:33:25.470849] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T18:33:25.597511] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-22T18:33:26.122030] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-22T18:33:26.210872] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T18:33:26.587828] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T18:33:26.922089] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-22T18:33:27.556910] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T18:33:27.722040] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-22T18:33:28.522057] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-22T18:33:28.654324] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T18:33:29.324768] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-22T18:33:29.332038] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T18:33:29.339866] [INFO ] [REMOTE ] EFX: Full fetch complete (64382 records). [2025-09-22T18:33:29.340016] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-22T18:33:29.779991] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-22T18:33:29.780097] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-22T18:33:29.781035] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-22T18:33:29.781104] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-22T18:33:29.782787] [DEBUG] [LOCAL ] EFX: Trimmed 64382 records to 44961 (keeping 200 days of data) [2025-09-22T18:33:29.904575] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T18:33:29.913795] [INFO ] [REMOTE ] EFXT: Full fetch complete (44210 records). [2025-09-22T18:33:29.917840] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-22T18:33:30.122498] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-22T18:33:30.354926] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-22T18:33:30.355737] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-22T18:33:30.356853] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-22T18:33:30.356983] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-22T18:33:30.363348] [DEBUG] [LOCAL ] EFXT: Trimmed 44210 records to 29392 (keeping 200 days of data) [2025-09-22T18:33:30.588593] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T18:33:30.676477] [DEBUG] [LOCAL ] EFX: Primary data saved (44961 records). [2025-09-22T18:33:30.678894] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-22T18:33:30.679051] [INFO ] [MAIN ] Update Progress: 706/2372 symbols completed. EFX took 38.6s. Estimated remaining: 3h 40m 31s. Rate: 7.6 symbols/min [2025-09-22T18:33:30.910156] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:33:30.922582] [DEBUG] [LOCAL ] EFXT: Primary data saved (29392 records). [2025-09-22T18:33:30.922463] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-22T18:33:30.922826] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-22T18:33:30.923003] [INFO ] [MAIN ] Update Progress: 707/2372 symbols completed. EFXT took 33.0s. Estimated remaining: 3h 40m 5s. Rate: 7.6 symbols/min [2025-09-22T18:33:31.113571] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:33:31.125931] [DEBUG] [LOCAL ] EGP: Loaded 31908 existing records from primary storage. [2025-09-22T18:33:31.126166] [INFO ] [MAIN ] EGP: Loaded 31908 existing records. [2025-09-22T18:33:31.366246] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:33:31.366632] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-22T18:33:31.366754] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-22T18:33:31.368829] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-22T18:33:31.368944] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-22T18:33:31.509448] [DEBUG] [LOCAL ] EGY: Loaded 43031 existing records from primary storage. [2025-09-22T18:33:31.536742] [INFO ] [MAIN ] EGY: Loaded 43031 existing records. [2025-09-22T18:33:32.085024] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:33:32.102718] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-22T18:33:32.103036] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-22T18:33:32.129944] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-22T18:33:32.143124] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-22T18:33:32.312008] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:33:32.343192] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-22T18:33:32.645762] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-22T18:33:32.675326] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T18:33:32.707192] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-22T18:33:32.790040] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:33:33.322074] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-22T18:33:33.857422] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T18:33:34.122072] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-22T18:33:34.224810] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T18:33:34.922119] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-22T18:33:35.112863] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T18:33:35.263411] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T18:33:35.722132] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-22T18:33:36.382131] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T18:33:36.388879] [INFO ] [REMOTE ] EG: Full fetch complete (43823 records). [2025-09-22T18:33:36.389009] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-22T18:33:36.389834] [FATAL] [VALIDATOR ] EG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:33:36.389948] [FATAL] [MAIN ] EG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:33:36.390034] [WARN ] [MAIN ] EG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:33:36.390126] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-22T18:33:36.390217] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-09-22T18:33:36.390273] [INFO ] [LOCAL ] EG: Starting deletion of derivative data. [2025-09-22T18:33:36.391031] [DEBUG] [LOCAL ] EG: Deleted derivative data file. [2025-09-22T18:33:36.391155] [INFO ] [MAIN ] Update Progress: 708/2372 symbols completed. EG took 27.2s. Estimated remaining: 3h 39m 51s. Rate: 7.6 symbols/min [2025-09-22T18:33:36.527213] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-22T18:33:36.572971] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:33:36.607101] [DEBUG] [LOCAL ] EHAB: Loaded 30600 existing records from primary storage. [2025-09-22T18:33:36.607258] [INFO ] [MAIN ] EHAB: Loaded 30600 existing records. [2025-09-22T18:33:36.791167] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:33:36.791393] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-22T18:33:36.791448] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-22T18:33:36.792107] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-22T18:33:36.792166] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-22T18:33:37.163578] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:33:37.182602] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T18:33:37.322051] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-22T18:33:38.122083] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-22T18:33:38.330512] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T18:33:38.364366] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T18:33:38.922062] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-22T18:33:39.611457] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T18:33:39.722027] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-22T18:33:40.068909] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T18:33:40.522112] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-22T18:33:40.934678] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T18:33:41.322053] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-22T18:33:41.663998] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T18:33:42.122077] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-22T18:33:42.488182] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T18:33:42.922131] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-22T18:33:43.236345] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T18:33:43.722043] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-22T18:33:44.385456] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T18:33:44.522013] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-22T18:33:44.837133] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T18:33:45.322061] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-22T18:33:46.122052] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-22T18:33:46.202404] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T18:33:46.789979] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-22T18:33:46.922094] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-22T18:33:47.722050] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-22T18:33:48.167569] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-22T18:33:48.351421] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T18:33:48.522094] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-22T18:33:48.937923] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T18:33:49.322147] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-22T18:33:49.851740] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T18:33:50.122088] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-22T18:33:50.250019] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-22T18:33:50.922112] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-22T18:33:51.722088] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-22T18:33:52.184030] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-22T18:33:52.217701] [INFO ] [REMOTE ] EGO: Full fetch complete (73292 records). [2025-09-22T18:33:52.218054] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-22T18:33:52.219821] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T18:33:52.529733] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-22T18:33:52.672719] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-22T18:33:52.672811] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-22T18:33:52.673854] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-22T18:33:52.673966] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-22T18:33:52.676233] [DEBUG] [LOCAL ] EGO: Trimmed 73292 records to 51470 (keeping 200 days of data) [2025-09-22T18:33:52.999180] [DEBUG] [LOCAL ] EGO: Primary data saved (51470 records). [2025-09-22T18:33:52.999343] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-22T18:33:52.999526] [INFO ] [MAIN ] Update Progress: 709/2372 symbols completed. EGO took 31.8s. Estimated remaining: 3h 40m 4s. Rate: 7.6 symbols/min [2025-09-22T18:33:53.186936] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:33:53.219381] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T18:33:53.276054] [DEBUG] [LOCAL ] EHC: Loaded 42121 existing records from primary storage. [2025-09-22T18:33:53.276222] [INFO ] [MAIN ] EHC: Loaded 42121 existing records. [2025-09-22T18:33:53.332105] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-22T18:33:53.461514] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:33:53.461833] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-22T18:33:53.461893] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-22T18:33:53.463019] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-22T18:33:53.463099] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-22T18:33:53.858618] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:33:53.886051] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T18:33:54.122084] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-22T18:33:54.577249] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T18:33:54.922069] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-22T18:33:55.722029] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-22T18:33:55.764364] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T18:33:56.201107] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-22T18:33:56.522157] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-22T18:33:56.995457] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T18:33:57.322072] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-22T18:33:58.122132] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-22T18:33:58.235957] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T18:33:58.664593] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T18:33:58.922060] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-22T18:33:59.601125] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T18:33:59.722369] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-22T18:34:00.194425] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T18:34:00.522092] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-22T18:34:01.239447] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T18:34:01.322062] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-22T18:34:01.962373] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T18:34:01.969202] [INFO ] [REMOTE ] EGP: Full fetch complete (45250 records). [2025-09-22T18:34:01.969440] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-22T18:34:02.127201] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-22T18:34:02.422234] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-22T18:34:02.422342] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-22T18:34:02.423059] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-22T18:34:02.423148] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-22T18:34:02.430593] [DEBUG] [LOCAL ] EGP: Trimmed 45250 records to 31337 (keeping 200 days of data) [2025-09-22T18:34:02.646186] [DEBUG] [LOCAL ] EGP: Primary data saved (31337 records). [2025-09-22T18:34:02.646471] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-22T18:34:02.646631] [INFO ] [MAIN ] Update Progress: 710/2372 symbols completed. EGP took 32.0s. Estimated remaining: 3h 39m 60s. Rate: 7.6 symbols/min [2025-09-22T18:34:02.839020] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:34:02.866118] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T18:34:02.884222] [DEBUG] [LOCAL ] EHI: Loaded 10346 existing records from primary storage. [2025-09-22T18:34:02.884365] [INFO ] [MAIN ] EHI: Loaded 10346 existing records. [2025-09-22T18:34:02.930725] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-22T18:34:03.080760] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:34:03.081078] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-22T18:34:03.081172] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-22T18:34:03.081684] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-22T18:34:03.081770] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-22T18:34:03.460909] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:34:03.575347] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T18:34:03.722039] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-22T18:34:04.522051] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-22T18:34:04.701308] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T18:34:05.285203] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T18:34:05.292345] [INFO ] [REMOTE ] EGY: Full fetch complete (61849 records). [2025-09-22T18:34:05.292518] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-22T18:34:05.327144] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-22T18:34:05.711613] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-22T18:34:05.711736] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-22T18:34:05.712478] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-22T18:34:05.712522] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-22T18:34:05.713935] [DEBUG] [LOCAL ] EGY: Trimmed 61849 records to 42312 (keeping 200 days of data) [2025-09-22T18:34:05.951490] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T18:34:06.005252] [DEBUG] [LOCAL ] EGY: Primary data saved (42312 records). [2025-09-22T18:34:06.005380] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-22T18:34:06.005489] [INFO ] [MAIN ] Update Progress: 711/2372 symbols completed. EGY took 35.1s. Estimated remaining: 3h 39m 41s. Rate: 7.6 symbols/min [2025-09-22T18:34:06.127158] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-22T18:34:06.185167] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:34:06.213182] [DEBUG] [LOCAL ] EIC: Loaded 24897 existing records from primary storage. [2025-09-22T18:34:06.213315] [INFO ] [MAIN ] EIC: Loaded 24897 existing records. [2025-09-22T18:34:06.409233] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:34:06.410543] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-22T18:34:06.410602] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-22T18:34:06.411871] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-22T18:34:06.411934] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-22T18:34:06.776847] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:34:06.922029] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-22T18:34:07.003678] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T18:34:07.572820] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T18:34:07.722048] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-22T18:34:08.522122] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-22T18:34:08.596078] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T18:34:08.613287] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T18:34:08.619904] [INFO ] [REMOTE ] EHAB: Full fetch complete (41633 records). [2025-09-22T18:34:08.620047] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-22T18:34:09.022517] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-22T18:34:09.022629] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-22T18:34:09.023268] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-22T18:34:09.023320] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-22T18:34:09.025130] [DEBUG] [LOCAL ] EHAB: Trimmed 41633 records to 30099 (keeping 200 days of data) [2025-09-22T18:34:09.218521] [DEBUG] [LOCAL ] EHAB: Primary data saved (30099 records). [2025-09-22T18:34:09.218716] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-22T18:34:09.218847] [INFO ] [MAIN ] Update Progress: 712/2372 symbols completed. EHAB took 32.8s. Estimated remaining: 3h 39m 22s. Rate: 7.6 symbols/min [2025-09-22T18:34:09.327222] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-22T18:34:09.408047] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:34:09.408257] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-22T18:34:09.408295] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-22T18:34:09.408504] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-22T18:34:09.408559] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-22T18:34:09.408601] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-22T18:34:09.408633] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-22T18:34:09.795498] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:34:09.927263] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T18:34:10.122071] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-22T18:34:10.679552] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T18:34:10.922081] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-22T18:34:10.961919] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T18:34:11.722082] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-22T18:34:12.022385] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T18:34:12.313715] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T18:34:12.522079] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-22T18:34:13.322068] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-22T18:34:13.379370] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-22T18:34:13.834041] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-22T18:34:14.122097] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-22T18:34:14.919041] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-22T18:34:14.921990] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-22T18:34:15.722036] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-22T18:34:15.841569] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-22T18:34:16.002453] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-22T18:34:16.522056] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-22T18:34:16.854495] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-22T18:34:17.322066] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-22T18:34:17.949303] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-22T18:34:18.122056] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-22T18:34:18.922067] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-22T18:34:19.494088] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-22T18:34:19.658521] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T18:34:19.722038] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-22T18:34:20.522048] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-22T18:34:21.138663] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T18:34:21.322050] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-22T18:34:22.082793] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T18:34:22.121667] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T18:34:22.124157] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-22T18:34:22.922061] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-22T18:34:23.262711] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-22T18:34:23.424089] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T18:34:23.722072] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-22T18:34:24.522061] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-22T18:34:25.252336] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T18:34:25.262202] [INFO ] [REMOTE ] EHC: Full fetch complete (58913 records). [2025-09-22T18:34:25.262435] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-22T18:34:25.328718] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-22T18:34:25.913105] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-22T18:34:25.916065] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-22T18:34:25.920713] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-22T18:34:25.922189] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-22T18:34:25.927876] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T18:34:25.927981] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-22T18:34:25.935768] [DEBUG] [LOCAL ] EHC: Trimmed 58913 records to 41502 (keeping 200 days of data) [2025-09-22T18:34:26.133350] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-22T18:34:26.223548] [DEBUG] [LOCAL ] EHC: Primary data saved (41502 records). [2025-09-22T18:34:26.223722] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-22T18:34:26.223820] [INFO ] [MAIN ] Update Progress: 713/2372 symbols completed. EHC took 33.2s. Estimated remaining: 3h 39m 35s. Rate: 7.6 symbols/min [2025-09-22T18:34:26.393865] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:34:26.394059] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-22T18:34:26.394097] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-22T18:34:26.394237] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-22T18:34:26.394292] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-22T18:34:26.394357] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-22T18:34:26.394392] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-22T18:34:26.753562] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:34:26.922072] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-22T18:34:27.297603] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-22T18:34:27.367749] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T18:34:27.722070] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-22T18:34:28.052384] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-22T18:34:28.522092] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-22T18:34:29.022197] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-22T18:34:29.322081] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-22T18:34:29.678955] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-22T18:34:30.122092] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-22T18:34:30.652842] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-22T18:34:30.922055] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-22T18:34:31.348240] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T18:34:31.722115] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-22T18:34:32.522128] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-22T18:34:32.885346] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-22T18:34:33.172306] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T18:34:33.322071] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-22T18:34:34.122055] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-22T18:34:34.432612] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T18:34:34.922092] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-22T18:34:35.095783] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T18:34:35.098089] [INFO ] [REMOTE ] EHI: Full fetch complete (16460 records). [2025-09-22T18:34:35.098161] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-22T18:34:35.304397] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-22T18:34:35.496120] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-22T18:34:35.496212] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-22T18:34:35.496631] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-22T18:34:35.496733] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-22T18:34:35.497372] [DEBUG] [LOCAL ] EHI: Trimmed 16460 records to 10286 (keeping 200 days of data) [2025-09-22T18:34:35.565273] [DEBUG] [LOCAL ] EHI: Primary data saved (10286 records). [2025-09-22T18:34:35.565428] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-22T18:34:35.565519] [INFO ] [MAIN ] Update Progress: 714/2372 symbols completed. EHI took 32.9s. Estimated remaining: 3h 39m 31s. Rate: 7.6 symbols/min [2025-09-22T18:34:35.723738] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-22T18:34:35.750905] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:34:35.751210] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-22T18:34:35.751294] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-22T18:34:35.751444] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-22T18:34:35.751496] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-22T18:34:35.751538] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-22T18:34:35.751570] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-22T18:34:36.135667] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:34:36.522089] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-22T18:34:37.024985] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-22T18:34:37.028431] [INFO ] [REMOTE ] EIC: Full fetch complete (35622 records). [2025-09-22T18:34:37.028527] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-22T18:34:37.141099] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-22T18:34:37.327127] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-22T18:34:37.418184] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-22T18:34:37.418265] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-22T18:34:37.418850] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-22T18:34:37.418931] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-22T18:34:37.419832] [DEBUG] [LOCAL ] EIC: Trimmed 35622 records to 24344 (keeping 200 days of data) [2025-09-22T18:34:37.571539] [DEBUG] [LOCAL ] EIC: Primary data saved (24344 records). [2025-09-22T18:34:37.571700] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-22T18:34:37.571795] [INFO ] [MAIN ] Update Progress: 715/2372 symbols completed. EIC took 31.6s. Estimated remaining: 3h 39m 9s. Rate: 7.6 symbols/min [2025-09-22T18:34:37.740034] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:34:37.760374] [DEBUG] [LOCAL ] EIG: Loaded 20564 existing records from primary storage. [2025-09-22T18:34:37.760506] [INFO ] [MAIN ] EIG: Loaded 20564 existing records. [2025-09-22T18:34:37.941183] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:34:37.941497] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-22T18:34:37.941555] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-22T18:34:37.944328] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-22T18:34:37.944450] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T18:34:37.944592] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-22T18:34:37.945558] [INFO ] [REMOTE ] EICA: Full fetch complete (1262 records). [2025-09-22T18:34:37.979071] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-22T18:34:38.124767] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-22T18:34:38.388603] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-22T18:34:38.454153] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:34:38.485959] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:34:38.502602] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-22T18:34:38.505741] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-22T18:34:38.505798] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-22T18:34:38.505904] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-22T18:34:38.506059] [INFO ] [MAIN ] Update Progress: 716/2372 symbols completed. EICA took 29.3s. Estimated remaining: 3h 38m 45s. Rate: 7.6 symbols/min [2025-09-22T18:34:38.650922] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:34:38.665129] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-22T18:34:38.771612] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:34:38.771852] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-09-22T18:34:38.771908] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-09-22T18:34:38.772052] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-22T18:34:38.772095] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-22T18:34:38.772137] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-22T18:34:38.772171] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-22T18:34:38.927166] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-22T18:34:39.142765] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:34:39.658195] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T18:34:39.722083] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-22T18:34:40.522061] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-22T18:34:40.735203] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T18:34:41.101195] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T18:34:41.322067] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-22T18:34:41.830623] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T18:34:42.122060] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-22T18:34:42.604516] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-22T18:34:42.922058] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-22T18:34:43.722055] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-22T18:34:44.097842] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-22T18:34:44.522061] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-22T18:34:45.227472] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T18:34:45.228606] [INFO ] [REMOTE ] EICB: Full fetch complete (2669 records). [2025-09-22T18:34:45.228712] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-22T18:34:45.328108] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-22T18:34:45.428877] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T18:34:45.429189] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:34:45.429355] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:34:45.429472] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-22T18:34:45.429693] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-22T18:34:45.429868] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-22T18:34:45.430013] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-22T18:34:45.430144] [INFO ] [MAIN ] Update Progress: 717/2372 symbols completed. EICB took 19.2s. Estimated remaining: 3h 38m 34s. Rate: 7.6 symbols/min [2025-09-22T18:34:45.459890] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-22T18:34:46.122067] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-22T18:34:46.329327] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T18:34:46.922058] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-22T18:34:47.722150] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-22T18:34:47.805559] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T18:34:48.080304] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-22T18:34:48.103273] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-22T18:34:48.522060] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-22T18:34:49.293458] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T18:34:49.322006] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-22T18:34:50.122082] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-22T18:34:50.491278] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T18:34:50.922095] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-22T18:34:51.722062] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-22T18:34:51.971916] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T18:34:52.012951] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T18:34:52.306939] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-22T18:34:52.522069] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-22T18:34:53.322073] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-22T18:34:53.758412] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-22T18:34:54.122135] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-22T18:34:54.445596] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T18:34:54.586302] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-22T18:34:54.922083] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-22T18:34:55.722060] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-22T18:34:56.437010] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T18:34:56.522072] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-22T18:34:57.292914] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T18:34:57.322012] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-22T18:34:57.428918] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-22T18:34:58.037108] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T18:34:58.122081] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-22T18:34:58.922124] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-22T18:34:59.090278] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-22T18:34:59.492177] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T18:34:59.493821] [INFO ] [REMOTE ] EICC: Full fetch complete (7800 records). [2025-09-22T18:34:59.493894] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-22T18:34:59.494303] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:34:59.494391] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:34:59.494434] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:34:59.494473] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-22T18:34:59.494531] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-22T18:34:59.494565] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-22T18:34:59.494672] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-22T18:34:59.494757] [INFO ] [MAIN ] Update Progress: 718/2372 symbols completed. EICC took 23.9s. Estimated remaining: 3h 38m 41s. Rate: 7.6 symbols/min [2025-09-22T18:34:59.722130] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-22T18:35:00.522071] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-22T18:35:01.926866] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T18:35:01.931901] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-22T18:35:02.113977] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-22T18:35:02.125480] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-22T18:35:03.580933] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T18:35:03.587218] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-22T18:35:03.830225] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T18:35:03.841551] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-22T18:35:04.815106] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T18:35:04.820307] [INFO ] [REMOTE ] EIG: Full fetch complete (26917 records). [2025-09-22T18:35:04.820436] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-22T18:35:05.207424] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-22T18:35:05.207509] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-22T18:35:05.207996] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-22T18:35:05.208058] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-22T18:35:05.208883] [DEBUG] [LOCAL ] EIG: Trimmed 26917 records to 20316 (keeping 200 days of data) [2025-09-22T18:35:05.330783] [DEBUG] [LOCAL ] EIG: Primary data saved (20316 records). [2025-09-22T18:35:05.330911] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-22T18:35:05.330991] [INFO ] [MAIN ] Update Progress: 719/2372 symbols completed. EIG took 27.8s. Estimated remaining: 3h 38m 28s. Rate: 7.6 symbols/min [2025-09-22T18:35:05.942586] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-22T18:35:05.955221] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-22T18:35:07.526345] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T18:35:07.537511] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-22T18:35:09.250360] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T18:35:09.258620] [INFO ] [REMOTE ] EIX: Full fetch complete (76937 records). [2025-09-22T18:35:09.258768] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-22T18:35:09.663708] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-22T18:35:09.663796] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-22T18:35:09.664669] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-22T18:35:09.664732] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-22T18:35:09.666421] [DEBUG] [LOCAL ] EIX: Trimmed 76937 records to 53346 (keeping 200 days of data) [2025-09-22T18:35:09.990379] [DEBUG] [LOCAL ] EIX: Primary data saved (53346 records). [2025-09-22T18:35:09.990556] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-22T18:35:09.990690] [INFO ] [MAIN ] Update Progress: 720/2372 symbols completed. EIX took 31.5s. Estimated remaining: 3h 38m 12s. Rate: 7.6 symbols/min [2025-09-22T18:35:10.668971] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:35:10.665046] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:35:10.670200] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:35:10.694158] [DEBUG] [LOCAL ] ELC: Loaded 3562 existing records from primary storage. [2025-09-22T18:35:10.699557] [INFO ] [MAIN ] ELC: Loaded 3562 existing records. [2025-09-22T18:35:10.764603] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:35:10.975782] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:35:10.990080] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-22T18:35:10.991545] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-22T18:35:11.007100] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-22T18:35:11.007342] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-22T18:35:11.007029] [DEBUG] [LOCAL ] ELF: Loaded 53101 existing records from primary storage. [2025-09-22T18:35:11.008320] [DEBUG] [LOCAL ] ELAN: Loaded 53959 existing records from primary storage. [2025-09-22T18:35:11.008442] [INFO ] [MAIN ] ELF: Loaded 53101 existing records. [2025-09-22T18:35:11.008573] [INFO ] [MAIN ] ELAN: Loaded 53959 existing records. [2025-09-22T18:35:11.383804] [DEBUG] [LOCAL ] EL: Loaded 54205 existing records from primary storage. [2025-09-22T18:35:11.440524] [INFO ] [MAIN ] EL: Loaded 54205 existing records. [2025-09-22T18:35:11.654213] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:35:11.615328] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:35:11.756903] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-22T18:35:11.756784] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-22T18:35:11.799355] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-22T18:35:11.818037] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-22T18:35:11.838993] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-22T18:35:11.839188] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-22T18:35:11.839582] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-22T18:35:11.887398] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-22T18:35:12.090856] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:35:12.163133] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-22T18:35:12.172184] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:35:12.222121] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-22T18:35:12.255453] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-22T18:35:12.392880] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-22T18:35:12.468684] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-22T18:35:12.816844] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:35:12.845698] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-22T18:35:12.916347] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:35:12.941114] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-22T18:35:13.043191] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T18:35:13.073213] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-22T18:35:13.162616] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:35:13.162943] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-22T18:35:13.711763] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T18:35:13.713240] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-22T18:35:14.132463] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T18:35:14.133828] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-22T18:35:14.630064] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-22T18:35:14.632140] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-22T18:35:14.676079] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T18:35:14.687167] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-22T18:35:15.030447] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T18:35:15.041150] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-22T18:35:15.198896] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-22T18:35:15.209034] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-22T18:35:15.218318] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-22T18:35:15.219776] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-22T18:35:15.587808] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-22T18:35:15.722067] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-22T18:35:16.158119] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T18:35:16.189119] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-22T18:35:16.522078] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-22T18:35:16.956396] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T18:35:16.996299] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T18:35:17.010735] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-22T18:35:17.322058] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-22T18:35:18.122073] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-22T18:35:18.922087] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-22T18:35:19.451031] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-22T18:35:19.518573] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-22T18:35:19.722039] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-22T18:35:19.826541] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T18:35:20.522064] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-22T18:35:21.145778] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T18:35:21.146971] [INFO ] [REMOTE ] ELC: Full fetch complete (5154 records). [2025-09-22T18:35:21.147040] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-22T18:35:21.329317] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-22T18:35:21.540134] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-22T18:35:21.540236] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-22T18:35:21.540403] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-22T18:35:21.540443] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-22T18:35:21.540913] [DEBUG] [LOCAL ] ELC: Trimmed 5154 records to 3492 (keeping 200 days of data) [2025-09-22T18:35:21.563816] [DEBUG] [LOCAL ] ELC: Primary data saved (3492 records). [2025-09-22T18:35:21.563933] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-22T18:35:21.564021] [INFO ] [MAIN ] Update Progress: 721/2372 symbols completed. ELC took 11.6s. Estimated remaining: 3h 38m 13s. Rate: 7.6 symbols/min [2025-09-22T18:35:21.762601] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:35:21.805549] [DEBUG] [LOCAL ] ELME: Loaded 39870 existing records from primary storage. [2025-09-22T18:35:21.805739] [INFO ] [MAIN ] ELME: Loaded 39870 existing records. [2025-09-22T18:35:21.987590] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:35:21.987920] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-22T18:35:21.988125] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-22T18:35:21.989325] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-22T18:35:21.989387] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-22T18:35:22.125871] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-22T18:35:22.351583] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-22T18:35:22.444684] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:35:22.922060] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-22T18:35:23.098519] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T18:35:23.722049] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-22T18:35:23.833830] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T18:35:24.522088] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-22T18:35:24.915805] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T18:35:25.162792] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-22T18:35:25.322099] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-22T18:35:26.122059] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-22T18:35:26.221498] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T18:35:26.922056] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-22T18:35:27.262186] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T18:35:27.722039] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-22T18:35:28.011185] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T18:35:28.522041] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-22T18:35:28.625481] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T18:35:29.322061] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-22T18:35:29.721166] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-22T18:35:29.858887] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T18:35:30.122095] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-22T18:35:30.922062] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-22T18:35:31.066750] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T18:35:31.562943] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T18:35:31.722042] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-22T18:35:32.522081] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-22T18:35:32.938373] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-22T18:35:33.154868] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T18:35:33.322045] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-22T18:35:34.122055] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-22T18:35:34.391417] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-22T18:35:34.779777] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T18:35:34.922074] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-22T18:35:35.722057] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-22T18:35:35.832931] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T18:35:36.522062] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-22T18:35:36.574377] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T18:35:37.322104] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-22T18:35:38.022395] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-22T18:35:38.122064] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-22T18:35:38.448141] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-22T18:35:38.922154] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-22T18:35:39.474074] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-22T18:35:39.722058] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-22T18:35:40.168073] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-22T18:35:40.178696] [INFO ] [REMOTE ] ELF: Full fetch complete (75403 records). [2025-09-22T18:35:40.178823] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-22T18:35:40.526741] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-22T18:35:40.578144] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-22T18:35:40.579542] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-22T18:35:40.580954] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-22T18:35:40.581443] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-22T18:35:40.583707] [DEBUG] [LOCAL ] ELF: Trimmed 75403 records to 52315 (keeping 200 days of data) [2025-09-22T18:35:40.618074] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T18:35:40.969381] [DEBUG] [LOCAL ] ELF: Primary data saved (52315 records). [2025-09-22T18:35:40.969558] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-22T18:35:40.970792] [INFO ] [MAIN ] Update Progress: 722/2372 symbols completed. ELF took 31.0s. Estimated remaining: 3h 38m 31s. Rate: 7.6 symbols/min [2025-09-22T18:35:41.166753] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:35:41.195317] [DEBUG] [LOCAL ] ELP: Loaded 26324 existing records from primary storage. [2025-09-22T18:35:41.195463] [INFO ] [MAIN ] ELP: Loaded 26324 existing records. [2025-09-22T18:35:41.335420] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-22T18:35:41.377565] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:35:41.377821] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-22T18:35:41.377881] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-22T18:35:41.378892] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-22T18:35:41.378953] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-22T18:35:41.739531] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:35:41.786185] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-22T18:35:41.796818] [INFO ] [REMOTE ] EL: Full fetch complete (77346 records). [2025-09-22T18:35:41.797003] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-22T18:35:42.127208] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-22T18:35:42.207721] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-22T18:35:42.207837] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-22T18:35:42.208809] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-22T18:35:42.208876] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-22T18:35:42.211930] [DEBUG] [LOCAL ] EL: Trimmed 77346 records to 53412 (keeping 200 days of data) [2025-09-22T18:35:42.472264] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T18:35:42.594963] [DEBUG] [LOCAL ] EL: Primary data saved (53412 records). [2025-09-22T18:35:42.595120] [INFO ] [MAIN ] EL: Full history saved. [2025-09-22T18:35:42.595246] [INFO ] [MAIN ] Update Progress: 723/2372 symbols completed. EL took 32.6s. Estimated remaining: 3h 38m 9s. Rate: 7.6 symbols/min [2025-09-22T18:35:42.770173] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:35:42.770426] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-22T18:35:42.770570] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-22T18:35:42.770983] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-22T18:35:42.771117] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-22T18:35:42.771205] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-22T18:35:42.771263] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-22T18:35:42.925597] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-22T18:35:43.006372] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T18:35:43.179172] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:35:43.586354] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T18:35:43.722076] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-22T18:35:44.250449] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-22T18:35:44.522063] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-22T18:35:44.709144] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T18:35:44.963573] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-22T18:35:45.322059] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-22T18:35:46.123388] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-22T18:35:46.127202] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T18:35:46.489923] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-22T18:35:46.922088] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-22T18:35:47.276092] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T18:35:47.722040] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-22T18:35:48.522079] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-22T18:35:48.909018] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T18:35:49.322020] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-22T18:35:49.697507] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T18:35:50.122057] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-22T18:35:50.922084] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-22T18:35:51.198635] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T18:35:51.252434] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T18:35:51.260993] [INFO ] [REMOTE ] ELAN: Full fetch complete (76859 records). [2025-09-22T18:35:51.261130] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-22T18:35:51.658016] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-22T18:35:51.658099] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-22T18:35:51.658995] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-22T18:35:51.659063] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-22T18:35:51.660691] [DEBUG] [LOCAL ] ELAN: Trimmed 76859 records to 53187 (keeping 200 days of data) [2025-09-22T18:35:51.729191] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-22T18:35:52.005280] [DEBUG] [LOCAL ] ELAN: Primary data saved (53187 records). [2025-09-22T18:35:52.005442] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-22T18:35:52.005533] [INFO ] [MAIN ] Update Progress: 724/2372 symbols completed. ELAN took 42.0s. Estimated remaining: 3h 38m 4s. Rate: 7.6 symbols/min [2025-09-22T18:35:52.198711] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:35:52.202332] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T18:35:52.202810] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-09-22T18:35:52.204307] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-09-22T18:35:52.204697] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-22T18:35:52.205058] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-22T18:35:52.205217] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-22T18:35:52.205413] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-22T18:35:52.356002] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T18:35:52.527263] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-22T18:35:52.636043] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:35:53.322090] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-22T18:35:54.122059] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-22T18:35:54.144182] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T18:35:54.151115] [INFO ] [REMOTE ] ELME: Full fetch complete (55741 records). [2025-09-22T18:35:54.151259] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-22T18:35:54.555204] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-22T18:35:54.557967] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-22T18:35:54.558116] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T18:35:54.558938] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-22T18:35:54.559100] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-22T18:35:54.561361] [DEBUG] [LOCAL ] ELME: Trimmed 55741 records to 39258 (keeping 200 days of data) [2025-09-22T18:35:54.824606] [DEBUG] [LOCAL ] ELME: Primary data saved (39258 records). [2025-09-22T18:35:54.824797] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-22T18:35:54.824927] [INFO ] [MAIN ] Update Progress: 725/2372 symbols completed. ELME took 33.3s. Estimated remaining: 3h 37m 45s. Rate: 7.6 symbols/min [2025-09-22T18:35:54.925348] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-22T18:35:55.012951] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T18:35:55.058587] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:35:55.058848] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-09-22T18:35:55.058906] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-09-22T18:35:55.059049] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-22T18:35:55.059094] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-22T18:35:55.059138] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-22T18:35:55.059173] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-22T18:35:55.356588] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-22T18:35:55.442475] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:35:55.722051] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-22T18:35:56.522068] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-22T18:35:56.670639] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-22T18:35:57.322070] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-22T18:35:58.122045] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-22T18:35:58.189221] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T18:35:58.334782] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T18:35:58.510505] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-22T18:35:58.922084] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-22T18:35:59.722064] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-22T18:36:00.339746] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T18:36:00.522057] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-22T18:36:01.322062] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-22T18:36:01.793100] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-22T18:36:01.892706] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T18:36:02.122061] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-22T18:36:02.922070] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-22T18:36:03.722066] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-22T18:36:04.323007] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (3.00 seconds). [2025-09-22T18:36:04.522071] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-22T18:36:09.288847] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (7.17 seconds). [2025-09-22T18:36:09.298575] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-22T18:36:10.395321] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (7.47 seconds). [2025-09-22T18:36:10.396301] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-22T18:36:10.438458] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (5.92 seconds). [2025-09-22T18:36:10.446794] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-22T18:36:10.548559] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (6.83 seconds). [2025-09-22T18:36:10.558884] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-22T18:36:11.521445] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T18:36:11.522379] [INFO ] [REMOTE ] ELPC: Full fetch complete (1486 records). [2025-09-22T18:36:11.522459] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-22T18:36:11.718124] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-22T18:36:11.719163] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:36:11.719356] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:36:11.719447] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-22T18:36:11.719836] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-22T18:36:11.720264] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-22T18:36:11.736925] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-22T18:36:11.737128] [INFO ] [MAIN ] Update Progress: 726/2372 symbols completed. ELPC took 29.1s. Estimated remaining: 3h 37m 57s. Rate: 7.6 symbols/min [2025-09-22T18:36:11.737630] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T18:36:11.776110] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-22T18:36:11.922586] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:36:11.922853] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-22T18:36:11.922898] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-22T18:36:11.923054] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-22T18:36:11.923097] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-22T18:36:11.923137] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-22T18:36:11.923170] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-22T18:36:12.294476] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:36:12.295025] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-22T18:36:12.329394] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-09-22T18:36:12.339856] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-22T18:36:12.989238] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:36:12.989685] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-22T18:36:12.990171] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-22T18:36:13.201783] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:36:13.202231] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-22T18:36:13.202889] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-22T18:36:13.531384] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T18:36:13.535139] [INFO ] [REMOTE ] ELP: Full fetch complete (37507 records). [2025-09-22T18:36:13.535242] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-22T18:36:13.536113] [FATAL] [VALIDATOR ] ELP: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:36:13.536202] [FATAL] [MAIN ] ELP: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:36:13.536255] [WARN ] [MAIN ] ELP: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:36:13.536317] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-22T18:36:13.536403] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-09-22T18:36:13.536458] [INFO ] [LOCAL ] ELP: Starting deletion of derivative data. [2025-09-22T18:36:13.536992] [DEBUG] [LOCAL ] ELP: Deleted derivative data file. [2025-09-22T18:36:13.537139] [INFO ] [MAIN ] Update Progress: 727/2372 symbols completed. ELP took 32.6s. Estimated remaining: 3h 37m 35s. Rate: 7.6 symbols/min [2025-09-22T18:36:13.626738] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:36:13.653569] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-22T18:36:13.657936] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-22T18:36:13.736318] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:36:13.736527] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-09-22T18:36:13.736581] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-09-22T18:36:13.736773] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-22T18:36:13.736882] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-22T18:36:13.736947] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-09-22T18:36:13.736981] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-22T18:36:13.895379] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:36:13.933398] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-22T18:36:13.942698] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-22T18:36:14.124950] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:36:14.125297] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-22T18:36:14.180306] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (3.62 seconds). [2025-09-22T18:36:14.202945] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:36:14.203274] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-22T18:36:14.292113] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T18:36:14.922054] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-22T18:36:15.722057] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-22T18:36:15.835736] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T18:36:16.522058] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-22T18:36:17.322064] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-22T18:36:17.508111] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-22T18:36:17.754272] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-22T18:36:17.857535] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T18:36:18.122034] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-22T18:36:18.259679] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-22T18:36:18.886754] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T18:36:18.922013] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-22T18:36:19.666049] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T18:36:19.722059] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-22T18:36:20.522068] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-22T18:36:21.322104] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-22T18:36:21.793702] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-22T18:36:22.122046] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-22T18:36:22.194526] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-22T18:36:22.922085] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-22T18:36:23.027889] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-22T18:36:23.708054] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T18:36:23.721989] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-22T18:36:23.787886] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T18:36:24.480989] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T18:36:24.522062] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-22T18:36:25.322064] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-22T18:36:25.586508] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T18:36:25.589343] [INFO ] [REMOTE ] EMA: Full fetch complete (7699 records). [2025-09-22T18:36:25.589435] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-22T18:36:25.589933] [FATAL] [VALIDATOR ] EMA: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:36:25.590020] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:36:25.590063] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:36:25.590133] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-22T18:36:25.590200] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-22T18:36:25.590235] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-22T18:36:25.590275] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-22T18:36:25.590331] [INFO ] [MAIN ] Update Progress: 728/2372 symbols completed. EMA took 13.9s. Estimated remaining: 3h 37m 37s. Rate: 7.6 symbols/min [2025-09-22T18:36:25.776893] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:36:25.820052] [DEBUG] [LOCAL ] EME: Loaded 32382 existing records from primary storage. [2025-09-22T18:36:25.820215] [INFO ] [MAIN ] EME: Loaded 32382 existing records. [2025-09-22T18:36:26.023378] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:36:26.023801] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-22T18:36:26.023871] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-22T18:36:26.025059] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-22T18:36:26.025134] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-22T18:36:26.125001] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-22T18:36:26.386886] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:36:26.922047] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-22T18:36:27.367983] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-22T18:36:27.566171] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-22T18:36:27.722038] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-22T18:36:28.179956] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T18:36:28.522112] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-22T18:36:29.322068] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-22T18:36:30.122082] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-22T18:36:30.370244] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-09-22T18:36:30.927139] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-22T18:36:30.939798] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T18:36:31.197212] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-22T18:36:31.722116] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-22T18:36:32.522073] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-22T18:36:32.800174] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-09-22T18:36:33.127614] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T18:36:33.322080] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-22T18:36:33.911146] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-09-22T18:36:33.919450] [INFO ] [REMOTE ] ELV: Full fetch complete (72835 records). [2025-09-22T18:36:33.919721] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-22T18:36:33.920934] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:36:33.921042] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:36:33.921089] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:36:33.921154] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-22T18:36:33.921265] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-22T18:36:33.921361] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-09-22T18:36:33.921450] [DEBUG] [LOCAL ] ELV: No derivative data file found to delete. [2025-09-22T18:36:33.921609] [INFO ] [MAIN ] Update Progress: 729/2372 symbols completed. ELV took 39.1s. Estimated remaining: 3h 37m 30s. Rate: 7.6 symbols/min [2025-09-22T18:36:34.130542] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-22T18:36:34.136342] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:36:34.145436] [DEBUG] [LOCAL ] EMF: Loaded 3735 existing records from primary storage. [2025-09-22T18:36:34.145554] [INFO ] [MAIN ] EMF: Loaded 3735 existing records. [2025-09-22T18:36:34.359369] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:36:34.360128] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-22T18:36:34.360271] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-22T18:36:34.360601] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-22T18:36:34.360827] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-22T18:36:34.546259] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-22T18:36:34.588932] [INFO ] [REMOTE ] ELS: Full fetch complete (70082 records). [2025-09-22T18:36:34.667953] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-22T18:36:34.707792] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:36:34.718281] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:36:34.740847] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:36:34.746741] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-22T18:36:34.753881] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-22T18:36:34.754143] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-09-22T18:36:34.779089] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:36:34.779835] [DEBUG] [LOCAL ] ELS: No derivative data file found to delete. [2025-09-22T18:36:34.780243] [INFO ] [MAIN ] Update Progress: 730/2372 symbols completed. ELS took 42.8s. Estimated remaining: 3h 37m 6s. Rate: 7.6 symbols/min [2025-09-22T18:36:34.926390] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-22T18:36:34.961884] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:36:34.993979] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T18:36:35.058105] [DEBUG] [LOCAL ] EMN: Loaded 50995 existing records from primary storage. [2025-09-22T18:36:35.058336] [INFO ] [MAIN ] EMN: Loaded 50995 existing records. [2025-09-22T18:36:35.242818] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:36:35.243130] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-22T18:36:35.243181] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-22T18:36:35.245238] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-22T18:36:35.245299] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-22T18:36:35.613031] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T18:36:35.632385] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:36:35.722047] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-22T18:36:35.917596] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T18:36:36.522091] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-22T18:36:37.322070] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-22T18:36:37.409438] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T18:36:38.122063] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-22T18:36:38.200174] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T18:36:38.368866] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T18:36:38.922142] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-22T18:36:39.722047] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-22T18:36:39.879167] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T18:36:39.909629] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-22T18:36:39.913263] [INFO ] [REMOTE ] EMD: Full fetch complete (32154 records). [2025-09-22T18:36:39.913370] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-22T18:36:40.286002] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-22T18:36:40.286089] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-22T18:36:40.286597] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-22T18:36:40.286672] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-22T18:36:40.287483] [DEBUG] [LOCAL ] EMD: Trimmed 32154 records to 21191 (keeping 200 days of data) [2025-09-22T18:36:40.432528] [DEBUG] [LOCAL ] EMD: Primary data saved (21191 records). [2025-09-22T18:36:40.432684] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-22T18:36:40.432797] [INFO ] [MAIN ] Update Progress: 731/2372 symbols completed. EMD took 26.9s. Estimated remaining: 3h 36m 53s. Rate: 7.6 symbols/min [2025-09-22T18:36:40.531180] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-22T18:36:40.615179] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:36:40.630518] [DEBUG] [LOCAL ] EMO: Loaded 12458 existing records from primary storage. [2025-09-22T18:36:40.630666] [INFO ] [MAIN ] EMO: Loaded 12458 existing records. [2025-09-22T18:36:40.809921] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:36:40.810295] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-22T18:36:40.810355] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-22T18:36:40.810903] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-22T18:36:40.810965] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-22T18:36:41.182789] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:36:41.177544] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T18:36:41.322051] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-22T18:36:41.407413] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T18:36:42.122122] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-22T18:36:42.399068] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T18:36:42.744803] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T18:36:42.922066] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-22T18:36:43.721992] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-22T18:36:43.762259] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T18:36:44.522109] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-22T18:36:45.322029] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-22T18:36:45.347180] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T18:36:46.014271] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T18:36:46.122006] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-22T18:36:46.131113] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T18:36:46.922058] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-22T18:36:47.249478] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T18:36:47.447510] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-22T18:36:47.722066] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-22T18:36:48.522065] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-22T18:36:49.322092] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-22T18:36:49.627681] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T18:36:49.942638] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T18:36:50.087701] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T18:36:50.122010] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-22T18:36:50.721795] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-22T18:36:50.922082] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-22T18:36:51.722054] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-22T18:36:52.531515] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-22T18:36:52.534014] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T18:36:52.539961] [INFO ] [REMOTE ] EME: Full fetch complete (46872 records). [2025-09-22T18:36:52.540117] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-22T18:36:52.953295] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-22T18:36:52.953662] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-22T18:36:52.954368] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-22T18:36:52.954433] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-22T18:36:52.955674] [DEBUG] [LOCAL ] EME: Trimmed 46872 records to 31792 (keeping 200 days of data) [2025-09-22T18:36:53.176743] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T18:36:53.178428] [DEBUG] [LOCAL ] EME: Primary data saved (31792 records). [2025-09-22T18:36:53.181622] [INFO ] [MAIN ] EME: Full history saved. [2025-09-22T18:36:53.181768] [INFO ] [MAIN ] Update Progress: 732/2372 symbols completed. EME took 27.6s. Estimated remaining: 3h 36m 56s. Rate: 7.6 symbols/min [2025-09-22T18:36:53.331672] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-22T18:36:53.359056] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:36:53.364410] [DEBUG] [LOCAL ] EMP: Loaded 3035 existing records from primary storage. [2025-09-22T18:36:53.364491] [INFO ] [MAIN ] EMP: Loaded 3035 existing records. [2025-09-22T18:36:53.552731] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:36:53.553153] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-22T18:36:53.553259] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-22T18:36:53.553763] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-22T18:36:53.553839] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-22T18:36:53.896720] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-22T18:36:53.976490] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:36:53.983415] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-22T18:36:54.122056] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-22T18:36:54.922115] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-22T18:36:54.943624] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-22T18:36:55.722057] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-22T18:36:55.808457] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T18:36:56.132935] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-22T18:36:56.522075] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-22T18:36:57.102504] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-22T18:36:57.322052] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-22T18:36:57.937484] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T18:36:58.122073] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-22T18:36:58.922062] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-22T18:36:58.968171] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T18:36:59.401678] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-22T18:36:59.722067] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-22T18:37:00.221600] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-22T18:37:00.522063] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-22T18:37:01.322068] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-22T18:37:02.122097] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-22T18:37:02.455072] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T18:37:02.461626] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-22T18:37:02.461859] [INFO ] [REMOTE ] EMO: Full fetch complete (17173 records). [2025-09-22T18:37:02.463530] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-22T18:37:02.720746] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-22T18:37:02.887901] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-22T18:37:02.887991] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-22T18:37:02.888420] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-22T18:37:02.888465] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-22T18:37:02.889318] [DEBUG] [LOCAL ] EMO: Trimmed 17173 records to 12340 (keeping 200 days of data) [2025-09-22T18:37:02.926988] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-22T18:37:02.968372] [DEBUG] [LOCAL ] EMO: Primary data saved (12340 records). [2025-09-22T18:37:02.968543] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-22T18:37:02.968636] [INFO ] [MAIN ] Update Progress: 733/2372 symbols completed. EMO took 22.5s. Estimated remaining: 3h 36m 52s. Rate: 7.6 symbols/min [2025-09-22T18:37:03.151778] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:37:03.220405] [DEBUG] [LOCAL ] EMR: Loaded 54035 existing records from primary storage. [2025-09-22T18:37:03.220580] [INFO ] [MAIN ] EMR: Loaded 54035 existing records. [2025-09-22T18:37:03.412812] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:37:03.413070] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-22T18:37:03.413138] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-22T18:37:03.414556] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-22T18:37:03.414619] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-22T18:37:03.505930] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-22T18:37:03.727303] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-22T18:37:03.796888] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:37:04.335616] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-22T18:37:04.522094] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-22T18:37:04.952573] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T18:37:05.322065] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-22T18:37:06.122068] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-22T18:37:06.621289] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T18:37:06.694705] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T18:37:06.922035] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-22T18:37:07.352216] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-22T18:37:07.722056] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-22T18:37:08.522075] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-22T18:37:09.322059] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-22T18:37:09.408133] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T18:37:09.465341] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T18:37:10.122069] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-22T18:37:10.732495] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-22T18:37:10.922057] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-22T18:37:11.090423] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T18:37:11.491428] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T18:37:11.492588] [INFO ] [REMOTE ] EMF: Full fetch complete (7359 records). [2025-09-22T18:37:11.492696] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-22T18:37:11.728211] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-22T18:37:11.861287] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-22T18:37:11.861369] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-22T18:37:11.861603] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-22T18:37:11.861668] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-22T18:37:11.862120] [DEBUG] [LOCAL ] EMF: Trimmed 7359 records to 3627 (keeping 200 days of data) [2025-09-22T18:37:11.884937] [DEBUG] [LOCAL ] EMF: Primary data saved (3627 records). [2025-09-22T18:37:11.885083] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-22T18:37:11.885173] [INFO ] [MAIN ] Update Progress: 734/2372 symbols completed. EMF took 38.0s. Estimated remaining: 3h 36m 46s. Rate: 7.6 symbols/min [2025-09-22T18:37:12.070828] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:37:12.136196] [DEBUG] [LOCAL ] ENB: Loaded 54299 existing records from primary storage. [2025-09-22T18:37:12.136367] [INFO ] [MAIN ] ENB: Loaded 54299 existing records. [2025-09-22T18:37:12.315223] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:37:12.315492] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-22T18:37:12.315561] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-22T18:37:12.317014] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-22T18:37:12.317077] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-22T18:37:12.532307] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-22T18:37:12.691961] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:37:13.316997] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T18:37:13.327381] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-22T18:37:13.803980] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-22T18:37:14.122056] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-22T18:37:14.676026] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-22T18:37:14.682157] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-22T18:37:14.678058] [INFO ] [REMOTE ] EMP: Full fetch complete (4273 records). [2025-09-22T18:37:14.692897] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-22T18:37:14.927204] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-22T18:37:15.068122] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-22T18:37:15.068209] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-22T18:37:15.068349] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-22T18:37:15.068398] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-22T18:37:15.068828] [DEBUG] [LOCAL ] EMP: Trimmed 4273 records to 3032 (keeping 200 days of data) [2025-09-22T18:37:15.087315] [DEBUG] [LOCAL ] EMP: Primary data saved (3032 records). [2025-09-22T18:37:15.087413] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-22T18:37:15.087509] [INFO ] [MAIN ] Update Progress: 735/2372 symbols completed. EMP took 21.9s. Estimated remaining: 3h 36m 27s. Rate: 7.6 symbols/min [2025-09-22T18:37:15.257329] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:37:15.262176] [DEBUG] [LOCAL ] ENFY: Loaded 3085 existing records from primary storage. [2025-09-22T18:37:15.262273] [INFO ] [MAIN ] ENFY: Loaded 3085 existing records. [2025-09-22T18:37:15.443792] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:37:15.444047] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-22T18:37:15.444096] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-22T18:37:15.444382] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-22T18:37:15.444443] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-22T18:37:15.729562] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-22T18:37:15.820318] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:37:16.522065] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-22T18:37:16.814083] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T18:37:17.322087] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-22T18:37:17.399118] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T18:37:17.541465] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-22T18:37:17.549761] [INFO ] [REMOTE ] EMN: Full fetch complete (71926 records). [2025-09-22T18:37:17.549879] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-22T18:37:17.939110] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-22T18:37:17.939186] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-22T18:37:17.940005] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-22T18:37:17.940069] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-22T18:37:17.941500] [DEBUG] [LOCAL ] EMN: Trimmed 71926 records to 50340 (keeping 200 days of data) [2025-09-22T18:37:18.128842] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-22T18:37:18.270531] [DEBUG] [LOCAL ] EMN: Primary data saved (50340 records). [2025-09-22T18:37:18.270701] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-22T18:37:18.270815] [INFO ] [MAIN ] Update Progress: 736/2372 symbols completed. EMN took 43.5s. Estimated remaining: 3h 36m 9s. Rate: 7.6 symbols/min [2025-09-22T18:37:18.510766] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:37:18.548260] [DEBUG] [LOCAL ] ENIC: Loaded 37334 existing records from primary storage. [2025-09-22T18:37:18.548403] [INFO ] [MAIN ] ENIC: Loaded 37334 existing records. [2025-09-22T18:37:18.750384] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:37:18.750628] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-22T18:37:18.750709] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-22T18:37:18.751702] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-22T18:37:18.751761] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-22T18:37:18.938811] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-22T18:37:19.138574] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:37:19.176570] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T18:37:19.722098] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-22T18:37:19.731529] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T18:37:19.970805] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T18:37:20.522061] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-22T18:37:21.171219] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T18:37:21.171901] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T18:37:21.322062] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-22T18:37:21.763008] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-22T18:37:22.122059] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-22T18:37:22.922070] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-22T18:37:23.462919] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T18:37:23.722091] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-22T18:37:24.522083] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-22T18:37:24.671872] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T18:37:25.322037] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-22T18:37:25.722289] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T18:37:25.823993] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-22T18:37:26.122103] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-22T18:37:26.922093] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-22T18:37:27.109671] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T18:37:27.389016] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T18:37:27.555797] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T18:37:27.722059] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-22T18:37:28.522121] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-22T18:37:29.137146] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T18:37:29.182997] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T18:37:29.322079] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-22T18:37:30.122066] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-22T18:37:30.524313] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T18:37:30.922104] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-22T18:37:31.722113] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-22T18:37:32.099306] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T18:37:32.185981] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T18:37:32.270901] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-22T18:37:32.522120] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-22T18:37:33.322059] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-22T18:37:34.122128] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-22T18:37:34.359215] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T18:37:34.608026] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-22T18:37:34.812524] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T18:37:34.922057] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-22T18:37:35.722097] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-22T18:37:36.179943] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-22T18:37:36.248239] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T18:37:36.522102] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-22T18:37:37.322129] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-22T18:37:37.998829] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T18:37:37.999924] [INFO ] [REMOTE ] ENFY: Full fetch complete (5638 records). [2025-09-22T18:37:37.999993] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-22T18:37:38.127133] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-22T18:37:38.374998] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-22T18:37:38.375174] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-22T18:37:38.375476] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-22T18:37:38.375538] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-22T18:37:38.376005] [DEBUG] [LOCAL ] ENFY: Trimmed 5638 records to 3051 (keeping 200 days of data) [2025-09-22T18:37:38.392781] [DEBUG] [LOCAL ] ENFY: Primary data saved (3051 records). [2025-09-22T18:37:38.392844] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-22T18:37:38.392919] [INFO ] [MAIN ] Update Progress: 737/2372 symbols completed. ENFY took 23.3s. Estimated remaining: 3h 36m 28s. Rate: 7.6 symbols/min [2025-09-22T18:37:38.609304] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:37:38.646418] [DEBUG] [LOCAL ] ENO: Loaded 2016 existing records from primary storage. [2025-09-22T18:37:38.647231] [INFO ] [MAIN ] ENO: Loaded 2016 existing records. [2025-09-22T18:37:38.649378] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-22T18:37:38.841933] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:37:38.842252] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-22T18:37:38.842303] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-22T18:37:38.842566] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-22T18:37:38.842626] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-22T18:37:38.930795] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-22T18:37:39.199035] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:37:39.722087] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-22T18:37:40.152729] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-22T18:37:40.522048] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-22T18:37:40.955175] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T18:37:41.046632] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-22T18:37:41.052226] [INFO ] [REMOTE ] ENIC: Full fetch complete (51136 records). [2025-09-22T18:37:41.052340] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-22T18:37:41.327181] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-22T18:37:41.444802] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-22T18:37:41.444903] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-22T18:37:41.445576] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-22T18:37:41.445619] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-22T18:37:41.446718] [DEBUG] [LOCAL ] ENIC: Trimmed 51136 records to 36699 (keeping 200 days of data) [2025-09-22T18:37:41.649426] [DEBUG] [LOCAL ] ENIC: Primary data saved (36699 records). [2025-09-22T18:37:41.649564] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-22T18:37:41.649670] [INFO ] [MAIN ] Update Progress: 738/2372 symbols completed. ENIC took 23.4s. Estimated remaining: 3h 36m 10s. Rate: 7.6 symbols/min [2025-09-22T18:37:41.830303] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:37:41.874862] [DEBUG] [LOCAL ] ENOV: Loaded 45945 existing records from primary storage. [2025-09-22T18:37:41.875059] [INFO ] [MAIN ] ENOV: Loaded 45945 existing records. [2025-09-22T18:37:42.058584] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:37:42.058919] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-22T18:37:42.058978] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-22T18:37:42.060111] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-22T18:37:42.060174] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-22T18:37:42.127170] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-22T18:37:42.435551] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:37:42.466491] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T18:37:42.588455] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-22T18:37:42.922044] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-22T18:37:43.305160] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-22T18:37:43.313559] [INFO ] [REMOTE ] EMR: Full fetch complete (77110 records). [2025-09-22T18:37:43.313728] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-22T18:37:43.711611] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-22T18:37:43.711773] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-22T18:37:43.712627] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-22T18:37:43.712707] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-22T18:37:43.714393] [DEBUG] [LOCAL ] EMR: Trimmed 77110 records to 53258 (keeping 200 days of data) [2025-09-22T18:37:43.773422] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-22T18:37:44.054013] [DEBUG] [LOCAL ] EMR: Primary data saved (53258 records). [2025-09-22T18:37:44.054170] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-22T18:37:44.055737] [INFO ] [MAIN ] Update Progress: 739/2372 symbols completed. EMR took 41.1s. Estimated remaining: 3h 35m 50s. Rate: 7.6 symbols/min [2025-09-22T18:37:44.163780] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-22T18:37:44.238528] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:37:44.238726] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-09-22T18:37:44.238777] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-09-22T18:37:44.238932] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-22T18:37:44.238976] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-22T18:37:44.239020] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-22T18:37:44.239054] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-22T18:37:44.531692] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-22T18:37:44.633411] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:37:44.669037] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T18:37:45.322063] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-22T18:37:46.122104] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-22T18:37:46.332267] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T18:37:46.620774] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-22T18:37:46.922124] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-22T18:37:47.260170] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T18:37:47.722142] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-22T18:37:48.065386] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T18:37:48.522060] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-22T18:37:48.769014] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T18:37:49.322090] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-22T18:37:49.498610] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-22T18:37:50.122108] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-22T18:37:50.922121] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-22T18:37:50.944130] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T18:37:51.387703] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-22T18:37:51.722033] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-22T18:37:51.923540] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-22T18:37:52.045173] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-22T18:37:52.522068] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-22T18:37:53.322067] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-22T18:37:54.109575] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T18:37:54.122013] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-22T18:37:54.922067] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-22T18:37:55.216898] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T18:37:55.310725] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-22T18:37:55.722039] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-22T18:37:55.810242] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T18:37:56.522072] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-22T18:37:56.823214] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-22T18:37:57.195557] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T18:37:57.322055] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-22T18:37:58.122086] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-22T18:37:58.691977] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T18:37:58.922076] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-22T18:37:59.722056] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-22T18:37:59.958163] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T18:38:00.142393] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T18:38:00.522082] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-22T18:38:00.649311] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T18:38:00.659210] [INFO ] [REMOTE ] ENB: Full fetch complete (77492 records). [2025-09-22T18:38:00.659339] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-22T18:38:01.058404] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-22T18:38:01.058491] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-22T18:38:01.059343] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-22T18:38:01.059408] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-22T18:38:01.060829] [DEBUG] [LOCAL ] ENB: Trimmed 77492 records to 53518 (keeping 200 days of data) [2025-09-22T18:38:01.187154] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-22T18:38:01.352267] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-22T18:38:01.403431] [DEBUG] [LOCAL ] ENB: Primary data saved (53518 records). [2025-09-22T18:38:01.403546] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-22T18:38:01.403629] [INFO ] [MAIN ] Update Progress: 740/2372 symbols completed. ENB took 49.5s. Estimated remaining: 3h 36m 2s. Rate: 7.6 symbols/min [2025-09-22T18:38:01.573554] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:38:01.603130] [DEBUG] [LOCAL ] ENS: Loaded 29761 existing records from primary storage. [2025-09-22T18:38:01.603259] [INFO ] [MAIN ] ENS: Loaded 29761 existing records. [2025-09-22T18:38:01.783200] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:38:01.783462] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-22T18:38:01.783509] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-22T18:38:01.784636] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-22T18:38:01.784726] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-22T18:38:02.127144] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-22T18:38:02.166232] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:38:02.635516] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-22T18:38:02.636413] [INFO ] [REMOTE ] ENO: Full fetch complete (3143 records). [2025-09-22T18:38:02.636482] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-22T18:38:02.924692] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-22T18:38:03.002413] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-22T18:38:03.002525] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-22T18:38:03.002723] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-22T18:38:03.002799] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-22T18:38:03.003332] [DEBUG] [LOCAL ] ENO: Trimmed 3143 records to 1966 (keeping 200 days of data) [2025-09-22T18:38:03.037631] [DEBUG] [LOCAL ] ENO: Primary data saved (1966 records). [2025-09-22T18:38:03.037952] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-22T18:38:03.039309] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T18:38:03.038424] [INFO ] [MAIN ] Update Progress: 741/2372 symbols completed. ENO took 24.6s. Estimated remaining: 3h 35m 41s. Rate: 7.6 symbols/min [2025-09-22T18:38:03.222738] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:38:03.252174] [DEBUG] [LOCAL ] ENVA: Loaded 26160 existing records from primary storage. [2025-09-22T18:38:03.252311] [INFO ] [MAIN ] ENVA: Loaded 26160 existing records. [2025-09-22T18:38:03.431762] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:38:03.432048] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-22T18:38:03.432113] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-22T18:38:03.432855] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-22T18:38:03.432918] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-22T18:38:03.727227] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-22T18:38:03.791728] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:38:04.333852] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T18:38:04.522050] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-22T18:38:05.248903] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T18:38:05.322007] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-22T18:38:05.685595] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T18:38:06.122067] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-22T18:38:06.283034] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T18:38:06.922098] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-22T18:38:07.722118] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-22T18:38:07.843460] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T18:38:08.465898] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T18:38:08.522066] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-22T18:38:08.718452] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T18:38:09.322054] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-22T18:38:09.901095] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T18:38:10.122110] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-22T18:38:10.258289] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T18:38:10.922117] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-22T18:38:11.722059] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-22T18:38:11.974534] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-22T18:38:12.263224] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T18:38:12.522175] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-22T18:38:13.054832] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T18:38:13.062506] [INFO ] [REMOTE ] ENOV: Full fetch complete (63076 records). [2025-09-22T18:38:13.062697] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-22T18:38:13.327264] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-22T18:38:13.475871] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-22T18:38:13.475952] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-22T18:38:13.476711] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-22T18:38:13.476775] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-22T18:38:13.478053] [DEBUG] [LOCAL ] ENOV: Trimmed 63076 records to 45225 (keeping 200 days of data) [2025-09-22T18:38:13.757342] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T18:38:13.772902] [DEBUG] [LOCAL ] ENOV: Primary data saved (45225 records). [2025-09-22T18:38:13.773041] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-22T18:38:13.773129] [INFO ] [MAIN ] Update Progress: 742/2372 symbols completed. ENOV took 32.1s. Estimated remaining: 3h 35m 39s. Rate: 7.6 symbols/min [2025-09-22T18:38:13.943030] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:38:13.958403] [DEBUG] [LOCAL ] EOD: Loaded 14342 existing records from primary storage. [2025-09-22T18:38:13.958530] [INFO ] [MAIN ] EOD: Loaded 14342 existing records. [2025-09-22T18:38:14.128926] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-22T18:38:14.134753] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:38:14.136218] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-22T18:38:14.136331] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-22T18:38:14.137008] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-22T18:38:14.137170] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-22T18:38:14.496717] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:38:14.663770] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T18:38:14.922056] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-22T18:38:15.155637] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T18:38:15.722031] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-22T18:38:15.966532] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T18:38:16.522072] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-22T18:38:16.679970] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T18:38:17.322084] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-22T18:38:17.482782] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T18:38:18.122121] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-22T18:38:18.591171] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T18:38:18.922104] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-22T18:38:18.967859] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T18:38:19.722057] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-22T18:38:20.236266] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T18:38:20.253514] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-22T18:38:20.522122] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-22T18:38:21.322080] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-22T18:38:21.413069] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T18:38:22.122023] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-22T18:38:22.450870] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T18:38:22.922063] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-22T18:38:23.467688] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T18:38:23.722020] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-22T18:38:23.785456] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T18:38:24.522062] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-22T18:38:25.163696] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T18:38:25.322031] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-22T18:38:25.968927] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T18:38:26.122037] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-22T18:38:26.362785] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T18:38:26.367761] [INFO ] [REMOTE ] ENS: Full fetch complete (41784 records). [2025-09-22T18:38:26.367843] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-22T18:38:26.778324] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-22T18:38:26.778410] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-22T18:38:26.779062] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-22T18:38:26.779124] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-22T18:38:26.780041] [DEBUG] [LOCAL ] ENS: Trimmed 41784 records to 29351 (keeping 200 days of data) [2025-09-22T18:38:26.930259] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-22T18:38:26.968283] [DEBUG] [LOCAL ] ENS: Primary data saved (29351 records). [2025-09-22T18:38:26.968404] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-22T18:38:26.968488] [INFO ] [MAIN ] Update Progress: 743/2372 symbols completed. ENS took 25.6s. Estimated remaining: 3h 35m 42s. Rate: 7.6 symbols/min [2025-09-22T18:38:27.143722] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:38:27.203855] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-22T18:38:27.204023] [INFO ] [MAIN ] EOG: Loaded 54121 existing records. [2025-09-22T18:38:27.383500] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:38:27.383770] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-22T18:38:27.383834] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-22T18:38:27.385258] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-22T18:38:27.385321] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-22T18:38:27.726269] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-22T18:38:27.749914] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:38:27.854472] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-22T18:38:27.942143] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T18:38:28.522081] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-22T18:38:29.151264] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T18:38:29.322056] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-22T18:38:29.777741] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T18:38:29.784439] [INFO ] [REMOTE ] ENR: Full fetch complete (57957 records). [2025-09-22T18:38:29.784541] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-22T18:38:30.127469] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-22T18:38:30.182941] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-22T18:38:30.183023] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-22T18:38:30.183752] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-22T18:38:30.183814] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-22T18:38:30.189987] [DEBUG] [LOCAL ] ENR: Trimmed 57957 records to 42631 (keeping 200 days of data) [2025-09-22T18:38:30.429801] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T18:38:30.478983] [DEBUG] [LOCAL ] ENR: Primary data saved (42631 records). [2025-09-22T18:38:30.479119] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-22T18:38:30.479193] [INFO ] [MAIN ] Update Progress: 744/2372 symbols completed. ENR took 46.4s. Estimated remaining: 3h 35m 25s. Rate: 7.6 symbols/min [2025-09-22T18:38:30.647609] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:38:30.659587] [DEBUG] [LOCAL ] EOI: Loaded 10854 existing records from primary storage. [2025-09-22T18:38:30.659731] [INFO ] [MAIN ] EOI: Loaded 10854 existing records. [2025-09-22T18:38:30.835873] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:38:30.836143] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-22T18:38:30.836220] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-22T18:38:30.836781] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-22T18:38:30.836848] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-22T18:38:30.927837] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-22T18:38:31.220182] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:38:31.227830] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T18:38:31.722055] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-22T18:38:32.039209] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T18:38:32.043776] [INFO ] [REMOTE ] ENVA: Full fetch complete (36368 records). [2025-09-22T18:38:32.043932] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-22T18:38:32.044600] [FATAL] [VALIDATOR ] ENVA: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:38:32.044713] [FATAL] [MAIN ] ENVA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:38:32.044772] [WARN ] [MAIN ] ENVA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:38:32.044850] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-22T18:38:32.044969] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-09-22T18:38:32.045029] [INFO ] [LOCAL ] ENVA: Starting deletion of derivative data. [2025-09-22T18:38:32.045541] [DEBUG] [LOCAL ] ENVA: Deleted derivative data file. [2025-09-22T18:38:32.045699] [INFO ] [MAIN ] Update Progress: 745/2372 symbols completed. ENVA took 29.0s. Estimated remaining: 3h 35m 3s. Rate: 7.6 symbols/min [2025-09-22T18:38:32.230754] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:38:32.249481] [DEBUG] [LOCAL ] EOS: Loaded 15784 existing records from primary storage. [2025-09-22T18:38:32.249626] [INFO ] [MAIN ] EOS: Loaded 15784 existing records. [2025-09-22T18:38:32.429493] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:38:32.429780] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-22T18:38:32.429835] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-22T18:38:32.430359] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-22T18:38:32.430420] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-22T18:38:32.527340] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-22T18:38:32.805324] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:38:32.891736] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T18:38:33.322021] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-22T18:38:33.617064] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T18:38:34.122029] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-22T18:38:34.436403] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T18:38:34.922108] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-22T18:38:35.722094] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-22T18:38:35.942439] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T18:38:36.174014] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-22T18:38:36.351301] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-22T18:38:36.522058] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-22T18:38:37.322015] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-22T18:38:37.417310] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T18:38:38.122058] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-22T18:38:38.922079] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-22T18:38:38.959256] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T18:38:39.097522] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T18:38:39.722058] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-22T18:38:39.908503] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-22T18:38:39.910867] [INFO ] [REMOTE ] EOD: Full fetch complete (19789 records). [2025-09-22T18:38:39.910954] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-22T18:38:40.279629] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-22T18:38:40.279734] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-22T18:38:40.280119] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-22T18:38:40.280177] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-22T18:38:40.280805] [DEBUG] [LOCAL ] EOD: Trimmed 19789 records to 14053 (keeping 200 days of data) [2025-09-22T18:38:40.368259] [DEBUG] [LOCAL ] EOD: Primary data saved (14053 records). [2025-09-22T18:38:40.368394] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-22T18:38:40.368493] [INFO ] [MAIN ] Update Progress: 746/2372 symbols completed. EOD took 26.6s. Estimated remaining: 3h 34m 56s. Rate: 7.6 symbols/min [2025-09-22T18:38:40.524536] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-22T18:38:40.549705] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:38:40.553329] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T18:38:40.567352] [DEBUG] [LOCAL ] EOT: Loaded 6926 existing records from primary storage. [2025-09-22T18:38:40.567471] [INFO ] [MAIN ] EOT: Loaded 6926 existing records. [2025-09-22T18:38:40.760947] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:38:40.761554] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-22T18:38:40.761660] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-22T18:38:40.762050] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-22T18:38:40.762125] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-22T18:38:41.122217] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:38:41.322050] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-22T18:38:41.456046] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T18:38:42.122098] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-22T18:38:42.306511] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T18:38:42.758666] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T18:38:42.922103] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-22T18:38:43.722102] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-22T18:38:43.815727] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T18:38:44.522075] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-22T18:38:44.756913] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T18:38:45.322053] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-22T18:38:46.122039] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-22T18:38:46.218768] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T18:38:46.387722] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-22T18:38:46.679308] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T18:38:46.922067] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-22T18:38:47.722078] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-22T18:38:48.522076] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-22T18:38:48.754076] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T18:38:48.792787] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T18:38:49.322074] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-22T18:38:49.440171] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T18:38:50.122057] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-22T18:38:50.757759] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T18:38:50.922060] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-22T18:38:51.255796] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-22T18:38:51.722129] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-22T18:38:51.787941] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T18:38:52.522063] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-22T18:38:53.322020] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-22T18:38:53.334201] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T18:38:53.593566] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-22T18:38:54.100987] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T18:38:54.122001] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-22T18:38:54.860889] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T18:38:54.922087] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-22T18:38:55.722084] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-22T18:38:55.861143] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T18:38:55.863755] [INFO ] [REMOTE ] EOS: Full fetch complete (23049 records). [2025-09-22T18:38:55.863887] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-22T18:38:56.267011] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-22T18:38:56.267113] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-22T18:38:56.267609] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-22T18:38:56.267693] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-22T18:38:56.268335] [DEBUG] [LOCAL ] EOS: Trimmed 23049 records to 15475 (keeping 200 days of data) [2025-09-22T18:38:56.371237] [DEBUG] [LOCAL ] EOS: Primary data saved (15475 records). [2025-09-22T18:38:56.371396] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-22T18:38:56.371522] [INFO ] [MAIN ] Update Progress: 747/2372 symbols completed. EOS took 24.3s. Estimated remaining: 3h 35m 5s. Rate: 7.6 symbols/min [2025-09-22T18:38:56.527847] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-22T18:38:56.535692] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T18:38:56.566550] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:38:56.570041] [DEBUG] [LOCAL ] EPAC: No existing data file found in primary storage. [2025-09-22T18:38:56.570103] [WARN ] [MAIN ] EPAC: No existing data found, performing full refresh instead. [2025-09-22T18:38:56.570262] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-22T18:38:56.570337] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-22T18:38:56.570383] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-09-22T18:38:56.570417] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-22T18:38:56.963185] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:38:57.257459] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T18:38:57.322032] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-22T18:38:58.099744] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T18:38:58.122039] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-22T18:38:58.922056] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-22T18:38:58.948365] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T18:38:59.605141] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T18:38:59.722060] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-22T18:39:00.246840] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-22T18:39:00.522057] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-22T18:39:01.322054] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-22T18:39:01.401699] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T18:39:02.122070] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-22T18:39:02.922100] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-22T18:39:03.722115] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-22T18:39:04.600856] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-22T18:39:04.603213] [INFO ] [REMOTE ] EOT: Full fetch complete (10853 records). [2025-09-22T18:39:04.603285] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-22T18:39:04.989195] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-22T18:39:04.989365] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-22T18:39:04.989747] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-22T18:39:04.989852] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-22T18:39:04.991141] [DEBUG] [LOCAL ] EOT: Trimmed 10853 records to 6845 (keeping 200 days of data) [2025-09-22T18:39:05.073108] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (3.75 seconds). [2025-09-22T18:39:05.073973] [DEBUG] [LOCAL ] EOT: Primary data saved (6845 records). [2025-09-22T18:39:05.084676] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-22T18:39:05.084853] [INFO ] [MAIN ] Update Progress: 748/2372 symbols completed. EOT took 24.7s. Estimated remaining: 3h 34m 59s. Rate: 7.6 symbols/min [2025-09-22T18:39:05.129160] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-22T18:39:05.263679] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:39:05.320072] [DEBUG] [LOCAL ] EPAM: Loaded 40338 existing records from primary storage. [2025-09-22T18:39:05.320213] [INFO ] [MAIN ] EPAM: Loaded 40338 existing records. [2025-09-22T18:39:05.447253] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T18:39:05.468993] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-22T18:39:05.475419] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-22T18:39:05.550525] [INFO ] [REMOTE ] EOI: Full fetch complete (15975 records). [2025-09-22T18:39:05.551528] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-22T18:39:05.550666] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:39:05.623553] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-22T18:39:05.623804] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-22T18:39:05.647934] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-22T18:39:05.656146] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-22T18:39:06.240294] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-22T18:39:06.263251] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-22T18:39:06.277995] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-22T18:39:06.278377] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-22T18:39:06.299162] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:39:06.299256] [DEBUG] [LOCAL ] EOI: Trimmed 15975 records to 10586 (keeping 200 days of data) [2025-09-22T18:39:06.299614] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-22T18:39:06.371639] [DEBUG] [LOCAL ] EOI: Primary data saved (10586 records). [2025-09-22T18:39:06.371869] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-22T18:39:06.371979] [INFO ] [MAIN ] Update Progress: 749/2372 symbols completed. EOI took 35.9s. Estimated remaining: 3h 34m 37s. Rate: 7.6 symbols/min [2025-09-22T18:39:06.548855] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:39:06.602254] [DEBUG] [LOCAL ] EPC: Loaded 40556 existing records from primary storage. [2025-09-22T18:39:06.602392] [INFO ] [MAIN ] EPC: Loaded 40556 existing records. [2025-09-22T18:39:06.784612] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:39:06.784958] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-22T18:39:06.785068] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-22T18:39:06.786625] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-22T18:39:06.786752] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-22T18:39:07.177958] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T18:39:07.176992] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:39:07.178446] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-22T18:39:07.218008] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-22T18:39:07.638671] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T18:39:07.722010] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-22T18:39:08.522082] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-22T18:39:08.685785] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T18:39:08.819960] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T18:39:09.322084] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-22T18:39:10.122035] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-22T18:39:10.172585] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T18:39:10.358384] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T18:39:10.922093] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-22T18:39:11.394834] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T18:39:11.722059] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-22T18:39:12.522017] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-22T18:39:12.630312] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T18:39:12.638589] [INFO ] [REMOTE ] EOG: Full fetch complete (77269 records). [2025-09-22T18:39:12.638777] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-22T18:39:12.947611] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T18:39:13.080480] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-22T18:39:13.080581] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-22T18:39:13.081458] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-22T18:39:13.081526] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-22T18:39:13.083108] [DEBUG] [LOCAL ] EOG: Trimmed 77269 records to 53341 (keeping 200 days of data) [2025-09-22T18:39:13.327869] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-22T18:39:13.480679] [DEBUG] [LOCAL ] EOG: Primary data saved (53341 records). [2025-09-22T18:39:13.480851] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-22T18:39:13.480988] [INFO ] [MAIN ] Update Progress: 750/2372 symbols completed. EOG took 46.5s. Estimated remaining: 3h 34m 27s. Rate: 7.6 symbols/min [2025-09-22T18:39:13.687220] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:39:13.756087] [DEBUG] [LOCAL ] EPD: Loaded 54396 existing records from primary storage. [2025-09-22T18:39:13.756279] [INFO ] [MAIN ] EPD: Loaded 54396 existing records. [2025-09-22T18:39:13.965688] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:39:13.966082] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-22T18:39:13.966144] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-22T18:39:13.968804] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-22T18:39:13.968936] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-22T18:39:14.127262] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-22T18:39:14.511314] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:39:14.536304] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-22T18:39:14.845575] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T18:39:14.922007] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-22T18:39:15.722059] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-22T18:39:16.154695] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-22T18:39:16.522029] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-22T18:39:16.588207] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T18:39:17.002714] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T18:39:17.322058] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-22T18:39:18.006247] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T18:39:18.122080] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-22T18:39:18.922023] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-22T18:39:19.006426] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T18:39:19.034795] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-22T18:39:19.722104] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-22T18:39:20.522072] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-22T18:39:20.647153] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T18:39:21.012889] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T18:39:21.322067] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-22T18:39:22.082345] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T18:39:22.122028] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-22T18:39:22.778962] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T18:39:22.783759] [INFO ] [REMOTE ] EPAC: Full fetch complete (39017 records). [2025-09-22T18:39:22.783866] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-22T18:39:22.927227] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-22T18:39:23.188057] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-22T18:39:23.188141] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-22T18:39:23.188795] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-22T18:39:23.188857] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-22T18:39:23.189963] [DEBUG] [LOCAL ] EPAC: Trimmed 39017 records to 27030 (keeping 200 days of data) [2025-09-22T18:39:23.360772] [DEBUG] [LOCAL ] EPAC: Primary data saved (27030 records). [2025-09-22T18:39:23.361056] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-22T18:39:23.361159] [INFO ] [MAIN ] Update Progress: 751/2372 symbols completed. EPAC took 27.0s. Estimated remaining: 3h 34m 23s. Rate: 7.6 symbols/min [2025-09-22T18:39:23.532750] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:39:23.581014] [DEBUG] [LOCAL ] EPR: Loaded 45037 existing records from primary storage. [2025-09-22T18:39:23.581257] [INFO ] [MAIN ] EPR: Loaded 45037 existing records. [2025-09-22T18:39:23.734365] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-22T18:39:23.776982] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:39:23.777908] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-22T18:39:23.777993] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-22T18:39:23.787892] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-22T18:39:23.793775] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-22T18:39:23.837168] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T18:39:24.279534] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:39:24.522139] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-22T18:39:24.692041] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T18:39:25.322092] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-22T18:39:25.624753] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-22T18:39:26.122093] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-22T18:39:26.881155] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-22T18:39:26.922036] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-22T18:39:27.511019] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-22T18:39:27.722128] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-22T18:39:28.522089] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-22T18:39:28.796746] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-22T18:39:28.864060] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T18:39:28.966831] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-22T18:39:29.322066] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-22T18:39:30.122069] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-22T18:39:30.393765] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-22T18:39:30.738025] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T18:39:30.922075] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-22T18:39:31.722087] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-22T18:39:31.754511] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T18:39:32.522062] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-22T18:39:32.577460] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T18:39:33.322030] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-22T18:39:33.402622] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T18:39:34.073231] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T18:39:34.122028] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-22T18:39:34.835583] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T18:39:34.922030] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-22T18:39:35.722040] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-22T18:39:36.214511] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-22T18:39:36.522114] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-22T18:39:36.840062] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T18:39:37.322021] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-22T18:39:37.448263] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T18:39:37.454910] [INFO ] [REMOTE ] EPAM: Full fetch complete (56029 records). [2025-09-22T18:39:37.455019] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-22T18:39:37.840809] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-22T18:39:37.841032] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-22T18:39:37.841808] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-22T18:39:37.842058] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-22T18:39:37.867568] [DEBUG] [LOCAL ] EPAM: Trimmed 56029 records to 39649 (keeping 200 days of data) [2025-09-22T18:39:37.872973] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T18:39:37.963565] [INFO ] [REMOTE ] EPC: Full fetch complete (56699 records). [2025-09-22T18:39:37.965012] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-22T18:39:38.134730] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-22T18:39:38.414334] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-22T18:39:38.418440] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-22T18:39:38.419325] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-22T18:39:38.419412] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-22T18:39:38.503428] [DEBUG] [LOCAL ] EPC: Trimmed 56699 records to 39905 (keeping 200 days of data) [2025-09-22T18:39:38.640030] [DEBUG] [LOCAL ] EPAM: Primary data saved (39649 records). [2025-09-22T18:39:38.646031] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-22T18:39:38.654360] [INFO ] [MAIN ] Update Progress: 752/2372 symbols completed. EPAM took 33.6s. Estimated remaining: 3h 34m 31s. Rate: 7.6 symbols/min [2025-09-22T18:39:38.856287] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:39:39.012407] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T18:39:39.038331] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-22T18:39:39.043043] [DEBUG] [LOCAL ] EPRT: Loaded 49420 existing records from primary storage. [2025-09-22T18:39:39.043591] [INFO ] [MAIN ] EPRT: Loaded 49420 existing records. [2025-09-22T18:39:39.268872] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:39:39.270325] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-22T18:39:39.270665] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-22T18:39:39.272310] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-22T18:39:39.272705] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-22T18:39:39.630345] [DEBUG] [LOCAL ] EPC: Primary data saved (39905 records). [2025-09-22T18:39:39.667090] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-22T18:39:39.673369] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:39:39.673588] [INFO ] [MAIN ] Update Progress: 753/2372 symbols completed. EPC took 33.3s. Estimated remaining: 3h 34m 8s. Rate: 7.6 symbols/min [2025-09-22T18:39:39.732866] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-22T18:39:39.856013] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:39:39.868387] [DEBUG] [LOCAL ] EQBK: Loaded 11059 existing records from primary storage. [2025-09-22T18:39:39.868512] [INFO ] [MAIN ] EQBK: Loaded 11059 existing records. [2025-09-22T18:39:40.051687] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:39:40.051949] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-22T18:39:40.052000] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-22T18:39:40.052361] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-22T18:39:40.052421] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-22T18:39:40.433995] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:39:40.466266] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-22T18:39:40.500906] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T18:39:40.522005] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-22T18:39:41.322035] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-22T18:39:41.400376] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T18:39:41.786470] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T18:39:42.093872] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T18:39:42.122010] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-22T18:39:42.731973] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T18:39:42.922057] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-22T18:39:43.659231] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T18:39:43.722020] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-22T18:39:44.292727] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-22T18:39:44.522076] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-22T18:39:45.322059] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-22T18:39:46.096560] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T18:39:46.122003] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-22T18:39:46.922058] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-22T18:39:47.132507] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T18:39:47.586401] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T18:39:47.722024] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-22T18:39:47.870934] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-22T18:39:48.522053] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-22T18:39:48.988063] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T18:39:49.322057] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-22T18:39:50.045422] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T18:39:50.122040] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-22T18:39:50.174795] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T18:39:50.922053] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-22T18:39:51.061330] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-22T18:39:51.722089] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-22T18:39:52.522070] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-22T18:39:52.668178] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T18:39:52.869972] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T18:39:53.322075] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-22T18:39:54.122049] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-22T18:39:54.209870] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T18:39:54.922053] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-22T18:39:55.005785] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T18:39:55.267043] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T18:39:55.722049] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-22T18:39:56.529040] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-22T18:39:56.548785] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T18:39:56.590737] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T18:39:56.593153] [INFO ] [REMOTE ] EQBK: Full fetch complete (15536 records). [2025-09-22T18:39:56.593226] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-22T18:39:56.975502] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-22T18:39:56.975594] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-22T18:39:56.975967] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-22T18:39:56.976026] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-22T18:39:56.976552] [DEBUG] [LOCAL ] EQBK: Trimmed 15536 records to 10916 (keeping 200 days of data) [2025-09-22T18:39:57.041781] [DEBUG] [LOCAL ] EQBK: Primary data saved (10916 records). [2025-09-22T18:39:57.041924] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-22T18:39:57.042028] [INFO ] [MAIN ] Update Progress: 754/2372 symbols completed. EQBK took 17.4s. Estimated remaining: 3h 34m 21s. Rate: 7.5 symbols/min [2025-09-22T18:39:57.215252] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:39:57.215511] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-09-22T18:39:57.215562] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-09-22T18:39:57.215755] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-22T18:39:57.215803] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-22T18:39:57.215844] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-09-22T18:39:57.215875] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-22T18:39:57.327282] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-22T18:39:57.594291] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:39:58.122047] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-22T18:39:58.292118] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T18:39:58.922040] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-22T18:39:59.271352] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-22T18:39:59.280780] [INFO ] [REMOTE ] EPD: Full fetch complete (77643 records). [2025-09-22T18:39:59.280948] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-22T18:39:59.687692] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-22T18:39:59.687792] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-22T18:39:59.688743] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-22T18:39:59.688810] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-22T18:39:59.690348] [DEBUG] [LOCAL ] EPD: Trimmed 77643 records to 53616 (keeping 200 days of data) [2025-09-22T18:39:59.746075] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-22T18:39:59.964810] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T18:40:00.073372] [DEBUG] [LOCAL ] EPD: Primary data saved (53616 records). [2025-09-22T18:40:00.073542] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-22T18:40:00.073669] [INFO ] [MAIN ] Update Progress: 755/2372 symbols completed. EPD took 46.6s. Estimated remaining: 3h 34m 2s. Rate: 7.6 symbols/min [2025-09-22T18:40:00.251927] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:40:00.303697] [DEBUG] [LOCAL ] EQNR: Loaded 53821 existing records from primary storage. [2025-09-22T18:40:00.303839] [INFO ] [MAIN ] EQNR: Loaded 53821 existing records. [2025-09-22T18:40:00.488278] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:40:00.488674] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-22T18:40:00.488752] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-22T18:40:00.495842] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-22T18:40:00.506844] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-22T18:40:00.538333] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-22T18:40:00.551990] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T18:40:00.631720] [INFO ] [REMOTE ] EPR: Full fetch complete (62883 records). [2025-09-22T18:40:00.642098] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-22T18:40:01.198365] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:40:01.319629] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-22T18:40:01.319785] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-22T18:40:01.320578] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-22T18:40:01.320792] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-22T18:40:01.322110] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-22T18:40:01.324151] [DEBUG] [LOCAL ] EPR: Trimmed 62883 records to 44290 (keeping 200 days of data) [2025-09-22T18:40:01.595468] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-22T18:40:01.675881] [DEBUG] [LOCAL ] EPR: Primary data saved (44290 records). [2025-09-22T18:40:01.676149] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-22T18:40:01.676279] [INFO ] [MAIN ] Update Progress: 756/2372 symbols completed. EPR took 38.3s. Estimated remaining: 3h 33m 41s. Rate: 7.6 symbols/min [2025-09-22T18:40:01.863126] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:40:01.919417] [DEBUG] [LOCAL ] EQR: Loaded 52136 existing records from primary storage. [2025-09-22T18:40:01.919591] [INFO ] [MAIN ] EQR: Loaded 52136 existing records. [2025-09-22T18:40:02.123969] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:40:02.123826] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-22T18:40:02.125107] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-22T18:40:02.125165] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-22T18:40:02.126327] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-22T18:40:02.126410] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-22T18:40:02.526467] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:40:02.555330] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-22T18:40:02.922066] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-22T18:40:03.390960] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T18:40:03.493285] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-22T18:40:03.722054] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-22T18:40:04.522054] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-22T18:40:04.611415] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T18:40:05.322090] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-22T18:40:05.585796] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T18:40:06.122035] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-22T18:40:06.159961] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T18:40:06.898803] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T18:40:06.922005] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-22T18:40:07.722054] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-22T18:40:07.844723] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T18:40:08.319496] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T18:40:08.522057] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-22T18:40:09.286317] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T18:40:09.322019] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-22T18:40:10.122062] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-22T18:40:10.297923] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T18:40:10.880237] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T18:40:10.922002] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-22T18:40:11.722070] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-22T18:40:12.071881] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T18:40:12.505955] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T18:40:12.522022] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-22T18:40:13.322056] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-22T18:40:14.122057] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-22T18:40:14.452048] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T18:40:14.708531] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.99 seconds). [2025-09-22T18:40:14.715970] [INFO ] [REMOTE ] EPRT: Full fetch complete (68278 records). [2025-09-22T18:40:14.716126] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-22T18:40:14.717025] [FATAL] [VALIDATOR ] EPRT: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:40:14.717118] [FATAL] [MAIN ] EPRT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:40:14.717161] [WARN ] [MAIN ] EPRT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:40:14.717225] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-22T18:40:14.717375] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-09-22T18:40:14.717441] [INFO ] [LOCAL ] EPRT: Starting deletion of derivative data. [2025-09-22T18:40:14.717947] [DEBUG] [LOCAL ] EPRT: Deleted derivative data file. [2025-09-22T18:40:14.718089] [INFO ] [MAIN ] Update Progress: 757/2372 symbols completed. EPRT took 36.1s. Estimated remaining: 3h 33m 44s. Rate: 7.6 symbols/min [2025-09-22T18:40:14.938077] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-22T18:40:14.941008] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T18:40:15.729451] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-22T18:40:15.749981] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T18:40:16.522069] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-22T18:40:16.905853] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-22T18:40:17.322075] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-22T18:40:17.648900] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T18:40:18.122093] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-22T18:40:18.364083] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T18:40:18.922061] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-22T18:40:19.262010] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T18:40:19.722057] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-22T18:40:20.035292] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T18:40:20.522030] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-22T18:40:20.604600] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T18:40:21.322067] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-22T18:40:21.612580] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T18:40:21.766994] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T18:40:22.122094] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-22T18:40:22.922039] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-22T18:40:23.327149] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-22T18:40:23.335366] [INFO ] [REMOTE ] EQH: Full fetch complete (76305 records). [2025-09-22T18:40:23.335487] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-22T18:40:23.762266] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-22T18:40:23.762462] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-22T18:40:23.763471] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-22T18:40:23.763559] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-22T18:40:23.765302] [DEBUG] [LOCAL ] EQH: Trimmed 76305 records to 52672 (keeping 200 days of data) [2025-09-22T18:40:23.887432] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T18:40:23.905756] [INFO ] [REMOTE ] EQNR: Full fetch complete (76746 records). [2025-09-22T18:40:23.917585] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-22T18:40:24.457549] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-22T18:40:24.457879] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-22T18:40:24.459281] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-22T18:40:24.459638] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-22T18:40:24.464550] [DEBUG] [LOCAL ] EQNR: Trimmed 76746 records to 53042 (keeping 200 days of data) [2025-09-22T18:40:24.707546] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T18:40:24.811898] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-22T18:40:24.842221] [DEBUG] [LOCAL ] EQH: Primary data saved (52672 records). [2025-09-22T18:40:24.843152] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-22T18:40:24.844054] [INFO ] [MAIN ] Update Progress: 758/2372 symbols completed. EQH took 27.8s. Estimated remaining: 3h 33m 40s. Rate: 7.6 symbols/min [2025-09-22T18:40:24.953745] [DEBUG] [LOCAL ] EQNR: Primary data saved (53042 records). [2025-09-22T18:40:24.953901] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-22T18:40:24.953989] [INFO ] [MAIN ] Update Progress: 759/2372 symbols completed. EQNR took 24.9s. Estimated remaining: 3h 33m 16s. Rate: 7.6 symbols/min [2025-09-22T18:40:26.478816] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T18:40:26.496340] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-22T18:40:28.003259] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T18:40:28.014591] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-22T18:40:29.708117] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T18:40:29.717507] [INFO ] [REMOTE ] EQR: Full fetch complete (73697 records). [2025-09-22T18:40:29.717789] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-22T18:40:30.163414] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-22T18:40:30.163547] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-22T18:40:30.164785] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-22T18:40:30.164918] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-22T18:40:30.167210] [DEBUG] [LOCAL ] EQR: Trimmed 73697 records to 51410 (keeping 200 days of data) [2025-09-22T18:40:30.519660] [DEBUG] [LOCAL ] EQR: Primary data saved (51410 records). [2025-09-22T18:40:30.519878] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-22T18:40:30.520004] [INFO ] [MAIN ] Update Progress: 760/2372 symbols completed. EQR took 28.8s. Estimated remaining: 3h 33m 3s. Rate: 7.6 symbols/min [2025-09-22T18:40:31.190308] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:40:31.243582] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:40:31.242735] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:40:31.264928] [DEBUG] [LOCAL ] EQV: No existing data file found in primary storage. [2025-09-22T18:40:31.265184] [WARN ] [MAIN ] EQV: No existing data found, performing full refresh instead. [2025-09-22T18:40:31.264811] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:40:31.265506] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-22T18:40:31.265727] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-22T18:40:31.266010] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-22T18:40:31.266081] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-22T18:40:31.266159] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-22T18:40:31.266202] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-22T18:40:31.277599] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-22T18:40:31.297755] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-22T18:40:31.297823] [DEBUG] [LOCAL ] EQV: No primary data file found to delete. [2025-09-22T18:40:31.297857] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-22T18:40:31.881098] [DEBUG] [LOCAL ] ERJ: Loaded 51594 existing records from primary storage. [2025-09-22T18:40:31.838890] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-09-22T18:40:31.896916] [INFO ] [MAIN ] EQT: Loaded 54462 existing records. [2025-09-22T18:40:31.917770] [INFO ] [MAIN ] ERJ: Loaded 51594 existing records. [2025-09-22T18:40:32.327295] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:40:32.321417] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:40:32.328489] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-22T18:40:32.365010] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-22T18:40:32.465342] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:40:32.509617] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:40:32.510231] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-22T18:40:32.510184] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-22T18:40:32.510339] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-22T18:40:32.510382] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-22T18:40:32.512057] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-22T18:40:32.512096] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-22T18:40:32.512242] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-22T18:40:32.512290] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-22T18:40:33.208514] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T18:40:33.227937] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-22T18:40:33.234614] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:40:33.254011] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-22T18:40:33.297617] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T18:40:33.326591] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-22T18:40:33.343222] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:40:33.343755] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-22T18:40:33.593839] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-22T18:40:33.595058] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-22T18:40:33.918761] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-22T18:40:33.919633] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-22T18:40:34.112720] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T18:40:34.115085] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-22T18:40:34.265799] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T18:40:34.266744] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-22T18:40:34.591731] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-22T18:40:34.592633] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-22T18:40:34.617736] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-22T18:40:34.922093] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-22T18:40:34.975174] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-22T18:40:34.978810] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T18:40:35.329536] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-22T18:40:35.549707] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-22T18:40:35.722069] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-22T18:40:36.522115] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-22T18:40:37.322036] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-22T18:40:37.390407] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T18:40:37.647690] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-22T18:40:38.122024] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-22T18:40:38.389119] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T18:40:38.432329] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-22T18:40:38.922093] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-22T18:40:39.379133] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-22T18:40:39.722097] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-22T18:40:40.266274] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-22T18:40:40.522049] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-22T18:40:41.072878] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-22T18:40:41.322065] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-22T18:40:42.122066] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-22T18:40:42.486805] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-22T18:40:42.861950] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T18:40:42.922074] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-22T18:40:43.722097] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-22T18:40:44.405262] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T18:40:44.522092] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-22T18:40:44.743161] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T18:40:44.978866] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-22T18:40:44.979866] [INFO ] [REMOTE ] EQV: Full fetch complete (5725 records). [2025-09-22T18:40:44.979937] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-22T18:40:45.327312] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-22T18:40:45.370662] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-22T18:40:45.370759] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-22T18:40:45.370946] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-22T18:40:45.371006] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-22T18:40:45.371510] [DEBUG] [LOCAL ] EQV: Trimmed 5725 records to 2833 (keeping 200 days of data) [2025-09-22T18:40:45.389096] [DEBUG] [LOCAL ] EQV: Primary data saved (2833 records). [2025-09-22T18:40:45.389179] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-22T18:40:45.389318] [INFO ] [MAIN ] Update Progress: 761/2372 symbols completed. EQV took 14.9s. Estimated remaining: 3h 33m 10s. Rate: 7.6 symbols/min [2025-09-22T18:40:45.569492] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:40:45.618725] [DEBUG] [LOCAL ] ERO: Loaded 41705 existing records from primary storage. [2025-09-22T18:40:45.618872] [INFO ] [MAIN ] ERO: Loaded 41705 existing records. [2025-09-22T18:40:45.802090] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:40:45.802358] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-22T18:40:45.802405] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-22T18:40:45.803622] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-22T18:40:45.803725] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-22T18:40:46.127299] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-22T18:40:46.186164] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:40:46.922038] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-22T18:40:46.987635] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T18:40:47.484954] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-22T18:40:47.722067] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-22T18:40:48.049954] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T18:40:48.522110] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-22T18:40:49.322066] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-22T18:40:49.539267] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T18:40:49.704600] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T18:40:50.122063] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-22T18:40:50.170198] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T18:40:50.171842] [INFO ] [REMOTE ] EQS: Full fetch complete (2537 records). [2025-09-22T18:40:50.171929] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-22T18:40:50.375780] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-22T18:40:50.376235] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:40:50.376328] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:40:50.376435] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-22T18:40:50.376597] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-22T18:40:50.376767] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-22T18:40:50.376853] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-22T18:40:50.377093] [INFO ] [MAIN ] Update Progress: 762/2372 symbols completed. EQS took 19.9s. Estimated remaining: 3h 32m 56s. Rate: 7.6 symbols/min [2025-09-22T18:40:50.551638] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:40:50.623020] [DEBUG] [LOCAL ] ES: Loaded 53295 existing records from primary storage. [2025-09-22T18:40:50.623181] [INFO ] [MAIN ] ES: Loaded 53295 existing records. [2025-09-22T18:40:50.805089] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:40:50.805350] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-22T18:40:50.805399] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-22T18:40:50.807276] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-22T18:40:50.807348] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-22T18:40:50.927162] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-22T18:40:51.176700] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:40:51.722116] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-22T18:40:51.790757] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T18:40:52.522072] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-22T18:40:52.599388] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T18:40:53.322071] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-22T18:40:53.570775] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T18:40:54.079200] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T18:40:54.122064] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-22T18:40:54.922091] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-22T18:40:55.213367] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T18:40:55.370565] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T18:40:55.722047] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-22T18:40:56.522096] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-22T18:40:56.729155] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T18:40:57.322123] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-22T18:40:57.752568] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-22T18:40:58.122132] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-22T18:40:58.234241] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T18:40:58.922117] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-22T18:40:59.030849] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T18:40:59.722060] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-22T18:40:59.913841] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T18:41:00.522077] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-22T18:41:00.728813] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T18:41:01.322070] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-22T18:41:01.492738] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T18:41:02.122064] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-22T18:41:02.229161] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T18:41:02.922062] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-22T18:41:03.212578] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T18:41:03.535413] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T18:41:03.722065] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-22T18:41:04.504159] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T18:41:04.522020] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-22T18:41:05.127954] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T18:41:05.322056] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-22T18:41:06.050021] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T18:41:06.122044] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-22T18:41:06.815454] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T18:41:06.826287] [INFO ] [REMOTE ] ERJ: Full fetch complete (72174 records). [2025-09-22T18:41:06.826444] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-22T18:41:06.932441] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-22T18:41:07.266254] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-22T18:41:07.266352] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-22T18:41:07.267699] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-22T18:41:07.267826] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-22T18:41:07.269917] [DEBUG] [LOCAL ] ERJ: Trimmed 72174 records to 50813 (keeping 200 days of data) [2025-09-22T18:41:07.594691] [DEBUG] [LOCAL ] ERJ: Primary data saved (50813 records). [2025-09-22T18:41:07.594859] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-22T18:41:07.595033] [INFO ] [MAIN ] Update Progress: 763/2372 symbols completed. ERJ took 37.1s. Estimated remaining: 3h 33m 7s. Rate: 7.5 symbols/min [2025-09-22T18:41:07.726681] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-22T18:41:07.784787] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:41:07.812148] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T18:41:07.846679] [DEBUG] [LOCAL ] ESAB: Loaded 26149 existing records from primary storage. [2025-09-22T18:41:07.846846] [INFO ] [MAIN ] ESAB: Loaded 26149 existing records. [2025-09-22T18:41:08.038421] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:41:08.038998] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-22T18:41:08.039055] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-22T18:41:08.040220] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-22T18:41:08.040293] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-22T18:41:08.407123] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:41:08.522303] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-22T18:41:09.105505] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-22T18:41:09.113962] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-22T18:41:09.114123] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-22T18:41:09.348754] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-22T18:41:09.524379] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-22T18:41:09.524872] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-22T18:41:09.525922] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-22T18:41:09.526041] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-22T18:41:09.528425] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-09-22T18:41:09.652187] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-22T18:41:09.824078] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T18:41:09.934043] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-22T18:41:09.934200] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-22T18:41:09.934320] [INFO ] [MAIN ] Update Progress: 764/2372 symbols completed. EQT took 39.4s. Estimated remaining: 3h 32m 47s. Rate: 7.6 symbols/min [2025-09-22T18:41:10.107038] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:41:10.125944] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-22T18:41:10.125813] [DEBUG] [LOCAL ] ESE: Loaded 16887 existing records from primary storage. [2025-09-22T18:41:10.126108] [INFO ] [MAIN ] ESE: Loaded 16887 existing records. [2025-09-22T18:41:10.307139] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:41:10.307401] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-22T18:41:10.307448] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-22T18:41:10.308204] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-22T18:41:10.308266] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-22T18:41:10.672252] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:41:10.846342] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T18:41:10.922005] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-22T18:41:11.241584] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T18:41:11.722062] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-22T18:41:12.522100] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-22T18:41:12.730933] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T18:41:12.749849] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T18:41:13.322062] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-22T18:41:13.411425] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T18:41:14.122074] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-22T18:41:14.312523] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T18:41:14.922073] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-22T18:41:15.513774] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T18:41:15.532578] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T18:41:15.722079] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-22T18:41:16.522058] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-22T18:41:16.791087] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T18:41:17.322061] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-22T18:41:17.653896] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T18:41:17.660872] [INFO ] [REMOTE ] ERO: Full fetch complete (58643 records). [2025-09-22T18:41:17.661077] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-22T18:41:17.661781] [FATAL] [VALIDATOR ] ERO: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:41:17.661883] [FATAL] [MAIN ] ERO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:41:17.661926] [WARN ] [MAIN ] ERO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:41:17.661965] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-22T18:41:17.662023] [DEBUG] [LOCAL ] ERO: No primary data file found to delete. [2025-09-22T18:41:17.662058] [INFO ] [LOCAL ] ERO: Starting deletion of derivative data. [2025-09-22T18:41:17.662565] [DEBUG] [LOCAL ] ERO: Deleted derivative data file. [2025-09-22T18:41:17.662720] [INFO ] [MAIN ] Update Progress: 765/2372 symbols completed. ERO took 32.3s. Estimated remaining: 3h 32m 39s. Rate: 7.6 symbols/min [2025-09-22T18:41:17.860846] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:41:17.921491] [DEBUG] [LOCAL ] ESI: Loaded 51608 existing records from primary storage. [2025-09-22T18:41:17.921698] [INFO ] [MAIN ] ESI: Loaded 51608 existing records. [2025-09-22T18:41:18.118517] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:41:18.118776] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-22T18:41:18.118829] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-22T18:41:18.120325] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-22T18:41:18.120404] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-22T18:41:18.132152] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-22T18:41:18.505307] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T18:41:18.592602] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:41:18.922065] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-22T18:41:19.722112] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-22T18:41:20.230876] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-22T18:41:20.470613] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T18:41:20.522120] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-22T18:41:20.726627] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T18:41:21.322068] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-22T18:41:22.122061] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-22T18:41:22.356496] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T18:41:22.378102] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T18:41:22.922103] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-22T18:41:23.487818] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T18:41:23.722056] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-22T18:41:24.522036] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-22T18:41:24.796739] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T18:41:24.809155] [INFO ] [REMOTE ] ES: Full fetch complete (75748 records). [2025-09-22T18:41:24.809307] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-22T18:41:24.810319] [FATAL] [VALIDATOR ] ES: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:41:24.810485] [FATAL] [MAIN ] ES: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:41:24.810558] [WARN ] [MAIN ] ES: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:41:24.810670] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-22T18:41:24.810779] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-09-22T18:41:24.810837] [INFO ] [LOCAL ] ES: Starting deletion of derivative data. [2025-09-22T18:41:24.811458] [DEBUG] [LOCAL ] ES: Deleted derivative data file. [2025-09-22T18:41:24.811587] [INFO ] [MAIN ] Update Progress: 766/2372 symbols completed. ES took 34.4s. Estimated remaining: 3h 32m 29s. Rate: 7.6 symbols/min [2025-09-22T18:41:25.029218] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:41:25.076901] [DEBUG] [LOCAL ] ESNT: Loaded 39389 existing records from primary storage. [2025-09-22T18:41:25.077073] [INFO ] [MAIN ] ESNT: Loaded 39389 existing records. [2025-09-22T18:41:25.268896] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:41:25.269246] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-22T18:41:25.269307] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-22T18:41:25.271332] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-22T18:41:25.271393] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-22T18:41:25.329486] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-22T18:41:25.491958] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-22T18:41:25.705683] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:41:25.723223] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T18:41:26.122027] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-22T18:41:26.442352] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T18:41:26.922052] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-22T18:41:27.643030] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T18:41:27.703098] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T18:41:27.722008] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-22T18:41:28.522014] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-22T18:41:28.534103] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T18:41:28.537428] [INFO ] [REMOTE ] ESE: Full fetch complete (21808 records). [2025-09-22T18:41:28.537505] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-22T18:41:28.922616] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-22T18:41:28.922736] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-22T18:41:28.923239] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-22T18:41:28.923304] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-22T18:41:28.924031] [DEBUG] [LOCAL ] ESE: Trimmed 21808 records to 16560 (keeping 200 days of data) [2025-09-22T18:41:29.033000] [DEBUG] [LOCAL ] ESE: Primary data saved (16560 records). [2025-09-22T18:41:29.033152] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-22T18:41:29.033242] [INFO ] [MAIN ] Update Progress: 767/2372 symbols completed. ESE took 19.1s. Estimated remaining: 3h 32m 14s. Rate: 7.6 symbols/min [2025-09-22T18:41:29.215418] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:41:29.260535] [DEBUG] [LOCAL ] ESRT: Loaded 47076 existing records from primary storage. [2025-09-22T18:41:29.260737] [INFO ] [MAIN ] ESRT: Loaded 47076 existing records. [2025-09-22T18:41:29.328919] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-22T18:41:29.457789] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:41:29.458037] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-22T18:41:29.458101] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-22T18:41:29.459393] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-22T18:41:29.459479] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-22T18:41:29.844591] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:41:30.122044] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-22T18:41:30.162548] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T18:41:30.560959] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T18:41:30.922061] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-22T18:41:31.722077] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-22T18:41:32.102918] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-22T18:41:32.522055] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-22T18:41:32.806493] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T18:41:32.831668] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T18:41:33.322075] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-22T18:41:33.590487] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T18:41:34.122070] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-22T18:41:34.871664] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T18:41:34.922057] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-22T18:41:35.199696] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T18:41:35.722097] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-22T18:41:36.522042] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-22T18:41:36.589977] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T18:41:37.174910] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T18:41:37.322008] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-22T18:41:37.962286] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T18:41:38.122083] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-22T18:41:38.841462] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T18:41:38.922095] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-22T18:41:39.409003] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T18:41:39.722073] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-22T18:41:40.522536] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-22T18:41:40.525222] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T18:41:41.041730] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-22T18:41:41.322080] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-22T18:41:41.473995] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T18:41:42.122097] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-22T18:41:42.890152] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T18:41:42.922010] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-22T18:41:43.372293] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T18:41:43.377174] [INFO ] [REMOTE ] ESAB: Full fetch complete (35249 records). [2025-09-22T18:41:43.377292] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-22T18:41:43.730709] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-22T18:41:43.763713] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-22T18:41:43.763819] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-22T18:41:43.764466] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-22T18:41:43.764701] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-22T18:41:43.766277] [DEBUG] [LOCAL ] ESAB: Trimmed 35249 records to 25962 (keeping 200 days of data) [2025-09-22T18:41:43.931404] [DEBUG] [LOCAL ] ESAB: Primary data saved (25962 records). [2025-09-22T18:41:43.931545] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-22T18:41:43.931632] [INFO ] [MAIN ] Update Progress: 768/2372 symbols completed. ESAB took 36.3s. Estimated remaining: 3h 32m 20s. Rate: 7.6 symbols/min [2025-09-22T18:41:44.109911] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:41:44.140118] [DEBUG] [LOCAL ] ESS: Loaded 30525 existing records from primary storage. [2025-09-22T18:41:44.140249] [INFO ] [MAIN ] ESS: Loaded 30525 existing records. [2025-09-22T18:41:44.324305] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T18:41:44.366341] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:41:44.366578] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-22T18:41:44.366628] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-22T18:41:44.367513] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-22T18:41:44.367574] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-22T18:41:44.527310] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-22T18:41:44.745709] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:41:45.324992] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-22T18:41:45.327729] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T18:41:46.122064] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-22T18:41:46.379521] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T18:41:46.826084] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T18:41:46.922059] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-22T18:41:47.327638] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T18:41:47.722052] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-22T18:41:48.522465] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-22T18:41:48.528688] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T18:41:48.701078] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T18:41:49.322059] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-22T18:41:50.122039] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-22T18:41:50.206973] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T18:41:50.922072] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-22T18:41:51.263596] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T18:41:51.594847] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T18:41:51.722091] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-22T18:41:52.238825] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-22T18:41:52.247631] [INFO ] [REMOTE ] ESI: Full fetch complete (72317 records). [2025-09-22T18:41:52.247819] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-22T18:41:52.527110] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-22T18:41:52.644381] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-22T18:41:52.644467] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-22T18:41:52.645388] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-22T18:41:52.645455] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-22T18:41:52.647783] [DEBUG] [LOCAL ] ESI: Trimmed 72317 records to 50861 (keeping 200 days of data) [2025-09-22T18:41:52.919390] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-22T18:41:53.011542] [DEBUG] [LOCAL ] ESI: Primary data saved (50861 records). [2025-09-22T18:41:53.011715] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-22T18:41:53.011824] [INFO ] [MAIN ] Update Progress: 769/2372 symbols completed. ESI took 35.3s. Estimated remaining: 3h 32m 15s. Rate: 7.6 symbols/min [2025-09-22T18:41:53.186084] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:41:53.240319] [DEBUG] [LOCAL ] ESTC: Loaded 50967 existing records from primary storage. [2025-09-22T18:41:53.240525] [INFO ] [MAIN ] ESTC: Loaded 50967 existing records. [2025-09-22T18:41:53.327141] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-22T18:41:53.423634] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:41:53.424321] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-22T18:41:53.424376] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-22T18:41:53.425350] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-22T18:41:53.425410] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-22T18:41:53.777891] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:41:53.896614] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T18:41:54.122053] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-22T18:41:54.466084] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T18:41:54.471902] [INFO ] [REMOTE ] ESNT: Full fetch complete (57242 records). [2025-09-22T18:41:54.472016] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-22T18:41:54.855585] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-22T18:41:54.855699] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-22T18:41:54.856440] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-22T18:41:54.856484] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-22T18:41:54.857789] [DEBUG] [LOCAL ] ESNT: Trimmed 57242 records to 38709 (keeping 200 days of data) [2025-09-22T18:41:54.928417] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-22T18:41:55.108963] [DEBUG] [LOCAL ] ESNT: Primary data saved (38709 records). [2025-09-22T18:41:55.109125] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-22T18:41:55.109217] [INFO ] [MAIN ] Update Progress: 770/2372 symbols completed. ESNT took 30.3s. Estimated remaining: 3h 31m 55s. Rate: 7.6 symbols/min [2025-09-22T18:41:55.289803] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:41:55.344351] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-22T18:41:55.344517] [INFO ] [MAIN ] ET: Loaded 54569 existing records. [2025-09-22T18:41:55.534966] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:41:55.535436] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-22T18:41:55.535504] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-22T18:41:55.542241] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-22T18:41:55.551726] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-22T18:41:55.624971] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T18:41:55.722372] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-22T18:41:55.938540] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:41:56.522085] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-22T18:41:56.571895] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T18:41:57.269102] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T18:41:57.322082] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-22T18:41:58.122107] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-22T18:41:58.648081] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T18:41:58.790282] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-22T18:41:58.922063] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-22T18:41:59.722139] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-22T18:41:59.834516] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T18:42:00.522056] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-22T18:42:01.149567] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-22T18:42:01.322053] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-22T18:42:01.515432] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T18:42:02.122045] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-22T18:42:02.506249] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-22T18:42:02.922051] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-22T18:42:03.722058] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-22T18:42:04.406357] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (3.08 seconds). [2025-09-22T18:42:04.522102] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-22T18:42:04.796130] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-22T18:42:05.242997] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-22T18:42:05.250400] [INFO ] [REMOTE ] ESRT: Full fetch complete (66382 records). [2025-09-22T18:42:05.250540] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-22T18:42:05.331477] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-22T18:42:05.674506] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-22T18:42:05.674665] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-22T18:42:05.675731] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-22T18:42:05.675920] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-22T18:42:05.697774] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-22T18:42:05.705565] [DEBUG] [LOCAL ] ESRT: Trimmed 66382 records to 46390 (keeping 200 days of data) [2025-09-22T18:42:05.993894] [DEBUG] [LOCAL ] ESRT: Primary data saved (46390 records). [2025-09-22T18:42:05.994053] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-22T18:42:05.994167] [INFO ] [MAIN ] Update Progress: 771/2372 symbols completed. ESRT took 37.0s. Estimated remaining: 3h 31m 53s. Rate: 7.6 symbols/min [2025-09-22T18:42:06.127167] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-22T18:42:06.188072] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:42:06.203813] [DEBUG] [LOCAL ] ETB: Loaded 12338 existing records from primary storage. [2025-09-22T18:42:06.204007] [INFO ] [MAIN ] ETB: Loaded 12338 existing records. [2025-09-22T18:42:06.395898] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:42:06.396147] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-22T18:42:06.396195] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-22T18:42:06.396601] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-22T18:42:06.396695] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-22T18:42:06.767068] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:42:06.807927] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-22T18:42:06.927157] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-22T18:42:06.950010] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T18:42:07.388127] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T18:42:07.722064] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-22T18:42:08.522055] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-22T18:42:09.114305] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T18:42:09.236766] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-22T18:42:09.322000] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-22T18:42:10.009547] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T18:42:10.122050] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-22T18:42:10.922043] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-22T18:42:11.581485] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T18:42:11.586839] [INFO ] [REMOTE ] ESS: Full fetch complete (43316 records). [2025-09-22T18:42:11.586966] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-22T18:42:11.723688] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-22T18:42:11.810082] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-22T18:42:11.887125] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T18:42:12.051737] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-22T18:42:12.051839] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-22T18:42:12.052511] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-22T18:42:12.052574] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-22T18:42:12.053542] [DEBUG] [LOCAL ] ESS: Trimmed 43316 records to 30116 (keeping 200 days of data) [2025-09-22T18:42:12.236685] [DEBUG] [LOCAL ] ESS: Primary data saved (30116 records). [2025-09-22T18:42:12.236837] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-22T18:42:12.236939] [INFO ] [MAIN ] Update Progress: 772/2372 symbols completed. ESS took 28.3s. Estimated remaining: 3h 31m 41s. Rate: 7.6 symbols/min [2025-09-22T18:42:12.405167] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:42:12.435917] [DEBUG] [LOCAL ] ETD: Loaded 27755 existing records from primary storage. [2025-09-22T18:42:12.436057] [INFO ] [MAIN ] ETD: Loaded 27755 existing records. [2025-09-22T18:42:12.527305] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-22T18:42:12.618021] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:42:12.618276] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-22T18:42:12.618325] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-22T18:42:12.619041] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-22T18:42:12.619101] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-22T18:42:13.031336] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:42:13.322097] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-22T18:42:13.718591] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-22T18:42:14.122094] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-22T18:42:14.922202] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-22T18:42:15.065417] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T18:42:15.607462] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T18:42:15.722143] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-22T18:42:15.868022] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (3.34 seconds). [2025-09-22T18:42:16.522177] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-22T18:42:16.945162] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-22T18:42:17.083894] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T18:42:17.322057] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-22T18:42:18.099796] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T18:42:18.122088] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-22T18:42:18.789472] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T18:42:18.923061] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-22T18:42:18.931161] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-22T18:42:19.722153] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-22T18:42:19.876063] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T18:42:20.522105] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-22T18:42:21.322090] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-22T18:42:21.892755] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-22T18:42:22.117437] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-22T18:42:22.121997] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-22T18:42:22.358919] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T18:42:22.798744] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T18:42:22.922065] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-22T18:42:23.658365] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-22T18:42:23.722097] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-22T18:42:24.522059] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-22T18:42:24.956919] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T18:42:25.322067] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-22T18:42:26.122068] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-22T18:42:26.592117] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T18:42:26.686131] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-22T18:42:26.694593] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-22T18:42:26.694757] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-22T18:42:26.928446] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-22T18:42:27.102106] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-22T18:42:27.102188] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-22T18:42:27.103066] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-22T18:42:27.103132] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-22T18:42:27.104958] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-09-22T18:42:27.443128] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-09-22T18:42:27.443292] [INFO ] [MAIN ] ET: Full history saved. [2025-09-22T18:42:27.443385] [INFO ] [MAIN ] Update Progress: 773/2372 symbols completed. ET took 32.3s. Estimated remaining: 3h 31m 48s. Rate: 7.5 symbols/min [2025-09-22T18:42:27.626562] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:42:27.646741] [DEBUG] [LOCAL ] ETG: Loaded 17227 existing records from primary storage. [2025-09-22T18:42:27.646889] [INFO ] [MAIN ] ETG: Loaded 17227 existing records. [2025-09-22T18:42:27.723067] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-22T18:42:27.854094] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:42:27.854528] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-22T18:42:27.854700] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-22T18:42:27.855356] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-22T18:42:27.855449] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-22T18:42:28.151067] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T18:42:28.290044] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:42:28.311811] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T18:42:28.326471] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T18:42:28.522071] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-22T18:42:29.322073] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-22T18:42:29.813245] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T18:42:30.122017] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-22T18:42:30.137333] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T18:42:30.922060] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-22T18:42:31.722050] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-22T18:42:32.522117] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-22T18:42:32.772157] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-22T18:42:33.278049] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-22T18:42:33.322022] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-22T18:42:34.122070] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-22T18:42:34.239094] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T18:42:34.240916] [INFO ] [REMOTE ] ETB: Full fetch complete (17696 records). [2025-09-22T18:42:34.240992] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-22T18:42:34.241425] [FATAL] [VALIDATOR ] ETB: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:42:34.241513] [FATAL] [MAIN ] ETB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:42:34.241555] [WARN ] [MAIN ] ETB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:42:34.241592] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-22T18:42:34.241705] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-09-22T18:42:34.241761] [INFO ] [LOCAL ] ETB: Starting deletion of derivative data. [2025-09-22T18:42:34.242160] [DEBUG] [LOCAL ] ETB: Deleted derivative data file. [2025-09-22T18:42:34.242271] [INFO ] [MAIN ] Update Progress: 774/2372 symbols completed. ETB took 28.2s. Estimated remaining: 3h 31m 38s. Rate: 7.6 symbols/min [2025-09-22T18:42:34.425017] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:42:34.443850] [DEBUG] [LOCAL ] ETJ: Loaded 17236 existing records from primary storage. [2025-09-22T18:42:34.443997] [INFO ] [MAIN ] ETJ: Loaded 17236 existing records. [2025-09-22T18:42:34.647099] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:42:34.661262] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-22T18:42:34.661424] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-22T18:42:34.661110] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T18:42:34.665904] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-22T18:42:34.666781] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-22T18:42:34.932940] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-22T18:42:35.042896] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:42:35.065525] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-22T18:42:35.076065] [INFO ] [REMOTE ] ESTC: Full fetch complete (72184 records). [2025-09-22T18:42:35.076194] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-22T18:42:35.477750] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-22T18:42:35.477853] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-22T18:42:35.478740] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-22T18:42:35.478822] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-22T18:42:35.499428] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T18:42:35.506431] [DEBUG] [LOCAL ] ESTC: Trimmed 72184 records to 50184 (keeping 200 days of data) [2025-09-22T18:42:35.723916] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-22T18:42:35.814087] [DEBUG] [LOCAL ] ESTC: Primary data saved (50184 records). [2025-09-22T18:42:35.814231] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-22T18:42:35.814316] [INFO ] [MAIN ] Update Progress: 775/2372 symbols completed. ESTC took 42.8s. Estimated remaining: 3h 31m 17s. Rate: 7.6 symbols/min [2025-09-22T18:42:35.993034] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:42:36.003774] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T18:42:36.061866] [DEBUG] [LOCAL ] ETN: Loaded 53621 existing records from primary storage. [2025-09-22T18:42:36.062017] [INFO ] [MAIN ] ETN: Loaded 53621 existing records. [2025-09-22T18:42:36.241796] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:42:36.242079] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-22T18:42:36.242129] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-22T18:42:36.244215] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-22T18:42:36.244279] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-22T18:42:36.522771] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-22T18:42:36.603995] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:42:36.961813] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T18:42:36.966702] [INFO ] [REMOTE ] ETD: Full fetch complete (37919 records). [2025-09-22T18:42:36.966804] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-22T18:42:37.327140] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-22T18:42:37.366566] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-22T18:42:37.366682] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-22T18:42:37.367323] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-22T18:42:37.367370] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-22T18:42:37.368419] [DEBUG] [LOCAL ] ETD: Trimmed 37919 records to 27409 (keeping 200 days of data) [2025-09-22T18:42:37.546408] [DEBUG] [LOCAL ] ETD: Primary data saved (27409 records). [2025-09-22T18:42:37.546574] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-22T18:42:37.546695] [INFO ] [MAIN ] Update Progress: 776/2372 symbols completed. ETD took 25.3s. Estimated remaining: 3h 30m 56s. Rate: 7.6 symbols/min [2025-09-22T18:42:37.728198] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T18:42:37.737203] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:42:37.751337] [DEBUG] [LOCAL ] ETO: Loaded 6704 existing records from primary storage. [2025-09-22T18:42:37.751505] [INFO ] [MAIN ] ETO: Loaded 6704 existing records. [2025-09-22T18:42:37.930560] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:42:37.930878] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-22T18:42:37.930926] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-22T18:42:37.931278] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-22T18:42:37.931338] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-22T18:42:38.127222] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-22T18:42:38.286637] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:42:38.922080] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-22T18:42:39.151335] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T18:42:39.225384] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T18:42:39.439611] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-22T18:42:39.722059] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-22T18:42:40.522062] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-22T18:42:40.743001] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T18:42:41.322056] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-22T18:42:42.122018] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-22T18:42:42.375972] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T18:42:42.631843] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-22T18:42:42.811790] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-22T18:42:42.922093] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-22T18:42:43.634662] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T18:42:43.722083] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-22T18:42:44.522063] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-22T18:42:44.765162] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-22T18:42:45.322061] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-22T18:42:46.122116] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-22T18:42:46.166319] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T18:42:46.344745] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-22T18:42:46.770552] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-22T18:42:46.922086] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-22T18:42:47.722064] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-22T18:42:48.522018] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-22T18:42:48.912839] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T18:42:49.023473] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-22T18:42:49.322103] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-22T18:42:49.652318] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T18:42:50.122055] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-22T18:42:50.922095] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-22T18:42:51.182009] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T18:42:51.469389] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-22T18:42:51.722597] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-22T18:42:51.725121] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-22T18:42:52.522079] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-22T18:42:53.329632] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-22T18:42:53.331996] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T18:42:53.839296] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-22T18:42:54.054225] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T18:42:54.122112] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-22T18:42:54.922076] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-22T18:42:55.719069] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T18:42:55.722001] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-22T18:42:56.181555] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-22T18:42:56.484348] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T18:42:56.522008] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-22T18:42:57.229105] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T18:42:57.322084] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-22T18:42:57.999434] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T18:42:58.000900] [INFO ] [REMOTE ] ETO: Full fetch complete (9241 records). [2025-09-22T18:42:58.000975] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-22T18:42:58.001747] [FATAL] [VALIDATOR ] ETO: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:42:58.001849] [FATAL] [MAIN ] ETO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:42:58.001939] [WARN ] [MAIN ] ETO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:42:58.002022] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-22T18:42:58.002129] [DEBUG] [LOCAL ] ETO: No primary data file found to delete. [2025-09-22T18:42:58.002204] [INFO ] [LOCAL ] ETO: Starting deletion of derivative data. [2025-09-22T18:42:58.002684] [DEBUG] [LOCAL ] ETO: Deleted derivative data file. [2025-09-22T18:42:58.002809] [INFO ] [MAIN ] Update Progress: 777/2372 symbols completed. ETO took 20.5s. Estimated remaining: 3h 31m 14s. Rate: 7.6 symbols/min [2025-09-22T18:42:58.127165] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-22T18:42:58.193768] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:42:58.255361] [DEBUG] [LOCAL ] ETR: Loaded 54016 existing records from primary storage. [2025-09-22T18:42:58.255521] [INFO ] [MAIN ] ETR: Loaded 54016 existing records. [2025-09-22T18:42:58.438052] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:42:58.438341] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-22T18:42:58.438410] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-22T18:42:58.439771] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-22T18:42:58.439835] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-22T18:42:58.826679] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:42:58.922057] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-22T18:42:59.722057] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-22T18:42:59.910309] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T18:43:00.522073] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-22T18:43:00.973846] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T18:43:01.082335] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-22T18:43:01.322070] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-22T18:43:02.122068] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-22T18:43:02.537362] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T18:43:02.681324] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T18:43:02.813698] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T18:43:02.922019] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-22T18:43:03.722061] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-22T18:43:04.008332] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T18:43:04.522061] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-22T18:43:05.322194] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-22T18:43:05.870611] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-22T18:43:05.879525] [INFO ] [REMOTE ] ETN: Full fetch complete (76571 records). [2025-09-22T18:43:05.879755] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-22T18:43:06.129138] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-22T18:43:06.353474] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-22T18:43:06.353856] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-22T18:43:06.355750] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-22T18:43:06.355942] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-22T18:43:06.368632] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T18:43:06.374240] [DEBUG] [LOCAL ] ETN: Trimmed 76571 records to 52837 (keeping 200 days of data) [2025-09-22T18:43:06.510573] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-22T18:43:06.868630] [DEBUG] [LOCAL ] ETN: Primary data saved (52837 records). [2025-09-22T18:43:06.869068] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-22T18:43:06.869387] [INFO ] [MAIN ] Update Progress: 778/2372 symbols completed. ETN took 31.1s. Estimated remaining: 3h 31m 8s. Rate: 7.5 symbols/min [2025-09-22T18:43:06.927370] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-22T18:43:07.143262] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:43:07.155860] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-22T18:43:07.181181] [DEBUG] [LOCAL ] ETV: Loaded 21937 existing records from primary storage. [2025-09-22T18:43:07.181387] [INFO ] [MAIN ] ETV: Loaded 21937 existing records. [2025-09-22T18:43:07.441601] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:43:07.441973] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-22T18:43:07.442036] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-22T18:43:07.442576] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-22T18:43:07.442676] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-22T18:43:07.727359] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-22T18:43:07.826095] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T18:43:07.887857] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:43:07.884186] [INFO ] [REMOTE ] ETJ: Full fetch complete (24938 records). [2025-09-22T18:43:07.888252] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-22T18:43:08.311076] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-22T18:43:08.311154] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-22T18:43:08.311611] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-22T18:43:08.311677] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-22T18:43:08.312324] [DEBUG] [LOCAL ] ETJ: Trimmed 24938 records to 16753 (keeping 200 days of data) [2025-09-22T18:43:08.424037] [DEBUG] [LOCAL ] ETJ: Primary data saved (16753 records). [2025-09-22T18:43:08.424169] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-22T18:43:08.424290] [INFO ] [MAIN ] Update Progress: 779/2372 symbols completed. ETJ took 34.2s. Estimated remaining: 3h 30m 47s. Rate: 7.6 symbols/min [2025-09-22T18:43:08.525971] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-22T18:43:08.597829] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:43:08.625699] [DEBUG] [LOCAL ] ETW: Loaded 25741 existing records from primary storage. [2025-09-22T18:43:08.625888] [INFO ] [MAIN ] ETW: Loaded 25741 existing records. [2025-09-22T18:43:08.809625] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T18:43:08.813479] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:43:08.816248] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-22T18:43:08.816298] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-22T18:43:08.816970] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-22T18:43:08.817030] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-22T18:43:08.859738] [INFO ] [REMOTE ] ETG: Full fetch complete (25067 records). [2025-09-22T18:43:08.886415] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-22T18:43:09.347151] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-22T18:43:09.486093] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:43:09.555949] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-22T18:43:09.556034] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-22T18:43:09.556613] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-22T18:43:09.556683] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-22T18:43:09.558329] [DEBUG] [LOCAL ] ETG: Trimmed 25067 records to 16734 (keeping 200 days of data) [2025-09-22T18:43:09.669912] [DEBUG] [LOCAL ] ETG: Primary data saved (16734 records). [2025-09-22T18:43:09.670068] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-22T18:43:09.670162] [INFO ] [MAIN ] Update Progress: 780/2372 symbols completed. ETG took 42.2s. Estimated remaining: 3h 30m 25s. Rate: 7.6 symbols/min [2025-09-22T18:43:09.849461] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:43:09.861629] [DEBUG] [LOCAL ] ETX: Loaded 4960 existing records from primary storage. [2025-09-22T18:43:09.861858] [INFO ] [MAIN ] ETX: Loaded 4960 existing records. [2025-09-22T18:43:10.051955] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:43:10.052364] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-22T18:43:10.052423] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-22T18:43:10.052735] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-22T18:43:10.052795] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-22T18:43:10.123253] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-22T18:43:10.432233] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T18:43:10.465555] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:43:10.741032] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T18:43:10.922044] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-22T18:43:10.972026] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T18:43:11.722071] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-22T18:43:12.406939] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-22T18:43:12.522097] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-22T18:43:12.840773] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T18:43:13.076587] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-22T18:43:13.322061] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-22T18:43:13.869840] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T18:43:14.122083] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-22T18:43:14.618451] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-22T18:43:14.922105] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-22T18:43:15.722091] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-22T18:43:16.522034] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-22T18:43:16.734616] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T18:43:16.819576] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T18:43:17.284800] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T18:43:17.322000] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-22T18:43:18.122024] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-22T18:43:18.187160] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T18:43:18.922106] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-22T18:43:19.480161] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T18:43:19.722117] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-22T18:43:19.817338] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T18:43:20.280628] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T18:43:20.522141] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-22T18:43:20.967844] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T18:43:21.322130] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-22T18:43:22.122136] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-22T18:43:22.749996] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-22T18:43:22.922122] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-22T18:43:23.298356] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T18:43:23.723792] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-22T18:43:23.729053] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T18:43:24.436617] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T18:43:24.522028] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-22T18:43:25.322018] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-22T18:43:25.485579] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T18:43:26.122048] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-22T18:43:26.656539] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T18:43:26.922063] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-22T18:43:27.277243] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T18:43:27.722057] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-22T18:43:28.522114] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-22T18:43:28.827125] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T18:43:28.940742] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T18:43:29.247760] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T18:43:29.250123] [INFO ] [REMOTE ] ETX: Full fetch complete (6986 records). [2025-09-22T18:43:29.250291] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-22T18:43:29.329388] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-22T18:43:29.668440] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-22T18:43:29.668522] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-22T18:43:29.668768] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-22T18:43:29.668907] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-22T18:43:29.669469] [DEBUG] [LOCAL ] ETX: Trimmed 6986 records to 4913 (keeping 200 days of data) [2025-09-22T18:43:29.705947] [DEBUG] [LOCAL ] ETX: Primary data saved (4913 records). [2025-09-22T18:43:29.706117] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-22T18:43:29.706243] [INFO ] [MAIN ] Update Progress: 781/2372 symbols completed. ETX took 20.0s. Estimated remaining: 3h 30m 42s. Rate: 7.6 symbols/min [2025-09-22T18:43:29.883339] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:43:29.913792] [DEBUG] [LOCAL ] ETY: Loaded 23320 existing records from primary storage. [2025-09-22T18:43:29.913936] [INFO ] [MAIN ] ETY: Loaded 23320 existing records. [2025-09-22T18:43:30.095228] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:43:30.095502] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-22T18:43:30.095551] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-22T18:43:30.096195] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-22T18:43:30.096282] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-22T18:43:30.127126] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-22T18:43:30.476903] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:43:30.492287] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T18:43:30.922091] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-22T18:43:31.648963] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T18:43:31.658295] [INFO ] [REMOTE ] ETR: Full fetch complete (76579 records). [2025-09-22T18:43:31.658466] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-22T18:43:31.663497] [FATAL] [VALIDATOR ] ETR: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:43:31.663620] [FATAL] [MAIN ] ETR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:43:31.663701] [WARN ] [MAIN ] ETR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:43:31.663764] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-22T18:43:31.663839] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-09-22T18:43:31.663884] [INFO ] [LOCAL ] ETR: Starting deletion of derivative data. [2025-09-22T18:43:31.664291] [DEBUG] [LOCAL ] ETR: Deleted derivative data file. [2025-09-22T18:43:31.664454] [INFO ] [MAIN ] Update Progress: 782/2372 symbols completed. ETR took 33.7s. Estimated remaining: 3h 30m 22s. Rate: 7.6 symbols/min [2025-09-22T18:43:31.730990] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-22T18:43:31.863356] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:43:31.889150] [DEBUG] [LOCAL ] EVC: Loaded 20566 existing records from primary storage. [2025-09-22T18:43:31.889350] [INFO ] [MAIN ] EVC: Loaded 20566 existing records. [2025-09-22T18:43:32.005131] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-22T18:43:32.104585] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:43:32.104963] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-22T18:43:32.105024] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-22T18:43:32.105698] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-22T18:43:32.105761] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-22T18:43:32.475761] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:43:32.522029] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-22T18:43:33.022246] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T18:43:33.322106] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-22T18:43:33.435368] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-22T18:43:34.122146] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-22T18:43:34.468488] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T18:43:34.826561] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T18:43:34.922070] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-22T18:43:35.722038] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-22T18:43:36.029299] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T18:43:36.522120] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-22T18:43:36.905041] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T18:43:37.322134] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-22T18:43:37.612766] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T18:43:38.122143] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-22T18:43:38.410517] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T18:43:38.922076] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-22T18:43:39.235838] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T18:43:39.711180] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T18:43:39.722016] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-22T18:43:40.382020] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-22T18:43:40.522188] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-22T18:43:41.322105] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-22T18:43:41.654855] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T18:43:41.659408] [INFO ] [REMOTE ] ETW: Full fetch complete (36354 records). [2025-09-22T18:43:41.659538] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-22T18:43:42.069468] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-22T18:43:42.069882] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-22T18:43:42.070811] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-22T18:43:42.070882] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-22T18:43:42.072266] [DEBUG] [LOCAL ] ETW: Trimmed 36354 records to 25180 (keeping 200 days of data) [2025-09-22T18:43:42.133039] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-22T18:43:42.249782] [DEBUG] [LOCAL ] ETW: Primary data saved (25180 records). [2025-09-22T18:43:42.249998] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-22T18:43:42.250134] [INFO ] [MAIN ] Update Progress: 783/2372 symbols completed. ETW took 33.8s. Estimated remaining: 3h 30m 20s. Rate: 7.6 symbols/min [2025-09-22T18:43:42.437269] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:43:42.478930] [DEBUG] [LOCAL ] EVEX: Loaded 29763 existing records from primary storage. [2025-09-22T18:43:42.479141] [INFO ] [MAIN ] EVEX: Loaded 29763 existing records. [2025-09-22T18:43:42.674333] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:43:42.689194] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-22T18:43:42.689361] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-22T18:43:42.690770] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-22T18:43:42.690693] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T18:43:42.690974] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-22T18:43:42.926615] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-22T18:43:43.100690] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T18:43:43.107490] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:43:43.112600] [INFO ] [REMOTE ] ETV: Full fetch complete (31837 records). [2025-09-22T18:43:43.112761] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-22T18:43:43.493087] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-22T18:43:43.493199] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-22T18:43:43.493795] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-22T18:43:43.493858] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-22T18:43:43.494666] [DEBUG] [LOCAL ] ETV: Trimmed 31837 records to 21450 (keeping 200 days of data) [2025-09-22T18:43:43.629951] [DEBUG] [LOCAL ] ETV: Primary data saved (21450 records). [2025-09-22T18:43:43.630093] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-22T18:43:43.630221] [INFO ] [MAIN ] Update Progress: 784/2372 symbols completed. ETV took 36.8s. Estimated remaining: 3h 29m 58s. Rate: 7.6 symbols/min [2025-09-22T18:43:43.728168] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-22T18:43:43.806463] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:43:43.816127] [DEBUG] [LOCAL ] EVF: Loaded 9194 existing records from primary storage. [2025-09-22T18:43:43.816229] [INFO ] [MAIN ] EVF: Loaded 9194 existing records. [2025-09-22T18:43:43.995347] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:43:43.995611] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-22T18:43:43.995687] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-22T18:43:43.996051] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-22T18:43:43.996109] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-22T18:43:44.348161] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:43:44.406372] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T18:43:44.522068] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-22T18:43:44.799982] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T18:43:45.238785] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-22T18:43:45.322032] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-22T18:43:46.122057] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-22T18:43:46.740184] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T18:43:46.922096] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-22T18:43:47.405974] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-22T18:43:47.722033] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-22T18:43:47.862436] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T18:43:48.522060] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-22T18:43:48.671409] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-22T18:43:49.322068] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-22T18:43:49.845726] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T18:43:50.122117] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-22T18:43:50.356817] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T18:43:50.897552] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T18:43:50.922023] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-22T18:43:51.722024] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-22T18:43:52.082680] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T18:43:52.412204] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T18:43:52.522089] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-22T18:43:53.322093] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-22T18:43:53.561050] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T18:43:53.978006] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T18:43:54.122058] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-22T18:43:54.922038] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-22T18:43:55.237178] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T18:43:55.689054] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-22T18:43:55.722019] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-22T18:43:56.312770] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T18:43:56.522064] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-22T18:43:57.322082] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-22T18:43:57.624863] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T18:43:58.122055] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-22T18:43:58.532247] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T18:43:58.922039] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-22T18:43:59.127946] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T18:43:59.722062] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-22T18:43:59.744779] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T18:43:59.748496] [INFO ] [REMOTE ] ETY: Full fetch complete (34254 records). [2025-09-22T18:43:59.748582] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-22T18:44:00.166083] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-22T18:44:00.166169] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-22T18:44:00.166763] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-22T18:44:00.166824] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-22T18:44:00.167890] [DEBUG] [LOCAL ] ETY: Trimmed 34254 records to 22861 (keeping 200 days of data) [2025-09-22T18:44:00.309794] [DEBUG] [LOCAL ] ETY: Primary data saved (22861 records). [2025-09-22T18:44:00.309940] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-22T18:44:00.310029] [INFO ] [MAIN ] Update Progress: 785/2372 symbols completed. ETY took 30.6s. Estimated remaining: 3h 30m 8s. Rate: 7.6 symbols/min [2025-09-22T18:44:00.476935] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:44:00.485047] [DEBUG] [LOCAL ] EVG: Loaded 5883 existing records from primary storage. [2025-09-22T18:44:00.485166] [INFO ] [MAIN ] EVG: Loaded 5883 existing records. [2025-09-22T18:44:00.527219] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-22T18:44:00.665322] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:44:00.665569] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-22T18:44:00.665659] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-22T18:44:00.666017] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-22T18:44:00.666077] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-22T18:44:01.026796] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:44:01.042634] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T18:44:01.322083] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-22T18:44:01.755155] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T18:44:02.122058] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-22T18:44:02.857941] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T18:44:02.922053] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-22T18:44:02.950681] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T18:44:03.722064] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-22T18:44:04.417948] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T18:44:04.531971] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-22T18:44:04.537978] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T18:44:05.322072] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-22T18:44:05.373185] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T18:44:06.004599] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T18:44:06.122055] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-22T18:44:06.922061] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-22T18:44:07.722058] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-22T18:44:08.284131] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T18:44:08.287707] [INFO ] [REMOTE ] EVC: Full fetch complete (31146 records). [2025-09-22T18:44:08.287900] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-22T18:44:08.528329] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-22T18:44:08.530296] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-22T18:44:08.611166] [INFO ] [REMOTE ] EVEX: Full fetch complete (41430 records). [2025-09-22T18:44:08.622476] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-22T18:44:08.811483] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T18:44:08.811680] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-22T18:44:08.835201] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-22T18:44:08.839567] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-22T18:44:08.839766] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-22T18:44:08.893105] [DEBUG] [LOCAL ] EVC: Trimmed 31146 records to 19774 (keeping 200 days of data) [2025-09-22T18:44:09.229282] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-22T18:44:09.229612] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-22T18:44:09.230559] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-22T18:44:09.230638] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-22T18:44:09.238714] [DEBUG] [LOCAL ] EVEX: Trimmed 41430 records to 29592 (keeping 200 days of data) [2025-09-22T18:44:09.244925] [DEBUG] [LOCAL ] EVC: Primary data saved (19774 records). [2025-09-22T18:44:09.245109] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-22T18:44:09.245238] [INFO ] [MAIN ] Update Progress: 786/2372 symbols completed. EVC took 37.6s. Estimated remaining: 3h 30m 2s. Rate: 7.6 symbols/min [2025-09-22T18:44:09.326441] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-22T18:44:09.417174] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T18:44:09.529712] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:44:09.604853] [DEBUG] [LOCAL ] EVEX: Primary data saved (29592 records). [2025-09-22T18:44:09.605087] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-22T18:44:09.605188] [INFO ] [MAIN ] Update Progress: 787/2372 symbols completed. EVEX took 27.4s. Estimated remaining: 3h 29m 39s. Rate: 7.6 symbols/min [2025-09-22T18:44:09.779992] [DEBUG] [LOCAL ] EVH: Loaded 50085 existing records from primary storage. [2025-09-22T18:44:09.794935] [INFO ] [MAIN ] EVH: Loaded 50085 existing records. [2025-09-22T18:44:09.897821] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:44:10.020618] [DEBUG] [LOCAL ] EVN: Loaded 11051 existing records from primary storage. [2025-09-22T18:44:10.020262] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:44:10.020905] [INFO ] [MAIN ] EVN: Loaded 11051 existing records. [2025-09-22T18:44:10.068212] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-22T18:44:10.092823] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-22T18:44:10.129706] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-22T18:44:10.121628] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-22T18:44:10.134605] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-22T18:44:10.329833] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:44:10.330183] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-22T18:44:10.330619] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-22T18:44:10.357113] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-22T18:44:10.380579] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-22T18:44:10.620889] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-22T18:44:10.815408] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T18:44:10.896040] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:44:10.927207] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-22T18:44:11.012540] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:44:11.702837] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T18:44:11.722000] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-22T18:44:12.494262] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T18:44:12.496175] [INFO ] [REMOTE ] EVF: Full fetch complete (11674 records). [2025-09-22T18:44:12.496291] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-22T18:44:12.527235] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-22T18:44:12.877792] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-22T18:44:12.877870] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-22T18:44:12.878164] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-22T18:44:12.878202] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-22T18:44:12.878706] [DEBUG] [LOCAL ] EVF: Trimmed 11674 records to 9041 (keeping 200 days of data) [2025-09-22T18:44:12.931913] [DEBUG] [LOCAL ] EVF: Primary data saved (9041 records). [2025-09-22T18:44:12.932059] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-22T18:44:12.932146] [INFO ] [MAIN ] Update Progress: 788/2372 symbols completed. EVF took 29.3s. Estimated remaining: 3h 29m 22s. Rate: 7.6 symbols/min [2025-09-22T18:44:13.105548] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:44:13.145386] [DEBUG] [LOCAL ] EVR: Loaded 36434 existing records from primary storage. [2025-09-22T18:44:13.145546] [INFO ] [MAIN ] EVR: Loaded 36434 existing records. [2025-09-22T18:44:13.327169] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-22T18:44:13.333090] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:44:13.337462] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-22T18:44:13.338561] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-22T18:44:13.339229] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T18:44:13.341156] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-22T18:44:13.341542] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-22T18:44:13.712807] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:44:14.122104] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-22T18:44:14.922120] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-22T18:44:15.110721] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T18:44:15.532477] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T18:44:15.722040] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-22T18:44:15.753010] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T18:44:16.522096] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-22T18:44:17.039867] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T18:44:17.226733] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T18:44:17.322013] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-22T18:44:18.122053] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-22T18:44:18.177395] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T18:44:18.636498] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-22T18:44:18.922053] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-22T18:44:19.722115] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-22T18:44:19.854708] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T18:44:20.141834] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T18:44:20.522141] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-22T18:44:21.010811] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-22T18:44:21.322144] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-22T18:44:22.122122] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-22T18:44:22.212128] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T18:44:22.922114] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-22T18:44:23.652047] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T18:44:23.722018] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-22T18:44:23.768779] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T18:44:24.454624] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T18:44:24.522094] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-22T18:44:25.125855] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T18:44:25.322066] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-22T18:44:26.122057] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-22T18:44:26.583264] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T18:44:26.608064] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T18:44:26.922070] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-22T18:44:27.676326] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T18:44:27.677862] [INFO ] [REMOTE ] EVG: Full fetch complete (8042 records). [2025-09-22T18:44:27.677959] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-22T18:44:27.727178] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-22T18:44:28.081434] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-22T18:44:28.081516] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-22T18:44:28.081739] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-22T18:44:28.081799] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-22T18:44:28.082217] [DEBUG] [LOCAL ] EVG: Trimmed 8042 records to 5780 (keeping 200 days of data) [2025-09-22T18:44:28.119478] [DEBUG] [LOCAL ] EVG: Primary data saved (5780 records). [2025-09-22T18:44:28.119580] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-22T18:44:28.119685] [INFO ] [MAIN ] Update Progress: 789/2372 symbols completed. EVG took 27.8s. Estimated remaining: 3h 29m 28s. Rate: 7.6 symbols/min [2025-09-22T18:44:28.291808] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:44:28.310619] [DEBUG] [LOCAL ] EVT: Loaded 17841 existing records from primary storage. [2025-09-22T18:44:28.310796] [INFO ] [MAIN ] EVT: Loaded 17841 existing records. [2025-09-22T18:44:28.488330] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:44:28.488596] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-22T18:44:28.488794] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-22T18:44:28.489433] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-22T18:44:28.489493] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-22T18:44:28.527775] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-22T18:44:28.653117] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T18:44:28.867718] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:44:29.322059] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-22T18:44:30.031772] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T18:44:30.122040] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-22T18:44:30.354368] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T18:44:30.922048] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-22T18:44:31.008971] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T18:44:31.722079] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-22T18:44:31.957586] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T18:44:32.522057] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-22T18:44:33.227120] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T18:44:33.322064] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-22T18:44:33.410634] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T18:44:33.412994] [INFO ] [REMOTE ] EVN: Full fetch complete (17420 records). [2025-09-22T18:44:33.413093] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-22T18:44:33.794427] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-22T18:44:33.794518] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-22T18:44:33.794946] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-22T18:44:33.795010] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-22T18:44:33.795533] [DEBUG] [LOCAL ] EVN: Trimmed 17420 records to 10956 (keeping 200 days of data) [2025-09-22T18:44:33.862003] [DEBUG] [LOCAL ] EVN: Primary data saved (10956 records). [2025-09-22T18:44:33.862145] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-22T18:44:33.862232] [INFO ] [MAIN ] Update Progress: 790/2372 symbols completed. EVN took 24.3s. Estimated remaining: 3h 29m 16s. Rate: 7.6 symbols/min [2025-09-22T18:44:34.040063] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:44:34.066753] [DEBUG] [LOCAL ] EVTC: Loaded 27089 existing records from primary storage. [2025-09-22T18:44:34.066892] [INFO ] [MAIN ] EVTC: Loaded 27089 existing records. [2025-09-22T18:44:34.130637] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-22T18:44:34.257076] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:44:34.257384] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-22T18:44:34.257437] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-22T18:44:34.258331] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-22T18:44:34.258397] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-22T18:44:34.639810] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:44:34.922049] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-22T18:44:35.113663] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T18:44:35.453699] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T18:44:35.722059] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-22T18:44:35.881787] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T18:44:36.522068] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-22T18:44:37.206515] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T18:44:37.322053] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-22T18:44:37.806512] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-22T18:44:38.122056] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-22T18:44:38.851167] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T18:44:38.887674] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T18:44:38.922009] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-22T18:44:39.722125] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-22T18:44:39.950122] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T18:44:40.522071] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-22T18:44:41.196347] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T18:44:41.322018] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-22T18:44:41.774079] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T18:44:42.122069] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-22T18:44:42.692225] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T18:44:42.828273] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T18:44:42.922039] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-22T18:44:43.525608] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T18:44:43.722054] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-22T18:44:44.522060] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-22T18:44:44.728627] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T18:44:45.322069] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-22T18:44:45.984736] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T18:44:46.122073] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-22T18:44:46.474000] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T18:44:46.800309] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T18:44:46.803015] [INFO ] [REMOTE ] EVT: Full fetch complete (25434 records). [2025-09-22T18:44:46.803092] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-22T18:44:46.927310] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-22T18:44:47.174049] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-22T18:44:47.174129] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-22T18:44:47.174638] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-22T18:44:47.174727] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-22T18:44:47.175379] [DEBUG] [LOCAL ] EVT: Trimmed 25434 records to 17313 (keeping 200 days of data) [2025-09-22T18:44:47.280639] [DEBUG] [LOCAL ] EVT: Primary data saved (17313 records). [2025-09-22T18:44:47.280806] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-22T18:44:47.280893] [INFO ] [MAIN ] Update Progress: 791/2372 symbols completed. EVT took 19.2s. Estimated remaining: 3h 29m 19s. Rate: 7.6 symbols/min [2025-09-22T18:44:47.454563] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:44:47.454833] [DEBUG] [LOCAL ] EVTL: No existing data file found in primary storage. [2025-09-22T18:44:47.454941] [WARN ] [MAIN ] EVTL: No existing data found, performing full refresh instead. [2025-09-22T18:44:47.455137] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-22T18:44:47.455188] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-22T18:44:47.455250] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-09-22T18:44:47.455284] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-22T18:44:47.728438] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-22T18:44:47.811104] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:44:48.322423] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T18:44:48.522093] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-22T18:44:49.322090] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-22T18:44:49.384990] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T18:44:49.491042] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T18:44:50.122070] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-22T18:44:50.735906] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T18:44:50.922077] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-22T18:44:51.722100] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-22T18:44:51.848686] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T18:44:52.270834] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T18:44:52.522031] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-22T18:44:52.559320] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T18:44:53.322061] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-22T18:44:53.883617] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T18:44:53.888942] [INFO ] [REMOTE ] EVR: Full fetch complete (50714 records). [2025-09-22T18:44:53.889075] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-22T18:44:54.130761] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-22T18:44:54.312692] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-22T18:44:54.312856] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-22T18:44:54.313759] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-22T18:44:54.313942] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-22T18:44:54.315372] [DEBUG] [LOCAL ] EVR: Trimmed 50714 records to 35778 (keeping 200 days of data) [2025-09-22T18:44:54.450772] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T18:44:54.575016] [DEBUG] [LOCAL ] EVR: Primary data saved (35778 records). [2025-09-22T18:44:54.575172] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-22T18:44:54.575259] [INFO ] [MAIN ] Update Progress: 792/2372 symbols completed. EVR took 41.6s. Estimated remaining: 3h 29m 10s. Rate: 7.6 symbols/min [2025-09-22T18:44:54.750038] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:44:54.774831] [DEBUG] [LOCAL ] EVTR: Loaded 23278 existing records from primary storage. [2025-09-22T18:44:54.774998] [INFO ] [MAIN ] EVTR: Loaded 23278 existing records. [2025-09-22T18:44:54.923901] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-22T18:44:54.964562] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:44:54.964837] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-22T18:44:54.964917] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-22T18:44:54.965775] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-22T18:44:54.965839] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-22T18:44:55.323634] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:44:55.590007] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T18:44:55.722069] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-22T18:44:56.282854] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T18:44:56.522018] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-22T18:44:56.711198] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T18:44:57.322059] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-22T18:44:58.001617] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T18:44:58.009768] [INFO ] [REMOTE ] EVH: Full fetch complete (71743 records). [2025-09-22T18:44:58.009909] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-22T18:44:58.123030] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-22T18:44:58.415660] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-22T18:44:58.415761] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-22T18:44:58.416598] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-22T18:44:58.416661] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-22T18:44:58.418188] [DEBUG] [LOCAL ] EVH: Trimmed 71743 records to 49345 (keeping 200 days of data) [2025-09-22T18:44:58.542561] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T18:44:58.746006] [DEBUG] [LOCAL ] EVH: Primary data saved (49345 records). [2025-09-22T18:44:58.746167] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-22T18:44:58.746260] [INFO ] [MAIN ] Update Progress: 793/2372 symbols completed. EVH took 49.5s. Estimated remaining: 3h 28m 54s. Rate: 7.6 symbols/min [2025-09-22T18:44:58.930751] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:44:58.927157] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-22T18:44:58.984440] [DEBUG] [LOCAL ] EW: Loaded 54177 existing records from primary storage. [2025-09-22T18:44:58.984662] [INFO ] [MAIN ] EW: Loaded 54177 existing records. [2025-09-22T18:44:59.168611] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:44:59.168900] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-22T18:44:59.168950] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-22T18:44:59.170400] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-22T18:44:59.170464] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-22T18:44:59.538545] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:44:59.552777] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T18:44:59.722024] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-22T18:45:00.115522] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T18:45:00.522114] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-22T18:45:01.322083] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-22T18:45:01.673362] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T18:45:01.790026] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T18:45:02.122063] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-22T18:45:02.922103] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-22T18:45:03.351787] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-22T18:45:03.722064] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-22T18:45:04.522120] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-22T18:45:04.697634] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-22T18:45:05.241521] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T18:45:05.322084] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-22T18:45:05.464852] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T18:45:05.592152] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-22T18:45:06.122050] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-22T18:45:06.516440] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T18:45:06.922059] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-22T18:45:07.302600] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T18:45:07.722057] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-22T18:45:08.035621] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T18:45:08.522074] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-22T18:45:09.322067] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-22T18:45:09.449382] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T18:45:09.470215] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T18:45:09.474730] [INFO ] [REMOTE ] EVTC: Full fetch complete (37611 records). [2025-09-22T18:45:09.474844] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-22T18:45:09.475578] [FATAL] [VALIDATOR ] EVTC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:45:09.475745] [FATAL] [MAIN ] EVTC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:45:09.475796] [WARN ] [MAIN ] EVTC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:45:09.475875] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-22T18:45:09.476000] [DEBUG] [LOCAL ] EVTC: No primary data file found to delete. [2025-09-22T18:45:09.476082] [INFO ] [LOCAL ] EVTC: Starting deletion of derivative data. [2025-09-22T18:45:09.476715] [DEBUG] [LOCAL ] EVTC: Deleted derivative data file. [2025-09-22T18:45:09.476855] [INFO ] [MAIN ] Update Progress: 794/2372 symbols completed. EVTC took 35.6s. Estimated remaining: 3h 28m 52s. Rate: 7.6 symbols/min [2025-09-22T18:45:09.660424] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:45:09.695966] [DEBUG] [LOCAL ] EXG: Loaded 35265 existing records from primary storage. [2025-09-22T18:45:09.696152] [INFO ] [MAIN ] EXG: Loaded 35265 existing records. [2025-09-22T18:45:09.874479] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:45:09.874749] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-22T18:45:09.874830] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-22T18:45:09.876903] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-22T18:45:09.876965] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-22T18:45:10.127213] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-22T18:45:10.229689] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:45:10.555501] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T18:45:10.922076] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-22T18:45:11.722057] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-22T18:45:12.114855] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-22T18:45:12.522084] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-22T18:45:13.060985] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-22T18:45:13.228807] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T18:45:13.322091] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-22T18:45:14.031797] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T18:45:14.122112] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-22T18:45:14.922086] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-22T18:45:15.671765] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-22T18:45:15.722048] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-22T18:45:16.522056] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-22T18:45:16.707939] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T18:45:16.739989] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-22T18:45:16.954362] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-22T18:45:17.322065] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-22T18:45:17.608527] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T18:45:18.122064] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-22T18:45:18.922064] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-22T18:45:19.222347] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T18:45:19.230019] [INFO ] [REMOTE ] EVTL: Full fetch complete (50113 records). [2025-09-22T18:45:19.230192] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-22T18:45:19.629305] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-22T18:45:19.629436] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-22T18:45:19.630269] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-22T18:45:19.630339] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-22T18:45:19.631668] [DEBUG] [LOCAL ] EVTL: Trimmed 50113 records to 36915 (keeping 200 days of data) [2025-09-22T18:45:19.722558] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-22T18:45:19.857019] [DEBUG] [LOCAL ] EVTL: Primary data saved (36915 records). [2025-09-22T18:45:19.857193] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-22T18:45:19.857288] [INFO ] [MAIN ] Update Progress: 795/2372 symbols completed. EVTL took 32.6s. Estimated remaining: 3h 28m 49s. Rate: 7.6 symbols/min [2025-09-22T18:45:20.036687] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:45:20.084328] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T18:45:20.146568] [DEBUG] [LOCAL ] EXK: Loaded 53855 existing records from primary storage. [2025-09-22T18:45:20.146763] [INFO ] [MAIN ] EXK: Loaded 53855 existing records. [2025-09-22T18:45:20.330229] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:45:20.330799] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-22T18:45:20.330926] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-22T18:45:20.332408] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-22T18:45:20.332497] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-22T18:45:20.444325] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T18:45:20.526407] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-22T18:45:20.809728] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:45:21.045836] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T18:45:21.322055] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-22T18:45:22.122051] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-22T18:45:22.326380] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-22T18:45:22.331825] [INFO ] [REMOTE ] EVTR: Full fetch complete (31549 records). [2025-09-22T18:45:22.331927] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-22T18:45:22.753034] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-22T18:45:22.753232] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-22T18:45:22.753828] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-22T18:45:22.754043] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-22T18:45:22.785972] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-22T18:45:22.786112] [DEBUG] [LOCAL ] EVTR: Trimmed 31549 records to 23026 (keeping 200 days of data) [2025-09-22T18:45:22.922073] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-22T18:45:22.951481] [DEBUG] [LOCAL ] EVTR: Primary data saved (23026 records). [2025-09-22T18:45:22.951620] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-22T18:45:22.951778] [INFO ] [MAIN ] Update Progress: 796/2372 symbols completed. EVTR took 28.4s. Estimated remaining: 3h 28m 31s. Rate: 7.6 symbols/min [2025-09-22T18:45:23.129232] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:45:23.167425] [DEBUG] [LOCAL ] EXP: Loaded 30759 existing records from primary storage. [2025-09-22T18:45:23.167566] [INFO ] [MAIN ] EXP: Loaded 30759 existing records. [2025-09-22T18:45:23.345105] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:45:23.345365] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-22T18:45:23.345413] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-22T18:45:23.346324] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-22T18:45:23.346385] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-22T18:45:23.722601] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:45:23.723375] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-22T18:45:23.762352] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T18:45:24.522033] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-22T18:45:24.852196] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-22T18:45:25.210237] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T18:45:25.322063] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-22T18:45:25.922832] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T18:45:26.122077] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-22T18:45:26.922119] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-22T18:45:27.000942] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T18:45:27.526071] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T18:45:27.722085] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-22T18:45:28.522076] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-22T18:45:29.114478] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-22T18:45:29.322056] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-22T18:45:29.887582] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-22T18:45:30.122078] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-22T18:45:30.435709] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-22T18:45:30.864948] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T18:45:30.922050] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-22T18:45:31.722065] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-22T18:45:31.937292] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T18:45:32.251585] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T18:45:32.522055] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-22T18:45:33.322033] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-22T18:45:33.684219] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T18:45:33.715561] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T18:45:33.720548] [INFO ] [REMOTE ] EXG: Full fetch complete (50060 records). [2025-09-22T18:45:33.720734] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-22T18:45:34.109514] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-22T18:45:34.109622] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-22T18:45:34.110740] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-22T18:45:34.110827] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-22T18:45:34.112365] [DEBUG] [LOCAL ] EXG: Trimmed 50060 records to 34542 (keeping 200 days of data) [2025-09-22T18:45:34.122064] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-22T18:45:34.329682] [DEBUG] [LOCAL ] EXG: Primary data saved (34542 records). [2025-09-22T18:45:34.329842] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-22T18:45:34.330028] [INFO ] [MAIN ] Update Progress: 797/2372 symbols completed. EXG took 24.9s. Estimated remaining: 3h 28m 30s. Rate: 7.6 symbols/min [2025-09-22T18:45:34.922073] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-22T18:45:35.323041] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T18:45:35.655121] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T18:45:35.722077] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-22T18:45:36.522069] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-22T18:45:36.696557] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T18:45:36.765179] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T18:45:37.322078] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-22T18:45:38.122079] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-22T18:45:38.451698] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-22T18:45:38.656133] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T18:45:38.922076] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-22T18:45:39.650025] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T18:45:39.658423] [INFO ] [REMOTE ] EW: Full fetch complete (77347 records). [2025-09-22T18:45:39.658609] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-22T18:45:39.729208] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-22T18:45:40.131776] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-22T18:45:40.131861] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-22T18:45:40.133811] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-22T18:45:40.133886] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-22T18:45:40.138246] [DEBUG] [LOCAL ] EW: Trimmed 77347 records to 53396 (keeping 200 days of data) [2025-09-22T18:45:40.498248] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T18:45:40.514083] [DEBUG] [LOCAL ] EW: Primary data saved (53396 records). [2025-09-22T18:45:40.514239] [INFO ] [MAIN ] EW: Full history saved. [2025-09-22T18:45:40.514403] [INFO ] [MAIN ] Update Progress: 798/2372 symbols completed. EW took 41.8s. Estimated remaining: 3h 28m 19s. Rate: 7.6 symbols/min [2025-09-22T18:45:40.522020] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-22T18:45:41.090487] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T18:45:41.322052] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-22T18:45:42.429216] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-22T18:45:42.440595] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-22T18:45:42.751184] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T18:45:42.922076] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-22T18:45:44.157987] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T18:45:44.164423] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-22T18:45:44.263026] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T18:45:44.522053] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-22T18:45:45.544182] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T18:45:45.548833] [INFO ] [REMOTE ] EXP: Full fetch complete (43135 records). [2025-09-22T18:45:45.548944] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-22T18:45:45.933771] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-22T18:45:45.933849] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-22T18:45:45.934456] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-22T18:45:45.934522] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-22T18:45:45.938462] [DEBUG] [LOCAL ] EXP: Trimmed 43135 records to 30188 (keeping 200 days of data) [2025-09-22T18:45:46.131105] [DEBUG] [LOCAL ] EXP: Primary data saved (30188 records). [2025-09-22T18:45:46.131231] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-22T18:45:46.131330] [INFO ] [MAIN ] Update Progress: 799/2372 symbols completed. EXP took 23.2s. Estimated remaining: 3h 28m 6s. Rate: 7.6 symbols/min [2025-09-22T18:45:46.627733] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-22T18:45:46.639808] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-22T18:45:48.609975] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-22T18:45:48.622494] [INFO ] [REMOTE ] EXK: Full fetch complete (76043 records). [2025-09-22T18:45:48.622726] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-22T18:45:48.623909] [FATAL] [VALIDATOR ] EXK: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:45:48.624007] [FATAL] [MAIN ] EXK: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:45:48.624063] [WARN ] [MAIN ] EXK: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:45:48.624148] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-22T18:45:48.624215] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-09-22T18:45:48.624270] [INFO ] [LOCAL ] EXK: Starting deletion of derivative data. [2025-09-22T18:45:48.624683] [DEBUG] [LOCAL ] EXK: Deleted derivative data file. [2025-09-22T18:45:48.624801] [INFO ] [MAIN ] Update Progress: 800/2372 symbols completed. EXK took 28.8s. Estimated remaining: 3h 27m 48s. Rate: 7.6 symbols/min [2025-09-22T18:45:49.237022] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:45:49.282553] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:45:49.342135] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:45:49.369836] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:45:49.452176] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-22T18:45:49.452530] [INFO ] [MAIN ] F: Loaded 54600 existing records. [2025-09-22T18:45:49.614170] [DEBUG] [LOCAL ] FAF: Loaded 42663 existing records from primary storage. [2025-09-22T18:45:49.615070] [DEBUG] [LOCAL ] EXPD: Loaded 48955 existing records from primary storage. [2025-09-22T18:45:49.650186] [INFO ] [MAIN ] EXPD: Loaded 48955 existing records. [2025-09-22T18:45:49.626796] [INFO ] [MAIN ] FAF: Loaded 42663 existing records. [2025-09-22T18:45:49.661584] [DEBUG] [LOCAL ] EXR: Loaded 46271 existing records from primary storage. [2025-09-22T18:45:49.745117] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:45:49.781197] [INFO ] [MAIN ] EXR: Loaded 46271 existing records. [2025-09-22T18:45:49.806367] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-22T18:45:49.850625] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-22T18:45:50.024939] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-22T18:45:50.133943] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-22T18:45:50.184697] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:45:50.219257] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-22T18:45:50.219026] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:45:50.235270] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-22T18:45:50.282755] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-22T18:45:50.319944] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-22T18:45:50.343686] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-22T18:45:50.335246] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-22T18:45:50.392452] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-22T18:45:50.392898] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-22T18:45:50.392685] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:45:50.503030] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-22T18:45:50.518587] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-22T18:45:50.652961] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-22T18:45:50.705630] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-22T18:45:51.522545] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:45:51.583884] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-22T18:45:51.589182] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:45:51.637325] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-22T18:45:51.696410] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:45:51.709836] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-22T18:45:51.812546] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:45:51.813035] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-22T18:45:54.139835] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-22T18:45:54.146836] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-22T18:45:54.442089] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-22T18:45:54.451610] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-22T18:45:54.547437] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-09-22T18:45:54.556727] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-22T18:45:54.847140] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (3.26 seconds). [2025-09-22T18:45:54.858462] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-22T18:45:55.655835] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T18:45:55.663491] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-22T18:45:55.690003] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T18:45:55.699603] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-22T18:45:56.217217] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T18:45:56.226611] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-22T18:45:56.549849] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T18:45:56.556824] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-22T18:45:56.926138] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-22T18:45:56.937082] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-22T18:45:57.338201] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T18:45:57.347018] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-22T18:45:57.883482] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T18:45:57.893217] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-22T18:45:58.086891] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T18:45:58.122009] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-22T18:45:59.165054] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T18:45:59.175287] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-22T18:45:59.373147] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-22T18:45:59.496442] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T18:45:59.637864] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T18:45:59.722041] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-22T18:46:00.522056] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-22T18:46:00.882051] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T18:46:01.322069] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-22T18:46:02.122070] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-22T18:46:02.157348] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T18:46:02.413439] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-22T18:46:02.813955] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T18:46:02.922062] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-22T18:46:03.722115] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-22T18:46:03.899016] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T18:46:04.050985] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T18:46:04.522048] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-22T18:46:05.322059] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-22T18:46:06.122038] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-22T18:46:06.202997] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-22T18:46:06.260782] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T18:46:06.922093] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-22T18:46:07.098382] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T18:46:07.723355] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-22T18:46:07.723165] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T18:46:08.522081] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-22T18:46:09.098572] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T18:46:09.322164] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-22T18:46:09.516682] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-22T18:46:10.122067] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-22T18:46:10.276844] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T18:46:10.656861] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T18:46:10.922092] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-22T18:46:11.722070] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-22T18:46:12.530177] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-22T18:46:12.552366] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T18:46:12.718598] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-22T18:46:13.252598] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T18:46:13.322075] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-22T18:46:13.809694] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T18:46:14.122083] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-22T18:46:14.922033] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-22T18:46:15.001568] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T18:46:15.008222] [INFO ] [REMOTE ] FAF: Full fetch complete (57511 records). [2025-09-22T18:46:15.008412] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-22T18:46:15.406927] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-22T18:46:15.407018] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-22T18:46:15.407828] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-22T18:46:15.407933] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-22T18:46:15.409245] [DEBUG] [LOCAL ] FAF: Trimmed 57511 records to 42036 (keeping 200 days of data) [2025-09-22T18:46:15.669782] [DEBUG] [LOCAL ] FAF: Primary data saved (42036 records). [2025-09-22T18:46:15.669916] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-22T18:46:15.670000] [INFO ] [MAIN ] Update Progress: 801/2372 symbols completed. FAF took 27.0s. Estimated remaining: 3h 28m 17s. Rate: 7.5 symbols/min [2025-09-22T18:46:15.734340] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-22T18:46:15.859866] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:46:15.884240] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T18:46:15.893305] [INFO ] [REMOTE ] EXR: Full fetch complete (65726 records). [2025-09-22T18:46:15.893480] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-22T18:46:16.245742] [DEBUG] [LOCAL ] FBIN: Loaded 51209 existing records from primary storage. [2025-09-22T18:46:16.257046] [INFO ] [MAIN ] FBIN: Loaded 51209 existing records. [2025-09-22T18:46:16.479429] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-22T18:46:16.510999] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-22T18:46:16.537001] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-22T18:46:16.537251] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-22T18:46:16.537128] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:46:16.537580] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-22T18:46:16.537635] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-22T18:46:16.538556] [DEBUG] [LOCAL ] EXR: Trimmed 65726 records to 45520 (keeping 200 days of data) [2025-09-22T18:46:16.539975] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-22T18:46:16.540038] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-22T18:46:17.147468] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:46:17.151022] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-22T18:46:17.209231] [DEBUG] [LOCAL ] EXR: Primary data saved (45520 records). [2025-09-22T18:46:17.209548] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-22T18:46:17.209708] [INFO ] [MAIN ] Update Progress: 802/2372 symbols completed. EXR took 28.6s. Estimated remaining: 3h 27m 57s. Rate: 7.6 symbols/min [2025-09-22T18:46:17.386870] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:46:17.425537] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T18:46:17.434971] [INFO ] [REMOTE ] EXPD: Full fetch complete (69209 records). [2025-09-22T18:46:17.435162] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-22T18:46:17.625217] [DEBUG] [LOCAL ] FBK: Loaded 25716 existing records from primary storage. [2025-09-22T18:46:17.664736] [INFO ] [MAIN ] FBK: Loaded 25716 existing records. [2025-09-22T18:46:18.087576] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:46:18.105563] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-22T18:46:18.108614] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-22T18:46:18.163961] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-22T18:46:18.135381] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-22T18:46:18.182797] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-22T18:46:18.187480] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-22T18:46:18.187378] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-22T18:46:18.220434] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-22T18:46:18.235878] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (3.31 seconds). [2025-09-22T18:46:18.294979] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-22T18:46:18.323126] [DEBUG] [LOCAL ] EXPD: Trimmed 69209 records to 48212 (keeping 200 days of data) [2025-09-22T18:46:18.727825] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:46:18.731495] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-22T18:46:18.908580] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T18:46:18.936886] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-22T18:46:18.950950] [DEBUG] [LOCAL ] EXPD: Primary data saved (48212 records). [2025-09-22T18:46:18.951316] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-22T18:46:18.952582] [INFO ] [MAIN ] Update Progress: 803/2372 symbols completed. EXPD took 30.3s. Estimated remaining: 3h 27m 37s. Rate: 7.6 symbols/min [2025-09-22T18:46:19.125482] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:46:19.174901] [DEBUG] [LOCAL ] FBP: Loaded 47037 existing records from primary storage. [2025-09-22T18:46:19.175085] [INFO ] [MAIN ] FBP: Loaded 47037 existing records. [2025-09-22T18:46:19.362770] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:46:19.363060] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-22T18:46:19.363128] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-22T18:46:19.364271] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-22T18:46:19.364338] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-22T18:46:19.744907] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:46:19.745359] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-22T18:46:19.794811] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T18:46:20.522065] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-22T18:46:20.605306] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-22T18:46:20.826341] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-22T18:46:20.914242] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T18:46:21.322068] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-22T18:46:21.530472] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T18:46:22.122089] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-22T18:46:22.531354] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T18:46:22.922051] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-22T18:46:23.318423] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T18:46:23.722073] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-22T18:46:24.522068] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-22T18:46:25.180474] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-22T18:46:25.322060] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-22T18:46:26.122138] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-22T18:46:26.173587] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T18:46:26.750100] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T18:46:26.922102] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-22T18:46:27.254107] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (3.53 seconds). [2025-09-22T18:46:27.263554] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-22T18:46:27.263779] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-22T18:46:27.679063] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-22T18:46:27.679156] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-22T18:46:27.680204] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-22T18:46:27.680296] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-22T18:46:27.681974] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-22T18:46:27.738077] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-22T18:46:27.936440] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-22T18:46:28.068030] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-22T18:46:28.068188] [INFO ] [MAIN ] F: Full history saved. [2025-09-22T18:46:28.068281] [INFO ] [MAIN ] Update Progress: 804/2372 symbols completed. F took 39.4s. Estimated remaining: 3h 27m 31s. Rate: 7.6 symbols/min [2025-09-22T18:46:28.249981] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:46:28.288344] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T18:46:28.306629] [DEBUG] [LOCAL ] FBRT: Loaded 34817 existing records from primary storage. [2025-09-22T18:46:28.306805] [INFO ] [MAIN ] FBRT: Loaded 34817 existing records. [2025-09-22T18:46:28.486196] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:46:28.486470] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-22T18:46:28.486518] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-22T18:46:28.487453] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-22T18:46:28.487512] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-22T18:46:28.532109] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-22T18:46:28.868476] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:46:29.322068] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-22T18:46:29.531750] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T18:46:30.108303] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T18:46:30.122009] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-22T18:46:30.690147] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T18:46:30.922057] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-22T18:46:31.722102] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-22T18:46:31.891329] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T18:46:31.999115] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T18:46:32.522107] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-22T18:46:33.060825] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-22T18:46:33.322033] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-22T18:46:33.576192] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T18:46:34.122055] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-22T18:46:34.572132] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T18:46:34.922106] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-22T18:46:35.682633] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T18:46:35.722017] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-22T18:46:36.375807] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T18:46:36.522034] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-22T18:46:36.978338] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T18:46:37.322055] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-22T18:46:37.699111] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T18:46:38.122063] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-22T18:46:38.658569] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T18:46:38.922071] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-22T18:46:39.732586] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-22T18:46:39.740685] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T18:46:40.523344] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-22T18:46:40.528873] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T18:46:41.067567] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T18:46:41.322060] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-22T18:46:42.122022] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-22T18:46:42.218749] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T18:46:42.922072] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-22T18:46:43.017705] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T18:46:43.025203] [INFO ] [REMOTE ] FBP: Full fetch complete (66270 records). [2025-09-22T18:46:43.025346] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-22T18:46:43.418601] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-22T18:46:43.418774] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-22T18:46:43.419706] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-22T18:46:43.419794] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-22T18:46:43.485338] [DEBUG] [LOCAL ] FBP: Trimmed 66270 records to 46272 (keeping 200 days of data) [2025-09-22T18:46:43.486852] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T18:46:43.491056] [INFO ] [REMOTE ] FBK: Full fetch complete (32795 records). [2025-09-22T18:46:43.491139] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-22T18:46:43.742678] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-22T18:46:44.003450] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-22T18:46:44.004336] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-22T18:46:44.010389] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-22T18:46:44.010781] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-22T18:46:44.016382] [DEBUG] [LOCAL ] FBK: Trimmed 32795 records to 25489 (keeping 200 days of data) [2025-09-22T18:46:44.228755] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T18:46:44.303160] [DEBUG] [LOCAL ] FBK: Primary data saved (25489 records). [2025-09-22T18:46:44.305798] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-22T18:46:44.306217] [INFO ] [MAIN ] Update Progress: 805/2372 symbols completed. FBK took 27.1s. Estimated remaining: 3h 27m 39s. Rate: 7.5 symbols/min [2025-09-22T18:46:44.489791] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:46:44.522689] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-22T18:46:44.543247] [DEBUG] [LOCAL ] FC: Loaded 15640 existing records from primary storage. [2025-09-22T18:46:44.543932] [INFO ] [MAIN ] FC: Loaded 15640 existing records. [2025-09-22T18:46:44.589400] [DEBUG] [LOCAL ] FBP: Primary data saved (46272 records). [2025-09-22T18:46:44.616610] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-22T18:46:44.622484] [INFO ] [MAIN ] Update Progress: 806/2372 symbols completed. FBP took 25.7s. Estimated remaining: 3h 27m 16s. Rate: 7.6 symbols/min [2025-09-22T18:46:44.877745] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:46:44.904325] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-22T18:46:44.904083] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:46:44.904508] [DEBUG] [LOCAL ] FCF: No existing data file found in primary storage. [2025-09-22T18:46:44.904469] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-22T18:46:44.904581] [WARN ] [MAIN ] FCF: No existing data found, performing full refresh instead. [2025-09-22T18:46:44.904853] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-22T18:46:44.904935] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-22T18:46:44.904996] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-09-22T18:46:44.905031] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-22T18:46:44.938529] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-22T18:46:44.970482] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-22T18:46:45.647706] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:46:45.660522] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:46:45.660894] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-22T18:46:45.692583] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T18:46:46.063012] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T18:46:46.122052] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-22T18:46:46.740538] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-22T18:46:46.922007] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-22T18:46:47.232089] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T18:46:47.722101] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-22T18:46:47.873151] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T18:46:48.522063] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-22T18:46:48.926377] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T18:46:49.322049] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-22T18:46:49.738299] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T18:46:50.122057] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-22T18:46:50.840796] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T18:46:50.922011] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-22T18:46:51.493780] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T18:46:51.722072] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-22T18:46:52.351363] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T18:46:52.522104] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-22T18:46:52.872545] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-22T18:46:53.322113] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-22T18:46:53.651402] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-22T18:46:54.122084] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-22T18:46:54.327565] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T18:46:54.922075] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-22T18:46:55.640899] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T18:46:55.722084] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-22T18:46:56.072092] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-22T18:46:56.522070] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-22T18:46:56.936468] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T18:46:57.322097] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-22T18:46:57.727526] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T18:46:57.732716] [INFO ] [REMOTE ] FBRT: Full fetch complete (48143 records). [2025-09-22T18:46:57.732832] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-22T18:46:58.127546] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-22T18:46:58.128380] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-22T18:46:58.129307] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-22T18:46:58.130161] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-22T18:46:58.130246] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-22T18:46:58.131587] [DEBUG] [LOCAL ] FBRT: Trimmed 48143 records to 34333 (keeping 200 days of data) [2025-09-22T18:46:58.339727] [DEBUG] [LOCAL ] FBRT: Primary data saved (34333 records). [2025-09-22T18:46:58.339979] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-22T18:46:58.340125] [INFO ] [MAIN ] Update Progress: 807/2372 symbols completed. FBRT took 30.3s. Estimated remaining: 3h 27m 20s. Rate: 7.5 symbols/min [2025-09-22T18:46:58.512905] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:46:58.541250] [DEBUG] [LOCAL ] FCN: Loaded 26751 existing records from primary storage. [2025-09-22T18:46:58.541385] [INFO ] [MAIN ] FCN: Loaded 26751 existing records. [2025-09-22T18:46:58.724412] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:46:58.724770] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-22T18:46:58.724828] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-22T18:46:58.725758] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-22T18:46:58.725819] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-22T18:46:58.933860] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-22T18:46:59.095374] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T18:46:59.134718] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:46:59.221567] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T18:46:59.722080] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-22T18:47:00.522074] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-22T18:47:00.783738] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T18:47:00.798553] [INFO ] [REMOTE ] FBIN: Full fetch complete (72615 records). [2025-09-22T18:47:00.798847] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-22T18:47:01.332706] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-22T18:47:01.411467] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T18:47:01.474563] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-22T18:47:01.474814] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-22T18:47:01.476539] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-22T18:47:01.476662] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-22T18:47:01.486992] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T18:47:01.491494] [DEBUG] [LOCAL ] FBIN: Trimmed 72615 records to 50429 (keeping 200 days of data) [2025-09-22T18:47:01.854169] [DEBUG] [LOCAL ] FBIN: Primary data saved (50429 records). [2025-09-22T18:47:01.854407] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-22T18:47:01.854526] [INFO ] [MAIN ] Update Progress: 808/2372 symbols completed. FBIN took 46.2s. Estimated remaining: 3h 27m 3s. Rate: 7.6 symbols/min [2025-09-22T18:47:02.082208] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:47:02.118919] [DEBUG] [LOCAL ] FCPT: Loaded 38112 existing records from primary storage. [2025-09-22T18:47:02.119087] [INFO ] [MAIN ] FCPT: Loaded 38112 existing records. [2025-09-22T18:47:02.130451] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-22T18:47:02.309673] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:47:02.310106] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-22T18:47:02.310182] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-22T18:47:02.311128] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-22T18:47:02.311188] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-22T18:47:02.678963] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:47:02.689841] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T18:47:02.785842] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T18:47:02.922068] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-22T18:47:03.722101] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-22T18:47:04.077525] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T18:47:04.522063] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-22T18:47:04.940214] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T18:47:05.322053] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-22T18:47:05.924947] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T18:47:06.045294] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T18:47:06.122180] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-22T18:47:06.922069] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-22T18:47:07.560432] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T18:47:07.722093] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-22T18:47:07.933359] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-22T18:47:07.936456] [INFO ] [REMOTE ] FC: Full fetch complete (21502 records). [2025-09-22T18:47:07.936535] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-22T18:47:08.303307] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-22T18:47:08.303404] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-22T18:47:08.303899] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-22T18:47:08.303961] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-22T18:47:08.304553] [DEBUG] [LOCAL ] FC: Trimmed 21502 records to 15403 (keeping 200 days of data) [2025-09-22T18:47:08.393426] [DEBUG] [LOCAL ] FC: Primary data saved (15403 records). [2025-09-22T18:47:08.393578] [INFO ] [MAIN ] FC: Full history saved. [2025-09-22T18:47:08.393688] [INFO ] [MAIN ] Update Progress: 809/2372 symbols completed. FC took 24.1s. Estimated remaining: 3h 26m 52s. Rate: 7.6 symbols/min [2025-09-22T18:47:08.532914] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-22T18:47:08.566002] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:47:08.566348] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-22T18:47:08.566404] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-22T18:47:08.566604] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-22T18:47:08.566684] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-22T18:47:08.566746] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-22T18:47:08.566780] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-22T18:47:08.954441] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:47:09.177976] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T18:47:09.184630] [INFO ] [REMOTE ] FCF: Full fetch complete (57974 records). [2025-09-22T18:47:09.184816] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-22T18:47:09.327134] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-22T18:47:09.585966] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-22T18:47:09.586082] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-22T18:47:09.586899] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-22T18:47:09.586966] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-22T18:47:09.588318] [DEBUG] [LOCAL ] FCF: Trimmed 57974 records to 39806 (keeping 200 days of data) [2025-09-22T18:47:09.721278] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T18:47:09.863003] [DEBUG] [LOCAL ] FCF: Primary data saved (39806 records). [2025-09-22T18:47:09.863173] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-22T18:47:09.863258] [INFO ] [MAIN ] Update Progress: 810/2372 symbols completed. FCF took 25.2s. Estimated remaining: 3h 26m 32s. Rate: 7.6 symbols/min [2025-09-22T18:47:10.035273] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:47:10.052086] [DEBUG] [LOCAL ] FCT: Loaded 14568 existing records from primary storage. [2025-09-22T18:47:10.052234] [INFO ] [MAIN ] FCT: Loaded 14568 existing records. [2025-09-22T18:47:10.129040] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-22T18:47:10.238632] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:47:10.238912] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-22T18:47:10.238961] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-22T18:47:10.239458] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-22T18:47:10.239556] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-22T18:47:10.523802] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-22T18:47:10.603842] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:47:10.803124] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T18:47:10.922078] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-22T18:47:11.339263] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T18:47:11.722105] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-22T18:47:12.522071] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-22T18:47:12.770055] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T18:47:13.322076] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-22T18:47:13.387396] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T18:47:14.122055] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-22T18:47:14.573479] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-22T18:47:14.922131] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-22T18:47:15.176451] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T18:47:15.722062] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-22T18:47:16.156131] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T18:47:16.426099] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T18:47:16.522073] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-22T18:47:17.322061] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-22T18:47:17.856028] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T18:47:18.122059] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-22T18:47:18.461109] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T18:47:18.461243] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-22T18:47:18.922054] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-22T18:47:19.722064] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-22T18:47:19.981327] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T18:47:20.522052] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-22T18:47:20.976734] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-22T18:47:21.043017] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T18:47:21.322065] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-22T18:47:22.122060] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-22T18:47:22.459474] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T18:47:22.922072] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-22T18:47:23.395626] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T18:47:23.722094] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-22T18:47:23.830401] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-22T18:47:24.302587] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-22T18:47:24.522146] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-22T18:47:25.326980] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-22T18:47:25.333128] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T18:47:25.651710] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-22T18:47:26.122101] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-22T18:47:26.540025] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-22T18:47:26.922134] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-22T18:47:27.529457] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T18:47:27.722119] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-22T18:47:28.522111] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-22T18:47:28.914358] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T18:47:29.322077] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-22T18:47:29.585737] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T18:47:30.122029] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-22T18:47:30.469042] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-22T18:47:30.490024] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T18:47:30.922059] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-22T18:47:31.722087] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-22T18:47:32.103922] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T18:47:32.107830] [INFO ] [REMOTE ] FCN: Full fetch complete (35576 records). [2025-09-22T18:47:32.107919] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-22T18:47:32.487444] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-22T18:47:32.487583] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-22T18:47:32.488254] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-22T18:47:32.488318] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-22T18:47:32.492085] [DEBUG] [LOCAL ] FCN: Trimmed 35576 records to 26353 (keeping 200 days of data) [2025-09-22T18:47:32.545166] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-22T18:47:32.656935] [DEBUG] [LOCAL ] FCN: Primary data saved (26353 records). [2025-09-22T18:47:32.657082] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-22T18:47:32.657169] [INFO ] [MAIN ] Update Progress: 811/2372 symbols completed. FCN took 34.3s. Estimated remaining: 3h 26m 53s. Rate: 7.5 symbols/min [2025-09-22T18:47:32.834513] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:47:32.853322] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T18:47:32.859798] [INFO ] [REMOTE ] FCPT: Full fetch complete (53218 records). [2025-09-22T18:47:32.859959] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-22T18:47:32.946307] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-22T18:47:33.195385] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-22T18:47:33.201216] [INFO ] [MAIN ] FCX: Loaded 54480 existing records. [2025-09-22T18:47:33.328494] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-22T18:47:33.408761] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-22T18:47:33.413996] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-22T18:47:33.419978] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-22T18:47:33.440268] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-22T18:47:33.483479] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:47:33.484247] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-22T18:47:33.484045] [DEBUG] [LOCAL ] FCPT: Trimmed 53218 records to 37416 (keeping 200 days of data) [2025-09-22T18:47:33.484337] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-22T18:47:33.489010] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-22T18:47:33.489110] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-22T18:47:33.972757] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:47:33.977614] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-22T18:47:33.980256] [INFO ] [REMOTE ] FCRX: Full fetch complete (1634 records). [2025-09-22T18:47:33.980833] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-22T18:47:33.981583] [FATAL] [VALIDATOR ] FCRX: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:47:33.981927] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:47:33.982267] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:47:33.982884] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-22T18:47:33.983428] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-22T18:47:33.983504] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-22T18:47:33.984187] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-22T18:47:33.984590] [INFO ] [MAIN ] Update Progress: 812/2372 symbols completed. FCRX took 25.6s. Estimated remaining: 3h 26m 32s. Rate: 7.6 symbols/min [2025-09-22T18:47:34.131081] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-22T18:47:34.169027] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:47:34.293005] [DEBUG] [LOCAL ] FCPT: Primary data saved (37416 records). [2025-09-22T18:47:34.293248] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-22T18:47:34.293380] [INFO ] [MAIN ] Update Progress: 813/2372 symbols completed. FCPT took 32.4s. Estimated remaining: 3h 26m 9s. Rate: 7.6 symbols/min [2025-09-22T18:47:34.473748] [DEBUG] [LOCAL ] FDP: Loaded 30932 existing records from primary storage. [2025-09-22T18:47:34.489906] [INFO ] [MAIN ] FDP: Loaded 30932 existing records. [2025-09-22T18:47:34.520329] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:47:34.696723] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:47:34.704990] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-22T18:47:34.705124] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-22T18:47:34.705546] [DEBUG] [LOCAL ] FDS: Loaded 26237 existing records from primary storage. [2025-09-22T18:47:34.705762] [INFO ] [MAIN ] FDS: Loaded 26237 existing records. [2025-09-22T18:47:34.737551] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-22T18:47:34.787886] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-22T18:47:34.927243] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-22T18:47:35.039960] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:47:35.051160] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-22T18:47:35.056361] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-22T18:47:35.086526] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-22T18:47:35.101436] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-22T18:47:35.569552] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:47:35.690613] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:47:35.722020] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-22T18:47:35.873306] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T18:47:36.010877] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T18:47:36.522078] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-22T18:47:36.878881] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T18:47:37.322108] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-22T18:47:38.122102] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-22T18:47:38.506266] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T18:47:38.662760] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-22T18:47:38.922100] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-22T18:47:39.383006] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T18:47:39.722074] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-22T18:47:40.266682] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T18:47:40.522092] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-22T18:47:40.897914] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T18:47:41.322069] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-22T18:47:41.448453] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T18:47:42.122114] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-22T18:47:42.922133] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-22T18:47:43.077194] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T18:47:43.232836] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-22T18:47:43.722053] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-22T18:47:44.168789] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-22T18:47:44.522061] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-22T18:47:45.322082] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-22T18:47:45.450825] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T18:47:45.511784] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-22T18:47:46.122065] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-22T18:47:46.621503] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T18:47:46.855782] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-22T18:47:46.922007] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-22T18:47:47.722068] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-22T18:47:48.319242] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T18:47:48.522088] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-22T18:47:48.741916] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-22T18:47:48.745061] [INFO ] [REMOTE ] FCT: Full fetch complete (21215 records). [2025-09-22T18:47:48.745151] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-22T18:47:49.122240] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-22T18:47:49.122390] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-22T18:47:49.122957] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-22T18:47:49.123024] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-22T18:47:49.123934] [DEBUG] [LOCAL ] FCT: Trimmed 21215 records to 14298 (keeping 200 days of data) [2025-09-22T18:47:49.217770] [DEBUG] [LOCAL ] FCT: Primary data saved (14298 records). [2025-09-22T18:47:49.217933] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-22T18:47:49.218024] [INFO ] [MAIN ] Update Progress: 814/2372 symbols completed. FCT took 39.4s. Estimated remaining: 3h 26m 15s. Rate: 7.6 symbols/min [2025-09-22T18:47:49.327200] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-22T18:47:49.400289] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:47:49.473864] [DEBUG] [LOCAL ] FDX: Loaded 52338 existing records from primary storage. [2025-09-22T18:47:49.474087] [INFO ] [MAIN ] FDX: Loaded 52338 existing records. [2025-09-22T18:47:49.660414] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:47:49.660858] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-22T18:47:49.660933] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-22T18:47:49.662471] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-22T18:47:49.662545] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-22T18:47:50.034705] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:47:50.122034] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-22T18:47:50.374188] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T18:47:50.725199] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-22T18:47:50.922063] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-22T18:47:51.722023] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-22T18:47:51.743242] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T18:47:52.028782] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T18:47:52.522059] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-22T18:47:53.322083] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-22T18:47:53.670786] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-22T18:47:53.723121] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-22T18:47:54.122041] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-22T18:47:54.479851] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T18:47:54.922059] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-22T18:47:55.722029] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-22T18:47:56.213689] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-22T18:47:56.522106] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-22T18:47:56.667053] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T18:47:56.760616] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T18:47:57.322059] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-22T18:47:57.541023] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T18:47:58.122060] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-22T18:47:58.581002] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T18:47:58.922055] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-22T18:47:59.527468] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T18:47:59.722051] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-22T18:48:00.295619] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T18:48:00.522095] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-22T18:48:01.322066] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-22T18:48:01.735154] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-22T18:48:02.122086] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-22T18:48:02.395332] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T18:48:02.401880] [INFO ] [REMOTE ] FDS: Full fetch complete (36542 records). [2025-09-22T18:48:02.402063] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-22T18:48:02.822142] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-22T18:48:02.822248] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-22T18:48:02.822951] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-22T18:48:02.823055] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-22T18:48:02.824166] [DEBUG] [LOCAL ] FDS: Trimmed 36542 records to 25991 (keeping 200 days of data) [2025-09-22T18:48:02.933755] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-22T18:48:03.013022] [DEBUG] [LOCAL ] FDS: Primary data saved (25991 records). [2025-09-22T18:48:03.013257] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-22T18:48:03.013480] [INFO ] [MAIN ] Update Progress: 815/2372 symbols completed. FDS took 28.7s. Estimated remaining: 3h 26m 18s. Rate: 7.5 symbols/min [2025-09-22T18:48:03.195440] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:48:03.262131] [DEBUG] [LOCAL ] FE: Loaded 54219 existing records from primary storage. [2025-09-22T18:48:03.262280] [INFO ] [MAIN ] FE: Loaded 54219 existing records. [2025-09-22T18:48:03.448363] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:48:03.448624] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-22T18:48:03.448704] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-22T18:48:03.450324] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-22T18:48:03.450394] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-22T18:48:03.808788] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:48:03.809125] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-22T18:48:04.320142] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (3.00 seconds). [2025-09-22T18:48:04.522070] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-22T18:48:05.236432] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (3.11 seconds). [2025-09-22T18:48:05.322011] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-22T18:48:05.693159] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T18:48:05.727127] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T18:48:05.737463] [INFO ] [REMOTE ] FDP: Full fetch complete (42750 records). [2025-09-22T18:48:05.737716] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-22T18:48:05.863288] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-22T18:48:06.127221] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-22T18:48:06.194994] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-22T18:48:06.195228] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-22T18:48:06.195941] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-22T18:48:06.196023] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-22T18:48:06.197536] [DEBUG] [LOCAL ] FDP: Trimmed 42750 records to 30411 (keeping 200 days of data) [2025-09-22T18:48:06.397287] [DEBUG] [LOCAL ] FDP: Primary data saved (30411 records). [2025-09-22T18:48:06.397436] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-22T18:48:06.397579] [INFO ] [MAIN ] Update Progress: 816/2372 symbols completed. FDP took 32.4s. Estimated remaining: 3h 26m 1s. Rate: 7.6 symbols/min [2025-09-22T18:48:06.565761] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:48:06.565968] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-22T18:48:06.566025] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-22T18:48:06.566173] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-22T18:48:06.566219] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-22T18:48:06.566262] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-22T18:48:06.566307] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-22T18:48:06.921753] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:48:06.922225] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-22T18:48:07.278015] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-22T18:48:07.386959] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-22T18:48:07.722054] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-22T18:48:07.959622] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T18:48:08.522066] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-22T18:48:09.322061] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-22T18:48:09.749982] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-22T18:48:09.759609] [INFO ] [REMOTE ] FCX: Full fetch complete (77739 records). [2025-09-22T18:48:09.759827] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-22T18:48:10.132101] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-22T18:48:10.174144] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T18:48:10.217386] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-22T18:48:10.217488] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-22T18:48:10.218598] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-22T18:48:10.218726] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-22T18:48:10.222251] [DEBUG] [LOCAL ] FCX: Trimmed 77739 records to 53700 (keeping 200 days of data) [2025-09-22T18:48:10.592636] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-09-22T18:48:10.593048] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-22T18:48:10.593226] [INFO ] [MAIN ] Update Progress: 817/2372 symbols completed. FCX took 37.9s. Estimated remaining: 3h 25m 46s. Rate: 7.6 symbols/min [2025-09-22T18:48:10.699946] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T18:48:10.778141] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:48:10.831465] [DEBUG] [LOCAL ] FERG: Loaded 49797 existing records from primary storage. [2025-09-22T18:48:10.831622] [INFO ] [MAIN ] FERG: Loaded 49797 existing records. [2025-09-22T18:48:10.927239] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-22T18:48:11.018309] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:48:11.018598] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-22T18:48:11.018669] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-22T18:48:11.020046] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-22T18:48:11.020114] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-22T18:48:11.391433] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:48:11.430444] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-22T18:48:11.722058] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-22T18:48:12.472829] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T18:48:12.522071] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-22T18:48:12.964956] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T18:48:13.312510] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T18:48:13.322947] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-22T18:48:13.906255] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-22T18:48:14.122133] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-22T18:48:14.922078] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-22T18:48:15.672811] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T18:48:15.722074] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-22T18:48:16.522098] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-22T18:48:17.285612] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-22T18:48:17.322015] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-22T18:48:17.364723] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T18:48:17.790979] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T18:48:18.122077] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-22T18:48:18.913043] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T18:48:18.923874] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-22T18:48:19.344279] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T18:48:19.722082] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-22T18:48:19.933943] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T18:48:20.019843] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-22T18:48:20.522095] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-22T18:48:21.322087] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-22T18:48:21.736446] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-22T18:48:21.908680] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T18:48:22.122077] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-22T18:48:22.473170] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-22T18:48:22.922059] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-22T18:48:23.529990] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T18:48:23.530937] [INFO ] [REMOTE ] FENG: Full fetch complete (2119 records). [2025-09-22T18:48:23.531026] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-22T18:48:23.709339] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T18:48:23.709546] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:48:23.709659] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:48:23.709739] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-22T18:48:23.709809] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-22T18:48:23.709858] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-22T18:48:23.709924] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-22T18:48:23.709996] [INFO ] [MAIN ] Update Progress: 818/2372 symbols completed. FENG took 17.3s. Estimated remaining: 3h 25m 48s. Rate: 7.6 symbols/min [2025-09-22T18:48:23.727236] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-22T18:48:23.886623] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:48:23.903590] [DEBUG] [LOCAL ] FET: Loaded 12925 existing records from primary storage. [2025-09-22T18:48:23.903725] [INFO ] [MAIN ] FET: Loaded 12925 existing records. [2025-09-22T18:48:24.087536] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:48:24.088881] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-22T18:48:24.088937] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-22T18:48:24.089852] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-22T18:48:24.089923] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-22T18:48:24.452238] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:48:24.522129] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-22T18:48:25.322051] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-22T18:48:25.589788] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-22T18:48:26.000679] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T18:48:26.122041] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-22T18:48:26.922050] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-22T18:48:27.191927] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-22T18:48:27.722112] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-22T18:48:28.015609] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T18:48:28.455237] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T18:48:28.522006] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-22T18:48:28.674779] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-22T18:48:29.322080] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-22T18:48:30.122106] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-22T18:48:30.380759] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T18:48:30.922110] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-22T18:48:31.264745] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-22T18:48:31.272901] [INFO ] [REMOTE ] FDX: Full fetch complete (74422 records). [2025-09-22T18:48:31.273052] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-22T18:48:31.673306] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-22T18:48:31.673471] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-22T18:48:31.674451] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-22T18:48:31.674518] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-22T18:48:31.676107] [DEBUG] [LOCAL ] FDX: Trimmed 74422 records to 51613 (keeping 200 days of data) [2025-09-22T18:48:31.741340] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-22T18:48:31.959992] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T18:48:32.075293] [DEBUG] [LOCAL ] FDX: Primary data saved (51613 records). [2025-09-22T18:48:32.075445] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-22T18:48:32.077282] [INFO ] [MAIN ] Update Progress: 819/2372 symbols completed. FDX took 42.9s. Estimated remaining: 3h 25m 41s. Rate: 7.6 symbols/min [2025-09-22T18:48:32.276997] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:48:32.306220] [DEBUG] [LOCAL ] FF: Loaded 26197 existing records from primary storage. [2025-09-22T18:48:32.306391] [INFO ] [MAIN ] FF: Loaded 26197 existing records. [2025-09-22T18:48:32.492348] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:48:32.492594] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-22T18:48:32.492677] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-22T18:48:32.493452] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-22T18:48:32.493514] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-22T18:48:32.527237] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-22T18:48:32.768733] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-22T18:48:32.875759] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:48:32.898162] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-22T18:48:32.910098] [INFO ] [REMOTE ] FE: Full fetch complete (77183 records). [2025-09-22T18:48:32.910269] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-22T18:48:33.302631] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-22T18:48:33.302770] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-22T18:48:33.303707] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-22T18:48:33.303776] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-22T18:48:33.305595] [DEBUG] [LOCAL ] FE: Trimmed 77183 records to 53438 (keeping 200 days of data) [2025-09-22T18:48:33.363514] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-22T18:48:33.632579] [DEBUG] [LOCAL ] FE: Primary data saved (53438 records). [2025-09-22T18:48:33.632777] [INFO ] [MAIN ] FE: Full history saved. [2025-09-22T18:48:33.632906] [INFO ] [MAIN ] Update Progress: 820/2372 symbols completed. FE took 30.6s. Estimated remaining: 3h 25m 21s. Rate: 7.6 symbols/min [2025-09-22T18:48:33.805867] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:48:33.813515] [DEBUG] [LOCAL ] FFA: Loaded 5687 existing records from primary storage. [2025-09-22T18:48:33.813619] [INFO ] [MAIN ] FFA: Loaded 5687 existing records. [2025-09-22T18:48:33.995023] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:48:33.995275] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-22T18:48:33.995336] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-22T18:48:33.995635] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-22T18:48:33.995729] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-22T18:48:34.127264] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-22T18:48:34.418585] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T18:48:34.451839] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:48:34.489320] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T18:48:34.922114] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-22T18:48:35.348530] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T18:48:35.722080] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-22T18:48:36.369587] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T18:48:36.392608] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T18:48:36.522081] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-22T18:48:37.322088] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-22T18:48:37.980351] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-22T18:48:38.122086] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-22T18:48:38.149544] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T18:48:38.922038] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-22T18:48:39.316049] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T18:48:39.722078] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-22T18:48:39.866214] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T18:48:40.266482] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-22T18:48:40.522069] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-22T18:48:41.077860] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T18:48:41.322056] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-22T18:48:42.122038] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-22T18:48:42.475248] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T18:48:42.922046] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-22T18:48:43.646993] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T18:48:43.722062] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-22T18:48:43.839438] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T18:48:43.847809] [INFO ] [REMOTE ] FERG: Full fetch complete (71036 records). [2025-09-22T18:48:43.847971] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-22T18:48:44.253304] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-22T18:48:44.253466] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-22T18:48:44.254482] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-22T18:48:44.254571] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-22T18:48:44.256344] [DEBUG] [LOCAL ] FERG: Trimmed 71036 records to 49036 (keeping 200 days of data) [2025-09-22T18:48:44.533396] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-22T18:48:44.566525] [DEBUG] [LOCAL ] FERG: Primary data saved (49036 records). [2025-09-22T18:48:44.566698] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-22T18:48:44.566799] [INFO ] [MAIN ] Update Progress: 821/2372 symbols completed. FERG took 34.0s. Estimated remaining: 3h 25m 19s. Rate: 7.6 symbols/min [2025-09-22T18:48:44.740256] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:48:44.758057] [DEBUG] [LOCAL ] FFC: Loaded 16868 existing records from primary storage. [2025-09-22T18:48:44.758184] [INFO ] [MAIN ] FFC: Loaded 16868 existing records. [2025-09-22T18:48:44.936364] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:48:44.936629] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-22T18:48:44.936712] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-22T18:48:44.937330] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-22T18:48:44.937392] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-22T18:48:45.068911] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-22T18:48:45.322177] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:48:45.340536] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-22T18:48:45.343704] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T18:48:46.122079] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-22T18:48:46.172849] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T18:48:46.922042] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-22T18:48:47.183976] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T18:48:47.494030] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-22T18:48:47.722049] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-22T18:48:48.522082] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-22T18:48:48.949012] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T18:48:49.322055] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-22T18:48:49.466404] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-22T18:48:49.958243] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T18:48:50.122055] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-22T18:48:50.922024] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-22T18:48:51.136819] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-22T18:48:51.139848] [INFO ] [REMOTE ] FET: Full fetch complete (18072 records). [2025-09-22T18:48:51.139936] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-22T18:48:51.521364] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-22T18:48:51.521443] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-22T18:48:51.521894] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-22T18:48:51.521956] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-22T18:48:51.522587] [DEBUG] [LOCAL ] FET: Trimmed 18072 records to 12626 (keeping 200 days of data) [2025-09-22T18:48:51.600074] [DEBUG] [LOCAL ] FET: Primary data saved (12626 records). [2025-09-22T18:48:51.600282] [INFO ] [MAIN ] FET: Full history saved. [2025-09-22T18:48:51.600387] [INFO ] [MAIN ] Update Progress: 822/2372 symbols completed. FET took 27.9s. Estimated remaining: 3h 25m 9s. Rate: 7.6 symbols/min [2025-09-22T18:48:51.727122] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-22T18:48:51.779143] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:48:51.791739] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T18:48:51.837859] [DEBUG] [LOCAL ] FFWM: Loaded 36810 existing records from primary storage. [2025-09-22T18:48:51.838033] [INFO ] [MAIN ] FFWM: Loaded 36810 existing records. [2025-09-22T18:48:52.014233] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:48:52.014516] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-22T18:48:52.014566] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-22T18:48:52.015431] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-22T18:48:52.015490] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-22T18:48:52.368938] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:48:52.522054] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-22T18:48:53.002813] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T18:48:53.106285] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T18:48:53.322055] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-22T18:48:53.993163] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-22T18:48:54.122052] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-22T18:48:54.708719] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-22T18:48:54.922050] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-22T18:48:55.722023] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-22T18:48:55.997821] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T18:48:56.108961] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-22T18:48:56.522064] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-22T18:48:57.219366] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-22T18:48:57.220920] [INFO ] [REMOTE ] FFA: Full fetch complete (8157 records). [2025-09-22T18:48:57.221009] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-22T18:48:57.324282] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-22T18:48:57.588197] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-22T18:48:57.588303] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-22T18:48:57.588555] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-22T18:48:57.588597] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-22T18:48:57.589059] [DEBUG] [LOCAL ] FFA: Trimmed 8157 records to 5609 (keeping 200 days of data) [2025-09-22T18:48:57.624590] [DEBUG] [LOCAL ] FFA: Primary data saved (5609 records). [2025-09-22T18:48:57.624741] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-22T18:48:57.624839] [INFO ] [MAIN ] Update Progress: 823/2372 symbols completed. FFA took 24.0s. Estimated remaining: 3h 24m 58s. Rate: 7.6 symbols/min [2025-09-22T18:48:57.810080] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:48:57.833772] [DEBUG] [LOCAL ] FG: Loaded 22587 existing records from primary storage. [2025-09-22T18:48:57.833913] [INFO ] [MAIN ] FG: Loaded 22587 existing records. [2025-09-22T18:48:58.015995] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:48:58.016314] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-22T18:48:58.016373] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-22T18:48:58.017148] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-22T18:48:58.017210] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-22T18:48:58.124444] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-22T18:48:58.387199] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:48:58.402503] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T18:48:58.922062] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-22T18:48:59.066769] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T18:48:59.722033] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-22T18:48:59.928118] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T18:49:00.522093] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-22T18:49:01.074575] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T18:49:01.322080] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-22T18:49:01.381085] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T18:49:02.122107] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-22T18:49:02.204436] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T18:49:02.922057] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-22T18:49:03.011356] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T18:49:03.722026] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-22T18:49:03.969805] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T18:49:04.522058] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-22T18:49:04.558727] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T18:49:05.322073] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-22T18:49:05.596538] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T18:49:06.122071] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-22T18:49:06.748935] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T18:49:06.805544] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T18:49:06.922104] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-22T18:49:07.589332] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T18:49:07.722163] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-22T18:49:08.522157] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-22T18:49:08.698472] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T18:49:09.290882] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T18:49:09.294933] [INFO ] [REMOTE ] FF: Full fetch complete (37238 records). [2025-09-22T18:49:09.295073] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-22T18:49:09.329569] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-22T18:49:09.744212] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-22T18:49:09.744314] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-22T18:49:09.744972] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-22T18:49:09.745037] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-22T18:49:09.745989] [DEBUG] [LOCAL ] FF: Trimmed 37238 records to 25726 (keeping 200 days of data) [2025-09-22T18:49:09.906798] [DEBUG] [LOCAL ] FF: Primary data saved (25726 records). [2025-09-22T18:49:09.906968] [INFO ] [MAIN ] FF: Full history saved. [2025-09-22T18:49:09.907064] [INFO ] [MAIN ] Update Progress: 824/2372 symbols completed. FF took 37.8s. Estimated remaining: 3h 24m 58s. Rate: 7.6 symbols/min [2025-09-22T18:49:10.078408] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:49:10.083999] [DEBUG] [LOCAL ] FGN: Loaded 4085 existing records from primary storage. [2025-09-22T18:49:10.084083] [INFO ] [MAIN ] FGN: Loaded 4085 existing records. [2025-09-22T18:49:10.127581] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-22T18:49:10.274939] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:49:10.275205] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-22T18:49:10.275258] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-22T18:49:10.275521] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-22T18:49:10.275583] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-22T18:49:10.638992] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:49:10.687618] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T18:49:10.922033] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-22T18:49:11.609109] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T18:49:11.722034] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-22T18:49:12.060320] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T18:49:12.522117] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-22T18:49:12.751186] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T18:49:13.249170] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T18:49:13.322070] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-22T18:49:14.122068] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-22T18:49:14.372295] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T18:49:14.691080] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T18:49:14.922044] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-22T18:49:15.597041] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T18:49:15.722067] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-22T18:49:16.522043] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-22T18:49:16.746915] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T18:49:16.992411] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-22T18:49:17.322057] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-22T18:49:18.122062] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-22T18:49:18.709341] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T18:49:18.922050] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-22T18:49:19.180488] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T18:49:19.722075] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-22T18:49:19.905001] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T18:49:20.321358] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-22T18:49:20.522126] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-22T18:49:21.322058] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-22T18:49:21.461561] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T18:49:21.464698] [INFO ] [REMOTE ] FFC: Full fetch complete (24722 records). [2025-09-22T18:49:21.464798] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-22T18:49:21.850460] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-22T18:49:21.850624] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-22T18:49:21.851156] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-22T18:49:21.851205] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-22T18:49:21.851972] [DEBUG] [LOCAL ] FFC: Trimmed 24722 records to 16591 (keeping 200 days of data) [2025-09-22T18:49:21.956117] [DEBUG] [LOCAL ] FFC: Primary data saved (16591 records). [2025-09-22T18:49:21.956272] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-22T18:49:21.956360] [INFO ] [MAIN ] Update Progress: 825/2372 symbols completed. FFC took 37.4s. Estimated remaining: 3h 24m 58s. Rate: 7.5 symbols/min [2025-09-22T18:49:22.124774] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:49:22.124845] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-22T18:49:22.125936] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-22T18:49:22.125989] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-22T18:49:22.126101] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-22T18:49:22.126139] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-22T18:49:22.126180] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-22T18:49:22.126211] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-22T18:49:22.483455] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:49:22.545913] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T18:49:22.549475] [INFO ] [REMOTE ] FG: Full fetch complete (27064 records). [2025-09-22T18:49:22.549561] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-22T18:49:22.924558] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-22T18:49:22.924742] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-22T18:49:22.924870] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-22T18:49:22.925462] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-22T18:49:22.925540] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-22T18:49:22.927068] [DEBUG] [LOCAL ] FG: Trimmed 27064 records to 22417 (keeping 200 days of data) [2025-09-22T18:49:23.067914] [DEBUG] [LOCAL ] FG: Primary data saved (22417 records). [2025-09-22T18:49:23.068046] [INFO ] [MAIN ] FG: Full history saved. [2025-09-22T18:49:23.068130] [INFO ] [MAIN ] Update Progress: 826/2372 symbols completed. FG took 25.4s. Estimated remaining: 3h 24m 37s. Rate: 7.6 symbols/min [2025-09-22T18:49:23.237393] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:49:23.281757] [DEBUG] [LOCAL ] FHI: Loaded 41458 existing records from primary storage. [2025-09-22T18:49:23.281932] [INFO ] [MAIN ] FHI: Loaded 41458 existing records. [2025-09-22T18:49:23.465874] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:49:23.466448] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-22T18:49:23.466510] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-22T18:49:23.473149] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-22T18:49:23.484574] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-22T18:49:23.491191] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T18:49:23.608962] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-22T18:49:23.727329] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-22T18:49:23.881191] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:49:23.988848] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:49:23.989176] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-22T18:49:24.522087] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-22T18:49:25.322056] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-22T18:49:25.872749] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T18:49:26.101406] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T18:49:26.122059] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-22T18:49:26.922047] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-22T18:49:27.357891] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T18:49:27.580366] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T18:49:27.722038] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-22T18:49:28.522062] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-22T18:49:29.020460] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-22T18:49:29.107932] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T18:49:29.322056] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-22T18:49:30.122061] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-22T18:49:30.326832] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-22T18:49:30.333869] [INFO ] [REMOTE ] FFWM: Full fetch complete (51709 records). [2025-09-22T18:49:30.333984] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-22T18:49:30.755487] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-22T18:49:30.755570] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-22T18:49:30.756402] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-22T18:49:30.756471] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-22T18:49:30.757690] [DEBUG] [LOCAL ] FFWM: Trimmed 51709 records to 36236 (keeping 200 days of data) [2025-09-22T18:49:30.936040] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-22T18:49:30.965505] [DEBUG] [LOCAL ] FFWM: Primary data saved (36236 records). [2025-09-22T18:49:30.965666] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-22T18:49:30.965777] [INFO ] [MAIN ] Update Progress: 827/2372 symbols completed. FFWM took 39.4s. Estimated remaining: 3h 24m 29s. Rate: 7.6 symbols/min [2025-09-22T18:49:31.142820] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:49:31.197025] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-22T18:49:31.197172] [INFO ] [MAIN ] FHN: Loaded 54148 existing records. [2025-09-22T18:49:31.378682] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:49:31.378949] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-22T18:49:31.378997] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-22T18:49:31.380556] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-22T18:49:31.380617] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-22T18:49:31.723695] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-22T18:49:31.753875] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T18:49:31.752525] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:49:31.782589] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T18:49:32.337324] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T18:49:32.522063] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-22T18:49:33.322073] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-22T18:49:34.122166] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-22T18:49:34.306838] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T18:49:34.376617] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-22T18:49:34.841315] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-22T18:49:34.922047] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-22T18:49:35.525330] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-22T18:49:35.722070] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-22T18:49:36.522168] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-22T18:49:37.330493] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-22T18:49:37.336685] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T18:49:37.725139] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T18:49:37.872295] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-22T18:49:38.122082] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-22T18:49:38.922063] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-22T18:49:39.695073] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T18:49:39.695942] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T18:49:39.722017] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-22T18:49:40.522101] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-22T18:49:41.265138] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T18:49:41.322027] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-22T18:49:41.713502] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T18:49:42.122067] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-22T18:49:42.669542] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T18:49:42.764261] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T18:49:42.922076] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-22T18:49:43.484452] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T18:49:43.485548] [INFO ] [REMOTE ] FGN: Full fetch complete (5769 records). [2025-09-22T18:49:43.485620] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-22T18:49:43.727248] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-22T18:49:43.852494] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-22T18:49:43.852570] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-22T18:49:43.852746] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-22T18:49:43.852807] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-22T18:49:43.853189] [DEBUG] [LOCAL ] FGN: Trimmed 5769 records to 3942 (keeping 200 days of data) [2025-09-22T18:49:43.877806] [DEBUG] [LOCAL ] FGN: Primary data saved (3942 records). [2025-09-22T18:49:43.877882] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-22T18:49:43.877960] [INFO ] [MAIN ] Update Progress: 828/2372 symbols completed. FGN took 34.0s. Estimated remaining: 3h 24m 30s. Rate: 7.6 symbols/min [2025-09-22T18:49:44.062451] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:49:44.121109] [DEBUG] [LOCAL ] FI: Loaded 54278 existing records from primary storage. [2025-09-22T18:49:44.121253] [INFO ] [MAIN ] FI: Loaded 54278 existing records. [2025-09-22T18:49:44.306927] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:49:44.307273] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-22T18:49:44.307980] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-22T18:49:44.309413] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-22T18:49:44.309480] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-22T18:49:44.432248] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T18:49:44.530811] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-22T18:49:44.682949] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:49:45.176460] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-22T18:49:45.322015] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-22T18:49:46.122055] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-22T18:49:46.922057] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-22T18:49:47.151497] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T18:49:47.560795] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T18:49:47.562301] [INFO ] [REMOTE ] FGSN: Full fetch complete (7500 records). [2025-09-22T18:49:47.562387] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-22T18:49:47.723188] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-22T18:49:47.755410] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-22T18:49:47.756548] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:49:47.756687] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:49:47.756765] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-22T18:49:47.756972] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-22T18:49:47.757078] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-22T18:49:47.757147] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-22T18:49:47.757231] [INFO ] [MAIN ] Update Progress: 829/2372 symbols completed. FGSN took 25.8s. Estimated remaining: 3h 24m 15s. Rate: 7.6 symbols/min [2025-09-22T18:49:47.938847] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:49:47.969909] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T18:49:48.000635] [DEBUG] [LOCAL ] FICO: Loaded 20784 existing records from primary storage. [2025-09-22T18:49:48.000828] [INFO ] [MAIN ] FICO: Loaded 20784 existing records. [2025-09-22T18:49:48.185216] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:49:48.185450] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-22T18:49:48.185497] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-22T18:49:48.186318] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-22T18:49:48.186379] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-22T18:49:48.527525] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-22T18:49:48.550072] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:49:49.256029] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T18:49:49.322023] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-22T18:49:50.122089] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-22T18:49:50.362323] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T18:49:50.786010] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T18:49:50.922060] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-22T18:49:51.099913] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T18:49:51.722064] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-22T18:49:52.126053] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T18:49:52.132684] [INFO ] [REMOTE ] FHI: Full fetch complete (57829 records). [2025-09-22T18:49:52.132853] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-22T18:49:52.524410] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-22T18:49:52.539564] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-22T18:49:52.539669] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-22T18:49:52.540452] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-22T18:49:52.540498] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-22T18:49:52.541965] [DEBUG] [LOCAL ] FHI: Trimmed 57829 records to 40812 (keeping 200 days of data) [2025-09-22T18:49:52.817670] [DEBUG] [LOCAL ] FHI: Primary data saved (40812 records). [2025-09-22T18:49:52.817809] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-22T18:49:52.817893] [INFO ] [MAIN ] Update Progress: 830/2372 symbols completed. FHI took 29.7s. Estimated remaining: 3h 24m 1s. Rate: 7.6 symbols/min [2025-09-22T18:49:52.988369] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:49:52.988593] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-22T18:49:52.988669] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-22T18:49:52.988818] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-22T18:49:52.988861] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-22T18:49:52.988902] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-22T18:49:52.988934] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-22T18:49:53.332675] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-22T18:49:53.350933] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:49:53.381774] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T18:49:53.719908] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-22T18:49:54.122052] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-22T18:49:54.846263] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T18:49:54.922037] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-22T18:49:55.723693] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T18:49:55.722130] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-22T18:49:56.025894] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-22T18:49:56.039959] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T18:49:56.522054] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-22T18:49:57.322051] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-22T18:49:57.543036] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-09-22T18:49:58.122047] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-22T18:49:58.181254] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T18:49:58.922074] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-22T18:49:59.072798] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T18:49:59.722113] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-22T18:49:59.963781] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-22T18:50:00.447348] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T18:50:00.522120] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-22T18:50:01.322089] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-22T18:50:02.122075] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-22T18:50:02.379594] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T18:50:02.640900] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-22T18:50:02.922086] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-22T18:50:03.529366] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T18:50:03.722056] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-22T18:50:04.011948] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-22T18:50:04.522108] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-22T18:50:04.867039] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-22T18:50:04.958627] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-22T18:50:05.322053] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-22T18:50:06.122089] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-22T18:50:06.459465] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-22T18:50:06.667328] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T18:50:06.922053] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-22T18:50:07.722089] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-22T18:50:07.873265] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T18:50:08.522063] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-22T18:50:08.741142] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:50:08.741462] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-22T18:50:09.322052] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-22T18:50:09.807750] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-22T18:50:09.846025] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-22T18:50:10.122100] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-22T18:50:10.922075] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-22T18:50:11.722061] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-22T18:50:12.226738] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-22T18:50:12.522060] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-22T18:50:13.125007] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T18:50:13.322078] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-22T18:50:13.643992] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-22T18:50:14.122009] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-22T18:50:14.614417] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-22T18:50:14.623319] [INFO ] [REMOTE ] FI: Full fetch complete (77160 records). [2025-09-22T18:50:14.623465] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-22T18:50:14.931725] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-22T18:50:15.051395] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-22T18:50:15.051504] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-22T18:50:15.052426] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-22T18:50:15.052494] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-22T18:50:15.055634] [DEBUG] [LOCAL ] FI: Trimmed 77160 records to 53506 (keeping 200 days of data) [2025-09-22T18:50:15.379749] [DEBUG] [LOCAL ] FI: Primary data saved (53506 records). [2025-09-22T18:50:15.379976] [INFO ] [MAIN ] FI: Full history saved. [2025-09-22T18:50:15.380135] [INFO ] [MAIN ] Update Progress: 831/2372 symbols completed. FI took 31.5s. Estimated remaining: 3h 24m 20s. Rate: 7.5 symbols/min [2025-09-22T18:50:15.567196] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:50:15.607237] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-22T18:50:15.618038] [INFO ] [REMOTE ] FHN: Full fetch complete (77271 records). [2025-09-22T18:50:15.618220] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-22T18:50:15.922458] [DEBUG] [LOCAL ] FIGS: Loaded 49796 existing records from primary storage. [2025-09-22T18:50:15.937330] [INFO ] [MAIN ] FIGS: Loaded 49796 existing records. [2025-09-22T18:50:16.272066] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:50:16.271767] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-22T18:50:16.272895] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-22T18:50:16.272482] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-22T18:50:16.274196] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-22T18:50:16.274303] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-22T18:50:16.274708] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-22T18:50:16.286198] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-22T18:50:16.288317] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-22T18:50:16.295280] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T18:50:16.333872] [DEBUG] [LOCAL ] FHN: Trimmed 77271 records to 53369 (keeping 200 days of data) [2025-09-22T18:50:16.363729] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-22T18:50:16.796704] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:50:16.798491] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-22T18:50:17.041290] [DEBUG] [LOCAL ] FHN: Primary data saved (53369 records). [2025-09-22T18:50:17.041698] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-22T18:50:17.042061] [INFO ] [MAIN ] Update Progress: 832/2372 symbols completed. FHN took 46.1s. Estimated remaining: 3h 24m 1s. Rate: 7.5 symbols/min [2025-09-22T18:50:17.232597] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:50:17.279768] [DEBUG] [LOCAL ] FIHL: Loaded 41125 existing records from primary storage. [2025-09-22T18:50:17.279924] [INFO ] [MAIN ] FIHL: Loaded 41125 existing records. [2025-09-22T18:50:17.474097] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:50:17.474360] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-22T18:50:17.474409] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-22T18:50:17.475402] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-22T18:50:17.475475] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-22T18:50:17.886039] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:50:17.886441] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-22T18:50:17.932695] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (3.81 seconds). [2025-09-22T18:50:17.953041] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T18:50:17.953269] [INFO ] [REMOTE ] FIG: Full fetch complete (14637 records). [2025-09-22T18:50:17.959800] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-22T18:50:18.127210] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-22T18:50:18.204184] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-22T18:50:18.204534] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:50:18.204630] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:50:18.204746] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-22T18:50:18.204829] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-22T18:50:18.204879] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-22T18:50:18.204987] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-22T18:50:18.205098] [INFO ] [MAIN ] Update Progress: 833/2372 symbols completed. FIG took 25.4s. Estimated remaining: 3h 23m 40s. Rate: 7.6 symbols/min [2025-09-22T18:50:18.385562] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:50:18.403072] [DEBUG] [LOCAL ] FINS: Loaded 8288 existing records from primary storage. [2025-09-22T18:50:18.403214] [INFO ] [MAIN ] FINS: Loaded 8288 existing records. [2025-09-22T18:50:18.592012] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:50:18.592449] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-22T18:50:18.593199] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-22T18:50:18.593972] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-22T18:50:18.594160] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-22T18:50:18.785969] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-22T18:50:18.927742] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-22T18:50:19.017383] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:50:19.228105] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T18:50:19.300732] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T18:50:19.722101] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-22T18:50:20.393445] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T18:50:20.522068] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-22T18:50:20.661062] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T18:50:21.322113] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-22T18:50:21.939995] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T18:50:22.122030] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-22T18:50:22.160149] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T18:50:22.922066] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-22T18:50:23.410812] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T18:50:23.417101] [INFO ] [REMOTE ] FICO: Full fetch complete (28328 records). [2025-09-22T18:50:23.417392] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-22T18:50:23.727253] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-22T18:50:23.803354] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-22T18:50:23.803434] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-22T18:50:23.804028] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-22T18:50:23.804115] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-22T18:50:23.804926] [DEBUG] [LOCAL ] FICO: Trimmed 28328 records to 20499 (keeping 200 days of data) [2025-09-22T18:50:23.950515] [DEBUG] [LOCAL ] FICO: Primary data saved (20499 records). [2025-09-22T18:50:23.950669] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-22T18:50:23.950825] [INFO ] [MAIN ] Update Progress: 834/2372 symbols completed. FICO took 36.2s. Estimated remaining: 3h 23m 28s. Rate: 7.6 symbols/min [2025-09-22T18:50:24.122223] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:50:24.174483] [DEBUG] [LOCAL ] FINV: Loaded 45658 existing records from primary storage. [2025-09-22T18:50:24.174846] [INFO ] [MAIN ] FINV: Loaded 45658 existing records. [2025-09-22T18:50:24.372170] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:50:24.372444] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-22T18:50:24.372494] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-22T18:50:24.374029] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-22T18:50:24.374102] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-22T18:50:24.527336] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-22T18:50:24.764021] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:50:24.798628] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T18:50:25.149162] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T18:50:25.322048] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-22T18:50:25.388167] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T18:50:26.122065] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-22T18:50:26.912567] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T18:50:26.922214] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-22T18:50:26.930045] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T18:50:27.722137] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-22T18:50:28.522112] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-22T18:50:28.718602] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T18:50:29.111152] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T18:50:29.322076] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-22T18:50:29.355145] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T18:50:30.122072] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-22T18:50:30.820294] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T18:50:30.922020] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-22T18:50:31.499002] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T18:50:31.722064] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-22T18:50:32.412166] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T18:50:32.522006] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-22T18:50:33.322031] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-22T18:50:33.365906] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T18:50:33.765396] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T18:50:34.122072] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-22T18:50:34.807374] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T18:50:34.922061] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-22T18:50:35.341485] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T18:50:35.722071] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-22T18:50:36.522085] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-22T18:50:36.555884] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T18:50:37.306144] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T18:50:37.322058] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-22T18:50:38.122069] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-22T18:50:38.232589] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T18:50:38.419315] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T18:50:38.922080] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-22T18:50:39.440425] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T18:50:39.722097] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-22T18:50:40.522111] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-22T18:50:40.545161] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T18:50:40.553279] [INFO ] [REMOTE ] FIHL: Full fetch complete (55783 records). [2025-09-22T18:50:40.553451] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-22T18:50:40.949884] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-22T18:50:40.949997] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-22T18:50:40.950773] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-22T18:50:40.950887] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-22T18:50:40.952428] [DEBUG] [LOCAL ] FIHL: Trimmed 55783 records to 40389 (keeping 200 days of data) [2025-09-22T18:50:41.092969] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T18:50:41.248934] [DEBUG] [LOCAL ] FIHL: Primary data saved (40389 records). [2025-09-22T18:50:41.249063] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-22T18:50:41.249162] [INFO ] [MAIN ] Update Progress: 835/2372 symbols completed. FIHL took 24.2s. Estimated remaining: 3h 23m 38s. Rate: 7.5 symbols/min [2025-09-22T18:50:41.327230] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-22T18:50:41.421311] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:50:41.483600] [DEBUG] [LOCAL ] FIS: Loaded 54148 existing records from primary storage. [2025-09-22T18:50:41.484588] [INFO ] [MAIN ] FIS: Loaded 54148 existing records. [2025-09-22T18:50:41.664039] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:50:41.664352] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-22T18:50:41.664411] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-22T18:50:41.666062] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-22T18:50:41.666123] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-22T18:50:42.021240] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:50:42.048392] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T18:50:42.122066] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-22T18:50:42.798117] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T18:50:42.922048] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-22T18:50:43.722055] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-22T18:50:43.892623] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T18:50:44.522072] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-22T18:50:44.541734] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T18:50:44.633516] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T18:50:44.641267] [INFO ] [REMOTE ] FIGS: Full fetch complete (71047 records). [2025-09-22T18:50:44.641394] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-22T18:50:45.038888] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-22T18:50:45.039013] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-22T18:50:45.039920] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-22T18:50:45.039988] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-22T18:50:45.041517] [DEBUG] [LOCAL ] FIGS: Trimmed 71047 records to 48969 (keeping 200 days of data) [2025-09-22T18:50:45.325408] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-22T18:50:45.326857] [DEBUG] [LOCAL ] FIGS: Primary data saved (48969 records). [2025-09-22T18:50:45.327880] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-22T18:50:45.327995] [INFO ] [MAIN ] Update Progress: 836/2372 symbols completed. FIGS took 29.9s. Estimated remaining: 3h 23m 23s. Rate: 7.6 symbols/min [2025-09-22T18:50:45.504029] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:50:45.539957] [DEBUG] [LOCAL ] FIX: Loaded 31371 existing records from primary storage. [2025-09-22T18:50:45.540108] [INFO ] [MAIN ] FIX: Loaded 31371 existing records. [2025-09-22T18:50:45.733714] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:50:45.733959] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-22T18:50:45.734010] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-22T18:50:45.734975] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-22T18:50:45.735061] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-22T18:50:46.061993] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-22T18:50:46.123909] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-22T18:50:46.130709] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:50:46.233956] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T18:50:46.594345] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-22T18:50:46.922046] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-22T18:50:47.651934] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T18:50:47.722023] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-22T18:50:48.391752] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-22T18:50:48.522028] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-22T18:50:49.268299] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T18:50:49.270013] [INFO ] [REMOTE ] FINS: Full fetch complete (12798 records). [2025-09-22T18:50:49.270086] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-22T18:50:49.331772] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-22T18:50:49.640967] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-22T18:50:49.641051] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-22T18:50:49.641376] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-22T18:50:49.641415] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-22T18:50:49.641930] [DEBUG] [LOCAL ] FINS: Trimmed 12798 records to 8193 (keeping 200 days of data) [2025-09-22T18:50:49.695435] [DEBUG] [LOCAL ] FINS: Primary data saved (8193 records). [2025-09-22T18:50:49.695559] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-22T18:50:49.695665] [INFO ] [MAIN ] Update Progress: 837/2372 symbols completed. FINS took 31.5s. Estimated remaining: 3h 23m 8s. Rate: 7.6 symbols/min [2025-09-22T18:50:50.122057] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-22T18:50:50.922069] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-22T18:50:51.138637] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T18:50:51.357419] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T18:50:51.722048] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-22T18:50:52.444820] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T18:50:52.522034] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-22T18:50:53.012271] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T18:50:53.322052] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-22T18:50:54.122108] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-22T18:50:54.199344] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T18:50:54.607883] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T18:50:54.922108] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-22T18:50:55.623607] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T18:50:55.722095] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-22T18:50:56.522105] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-22T18:50:56.902988] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-22T18:50:57.315251] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T18:50:57.322970] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-22T18:50:57.325243] [INFO ] [REMOTE ] FINV: Full fetch complete (63511 records). [2025-09-22T18:50:57.325786] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-22T18:50:57.716767] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-22T18:50:57.716947] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-22T18:50:57.717856] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-22T18:50:57.718055] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-22T18:50:57.719739] [DEBUG] [LOCAL ] FINV: Trimmed 63511 records to 45117 (keeping 200 days of data) [2025-09-22T18:50:57.840948] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-22T18:50:58.021139] [DEBUG] [LOCAL ] FINV: Primary data saved (45117 records). [2025-09-22T18:50:58.021286] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-22T18:50:58.021374] [INFO ] [MAIN ] Update Progress: 838/2372 symbols completed. FINV took 34.1s. Estimated remaining: 3h 23m 1s. Rate: 7.6 symbols/min [2025-09-22T18:50:58.122077] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-22T18:50:59.400395] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-22T18:50:59.412323] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-22T18:50:59.911264] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T18:50:59.919815] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-22T18:51:01.093513] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T18:51:01.104346] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-22T18:51:01.879871] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-22T18:51:01.886864] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-22T18:51:05.046069] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (3.94 seconds). [2025-09-22T18:51:05.057687] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-22T18:51:05.429435] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (3.54 seconds). [2025-09-22T18:51:05.435965] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-22T18:51:06.944507] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T18:51:06.952919] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-22T18:51:06.987785] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T18:51:07.000834] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-22T18:51:08.316448] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T18:51:08.322603] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-22T18:51:08.888409] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T18:51:08.897093] [INFO ] [REMOTE ] FIS: Full fetch complete (77169 records). [2025-09-22T18:51:08.897238] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-22T18:51:09.299171] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-22T18:51:09.299262] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-22T18:51:09.300155] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-22T18:51:09.300219] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-22T18:51:09.301708] [DEBUG] [LOCAL ] FIS: Trimmed 77169 records to 53366 (keeping 200 days of data) [2025-09-22T18:51:09.433092] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T18:51:09.439705] [INFO ] [REMOTE ] FIX: Full fetch complete (45707 records). [2025-09-22T18:51:09.440261] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-22T18:51:09.994228] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-22T18:51:09.994876] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-22T18:51:09.996123] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-22T18:51:09.996724] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-22T18:51:10.015808] [DEBUG] [LOCAL ] FIX: Trimmed 45707 records to 30683 (keeping 200 days of data) [2025-09-22T18:51:10.205454] [DEBUG] [LOCAL ] FIS: Primary data saved (53366 records). [2025-09-22T18:51:10.208682] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-22T18:51:10.209093] [INFO ] [MAIN ] Update Progress: 839/2372 symbols completed. FIS took 29.0s. Estimated remaining: 3h 23m 1s. Rate: 7.6 symbols/min [2025-09-22T18:51:10.301872] [DEBUG] [LOCAL ] FIX: Primary data saved (30683 records). [2025-09-22T18:51:10.302019] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-22T18:51:10.303257] [INFO ] [MAIN ] Update Progress: 840/2372 symbols completed. FIX took 25.0s. Estimated remaining: 3h 22m 38s. Rate: 7.6 symbols/min [2025-09-22T18:51:10.896949] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:10.990548] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:11.010490] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:11.037407] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-22T18:51:11.036891] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:11.037496] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-22T18:51:11.041935] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-22T18:51:11.042032] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-22T18:51:11.043689] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-22T18:51:11.043807] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-22T18:51:11.124056] [DEBUG] [LOCAL ] FLC: Loaded 5799 existing records from primary storage. [2025-09-22T18:51:11.145669] [INFO ] [MAIN ] FLC: Loaded 5799 existing records. [2025-09-22T18:51:11.519850] [DEBUG] [LOCAL ] FLG: Loaded 54112 existing records from primary storage. [2025-09-22T18:51:11.526245] [INFO ] [MAIN ] FLG: Loaded 54112 existing records. [2025-09-22T18:51:11.532976] [DEBUG] [LOCAL ] FLNG: Loaded 34778 existing records from primary storage. [2025-09-22T18:51:11.544084] [INFO ] [MAIN ] FLNG: Loaded 34778 existing records. [2025-09-22T18:51:11.716698] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:51:11.841962] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-22T18:51:11.847447] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-22T18:51:11.918361] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-22T18:51:11.962554] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-22T18:51:11.946536] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:11.973222] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-22T18:51:12.021733] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:51:12.095412] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:51:12.095758] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-22T18:51:12.112207] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-22T18:51:12.138618] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-22T18:51:12.126487] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-22T18:51:12.149487] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-22T18:51:12.177708] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-22T18:51:12.257588] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-22T18:51:12.315511] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-22T18:51:13.088266] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:13.081631] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:13.101910] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-22T18:51:13.108261] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-22T18:51:13.220001] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:13.220324] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-22T18:51:13.351550] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:51:13.351946] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-22T18:51:13.352448] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-22T18:51:13.604722] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:51:13.605071] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-22T18:51:13.605528] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-22T18:51:13.846177] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-22T18:51:13.848216] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-22T18:51:13.855330] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:51:13.855531] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-22T18:51:13.855849] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-22T18:51:14.065406] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:51:14.065736] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-22T18:51:14.066184] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-22T18:51:14.302415] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:51:14.302759] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-22T18:51:14.303208] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-22T18:51:14.502302] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:51:14.502490] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-22T18:51:14.502882] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-22T18:51:14.548723] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T18:51:14.812689] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T18:51:14.922054] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-22T18:51:15.169686] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-22T18:51:15.193278] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T18:51:15.525572] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-22T18:51:15.722070] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-22T18:51:16.522069] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-22T18:51:17.322070] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-22T18:51:17.502047] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T18:51:17.936132] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-22T18:51:17.957709] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T18:51:18.122070] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-22T18:51:18.922053] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-22T18:51:19.344314] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T18:51:19.523890] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-22T18:51:19.722058] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-22T18:51:20.522066] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-22T18:51:20.830797] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-22T18:51:21.266850] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T18:51:21.322078] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-22T18:51:21.910960] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-22T18:51:22.122071] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-22T18:51:22.667329] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-22T18:51:22.668337] [INFO ] [REMOTE ] FIXT: Full fetch complete (1702 records). [2025-09-22T18:51:22.668406] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-22T18:51:22.848683] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 68 unique days, need 200 days [2025-09-22T18:51:22.848906] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:51:22.848973] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:51:22.849049] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-22T18:51:22.849114] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-22T18:51:22.849151] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-22T18:51:22.849191] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-22T18:51:22.849248] [INFO ] [MAIN ] Update Progress: 841/2372 symbols completed. FIXT took 12.5s. Estimated remaining: 3h 22m 39s. Rate: 7.6 symbols/min [2025-09-22T18:51:22.927195] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-22T18:51:23.028745] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:23.088404] [DEBUG] [LOCAL ] FLO: Loaded 52630 existing records from primary storage. [2025-09-22T18:51:23.088592] [INFO ] [MAIN ] FLO: Loaded 52630 existing records. [2025-09-22T18:51:23.282454] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:51:23.282793] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-22T18:51:23.282851] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-22T18:51:23.284671] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-22T18:51:23.284735] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-22T18:51:23.642517] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:23.722086] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-22T18:51:24.522113] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-22T18:51:24.825033] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T18:51:25.322087] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-22T18:51:25.412096] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T18:51:26.122059] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-22T18:51:26.307823] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T18:51:26.376131] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T18:51:26.922078] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-22T18:51:27.644330] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T18:51:27.722067] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-22T18:51:28.306885] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T18:51:28.522059] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-22T18:51:29.322048] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-22T18:51:29.393447] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T18:51:29.914734] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-22T18:51:29.987618] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T18:51:30.122050] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-22T18:51:30.922047] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-22T18:51:31.518469] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T18:51:31.722055] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-22T18:51:31.960639] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T18:51:32.522063] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-22T18:51:33.156531] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T18:51:33.322031] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-22T18:51:34.052165] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T18:51:34.122033] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-22T18:51:34.922073] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-22T18:51:35.099808] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T18:51:35.548222] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-22T18:51:35.579263] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T18:51:35.722053] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-22T18:51:36.522061] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-22T18:51:37.285690] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T18:51:37.292528] [INFO ] [REMOTE ] FLNG: Full fetch complete (50950 records). [2025-09-22T18:51:37.292715] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-22T18:51:37.327402] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-22T18:51:37.742558] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-22T18:51:37.742687] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-22T18:51:37.743383] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-22T18:51:37.743425] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-22T18:51:37.744764] [DEBUG] [LOCAL ] FLNG: Trimmed 50950 records to 34117 (keeping 200 days of data) [2025-09-22T18:51:37.963918] [DEBUG] [LOCAL ] FLNG: Primary data saved (34117 records). [2025-09-22T18:51:37.964074] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-22T18:51:37.964163] [INFO ] [MAIN ] Update Progress: 842/2372 symbols completed. FLNG took 27.6s. Estimated remaining: 3h 22m 44s. Rate: 7.5 symbols/min [2025-09-22T18:51:38.122319] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-22T18:51:38.142853] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:38.144155] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-22T18:51:38.144257] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-22T18:51:38.145587] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-22T18:51:38.145669] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-22T18:51:38.145736] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-22T18:51:38.145773] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-22T18:51:38.282533] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T18:51:38.553416] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:38.860820] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-22T18:51:38.932164] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-22T18:51:38.956781] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T18:51:39.722108] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-22T18:51:40.070854] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T18:51:40.071168] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-22T18:51:40.279045] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:51:40.522063] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-22T18:51:41.322061] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-22T18:51:42.122025] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-22T18:51:42.241997] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T18:51:42.410045] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T18:51:42.830491] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T18:51:42.831911] [INFO ] [REMOTE ] FLC: Full fetch complete (8062 records). [2025-09-22T18:51:42.831985] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-22T18:51:42.927273] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-22T18:51:43.214190] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-22T18:51:43.214288] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-22T18:51:43.214522] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-22T18:51:43.214582] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-22T18:51:43.215073] [DEBUG] [LOCAL ] FLC: Trimmed 8062 records to 5602 (keeping 200 days of data) [2025-09-22T18:51:43.249324] [DEBUG] [LOCAL ] FLC: Primary data saved (5602 records). [2025-09-22T18:51:43.249451] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-22T18:51:43.249547] [INFO ] [MAIN ] Update Progress: 843/2372 symbols completed. FLC took 32.9s. Estimated remaining: 3h 22m 31s. Rate: 7.5 symbols/min [2025-09-22T18:51:43.426446] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:43.480727] [DEBUG] [LOCAL ] FLR: Loaded 53899 existing records from primary storage. [2025-09-22T18:51:43.480949] [INFO ] [MAIN ] FLR: Loaded 53899 existing records. [2025-09-22T18:51:43.657010] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:51:43.657268] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-22T18:51:43.657315] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-22T18:51:43.658618] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-22T18:51:43.658701] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-22T18:51:43.731783] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-22T18:51:44.026012] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:44.259485] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T18:51:44.522067] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-22T18:51:45.322065] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-22T18:51:45.437260] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T18:51:45.865716] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T18:51:46.122063] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-22T18:51:46.922050] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-22T18:51:47.023059] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T18:51:47.689616] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T18:51:47.722006] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-22T18:51:47.918086] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T18:51:48.522075] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-22T18:51:49.322054] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-22T18:51:49.696543] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-22T18:51:49.704975] [INFO ] [REMOTE ] FLO: Full fetch complete (74820 records). [2025-09-22T18:51:49.705120] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-22T18:51:50.116464] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-22T18:51:50.116852] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-22T18:51:50.118110] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-22T18:51:50.118315] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-22T18:51:50.120226] [DEBUG] [LOCAL ] FLO: Trimmed 74820 records to 51894 (keeping 200 days of data) [2025-09-22T18:51:50.122090] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-22T18:51:50.272425] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T18:51:50.504545] [DEBUG] [LOCAL ] FLO: Primary data saved (51894 records). [2025-09-22T18:51:50.504735] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-22T18:51:50.504863] [INFO ] [MAIN ] Update Progress: 844/2372 symbols completed. FLO took 27.7s. Estimated remaining: 3h 22m 22s. Rate: 7.6 symbols/min [2025-09-22T18:51:50.684716] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:50.705437] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T18:51:50.759088] [DEBUG] [LOCAL ] FLS: Loaded 50924 existing records from primary storage. [2025-09-22T18:51:50.759299] [INFO ] [MAIN ] FLS: Loaded 50924 existing records. [2025-09-22T18:51:50.935536] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-22T18:51:50.941484] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:51:50.942434] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-22T18:51:50.942490] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-22T18:51:50.943999] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-22T18:51:50.944065] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-22T18:51:51.300505] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:51.722058] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-22T18:51:51.914852] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T18:51:52.285836] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:51:52.522081] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-22T18:51:53.322050] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-22T18:51:53.397248] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T18:51:53.407023] [INFO ] [REMOTE ] FLG: Full fetch complete (77290 records). [2025-09-22T18:51:53.407259] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-22T18:51:53.850498] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-22T18:51:53.850627] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-22T18:51:53.852010] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-22T18:51:53.852090] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-22T18:51:53.854440] [DEBUG] [LOCAL ] FLG: Trimmed 77290 records to 53331 (keeping 200 days of data) [2025-09-22T18:51:54.122163] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-22T18:51:54.240313] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T18:51:54.277726] [DEBUG] [LOCAL ] FLG: Primary data saved (53331 records). [2025-09-22T18:51:54.278034] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-22T18:51:54.278226] [INFO ] [MAIN ] Update Progress: 845/2372 symbols completed. FLG took 44.0s. Estimated remaining: 3h 22m 6s. Rate: 7.6 symbols/min [2025-09-22T18:51:54.464523] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:54.485196] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T18:51:54.550125] [DEBUG] [LOCAL ] FLUT: Loaded 51736 existing records from primary storage. [2025-09-22T18:51:54.550305] [INFO ] [MAIN ] FLUT: Loaded 51736 existing records. [2025-09-22T18:51:54.734999] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:51:54.735308] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-22T18:51:54.735380] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-22T18:51:54.736918] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-22T18:51:54.736983] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-22T18:51:54.925320] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-22T18:51:55.118839] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:55.722032] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-22T18:51:55.820993] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T18:51:55.953714] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-22T18:51:56.522063] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-22T18:51:56.991212] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T18:51:57.322048] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-22T18:51:58.122039] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-22T18:51:58.248542] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T18:51:58.392036] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T18:51:58.397388] [INFO ] [REMOTE ] FLOC: Full fetch complete (36854 records). [2025-09-22T18:51:58.397543] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-22T18:51:58.586204] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 171 unique days, need 200 days [2025-09-22T18:51:58.586708] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:51:58.586781] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:51:58.586849] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-22T18:51:58.586913] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-22T18:51:58.586948] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-22T18:51:58.587005] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-22T18:51:58.587084] [INFO ] [MAIN ] Update Progress: 846/2372 symbols completed. FLOC took 20.6s. Estimated remaining: 3h 21m 52s. Rate: 7.6 symbols/min [2025-09-22T18:51:58.754742] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:51:58.775391] [DEBUG] [LOCAL ] FLXR: Loaded 19941 existing records from primary storage. [2025-09-22T18:51:58.775517] [INFO ] [MAIN ] FLXR: Loaded 19941 existing records. [2025-09-22T18:51:58.932232] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-22T18:51:58.955991] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:51:58.956277] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-22T18:51:58.956327] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-22T18:51:58.957139] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-22T18:51:58.957212] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-22T18:51:59.310096] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:51:59.608338] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T18:51:59.722071] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-22T18:52:00.277077] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T18:52:00.441511] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-22T18:52:00.522031] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-22T18:52:01.322057] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-22T18:52:01.376134] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T18:52:02.122058] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-22T18:52:02.799322] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T18:52:02.822887] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-22T18:52:02.922029] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-22T18:52:03.722084] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-22T18:52:04.522060] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-22T18:52:04.713909] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T18:52:05.314375] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T18:52:05.323403] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-22T18:52:05.358754] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T18:52:06.122141] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-22T18:52:06.625221] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T18:52:06.922082] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-22T18:52:07.106064] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-22T18:52:07.722119] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-22T18:52:08.482684] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T18:52:08.522110] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-22T18:52:08.622002] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T18:52:09.322073] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-22T18:52:09.880761] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T18:52:10.122100] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-22T18:52:10.922042] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-22T18:52:11.239538] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T18:52:11.532205] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-22T18:52:11.722021] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-22T18:52:11.930916] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T18:52:12.522085] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-22T18:52:12.858840] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T18:52:13.322076] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-22T18:52:13.942569] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T18:52:14.122034] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-22T18:52:14.438985] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T18:52:14.922049] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-22T18:52:15.603299] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T18:52:15.722045] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-22T18:52:16.522068] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-22T18:52:17.227131] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-22T18:52:17.322081] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-22T18:52:17.669778] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-22T18:52:18.122103] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-22T18:52:18.284400] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T18:52:18.922088] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-22T18:52:19.076390] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T18:52:19.654477] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T18:52:19.722017] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-22T18:52:20.531751] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-22T18:52:20.553164] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T18:52:21.322068] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-22T18:52:21.442225] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T18:52:21.447828] [INFO ] [REMOTE ] FLXR: Full fetch complete (24588 records). [2025-09-22T18:52:21.448089] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-22T18:52:21.908756] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-22T18:52:21.908999] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-22T18:52:21.909824] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-22T18:52:21.910045] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-22T18:52:21.912027] [DEBUG] [LOCAL ] FLXR: Trimmed 24588 records to 19779 (keeping 200 days of data) [2025-09-22T18:52:22.039037] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-22T18:52:22.089829] [DEBUG] [LOCAL ] FLXR: Primary data saved (19779 records). [2025-09-22T18:52:22.090072] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-22T18:52:22.090254] [INFO ] [MAIN ] Update Progress: 847/2372 symbols completed. FLXR took 23.5s. Estimated remaining: 3h 22m 12s. Rate: 7.5 symbols/min [2025-09-22T18:52:22.127223] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-22T18:52:22.277021] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:52:22.360495] [DEBUG] [LOCAL ] FMC: Loaded 52569 existing records from primary storage. [2025-09-22T18:52:22.360954] [INFO ] [MAIN ] FMC: Loaded 52569 existing records. [2025-09-22T18:52:22.562223] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:52:22.562815] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-22T18:52:22.562899] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-22T18:52:22.564522] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-22T18:52:22.564603] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-22T18:52:22.925228] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-22T18:52:22.948053] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:52:22.984146] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T18:52:23.649797] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T18:52:23.658984] [INFO ] [REMOTE ] FLS: Full fetch complete (71277 records). [2025-09-22T18:52:23.659120] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-22T18:52:23.728801] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-22T18:52:24.093283] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-22T18:52:24.093411] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-22T18:52:24.095399] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-22T18:52:24.095469] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-22T18:52:24.099434] [DEBUG] [LOCAL ] FLS: Trimmed 71277 records to 50181 (keeping 200 days of data) [2025-09-22T18:52:24.418352] [DEBUG] [LOCAL ] FLS: Primary data saved (50181 records). [2025-09-22T18:52:24.418494] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-22T18:52:24.418672] [INFO ] [MAIN ] Update Progress: 848/2372 symbols completed. FLS took 33.9s. Estimated remaining: 3h 21m 54s. Rate: 7.5 symbols/min [2025-09-22T18:52:24.527336] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-22T18:52:24.593303] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:52:24.605763] [DEBUG] [LOCAL ] FMN: Loaded 6267 existing records from primary storage. [2025-09-22T18:52:24.605901] [INFO ] [MAIN ] FMN: Loaded 6267 existing records. [2025-09-22T18:52:24.794247] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:52:24.794588] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-22T18:52:24.794666] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-22T18:52:24.795021] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-22T18:52:24.795088] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-22T18:52:25.161799] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:52:25.198357] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-22T18:52:25.209080] [INFO ] [REMOTE ] FLR: Full fetch complete (76291 records). [2025-09-22T18:52:25.209371] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-22T18:52:25.324450] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-22T18:52:25.654796] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-22T18:52:25.654901] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-22T18:52:25.655992] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-22T18:52:25.656061] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-22T18:52:25.657740] [DEBUG] [LOCAL ] FLR: Trimmed 76291 records to 53122 (keeping 200 days of data) [2025-09-22T18:52:25.796411] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-22T18:52:26.037516] [DEBUG] [LOCAL ] FLR: Primary data saved (53122 records). [2025-09-22T18:52:26.037742] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-22T18:52:26.037947] [INFO ] [MAIN ] Update Progress: 849/2372 symbols completed. FLR took 42.8s. Estimated remaining: 3h 21m 35s. Rate: 7.6 symbols/min [2025-09-22T18:52:26.132726] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-22T18:52:26.223795] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:52:26.232047] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-22T18:52:26.270677] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T18:52:26.302711] [DEBUG] [LOCAL ] FMS: Loaded 30974 existing records from primary storage. [2025-09-22T18:52:26.302869] [INFO ] [MAIN ] FMS: Loaded 30974 existing records. [2025-09-22T18:52:26.480378] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:52:26.480615] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-22T18:52:26.480693] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-22T18:52:26.481501] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-22T18:52:26.481563] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-22T18:52:26.851629] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:52:26.922044] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-22T18:52:27.555177] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-22T18:52:27.722044] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-22T18:52:27.984689] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T18:52:28.176027] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-22T18:52:28.522108] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-22T18:52:29.322078] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-22T18:52:29.347601] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T18:52:30.122082] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-22T18:52:30.670464] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T18:52:30.860399] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T18:52:30.922010] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-22T18:52:31.489183] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T18:52:31.722100] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-22T18:52:32.376568] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-22T18:52:32.522063] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-22T18:52:32.941193] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T18:52:33.322065] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-22T18:52:34.122067] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-22T18:52:34.922029] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-22T18:52:35.019109] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T18:52:35.172973] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T18:52:35.722981] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-22T18:52:36.293823] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-22T18:52:36.402846] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T18:52:36.410618] [INFO ] [REMOTE ] FLUT: Full fetch complete (72748 records). [2025-09-22T18:52:36.410781] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-22T18:52:36.527231] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-22T18:52:36.821928] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-22T18:52:36.822015] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-22T18:52:36.822891] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-22T18:52:36.822953] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-22T18:52:36.825370] [DEBUG] [LOCAL ] FLUT: Trimmed 72748 records to 50933 (keeping 200 days of data) [2025-09-22T18:52:37.148328] [DEBUG] [LOCAL ] FLUT: Primary data saved (50933 records). [2025-09-22T18:52:37.148478] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-22T18:52:37.148615] [INFO ] [MAIN ] Update Progress: 850/2372 symbols completed. FLUT took 42.9s. Estimated remaining: 3h 21m 32s. Rate: 7.6 symbols/min [2025-09-22T18:52:37.326919] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:52:37.327039] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-22T18:52:37.374481] [DEBUG] [LOCAL ] FMX: Loaded 41399 existing records from primary storage. [2025-09-22T18:52:37.374627] [INFO ] [MAIN ] FMX: Loaded 41399 existing records. [2025-09-22T18:52:37.616910] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:52:37.617203] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-22T18:52:37.617252] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-22T18:52:37.618308] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-22T18:52:37.618368] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-22T18:52:37.996680] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:52:38.058162] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T18:52:38.059729] [INFO ] [REMOTE ] FMN: Full fetch complete (10237 records). [2025-09-22T18:52:38.059979] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-22T18:52:38.127255] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-22T18:52:38.460693] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-22T18:52:38.460839] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-22T18:52:38.461187] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-22T18:52:38.461271] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-22T18:52:38.461942] [DEBUG] [LOCAL ] FMN: Trimmed 10237 records to 6172 (keeping 200 days of data) [2025-09-22T18:52:38.503498] [DEBUG] [LOCAL ] FMN: Primary data saved (6172 records). [2025-09-22T18:52:38.503609] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-22T18:52:38.503748] [INFO ] [MAIN ] Update Progress: 851/2372 symbols completed. FMN took 14.1s. Estimated remaining: 3h 21m 13s. Rate: 7.6 symbols/min [2025-09-22T18:52:38.697199] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:52:38.701399] [DEBUG] [LOCAL ] FMY: Loaded 1403 existing records from primary storage. [2025-09-22T18:52:38.701621] [INFO ] [MAIN ] FMY: Loaded 1403 existing records. [2025-09-22T18:52:38.818846] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-22T18:52:38.949009] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-22T18:52:38.962478] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:52:38.962925] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-22T18:52:38.962998] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-22T18:52:38.963400] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-22T18:52:38.963475] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-22T18:52:39.369217] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:52:39.518470] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T18:52:39.722118] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-22T18:52:40.506009] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T18:52:40.522007] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-22T18:52:41.322070] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-22T18:52:41.567967] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T18:52:41.644032] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T18:52:41.658313] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-22T18:52:42.122069] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-22T18:52:42.922058] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-22T18:52:43.583147] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T18:52:43.722067] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-22T18:52:44.522073] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-22T18:52:44.798487] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T18:52:44.880533] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-22T18:52:45.220823] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T18:52:45.322061] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-22T18:52:45.758011] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T18:52:46.122057] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-22T18:52:46.922070] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-22T18:52:47.208767] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T18:52:47.267497] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T18:52:47.722072] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-22T18:52:48.522056] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-22T18:52:49.079592] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T18:52:49.322076] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-22T18:52:50.122079] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-22T18:52:50.210725] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T18:52:50.484159] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T18:52:50.922053] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-22T18:52:51.727216] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-22T18:52:51.738635] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T18:52:51.924962] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T18:52:52.522145] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-22T18:52:53.322059] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-22T18:52:53.507207] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T18:52:53.590611] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T18:52:53.756469] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T18:52:54.122061] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-22T18:52:54.525197] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-22T18:52:54.922051] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-22T18:52:55.273150] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-22T18:52:55.722066] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-22T18:52:56.130633] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-22T18:52:56.522104] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-22T18:52:56.889082] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-22T18:52:57.322066] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-22T18:52:57.772185] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T18:52:57.773109] [INFO ] [REMOTE ] FMY: Full fetch complete (1952 records). [2025-09-22T18:52:57.773180] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-22T18:52:58.122247] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-22T18:52:58.153699] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-22T18:52:58.153790] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-22T18:52:58.153891] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-22T18:52:58.153930] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-22T18:52:58.154278] [DEBUG] [LOCAL ] FMY: Trimmed 1952 records to 1383 (keeping 200 days of data) [2025-09-22T18:52:58.163756] [DEBUG] [LOCAL ] FMY: Primary data saved (1383 records). [2025-09-22T18:52:58.163852] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-22T18:52:58.163945] [INFO ] [MAIN ] Update Progress: 852/2372 symbols completed. FMY took 19.7s. Estimated remaining: 3h 21m 26s. Rate: 7.5 symbols/min [2025-09-22T18:52:58.334585] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:52:58.382154] [DEBUG] [LOCAL ] FN: Loaded 40301 existing records from primary storage. [2025-09-22T18:52:58.382311] [INFO ] [MAIN ] FN: Loaded 40301 existing records. [2025-09-22T18:52:58.560060] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:52:58.560340] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-22T18:52:58.560388] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-22T18:52:58.561724] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-22T18:52:58.561787] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-22T18:52:58.925770] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-22T18:52:58.950012] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:52:59.419896] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T18:52:59.722102] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-22T18:52:59.965716] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T18:53:00.522123] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-22T18:53:00.941075] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T18:53:01.322122] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-22T18:53:02.063320] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T18:53:02.122188] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-22T18:53:02.787368] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T18:53:02.922104] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-22T18:53:03.722108] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-22T18:53:03.920591] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T18:53:04.111266] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T18:53:04.522110] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-22T18:53:04.902180] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T18:53:05.322074] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-22T18:53:06.122135] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-22T18:53:06.484691] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-22T18:53:06.493191] [INFO ] [REMOTE ] FMC: Full fetch complete (74853 records). [2025-09-22T18:53:06.493392] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-22T18:53:06.937040] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-22T18:53:06.941128] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-22T18:53:06.941251] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-22T18:53:06.943787] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-22T18:53:06.944228] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-22T18:53:06.946529] [DEBUG] [LOCAL ] FMC: Trimmed 74853 records to 51794 (keeping 200 days of data) [2025-09-22T18:53:07.090256] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T18:53:07.322324] [DEBUG] [LOCAL ] FMC: Primary data saved (51794 records). [2025-09-22T18:53:07.322474] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-22T18:53:07.322570] [INFO ] [MAIN ] Update Progress: 853/2372 symbols completed. FMC took 45.2s. Estimated remaining: 3h 21m 20s. Rate: 7.5 symbols/min [2025-09-22T18:53:07.498595] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:53:07.557152] [DEBUG] [LOCAL ] FNB: Loaded 53229 existing records from primary storage. [2025-09-22T18:53:07.557320] [INFO ] [MAIN ] FNB: Loaded 53229 existing records. [2025-09-22T18:53:07.734921] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-22T18:53:07.742831] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:53:07.772110] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-22T18:53:07.773675] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T18:53:07.773777] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-22T18:53:07.784784] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-22T18:53:07.784855] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-22T18:53:08.137629] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:53:08.191908] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T18:53:08.522112] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-22T18:53:09.322034] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-22T18:53:09.382877] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T18:53:09.390162] [INFO ] [REMOTE ] FMX: Full fetch complete (57694 records). [2025-09-22T18:53:09.390279] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-22T18:53:09.783320] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-22T18:53:09.783424] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-22T18:53:09.784209] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-22T18:53:09.784287] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-22T18:53:09.789085] [DEBUG] [LOCAL ] FMX: Trimmed 57694 records to 40726 (keeping 200 days of data) [2025-09-22T18:53:09.936485] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T18:53:10.080707] [DEBUG] [LOCAL ] FMX: Primary data saved (40726 records). [2025-09-22T18:53:10.080840] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-22T18:53:10.080922] [INFO ] [MAIN ] Update Progress: 854/2372 symbols completed. FMX took 32.9s. Estimated remaining: 3h 21m 3s. Rate: 7.6 symbols/min [2025-09-22T18:53:10.127179] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-22T18:53:10.254938] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:53:10.305719] [DEBUG] [LOCAL ] FND: Loaded 52939 existing records from primary storage. [2025-09-22T18:53:10.305887] [INFO ] [MAIN ] FND: Loaded 52939 existing records. [2025-09-22T18:53:10.482443] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:53:10.482715] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-22T18:53:10.482771] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-22T18:53:10.483815] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-22T18:53:10.483878] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-22T18:53:10.850450] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:53:10.874783] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T18:53:10.922021] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-22T18:53:11.555926] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T18:53:11.561258] [INFO ] [REMOTE ] FMS: Full fetch complete (42384 records). [2025-09-22T18:53:11.561393] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-22T18:53:11.735819] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-22T18:53:11.945391] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-22T18:53:11.945493] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-22T18:53:11.946181] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-22T18:53:11.946244] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-22T18:53:11.947156] [DEBUG] [LOCAL ] FMS: Trimmed 42384 records to 30396 (keeping 200 days of data) [2025-09-22T18:53:12.128908] [DEBUG] [LOCAL ] FMS: Primary data saved (30396 records). [2025-09-22T18:53:12.129047] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-22T18:53:12.129134] [INFO ] [MAIN ] Update Progress: 855/2372 symbols completed. FMS took 46.1s. Estimated remaining: 3h 20m 44s. Rate: 7.6 symbols/min [2025-09-22T18:53:12.299692] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:53:12.345633] [DEBUG] [LOCAL ] FNF: Loaded 50015 existing records from primary storage. [2025-09-22T18:53:12.345800] [INFO ] [MAIN ] FNF: Loaded 50015 existing records. [2025-09-22T18:53:12.527276] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-22T18:53:12.531051] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:53:12.532572] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-22T18:53:12.532795] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-22T18:53:12.533979] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-22T18:53:12.534041] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-22T18:53:12.832452] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T18:53:12.940819] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:53:13.322077] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-22T18:53:13.439579] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T18:53:14.054823] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T18:53:14.122000] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-22T18:53:14.743202] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T18:53:14.922106] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-22T18:53:15.487447] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T18:53:15.722113] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-22T18:53:16.411145] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T18:53:16.522099] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-22T18:53:17.322065] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-22T18:53:17.452059] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T18:53:18.122107] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-22T18:53:18.316246] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T18:53:18.587688] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T18:53:18.922049] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-22T18:53:19.237104] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T18:53:19.722159] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-22T18:53:20.522176] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-22T18:53:20.554571] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T18:53:21.322066] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-22T18:53:21.483998] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T18:53:22.108263] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T18:53:22.121999] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-22T18:53:22.922069] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-22T18:53:23.086261] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T18:53:23.682250] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T18:53:23.689010] [INFO ] [REMOTE ] FN: Full fetch complete (56457 records). [2025-09-22T18:53:23.689190] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-22T18:53:23.728311] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-22T18:53:24.107706] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-22T18:53:24.107793] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-22T18:53:24.108565] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-22T18:53:24.108606] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-22T18:53:24.109759] [DEBUG] [LOCAL ] FN: Trimmed 56457 records to 39605 (keeping 200 days of data) [2025-09-22T18:53:24.390107] [DEBUG] [LOCAL ] FN: Primary data saved (39605 records). [2025-09-22T18:53:24.391353] [INFO ] [MAIN ] FN: Full history saved. [2025-09-22T18:53:24.391484] [INFO ] [MAIN ] Update Progress: 856/2372 symbols completed. FN took 26.2s. Estimated remaining: 3h 20m 44s. Rate: 7.6 symbols/min [2025-09-22T18:53:24.393030] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T18:53:24.527234] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-22T18:53:24.581117] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:53:24.631701] [DEBUG] [LOCAL ] FNV: Loaded 47177 existing records from primary storage. [2025-09-22T18:53:24.631877] [INFO ] [MAIN ] FNV: Loaded 47177 existing records. [2025-09-22T18:53:24.811146] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:53:24.811458] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-22T18:53:24.811509] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-22T18:53:24.812985] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-22T18:53:24.813053] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-22T18:53:25.175027] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:53:25.322019] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-22T18:53:25.564763] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T18:53:25.949693] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T18:53:26.122111] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-22T18:53:26.562762] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T18:53:26.922070] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-22T18:53:27.722119] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-22T18:53:27.967074] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T18:53:28.304393] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T18:53:28.522053] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-22T18:53:29.013723] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T18:53:29.322067] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-22T18:53:29.848554] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T18:53:30.122055] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-22T18:53:30.922036] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-22T18:53:31.072165] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T18:53:31.722112] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-22T18:53:31.897251] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T18:53:32.164628] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-22T18:53:32.522085] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-22T18:53:33.322066] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-22T18:53:33.461803] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T18:53:33.665055] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T18:53:34.122060] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-22T18:53:34.922057] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-22T18:53:34.959771] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T18:53:35.722056] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-22T18:53:35.819355] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T18:53:36.522099] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-22T18:53:36.693388] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T18:53:37.322073] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-22T18:53:37.535887] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T18:53:38.088708] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T18:53:38.122015] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-22T18:53:38.795537] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T18:53:38.804995] [INFO ] [REMOTE ] FNB: Full fetch complete (75603 records). [2025-09-22T18:53:38.805229] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-22T18:53:38.927307] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-22T18:53:39.233160] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-22T18:53:39.233268] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-22T18:53:39.234354] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-22T18:53:39.234424] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-22T18:53:39.236338] [DEBUG] [LOCAL ] FNB: Trimmed 75603 records to 52454 (keeping 200 days of data) [2025-09-22T18:53:39.561951] [DEBUG] [LOCAL ] FNB: Primary data saved (52454 records). [2025-09-22T18:53:39.562123] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-22T18:53:39.562225] [INFO ] [MAIN ] Update Progress: 857/2372 symbols completed. FNB took 32.2s. Estimated remaining: 3h 20m 49s. Rate: 7.5 symbols/min [2025-09-22T18:53:39.734468] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-22T18:53:39.738385] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:53:39.755381] [DEBUG] [LOCAL ] FOA: Loaded 13348 existing records from primary storage. [2025-09-22T18:53:39.755534] [INFO ] [MAIN ] FOA: Loaded 13348 existing records. [2025-09-22T18:53:39.951072] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:53:39.951717] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-22T18:53:39.951873] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-22T18:53:39.952441] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-22T18:53:39.952506] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-22T18:53:40.120023] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-22T18:53:40.375850] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:53:40.523826] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-22T18:53:40.529228] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T18:53:41.129005] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T18:53:41.137967] [INFO ] [REMOTE ] FND: Full fetch complete (74349 records). [2025-09-22T18:53:41.138092] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-22T18:53:41.327286] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-22T18:53:41.514722] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T18:53:41.607313] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-22T18:53:41.607410] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-22T18:53:41.608413] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-22T18:53:41.608483] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-22T18:53:41.610244] [DEBUG] [LOCAL ] FND: Trimmed 74349 records to 52159 (keeping 200 days of data) [2025-09-22T18:53:41.913636] [DEBUG] [LOCAL ] FND: Primary data saved (52159 records). [2025-09-22T18:53:41.913850] [INFO ] [MAIN ] FND: Full history saved. [2025-09-22T18:53:41.913986] [INFO ] [MAIN ] Update Progress: 858/2372 symbols completed. FND took 31.8s. Estimated remaining: 3h 20m 31s. Rate: 7.6 symbols/min [2025-09-22T18:53:42.114855] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:53:42.122065] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-22T18:53:42.127406] [DEBUG] [LOCAL ] FOF: Loaded 8486 existing records from primary storage. [2025-09-22T18:53:42.127550] [INFO ] [MAIN ] FOF: Loaded 8486 existing records. [2025-09-22T18:53:42.323973] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:53:42.324287] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-22T18:53:42.324350] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-22T18:53:42.324812] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-22T18:53:42.324875] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-22T18:53:42.718279] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:53:42.922081] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-22T18:53:43.168364] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T18:53:43.264379] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T18:53:43.722070] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-22T18:53:44.478029] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T18:53:44.522085] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-22T18:53:44.683343] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T18:53:45.322086] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-22T18:53:46.081363] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T18:53:46.122002] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-22T18:53:46.561097] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T18:53:46.922103] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-22T18:53:47.730712] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-22T18:53:47.735344] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T18:53:47.743899] [INFO ] [REMOTE ] FNF: Full fetch complete (69524 records). [2025-09-22T18:53:47.744071] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-22T18:53:47.871488] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T18:53:48.170523] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-22T18:53:48.170662] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-22T18:53:48.171518] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-22T18:53:48.171565] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-22T18:53:48.172996] [DEBUG] [LOCAL ] FNF: Trimmed 69524 records to 49257 (keeping 200 days of data) [2025-09-22T18:53:48.475557] [DEBUG] [LOCAL ] FNF: Primary data saved (49257 records). [2025-09-22T18:53:48.475721] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-22T18:53:48.475830] [INFO ] [MAIN ] Update Progress: 859/2372 symbols completed. FNF took 36.3s. Estimated remaining: 3h 20m 21s. Rate: 7.6 symbols/min [2025-09-22T18:53:48.530145] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-22T18:53:48.588509] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T18:53:48.660799] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:53:48.682303] [DEBUG] [LOCAL ] FOR: Loaded 20598 existing records from primary storage. [2025-09-22T18:53:48.682429] [INFO ] [MAIN ] FOR: Loaded 20598 existing records. [2025-09-22T18:53:48.861810] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:53:48.862080] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-22T18:53:48.862135] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-22T18:53:48.862735] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-22T18:53:48.862794] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-22T18:53:49.223981] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:53:49.322038] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-22T18:53:49.483954] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-22T18:53:50.122106] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-22T18:53:50.863763] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T18:53:50.922055] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-22T18:53:50.973028] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T18:53:51.568904] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T18:53:51.722108] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-22T18:53:52.522056] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-22T18:53:53.139574] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T18:53:53.146755] [INFO ] [REMOTE ] FNV: Full fetch complete (65995 records). [2025-09-22T18:53:53.146874] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-22T18:53:53.322412] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-22T18:53:53.425835] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T18:53:53.546217] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-22T18:53:53.546310] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-22T18:53:53.547185] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-22T18:53:53.547253] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-22T18:53:53.548672] [DEBUG] [LOCAL ] FNV: Trimmed 65995 records to 46472 (keeping 200 days of data) [2025-09-22T18:53:53.859275] [DEBUG] [LOCAL ] FNV: Primary data saved (46472 records). [2025-09-22T18:53:53.859432] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-22T18:53:53.859524] [INFO ] [MAIN ] Update Progress: 860/2372 symbols completed. FNV took 29.5s. Estimated remaining: 3h 20m 8s. Rate: 7.6 symbols/min [2025-09-22T18:53:54.088669] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:53:54.107438] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-22T18:53:54.122098] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-22T18:53:54.175504] [DEBUG] [LOCAL ] FOUR: Loaded 50265 existing records from primary storage. [2025-09-22T18:53:54.175755] [INFO ] [MAIN ] FOUR: Loaded 50265 existing records. [2025-09-22T18:53:54.429317] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:53:54.429678] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-22T18:53:54.429740] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-22T18:53:54.431084] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-22T18:53:54.431150] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-22T18:53:54.906345] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:53:54.930414] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-22T18:53:54.933406] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T18:53:55.555430] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-22T18:53:55.722027] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-22T18:53:56.522070] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-22T18:53:56.535701] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T18:53:57.322075] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-22T18:53:57.737523] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T18:53:58.122068] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-22T18:53:58.713179] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-22T18:53:58.922107] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-22T18:53:59.100025] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T18:53:59.476198] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-22T18:53:59.722090] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-22T18:54:00.522079] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-22T18:54:00.573405] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-22T18:54:01.322074] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-22T18:54:02.122064] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-22T18:54:02.598464] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-22T18:54:02.622711] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T18:54:02.867560] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T18:54:02.922081] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-22T18:54:03.722114] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-22T18:54:03.752135] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T18:54:04.522069] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-22T18:54:04.567756] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T18:54:04.569958] [INFO ] [REMOTE ] FOF: Full fetch complete (11840 records). [2025-09-22T18:54:04.570031] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-22T18:54:04.941701] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-22T18:54:04.941788] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-22T18:54:04.942093] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-22T18:54:04.942134] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-22T18:54:04.942611] [DEBUG] [LOCAL ] FOF: Trimmed 11840 records to 8383 (keeping 200 days of data) [2025-09-22T18:54:04.995300] [DEBUG] [LOCAL ] FOF: Primary data saved (8383 records). [2025-09-22T18:54:04.995427] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-22T18:54:04.995512] [INFO ] [MAIN ] Update Progress: 861/2372 symbols completed. FOF took 23.1s. Estimated remaining: 3h 20m 6s. Rate: 7.6 symbols/min [2025-09-22T18:54:05.168831] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:54:05.187627] [DEBUG] [LOCAL ] FPF: Loaded 17887 existing records from primary storage. [2025-09-22T18:54:05.187823] [INFO ] [MAIN ] FPF: Loaded 17887 existing records. [2025-09-22T18:54:05.327156] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-22T18:54:05.368907] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:54:05.369124] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-22T18:54:05.369185] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-22T18:54:05.369875] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-22T18:54:05.369936] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-22T18:54:05.726547] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:54:05.917954] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T18:54:06.122026] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-22T18:54:06.186733] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T18:54:06.922101] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-22T18:54:07.257468] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T18:54:07.595136] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T18:54:07.722053] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-22T18:54:08.522056] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-22T18:54:08.613490] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T18:54:09.322061] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-22T18:54:10.113574] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T18:54:10.123542] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-22T18:54:10.356187] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T18:54:10.922029] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-22T18:54:10.997802] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T18:54:11.000800] [INFO ] [REMOTE ] FOA: Full fetch complete (22393 records). [2025-09-22T18:54:11.000898] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-22T18:54:11.368127] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-22T18:54:11.368204] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-22T18:54:11.368706] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-22T18:54:11.368768] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-22T18:54:11.369376] [DEBUG] [LOCAL ] FOA: Trimmed 22393 records to 13132 (keeping 200 days of data) [2025-09-22T18:54:11.447163] [DEBUG] [LOCAL ] FOA: Primary data saved (13132 records). [2025-09-22T18:54:11.447309] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-22T18:54:11.447395] [INFO ] [MAIN ] Update Progress: 862/2372 symbols completed. FOA took 31.9s. Estimated remaining: 3h 19m 55s. Rate: 7.6 symbols/min [2025-09-22T18:54:11.620141] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:54:11.640717] [DEBUG] [LOCAL ] FPH: Loaded 20104 existing records from primary storage. [2025-09-22T18:54:11.640877] [INFO ] [MAIN ] FPH: Loaded 20104 existing records. [2025-09-22T18:54:11.727234] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-22T18:54:11.829840] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:54:11.830098] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-22T18:54:11.830149] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-22T18:54:11.830754] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-22T18:54:11.830817] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-22T18:54:12.196741] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:54:12.522072] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-22T18:54:12.705893] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T18:54:12.765415] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T18:54:13.322054] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-22T18:54:13.723381] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T18:54:14.122061] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-22T18:54:14.235416] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T18:54:14.922076] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-22T18:54:15.417126] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-22T18:54:15.722094] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-22T18:54:16.522073] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-22T18:54:17.250469] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-22T18:54:17.322081] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-22T18:54:17.463074] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T18:54:17.481772] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T18:54:18.122054] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-22T18:54:18.614231] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T18:54:18.922013] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-22T18:54:19.355201] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T18:54:19.722066] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-22T18:54:20.311351] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T18:54:20.522057] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-22T18:54:20.733326] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T18:54:21.322063] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-22T18:54:22.122083] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-22T18:54:22.325414] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T18:54:22.353666] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-22T18:54:22.357051] [INFO ] [REMOTE ] FOR: Full fetch complete (29804 records). [2025-09-22T18:54:22.357144] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-22T18:54:22.743497] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-22T18:54:22.743582] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-22T18:54:22.744205] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-22T18:54:22.744271] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-22T18:54:22.745279] [DEBUG] [LOCAL ] FOR: Trimmed 29804 records to 20202 (keeping 200 days of data) [2025-09-22T18:54:22.870254] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T18:54:22.905957] [DEBUG] [LOCAL ] FOR: Primary data saved (20202 records). [2025-09-22T18:54:22.906091] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-22T18:54:22.906282] [INFO ] [MAIN ] Update Progress: 863/2372 symbols completed. FOR took 34.4s. Estimated remaining: 3h 19m 53s. Rate: 7.5 symbols/min [2025-09-22T18:54:22.928684] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-22T18:54:23.087634] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:54:23.122520] [DEBUG] [LOCAL ] FPI: Loaded 31700 existing records from primary storage. [2025-09-22T18:54:23.122681] [INFO ] [MAIN ] FPI: Loaded 31700 existing records. [2025-09-22T18:54:23.306213] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:54:23.306469] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-22T18:54:23.306522] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-22T18:54:23.307482] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-22T18:54:23.307547] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-22T18:54:23.690021] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:54:23.722073] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-22T18:54:24.522107] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-22T18:54:24.642038] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-22T18:54:24.908401] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-22T18:54:24.917521] [INFO ] [REMOTE ] FOUR: Full fetch complete (71922 records). [2025-09-22T18:54:24.917714] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-22T18:54:25.325015] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-22T18:54:25.328955] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-22T18:54:25.330451] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-22T18:54:25.332458] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-22T18:54:25.332815] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-22T18:54:25.336848] [DEBUG] [LOCAL ] FOUR: Trimmed 71922 records to 49522 (keeping 200 days of data) [2025-09-22T18:54:25.461068] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T18:54:25.665070] [DEBUG] [LOCAL ] FOUR: Primary data saved (49522 records). [2025-09-22T18:54:25.665235] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-22T18:54:25.665399] [INFO ] [MAIN ] Update Progress: 864/2372 symbols completed. FOUR took 31.8s. Estimated remaining: 3h 19m 36s. Rate: 7.6 symbols/min [2025-09-22T18:54:25.837805] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:54:25.892424] [DEBUG] [LOCAL ] FR: Loaded 47434 existing records from primary storage. [2025-09-22T18:54:25.892590] [INFO ] [MAIN ] FR: Loaded 47434 existing records. [2025-09-22T18:54:26.080868] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:54:26.081169] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-22T18:54:26.081236] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-22T18:54:26.082442] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-22T18:54:26.082515] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-22T18:54:26.127279] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-22T18:54:26.454435] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:54:26.474296] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T18:54:26.922025] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-22T18:54:27.076242] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T18:54:27.722075] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-22T18:54:28.522078] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-22T18:54:28.772419] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-22T18:54:29.322126] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-22T18:54:29.908991] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-22T18:54:30.122078] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-22T18:54:30.294095] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T18:54:30.478863] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-22T18:54:30.922148] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-22T18:54:31.180289] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T18:54:31.722082] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-22T18:54:32.462301] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T18:54:32.522027] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-22T18:54:33.082139] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T18:54:33.322060] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-22T18:54:33.777336] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T18:54:34.122067] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-22T18:54:34.645867] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T18:54:34.922063] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-22T18:54:35.722104] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-22T18:54:35.836515] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T18:54:35.890846] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T18:54:36.522064] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-22T18:54:37.076130] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T18:54:37.322049] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-22T18:54:38.061063] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T18:54:38.122092] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-22T18:54:38.138742] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T18:54:38.922063] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-22T18:54:39.730607] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-22T18:54:39.761932] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T18:54:40.206528] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T18:54:40.522079] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-22T18:54:40.901418] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T18:54:41.322106] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-22T18:54:41.665852] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T18:54:41.982934] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T18:54:41.986349] [INFO ] [REMOTE ] FPF: Full fetch complete (26322 records). [2025-09-22T18:54:41.986522] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-22T18:54:42.127224] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-22T18:54:42.392008] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-22T18:54:42.392137] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-22T18:54:42.392959] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-22T18:54:42.393028] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-22T18:54:42.394277] [DEBUG] [LOCAL ] FPF: Trimmed 26322 records to 17594 (keeping 200 days of data) [2025-09-22T18:54:42.532178] [DEBUG] [LOCAL ] FPF: Primary data saved (17594 records). [2025-09-22T18:54:42.533052] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-22T18:54:42.533386] [INFO ] [MAIN ] Update Progress: 865/2372 symbols completed. FPF took 37.5s. Estimated remaining: 3h 19m 44s. Rate: 7.5 symbols/min [2025-09-22T18:54:42.709506] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:54:42.730294] [DEBUG] [LOCAL ] FRA: Loaded 14908 existing records from primary storage. [2025-09-22T18:54:42.730448] [INFO ] [MAIN ] FRA: Loaded 14908 existing records. [2025-09-22T18:54:42.914781] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:54:42.915096] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-22T18:54:42.915146] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-22T18:54:42.915955] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-22T18:54:42.916017] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-22T18:54:42.927773] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-22T18:54:43.283812] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:54:43.448722] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T18:54:43.722110] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-22T18:54:43.918464] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T18:54:44.522068] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-22T18:54:45.048022] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T18:54:45.322101] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-22T18:54:45.629234] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T18:54:46.122137] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-22T18:54:46.677037] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T18:54:46.922119] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-22T18:54:47.257698] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-22T18:54:47.674083] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-22T18:54:47.722116] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-22T18:54:48.514605] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-22T18:54:48.521991] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-22T18:54:49.322082] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-22T18:54:49.693336] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T18:54:49.698152] [INFO ] [REMOTE ] FPI: Full fetch complete (44059 records). [2025-09-22T18:54:49.698264] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-22T18:54:50.079411] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-22T18:54:50.079498] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-22T18:54:50.080167] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-22T18:54:50.080234] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-22T18:54:50.081179] [DEBUG] [LOCAL ] FPI: Trimmed 44059 records to 31107 (keeping 200 days of data) [2025-09-22T18:54:50.139143] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-22T18:54:50.280221] [DEBUG] [LOCAL ] FPI: Primary data saved (31107 records). [2025-09-22T18:54:50.280373] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-22T18:54:50.280460] [INFO ] [MAIN ] Update Progress: 866/2372 symbols completed. FPI took 27.4s. Estimated remaining: 3h 19m 36s. Rate: 7.5 symbols/min [2025-09-22T18:54:50.457171] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:54:50.478101] [DEBUG] [LOCAL ] FRGE: Loaded 19246 existing records from primary storage. [2025-09-22T18:54:50.478223] [INFO ] [MAIN ] FRGE: Loaded 19246 existing records. [2025-09-22T18:54:50.658930] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:54:50.659194] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-22T18:54:50.659248] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-22T18:54:50.659832] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-22T18:54:50.659895] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-22T18:54:50.924812] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-22T18:54:51.043001] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:54:51.054243] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T18:54:51.081175] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T18:54:51.081449] [INFO ] [REMOTE ] FPH: Full fetch complete (31709 records). [2025-09-22T18:54:51.089172] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-22T18:54:51.133742] [INFO ] [REMOTE ] FR: Full fetch complete (66565 records). [2025-09-22T18:54:51.166782] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-22T18:54:51.750026] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-22T18:54:51.882934] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-22T18:54:51.901505] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-22T18:54:51.904302] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-22T18:54:51.911039] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-22T18:54:51.940381] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-22T18:54:51.940480] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-22T18:54:51.941198] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-22T18:54:51.941357] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-22T18:54:51.941892] [DEBUG] [LOCAL ] FPH: Trimmed 31709 records to 19781 (keeping 200 days of data) [2025-09-22T18:54:51.943195] [DEBUG] [LOCAL ] FR: Trimmed 66565 records to 46677 (keeping 200 days of data) [2025-09-22T18:54:52.168047] [DEBUG] [LOCAL ] FPH: Primary data saved (19781 records). [2025-09-22T18:54:52.171985] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-22T18:54:52.172152] [INFO ] [MAIN ] Update Progress: 867/2372 symbols completed. FPH took 40.7s. Estimated remaining: 3h 19m 17s. Rate: 7.6 symbols/min [2025-09-22T18:54:52.295341] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T18:54:52.476471] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:54:52.550271] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-22T18:54:52.590051] [DEBUG] [LOCAL ] FRO: Loaded 52689 existing records from primary storage. [2025-09-22T18:54:52.591753] [INFO ] [MAIN ] FRO: Loaded 52689 existing records. [2025-09-22T18:54:52.642171] [DEBUG] [LOCAL ] FR: Primary data saved (46677 records). [2025-09-22T18:54:52.670377] [INFO ] [MAIN ] FR: Full history saved. [2025-09-22T18:54:52.676840] [INFO ] [MAIN ] Update Progress: 868/2372 symbols completed. FR took 27.0s. Estimated remaining: 3h 18m 56s. Rate: 7.6 symbols/min [2025-09-22T18:54:52.955872] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:54:52.956155] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:54:52.956632] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-22T18:54:52.956720] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-22T18:54:52.958460] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-22T18:54:52.958546] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-22T18:54:53.273965] [DEBUG] [LOCAL ] FRT: Loaded 42999 existing records from primary storage. [2025-09-22T18:54:53.279776] [INFO ] [MAIN ] FRT: Loaded 42999 existing records. [2025-09-22T18:54:53.457436] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:54:53.453330] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T18:54:53.476358] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-22T18:54:53.559762] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:54:53.560205] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-22T18:54:53.560361] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-22T18:54:53.568309] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-22T18:54:53.582236] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-22T18:54:53.618838] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T18:54:53.989857] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:54:54.122025] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-22T18:54:54.922117] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-22T18:54:55.570006] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T18:54:55.645610] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-22T18:54:55.722025] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-22T18:54:55.891606] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T18:54:56.522091] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-22T18:54:57.197430] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T18:54:57.322011] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-22T18:54:57.546992] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T18:54:58.122055] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-22T18:54:58.527804] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T18:54:58.923344] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-22T18:54:58.928096] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T18:54:59.722084] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-22T18:55:00.444945] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T18:55:00.522030] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-22T18:55:01.023593] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T18:55:01.322016] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-22T18:55:01.799215] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T18:55:02.122068] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-22T18:55:02.289322] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-22T18:55:02.922068] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-22T18:55:03.102873] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T18:55:03.722097] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-22T18:55:04.522045] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-22T18:55:04.678521] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T18:55:04.958859] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-22T18:55:05.322061] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-22T18:55:06.068143] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T18:55:06.122021] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-22T18:55:06.288072] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T18:55:06.922080] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-22T18:55:07.556013] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T18:55:07.722110] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-22T18:55:08.472259] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T18:55:08.517223] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T18:55:08.527289] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-22T18:55:09.322071] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-22T18:55:10.050377] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T18:55:10.122010] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-22T18:55:10.169559] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T18:55:10.922093] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-22T18:55:11.498091] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T18:55:11.722153] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-22T18:55:12.245426] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-22T18:55:12.522067] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-22T18:55:12.934819] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-22T18:55:13.294603] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T18:55:13.322045] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-22T18:55:14.122035] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-22T18:55:14.142808] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T18:55:14.922098] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-22T18:55:15.735679] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-22T18:55:15.739236] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T18:55:15.818666] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T18:55:15.821432] [INFO ] [REMOTE ] FRA: Full fetch complete (24300 records). [2025-09-22T18:55:15.821534] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-22T18:55:16.202609] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-22T18:55:16.202720] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-22T18:55:16.203274] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-22T18:55:16.203328] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-22T18:55:16.204084] [DEBUG] [LOCAL ] FRA: Trimmed 24300 records to 14592 (keeping 200 days of data) [2025-09-22T18:55:16.294954] [DEBUG] [LOCAL ] FRA: Primary data saved (14592 records). [2025-09-22T18:55:16.295107] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-22T18:55:16.295212] [INFO ] [MAIN ] Update Progress: 869/2372 symbols completed. FRA took 33.8s. Estimated remaining: 3h 19m 16s. Rate: 7.5 symbols/min [2025-09-22T18:55:16.478674] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:55:16.527543] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-22T18:55:16.530791] [DEBUG] [LOCAL ] FSCO: Loaded 37339 existing records from primary storage. [2025-09-22T18:55:16.530985] [INFO ] [MAIN ] FSCO: Loaded 37339 existing records. [2025-09-22T18:55:16.729898] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:55:16.730149] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-22T18:55:16.730209] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-22T18:55:16.731117] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-22T18:55:16.731177] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-22T18:55:17.095585] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:55:17.331736] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-22T18:55:17.353840] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T18:55:17.992080] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T18:55:17.998581] [INFO ] [REMOTE ] FRT: Full fetch complete (60255 records). [2025-09-22T18:55:17.998732] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-22T18:55:18.127205] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-22T18:55:18.395399] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-22T18:55:18.395587] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-22T18:55:18.396559] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-22T18:55:18.396624] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-22T18:55:18.398593] [DEBUG] [LOCAL ] FRT: Trimmed 60255 records to 42371 (keeping 200 days of data) [2025-09-22T18:55:18.527172] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T18:55:18.542297] [INFO ] [REMOTE ] FRGE: Full fetch complete (34398 records). [2025-09-22T18:55:18.542495] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-22T18:55:18.925576] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-22T18:55:19.046537] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-22T18:55:19.050685] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-22T18:55:19.051554] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-22T18:55:19.051983] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-22T18:55:19.054977] [DEBUG] [LOCAL ] FRGE: Trimmed 34398 records to 18734 (keeping 200 days of data) [2025-09-22T18:55:19.152340] [DEBUG] [LOCAL ] FRT: Primary data saved (42371 records). [2025-09-22T18:55:19.158269] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-22T18:55:19.161060] [INFO ] [MAIN ] Update Progress: 870/2372 symbols completed. FRT took 26.5s. Estimated remaining: 3h 18m 59s. Rate: 7.5 symbols/min [2025-09-22T18:55:19.342911] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:55:19.365051] [DEBUG] [LOCAL ] FRGE: Primary data saved (18734 records). [2025-09-22T18:55:19.365266] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-22T18:55:19.365364] [INFO ] [MAIN ] Update Progress: 871/2372 symbols completed. FRGE took 29.1s. Estimated remaining: 3h 18m 38s. Rate: 7.6 symbols/min [2025-09-22T18:55:19.531706] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T18:55:19.557423] [DEBUG] [LOCAL ] FSK: Loaded 50114 existing records from primary storage. [2025-09-22T18:55:19.585136] [INFO ] [MAIN ] FSK: Loaded 50114 existing records. [2025-09-22T18:55:19.668855] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:55:19.722228] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-22T18:55:19.795743] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:55:19.796073] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-22T18:55:19.796131] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-22T18:55:19.797370] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-22T18:55:19.797437] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-22T18:55:20.097677] [DEBUG] [LOCAL ] FSLY: Loaded 52048 existing records from primary storage. [2025-09-22T18:55:20.124235] [INFO ] [MAIN ] FSLY: Loaded 52048 existing records. [2025-09-22T18:55:20.351821] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:55:20.426166] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:55:20.426469] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-22T18:55:20.426528] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-22T18:55:20.427523] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-22T18:55:20.427585] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-22T18:55:20.527110] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-22T18:55:20.790254] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:55:20.910093] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T18:55:21.016082] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T18:55:21.322063] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-22T18:55:21.989507] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T18:55:22.122065] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-22T18:55:22.922055] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-22T18:55:23.340479] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T18:55:23.722074] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-22T18:55:23.812861] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T18:55:24.273927] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T18:55:24.522063] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-22T18:55:25.322059] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-22T18:55:25.447396] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T18:55:25.821780] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T18:55:26.122065] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-22T18:55:26.922107] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-22T18:55:27.289995] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-22T18:55:27.638519] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T18:55:27.722049] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-22T18:55:28.489122] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T18:55:28.522008] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-22T18:55:29.102150] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T18:55:29.322072] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-22T18:55:30.040794] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T18:55:30.122088] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-22T18:55:30.922079] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-22T18:55:31.225852] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T18:55:31.722061] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-22T18:55:31.886695] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T18:55:32.377360] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T18:55:32.522068] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-22T18:55:33.322115] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-22T18:55:33.614275] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T18:55:33.973327] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T18:55:34.122062] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-22T18:55:34.861042] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T18:55:34.922017] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-22T18:55:35.476002] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T18:55:35.722064] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-22T18:55:36.451028] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T18:55:36.522118] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-22T18:55:37.322082] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-22T18:55:37.686813] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-22T18:55:37.695912] [INFO ] [REMOTE ] FRO: Full fetch complete (75435 records). [2025-09-22T18:55:37.696116] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-22T18:55:38.105590] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-22T18:55:38.105734] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-22T18:55:38.106791] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-22T18:55:38.106875] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-22T18:55:38.108586] [DEBUG] [LOCAL ] FRO: Trimmed 75435 records to 51881 (keeping 200 days of data) [2025-09-22T18:55:38.166723] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-22T18:55:38.243188] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T18:55:38.479316] [DEBUG] [LOCAL ] FRO: Primary data saved (51881 records). [2025-09-22T18:55:38.479519] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-22T18:55:38.479661] [INFO ] [MAIN ] Update Progress: 872/2372 symbols completed. FRO took 46.3s. Estimated remaining: 3h 18m 49s. Rate: 7.5 symbols/min [2025-09-22T18:55:38.662143] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:55:38.713957] [DEBUG] [LOCAL ] FSM: Loaded 54061 existing records from primary storage. [2025-09-22T18:55:38.714125] [INFO ] [MAIN ] FSM: Loaded 54061 existing records. [2025-09-22T18:55:38.922088] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-22T18:55:38.929832] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T18:55:38.929977] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:55:38.941015] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-22T18:55:38.941936] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-22T18:55:38.943244] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-22T18:55:38.943366] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-22T18:55:39.311450] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:55:39.381146] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-22T18:55:39.722058] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-22T18:55:40.522048] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-22T18:55:40.553040] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T18:55:41.322023] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-22T18:55:41.358976] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T18:55:41.987933] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T18:55:42.122056] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-22T18:55:42.922137] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-22T18:55:42.963866] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T18:55:43.722069] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-22T18:55:44.091894] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-22T18:55:44.388273] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T18:55:44.395198] [INFO ] [REMOTE ] FSCO: Full fetch complete (53827 records). [2025-09-22T18:55:44.395374] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-22T18:55:44.527232] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-22T18:55:44.806379] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-22T18:55:44.806545] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-22T18:55:44.807354] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-22T18:55:44.807419] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-22T18:55:44.810872] [DEBUG] [LOCAL ] FSCO: Trimmed 53827 records to 36753 (keeping 200 days of data) [2025-09-22T18:55:45.027684] [DEBUG] [LOCAL ] FSCO: Primary data saved (36753 records). [2025-09-22T18:55:45.027846] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-22T18:55:45.027935] [INFO ] [MAIN ] Update Progress: 873/2372 symbols completed. FSCO took 28.7s. Estimated remaining: 3h 18m 39s. Rate: 7.5 symbols/min [2025-09-22T18:55:45.195464] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:55:45.230947] [DEBUG] [LOCAL ] FSS: Loaded 35405 existing records from primary storage. [2025-09-22T18:55:45.231084] [INFO ] [MAIN ] FSS: Loaded 35405 existing records. [2025-09-22T18:55:45.330215] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-22T18:55:45.413919] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:55:45.414151] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-22T18:55:45.414198] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-22T18:55:45.415089] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-22T18:55:45.415152] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-22T18:55:45.784757] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:55:45.813680] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-22T18:55:46.122114] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-22T18:55:46.339674] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T18:55:46.922053] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-22T18:55:47.045744] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T18:55:47.722008] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-22T18:55:47.841246] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T18:55:48.072083] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T18:55:48.522057] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-22T18:55:49.322066] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-22T18:55:49.464637] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T18:55:50.120617] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T18:55:50.129107] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-22T18:55:50.132458] [INFO ] [REMOTE ] FSK: Full fetch complete (71377 records). [2025-09-22T18:55:50.132596] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-22T18:55:50.558805] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-22T18:55:50.559003] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-22T18:55:50.559963] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-22T18:55:50.560099] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-22T18:55:50.586937] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T18:55:50.593473] [DEBUG] [LOCAL ] FSK: Trimmed 71377 records to 49383 (keeping 200 days of data) [2025-09-22T18:55:50.915679] [DEBUG] [LOCAL ] FSK: Primary data saved (49383 records). [2025-09-22T18:55:50.915849] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-22T18:55:50.915945] [INFO ] [MAIN ] Update Progress: 874/2372 symbols completed. FSK took 31.8s. Estimated remaining: 3h 18m 27s. Rate: 7.5 symbols/min [2025-09-22T18:55:50.927734] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-22T18:55:51.093622] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:55:51.102453] [DEBUG] [LOCAL ] FT: Loaded 6424 existing records from primary storage. [2025-09-22T18:55:51.102574] [INFO ] [MAIN ] FT: Loaded 6424 existing records. [2025-09-22T18:55:51.278864] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:55:51.279156] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-22T18:55:51.279234] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-22T18:55:51.279681] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-22T18:55:51.279773] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-22T18:55:51.635188] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:55:51.722032] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-22T18:55:51.961983] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T18:55:52.126229] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-22T18:55:52.405978] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T18:55:52.522092] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-22T18:55:53.098753] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T18:55:53.322076] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-22T18:55:53.959911] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T18:55:54.122100] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-22T18:55:54.922058] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-22T18:55:55.518922] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-22T18:55:55.602921] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T18:55:55.722058] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-22T18:55:56.459506] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T18:55:56.522092] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-22T18:55:57.322068] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-22T18:55:58.122068] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-22T18:55:58.307333] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T18:55:58.721960] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-22T18:55:58.922031] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-22T18:55:58.968108] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T18:55:59.722064] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-22T18:56:00.522019] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-22T18:56:00.555372] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T18:56:00.565003] [INFO ] [REMOTE ] FSLY: Full fetch complete (74982 records). [2025-09-22T18:56:00.565214] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-22T18:56:01.014874] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-22T18:56:01.015021] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-22T18:56:01.016176] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-22T18:56:01.016246] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-22T18:56:01.017917] [DEBUG] [LOCAL ] FSLY: Trimmed 74982 records to 51270 (keeping 200 days of data) [2025-09-22T18:56:01.125543] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T18:56:01.178186] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T18:56:01.332538] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-22T18:56:01.373667] [DEBUG] [LOCAL ] FSLY: Primary data saved (51270 records). [2025-09-22T18:56:01.373841] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-22T18:56:01.373933] [INFO ] [MAIN ] Update Progress: 875/2372 symbols completed. FSLY took 42.0s. Estimated remaining: 3h 18m 23s. Rate: 7.5 symbols/min [2025-09-22T18:56:01.553985] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:56:01.566337] [DEBUG] [LOCAL ] FTHY: Loaded 11845 existing records from primary storage. [2025-09-22T18:56:01.566493] [INFO ] [MAIN ] FTHY: Loaded 11845 existing records. [2025-09-22T18:56:01.760100] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:56:01.760376] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-22T18:56:01.760443] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-22T18:56:01.760988] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-22T18:56:01.761050] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-22T18:56:02.115988] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:56:02.122013] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-22T18:56:02.790086] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T18:56:02.922111] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-22T18:56:02.968025] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T18:56:03.702871] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T18:56:03.722061] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-22T18:56:04.453599] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-22T18:56:04.522016] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-22T18:56:05.258241] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T18:56:05.260373] [INFO ] [REMOTE ] FT: Full fetch complete (9003 records). [2025-09-22T18:56:05.260454] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-22T18:56:05.327400] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-22T18:56:05.627528] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-22T18:56:05.627617] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-22T18:56:05.627916] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-22T18:56:05.627973] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-22T18:56:05.628389] [DEBUG] [LOCAL ] FT: Trimmed 9003 records to 6280 (keeping 200 days of data) [2025-09-22T18:56:05.665076] [DEBUG] [LOCAL ] FT: Primary data saved (6280 records). [2025-09-22T18:56:05.665169] [INFO ] [MAIN ] FT: Full history saved. [2025-09-22T18:56:05.665255] [INFO ] [MAIN ] Update Progress: 876/2372 symbols completed. FT took 14.7s. Estimated remaining: 3h 18m 9s. Rate: 7.5 symbols/min [2025-09-22T18:56:05.831694] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:56:05.883776] [DEBUG] [LOCAL ] FTI: Loaded 54083 existing records from primary storage. [2025-09-22T18:56:05.883923] [INFO ] [MAIN ] FTI: Loaded 54083 existing records. [2025-09-22T18:56:06.060971] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:56:06.061255] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-22T18:56:06.061303] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-22T18:56:06.062547] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-22T18:56:06.062608] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-22T18:56:06.127400] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-22T18:56:06.414361] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:56:06.922095] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-22T18:56:07.149906] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T18:56:07.579346] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T18:56:07.722054] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-22T18:56:08.522034] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-22T18:56:08.721502] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T18:56:09.083832] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-22T18:56:09.164408] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T18:56:09.322071] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-22T18:56:10.122073] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-22T18:56:10.670976] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T18:56:10.922052] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-22T18:56:10.992561] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T18:56:11.722032] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-22T18:56:11.778677] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T18:56:12.522091] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-22T18:56:13.044715] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T18:56:13.322051] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-22T18:56:13.561949] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T18:56:14.122066] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-22T18:56:14.241152] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T18:56:14.922071] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-22T18:56:15.712162] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T18:56:15.722007] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-22T18:56:15.753184] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T18:56:16.522054] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-22T18:56:16.541516] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T18:56:17.322081] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-22T18:56:17.720065] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T18:56:17.725074] [INFO ] [REMOTE ] FSS: Full fetch complete (48033 records). [2025-09-22T18:56:17.725185] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-22T18:56:18.059955] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-22T18:56:18.143800] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-22T18:56:18.127870] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-22T18:56:18.143964] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-22T18:56:18.144831] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-22T18:56:18.145147] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-22T18:56:18.147253] [DEBUG] [LOCAL ] FSS: Trimmed 48033 records to 34636 (keeping 200 days of data) [2025-09-22T18:56:18.386002] [DEBUG] [LOCAL ] FSS: Primary data saved (34636 records). [2025-09-22T18:56:18.386198] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-22T18:56:18.386308] [INFO ] [MAIN ] Update Progress: 877/2372 symbols completed. FSS took 33.4s. Estimated remaining: 3h 18m 9s. Rate: 7.5 symbols/min [2025-09-22T18:56:18.922145] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-22T18:56:19.722114] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-22T18:56:19.923395] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T18:56:20.031122] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T18:56:20.522053] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-22T18:56:21.322063] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-22T18:56:21.471046] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T18:56:22.105011] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-22T18:56:22.107281] [INFO ] [REMOTE ] FTHY: Full fetch complete (17663 records). [2025-09-22T18:56:22.107377] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-22T18:56:22.140940] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-22T18:56:22.493581] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-22T18:56:22.493730] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-22T18:56:22.494237] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-22T18:56:22.494338] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-22T18:56:22.495485] [DEBUG] [LOCAL ] FTHY: Trimmed 17663 records to 11687 (keeping 200 days of data) [2025-09-22T18:56:22.577042] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-22T18:56:22.595736] [INFO ] [REMOTE ] FSM: Full fetch complete (76678 records). [2025-09-22T18:56:22.605775] [DEBUG] [LOCAL ] FTHY: Primary data saved (11687 records). [2025-09-22T18:56:22.606021] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-22T18:56:22.606208] [INFO ] [MAIN ] Update Progress: 878/2372 symbols completed. FTHY took 21.2s. Estimated remaining: 3h 17m 55s. Rate: 7.5 symbols/min [2025-09-22T18:56:22.605931] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-22T18:56:22.999211] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-22T18:56:22.999290] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-22T18:56:23.000249] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-22T18:56:23.000313] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-22T18:56:23.001816] [DEBUG] [LOCAL ] FSM: Trimmed 76678 records to 53288 (keeping 200 days of data) [2025-09-22T18:56:23.320496] [DEBUG] [LOCAL ] FSM: Primary data saved (53288 records). [2025-09-22T18:56:23.320707] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-22T18:56:23.321013] [INFO ] [MAIN ] Update Progress: 879/2372 symbols completed. FSM took 44.8s. Estimated remaining: 3h 17m 35s. Rate: 7.6 symbols/min [2025-09-22T18:56:23.776865] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T18:56:23.791034] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-22T18:56:25.225029] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T18:56:25.236584] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-22T18:56:26.788610] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T18:56:26.801392] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-22T18:56:28.512239] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T18:56:28.523567] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-22T18:56:30.410292] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T18:56:30.419197] [INFO ] [REMOTE ] FTI: Full fetch complete (77124 records). [2025-09-22T18:56:30.419388] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-22T18:56:30.825490] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-22T18:56:30.825680] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-22T18:56:30.827110] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-22T18:56:30.827219] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-22T18:56:30.828904] [DEBUG] [LOCAL ] FTI: Trimmed 77124 records to 53303 (keeping 200 days of data) [2025-09-22T18:56:31.170158] [DEBUG] [LOCAL ] FTI: Primary data saved (53303 records). [2025-09-22T18:56:31.170317] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-22T18:56:31.170471] [INFO ] [MAIN ] Update Progress: 880/2372 symbols completed. FTI took 25.5s. Estimated remaining: 3h 17m 27s. Rate: 7.6 symbols/min [2025-09-22T18:56:31.773082] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:56:31.899879] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:56:31.927384] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:56:31.965704] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:56:31.974153] [DEBUG] [LOCAL ] FTWO: Loaded 1824 existing records from primary storage. [2025-09-22T18:56:31.974541] [INFO ] [MAIN ] FTWO: Loaded 1824 existing records. [2025-09-22T18:56:32.187883] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:56:32.188225] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-22T18:56:32.188276] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-22T18:56:32.188598] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-22T18:56:32.188711] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-22T18:56:32.285027] [DEBUG] [LOCAL ] FTK: Loaded 32433 existing records from primary storage. [2025-09-22T18:56:32.318274] [INFO ] [MAIN ] FTK: Loaded 32433 existing records. [2025-09-22T18:56:32.413248] [DEBUG] [LOCAL ] FTS: Loaded 42760 existing records from primary storage. [2025-09-22T18:56:32.451958] [INFO ] [MAIN ] FTS: Loaded 42760 existing records. [2025-09-22T18:56:32.474724] [DEBUG] [LOCAL ] FTV: Loaded 53674 existing records from primary storage. [2025-09-22T18:56:32.579497] [INFO ] [MAIN ] FTV: Loaded 53674 existing records. [2025-09-22T18:56:33.109002] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:56:33.174733] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:56:33.174503] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:56:33.198508] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-22T18:56:33.202038] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-22T18:56:33.208359] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-22T18:56:33.228684] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-22T18:56:33.235538] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-22T18:56:33.235363] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:56:33.236173] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-22T18:56:33.236244] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-22T18:56:33.236383] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-22T18:56:33.236483] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-22T18:56:33.248039] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-22T18:56:33.257546] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-22T18:56:33.266825] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-22T18:56:33.302186] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-22T18:56:33.942980] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T18:56:34.175869] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-22T18:56:34.349901] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:56:34.346805] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:56:34.388489] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-22T18:56:34.388065] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-22T18:56:34.412780] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:56:34.413899] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-22T18:56:34.898112] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T18:56:34.899835] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-22T18:56:35.262955] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-22T18:56:35.268198] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-22T18:56:35.344506] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T18:56:35.346300] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-22T18:56:35.770416] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-22T18:56:35.771626] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-22T18:56:35.830135] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T18:56:35.838408] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-22T18:56:36.137691] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T18:56:36.150810] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-22T18:56:36.153079] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-22T18:56:36.154578] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-22T18:56:36.208125] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T18:56:36.213584] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-22T18:56:36.503134] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-22T18:56:36.522072] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-22T18:56:36.830330] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-22T18:56:37.267425] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T18:56:37.322100] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-22T18:56:37.420058] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T18:56:37.445905] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T18:56:37.764184] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-22T18:56:38.122084] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-22T18:56:38.574474] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-22T18:56:38.922088] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-22T18:56:39.722069] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-22T18:56:40.193084] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T18:56:40.227455] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-22T18:56:40.228482] [INFO ] [REMOTE ] FTWO: Full fetch complete (3502 records). [2025-09-22T18:56:40.228578] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-22T18:56:40.527125] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-22T18:56:40.603739] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-22T18:56:40.603813] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-22T18:56:40.603931] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-22T18:56:40.603968] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-22T18:56:40.604310] [DEBUG] [LOCAL ] FTWO: Trimmed 3502 records to 1779 (keeping 200 days of data) [2025-09-22T18:56:40.617207] [DEBUG] [LOCAL ] FTWO: Primary data saved (1779 records). [2025-09-22T18:56:40.617274] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-22T18:56:40.617379] [INFO ] [MAIN ] Update Progress: 881/2372 symbols completed. FTWO took 9.4s. Estimated remaining: 3h 17m 21s. Rate: 7.6 symbols/min [2025-09-22T18:56:40.791368] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:56:40.857776] [DEBUG] [LOCAL ] FUBO: Loaded 54479 existing records from primary storage. [2025-09-22T18:56:40.857928] [INFO ] [MAIN ] FUBO: Loaded 54479 existing records. [2025-09-22T18:56:41.036054] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:56:41.036362] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-22T18:56:41.036417] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-22T18:56:41.038134] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-22T18:56:41.038194] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-22T18:56:41.327176] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-22T18:56:41.406383] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:56:41.711722] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T18:56:42.122068] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-22T18:56:42.922114] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-22T18:56:43.152221] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-22T18:56:43.502754] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T18:56:43.722065] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-22T18:56:44.522015] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-22T18:56:44.994821] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-22T18:56:45.140064] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T18:56:45.322089] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-22T18:56:45.998024] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T18:56:46.122084] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-22T18:56:46.904124] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T18:56:46.922016] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-22T18:56:47.722081] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-22T18:56:48.116320] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-22T18:56:48.525509] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-22T18:56:48.528131] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T18:56:49.322050] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-22T18:56:49.447044] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T18:56:50.122109] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-22T18:56:50.534677] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-22T18:56:50.747460] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T18:56:50.922071] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-22T18:56:51.722102] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-22T18:56:51.926276] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T18:56:52.522078] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-22T18:56:52.692793] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T18:56:52.776087] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T18:56:53.322061] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-22T18:56:54.059720] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T18:56:54.122066] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-22T18:56:54.557546] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T18:56:54.922106] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-22T18:56:55.438776] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T18:56:55.722114] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-22T18:56:56.522120] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-22T18:56:57.105407] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T18:56:57.151698] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-22T18:56:57.322069] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-22T18:56:57.788705] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T18:56:58.122062] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-22T18:56:58.922105] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-22T18:56:59.068695] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T18:56:59.460912] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T18:56:59.466325] [INFO ] [REMOTE ] FTK: Full fetch complete (42359 records). [2025-09-22T18:56:59.466421] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-22T18:56:59.727275] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-22T18:56:59.865232] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-22T18:56:59.865327] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-22T18:56:59.866074] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-22T18:56:59.866138] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-22T18:56:59.867311] [DEBUG] [LOCAL ] FTK: Trimmed 42359 records to 32110 (keeping 200 days of data) [2025-09-22T18:57:00.071707] [DEBUG] [LOCAL ] FTK: Primary data saved (32110 records). [2025-09-22T18:57:00.071881] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-22T18:57:00.072019] [INFO ] [MAIN ] Update Progress: 882/2372 symbols completed. FTK took 28.9s. Estimated remaining: 3h 17m 33s. Rate: 7.5 symbols/min [2025-09-22T18:57:00.259034] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:57:00.299888] [DEBUG] [LOCAL ] FUL: Loaded 33507 existing records from primary storage. [2025-09-22T18:57:00.300031] [INFO ] [MAIN ] FUL: Loaded 33507 existing records. [2025-09-22T18:57:00.480739] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:57:00.481056] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-22T18:57:00.481106] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-22T18:57:00.482242] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-22T18:57:00.482303] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-22T18:57:00.527178] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-22T18:57:00.857550] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:57:01.283467] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-22T18:57:01.322064] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-22T18:57:01.420280] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T18:57:02.122095] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-22T18:57:02.484166] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-22T18:57:02.491166] [INFO ] [REMOTE ] FTS: Full fetch complete (60060 records). [2025-09-22T18:57:02.491324] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-22T18:57:02.895034] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-22T18:57:02.895134] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-22T18:57:02.896078] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-22T18:57:02.896157] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-22T18:57:02.897515] [DEBUG] [LOCAL ] FTS: Trimmed 60060 records to 42110 (keeping 200 days of data) [2025-09-22T18:57:02.960707] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-22T18:57:03.171850] [DEBUG] [LOCAL ] FTS: Primary data saved (42110 records). [2025-09-22T18:57:03.172037] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-22T18:57:03.172152] [INFO ] [MAIN ] Update Progress: 883/2372 symbols completed. FTS took 32.0s. Estimated remaining: 3h 17m 17s. Rate: 7.5 symbols/min [2025-09-22T18:57:03.339855] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:57:03.389376] [DEBUG] [LOCAL ] FUN: Loaded 52303 existing records from primary storage. [2025-09-22T18:57:03.389540] [INFO ] [MAIN ] FUN: Loaded 52303 existing records. [2025-09-22T18:57:03.581877] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:57:03.582126] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-22T18:57:03.582191] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-22T18:57:03.583668] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-22T18:57:03.583734] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-22T18:57:03.966085] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:57:03.966445] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-22T18:57:04.862313] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-22T18:57:04.867814] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-22T18:57:05.190747] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (3.87 seconds). [2025-09-22T18:57:05.322027] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-22T18:57:05.377034] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T18:57:06.120110] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-09-22T18:57:06.131372] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-22T18:57:06.317162] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T18:57:06.922126] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-22T18:57:07.253461] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T18:57:07.714526] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T18:57:07.723385] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-22T18:57:08.399152] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T18:57:08.408020] [INFO ] [REMOTE ] FTV: Full fetch complete (76232 records). [2025-09-22T18:57:08.408150] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-22T18:57:08.527325] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-22T18:57:08.808319] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-22T18:57:08.808419] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-22T18:57:08.809441] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-22T18:57:08.809521] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-22T18:57:08.811196] [DEBUG] [LOCAL ] FTV: Trimmed 76232 records to 52917 (keeping 200 days of data) [2025-09-22T18:57:08.958988] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T18:57:09.172806] [DEBUG] [LOCAL ] FTV: Primary data saved (52917 records). [2025-09-22T18:57:09.172969] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-22T18:57:09.173057] [INFO ] [MAIN ] Update Progress: 884/2372 symbols completed. FTV took 38.0s. Estimated remaining: 3h 17m 5s. Rate: 7.5 symbols/min [2025-09-22T18:57:09.327530] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-22T18:57:09.347750] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:57:09.371691] [DEBUG] [LOCAL ] FVR: Loaded 22259 existing records from primary storage. [2025-09-22T18:57:09.371873] [INFO ] [MAIN ] FVR: Loaded 22259 existing records. [2025-09-22T18:57:09.551694] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:57:09.551966] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-22T18:57:09.552017] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-22T18:57:09.552779] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-22T18:57:09.552840] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-22T18:57:09.909601] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:57:10.122025] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-22T18:57:10.154530] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T18:57:10.922109] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-22T18:57:11.567002] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-22T18:57:11.617143] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T18:57:11.722014] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-22T18:57:12.522055] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-22T18:57:13.130672] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-22T18:57:13.322054] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-22T18:57:14.118873] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-22T18:57:14.127228] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-22T18:57:14.816249] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T18:57:14.897874] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T18:57:14.922010] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-22T18:57:15.611316] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-09-22T18:57:15.620393] [INFO ] [REMOTE ] FUBO: Full fetch complete (77750 records). [2025-09-22T18:57:15.620578] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-22T18:57:15.724993] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-22T18:57:16.012039] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T18:57:16.063746] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-22T18:57:16.063846] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-22T18:57:16.064844] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-22T18:57:16.064930] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-22T18:57:16.066752] [DEBUG] [LOCAL ] FUBO: Trimmed 77750 records to 53700 (keeping 200 days of data) [2025-09-22T18:57:16.381845] [DEBUG] [LOCAL ] FUBO: Primary data saved (53700 records). [2025-09-22T18:57:16.381992] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-22T18:57:16.382144] [INFO ] [MAIN ] Update Progress: 885/2372 symbols completed. FUBO took 35.8s. Estimated remaining: 3h 16m 56s. Rate: 7.6 symbols/min [2025-09-22T18:57:16.527245] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-22T18:57:16.581350] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:57:16.627219] [DEBUG] [LOCAL ] FVRR: Loaded 40863 existing records from primary storage. [2025-09-22T18:57:16.627426] [INFO ] [MAIN ] FVRR: Loaded 40863 existing records. [2025-09-22T18:57:16.826403] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:57:16.826979] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-22T18:57:16.833047] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-22T18:57:16.844702] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-22T18:57:16.844595] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T18:57:16.850528] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-22T18:57:17.242117] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:57:17.322016] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-22T18:57:18.103518] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T18:57:18.122006] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-22T18:57:18.531161] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T18:57:18.922050] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-22T18:57:19.639290] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T18:57:19.722054] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-22T18:57:20.068565] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T18:57:20.504115] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T18:57:20.522042] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-22T18:57:21.322089] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-22T18:57:21.607796] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T18:57:22.122078] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-22T18:57:22.358221] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T18:57:22.922063] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-22T18:57:23.722030] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-22T18:57:23.810491] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T18:57:24.017084] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T18:57:24.465628] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T18:57:24.522019] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-22T18:57:25.322056] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-22T18:57:25.691861] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-22T18:57:26.122049] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-22T18:57:26.645228] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T18:57:26.922058] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-22T18:57:27.493849] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T18:57:27.722057] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-22T18:57:28.401212] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T18:57:28.522062] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-22T18:57:29.231754] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T18:57:29.322067] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-22T18:57:30.078250] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T18:57:30.122048] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-22T18:57:30.922120] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-22T18:57:31.150579] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T18:57:31.159252] [INFO ] [REMOTE ] FUN: Full fetch complete (72324 records). [2025-09-22T18:57:31.159385] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-22T18:57:31.553365] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-22T18:57:31.553599] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-22T18:57:31.554633] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-22T18:57:31.554843] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-22T18:57:31.556701] [DEBUG] [LOCAL ] FUN: Trimmed 72324 records to 51566 (keeping 200 days of data) [2025-09-22T18:57:31.686781] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T18:57:31.751242] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-22T18:57:31.905870] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T18:57:31.918940] [DEBUG] [LOCAL ] FUN: Primary data saved (51566 records). [2025-09-22T18:57:31.919086] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-22T18:57:31.919173] [INFO ] [MAIN ] Update Progress: 886/2372 symbols completed. FUN took 28.7s. Estimated remaining: 3h 17m 1s. Rate: 7.5 symbols/min [2025-09-22T18:57:32.088940] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:57:32.092031] [DEBUG] [LOCAL ] FXED: Loaded 1232 existing records from primary storage. [2025-09-22T18:57:32.092102] [INFO ] [MAIN ] FXED: Loaded 1232 existing records. [2025-09-22T18:57:32.267254] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:57:32.267512] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-22T18:57:32.267568] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-22T18:57:32.267807] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-22T18:57:32.267866] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-22T18:57:32.527339] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-22T18:57:32.626253] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:57:33.322071] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-22T18:57:33.487154] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T18:57:33.663311] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-22T18:57:33.794273] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T18:57:34.122056] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-22T18:57:34.922053] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-22T18:57:35.236913] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T18:57:35.722076] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-22T18:57:36.223444] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T18:57:36.522113] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-22T18:57:36.684124] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T18:57:36.689727] [INFO ] [REMOTE ] FUL: Full fetch complete (46660 records). [2025-09-22T18:57:36.689820] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-22T18:57:37.071225] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-22T18:57:37.071323] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-22T18:57:37.072022] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-22T18:57:37.072084] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-22T18:57:37.073850] [DEBUG] [LOCAL ] FUL: Trimmed 46660 records to 33021 (keeping 200 days of data) [2025-09-22T18:57:37.273269] [DEBUG] [LOCAL ] FUL: Primary data saved (33021 records). [2025-09-22T18:57:37.273392] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-22T18:57:37.273471] [INFO ] [MAIN ] Update Progress: 887/2372 symbols completed. FUL took 37.2s. Estimated remaining: 3h 16m 49s. Rate: 7.5 symbols/min [2025-09-22T18:57:37.328432] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-22T18:57:37.447335] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:57:37.498557] [DEBUG] [LOCAL ] G: Loaded 50508 existing records from primary storage. [2025-09-22T18:57:37.498750] [INFO ] [MAIN ] G: Loaded 50508 existing records. [2025-09-22T18:57:37.682696] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:57:37.683087] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-22T18:57:37.683197] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-22T18:57:37.689559] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-22T18:57:37.695552] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-22T18:57:37.767514] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T18:57:38.073030] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:57:38.122003] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-22T18:57:38.928765] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-22T18:57:38.933779] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T18:57:38.942904] [INFO ] [REMOTE ] FVRR: Full fetch complete (58878 records). [2025-09-22T18:57:38.943086] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-22T18:57:39.343900] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-22T18:57:39.343977] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-22T18:57:39.344755] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-22T18:57:39.344817] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-22T18:57:39.346203] [DEBUG] [LOCAL ] FVRR: Trimmed 58878 records to 40203 (keeping 200 days of data) [2025-09-22T18:57:39.586864] [DEBUG] [LOCAL ] FVRR: Primary data saved (40203 records). [2025-09-22T18:57:39.586999] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-22T18:57:39.587081] [INFO ] [MAIN ] Update Progress: 888/2372 symbols completed. FVRR took 23.2s. Estimated remaining: 3h 16m 31s. Rate: 7.6 symbols/min [2025-09-22T18:57:39.730328] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-22T18:57:39.765361] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:57:39.839409] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T18:57:39.866205] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T18:57:39.870300] [INFO ] [REMOTE ] FVR: Full fetch complete (30750 records). [2025-09-22T18:57:39.870417] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-22T18:57:39.974787] [DEBUG] [LOCAL ] GAB: Loaded 28200 existing records from primary storage. [2025-09-22T18:57:39.985919] [INFO ] [MAIN ] GAB: Loaded 28200 existing records. [2025-09-22T18:57:40.270471] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-22T18:57:40.318627] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:57:40.381294] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-22T18:57:40.381476] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-22T18:57:40.387469] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-22T18:57:40.402940] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-22T18:57:40.526528] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-22T18:57:40.574457] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-22T18:57:40.586037] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-22T18:57:40.586740] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-22T18:57:40.586910] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-22T18:57:40.604368] [DEBUG] [LOCAL ] FVR: Trimmed 30750 records to 22151 (keeping 200 days of data) [2025-09-22T18:57:40.959593] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:57:41.000293] [DEBUG] [LOCAL ] FVR: Primary data saved (22151 records). [2025-09-22T18:57:41.000411] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-22T18:57:41.000486] [INFO ] [MAIN ] Update Progress: 889/2372 symbols completed. FVR took 31.8s. Estimated remaining: 3h 16m 13s. Rate: 7.6 symbols/min [2025-09-22T18:57:41.169486] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:57:41.175283] [DEBUG] [LOCAL ] GAM: Loaded 4398 existing records from primary storage. [2025-09-22T18:57:41.175365] [INFO ] [MAIN ] GAM: Loaded 4398 existing records. [2025-09-22T18:57:41.327150] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-22T18:57:41.361168] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:57:41.361513] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-22T18:57:41.361587] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-22T18:57:41.361914] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-22T18:57:41.361975] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-22T18:57:41.737570] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:57:41.821203] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T18:57:42.122056] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-22T18:57:42.460321] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-22T18:57:42.479133] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T18:57:42.922068] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-22T18:57:43.722064] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-22T18:57:44.069839] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T18:57:44.493799] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T18:57:44.522025] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-22T18:57:45.322094] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-22T18:57:45.969842] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T18:57:46.122114] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-22T18:57:46.307783] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T18:57:46.922111] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-22T18:57:47.343944] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-22T18:57:47.722101] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-22T18:57:47.796264] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T18:57:48.289105] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T18:57:48.522116] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-22T18:57:49.322084] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-22T18:57:49.942077] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T18:57:50.122084] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-22T18:57:50.355995] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T18:57:50.474466] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-22T18:57:50.922111] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-22T18:57:51.722043] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-22T18:57:51.952266] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T18:57:52.522057] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-22T18:57:53.322069] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-22T18:57:53.359173] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T18:57:53.821229] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T18:57:54.000710] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-22T18:57:54.122049] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-22T18:57:54.854931] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-22T18:57:54.922035] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-22T18:57:55.556748] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-22T18:57:55.722126] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-22T18:57:56.304220] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T18:57:56.522055] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-22T18:57:57.322075] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-22T18:57:57.658445] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-22T18:57:58.021267] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T18:57:58.122076] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-22T18:57:58.553608] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-22T18:57:58.922090] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-22T18:57:59.722098] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-22T18:58:00.154178] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T18:58:00.278549] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T18:58:00.522058] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-22T18:58:01.322074] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-22T18:58:01.897612] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T18:58:02.122067] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-22T18:58:02.316203] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T18:58:02.720986] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T18:58:02.922064] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-22T18:58:03.722070] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-22T18:58:03.865011] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T18:58:04.190753] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-22T18:58:04.522089] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-22T18:58:05.322054] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-22T18:58:05.749602] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-22T18:58:05.750699] [INFO ] [REMOTE ] GAM: Full fetch complete (6922 records). [2025-09-22T18:58:05.750775] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-22T18:58:06.125056] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-22T18:58:06.178962] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-22T18:58:06.179246] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-22T18:58:06.180011] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-22T18:58:06.181230] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-22T18:58:06.181147] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T18:58:06.190868] [DEBUG] [LOCAL ] GAM: Trimmed 6922 records to 4217 (keeping 200 days of data) [2025-09-22T18:58:06.191374] [INFO ] [REMOTE ] G: Full fetch complete (71558 records). [2025-09-22T18:58:06.191773] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-22T18:58:06.294206] [DEBUG] [LOCAL ] GAM: Primary data saved (4217 records). [2025-09-22T18:58:06.301293] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-22T18:58:06.317383] [INFO ] [MAIN ] Update Progress: 890/2372 symbols completed. GAM took 25.3s. Estimated remaining: 3h 16m 34s. Rate: 7.5 symbols/min [2025-09-22T18:58:06.613263] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:58:06.691297] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T18:58:06.710026] [INFO ] [REMOTE ] FXED: Full fetch complete (1776 records). [2025-09-22T18:58:06.722303] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-22T18:58:06.928733] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-22T18:58:06.934230] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-22T18:58:06.934298] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-22T18:58:06.935261] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-22T18:58:06.941415] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-22T18:58:07.037038] [DEBUG] [LOCAL ] G: Trimmed 71558 records to 49754 (keeping 200 days of data) [2025-09-22T18:58:07.256157] [DEBUG] [LOCAL ] GAP: Loaded 54435 existing records from primary storage. [2025-09-22T18:58:07.262349] [INFO ] [MAIN ] GAP: Loaded 54435 existing records. [2025-09-22T18:58:07.418386] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-22T18:58:07.426826] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-22T18:58:07.437747] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-22T18:58:07.447556] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-22T18:58:07.474490] [DEBUG] [LOCAL ] FXED: Trimmed 1776 records to 1217 (keeping 200 days of data) [2025-09-22T18:58:07.576615] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:58:07.575037] [DEBUG] [LOCAL ] FXED: Primary data saved (1217 records). [2025-09-22T18:58:07.577917] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-22T18:58:07.578466] [INFO ] [MAIN ] Update Progress: 891/2372 symbols completed. FXED took 35.7s. Estimated remaining: 3h 16m 14s. Rate: 7.5 symbols/min [2025-09-22T18:58:07.594697] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-22T18:58:07.598231] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-22T18:58:07.703975] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-22T18:58:07.727150] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-22T18:58:08.093628] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:58:08.132124] [DEBUG] [LOCAL ] G: Primary data saved (49754 records). [2025-09-22T18:58:08.142616] [INFO ] [MAIN ] G: Full history saved. [2025-09-22T18:58:08.170246] [INFO ] [MAIN ] Update Progress: 892/2372 symbols completed. G took 30.9s. Estimated remaining: 3h 15m 54s. Rate: 7.6 symbols/min [2025-09-22T18:58:08.267434] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T18:58:08.446763] [DEBUG] [LOCAL ] GATX: Loaded 18317 existing records from primary storage. [2025-09-22T18:58:08.454231] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-22T18:58:08.454518] [INFO ] [MAIN ] GATX: Loaded 18317 existing records. [2025-09-22T18:58:08.614305] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:58:08.647385] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-22T18:58:08.649043] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:58:08.795547] [DEBUG] [LOCAL ] GBAB: Loaded 13219 existing records from primary storage. [2025-09-22T18:58:08.811575] [INFO ] [MAIN ] GBAB: Loaded 13219 existing records. [2025-09-22T18:58:08.860525] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:58:08.892759] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-22T18:58:08.897971] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-22T18:58:08.908593] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-22T18:58:08.908699] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-22T18:58:09.130844] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:58:09.163515] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-22T18:58:09.163614] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-22T18:58:09.180383] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-22T18:58:09.228295] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-22T18:58:09.532085] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:58:09.548569] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-22T18:58:09.734239] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:58:09.750779] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-22T18:58:10.122040] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-22T18:58:10.284740] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T18:58:10.482686] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T18:58:10.922044] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-22T18:58:10.949963] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T18:58:11.722089] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-22T18:58:11.911065] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T18:58:12.522066] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-22T18:58:12.796206] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T18:58:13.322076] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-22T18:58:13.406876] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T18:58:13.411830] [INFO ] [REMOTE ] GAB: Full fetch complete (39378 records). [2025-09-22T18:58:13.411938] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-22T18:58:13.797159] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-22T18:58:13.797240] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-22T18:58:13.797883] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-22T18:58:13.797946] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-22T18:58:13.798877] [DEBUG] [LOCAL ] GAB: Trimmed 39378 records to 27907 (keeping 200 days of data) [2025-09-22T18:58:13.970769] [DEBUG] [LOCAL ] GAB: Primary data saved (27907 records). [2025-09-22T18:58:13.970919] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-22T18:58:13.971009] [INFO ] [MAIN ] Update Progress: 893/2372 symbols completed. GAB took 34.4s. Estimated remaining: 3h 15m 43s. Rate: 7.6 symbols/min [2025-09-22T18:58:14.133157] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-22T18:58:14.169412] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:58:14.213011] [DEBUG] [LOCAL ] GBCI: Loaded 40713 existing records from primary storage. [2025-09-22T18:58:14.213175] [INFO ] [MAIN ] GBCI: Loaded 40713 existing records. [2025-09-22T18:58:14.395589] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:58:14.395919] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-22T18:58:14.395970] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-22T18:58:14.397074] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-22T18:58:14.397161] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-22T18:58:14.798442] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:58:14.922105] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-22T18:58:15.029440] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T18:58:15.103887] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T18:58:15.722065] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-22T18:58:16.377457] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T18:58:16.522084] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-22T18:58:17.322150] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-22T18:58:17.389577] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T18:58:17.435594] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T18:58:18.122118] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-22T18:58:18.499771] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T18:58:18.922130] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-22T18:58:19.269631] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T18:58:19.722139] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-22T18:58:20.281400] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T18:58:20.455614] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T18:58:20.522027] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-22T18:58:21.322182] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-22T18:58:21.996626] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T18:58:22.128031] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-22T18:58:22.130357] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T18:58:22.922102] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-22T18:58:23.722062] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-22T18:58:24.020500] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T18:58:24.338056] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-22T18:58:24.380073] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T18:58:24.522039] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-22T18:58:25.322109] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-22T18:58:26.055529] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T18:58:26.081018] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T18:58:26.122031] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-22T18:58:26.922074] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-22T18:58:27.624710] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T18:58:27.674933] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T18:58:27.722039] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-22T18:58:28.522082] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-22T18:58:29.097550] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T18:58:29.322047] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-22T18:58:29.374275] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T18:58:30.122057] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-22T18:58:30.231924] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-22T18:58:30.823278] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T18:58:30.922051] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-22T18:58:31.722059] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-22T18:58:31.879872] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T18:58:32.522065] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-22T18:58:32.694806] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-22T18:58:33.322092] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-22T18:58:34.122058] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-22T18:58:34.374828] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T18:58:34.701960] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T18:58:34.922086] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-22T18:58:35.237347] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T18:58:35.241351] [INFO ] [REMOTE ] GATX: Full fetch complete (25358 records). [2025-09-22T18:58:35.241491] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-22T18:58:35.648942] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-22T18:58:35.649045] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-22T18:58:35.649743] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-22T18:58:35.649853] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-22T18:58:35.650691] [DEBUG] [LOCAL ] GATX: Trimmed 25358 records to 18149 (keeping 200 days of data) [2025-09-22T18:58:35.727151] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-22T18:58:35.787541] [DEBUG] [LOCAL ] GATX: Primary data saved (18149 records). [2025-09-22T18:58:35.787727] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-22T18:58:35.787891] [INFO ] [MAIN ] Update Progress: 894/2372 symbols completed. GATX took 28.2s. Estimated remaining: 3h 15m 58s. Rate: 7.5 symbols/min [2025-09-22T18:58:35.977506] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:58:35.977758] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-22T18:58:35.977816] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-22T18:58:35.977974] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-22T18:58:35.978019] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-22T18:58:35.978062] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-22T18:58:35.978113] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-22T18:58:36.372316] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:58:36.399680] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T18:58:36.522043] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-22T18:58:37.322113] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-22T18:58:37.734019] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-22T18:58:37.812496] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T18:58:37.825950] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-22T18:58:38.122063] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-22T18:58:38.922083] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-22T18:58:39.000873] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T18:58:39.003487] [INFO ] [REMOTE ] GBAB: Full fetch complete (20408 records). [2025-09-22T18:58:39.003561] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-22T18:58:39.395370] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-22T18:58:39.395452] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-22T18:58:39.396182] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-22T18:58:39.396254] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-22T18:58:39.398872] [DEBUG] [LOCAL ] GBAB: Trimmed 20408 records to 13020 (keeping 200 days of data) [2025-09-22T18:58:39.486968] [DEBUG] [LOCAL ] GBAB: Primary data saved (13020 records). [2025-09-22T18:58:39.487118] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-22T18:58:39.487249] [INFO ] [MAIN ] Update Progress: 895/2372 symbols completed. GBAB took 31.3s. Estimated remaining: 3h 15m 43s. Rate: 7.5 symbols/min [2025-09-22T18:58:39.669052] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:58:39.730235] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-22T18:58:39.733168] [DEBUG] [LOCAL ] GBTG: Loaded 41256 existing records from primary storage. [2025-09-22T18:58:39.733314] [INFO ] [MAIN ] GBTG: Loaded 41256 existing records. [2025-09-22T18:58:39.939097] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:58:39.939424] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-22T18:58:39.939497] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-22T18:58:39.940482] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-22T18:58:39.940571] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-22T18:58:40.377529] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:58:40.522048] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-22T18:58:40.620705] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T18:58:40.948189] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-22T18:58:41.059548] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T18:58:41.069099] [INFO ] [REMOTE ] GBCI: Full fetch complete (57691 records). [2025-09-22T18:58:41.069263] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-22T18:58:41.327211] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-22T18:58:41.472712] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-22T18:58:41.472800] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-22T18:58:41.473557] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-22T18:58:41.473600] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-22T18:58:41.477207] [DEBUG] [LOCAL ] GBCI: Trimmed 57691 records to 40084 (keeping 200 days of data) [2025-09-22T18:58:41.736403] [DEBUG] [LOCAL ] GBCI: Primary data saved (40084 records). [2025-09-22T18:58:41.736537] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-22T18:58:41.736681] [INFO ] [MAIN ] Update Progress: 896/2372 symbols completed. GBCI took 27.8s. Estimated remaining: 3h 15m 26s. Rate: 7.6 symbols/min [2025-09-22T18:58:41.811311] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T18:58:41.927042] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:58:41.970990] [DEBUG] [LOCAL ] GBX: Loaded 29882 existing records from primary storage. [2025-09-22T18:58:41.971392] [INFO ] [MAIN ] GBX: Loaded 29882 existing records. [2025-09-22T18:58:42.129589] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-22T18:58:42.173208] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:58:42.173901] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-22T18:58:42.174095] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-22T18:58:42.175239] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-22T18:58:42.175308] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-22T18:58:42.550398] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:58:42.567199] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T18:58:42.922105] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-22T18:58:43.722125] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-22T18:58:44.522098] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-22T18:58:44.938899] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T18:58:45.146773] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T18:58:45.322018] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-22T18:58:45.628969] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T18:58:46.122065] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-22T18:58:46.463528] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T18:58:46.474677] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T18:58:46.922068] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-22T18:58:47.722067] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-22T18:58:47.979339] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T18:58:48.137730] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-22T18:58:48.522082] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-22T18:58:49.322085] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-22T18:58:49.501737] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-22T18:58:50.122057] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-22T18:58:50.441226] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T18:58:50.922092] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-22T18:58:51.602245] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T18:58:51.722062] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-22T18:58:51.999046] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T18:58:52.522069] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-22T18:58:53.027884] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T18:58:53.322059] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-22T18:58:54.122014] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-22T18:58:54.219187] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T18:58:54.227546] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-22T18:58:54.227685] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-22T18:58:54.626393] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-22T18:58:54.626481] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-22T18:58:54.627446] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-22T18:58:54.627509] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-22T18:58:54.629179] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-09-22T18:58:54.922089] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-22T18:58:54.994306] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T18:58:55.007042] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-22T18:58:55.007472] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-22T18:58:55.007585] [INFO ] [MAIN ] Update Progress: 897/2372 symbols completed. GAP took 48.7s. Estimated remaining: 3h 15m 26s. Rate: 7.5 symbols/min [2025-09-22T18:58:55.180777] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:58:55.234578] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-22T18:58:55.234712] [DEBUG] [LOCAL ] GCI: Loaded 44929 existing records from primary storage. [2025-09-22T18:58:55.236795] [INFO ] [MAIN ] GCI: Loaded 44929 existing records. [2025-09-22T18:58:55.419053] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:58:55.419448] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-22T18:58:55.419507] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-22T18:58:55.421054] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-22T18:58:55.421118] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-22T18:58:55.727204] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-22T18:58:55.787101] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:58:55.812358] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T18:58:56.034956] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-22T18:58:56.522087] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-22T18:58:56.788765] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-22T18:58:57.322092] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-22T18:58:58.122082] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-22T18:58:58.640742] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T18:58:58.922089] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-22T18:58:59.618625] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T18:58:59.722066] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-22T18:59:00.385879] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T18:59:00.522071] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-22T18:59:00.890818] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T18:59:00.952315] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T18:59:01.322067] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-22T18:59:02.122100] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-22T18:59:02.922028] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-22T18:59:02.966342] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T18:59:03.250280] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T18:59:03.382086] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-22T18:59:03.382946] [INFO ] [REMOTE ] GBLI: Full fetch complete (1389 records). [2025-09-22T18:59:03.383016] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-22T18:59:03.383393] [FATAL] [VALIDATOR ] GBLI: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T18:59:03.383479] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T18:59:03.383540] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T18:59:03.383626] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-22T18:59:03.383737] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-22T18:59:03.383782] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-22T18:59:03.383824] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-22T18:59:03.383881] [INFO ] [MAIN ] Update Progress: 898/2372 symbols completed. GBLI took 27.6s. Estimated remaining: 3h 15m 19s. Rate: 7.5 symbols/min [2025-09-22T18:59:03.570017] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:59:03.601368] [DEBUG] [LOCAL ] GCO: Loaded 26266 existing records from primary storage. [2025-09-22T18:59:03.601510] [INFO ] [MAIN ] GCO: Loaded 26266 existing records. [2025-09-22T18:59:03.727257] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-22T18:59:03.784705] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:59:03.784972] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-22T18:59:03.785029] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-22T18:59:03.785781] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-22T18:59:03.785925] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-22T18:59:04.149725] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:59:04.522082] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-22T18:59:05.317462] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T18:59:05.325789] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-22T18:59:06.063882] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T18:59:06.122030] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-22T18:59:06.381721] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T18:59:06.922021] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-22T18:59:07.246796] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T18:59:07.706256] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T18:59:07.721997] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-22T18:59:08.417548] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-22T18:59:08.522050] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-22T18:59:09.322056] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-22T18:59:10.056522] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T18:59:10.063143] [INFO ] [REMOTE ] GBTG: Full fetch complete (56646 records). [2025-09-22T18:59:10.063257] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-22T18:59:10.128213] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-22T18:59:10.451981] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T18:59:10.475449] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-22T18:59:10.475714] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-22T18:59:10.476549] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-22T18:59:10.476628] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-22T18:59:10.476779] [INFO ] [REMOTE ] GBX: Full fetch complete (42653 records). [2025-09-22T18:59:10.477055] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-22T18:59:10.576972] [DEBUG] [LOCAL ] GBTG: Trimmed 56646 records to 40434 (keeping 200 days of data) [2025-09-22T18:59:10.927619] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-22T18:59:10.964965] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-22T18:59:10.965431] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-22T18:59:10.966543] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-22T18:59:10.966621] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-22T18:59:10.970547] [DEBUG] [LOCAL ] GBX: Trimmed 42653 records to 29314 (keeping 200 days of data) [2025-09-22T18:59:11.255318] [DEBUG] [LOCAL ] GBX: Primary data saved (29314 records). [2025-09-22T18:59:11.256497] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-22T18:59:11.256987] [INFO ] [MAIN ] Update Progress: 899/2372 symbols completed. GBX took 29.5s. Estimated remaining: 3h 15m 11s. Rate: 7.5 symbols/min [2025-09-22T18:59:11.443598] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:59:11.446269] [DEBUG] [LOCAL ] GCTS: No existing data file found in primary storage. [2025-09-22T18:59:11.446675] [WARN ] [MAIN ] GCTS: No existing data found, performing full refresh instead. [2025-09-22T18:59:11.449855] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-22T18:59:11.450347] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-22T18:59:11.450863] [DEBUG] [LOCAL ] GCTS: No primary data file found to delete. [2025-09-22T18:59:11.451966] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-22T18:59:11.502341] [DEBUG] [LOCAL ] GBTG: Primary data saved (40434 records). [2025-09-22T18:59:11.540867] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-22T18:59:11.552453] [INFO ] [MAIN ] Update Progress: 900/2372 symbols completed. GBTG took 32.1s. Estimated remaining: 3h 14m 51s. Rate: 7.6 symbols/min [2025-09-22T18:59:11.933209] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T18:59:12.018928] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-22T18:59:12.049810] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:59:12.071719] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:59:12.080320] [DEBUG] [LOCAL ] GCV: Loaded 7140 existing records from primary storage. [2025-09-22T18:59:12.080538] [INFO ] [MAIN ] GCV: Loaded 7140 existing records. [2025-09-22T18:59:12.263801] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:59:12.264052] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-22T18:59:12.264102] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-22T18:59:12.264465] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-22T18:59:12.264525] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-22T18:59:12.523363] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-22T18:59:12.645591] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:59:12.667175] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T18:59:13.322039] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-22T18:59:13.493682] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T18:59:13.513295] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T18:59:13.738880] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-22T18:59:14.122091] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-22T18:59:14.915943] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T18:59:14.922035] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-22T18:59:15.722031] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-22T18:59:16.026138] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T18:59:16.522069] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-22T18:59:16.565347] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T18:59:17.322071] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-22T18:59:18.025334] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T18:59:18.122067] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-22T18:59:18.384959] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T18:59:18.922080] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-22T18:59:19.722073] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-22T18:59:19.796407] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T18:59:19.844587] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T18:59:20.310003] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-22T18:59:20.522072] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-22T18:59:21.322086] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-22T18:59:21.690637] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T18:59:22.122053] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-22T18:59:22.230937] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T18:59:22.922072] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-22T18:59:23.728896] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-22T18:59:23.734742] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T18:59:23.807273] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T18:59:24.389346] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-22T18:59:24.522063] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-22T18:59:25.322055] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-22T18:59:25.720067] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T18:59:25.998958] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-22T18:59:26.122049] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-22T18:59:26.922055] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-22T18:59:27.593613] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T18:59:27.629977] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T18:59:27.722062] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-22T18:59:28.522109] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-22T18:59:28.591181] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T18:59:29.322065] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-22T18:59:30.122042] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-22T18:59:30.243491] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T18:59:30.459571] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T18:59:30.892460] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T18:59:30.922042] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-22T18:59:31.538189] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-22T18:59:31.722068] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-22T18:59:32.425027] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T18:59:32.522039] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-22T18:59:33.322059] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-22T18:59:34.122053] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-22T18:59:34.186745] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T18:59:34.237332] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T18:59:34.922091] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-22T18:59:35.004562] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T18:59:35.008750] [INFO ] [REMOTE ] GCO: Full fetch complete (36102 records). [2025-09-22T18:59:35.008831] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-22T18:59:35.396046] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-22T18:59:35.396128] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-22T18:59:35.396827] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-22T18:59:35.396909] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-22T18:59:35.397836] [DEBUG] [LOCAL ] GCO: Trimmed 36102 records to 25807 (keeping 200 days of data) [2025-09-22T18:59:35.556409] [DEBUG] [LOCAL ] GCO: Primary data saved (25807 records). [2025-09-22T18:59:35.556559] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-22T18:59:35.556670] [INFO ] [MAIN ] Update Progress: 901/2372 symbols completed. GCO took 32.2s. Estimated remaining: 3h 15m 9s. Rate: 7.5 symbols/min [2025-09-22T18:59:35.732437] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:59:35.727949] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-22T18:59:35.782514] [DEBUG] [LOCAL ] GD: Loaded 48133 existing records from primary storage. [2025-09-22T18:59:35.782698] [INFO ] [MAIN ] GD: Loaded 48133 existing records. [2025-09-22T18:59:35.970627] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:59:35.971049] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-22T18:59:35.971193] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-22T18:59:35.980828] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T18:59:35.982058] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-22T18:59:35.984611] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-22T18:59:36.357705] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:59:36.522039] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-22T18:59:37.296622] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T18:59:37.303739] [INFO ] [REMOTE ] GCI: Full fetch complete (63007 records). [2025-09-22T18:59:37.303857] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-22T18:59:37.327243] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-22T18:59:37.697562] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-22T18:59:37.697670] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-22T18:59:37.698479] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-22T18:59:37.698525] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-22T18:59:37.699846] [DEBUG] [LOCAL ] GCI: Trimmed 63007 records to 44231 (keeping 200 days of data) [2025-09-22T18:59:37.808377] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T18:59:37.815807] [INFO ] [REMOTE ] GCTS: Full fetch complete (26921 records). [2025-09-22T18:59:37.816429] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-22T18:59:38.134603] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-22T18:59:38.322329] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-22T18:59:38.322465] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-22T18:59:38.324852] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-22T18:59:38.325469] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-22T18:59:38.328547] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-22T18:59:38.329434] [INFO ] [REMOTE ] GCV: Full fetch complete (9268 records). [2025-09-22T18:59:38.330018] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-22T18:59:38.377965] [DEBUG] [LOCAL ] GCTS: Trimmed 26921 records to 19736 (keeping 200 days of data) [2025-09-22T18:59:38.873187] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-22T18:59:38.873868] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-22T18:59:38.874439] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-22T18:59:38.876044] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-22T18:59:38.891037] [DEBUG] [LOCAL ] GCV: Trimmed 9268 records to 7100 (keeping 200 days of data) [2025-09-22T18:59:38.903998] [DEBUG] [LOCAL ] GCTS: Primary data saved (19736 records). [2025-09-22T18:59:38.927330] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-22T18:59:38.939960] [INFO ] [MAIN ] Update Progress: 902/2372 symbols completed. GCTS took 27.7s. Estimated remaining: 3h 14m 53s. Rate: 7.5 symbols/min [2025-09-22T18:59:38.945019] [DEBUG] [LOCAL ] GCI: Primary data saved (44231 records). [2025-09-22T18:59:38.963329] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-22T18:59:38.968583] [INFO ] [MAIN ] Update Progress: 903/2372 symbols completed. GCI took 44.0s. Estimated remaining: 3h 14m 33s. Rate: 7.6 symbols/min [2025-09-22T18:59:39.214934] [DEBUG] [LOCAL ] GCV: Primary data saved (7100 records). [2025-09-22T18:59:39.333156] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:59:39.333230] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-22T18:59:39.329704] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:59:39.333457] [INFO ] [MAIN ] Update Progress: 904/2372 symbols completed. GCV took 27.8s. Estimated remaining: 3h 14m 12s. Rate: 7.6 symbols/min [2025-09-22T18:59:39.412500] [DEBUG] [LOCAL ] GDIV: Loaded 3814 existing records from primary storage. [2025-09-22T18:59:39.436146] [INFO ] [MAIN ] GDIV: Loaded 3814 existing records. [2025-09-22T18:59:39.605717] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T18:59:39.629769] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-22T18:59:39.635298] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-22T18:59:39.694190] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-22T18:59:39.728334] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:59:39.704796] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-22T18:59:39.729231] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-22T18:59:39.729417] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-22T18:59:39.775028] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-22T18:59:39.792525] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-22T18:59:39.801209] [DEBUG] [LOCAL ] GDDY: Loaded 50573 existing records from primary storage. [2025-09-22T18:59:39.828357] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-22T18:59:39.833672] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-22T18:59:39.833613] [INFO ] [MAIN ] GDDY: Loaded 50573 existing records. [2025-09-22T18:59:40.445788] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T18:59:40.490056] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-22T18:59:40.556284] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-22T18:59:40.608725] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:59:40.624615] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-22T18:59:40.630006] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-22T18:59:40.637160] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-22T18:59:40.797670] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:59:40.810941] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-22T18:59:41.063683] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-09-22T18:59:41.090345] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-22T18:59:41.155991] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T18:59:41.159471] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-22T18:59:41.204289] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-22T18:59:41.322001] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-22T18:59:41.868596] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-22T18:59:42.122064] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-22T18:59:42.827798] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T18:59:42.922012] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-22T18:59:43.010926] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T18:59:43.722058] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-22T18:59:44.280920] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T18:59:44.522056] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-22T18:59:44.766942] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T18:59:45.322089] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-22T18:59:45.783833] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T18:59:46.122043] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-22T18:59:46.200602] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T18:59:46.592579] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-22T18:59:46.922058] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-22T18:59:47.316497] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-22T18:59:47.722094] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-22T18:59:48.193358] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T18:59:48.522134] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-22T18:59:49.070692] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-22T18:59:49.322076] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-22T18:59:49.683983] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-22T18:59:50.122076] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-22T18:59:50.922071] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-22T18:59:51.331522] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-22T18:59:51.722035] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-22T18:59:51.806286] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T18:59:52.148897] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-22T18:59:52.522087] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-22T18:59:53.054490] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T18:59:53.322047] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-22T18:59:54.122129] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-22T18:59:54.534182] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-22T18:59:54.922067] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-22T18:59:55.157023] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T18:59:55.722116] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-22T18:59:56.522130] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-22T18:59:56.593171] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T18:59:56.979729] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-22T18:59:57.323066] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T18:59:57.323190] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-22T18:59:58.122096] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-22T18:59:58.921087] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T18:59:58.931026] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-22T18:59:59.409395] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-22T18:59:59.722092] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-22T18:59:59.944715] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T19:00:00.322627] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-22T19:00:00.323788] [INFO ] [REMOTE ] GDL: Full fetch complete (3582 records). [2025-09-22T19:00:00.323859] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-22T19:00:00.506343] [WARN ] [VALIDATOR ] GDL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T19:00:00.506586] [FATAL] [MAIN ] GDL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:00:00.506697] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:00:00.506796] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-22T19:00:00.506877] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-22T19:00:00.506918] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-09-22T19:00:00.506961] [DEBUG] [LOCAL ] GDL: No derivative data file found to delete. [2025-09-22T19:00:00.507021] [INFO ] [MAIN ] Update Progress: 905/2372 symbols completed. GDL took 21.2s. Estimated remaining: 3h 14m 26s. Rate: 7.5 symbols/min [2025-09-22T19:00:00.528952] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-22T19:00:00.693962] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:00:00.702339] [DEBUG] [LOCAL ] GDO: Loaded 6116 existing records from primary storage. [2025-09-22T19:00:00.702451] [INFO ] [MAIN ] GDO: Loaded 6116 existing records. [2025-09-22T19:00:00.894489] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:00:00.894799] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-22T19:00:00.894862] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-22T19:00:00.895234] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-22T19:00:00.895299] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-22T19:00:01.147566] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T19:00:01.283384] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:00:01.322064] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-22T19:00:02.122089] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-22T19:00:02.922102] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-22T19:00:03.722108] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-22T19:00:03.808845] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-22T19:00:03.810069] [INFO ] [REMOTE ] GDIV: Full fetch complete (5427 records). [2025-09-22T19:00:03.810144] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-22T19:00:04.223934] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-22T19:00:04.224049] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-22T19:00:04.224260] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-22T19:00:04.224302] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-22T19:00:04.224980] [DEBUG] [LOCAL ] GDIV: Trimmed 5427 records to 3716 (keeping 200 days of data) [2025-09-22T19:00:04.248978] [DEBUG] [LOCAL ] GDIV: Primary data saved (3716 records). [2025-09-22T19:00:04.249135] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-22T19:00:04.249225] [INFO ] [MAIN ] Update Progress: 906/2372 symbols completed. GDIV took 25.3s. Estimated remaining: 3h 14m 11s. Rate: 7.5 symbols/min [2025-09-22T19:00:04.427396] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:00:04.465203] [DEBUG] [LOCAL ] GDOT: Loaded 39273 existing records from primary storage. [2025-09-22T19:00:04.465349] [INFO ] [MAIN ] GDOT: Loaded 39273 existing records. [2025-09-22T19:00:04.659451] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:00:04.659827] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-22T19:00:04.659983] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-22T19:00:04.661174] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-22T19:00:04.661239] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-22T19:00:04.822037] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-22T19:00:04.847574] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-22T19:00:05.068175] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:00:05.322060] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-22T19:00:05.624842] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (3.50 seconds). [2025-09-22T19:00:05.862273] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-22T19:00:05.887460] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T19:00:06.122091] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-22T19:00:06.625787] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T19:00:06.922060] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-22T19:00:07.394235] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-22T19:00:07.722091] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-22T19:00:07.895789] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T19:00:08.522071] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-22T19:00:08.610017] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T19:00:09.216086] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-22T19:00:09.322068] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-22T19:00:10.122050] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-22T19:00:10.854885] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T19:00:10.922107] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-22T19:00:10.979677] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T19:00:11.722100] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-22T19:00:12.306381] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T19:00:12.493150] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T19:00:12.522011] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-22T19:00:13.322071] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-22T19:00:14.042213] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T19:00:14.122017] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-22T19:00:14.521543] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T19:00:14.922064] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-22T19:00:15.722094] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-22T19:00:16.081907] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T19:00:16.261429] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-22T19:00:16.522081] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-22T19:00:16.719331] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T19:00:16.727814] [INFO ] [REMOTE ] GD: Full fetch complete (70526 records). [2025-09-22T19:00:16.727948] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-22T19:00:17.124186] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-22T19:00:17.124284] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-22T19:00:17.125187] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-22T19:00:17.125253] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-22T19:00:17.126718] [DEBUG] [LOCAL ] GD: Trimmed 70526 records to 47324 (keeping 200 days of data) [2025-09-22T19:00:17.323689] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-22T19:00:17.439205] [DEBUG] [LOCAL ] GD: Primary data saved (47324 records). [2025-09-22T19:00:17.439386] [INFO ] [MAIN ] GD: Full history saved. [2025-09-22T19:00:17.439507] [INFO ] [MAIN ] Update Progress: 907/2372 symbols completed. GD took 41.9s. Estimated remaining: 3h 14m 12s. Rate: 7.5 symbols/min [2025-09-22T19:00:17.623363] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:00:17.643253] [DEBUG] [LOCAL ] GDV: Loaded 20234 existing records from primary storage. [2025-09-22T19:00:17.643389] [INFO ] [MAIN ] GDV: Loaded 20234 existing records. [2025-09-22T19:00:17.827025] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:00:17.827273] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-22T19:00:17.827320] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-22T19:00:17.827977] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-22T19:00:17.828037] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-22T19:00:17.949753] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-22T19:00:18.127152] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-22T19:00:18.207903] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:00:18.275746] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T19:00:18.922068] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-22T19:00:19.722071] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-22T19:00:20.501764] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-22T19:00:20.522004] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-22T19:00:20.923833] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-22T19:00:21.322064] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-22T19:00:22.028392] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T19:00:22.048715] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T19:00:22.122064] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-22T19:00:22.815583] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (3.89 seconds). [2025-09-22T19:00:22.823716] [INFO ] [REMOTE ] GDDY: Full fetch complete (71242 records). [2025-09-22T19:00:22.823860] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-22T19:00:22.927162] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-22T19:00:23.227046] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-22T19:00:23.227158] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-22T19:00:23.228084] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-22T19:00:23.228173] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-22T19:00:23.235135] [DEBUG] [LOCAL ] GDDY: Trimmed 71242 records to 49765 (keeping 200 days of data) [2025-09-22T19:00:23.242866] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T19:00:23.556404] [DEBUG] [LOCAL ] GDDY: Primary data saved (49765 records). [2025-09-22T19:00:23.556562] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-22T19:00:23.556698] [INFO ] [MAIN ] Update Progress: 908/2372 symbols completed. GDDY took 44.6s. Estimated remaining: 3h 14m 1s. Rate: 7.5 symbols/min [2025-09-22T19:00:23.665265] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T19:00:23.682594] [INFO ] [REMOTE ] GDO: Full fetch complete (9551 records). [2025-09-22T19:00:23.687837] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-22T19:00:23.770006] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:00:23.727228] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-22T19:00:23.802914] [DEBUG] [LOCAL ] GE: No existing data file found in primary storage. [2025-09-22T19:00:23.815093] [WARN ] [MAIN ] GE: No existing data found, performing full refresh instead. [2025-09-22T19:00:23.827022] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-22T19:00:23.842116] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-22T19:00:23.846473] [DEBUG] [LOCAL ] GE: No primary data file found to delete. [2025-09-22T19:00:23.846537] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-22T19:00:24.447477] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-22T19:00:24.463003] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-22T19:00:24.484234] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-22T19:00:24.522539] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-22T19:00:24.522669] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-22T19:00:24.529717] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:00:24.531453] [DEBUG] [LOCAL ] GDO: Trimmed 9551 records to 6067 (keeping 200 days of data) [2025-09-22T19:00:24.573321] [DEBUG] [LOCAL ] GDO: Primary data saved (6067 records). [2025-09-22T19:00:24.573447] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-22T19:00:24.573530] [INFO ] [MAIN ] Update Progress: 909/2372 symbols completed. GDO took 24.1s. Estimated remaining: 3h 13m 42s. Rate: 7.6 symbols/min [2025-09-22T19:00:24.743353] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:00:24.764582] [DEBUG] [LOCAL ] GEF: Loaded 21067 existing records from primary storage. [2025-09-22T19:00:24.764735] [INFO ] [MAIN ] GEF: Loaded 21067 existing records. [2025-09-22T19:00:24.942795] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:00:24.943076] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-22T19:00:24.943137] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-22T19:00:24.943930] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-22T19:00:24.943990] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-22T19:00:25.320720] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:00:25.328796] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-22T19:00:25.343510] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T19:00:25.534579] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T19:00:26.122044] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-22T19:00:26.206119] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T19:00:26.922054] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-22T19:00:27.529483] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T19:00:27.722062] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-22T19:00:28.019988] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T19:00:28.522064] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-22T19:00:29.167410] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T19:00:29.322076] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-22T19:00:29.599356] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T19:00:30.122059] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-22T19:00:30.350081] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T19:00:30.922058] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-22T19:00:31.658498] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T19:00:31.722019] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-22T19:00:31.770033] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T19:00:32.522063] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-22T19:00:33.014176] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T19:00:33.322067] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-22T19:00:34.122102] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-22T19:00:34.681852] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-22T19:00:34.890680] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T19:00:34.897214] [INFO ] [REMOTE ] GDOT: Full fetch complete (52426 records). [2025-09-22T19:00:34.897340] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-22T19:00:34.927157] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-22T19:00:35.258138] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-22T19:00:35.319110] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-22T19:00:35.319229] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-22T19:00:35.320242] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-22T19:00:35.320336] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-22T19:00:35.321848] [DEBUG] [LOCAL ] GDOT: Trimmed 52426 records to 38655 (keeping 200 days of data) [2025-09-22T19:00:35.549639] [DEBUG] [LOCAL ] GDOT: Primary data saved (38655 records). [2025-09-22T19:00:35.549817] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-22T19:00:35.549903] [INFO ] [MAIN ] Update Progress: 910/2372 symbols completed. GDOT took 31.3s. Estimated remaining: 3h 13m 38s. Rate: 7.6 symbols/min [2025-09-22T19:00:35.717146] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:00:35.722053] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-22T19:00:35.755316] [DEBUG] [LOCAL ] GEL: Loaded 34950 existing records from primary storage. [2025-09-22T19:00:35.755465] [INFO ] [MAIN ] GEL: Loaded 34950 existing records. [2025-09-22T19:00:35.930730] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:00:35.931012] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-22T19:00:35.931068] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-22T19:00:35.932128] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-22T19:00:35.932189] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-22T19:00:36.286122] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:00:36.522061] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-22T19:00:37.046381] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T19:00:37.287529] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-22T19:00:37.322012] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-22T19:00:37.362629] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-22T19:00:37.922438] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-22T19:00:38.122051] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-22T19:00:38.922066] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-22T19:00:39.722043] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-22T19:00:40.104422] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T19:00:40.298928] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-22T19:00:40.522068] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-22T19:00:40.949621] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T19:00:41.322067] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-22T19:00:42.122077] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-22T19:00:42.416545] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T19:00:42.520184] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T19:00:42.888235] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T19:00:42.922047] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-22T19:00:43.722110] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-22T19:00:43.869024] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T19:00:44.522090] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-22T19:00:44.795429] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T19:00:45.322070] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-22T19:00:45.489163] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-22T19:00:46.122043] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-22T19:00:46.499476] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T19:00:46.503569] [INFO ] [REMOTE ] GEF: Full fetch complete (29410 records). [2025-09-22T19:00:46.503688] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-22T19:00:46.913904] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-22T19:00:46.914045] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-22T19:00:46.914697] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-22T19:00:46.914771] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-22T19:00:46.916534] [DEBUG] [LOCAL ] GEF: Trimmed 29410 records to 20694 (keeping 200 days of data) [2025-09-22T19:00:46.922053] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-22T19:00:47.055353] [DEBUG] [LOCAL ] GEF: Primary data saved (20694 records). [2025-09-22T19:00:47.055492] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-22T19:00:47.055576] [INFO ] [MAIN ] Update Progress: 911/2372 symbols completed. GEF took 22.5s. Estimated remaining: 3h 13m 36s. Rate: 7.5 symbols/min [2025-09-22T19:00:47.225493] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:00:47.283464] [DEBUG] [LOCAL ] GENI: Loaded 53692 existing records from primary storage. [2025-09-22T19:00:47.283638] [INFO ] [MAIN ] GENI: Loaded 53692 existing records. [2025-09-22T19:00:47.464075] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:00:47.464471] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-22T19:00:47.464590] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-22T19:00:47.474207] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-22T19:00:47.485927] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-22T19:00:47.519981] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T19:00:47.731608] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-22T19:00:47.878171] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:00:48.522058] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-22T19:00:49.072485] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T19:00:49.183705] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-22T19:00:49.322074] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-22T19:00:50.017371] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T19:00:50.034714] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T19:00:50.037588] [INFO ] [REMOTE ] GDV: Full fetch complete (28828 records). [2025-09-22T19:00:50.037704] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-22T19:00:50.127177] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-22T19:00:50.422510] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-22T19:00:50.422598] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-22T19:00:50.423499] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-22T19:00:50.423596] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-22T19:00:50.424479] [DEBUG] [LOCAL ] GDV: Trimmed 28828 records to 19856 (keeping 200 days of data) [2025-09-22T19:00:50.561057] [DEBUG] [LOCAL ] GDV: Primary data saved (19856 records). [2025-09-22T19:00:50.561261] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-22T19:00:50.561431] [INFO ] [MAIN ] Update Progress: 912/2372 symbols completed. GDV took 33.1s. Estimated remaining: 3h 13m 21s. Rate: 7.6 symbols/min [2025-09-22T19:00:50.730918] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:00:50.784323] [DEBUG] [LOCAL ] GEO: Loaded 52962 existing records from primary storage. [2025-09-22T19:00:50.784482] [INFO ] [MAIN ] GEO: Loaded 52962 existing records. [2025-09-22T19:00:50.927293] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-22T19:00:50.967755] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:00:50.968042] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-22T19:00:50.968128] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-22T19:00:50.969290] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-22T19:00:50.969355] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-22T19:00:51.346058] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:00:51.722270] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-22T19:00:52.472295] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-22T19:00:52.524615] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-22T19:00:52.541190] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T19:00:53.322203] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-22T19:00:53.458114] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T19:00:54.122084] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-22T19:00:54.419435] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T19:00:54.506574] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-22T19:00:54.922083] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-22T19:00:55.719909] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T19:00:55.728598] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-22T19:00:56.299549] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T19:00:56.522067] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-22T19:00:57.322159] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-22T19:00:57.813999] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-22T19:00:58.122055] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-22T19:00:58.236471] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T19:00:58.878845] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T19:00:58.922034] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-22T19:00:59.722071] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-22T19:01:00.400030] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-22T19:01:00.522058] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-22T19:01:00.743849] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T19:01:01.057522] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T19:01:01.322064] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-22T19:01:02.032527] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T19:01:02.122072] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-22T19:01:02.762162] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T19:01:02.922066] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-22T19:01:03.722074] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-22T19:01:03.990675] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-22T19:01:04.522102] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-22T19:01:05.268755] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-22T19:01:05.277448] [INFO ] [REMOTE ] GE: Full fetch complete (77778 records). [2025-09-22T19:01:05.277623] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-22T19:01:05.327129] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-22T19:01:05.704494] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-22T19:01:05.704630] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-22T19:01:05.705911] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-22T19:01:05.706055] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-22T19:01:05.748281] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-22T19:01:05.748514] [DEBUG] [LOCAL ] GE: Trimmed 77778 records to 53713 (keeping 200 days of data) [2025-09-22T19:01:06.108824] [DEBUG] [LOCAL ] GE: Primary data saved (53713 records). [2025-09-22T19:01:06.108975] [INFO ] [MAIN ] GE: Full history saved. [2025-09-22T19:01:06.109098] [INFO ] [MAIN ] Update Progress: 913/2372 symbols completed. GE took 42.6s. Estimated remaining: 3h 13m 25s. Rate: 7.5 symbols/min [2025-09-22T19:01:06.124832] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-22T19:01:06.292047] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:01:06.328907] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T19:01:06.374698] [DEBUG] [LOCAL ] GES: Loaded 41008 existing records from primary storage. [2025-09-22T19:01:06.374845] [INFO ] [MAIN ] GES: Loaded 41008 existing records. [2025-09-22T19:01:06.556864] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:01:06.557406] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-22T19:01:06.557461] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-22T19:01:06.558570] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-22T19:01:06.558697] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-22T19:01:06.921080] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:01:06.922046] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-22T19:01:06.945760] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T19:01:07.708607] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T19:01:07.722007] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-22T19:01:08.522032] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-22T19:01:08.570132] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T19:01:09.322068] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-22T19:01:09.403906] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T19:01:09.742785] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T19:01:09.747302] [INFO ] [REMOTE ] GEL: Full fetch complete (48642 records). [2025-09-22T19:01:09.747414] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-22T19:01:10.125836] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-22T19:01:10.143346] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-22T19:01:10.143446] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-22T19:01:10.144212] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-22T19:01:10.144279] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-22T19:01:10.145673] [DEBUG] [LOCAL ] GEL: Trimmed 48642 records to 34191 (keeping 200 days of data) [2025-09-22T19:01:10.373206] [DEBUG] [LOCAL ] GEL: Primary data saved (34191 records). [2025-09-22T19:01:10.373369] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-22T19:01:10.373509] [INFO ] [MAIN ] Update Progress: 914/2372 symbols completed. GEL took 34.8s. Estimated remaining: 3h 13m 12s. Rate: 7.5 symbols/min [2025-09-22T19:01:10.553133] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:01:10.620530] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T19:01:10.621228] [DEBUG] [LOCAL ] GETY: Loaded 36842 existing records from primary storage. [2025-09-22T19:01:10.629882] [INFO ] [MAIN ] GETY: Loaded 36842 existing records. [2025-09-22T19:01:10.806470] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:01:10.806795] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-22T19:01:10.806848] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-22T19:01:10.807710] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-22T19:01:10.807770] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-22T19:01:10.927193] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-22T19:01:11.175318] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:01:11.722068] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-22T19:01:12.152675] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-22T19:01:12.522048] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-22T19:01:12.807707] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T19:01:12.870783] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T19:01:13.322070] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-22T19:01:14.027166] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T19:01:14.122083] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-22T19:01:14.922057] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-22T19:01:15.160771] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T19:01:15.573615] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T19:01:15.582328] [INFO ] [REMOTE ] GENI: Full fetch complete (75435 records). [2025-09-22T19:01:15.582462] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-22T19:01:15.727146] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-22T19:01:16.024302] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-22T19:01:16.024409] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-22T19:01:16.025450] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-22T19:01:16.025518] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-22T19:01:16.029902] [DEBUG] [LOCAL ] GENI: Trimmed 75435 records to 52914 (keeping 200 days of data) [2025-09-22T19:01:16.388019] [DEBUG] [LOCAL ] GENI: Primary data saved (52914 records). [2025-09-22T19:01:16.388222] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-22T19:01:16.388429] [INFO ] [MAIN ] Update Progress: 915/2372 symbols completed. GENI took 29.3s. Estimated remaining: 3h 13m 0s. Rate: 7.5 symbols/min [2025-09-22T19:01:16.527166] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-22T19:01:16.591508] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:01:16.657785] [DEBUG] [LOCAL ] GEV: Loaded 53932 existing records from primary storage. [2025-09-22T19:01:16.657951] [INFO ] [MAIN ] GEV: Loaded 53932 existing records. [2025-09-22T19:01:16.859582] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:01:16.860070] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-22T19:01:16.860295] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-22T19:01:16.862078] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-22T19:01:16.862149] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-22T19:01:17.098100] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-22T19:01:17.295839] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:01:17.326129] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-22T19:01:17.329083] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T19:01:17.753490] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T19:01:18.122075] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-22T19:01:18.922082] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-22T19:01:19.492413] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-22T19:01:19.722082] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-22T19:01:19.783980] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T19:01:20.188756] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T19:01:20.522115] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-22T19:01:21.322113] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-22T19:01:21.800910] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-22T19:01:22.122060] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-22T19:01:22.147021] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T19:01:22.154953] [INFO ] [REMOTE ] GEO: Full fetch complete (75627 records). [2025-09-22T19:01:22.155071] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-22T19:01:22.552941] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-22T19:01:22.553032] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-22T19:01:22.553966] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-22T19:01:22.554039] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-22T19:01:22.555562] [DEBUG] [LOCAL ] GEO: Trimmed 75627 records to 52179 (keeping 200 days of data) [2025-09-22T19:01:22.870522] [DEBUG] [LOCAL ] GEO: Primary data saved (52179 records). [2025-09-22T19:01:22.870710] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-22T19:01:22.870837] [INFO ] [MAIN ] Update Progress: 916/2372 symbols completed. GEO took 32.3s. Estimated remaining: 3h 12m 50s. Rate: 7.6 symbols/min [2025-09-22T19:01:22.937541] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-22T19:01:23.052567] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:01:23.083850] [DEBUG] [LOCAL ] GF: Loaded 3524 existing records from primary storage. [2025-09-22T19:01:23.083629] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T19:01:23.084022] [INFO ] [MAIN ] GF: Loaded 3524 existing records. [2025-09-22T19:01:23.271834] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:01:23.272093] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-22T19:01:23.272154] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-22T19:01:23.272413] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-22T19:01:23.272470] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-22T19:01:23.636063] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:01:23.722006] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-22T19:01:23.984570] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T19:01:24.522059] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-22T19:01:24.673612] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T19:01:24.867939] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T19:01:25.322058] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-22T19:01:26.122062] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-22T19:01:26.594075] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-22T19:01:26.639446] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-22T19:01:26.748973] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T19:01:26.922067] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-22T19:01:27.722092] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-22T19:01:28.522076] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-22T19:01:29.154523] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T19:01:29.232056] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-22T19:01:29.322056] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-22T19:01:29.560120] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T19:01:30.122083] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-22T19:01:30.748262] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T19:01:30.922065] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-22T19:01:31.385533] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T19:01:31.442497] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T19:01:31.722049] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-22T19:01:32.522069] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-22T19:01:33.283941] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T19:01:33.321998] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-22T19:01:34.122079] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-22T19:01:34.523020] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-22T19:01:34.922041] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-22T19:01:34.989423] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T19:01:35.231378] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T19:01:35.538365] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T19:01:35.722083] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-22T19:01:36.522058] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-22T19:01:37.290422] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T19:01:37.322084] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-22T19:01:37.676105] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-22T19:01:38.122056] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-22T19:01:38.485583] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T19:01:38.491473] [INFO ] [REMOTE ] GETY: Full fetch complete (55819 records). [2025-09-22T19:01:38.491624] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-22T19:01:38.906487] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-22T19:01:38.906588] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-22T19:01:38.907381] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-22T19:01:38.907450] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-22T19:01:38.908798] [DEBUG] [LOCAL ] GETY: Trimmed 55819 records to 36102 (keeping 200 days of data) [2025-09-22T19:01:38.968172] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-22T19:01:39.135532] [DEBUG] [LOCAL ] GETY: Primary data saved (36102 records). [2025-09-22T19:01:39.135704] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-22T19:01:39.135814] [INFO ] [MAIN ] Update Progress: 917/2372 symbols completed. GETY took 28.8s. Estimated remaining: 3h 12m 55s. Rate: 7.5 symbols/min [2025-09-22T19:01:39.370172] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-22T19:01:39.722063] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-22T19:01:40.407355] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-22T19:01:40.423723] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T19:01:40.522041] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-22T19:01:41.126170] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T19:01:41.322034] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-22T19:01:41.755604] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-22T19:01:42.122052] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-22T19:01:42.922083] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-22T19:01:43.400800] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-22T19:01:43.722052] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-22T19:01:44.242570] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-22T19:01:44.243503] [INFO ] [REMOTE ] GF: Full fetch complete (5406 records). [2025-09-22T19:01:44.243590] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-22T19:01:44.532103] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-22T19:01:44.629414] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-22T19:01:44.629619] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-22T19:01:44.629829] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-22T19:01:44.629905] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-22T19:01:44.630581] [DEBUG] [LOCAL ] GF: Trimmed 5406 records to 3368 (keeping 200 days of data) [2025-09-22T19:01:44.652406] [DEBUG] [LOCAL ] GF: Primary data saved (3368 records). [2025-09-22T19:01:44.652550] [INFO ] [MAIN ] GF: Full history saved. [2025-09-22T19:01:44.652752] [INFO ] [MAIN ] Update Progress: 918/2372 symbols completed. GF took 21.8s. Estimated remaining: 3h 12m 44s. Rate: 7.5 symbols/min [2025-09-22T19:01:44.682256] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-22T19:01:45.322084] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-22T19:01:45.902750] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T19:01:45.909312] [INFO ] [REMOTE ] GES: Full fetch complete (60179 records). [2025-09-22T19:01:45.909526] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-22T19:01:46.477777] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-22T19:01:46.477957] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-22T19:01:46.479567] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-22T19:01:46.479689] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-22T19:01:46.481537] [DEBUG] [LOCAL ] GES: Trimmed 60179 records to 40196 (keeping 200 days of data) [2025-09-22T19:01:46.791871] [DEBUG] [LOCAL ] GES: Primary data saved (40196 records). [2025-09-22T19:01:46.792002] [INFO ] [MAIN ] GES: Full history saved. [2025-09-22T19:01:46.792290] [INFO ] [MAIN ] Update Progress: 919/2372 symbols completed. GES took 40.7s. Estimated remaining: 3h 12m 26s. Rate: 7.6 symbols/min [2025-09-22T19:01:47.843174] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-22T19:01:47.851518] [INFO ] [REMOTE ] GEV: Full fetch complete (76996 records). [2025-09-22T19:01:47.851678] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-22T19:01:48.255494] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-22T19:01:48.255578] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-22T19:01:48.256612] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-22T19:01:48.256707] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-22T19:01:48.258369] [DEBUG] [LOCAL ] GEV: Trimmed 76996 records to 53150 (keeping 200 days of data) [2025-09-22T19:01:48.599891] [DEBUG] [LOCAL ] GEV: Primary data saved (53150 records). [2025-09-22T19:01:48.600032] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-22T19:01:48.600118] [INFO ] [MAIN ] Update Progress: 920/2372 symbols completed. GEV took 32.2s. Estimated remaining: 3h 12m 9s. Rate: 7.6 symbols/min [2025-09-22T19:01:49.205378] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:01:49.298921] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:01:49.289928] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:01:49.319150] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:01:49.328213] [DEBUG] [LOCAL ] GFR: Loaded 8622 existing records from primary storage. [2025-09-22T19:01:49.328428] [INFO ] [MAIN ] GFR: Loaded 8622 existing records. [2025-09-22T19:01:49.570076] [DEBUG] [LOCAL ] GFF: Loaded 31628 existing records from primary storage. [2025-09-22T19:01:49.568733] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:01:49.570946] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-22T19:01:49.571090] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-22T19:01:49.571517] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-22T19:01:49.571577] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-22T19:01:49.570397] [INFO ] [MAIN ] GFF: Loaded 31628 existing records. [2025-09-22T19:01:49.798281] [DEBUG] [LOCAL ] GFL: Loaded 48895 existing records from primary storage. [2025-09-22T19:01:49.814013] [INFO ] [MAIN ] GFL: Loaded 48895 existing records. [2025-09-22T19:01:49.974321] [DEBUG] [LOCAL ] GFI: Loaded 53872 existing records from primary storage. [2025-09-22T19:01:50.084531] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:01:50.120997] [INFO ] [MAIN ] GFI: Loaded 53872 existing records. [2025-09-22T19:01:50.167689] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-22T19:01:50.183286] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-22T19:01:50.238958] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-22T19:01:50.275190] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-22T19:01:50.530626] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:01:50.667263] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-22T19:01:50.644804] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:01:50.672860] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-22T19:01:50.673023] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:01:50.679938] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-22T19:01:50.679876] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-22T19:01:50.692296] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-22T19:01:50.692118] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-22T19:01:50.752142] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-22T19:01:50.755262] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-22T19:01:50.793623] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-22T19:01:51.319037] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:01:51.362769] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-22T19:01:51.698339] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:01:51.678105] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T19:01:51.709077] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-22T19:01:51.738786] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-22T19:01:51.744099] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:01:51.746374] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-22T19:01:52.320523] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T19:01:52.323188] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-22T19:01:52.556397] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T19:01:52.562319] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-22T19:01:53.053422] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-22T19:01:53.055836] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-22T19:01:53.281745] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T19:01:53.291146] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-22T19:01:53.507273] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:01:53.517305] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-22T19:01:53.709086] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-22T19:01:54.017684] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T19:01:54.122041] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-22T19:01:54.729962] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T19:01:54.922092] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-22T19:01:54.939530] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T19:01:55.706604] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-22T19:01:55.722000] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-22T19:01:56.142095] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T19:01:56.401762] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T19:01:56.522070] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-22T19:01:57.322061] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-22T19:01:58.061420] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T19:01:58.122012] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-22T19:01:58.922124] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-22T19:01:59.141284] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T19:01:59.470471] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-22T19:01:59.716088] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T19:01:59.727111] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-22T19:02:00.397266] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-22T19:02:00.522076] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-22T19:02:01.322095] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-22T19:02:01.933718] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T19:02:02.122072] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-22T19:02:02.922088] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-22T19:02:03.241868] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T19:02:03.587501] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T19:02:03.722074] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-22T19:02:04.522047] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-22T19:02:04.633636] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T19:02:04.811872] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T19:02:05.090636] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-22T19:02:05.322029] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-22T19:02:06.115307] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T19:02:06.116898] [INFO ] [REMOTE ] GFR: Full fetch complete (12949 records). [2025-09-22T19:02:06.117012] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-22T19:02:06.127107] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-22T19:02:06.521792] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-22T19:02:06.521914] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-22T19:02:06.522265] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-22T19:02:06.522309] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-22T19:02:06.522862] [DEBUG] [LOCAL ] GFR: Trimmed 12949 records to 8382 (keeping 200 days of data) [2025-09-22T19:02:06.580439] [DEBUG] [LOCAL ] GFR: Primary data saved (8382 records). [2025-09-22T19:02:06.580612] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-22T19:02:06.580739] [INFO ] [MAIN ] Update Progress: 921/2372 symbols completed. GFR took 18.0s. Estimated remaining: 3h 12m 17s. Rate: 7.5 symbols/min [2025-09-22T19:02:06.760613] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:02:06.810973] [DEBUG] [LOCAL ] GGB: Loaded 51759 existing records from primary storage. [2025-09-22T19:02:06.811154] [INFO ] [MAIN ] GGB: Loaded 51759 existing records. [2025-09-22T19:02:06.927237] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-22T19:02:06.995804] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:02:06.996060] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-22T19:02:06.996111] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-22T19:02:06.997264] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-22T19:02:06.997325] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-22T19:02:07.385877] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:02:07.722085] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-22T19:02:08.355346] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-22T19:02:08.522043] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-22T19:02:08.573053] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T19:02:08.768242] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T19:02:09.322066] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-22T19:02:10.122026] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-22T19:02:10.306121] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T19:02:10.810332] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T19:02:10.922087] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-22T19:02:11.722062] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-22T19:02:11.936665] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T19:02:12.153495] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T19:02:12.522080] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-22T19:02:12.970954] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T19:02:13.322060] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-22T19:02:14.122074] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-22T19:02:14.171515] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T19:02:14.394805] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T19:02:14.922055] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-22T19:02:15.692980] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T19:02:15.722040] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-22T19:02:16.169387] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T19:02:16.174188] [INFO ] [REMOTE ] GFF: Full fetch complete (44205 records). [2025-09-22T19:02:16.174291] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-22T19:02:16.526368] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-22T19:02:16.560984] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-22T19:02:16.561057] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-22T19:02:16.561890] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-22T19:02:16.561955] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-22T19:02:16.563071] [DEBUG] [LOCAL ] GFF: Trimmed 44205 records to 30950 (keeping 200 days of data) [2025-09-22T19:02:16.759014] [DEBUG] [LOCAL ] GFF: Primary data saved (30950 records). [2025-09-22T19:02:16.759155] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-22T19:02:16.759242] [INFO ] [MAIN ] Update Progress: 922/2372 symbols completed. GFF took 28.2s. Estimated remaining: 3h 12m 12s. Rate: 7.5 symbols/min [2025-09-22T19:02:16.930523] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:02:16.971232] [DEBUG] [LOCAL ] GGG: Loaded 41753 existing records from primary storage. [2025-09-22T19:02:16.971374] [INFO ] [MAIN ] GGG: Loaded 41753 existing records. [2025-09-22T19:02:17.153475] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:02:17.153767] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-22T19:02:17.153823] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-22T19:02:17.154697] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-22T19:02:17.154757] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-22T19:02:17.327399] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-22T19:02:17.526878] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:02:17.552829] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-22T19:02:18.122055] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-22T19:02:18.306031] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T19:02:18.313962] [INFO ] [REMOTE ] GFL: Full fetch complete (68630 records). [2025-09-22T19:02:18.314119] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-22T19:02:18.704868] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-22T19:02:18.704982] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-22T19:02:18.705860] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-22T19:02:18.705924] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-22T19:02:18.707309] [DEBUG] [LOCAL ] GFL: Trimmed 68630 records to 48052 (keeping 200 days of data) [2025-09-22T19:02:18.925840] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-22T19:02:19.010556] [DEBUG] [LOCAL ] GFL: Primary data saved (48052 records). [2025-09-22T19:02:19.010722] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-22T19:02:19.010821] [INFO ] [MAIN ] Update Progress: 923/2372 symbols completed. GFL took 30.4s. Estimated remaining: 3h 11m 55s. Rate: 7.5 symbols/min [2025-09-22T19:02:19.187192] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:02:19.219961] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T19:02:19.241413] [DEBUG] [LOCAL ] GGT: Loaded 14290 existing records from primary storage. [2025-09-22T19:02:19.241961] [INFO ] [MAIN ] GGT: Loaded 14290 existing records. [2025-09-22T19:02:19.422975] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T19:02:19.457273] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:02:19.458081] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-22T19:02:19.458146] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-22T19:02:19.458580] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-22T19:02:19.458685] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-22T19:02:19.727127] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-22T19:02:19.832126] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:02:20.522075] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-22T19:02:20.599176] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T19:02:21.322029] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-22T19:02:21.364081] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T19:02:21.389823] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T19:02:22.122052] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-22T19:02:22.922055] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-22T19:02:23.585983] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-22T19:02:23.722049] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-22T19:02:23.812349] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T19:02:24.384120] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T19:02:24.522106] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-22T19:02:25.322067] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-22T19:02:25.758622] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T19:02:26.122704] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-22T19:02:26.125380] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T19:02:26.666854] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-22T19:02:26.922057] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-22T19:02:27.031874] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T19:02:27.722053] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-22T19:02:28.522025] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-22T19:02:28.632358] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T19:02:29.238186] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T19:02:29.322053] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-22T19:02:29.650732] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-22T19:02:30.122061] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-22T19:02:30.922766] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-22T19:02:30.928699] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-22T19:02:31.722056] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-22T19:02:32.074924] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T19:02:32.522098] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-22T19:02:32.620611] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T19:02:33.007354] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-22T19:02:33.017848] [INFO ] [REMOTE ] GFI: Full fetch complete (76258 records). [2025-09-22T19:02:33.018041] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-22T19:02:33.322963] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-22T19:02:33.421162] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-22T19:02:33.421253] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-22T19:02:33.422286] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-22T19:02:33.422355] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-22T19:02:33.423897] [DEBUG] [LOCAL ] GFI: Trimmed 76258 records to 53104 (keeping 200 days of data) [2025-09-22T19:02:33.752527] [DEBUG] [LOCAL ] GFI: Primary data saved (53104 records). [2025-09-22T19:02:33.752694] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-22T19:02:33.752794] [INFO ] [MAIN ] Update Progress: 924/2372 symbols completed. GFI took 45.2s. Estimated remaining: 3h 11m 58s. Rate: 7.5 symbols/min [2025-09-22T19:02:33.921778] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:02:33.926100] [DEBUG] [LOCAL ] GGZ: Loaded 2533 existing records from primary storage. [2025-09-22T19:02:33.926185] [INFO ] [MAIN ] GGZ: Loaded 2533 existing records. [2025-09-22T19:02:34.109821] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:02:34.110152] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-22T19:02:34.110213] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-22T19:02:34.110481] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-22T19:02:34.110540] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-22T19:02:34.142112] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-22T19:02:34.411956] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T19:02:34.496764] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:02:34.525270] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-22T19:02:34.922059] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-22T19:02:35.596424] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T19:02:35.722007] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-22T19:02:36.522105] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-22T19:02:36.968002] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-22T19:02:36.976027] [INFO ] [REMOTE ] GGB: Full fetch complete (73945 records). [2025-09-22T19:02:36.976162] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-22T19:02:37.208686] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-22T19:02:37.334809] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-22T19:02:37.398868] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-22T19:02:37.399678] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-22T19:02:37.400620] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-22T19:02:37.400782] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-22T19:02:37.417322] [DEBUG] [LOCAL ] GGB: Trimmed 73945 records to 51011 (keeping 200 days of data) [2025-09-22T19:02:37.429785] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T19:02:37.759099] [DEBUG] [LOCAL ] GGB: Primary data saved (51011 records). [2025-09-22T19:02:37.759327] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-22T19:02:37.759571] [INFO ] [MAIN ] Update Progress: 925/2372 symbols completed. GGB took 31.2s. Estimated remaining: 3h 11m 44s. Rate: 7.5 symbols/min [2025-09-22T19:02:37.944979] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:02:37.950051] [DEBUG] [LOCAL ] GHC: Loaded 2646 existing records from primary storage. [2025-09-22T19:02:37.950144] [INFO ] [MAIN ] GHC: Loaded 2646 existing records. [2025-09-22T19:02:38.060995] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T19:02:38.125722] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-22T19:02:38.149129] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:02:38.150846] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-22T19:02:38.150898] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-22T19:02:38.151121] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-22T19:02:38.151180] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-22T19:02:38.623190] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:02:38.922154] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-22T19:02:39.395387] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-22T19:02:39.450952] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T19:02:39.722085] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-22T19:02:40.129252] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-22T19:02:40.522062] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-22T19:02:41.322079] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-22T19:02:42.012115] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T19:02:42.021565] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T19:02:42.023892] [INFO ] [REMOTE ] GGG: Full fetch complete (59260 records). [2025-09-22T19:02:42.024046] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-22T19:02:42.129890] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-22T19:02:42.420114] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-22T19:02:42.420204] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-22T19:02:42.421029] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-22T19:02:42.421117] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-22T19:02:42.422552] [DEBUG] [LOCAL ] GGG: Trimmed 59260 records to 41029 (keeping 200 days of data) [2025-09-22T19:02:42.687327] [DEBUG] [LOCAL ] GGG: Primary data saved (41029 records). [2025-09-22T19:02:42.687468] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-22T19:02:42.687615] [INFO ] [MAIN ] Update Progress: 926/2372 symbols completed. GGG took 25.9s. Estimated remaining: 3h 11m 31s. Rate: 7.6 symbols/min [2025-09-22T19:02:42.791504] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T19:02:42.927124] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-22T19:02:42.927030] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:02:42.936223] [DEBUG] [LOCAL ] GHG: Loaded 3180 existing records from primary storage. [2025-09-22T19:02:42.936332] [INFO ] [MAIN ] GHG: Loaded 3180 existing records. [2025-09-22T19:02:43.118616] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:02:43.118918] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-22T19:02:43.118971] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-22T19:02:43.119198] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-22T19:02:43.119258] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-22T19:02:43.470684] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:02:43.722016] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-22T19:02:44.018854] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-22T19:02:44.035725] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T19:02:44.522070] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-22T19:02:44.853196] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-22T19:02:45.322052] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-22T19:02:45.766512] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T19:02:46.122066] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-22T19:02:46.636237] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-22T19:02:46.922071] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-22T19:02:47.318085] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-22T19:02:47.722060] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-22T19:02:48.285170] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T19:02:48.522060] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-22T19:02:49.070773] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-22T19:02:49.322066] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-22T19:02:49.776079] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-22T19:02:50.122057] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-22T19:02:50.765865] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-22T19:02:50.922167] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-22T19:02:51.397859] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-22T19:02:51.722053] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-22T19:02:52.279681] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T19:02:52.522060] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-22T19:02:53.322058] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-22T19:02:53.463474] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-22T19:02:53.714634] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-22T19:02:54.122112] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-22T19:02:54.698117] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-22T19:02:54.922106] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-22T19:02:55.416021] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T19:02:55.722114] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-22T19:02:56.522053] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-22T19:02:56.687919] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T19:02:56.869355] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-22T19:02:57.322086] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-22T19:02:57.779112] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-22T19:02:58.122060] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-22T19:02:58.922086] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-22T19:02:58.938430] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T19:02:59.602087] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T19:02:59.603681] [INFO ] [REMOTE ] GHC: Full fetch complete (3240 records). [2025-09-22T19:02:59.603778] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-22T19:02:59.727160] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-22T19:02:59.992495] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-22T19:02:59.992604] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-22T19:02:59.992873] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-22T19:02:59.992943] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-22T19:02:59.993464] [DEBUG] [LOCAL ] GHC: Trimmed 3240 records to 2629 (keeping 200 days of data) [2025-09-22T19:03:00.014995] [DEBUG] [LOCAL ] GHC: Primary data saved (2629 records). [2025-09-22T19:03:00.015151] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-22T19:03:00.015322] [INFO ] [MAIN ] Update Progress: 927/2372 symbols completed. GHC took 22.3s. Estimated remaining: 3h 11m 38s. Rate: 7.5 symbols/min [2025-09-22T19:03:00.197105] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:03:00.213286] [DEBUG] [LOCAL ] GHI: Loaded 7129 existing records from primary storage. [2025-09-22T19:03:00.213465] [INFO ] [MAIN ] GHI: Loaded 7129 existing records. [2025-09-22T19:03:00.396339] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:03:00.396604] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-22T19:03:00.396675] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-22T19:03:00.397035] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-22T19:03:00.397104] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-22T19:03:00.534924] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-22T19:03:00.771148] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:03:00.958796] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T19:03:00.961661] [INFO ] [REMOTE ] GGT: Full fetch complete (18677 records). [2025-09-22T19:03:00.961768] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-22T19:03:01.068716] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T19:03:01.325462] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-22T19:03:01.335103] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-22T19:03:01.335168] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-22T19:03:01.335730] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-22T19:03:01.335831] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-22T19:03:01.337677] [DEBUG] [LOCAL ] GGT: Trimmed 18677 records to 14114 (keeping 200 days of data) [2025-09-22T19:03:01.445695] [DEBUG] [LOCAL ] GGT: Primary data saved (14114 records). [2025-09-22T19:03:01.446128] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-22T19:03:01.446328] [INFO ] [MAIN ] Update Progress: 928/2372 symbols completed. GGT took 42.4s. Estimated remaining: 3h 11m 20s. Rate: 7.5 symbols/min [2025-09-22T19:03:01.645816] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:03:01.658616] [DEBUG] [LOCAL ] GHLD: Loaded 4080 existing records from primary storage. [2025-09-22T19:03:01.658782] [INFO ] [MAIN ] GHLD: Loaded 4080 existing records. [2025-09-22T19:03:01.864353] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:03:01.864631] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-22T19:03:01.864727] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-22T19:03:01.865068] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-22T19:03:01.865132] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-22T19:03:02.132352] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-22T19:03:02.261327] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:03:02.371425] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T19:03:02.922158] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-22T19:03:03.722106] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-22T19:03:04.522073] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-22T19:03:05.072199] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-22T19:03:05.096997] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T19:03:05.322058] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-22T19:03:05.481777] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T19:03:05.482963] [INFO ] [REMOTE ] GHG: Full fetch complete (3966 records). [2025-09-22T19:03:05.483032] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-22T19:03:05.704037] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-22T19:03:05.695946] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (3.56 seconds). [2025-09-22T19:03:05.878128] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-22T19:03:05.878239] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-22T19:03:05.878405] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-22T19:03:05.878447] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-22T19:03:05.878880] [DEBUG] [LOCAL ] GHG: Trimmed 3966 records to 3157 (keeping 200 days of data) [2025-09-22T19:03:05.896602] [DEBUG] [LOCAL ] GHG: Primary data saved (3157 records). [2025-09-22T19:03:05.896723] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-22T19:03:05.896881] [INFO ] [MAIN ] Update Progress: 929/2372 symbols completed. GHG took 23.2s. Estimated remaining: 3h 11m 6s. Rate: 7.6 symbols/min [2025-09-22T19:03:06.087521] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:03:06.113098] [DEBUG] [LOCAL ] GHM: Loaded 14487 existing records from primary storage. [2025-09-22T19:03:06.113248] [INFO ] [MAIN ] GHM: Loaded 14487 existing records. [2025-09-22T19:03:06.127172] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-22T19:03:06.317137] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:03:06.317613] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-22T19:03:06.317694] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-22T19:03:06.318268] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-22T19:03:06.318328] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-22T19:03:06.673457] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:03:06.677158] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T19:03:06.922047] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-22T19:03:07.722027] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-22T19:03:07.848875] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T19:03:08.522043] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-22T19:03:08.542960] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-22T19:03:08.927471] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-22T19:03:09.322099] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-22T19:03:09.961819] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T19:03:10.122044] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-22T19:03:10.720918] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-22T19:03:10.721937] [INFO ] [REMOTE ] GGZ: Full fetch complete (4155 records). [2025-09-22T19:03:10.722006] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-22T19:03:10.924695] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-22T19:03:11.126996] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-22T19:03:11.127082] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-22T19:03:11.127221] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-22T19:03:11.127257] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-22T19:03:11.127686] [DEBUG] [LOCAL ] GGZ: Trimmed 4155 records to 2460 (keeping 200 days of data) [2025-09-22T19:03:11.143206] [DEBUG] [LOCAL ] GGZ: Primary data saved (2460 records). [2025-09-22T19:03:11.143267] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-22T19:03:11.143344] [INFO ] [MAIN ] Update Progress: 930/2372 symbols completed. GGZ took 37.4s. Estimated remaining: 3h 10m 54s. Rate: 7.6 symbols/min [2025-09-22T19:03:11.311460] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:03:11.337462] [DEBUG] [LOCAL ] GHY: Loaded 21391 existing records from primary storage. [2025-09-22T19:03:11.337584] [INFO ] [MAIN ] GHY: Loaded 21391 existing records. [2025-09-22T19:03:11.514146] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:03:11.514365] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-22T19:03:11.514412] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-22T19:03:11.515500] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-22T19:03:11.515563] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-22T19:03:11.727119] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-22T19:03:11.821344] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T19:03:11.891485] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:03:12.137249] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-22T19:03:12.522081] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-22T19:03:12.997240] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-22T19:03:13.322055] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-22T19:03:14.122053] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-22T19:03:14.212358] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T19:03:14.922050] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-22T19:03:15.070736] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T19:03:15.722125] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-22T19:03:16.033392] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T19:03:16.522113] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-22T19:03:17.257783] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T19:03:17.322057] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-22T19:03:17.732542] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T19:03:18.122064] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-22T19:03:18.331395] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T19:03:18.922078] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-22T19:03:19.121228] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T19:03:19.377524] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-22T19:03:19.722063] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-22T19:03:20.157262] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T19:03:20.522053] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-22T19:03:21.326438] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-22T19:03:21.328456] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T19:03:21.850207] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-22T19:03:22.122064] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-22T19:03:22.909877] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T19:03:22.922006] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-22T19:03:23.673289] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T19:03:23.722057] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-22T19:03:24.435296] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T19:03:24.522072] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-22T19:03:25.322031] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-22T19:03:25.576196] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-22T19:03:25.993693] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-22T19:03:25.995141] [INFO ] [REMOTE ] GHLD: Full fetch complete (4699 records). [2025-09-22T19:03:25.995211] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-22T19:03:26.127144] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-22T19:03:26.373994] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-22T19:03:26.374315] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-22T19:03:26.374487] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-22T19:03:26.374529] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-22T19:03:26.374990] [DEBUG] [LOCAL ] GHLD: Trimmed 4699 records to 4078 (keeping 200 days of data) [2025-09-22T19:03:26.401868] [DEBUG] [LOCAL ] GHLD: Primary data saved (4078 records). [2025-09-22T19:03:26.401941] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-22T19:03:26.402014] [INFO ] [MAIN ] Update Progress: 931/2372 symbols completed. GHLD took 25.0s. Estimated remaining: 3h 10m 58s. Rate: 7.5 symbols/min [2025-09-22T19:03:26.603702] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:03:26.644747] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-22T19:03:26.658368] [DEBUG] [LOCAL ] GIB: Loaded 32922 existing records from primary storage. [2025-09-22T19:03:26.658490] [INFO ] [MAIN ] GIB: Loaded 32922 existing records. [2025-09-22T19:03:26.866978] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:03:26.867293] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-22T19:03:26.867342] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-22T19:03:26.868679] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-22T19:03:26.868745] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-22T19:03:26.931377] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-22T19:03:27.240734] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:03:27.722041] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-22T19:03:27.880167] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T19:03:28.522022] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-22T19:03:28.892925] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T19:03:29.322048] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-22T19:03:29.521447] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T19:03:30.122062] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-22T19:03:30.147753] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T19:03:30.922037] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-22T19:03:31.138939] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T19:03:31.722089] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-22T19:03:32.287460] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T19:03:32.299740] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T19:03:32.522057] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-22T19:03:33.322062] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-22T19:03:33.363893] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T19:03:33.365588] [INFO ] [REMOTE ] GHI: Full fetch complete (11837 records). [2025-09-22T19:03:33.365697] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-22T19:03:33.738348] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-22T19:03:33.738441] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-22T19:03:33.738791] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-22T19:03:33.738853] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-22T19:03:33.739346] [DEBUG] [LOCAL ] GHI: Trimmed 11837 records to 6952 (keeping 200 days of data) [2025-09-22T19:03:33.783335] [DEBUG] [LOCAL ] GHI: Primary data saved (6952 records). [2025-09-22T19:03:33.783486] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-22T19:03:33.783585] [INFO ] [MAIN ] Update Progress: 932/2372 symbols completed. GHI took 33.8s. Estimated remaining: 3h 10m 49s. Rate: 7.5 symbols/min [2025-09-22T19:03:33.953193] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:03:33.972871] [DEBUG] [LOCAL ] GIC: Loaded 14066 existing records from primary storage. [2025-09-22T19:03:33.973086] [INFO ] [MAIN ] GIC: Loaded 14066 existing records. [2025-09-22T19:03:34.126756] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-22T19:03:34.166630] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:03:34.167265] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-22T19:03:34.167384] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-22T19:03:34.173275] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-22T19:03:34.180769] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-22T19:03:34.181753] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T19:03:34.591838] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:03:34.922093] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-22T19:03:35.275977] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T19:03:35.722090] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-22T19:03:35.913169] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T19:03:36.451065] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-22T19:03:36.522084] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-22T19:03:37.322056] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-22T19:03:37.483115] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T19:03:37.485947] [INFO ] [REMOTE ] GHM: Full fetch complete (21486 records). [2025-09-22T19:03:37.486025] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-22T19:03:37.890528] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-22T19:03:37.890708] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-22T19:03:37.891350] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-22T19:03:37.891492] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-22T19:03:37.892394] [DEBUG] [LOCAL ] GHM: Trimmed 21486 records to 14159 (keeping 200 days of data) [2025-09-22T19:03:37.992677] [DEBUG] [LOCAL ] GHM: Primary data saved (14159 records). [2025-09-22T19:03:37.992832] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-22T19:03:37.992981] [INFO ] [MAIN ] Update Progress: 933/2372 symbols completed. GHM took 32.1s. Estimated remaining: 3h 10m 35s. Rate: 7.6 symbols/min [2025-09-22T19:03:38.112934] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T19:03:38.128679] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-22T19:03:38.189466] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:03:38.235159] [DEBUG] [LOCAL ] GIL: Loaded 43701 existing records from primary storage. [2025-09-22T19:03:38.235329] [INFO ] [MAIN ] GIL: Loaded 43701 existing records. [2025-09-22T19:03:38.418262] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:03:38.418557] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-22T19:03:38.418633] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-22T19:03:38.420063] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-22T19:03:38.420126] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-22T19:03:38.784827] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:03:38.922236] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-22T19:03:38.970913] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T19:03:39.722100] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-22T19:03:40.350816] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-22T19:03:40.522055] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-22T19:03:40.652945] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T19:03:41.322059] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-22T19:03:41.854402] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T19:03:42.122047] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-22T19:03:42.759504] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T19:03:42.922032] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-22T19:03:43.086883] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T19:03:43.722077] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-22T19:03:44.038597] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T19:03:44.284742] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T19:03:44.522076] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-22T19:03:45.322032] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-22T19:03:45.378865] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-22T19:03:46.122061] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-22T19:03:46.860579] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T19:03:46.922072] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-22T19:03:47.195383] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T19:03:47.722071] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-22T19:03:47.867101] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T19:03:48.522056] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-22T19:03:49.205036] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T19:03:49.322077] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-22T19:03:49.532388] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T19:03:50.122093] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-22T19:03:50.928072] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-22T19:03:50.933507] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T19:03:50.973594] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T19:03:51.722130] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-22T19:03:51.974274] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T19:03:51.979329] [INFO ] [REMOTE ] GHY: Full fetch complete (31917 records). [2025-09-22T19:03:51.979571] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-22T19:03:52.526883] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-22T19:03:52.513438] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T19:03:52.599888] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-22T19:03:52.600013] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-22T19:03:52.601401] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-22T19:03:52.601489] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-22T19:03:52.602885] [DEBUG] [LOCAL ] GHY: Trimmed 31917 records to 20934 (keeping 200 days of data) [2025-09-22T19:03:52.788467] [DEBUG] [LOCAL ] GHY: Primary data saved (20934 records). [2025-09-22T19:03:52.788612] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-22T19:03:52.788736] [INFO ] [MAIN ] Update Progress: 934/2372 symbols completed. GHY took 41.6s. Estimated remaining: 3h 10m 38s. Rate: 7.5 symbols/min [2025-09-22T19:03:52.972795] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:03:53.031522] [DEBUG] [LOCAL ] GIS: Loaded 54454 existing records from primary storage. [2025-09-22T19:03:53.031729] [INFO ] [MAIN ] GIS: Loaded 54454 existing records. [2025-09-22T19:03:53.246998] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:03:53.247348] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-22T19:03:53.247402] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-22T19:03:53.248950] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-22T19:03:53.249010] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-22T19:03:53.327130] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-22T19:03:53.617635] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:03:53.936352] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T19:03:54.122109] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-22T19:03:54.191979] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T19:03:54.922141] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-22T19:03:55.705577] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T19:03:55.722004] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-22T19:03:56.306800] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T19:03:56.522094] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-22T19:03:56.913763] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-22T19:03:57.322080] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-22T19:03:57.949378] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T19:03:58.122089] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-22T19:03:58.844060] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T19:03:58.922027] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-22T19:03:59.048966] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T19:03:59.722074] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-22T19:04:00.522137] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-22T19:04:00.570781] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T19:04:01.322111] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-22T19:04:01.616024] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T19:04:01.935139] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T19:04:01.940809] [INFO ] [REMOTE ] GIB: Full fetch complete (44956 records). [2025-09-22T19:04:01.940956] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-22T19:04:02.130420] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-22T19:04:02.342363] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-22T19:04:02.360988] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-22T19:04:02.361160] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-22T19:04:02.361919] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-22T19:04:02.362087] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-22T19:04:02.362029] [INFO ] [REMOTE ] GIC: Full fetch complete (20354 records). [2025-09-22T19:04:02.362291] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-22T19:04:02.363175] [DEBUG] [LOCAL ] GIB: Trimmed 44956 records to 32195 (keeping 200 days of data) [2025-09-22T19:04:02.941686] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-22T19:04:02.942426] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-22T19:04:02.943329] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-22T19:04:02.940472] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-22T19:04:02.943436] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-22T19:04:02.956593] [DEBUG] [LOCAL ] GIB: Primary data saved (32195 records). [2025-09-22T19:04:02.957261] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-22T19:04:02.957461] [INFO ] [MAIN ] Update Progress: 935/2372 symbols completed. GIB took 36.6s. Estimated remaining: 3h 10m 33s. Rate: 7.5 symbols/min [2025-09-22T19:04:02.989396] [DEBUG] [LOCAL ] GIC: Trimmed 20354 records to 13763 (keeping 200 days of data) [2025-09-22T19:04:03.204363] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:04:03.221515] [DEBUG] [LOCAL ] GIC: Primary data saved (13763 records). [2025-09-22T19:04:03.221703] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-22T19:04:03.221810] [INFO ] [MAIN ] Update Progress: 936/2372 symbols completed. GIC took 29.4s. Estimated remaining: 3h 10m 13s. Rate: 7.5 symbols/min [2025-09-22T19:04:03.438940] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:04:03.440128] [DEBUG] [LOCAL ] GKOS: Loaded 43831 existing records from primary storage. [2025-09-22T19:04:03.440391] [INFO ] [MAIN ] GKOS: Loaded 43831 existing records. [2025-09-22T19:04:03.642604] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:04:03.642902] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-22T19:04:03.642955] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-22T19:04:03.644141] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-22T19:04:03.644206] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-22T19:04:03.769795] [DEBUG] [LOCAL ] GL: Loaded 38747 existing records from primary storage. [2025-09-22T19:04:03.785508] [INFO ] [MAIN ] GL: Loaded 38747 existing records. [2025-09-22T19:04:04.226618] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:04:04.235573] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:04:04.236176] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-22T19:04:04.236478] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-22T19:04:04.236591] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-22T19:04:04.238240] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-22T19:04:04.238313] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-22T19:04:04.430997] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-22T19:04:04.531413] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-22T19:04:04.664496] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:04:04.694720] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T19:04:04.703518] [INFO ] [REMOTE ] GIL: Full fetch complete (61205 records). [2025-09-22T19:04:04.703720] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-22T19:04:05.104759] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-22T19:04:05.104847] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-22T19:04:05.105719] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-22T19:04:05.105785] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-22T19:04:05.107081] [DEBUG] [LOCAL ] GIL: Trimmed 61205 records to 43097 (keeping 200 days of data) [2025-09-22T19:04:05.329705] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-22T19:04:05.388365] [DEBUG] [LOCAL ] GIL: Primary data saved (43097 records). [2025-09-22T19:04:05.388573] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-22T19:04:05.388702] [INFO ] [MAIN ] Update Progress: 937/2372 symbols completed. GIL took 27.4s. Estimated remaining: 3h 9m 57s. Rate: 7.6 symbols/min [2025-09-22T19:04:05.560979] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:04:05.607920] [DEBUG] [LOCAL ] GLOB: Loaded 47899 existing records from primary storage. [2025-09-22T19:04:05.608068] [INFO ] [MAIN ] GLOB: Loaded 47899 existing records. [2025-09-22T19:04:05.798019] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:04:05.798375] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-22T19:04:05.798590] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-22T19:04:05.806126] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-22T19:04:05.818469] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-22T19:04:05.860570] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T19:04:06.136508] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-22T19:04:06.230393] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:04:06.346607] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T19:04:06.922141] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-22T19:04:07.032764] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T19:04:07.620411] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T19:04:07.722081] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-22T19:04:07.981476] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T19:04:08.522071] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-22T19:04:09.252058] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T19:04:09.322024] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-22T19:04:10.053897] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T19:04:10.122047] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-22T19:04:10.922062] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-22T19:04:10.973942] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T19:04:11.177177] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T19:04:11.722055] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-22T19:04:12.522069] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-22T19:04:12.849049] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T19:04:13.103778] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T19:04:13.322079] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-22T19:04:13.924416] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:04:14.122111] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-22T19:04:14.813173] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T19:04:14.922005] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-22T19:04:15.412501] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-22T19:04:15.722115] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-22T19:04:16.502267] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T19:04:16.522001] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-22T19:04:17.018747] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T19:04:17.322056] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-22T19:04:18.122026] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-22T19:04:18.183837] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T19:04:18.864486] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T19:04:18.922053] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-22T19:04:19.722057] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-22T19:04:19.869216] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T19:04:20.428862] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T19:04:20.522051] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-22T19:04:20.846906] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T19:04:21.322033] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-22T19:04:21.978057] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T19:04:22.122088] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-22T19:04:22.922125] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-22T19:04:22.976692] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T19:04:23.307560] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T19:04:23.722106] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-22T19:04:24.321084] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T19:04:24.522067] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-22T19:04:25.322022] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-22T19:04:25.763763] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T19:04:25.801916] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-22T19:04:26.122110] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-22T19:04:26.887155] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T19:04:26.922005] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-22T19:04:27.382094] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T19:04:27.722083] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-22T19:04:28.522036] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-22T19:04:28.587415] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T19:04:28.917505] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T19:04:28.923270] [INFO ] [REMOTE ] GL: Full fetch complete (55731 records). [2025-09-22T19:04:28.923372] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-22T19:04:29.303396] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-22T19:04:29.303480] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-22T19:04:29.304229] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-22T19:04:29.304291] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-22T19:04:29.305448] [DEBUG] [LOCAL ] GL: Trimmed 55731 records to 37985 (keeping 200 days of data) [2025-09-22T19:04:29.366078] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-22T19:04:29.566973] [DEBUG] [LOCAL ] GL: Primary data saved (37985 records). [2025-09-22T19:04:29.567141] [INFO ] [MAIN ] GL: Full history saved. [2025-09-22T19:04:29.567284] [INFO ] [MAIN ] Update Progress: 938/2372 symbols completed. GL took 26.3s. Estimated remaining: 3h 10m 14s. Rate: 7.5 symbols/min [2025-09-22T19:04:29.745941] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:04:29.757295] [DEBUG] [LOCAL ] GLP: Loaded 9735 existing records from primary storage. [2025-09-22T19:04:29.757402] [INFO ] [MAIN ] GLP: Loaded 9735 existing records. [2025-09-22T19:04:29.936091] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:04:29.936349] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-22T19:04:29.936397] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-22T19:04:29.936813] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-22T19:04:29.936872] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-22T19:04:30.128616] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-22T19:04:30.321379] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:04:30.322975] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T19:04:30.330210] [INFO ] [REMOTE ] GKOS: Full fetch complete (59899 records). [2025-09-22T19:04:30.330343] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-22T19:04:30.711264] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-22T19:04:30.711367] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-22T19:04:30.712214] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-22T19:04:30.712291] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-22T19:04:30.714301] [DEBUG] [LOCAL ] GKOS: Trimmed 59899 records to 43097 (keeping 200 days of data) [2025-09-22T19:04:30.922064] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-22T19:04:30.976286] [DEBUG] [LOCAL ] GKOS: Primary data saved (43097 records). [2025-09-22T19:04:30.976427] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-22T19:04:30.976516] [INFO ] [MAIN ] Update Progress: 939/2372 symbols completed. GKOS took 28.0s. Estimated remaining: 3h 9m 56s. Rate: 7.5 symbols/min [2025-09-22T19:04:31.171470] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:04:31.174411] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-22T19:04:31.183880] [INFO ] [REMOTE ] GLOB: Full fetch complete (63102 records). [2025-09-22T19:04:31.184007] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-22T19:04:31.590924] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-22T19:04:31.610476] [INFO ] [MAIN ] GLW: Loaded 54415 existing records. [2025-09-22T19:04:31.738132] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-22T19:04:31.763085] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-22T19:04:31.776367] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-22T19:04:31.808708] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-22T19:04:31.844774] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T19:04:31.872462] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-22T19:04:31.882949] [DEBUG] [LOCAL ] GLOB: Trimmed 63102 records to 47283 (keeping 200 days of data) [2025-09-22T19:04:31.888352] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:04:31.889610] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-22T19:04:31.889856] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-22T19:04:31.891358] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-22T19:04:31.891422] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-22T19:04:32.263420] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-22T19:04:32.528709] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-22T19:04:32.552583] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:04:32.628276] [DEBUG] [LOCAL ] GLOB: Primary data saved (47283 records). [2025-09-22T19:04:32.628429] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-22T19:04:32.628526] [INFO ] [MAIN ] Update Progress: 940/2372 symbols completed. GLOB took 27.2s. Estimated remaining: 3h 9m 38s. Rate: 7.6 symbols/min [2025-09-22T19:04:32.746252] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T19:04:32.812792] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:04:32.866582] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-22T19:04:32.866795] [INFO ] [MAIN ] GM: Loaded 54508 existing records. [2025-09-22T19:04:33.043128] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:04:33.043400] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-22T19:04:33.043459] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-22T19:04:33.045080] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-22T19:04:33.045146] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-22T19:04:33.327154] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-22T19:04:33.398320] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:04:34.062726] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T19:04:34.122012] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-22T19:04:34.922024] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-22T19:04:35.316582] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-22T19:04:35.701487] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T19:04:35.721998] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-22T19:04:35.957995] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T19:04:36.522062] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-22T19:04:36.547161] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T19:04:37.322070] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-22T19:04:38.122065] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-22T19:04:38.563610] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-22T19:04:38.922086] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-22T19:04:39.244394] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T19:04:39.649524] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T19:04:39.722043] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-22T19:04:40.522067] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-22T19:04:41.023774] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-22T19:04:41.309047] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T19:04:41.322011] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-22T19:04:42.122015] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-22T19:04:42.354283] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T19:04:42.362514] [INFO ] [REMOTE ] GIS: Full fetch complete (77649 records). [2025-09-22T19:04:42.362635] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-22T19:04:42.752248] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-22T19:04:42.752334] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-22T19:04:42.753269] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-22T19:04:42.753336] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-22T19:04:42.754803] [DEBUG] [LOCAL ] GIS: Trimmed 77649 records to 53675 (keeping 200 days of data) [2025-09-22T19:04:42.930849] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-22T19:04:43.048091] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-22T19:04:43.093511] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-09-22T19:04:43.093622] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-22T19:04:43.093750] [INFO ] [MAIN ] Update Progress: 941/2372 symbols completed. GIS took 50.3s. Estimated remaining: 3h 9m 34s. Rate: 7.5 symbols/min [2025-09-22T19:04:43.276579] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:04:43.310377] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T19:04:43.374253] [DEBUG] [LOCAL ] GME: Loaded 54539 existing records from primary storage. [2025-09-22T19:04:43.374426] [INFO ] [MAIN ] GME: Loaded 54539 existing records. [2025-09-22T19:04:43.551148] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:04:43.551428] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-22T19:04:43.551476] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-22T19:04:43.552732] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-22T19:04:43.552795] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-22T19:04:43.725044] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-22T19:04:43.907621] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:04:44.407796] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T19:04:44.522115] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-22T19:04:44.755757] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T19:04:45.322097] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-22T19:04:46.122070] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-22T19:04:46.922155] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-22T19:04:47.227273] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T19:04:47.278387] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-22T19:04:47.551610] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-22T19:04:47.722062] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-22T19:04:48.034667] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T19:04:48.522082] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-22T19:04:49.322029] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-22T19:04:49.587609] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-22T19:04:49.723512] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-22T19:04:50.122102] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-22T19:04:50.912368] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-22T19:04:50.922739] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-22T19:04:51.670354] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T19:04:51.722043] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-22T19:04:52.522078] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-22T19:04:52.877293] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T19:04:53.322039] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-22T19:04:53.757426] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-22T19:04:53.886529] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-22T19:04:54.122079] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-22T19:04:54.814717] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-22T19:04:54.928802] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-22T19:04:54.931279] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T19:04:54.934683] [INFO ] [REMOTE ] GLP: Full fetch complete (14423 records). [2025-09-22T19:04:54.934796] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-22T19:04:55.305829] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-22T19:04:55.305910] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-22T19:04:55.306262] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-22T19:04:55.306300] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-22T19:04:55.306851] [DEBUG] [LOCAL ] GLP: Trimmed 14423 records to 9519 (keeping 200 days of data) [2025-09-22T19:04:55.364824] [DEBUG] [LOCAL ] GLP: Primary data saved (9519 records). [2025-09-22T19:04:55.365003] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-22T19:04:55.365105] [INFO ] [MAIN ] Update Progress: 942/2372 symbols completed. GLP took 25.8s. Estimated remaining: 3h 9m 33s. Rate: 7.5 symbols/min [2025-09-22T19:04:55.541406] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:04:55.593697] [DEBUG] [LOCAL ] GMED: Loaded 48979 existing records from primary storage. [2025-09-22T19:04:55.593861] [INFO ] [MAIN ] GMED: Loaded 48979 existing records. [2025-09-22T19:04:55.735421] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-22T19:04:55.781513] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:04:55.781822] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-22T19:04:55.781893] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-22T19:04:55.783119] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-22T19:04:55.783183] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-22T19:04:56.145175] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:04:56.522072] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-22T19:04:57.050979] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-22T19:04:57.322100] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-22T19:04:57.678004] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T19:04:58.122067] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-22T19:04:58.571408] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-22T19:04:58.843795] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T19:04:58.922065] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-22T19:04:59.722055] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-22T19:05:00.482845] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-22T19:05:00.492116] [INFO ] [REMOTE ] GLW: Full fetch complete (77614 records). [2025-09-22T19:05:00.492330] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-22T19:05:00.527847] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-22T19:05:00.871719] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T19:05:00.992639] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-22T19:05:00.992770] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-22T19:05:00.993876] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-22T19:05:00.993986] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-22T19:05:00.995784] [DEBUG] [LOCAL ] GLW: Trimmed 77614 records to 53635 (keeping 200 days of data) [2025-09-22T19:05:01.323331] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-22T19:05:01.352384] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-22T19:05:01.352516] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-22T19:05:01.352693] [INFO ] [MAIN ] Update Progress: 943/2372 symbols completed. GLW took 30.4s. Estimated remaining: 3h 9m 22s. Rate: 7.5 symbols/min [2025-09-22T19:05:01.529903] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:05:01.570955] [DEBUG] [LOCAL ] GMRE: Loaded 38263 existing records from primary storage. [2025-09-22T19:05:01.571103] [INFO ] [MAIN ] GMRE: Loaded 38263 existing records. [2025-09-22T19:05:01.750354] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:05:01.750732] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-22T19:05:01.750794] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-22T19:05:01.751780] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-22T19:05:01.751856] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-22T19:05:02.145458] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:05:02.145813] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-22T19:05:02.445664] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-22T19:05:02.635825] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-22T19:05:02.922063] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-22T19:05:03.051974] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T19:05:03.480296] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T19:05:03.722062] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-22T19:05:04.522074] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-22T19:05:05.048541] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T19:05:05.322133] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-22T19:05:05.541542] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-22T19:05:05.916242] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T19:05:06.122049] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-22T19:05:06.922026] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-22T19:05:07.028872] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T19:05:07.076204] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T19:05:07.722067] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-22T19:05:08.522063] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-22T19:05:08.715487] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T19:05:09.322092] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-22T19:05:09.695567] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-22T19:05:09.990487] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T19:05:10.122007] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-22T19:05:10.922058] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-22T19:05:11.237389] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-22T19:05:11.318019] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-22T19:05:11.722056] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-22T19:05:12.522115] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-22T19:05:12.744897] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-22T19:05:13.191854] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-22T19:05:13.322019] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-22T19:05:13.835668] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T19:05:14.122076] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-22T19:05:14.922080] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-22T19:05:15.722125] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-22T19:05:15.781792] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-22T19:05:15.817965] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T19:05:15.826484] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-22T19:05:15.826717] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-22T19:05:16.230720] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-22T19:05:16.230854] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-22T19:05:16.232807] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-22T19:05:16.232931] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-22T19:05:16.234949] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53728 (keeping 200 days of data) [2025-09-22T19:05:16.402286] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T19:05:16.522164] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-22T19:05:16.622729] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-22T19:05:16.622868] [INFO ] [MAIN ] GM: Full history saved. [2025-09-22T19:05:16.622974] [INFO ] [MAIN ] Update Progress: 944/2372 symbols completed. GM took 44.0s. Estimated remaining: 3h 9m 25s. Rate: 7.5 symbols/min [2025-09-22T19:05:16.793573] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:05:16.813940] [DEBUG] [LOCAL ] GNE: Loaded 17580 existing records from primary storage. [2025-09-22T19:05:16.814087] [INFO ] [MAIN ] GNE: Loaded 17580 existing records. [2025-09-22T19:05:17.008086] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:05:17.008415] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-22T19:05:17.008528] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-22T19:05:17.009174] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-22T19:05:17.009345] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-22T19:05:17.335468] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-22T19:05:17.397052] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:05:17.424206] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T19:05:18.106267] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T19:05:18.122018] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-22T19:05:18.922078] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-22T19:05:19.425200] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-22T19:05:19.603984] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-22T19:05:19.722015] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-22T19:05:19.751046] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T19:05:19.760474] [INFO ] [REMOTE ] GMED: Full fetch complete (69075 records). [2025-09-22T19:05:19.760629] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-22T19:05:20.157000] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-22T19:05:20.157147] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-22T19:05:20.158062] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-22T19:05:20.158128] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-22T19:05:20.159796] [DEBUG] [LOCAL ] GMED: Trimmed 69075 records to 48319 (keeping 200 days of data) [2025-09-22T19:05:20.461719] [DEBUG] [LOCAL ] GMED: Primary data saved (48319 records). [2025-09-22T19:05:20.461879] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-22T19:05:20.461982] [INFO ] [MAIN ] Update Progress: 945/2372 symbols completed. GMED took 25.1s. Estimated remaining: 3h 9m 11s. Rate: 7.5 symbols/min [2025-09-22T19:05:20.527207] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-22T19:05:20.645825] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:05:20.689132] [DEBUG] [LOCAL ] GNK: Loaded 41479 existing records from primary storage. [2025-09-22T19:05:20.689319] [INFO ] [MAIN ] GNK: Loaded 41479 existing records. [2025-09-22T19:05:20.867296] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:05:20.867614] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-22T19:05:20.867694] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-22T19:05:20.868875] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-22T19:05:20.868936] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-22T19:05:21.226704] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:05:21.322041] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-22T19:05:21.417098] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T19:05:22.122041] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-22T19:05:22.464703] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-22T19:05:22.478136] [INFO ] [REMOTE ] GME: Full fetch complete (77918 records). [2025-09-22T19:05:22.478344] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-22T19:05:22.716833] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T19:05:22.946400] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T19:05:22.924750] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-22T19:05:22.953470] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-22T19:05:22.954682] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-22T19:05:22.956005] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-22T19:05:22.956201] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-22T19:05:22.958132] [DEBUG] [LOCAL ] GME: Trimmed 77918 records to 53761 (keeping 200 days of data) [2025-09-22T19:05:23.301592] [DEBUG] [LOCAL ] GME: Primary data saved (53761 records). [2025-09-22T19:05:23.302081] [INFO ] [MAIN ] GME: Full history saved. [2025-09-22T19:05:23.302179] [INFO ] [MAIN ] Update Progress: 946/2372 symbols completed. GME took 40.2s. Estimated remaining: 3h 8m 55s. Rate: 7.5 symbols/min [2025-09-22T19:05:23.497047] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:05:23.542333] [DEBUG] [LOCAL ] GNL: Loaded 48190 existing records from primary storage. [2025-09-22T19:05:23.542506] [INFO ] [MAIN ] GNL: Loaded 48190 existing records. [2025-09-22T19:05:23.725099] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-22T19:05:23.725264] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:05:23.726707] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-22T19:05:23.726767] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-22T19:05:23.728134] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-22T19:05:23.728197] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-22T19:05:24.117275] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:05:24.361281] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T19:05:24.437628] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-22T19:05:24.522050] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-22T19:05:25.322061] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-22T19:05:25.880716] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T19:05:26.122119] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-22T19:05:26.745730] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T19:05:26.922146] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-22T19:05:27.519440] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T19:05:27.627869] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-22T19:05:27.722057] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-22T19:05:28.522064] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-22T19:05:29.097309] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T19:05:29.322087] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-22T19:05:29.465192] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T19:05:30.122102] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-22T19:05:30.930429] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-22T19:05:30.935404] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T19:05:31.592408] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T19:05:31.722064] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-22T19:05:32.381110] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T19:05:32.387683] [INFO ] [REMOTE ] GMRE: Full fetch complete (53461 records). [2025-09-22T19:05:32.387804] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-22T19:05:32.531295] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-22T19:05:32.781873] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-22T19:05:32.781952] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-22T19:05:32.782708] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-22T19:05:32.782771] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-22T19:05:32.783862] [DEBUG] [LOCAL ] GMRE: Trimmed 53461 records to 37625 (keeping 200 days of data) [2025-09-22T19:05:33.014198] [DEBUG] [LOCAL ] GMRE: Primary data saved (37625 records). [2025-09-22T19:05:33.014336] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-22T19:05:33.014420] [INFO ] [MAIN ] Update Progress: 947/2372 symbols completed. GMRE took 31.7s. Estimated remaining: 3h 8m 50s. Rate: 7.5 symbols/min [2025-09-22T19:05:33.193379] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:05:33.241615] [DEBUG] [LOCAL ] GNRC: Loaded 45796 existing records from primary storage. [2025-09-22T19:05:33.241779] [INFO ] [MAIN ] GNRC: Loaded 45796 existing records. [2025-09-22T19:05:33.327467] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-22T19:05:33.446070] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T19:05:33.452572] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:05:33.461155] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-22T19:05:33.461546] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-22T19:05:33.462932] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-22T19:05:33.462992] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-22T19:05:33.820605] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:05:33.835620] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T19:05:34.122071] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-22T19:05:34.639151] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-22T19:05:34.922049] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-22T19:05:35.426402] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T19:05:35.722018] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-22T19:05:36.117441] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T19:05:36.522123] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-22T19:05:37.322026] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-22T19:05:37.404776] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T19:05:37.818180] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T19:05:38.122045] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-22T19:05:38.827255] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T19:05:38.922111] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-22T19:05:39.612617] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T19:05:39.722106] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-22T19:05:40.026964] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T19:05:40.522107] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-22T19:05:40.876812] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T19:05:41.322082] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-22T19:05:42.048406] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T19:05:42.122056] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-22T19:05:42.859945] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T19:05:42.922046] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-22T19:05:43.483414] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T19:05:43.722118] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-22T19:05:44.413056] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T19:05:44.522083] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-22T19:05:45.056689] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T19:05:45.322050] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-22T19:05:45.831352] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T19:05:45.837473] [INFO ] [REMOTE ] GNK: Full fetch complete (56951 records). [2025-09-22T19:05:45.837637] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-22T19:05:46.126679] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-22T19:05:46.233786] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T19:05:46.247942] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-22T19:05:46.252581] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-22T19:05:46.253745] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-22T19:05:46.252784] [INFO ] [REMOTE ] GNE: Full fetch complete (22145 records). [2025-09-22T19:05:46.253918] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-22T19:05:46.254164] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-22T19:05:46.354418] [DEBUG] [LOCAL ] GNK: Trimmed 56951 records to 40728 (keeping 200 days of data) [2025-09-22T19:05:46.880211] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-22T19:05:46.881079] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-22T19:05:46.882379] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-22T19:05:46.882458] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-22T19:05:46.889751] [DEBUG] [LOCAL ] GNE: Trimmed 22145 records to 17531 (keeping 200 days of data) [2025-09-22T19:05:46.940228] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-22T19:05:46.994025] [DEBUG] [LOCAL ] GNK: Primary data saved (40728 records). [2025-09-22T19:05:46.995407] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-22T19:05:46.997881] [INFO ] [MAIN ] Update Progress: 948/2372 symbols completed. GNK took 26.5s. Estimated remaining: 3h 8m 51s. Rate: 7.5 symbols/min [2025-09-22T19:05:47.128346] [DEBUG] [LOCAL ] GNE: Primary data saved (17531 records). [2025-09-22T19:05:47.134319] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-22T19:05:47.139603] [INFO ] [MAIN ] Update Progress: 949/2372 symbols completed. GNE took 30.5s. Estimated remaining: 3h 8m 31s. Rate: 7.5 symbols/min [2025-09-22T19:05:47.298503] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:05:47.388599] [DEBUG] [LOCAL ] GNT: Loaded 7944 existing records from primary storage. [2025-09-22T19:05:47.389764] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:05:47.389995] [INFO ] [MAIN ] GNT: Loaded 7944 existing records. [2025-09-22T19:05:47.529433] [DEBUG] [LOCAL ] GNTY: Loaded 7131 existing records from primary storage. [2025-09-22T19:05:47.550460] [INFO ] [MAIN ] GNTY: Loaded 7131 existing records. [2025-09-22T19:05:47.655490] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:05:47.714822] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-22T19:05:47.719351] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-22T19:05:47.730381] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-22T19:05:47.740762] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-22T19:05:47.872376] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:05:47.937296] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-22T19:05:47.940995] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-22T19:05:47.986198] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-22T19:05:48.002460] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-22T19:05:48.448130] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-22T19:05:48.505176] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:05:48.531911] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-22T19:05:48.555289] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-22T19:05:48.640376] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:05:48.665328] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T19:05:49.192327] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-22T19:05:49.322066] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-22T19:05:50.031987] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-22T19:05:50.094376] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T19:05:50.122011] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-22T19:05:50.922059] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-22T19:05:51.705525] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T19:05:51.712538] [INFO ] [REMOTE ] GNL: Full fetch complete (68538 records). [2025-09-22T19:05:51.712678] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-22T19:05:51.727252] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-22T19:05:52.112515] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-22T19:05:52.112617] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-22T19:05:52.113510] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-22T19:05:52.113569] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-22T19:05:52.114924] [DEBUG] [LOCAL ] GNL: Trimmed 68538 records to 47345 (keeping 200 days of data) [2025-09-22T19:05:52.391537] [DEBUG] [LOCAL ] GNL: Primary data saved (47345 records). [2025-09-22T19:05:52.391698] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-22T19:05:52.391798] [INFO ] [MAIN ] Update Progress: 950/2372 symbols completed. GNL took 29.1s. Estimated remaining: 3h 8m 19s. Rate: 7.6 symbols/min [2025-09-22T19:05:52.530277] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-22T19:05:52.575768] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T19:05:52.614167] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:05:52.618917] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T19:05:52.675818] [DEBUG] [LOCAL ] GNW: Loaded 52097 existing records from primary storage. [2025-09-22T19:05:52.675967] [INFO ] [MAIN ] GNW: Loaded 52097 existing records. [2025-09-22T19:05:52.862219] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:05:52.862512] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-22T19:05:52.862569] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-22T19:05:52.863843] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-22T19:05:52.863908] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-22T19:05:53.228339] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:05:53.274146] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T19:05:53.322053] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-22T19:05:53.739373] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T19:05:54.122045] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-22T19:05:54.922124] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-22T19:05:55.435001] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-22T19:05:55.722054] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-22T19:05:55.920542] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T19:05:56.342894] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T19:05:56.522077] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-22T19:05:57.322066] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-22T19:05:57.878622] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T19:05:58.122067] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-22T19:05:58.891754] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T19:05:58.922019] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-22T19:05:59.340148] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T19:05:59.722058] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-22T19:06:00.302392] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-22T19:06:00.493191] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T19:06:00.522016] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-22T19:06:01.284698] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T19:06:01.322076] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-22T19:06:02.122047] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-22T19:06:02.922156] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-22T19:06:03.710409] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T19:06:03.721992] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-22T19:06:03.997695] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-22T19:06:04.423732] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T19:06:04.522069] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-22T19:06:04.788984] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T19:06:05.116302] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-22T19:06:05.322052] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-22T19:06:06.122110] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-22T19:06:06.734723] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T19:06:06.922027] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-22T19:06:07.024840] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T19:06:07.701932] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-22T19:06:07.704574] [INFO ] [REMOTE ] GNT: Full fetch complete (10469 records). [2025-09-22T19:06:07.704694] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-22T19:06:07.727127] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-22T19:06:08.069607] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-22T19:06:08.069715] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-22T19:06:08.069979] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-22T19:06:08.070018] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-22T19:06:08.070490] [DEBUG] [LOCAL ] GNT: Trimmed 10469 records to 7946 (keeping 200 days of data) [2025-09-22T19:06:08.119237] [DEBUG] [LOCAL ] GNT: Primary data saved (7946 records). [2025-09-22T19:06:08.119371] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-22T19:06:08.119457] [INFO ] [MAIN ] Update Progress: 951/2372 symbols completed. GNT took 21.1s. Estimated remaining: 3h 8m 23s. Rate: 7.5 symbols/min [2025-09-22T19:06:08.290490] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:06:08.335923] [DEBUG] [LOCAL ] GOF: Loaded 43673 existing records from primary storage. [2025-09-22T19:06:08.336111] [INFO ] [MAIN ] GOF: Loaded 43673 existing records. [2025-09-22T19:06:08.531352] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-22T19:06:08.538542] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:06:08.539721] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-22T19:06:08.539798] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-22T19:06:08.541187] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-22T19:06:08.541265] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-22T19:06:08.907116] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:06:09.011990] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-22T19:06:09.250994] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T19:06:09.322070] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-22T19:06:09.778501] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-22T19:06:10.122061] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-22T19:06:10.922055] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-22T19:06:11.722059] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-22T19:06:11.839573] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T19:06:12.522038] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-22T19:06:12.622930] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T19:06:13.322072] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-22T19:06:13.424678] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T19:06:14.122135] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-22T19:06:14.126228] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T19:06:14.136835] [INFO ] [REMOTE ] GNRC: Full fetch complete (65111 records). [2025-09-22T19:06:14.137061] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-22T19:06:14.584769] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-22T19:06:14.584934] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-22T19:06:14.586176] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-22T19:06:14.586383] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-22T19:06:14.588444] [DEBUG] [LOCAL ] GNRC: Trimmed 65111 records to 45155 (keeping 200 days of data) [2025-09-22T19:06:14.760350] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T19:06:14.922381] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-22T19:06:14.924538] [DEBUG] [LOCAL ] GNRC: Primary data saved (45155 records). [2025-09-22T19:06:14.924740] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-22T19:06:14.924866] [INFO ] [MAIN ] Update Progress: 952/2372 symbols completed. GNRC took 41.9s. Estimated remaining: 3h 8m 13s. Rate: 7.5 symbols/min [2025-09-22T19:06:15.107542] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:06:15.140175] [DEBUG] [LOCAL ] GOLF: Loaded 32439 existing records from primary storage. [2025-09-22T19:06:15.140318] [INFO ] [MAIN ] GOLF: Loaded 32439 existing records. [2025-09-22T19:06:15.325741] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:06:15.326028] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-22T19:06:15.326079] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-22T19:06:15.326965] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-22T19:06:15.327029] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-22T19:06:15.694160] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:06:15.722073] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-22T19:06:16.145741] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T19:06:16.179412] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-22T19:06:16.522070] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-22T19:06:17.322098] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-22T19:06:18.060091] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-22T19:06:18.099685] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T19:06:18.122093] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-22T19:06:18.922056] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-22T19:06:18.976118] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T19:06:19.173698] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-22T19:06:19.519317] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-22T19:06:19.521330] [INFO ] [REMOTE ] GNTY: Full fetch complete (10182 records). [2025-09-22T19:06:19.521404] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-22T19:06:19.726428] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-22T19:06:19.919868] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-22T19:06:19.919958] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-22T19:06:19.920349] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-22T19:06:19.920435] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-22T19:06:19.921052] [DEBUG] [LOCAL ] GNTY: Trimmed 10182 records to 7079 (keeping 200 days of data) [2025-09-22T19:06:19.965925] [DEBUG] [LOCAL ] GNTY: Primary data saved (7079 records). [2025-09-22T19:06:19.966086] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-22T19:06:19.966181] [INFO ] [MAIN ] Update Progress: 953/2372 symbols completed. GNTY took 32.8s. Estimated remaining: 3h 8m 1s. Rate: 7.5 symbols/min [2025-09-22T19:06:20.139318] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:06:20.186445] [DEBUG] [LOCAL ] GOOS: Loaded 46476 existing records from primary storage. [2025-09-22T19:06:20.186633] [INFO ] [MAIN ] GOOS: Loaded 46476 existing records. [2025-09-22T19:06:20.380225] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:06:20.380542] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-22T19:06:20.380598] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-22T19:06:20.381616] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-22T19:06:20.381713] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-22T19:06:20.530463] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-22T19:06:20.739775] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:06:21.322065] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-22T19:06:21.538165] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T19:06:22.122082] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-22T19:06:22.278079] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T19:06:22.507403] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T19:06:22.922063] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-22T19:06:23.722072] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-22T19:06:23.962307] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T19:06:23.970584] [INFO ] [REMOTE ] GNW: Full fetch complete (73406 records). [2025-09-22T19:06:23.970803] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-22T19:06:24.383504] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-22T19:06:24.383734] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-22T19:06:24.384685] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-22T19:06:24.384750] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-22T19:06:24.386297] [DEBUG] [LOCAL ] GNW: Trimmed 73406 records to 51338 (keeping 200 days of data) [2025-09-22T19:06:24.553943] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-22T19:06:24.715759] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T19:06:24.742718] [DEBUG] [LOCAL ] GNW: Primary data saved (51338 records). [2025-09-22T19:06:24.742911] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-22T19:06:24.743030] [INFO ] [MAIN ] Update Progress: 954/2372 symbols completed. GNW took 32.4s. Estimated remaining: 3h 7m 48s. Rate: 7.6 symbols/min [2025-09-22T19:06:24.920181] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:06:24.962120] [DEBUG] [LOCAL ] GOTU: Loaded 40002 existing records from primary storage. [2025-09-22T19:06:24.962276] [INFO ] [MAIN ] GOTU: Loaded 40002 existing records. [2025-09-22T19:06:25.166176] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:06:25.166639] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-22T19:06:25.166816] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-22T19:06:25.176621] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-22T19:06:25.191346] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-22T19:06:25.261321] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T19:06:25.327291] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-22T19:06:25.603576] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:06:26.012267] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T19:06:26.122099] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-22T19:06:26.922083] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-22T19:06:27.016629] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T19:06:27.546002] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T19:06:27.722104] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-22T19:06:28.522159] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-22T19:06:28.566894] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T19:06:29.237606] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T19:06:29.322010] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-22T19:06:30.122056] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-22T19:06:30.311351] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T19:06:30.750119] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T19:06:30.922153] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-22T19:06:31.588997] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T19:06:31.722192] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-22T19:06:32.524342] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-22T19:06:32.531997] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T19:06:33.322079] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-22T19:06:33.372450] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T19:06:33.465241] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-22T19:06:34.122078] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-22T19:06:34.480627] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T19:06:34.922059] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-22T19:06:35.684190] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T19:06:35.722015] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-22T19:06:36.522099] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-22T19:06:36.589107] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T19:06:37.031910] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T19:06:37.039041] [INFO ] [REMOTE ] GOF: Full fetch complete (62262 records). [2025-09-22T19:06:37.039176] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-22T19:06:37.327251] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-22T19:06:37.470018] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-22T19:06:37.470169] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-22T19:06:37.471049] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-22T19:06:37.471115] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-22T19:06:37.473333] [DEBUG] [LOCAL ] GOF: Trimmed 62262 records to 42926 (keeping 200 days of data) [2025-09-22T19:06:37.748080] [DEBUG] [LOCAL ] GOF: Primary data saved (42926 records). [2025-09-22T19:06:37.748208] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-22T19:06:37.748292] [INFO ] [MAIN ] Update Progress: 955/2372 symbols completed. GOF took 29.6s. Estimated remaining: 3h 7m 48s. Rate: 7.5 symbols/min [2025-09-22T19:06:37.922129] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:06:37.952730] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T19:06:38.005519] [DEBUG] [LOCAL ] GPC: Loaded 47474 existing records from primary storage. [2025-09-22T19:06:38.005701] [INFO ] [MAIN ] GPC: Loaded 47474 existing records. [2025-09-22T19:06:38.128588] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-22T19:06:38.199003] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:06:38.199256] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-22T19:06:38.199306] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-22T19:06:38.200537] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-22T19:06:38.200600] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-22T19:06:38.571543] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:06:38.922065] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-22T19:06:39.066621] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T19:06:39.722065] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-22T19:06:39.896487] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T19:06:40.522018] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-22T19:06:40.571420] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T19:06:40.999016] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T19:06:41.322092] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-22T19:06:41.845669] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T19:06:42.122075] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-22T19:06:42.642081] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T19:06:42.922099] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-22T19:06:43.173896] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T19:06:43.722084] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-22T19:06:44.330627] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T19:06:44.522066] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-22T19:06:45.322061] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-22T19:06:45.367273] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T19:06:45.779957] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T19:06:46.122059] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-22T19:06:46.541038] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T19:06:46.546875] [INFO ] [REMOTE ] GOLF: Full fetch complete (44785 records). [2025-09-22T19:06:46.547043] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-22T19:06:46.922195] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-22T19:06:46.939253] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-22T19:06:46.940594] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-22T19:06:46.942381] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-22T19:06:46.942595] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-22T19:06:46.946205] [DEBUG] [LOCAL ] GOLF: Trimmed 44785 records to 31784 (keeping 200 days of data) [2025-09-22T19:06:47.163700] [DEBUG] [LOCAL ] GOLF: Primary data saved (31784 records). [2025-09-22T19:06:47.163855] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-22T19:06:47.164046] [INFO ] [MAIN ] Update Progress: 956/2372 symbols completed. GOLF took 32.2s. Estimated remaining: 3h 7m 42s. Rate: 7.5 symbols/min [2025-09-22T19:06:47.343785] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:06:47.361707] [DEBUG] [LOCAL ] GPI: Loaded 15365 existing records from primary storage. [2025-09-22T19:06:47.361854] [INFO ] [MAIN ] GPI: Loaded 15365 existing records. [2025-09-22T19:06:47.546857] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:06:47.547125] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-22T19:06:47.547182] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-22T19:06:47.547728] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-22T19:06:47.547809] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-22T19:06:47.743965] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-22T19:06:47.927291] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:06:47.963391] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T19:06:48.522076] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-22T19:06:48.573517] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T19:06:49.322074] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-22T19:06:49.432147] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-22T19:06:49.593935] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T19:06:50.122059] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-22T19:06:50.728204] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T19:06:50.922055] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-22T19:06:51.405300] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T19:06:51.412275] [INFO ] [REMOTE ] GOOS: Full fetch complete (66158 records). [2025-09-22T19:06:51.412398] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-22T19:06:51.727175] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-22T19:06:51.813632] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-22T19:06:51.813904] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-22T19:06:51.815450] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-22T19:06:51.815558] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-22T19:06:51.823627] [DEBUG] [LOCAL ] GOOS: Trimmed 66158 records to 45674 (keeping 200 days of data) [2025-09-22T19:06:51.956828] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T19:06:52.137552] [DEBUG] [LOCAL ] GOOS: Primary data saved (45674 records). [2025-09-22T19:06:52.137759] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-22T19:06:52.137890] [INFO ] [MAIN ] Update Progress: 957/2372 symbols completed. GOOS took 32.2s. Estimated remaining: 3h 7m 30s. Rate: 7.5 symbols/min [2025-09-22T19:06:52.522076] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-22T19:06:52.751022] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T19:06:53.322079] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-22T19:06:54.051249] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-22T19:06:54.122036] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-22T19:06:54.308982] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T19:06:54.922111] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-22T19:06:55.203953] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T19:06:55.722130] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-22T19:06:56.501576] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T19:06:56.522033] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-22T19:06:56.676972] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T19:06:57.322095] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-22T19:06:58.122057] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-22T19:06:58.157195] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T19:06:58.731222] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T19:06:58.737167] [INFO ] [REMOTE ] GOTU: Full fetch complete (59937 records). [2025-09-22T19:06:58.737289] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-22T19:06:58.930621] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-22T19:06:59.158190] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-22T19:06:59.158687] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-22T19:06:59.159832] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-22T19:06:59.160008] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-22T19:06:59.175058] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T19:06:59.180070] [DEBUG] [LOCAL ] GOTU: Trimmed 59937 records to 39180 (keeping 200 days of data) [2025-09-22T19:06:59.416156] [DEBUG] [LOCAL ] GOTU: Primary data saved (39180 records). [2025-09-22T19:06:59.416304] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-22T19:06:59.416412] [INFO ] [MAIN ] Update Progress: 958/2372 symbols completed. GOTU took 34.7s. Estimated remaining: 3h 7m 21s. Rate: 7.5 symbols/min [2025-09-22T19:06:59.722111] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-22T19:07:00.593313] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T19:07:00.610159] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-22T19:07:00.612020] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-22T19:07:01.322102] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-22T19:07:02.281309] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T19:07:02.285518] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-22T19:07:02.374903] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T19:07:02.922061] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-22T19:07:03.098874] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-22T19:07:03.722117] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-22T19:07:04.531139] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T19:07:04.541082] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-22T19:07:04.641524] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T19:07:05.322052] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-22T19:07:05.937291] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T19:07:05.944972] [INFO ] [REMOTE ] GPC: Full fetch complete (69150 records). [2025-09-22T19:07:05.945135] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-22T19:07:06.344673] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-22T19:07:06.371081] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-22T19:07:06.371328] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-22T19:07:06.372494] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-22T19:07:06.372587] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-22T19:07:06.371252] [INFO ] [REMOTE ] GPI: Full fetch complete (20814 records). [2025-09-22T19:07:06.373008] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-22T19:07:06.477346] [DEBUG] [LOCAL ] GPC: Trimmed 69150 records to 46710 (keeping 200 days of data) [2025-09-22T19:07:06.962232] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-22T19:07:06.990138] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-22T19:07:07.012798] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-22T19:07:07.018715] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-22T19:07:07.030509] [DEBUG] [LOCAL ] GPI: Trimmed 20814 records to 14915 (keeping 200 days of data) [2025-09-22T19:07:07.139432] [DEBUG] [LOCAL ] GPC: Primary data saved (46710 records). [2025-09-22T19:07:07.144524] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-22T19:07:07.147443] [INFO ] [MAIN ] Update Progress: 959/2372 symbols completed. GPC took 29.4s. Estimated remaining: 3h 7m 12s. Rate: 7.5 symbols/min [2025-09-22T19:07:07.171047] [DEBUG] [LOCAL ] GPI: Primary data saved (14915 records). [2025-09-22T19:07:07.171292] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-22T19:07:07.171488] [INFO ] [MAIN ] Update Progress: 960/2372 symbols completed. GPI took 20.0s. Estimated remaining: 3h 6m 53s. Rate: 7.6 symbols/min [2025-09-22T19:07:07.825111] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:07:07.828760] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:07:07.955461] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:07:07.986638] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:07:07.982816] [DEBUG] [LOCAL ] GPJA: Loaded 4084 existing records from primary storage. [2025-09-22T19:07:07.997734] [INFO ] [MAIN ] GPJA: Loaded 4084 existing records. [2025-09-22T19:07:08.072365] [DEBUG] [LOCAL ] GPMT: Loaded 27210 existing records from primary storage. [2025-09-22T19:07:08.089488] [INFO ] [MAIN ] GPMT: Loaded 27210 existing records. [2025-09-22T19:07:08.345620] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:07:08.446488] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:07:08.446697] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-22T19:07:08.446934] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-22T19:07:08.447053] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-22T19:07:08.447006] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-22T19:07:08.463256] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-22T19:07:08.464852] [DEBUG] [LOCAL ] GPK: Loaded 53444 existing records from primary storage. [2025-09-22T19:07:08.463761] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-22T19:07:08.465127] [INFO ] [MAIN ] GPK: Loaded 53444 existing records. [2025-09-22T19:07:08.463619] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-22T19:07:08.484364] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-22T19:07:08.545243] [DEBUG] [LOCAL ] GPN: Loaded 52839 existing records from primary storage. [2025-09-22T19:07:08.554361] [INFO ] [MAIN ] GPN: Loaded 52839 existing records. [2025-09-22T19:07:09.168794] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:07:09.218997] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:07:09.285984] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-22T19:07:09.291262] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-22T19:07:09.291348] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-22T19:07:09.317904] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-22T19:07:09.356463] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-22T19:07:09.366105] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-22T19:07:09.349702] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-22T19:07:09.489323] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-22T19:07:09.700812] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:07:09.733273] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-22T19:07:09.904728] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:07:09.957726] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-22T19:07:10.305902] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:07:10.324494] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-22T19:07:10.348128] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:07:10.348427] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-22T19:07:10.453550] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-22T19:07:10.455708] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-22T19:07:11.086308] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T19:07:11.092378] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-22T19:07:11.327139] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T19:07:11.330357] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-22T19:07:11.659903] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T19:07:11.723977] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-22T19:07:11.730076] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T19:07:11.880459] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T19:07:11.898879] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T19:07:12.522137] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-22T19:07:13.068244] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-22T19:07:13.328158] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-22T19:07:13.351205] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T19:07:14.107083] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T19:07:14.122044] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-22T19:07:14.922099] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-22T19:07:15.388616] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T19:07:15.399962] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-22T19:07:15.722079] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-22T19:07:16.522061] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-22T19:07:16.999204] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-22T19:07:17.322066] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-22T19:07:17.324960] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T19:07:17.778734] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-22T19:07:18.122045] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-22T19:07:18.922073] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-22T19:07:19.731283] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-22T19:07:19.736916] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T19:07:20.230685] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-22T19:07:20.330110] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T19:07:20.522057] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-22T19:07:21.322005] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-22T19:07:22.122053] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-22T19:07:22.189534] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T19:07:22.396427] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T19:07:22.576115] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-22T19:07:22.922082] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-22T19:07:23.567038] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T19:07:23.568408] [INFO ] [REMOTE ] GPJA: Full fetch complete (7294 records). [2025-09-22T19:07:23.568476] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-22T19:07:23.730521] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-22T19:07:23.979096] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-22T19:07:23.979200] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-22T19:07:23.979404] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-22T19:07:23.979443] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-22T19:07:23.979881] [DEBUG] [LOCAL ] GPJA: Trimmed 7294 records to 4078 (keeping 200 days of data) [2025-09-22T19:07:24.005045] [DEBUG] [LOCAL ] GPJA: Primary data saved (4078 records). [2025-09-22T19:07:24.005167] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-22T19:07:24.005251] [INFO ] [MAIN ] Update Progress: 961/2372 symbols completed. GPJA took 16.8s. Estimated remaining: 3h 6m 58s. Rate: 7.5 symbols/min [2025-09-22T19:07:24.174529] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:07:24.201477] [DEBUG] [LOCAL ] GPOR: Loaded 23489 existing records from primary storage. [2025-09-22T19:07:24.201621] [INFO ] [MAIN ] GPOR: Loaded 23489 existing records. [2025-09-22T19:07:24.383040] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:07:24.383399] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-22T19:07:24.383460] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-22T19:07:24.384518] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-22T19:07:24.384582] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-22T19:07:24.529859] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-22T19:07:24.753932] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:07:25.322073] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-22T19:07:25.633272] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T19:07:26.122024] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-22T19:07:26.261419] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T19:07:26.498244] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T19:07:26.922088] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-22T19:07:27.381771] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T19:07:27.722109] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-22T19:07:28.014376] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T19:07:28.522128] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-22T19:07:29.296073] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T19:07:29.322014] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-22T19:07:29.754221] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T19:07:30.122059] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-22T19:07:30.922070] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-22T19:07:31.235310] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T19:07:31.515197] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T19:07:31.722092] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-22T19:07:32.206272] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T19:07:32.522072] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-22T19:07:32.881235] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T19:07:33.322053] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-22T19:07:33.609243] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T19:07:34.122044] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-22T19:07:34.436421] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T19:07:34.922069] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-22T19:07:35.722039] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-22T19:07:35.834143] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T19:07:35.890888] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T19:07:36.522370] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-22T19:07:36.837244] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T19:07:36.840574] [INFO ] [REMOTE ] GPMT: Full fetch complete (38023 records). [2025-09-22T19:07:36.840685] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-22T19:07:37.249417] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-22T19:07:37.249553] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-22T19:07:37.250580] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-22T19:07:37.250712] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-22T19:07:37.252313] [DEBUG] [LOCAL ] GPMT: Trimmed 38023 records to 26820 (keeping 200 days of data) [2025-09-22T19:07:37.344319] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-22T19:07:37.383003] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T19:07:37.448823] [DEBUG] [LOCAL ] GPMT: Primary data saved (26820 records). [2025-09-22T19:07:37.449005] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-22T19:07:37.449128] [INFO ] [MAIN ] Update Progress: 962/2372 symbols completed. GPMT took 30.3s. Estimated remaining: 3h 6m 58s. Rate: 7.5 symbols/min [2025-09-22T19:07:37.626891] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:07:37.665620] [DEBUG] [LOCAL ] GPRK: Loaded 39827 existing records from primary storage. [2025-09-22T19:07:37.665812] [INFO ] [MAIN ] GPRK: Loaded 39827 existing records. [2025-09-22T19:07:37.842327] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:07:37.842585] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-22T19:07:37.842662] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-22T19:07:37.843873] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-22T19:07:37.843934] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-22T19:07:38.125681] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-22T19:07:38.205997] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:07:38.922118] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-22T19:07:39.117139] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T19:07:39.536303] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T19:07:39.722061] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-22T19:07:39.939263] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T19:07:40.522100] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-22T19:07:41.322064] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-22T19:07:41.364379] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T19:07:42.122055] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-22T19:07:42.240848] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T19:07:42.491846] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T19:07:42.922059] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-22T19:07:43.722080] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-22T19:07:43.911984] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T19:07:44.522102] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-22T19:07:44.621989] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T19:07:44.631023] [INFO ] [REMOTE ] GPK: Full fetch complete (75368 records). [2025-09-22T19:07:44.631240] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-22T19:07:45.127637] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-22T19:07:45.127807] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-22T19:07:45.129189] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-22T19:07:45.129279] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-22T19:07:45.131119] [DEBUG] [LOCAL ] GPK: Trimmed 75368 records to 52695 (keeping 200 days of data) [2025-09-22T19:07:45.296546] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T19:07:45.325488] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-22T19:07:45.617632] [DEBUG] [LOCAL ] GPK: Primary data saved (52695 records). [2025-09-22T19:07:45.617869] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-22T19:07:45.618006] [INFO ] [MAIN ] Update Progress: 963/2372 symbols completed. GPK took 38.4s. Estimated remaining: 3h 6m 50s. Rate: 7.5 symbols/min [2025-09-22T19:07:45.870123] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:07:45.935744] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T19:07:45.957023] [DEBUG] [LOCAL ] GRBK: Loaded 27675 existing records from primary storage. [2025-09-22T19:07:45.957187] [INFO ] [MAIN ] GRBK: Loaded 27675 existing records. [2025-09-22T19:07:46.143239] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-22T19:07:46.149396] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:07:46.150333] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-22T19:07:46.150407] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-22T19:07:46.151414] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-22T19:07:46.151481] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-22T19:07:46.518880] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:07:46.669477] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T19:07:46.922035] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-22T19:07:47.722097] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-22T19:07:47.749959] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T19:07:48.252590] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T19:07:48.257067] [INFO ] [REMOTE ] GPOR: Full fetch complete (34926 records). [2025-09-22T19:07:48.257150] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-22T19:07:48.531865] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-22T19:07:48.629601] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-22T19:07:48.629706] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-22T19:07:48.630311] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-22T19:07:48.630351] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-22T19:07:48.631126] [DEBUG] [LOCAL ] GPOR: Trimmed 34926 records to 22934 (keeping 200 days of data) [2025-09-22T19:07:48.777027] [DEBUG] [LOCAL ] GPOR: Primary data saved (22934 records). [2025-09-22T19:07:48.777176] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-22T19:07:48.777272] [INFO ] [MAIN ] Update Progress: 964/2372 symbols completed. GPOR took 24.8s. Estimated remaining: 3h 6m 35s. Rate: 7.5 symbols/min [2025-09-22T19:07:48.945578] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:07:48.955885] [DEBUG] [LOCAL ] GRC: Loaded 8977 existing records from primary storage. [2025-09-22T19:07:48.955994] [INFO ] [MAIN ] GRC: Loaded 8977 existing records. [2025-09-22T19:07:49.132786] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:07:49.133014] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-22T19:07:49.133061] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-22T19:07:49.133679] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-22T19:07:49.133739] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-22T19:07:49.340221] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-22T19:07:49.493712] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:07:49.562131] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T19:07:49.589035] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T19:07:49.597122] [INFO ] [REMOTE ] GPN: Full fetch complete (74792 records). [2025-09-22T19:07:49.597261] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-22T19:07:49.986078] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-22T19:07:49.986159] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-22T19:07:49.987067] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-22T19:07:49.987133] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-22T19:07:49.988673] [DEBUG] [LOCAL ] GPN: Trimmed 74792 records to 52107 (keeping 200 days of data) [2025-09-22T19:07:50.122060] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-22T19:07:50.324740] [DEBUG] [LOCAL ] GPN: Primary data saved (52107 records). [2025-09-22T19:07:50.324869] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-22T19:07:50.330117] [INFO ] [MAIN ] Update Progress: 965/2372 symbols completed. GPN took 43.2s. Estimated remaining: 3h 6m 18s. Rate: 7.6 symbols/min [2025-09-22T19:07:50.502676] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:07:50.523968] [DEBUG] [LOCAL ] GRDN: Loaded 19583 existing records from primary storage. [2025-09-22T19:07:50.524100] [INFO ] [MAIN ] GRDN: Loaded 19583 existing records. [2025-09-22T19:07:50.713178] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:07:50.713709] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-22T19:07:50.713782] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-22T19:07:50.722054] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-22T19:07:50.735717] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-22T19:07:50.809176] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T19:07:50.927292] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-22T19:07:51.121636] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:07:51.137977] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T19:07:51.722070] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-22T19:07:51.848380] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T19:07:52.522117] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-22T19:07:52.890634] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T19:07:53.322046] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-22T19:07:53.560332] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T19:07:54.122085] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-22T19:07:54.216399] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T19:07:54.749607] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-22T19:07:54.922067] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-22T19:07:55.722074] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-22T19:07:56.021045] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T19:07:56.526604] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-22T19:07:56.529778] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T19:07:57.322016] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-22T19:07:57.401418] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T19:07:58.122064] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-22T19:07:58.416790] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T19:07:58.880022] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T19:07:58.922049] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-22T19:07:59.722107] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-22T19:07:59.841877] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-22T19:08:00.522106] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-22T19:08:00.664582] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-22T19:08:01.322080] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-22T19:08:02.107103] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T19:08:02.123044] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-22T19:08:02.125272] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-22T19:08:02.922010] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-22T19:08:03.326791] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T19:08:03.722058] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-22T19:08:04.265084] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-22T19:08:04.277977] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T19:08:04.522121] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-22T19:08:05.322056] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-22T19:08:05.749394] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T19:08:06.100838] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T19:08:06.122007] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-22T19:08:06.883963] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T19:08:06.922067] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-22T19:08:07.722072] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-22T19:08:07.800121] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T19:08:08.522060] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-22T19:08:09.110072] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T19:08:09.322070] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-22T19:08:09.554089] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T19:08:10.122052] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-22T19:08:10.380452] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T19:08:10.922063] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-22T19:08:11.110927] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T19:08:11.722076] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-22T19:08:12.325327] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T19:08:12.522090] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-22T19:08:12.926606] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T19:08:13.322049] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-22T19:08:13.612235] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T19:08:13.618550] [INFO ] [REMOTE ] GRBK: Full fetch complete (40702 records). [2025-09-22T19:08:13.618785] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-22T19:08:14.015049] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-22T19:08:14.015156] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-22T19:08:14.015940] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-22T19:08:14.016053] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-22T19:08:14.017029] [DEBUG] [LOCAL ] GRBK: Trimmed 40702 records to 27108 (keeping 200 days of data) [2025-09-22T19:08:14.129070] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-22T19:08:14.184349] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T19:08:14.190871] [DEBUG] [LOCAL ] GRBK: Primary data saved (27108 records). [2025-09-22T19:08:14.191024] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-22T19:08:14.191113] [INFO ] [MAIN ] Update Progress: 966/2372 symbols completed. GRBK took 28.6s. Estimated remaining: 3h 6m 33s. Rate: 7.5 symbols/min [2025-09-22T19:08:14.374754] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:08:14.422282] [DEBUG] [LOCAL ] GRMN: Loaded 42296 existing records from primary storage. [2025-09-22T19:08:14.422427] [INFO ] [MAIN ] GRMN: Loaded 42296 existing records. [2025-09-22T19:08:14.632588] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:08:14.632875] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-22T19:08:14.632925] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-22T19:08:14.634220] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-22T19:08:14.634283] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-22T19:08:14.927210] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-22T19:08:15.034241] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:08:15.609269] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T19:08:15.722025] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-22T19:08:15.788901] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-22T19:08:15.790868] [INFO ] [REMOTE ] GRC: Full fetch complete (12935 records). [2025-09-22T19:08:15.790940] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-22T19:08:16.160192] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-22T19:08:16.160332] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-22T19:08:16.160703] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-22T19:08:16.160766] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-22T19:08:16.161246] [DEBUG] [LOCAL ] GRC: Trimmed 12935 records to 8788 (keeping 200 days of data) [2025-09-22T19:08:16.214778] [DEBUG] [LOCAL ] GRC: Primary data saved (8788 records). [2025-09-22T19:08:16.214938] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-22T19:08:16.215048] [INFO ] [MAIN ] Update Progress: 967/2372 symbols completed. GRC took 27.4s. Estimated remaining: 3h 6m 17s. Rate: 7.5 symbols/min [2025-09-22T19:08:16.386290] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:08:16.439066] [DEBUG] [LOCAL ] GRND: Loaded 50876 existing records from primary storage. [2025-09-22T19:08:16.439238] [INFO ] [MAIN ] GRND: Loaded 50876 existing records. [2025-09-22T19:08:16.527152] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-22T19:08:16.629133] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:08:16.629402] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-22T19:08:16.629470] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-22T19:08:16.631015] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-22T19:08:16.631078] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-22T19:08:16.994057] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:08:17.266186] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T19:08:17.322033] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-22T19:08:17.624796] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T19:08:18.122037] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-22T19:08:18.910443] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T19:08:18.921995] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-22T19:08:19.396855] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T19:08:19.401821] [INFO ] [REMOTE ] GRDN: Full fetch complete (25876 records). [2025-09-22T19:08:19.401922] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-22T19:08:19.729574] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-22T19:08:19.783469] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-22T19:08:19.783574] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-22T19:08:19.784317] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-22T19:08:19.784385] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-22T19:08:19.785219] [DEBUG] [LOCAL ] GRDN: Trimmed 25876 records to 19640 (keeping 200 days of data) [2025-09-22T19:08:19.914533] [DEBUG] [LOCAL ] GRDN: Primary data saved (19640 records). [2025-09-22T19:08:19.914717] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-22T19:08:19.914819] [INFO ] [MAIN ] Update Progress: 968/2372 symbols completed. GRDN took 29.6s. Estimated remaining: 3h 6m 3s. Rate: 7.5 symbols/min [2025-09-22T19:08:20.112525] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:08:20.156270] [DEBUG] [LOCAL ] GRNT: Loaded 34483 existing records from primary storage. [2025-09-22T19:08:20.156523] [INFO ] [MAIN ] GRNT: Loaded 34483 existing records. [2025-09-22T19:08:20.334111] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T19:08:20.387317] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:08:20.387709] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-22T19:08:20.387769] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-22T19:08:20.388749] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-22T19:08:20.388812] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-22T19:08:20.527232] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-22T19:08:20.779229] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:08:21.240443] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T19:08:21.248450] [INFO ] [REMOTE ] GPRK: Full fetch complete (57213 records). [2025-09-22T19:08:21.248565] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-22T19:08:21.327156] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-22T19:08:21.645193] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-22T19:08:21.645274] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-22T19:08:21.646085] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-22T19:08:21.646148] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-22T19:08:21.647366] [DEBUG] [LOCAL ] GPRK: Trimmed 57213 records to 39112 (keeping 200 days of data) [2025-09-22T19:08:21.881302] [DEBUG] [LOCAL ] GPRK: Primary data saved (39112 records). [2025-09-22T19:08:21.881480] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-22T19:08:21.881600] [INFO ] [MAIN ] Update Progress: 969/2372 symbols completed. GPRK took 44.4s. Estimated remaining: 3h 5m 46s. Rate: 7.6 symbols/min [2025-09-22T19:08:22.056810] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:08:22.067505] [DEBUG] [LOCAL ] GROV: Loaded 9258 existing records from primary storage. [2025-09-22T19:08:22.067613] [INFO ] [MAIN ] GROV: Loaded 9258 existing records. [2025-09-22T19:08:22.132358] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-22T19:08:22.258275] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:08:22.258853] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-22T19:08:22.258978] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-22T19:08:22.259361] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-22T19:08:22.259425] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-22T19:08:22.622970] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-22T19:08:22.679758] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:08:22.888901] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T19:08:22.922016] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-22T19:08:23.274112] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T19:08:23.722064] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-22T19:08:24.522074] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-22T19:08:24.524835] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T19:08:24.655035] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T19:08:25.322083] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-22T19:08:26.122075] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-22T19:08:26.237798] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T19:08:26.429062] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T19:08:26.688519] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T19:08:26.922067] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-22T19:08:27.722080] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-22T19:08:28.155794] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T19:08:28.522074] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-22T19:08:28.864256] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T19:08:29.322054] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-22T19:08:30.024255] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T19:08:30.122079] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-22T19:08:30.790055] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T19:08:30.819851] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T19:08:30.922057] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-22T19:08:31.722072] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-22T19:08:32.522053] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-22T19:08:32.621870] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T19:08:32.868806] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T19:08:33.322094] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-22T19:08:33.776249] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T19:08:34.122052] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-22T19:08:34.140756] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T19:08:34.922104] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-22T19:08:35.565189] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T19:08:35.722114] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-22T19:08:35.811840] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T19:08:36.522097] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-22T19:08:37.081573] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T19:08:37.101331] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T19:08:37.322077] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-22T19:08:38.122046] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-22T19:08:38.139141] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T19:08:38.922118] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-22T19:08:39.722609] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-22T19:08:39.730364] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T19:08:39.739001] [INFO ] [REMOTE ] GRMN: Full fetch complete (60299 records). [2025-09-22T19:08:39.739278] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-22T19:08:40.205184] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-22T19:08:40.205284] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-22T19:08:40.206230] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-22T19:08:40.206299] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-22T19:08:40.207595] [DEBUG] [LOCAL ] GRMN: Trimmed 60299 records to 41568 (keeping 200 days of data) [2025-09-22T19:08:40.480380] [DEBUG] [LOCAL ] GRMN: Primary data saved (41568 records). [2025-09-22T19:08:40.480515] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-22T19:08:40.480599] [INFO ] [MAIN ] Update Progress: 970/2372 symbols completed. GRMN took 26.3s. Estimated remaining: 3h 5m 53s. Rate: 7.5 symbols/min [2025-09-22T19:08:40.524193] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-22T19:08:40.698529] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:08:40.701507] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T19:08:40.720212] [DEBUG] [LOCAL ] GRX: Loaded 4454 existing records from primary storage. [2025-09-22T19:08:40.720872] [INFO ] [MAIN ] GRX: Loaded 4454 existing records. [2025-09-22T19:08:40.913589] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:08:40.914040] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-22T19:08:40.914142] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-22T19:08:40.921854] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-22T19:08:40.935575] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-22T19:08:40.970332] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T19:08:41.317278] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:08:41.322000] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-22T19:08:41.351845] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T19:08:41.928381] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-22T19:08:42.122070] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-22T19:08:42.922086] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-22T19:08:43.372932] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T19:08:43.722089] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-22T19:08:44.522118] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-22T19:08:44.602585] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T19:08:45.124615] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T19:08:45.124416] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T19:08:45.322064] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-22T19:08:45.791635] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-22T19:08:46.122112] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-22T19:08:46.922131] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-22T19:08:47.722177] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-22T19:08:47.736092] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-22T19:08:47.823571] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T19:08:48.522056] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-22T19:08:49.072764] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T19:08:49.322087] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-22T19:08:49.822555] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-22T19:08:49.823931] [INFO ] [REMOTE ] GROV: Full fetch complete (14686 records). [2025-09-22T19:08:49.824019] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-22T19:08:50.128934] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-22T19:08:50.219464] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-22T19:08:50.219580] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-22T19:08:50.220074] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-22T19:08:50.220152] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-22T19:08:50.220966] [DEBUG] [LOCAL ] GROV: Trimmed 14686 records to 9089 (keeping 200 days of data) [2025-09-22T19:08:50.287971] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T19:08:50.313270] [DEBUG] [LOCAL ] GROV: Primary data saved (9089 records). [2025-09-22T19:08:50.313406] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-22T19:08:50.313490] [INFO ] [MAIN ] Update Progress: 971/2372 symbols completed. GROV took 28.4s. Estimated remaining: 3h 5m 48s. Rate: 7.5 symbols/min [2025-09-22T19:08:50.483076] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:08:50.541004] [DEBUG] [LOCAL ] GS: Loaded 52916 existing records from primary storage. [2025-09-22T19:08:50.541166] [INFO ] [MAIN ] GS: Loaded 52916 existing records. [2025-09-22T19:08:50.732004] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:08:50.732238] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-22T19:08:50.732285] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-22T19:08:50.734101] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-22T19:08:50.734166] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-22T19:08:50.818217] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-22T19:08:50.925282] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-22T19:08:51.112796] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:08:51.722090] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-22T19:08:52.522105] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-22T19:08:52.874027] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-22T19:08:52.882104] [INFO ] [REMOTE ] GRND: Full fetch complete (70188 records). [2025-09-22T19:08:52.882281] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-22T19:08:53.308854] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-22T19:08:53.309080] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-22T19:08:53.310085] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-22T19:08:53.310245] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-22T19:08:53.324243] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-22T19:08:53.336219] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T19:08:53.344616] [DEBUG] [LOCAL ] GRND: Trimmed 70188 records to 50065 (keeping 200 days of data) [2025-09-22T19:08:53.672337] [DEBUG] [LOCAL ] GRND: Primary data saved (50065 records). [2025-09-22T19:08:53.672503] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-22T19:08:53.672671] [INFO ] [MAIN ] Update Progress: 972/2372 symbols completed. GRND took 37.5s. Estimated remaining: 3h 5m 34s. Rate: 7.5 symbols/min [2025-09-22T19:08:53.848973] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:08:53.890693] [DEBUG] [LOCAL ] GSBD: Loaded 39847 existing records from primary storage. [2025-09-22T19:08:53.890891] [INFO ] [MAIN ] GSBD: Loaded 39847 existing records. [2025-09-22T19:08:53.977829] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-22T19:08:54.101279] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:08:54.101580] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-22T19:08:54.101678] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-22T19:08:54.102852] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-22T19:08:54.102914] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-22T19:08:54.127208] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-22T19:08:54.490282] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:08:54.536888] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-22T19:08:54.922096] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-22T19:08:55.483390] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T19:08:55.534268] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T19:08:55.540615] [INFO ] [REMOTE ] GRNT: Full fetch complete (48436 records). [2025-09-22T19:08:55.540880] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-22T19:08:55.727400] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-22T19:08:55.946135] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-22T19:08:55.946225] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-22T19:08:55.947002] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-22T19:08:55.947066] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-22T19:08:55.948216] [DEBUG] [LOCAL ] GRNT: Trimmed 48436 records to 33861 (keeping 200 days of data) [2025-09-22T19:08:56.160086] [DEBUG] [LOCAL ] GRNT: Primary data saved (33861 records). [2025-09-22T19:08:56.160212] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-22T19:08:56.160292] [INFO ] [MAIN ] Update Progress: 973/2372 symbols completed. GRNT took 36.2s. Estimated remaining: 3h 5m 18s. Rate: 7.6 symbols/min [2025-09-22T19:08:56.332399] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:08:56.390946] [DEBUG] [LOCAL ] GSK: Loaded 54278 existing records from primary storage. [2025-09-22T19:08:56.391126] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T19:08:56.393450] [INFO ] [MAIN ] GSK: Loaded 54278 existing records. [2025-09-22T19:08:56.533895] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-22T19:08:56.579125] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:08:56.579373] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-22T19:08:56.579429] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-22T19:08:56.581213] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-22T19:08:56.581290] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-22T19:08:56.941256] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:08:57.191165] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T19:08:57.322093] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-22T19:08:57.886479] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-22T19:08:58.122100] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-22T19:08:58.922059] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-22T19:08:59.722062] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-22T19:08:59.780986] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T19:09:00.522058] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-22T19:09:01.026378] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-22T19:09:01.028164] [INFO ] [REMOTE ] GRX: Full fetch complete (6505 records). [2025-09-22T19:09:01.028233] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-22T19:09:01.333709] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-22T19:09:01.434735] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-22T19:09:01.435143] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-22T19:09:01.435551] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-22T19:09:01.435666] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-22T19:09:01.436844] [DEBUG] [LOCAL ] GRX: Trimmed 6505 records to 4423 (keeping 200 days of data) [2025-09-22T19:09:01.546453] [DEBUG] [LOCAL ] GRX: Primary data saved (4423 records). [2025-09-22T19:09:01.549405] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-09-22T19:09:01.549638] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-22T19:09:01.560780] [INFO ] [MAIN ] Update Progress: 974/2372 symbols completed. GRX took 21.1s. Estimated remaining: 3h 5m 6s. Rate: 7.6 symbols/min [2025-09-22T19:09:01.565736] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T19:09:01.761147] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:09:01.808001] [DEBUG] [LOCAL ] GSL: Loaded 34370 existing records from primary storage. [2025-09-22T19:09:01.808208] [INFO ] [MAIN ] GSL: Loaded 34370 existing records. [2025-09-22T19:09:01.991756] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:09:01.992036] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-22T19:09:01.992088] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-22T19:09:01.993544] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-22T19:09:01.993608] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-22T19:09:02.127180] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-22T19:09:02.395731] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:09:02.922095] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-22T19:09:03.722079] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-22T19:09:04.470347] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (3.14 seconds). [2025-09-22T19:09:04.522010] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-22T19:09:05.389997] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-22T19:09:05.400230] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-22T19:09:05.499512] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (3.37 seconds). [2025-09-22T19:09:05.531987] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T19:09:06.122040] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-22T19:09:06.526812] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-22T19:09:06.709728] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-22T19:09:06.922071] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-22T19:09:07.722074] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-22T19:09:08.383866] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-22T19:09:08.530759] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-22T19:09:08.556689] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T19:09:08.985936] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-22T19:09:09.322050] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-22T19:09:10.122054] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-22T19:09:10.801989] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-22T19:09:10.841314] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T19:09:10.922049] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-22T19:09:11.428869] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T19:09:11.722057] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-22T19:09:12.522036] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-22T19:09:12.679050] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T19:09:13.266487] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T19:09:13.322011] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-22T19:09:14.122066] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-22T19:09:14.666283] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-22T19:09:14.715837] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T19:09:14.922070] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-22T19:09:15.625517] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T19:09:15.722091] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-22T19:09:16.522072] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-22T19:09:17.322420] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-22T19:09:17.322586] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-22T19:09:18.122052] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-22T19:09:18.259089] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-22T19:09:18.676069] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-22T19:09:18.709950] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T19:09:18.922058] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-22T19:09:19.722111] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-22T19:09:20.031457] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-22T19:09:20.427447] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T19:09:20.522129] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-22T19:09:21.216630] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T19:09:21.322074] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-22T19:09:21.985624] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T19:09:22.122045] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-22T19:09:22.922028] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-22T19:09:23.068224] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T19:09:23.163375] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T19:09:23.722062] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-22T19:09:24.376825] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T19:09:24.522052] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-22T19:09:25.098957] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T19:09:25.322270] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-22T19:09:25.977993] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T19:09:25.988122] [INFO ] [REMOTE ] GSBD: Full fetch complete (58464 records). [2025-09-22T19:09:25.988298] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-22T19:09:26.127183] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-22T19:09:26.428952] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-22T19:09:26.429069] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-22T19:09:26.429906] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-22T19:09:26.430017] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-22T19:09:26.433442] [DEBUG] [LOCAL ] GSBD: Trimmed 58464 records to 39134 (keeping 200 days of data) [2025-09-22T19:09:26.707173] [DEBUG] [LOCAL ] GSBD: Primary data saved (39134 records). [2025-09-22T19:09:26.707346] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-22T19:09:26.707572] [INFO ] [MAIN ] Update Progress: 975/2372 symbols completed. GSBD took 33.0s. Estimated remaining: 3h 5m 23s. Rate: 7.5 symbols/min [2025-09-22T19:09:26.895663] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:09:26.931255] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-22T19:09:26.986970] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T19:09:26.985584] [DEBUG] [LOCAL ] GTES: Loaded 51492 existing records from primary storage. [2025-09-22T19:09:26.987126] [INFO ] [MAIN ] GTES: Loaded 51492 existing records. [2025-09-22T19:09:27.196993] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:09:27.197237] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-22T19:09:27.197284] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-22T19:09:27.198468] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-22T19:09:27.198544] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-22T19:09:27.565268] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:09:27.647887] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T19:09:27.722023] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-22T19:09:28.522011] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-22T19:09:28.611770] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T19:09:29.088142] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T19:09:29.093317] [INFO ] [REMOTE ] GSL: Full fetch complete (48177 records). [2025-09-22T19:09:29.093406] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-22T19:09:29.327397] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-22T19:09:29.480694] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-22T19:09:29.480784] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-22T19:09:29.481740] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-22T19:09:29.481803] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-22T19:09:29.482852] [DEBUG] [LOCAL ] GSL: Trimmed 48177 records to 33677 (keeping 200 days of data) [2025-09-22T19:09:29.695859] [DEBUG] [LOCAL ] GSL: Primary data saved (33677 records). [2025-09-22T19:09:29.696028] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-22T19:09:29.696171] [INFO ] [MAIN ] Update Progress: 976/2372 symbols completed. GSL took 28.1s. Estimated remaining: 3h 5m 8s. Rate: 7.5 symbols/min [2025-09-22T19:09:29.940526] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:09:29.986253] [DEBUG] [LOCAL ] GTLS: Loaded 43830 existing records from primary storage. [2025-09-22T19:09:29.986387] [INFO ] [MAIN ] GTLS: Loaded 43830 existing records. [2025-09-22T19:09:30.139862] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-22T19:09:30.172448] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:09:30.172893] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-22T19:09:30.172970] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-22T19:09:30.174210] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-22T19:09:30.174275] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-22T19:09:30.268218] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T19:09:30.309096] [INFO ] [REMOTE ] GSK: Full fetch complete (77474 records). [2025-09-22T19:09:30.314976] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-22T19:09:30.860266] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:09:30.927109] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-22T19:09:30.985378] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-22T19:09:30.985468] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-22T19:09:30.986374] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-22T19:09:30.986440] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-22T19:09:30.990961] [DEBUG] [LOCAL ] GSK: Trimmed 77474 records to 53495 (keeping 200 days of data) [2025-09-22T19:09:31.324065] [DEBUG] [LOCAL ] GSK: Primary data saved (53495 records). [2025-09-22T19:09:31.324197] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-22T19:09:31.324282] [INFO ] [MAIN ] Update Progress: 977/2372 symbols completed. GSK took 35.2s. Estimated remaining: 3h 4m 51s. Rate: 7.5 symbols/min [2025-09-22T19:09:31.498792] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:09:31.521804] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-22T19:09:31.532080] [INFO ] [REMOTE ] GS: Full fetch complete (75852 records). [2025-09-22T19:09:31.532264] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-22T19:09:31.876347] [DEBUG] [LOCAL ] GTN: Loaded 46463 existing records from primary storage. [2025-09-22T19:09:31.903289] [INFO ] [MAIN ] GTN: Loaded 46463 existing records. [2025-09-22T19:09:32.065842] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-22T19:09:32.092297] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-22T19:09:32.118564] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-22T19:09:32.119445] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-22T19:09:32.204515] [DEBUG] [LOCAL ] GS: Trimmed 75852 records to 52088 (keeping 200 days of data) [2025-09-22T19:09:32.232756] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:09:32.234916] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-22T19:09:32.247749] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-22T19:09:32.410431] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-22T19:09:32.410082] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-22T19:09:32.411118] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-22T19:09:32.450377] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-22T19:09:33.038160] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-22T19:09:33.070547] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-22T19:09:33.182083] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:09:33.322733] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-22T19:09:33.341577] [DEBUG] [LOCAL ] GS: Primary data saved (52088 records). [2025-09-22T19:09:33.341783] [INFO ] [MAIN ] GS: Full history saved. [2025-09-22T19:09:33.341938] [INFO ] [MAIN ] Update Progress: 978/2372 symbols completed. GS took 43.0s. Estimated remaining: 3h 4m 34s. Rate: 7.6 symbols/min [2025-09-22T19:09:33.522972] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:09:33.554327] [DEBUG] [LOCAL ] GTY: Loaded 30827 existing records from primary storage. [2025-09-22T19:09:33.554469] [INFO ] [MAIN ] GTY: Loaded 30827 existing records. [2025-09-22T19:09:33.736576] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:09:33.736878] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-22T19:09:33.736930] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-22T19:09:33.737882] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-22T19:09:33.737941] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-22T19:09:34.087952] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:09:34.121999] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-22T19:09:34.158157] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T19:09:34.824692] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T19:09:34.912525] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T19:09:34.922152] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-22T19:09:35.436012] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T19:09:35.722069] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-22T19:09:36.199287] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T19:09:36.522106] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-22T19:09:36.720752] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T19:09:37.322065] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-22T19:09:37.977145] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T19:09:38.122049] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-22T19:09:38.653176] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T19:09:38.922072] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-22T19:09:39.265503] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T19:09:39.722076] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-22T19:09:40.522126] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-22T19:09:40.862160] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T19:09:41.281385] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T19:09:41.322017] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-22T19:09:42.017156] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T19:09:42.122039] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-22T19:09:42.344530] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T19:09:42.922062] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-22T19:09:43.722136] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-22T19:09:43.850934] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T19:09:43.882384] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T19:09:44.522084] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-22T19:09:45.095839] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T19:09:45.322021] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-22T19:09:45.445812] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T19:09:46.122045] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-22T19:09:46.924827] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-22T19:09:46.930375] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-22T19:09:47.555951] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T19:09:47.722073] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-22T19:09:48.396558] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T19:09:48.522062] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-22T19:09:49.243470] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T19:09:49.322060] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-22T19:09:49.797384] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T19:09:50.122055] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-22T19:09:50.903413] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T19:09:50.922026] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-22T19:09:51.691719] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T19:09:51.722110] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-22T19:09:52.087442] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-22T19:09:52.522107] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-22T19:09:53.322091] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-22T19:09:53.431392] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T19:09:54.122118] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-22T19:09:54.180195] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T19:09:54.408030] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T19:09:54.413151] [INFO ] [REMOTE ] GTY: Full fetch complete (43091 records). [2025-09-22T19:09:54.413292] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-22T19:09:54.816584] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-22T19:09:54.816692] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-22T19:09:54.817431] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-22T19:09:54.817529] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-22T19:09:54.818519] [DEBUG] [LOCAL ] GTY: Trimmed 43091 records to 30384 (keeping 200 days of data) [2025-09-22T19:09:54.926808] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-22T19:09:55.011272] [DEBUG] [LOCAL ] GTY: Primary data saved (30384 records). [2025-09-22T19:09:55.011440] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-22T19:09:55.011533] [INFO ] [MAIN ] Update Progress: 979/2372 symbols completed. GTY took 21.7s. Estimated remaining: 3h 4m 46s. Rate: 7.5 symbols/min [2025-09-22T19:09:55.178613] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:09:55.192158] [DEBUG] [LOCAL ] GUG: Loaded 12453 existing records from primary storage. [2025-09-22T19:09:55.192277] [INFO ] [MAIN ] GUG: Loaded 12453 existing records. [2025-09-22T19:09:55.374140] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:09:55.374612] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-22T19:09:55.374730] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-22T19:09:55.375276] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-22T19:09:55.375347] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-22T19:09:55.712914] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T19:09:55.733224] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-22T19:09:55.813155] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:09:56.522082] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-22T19:09:56.832908] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T19:09:57.200356] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T19:09:57.322040] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-22T19:09:57.483276] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T19:09:58.122058] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-22T19:09:58.806750] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T19:09:58.922006] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-22T19:09:59.336197] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T19:09:59.343250] [INFO ] [REMOTE ] GTN: Full fetch complete (66362 records). [2025-09-22T19:09:59.343379] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-22T19:09:59.727472] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-22T19:09:59.745461] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-22T19:09:59.745592] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-22T19:09:59.746635] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-22T19:09:59.746887] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-22T19:09:59.748432] [DEBUG] [LOCAL ] GTN: Trimmed 66362 records to 45674 (keeping 200 days of data) [2025-09-22T19:10:00.031272] [DEBUG] [LOCAL ] GTN: Primary data saved (45674 records). [2025-09-22T19:10:00.031461] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-22T19:10:00.031561] [INFO ] [MAIN ] Update Progress: 980/2372 symbols completed. GTN took 28.7s. Estimated remaining: 3h 4m 34s. Rate: 7.5 symbols/min [2025-09-22T19:10:00.217302] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:10:00.245984] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T19:10:00.271154] [DEBUG] [LOCAL ] GUT: Loaded 15779 existing records from primary storage. [2025-09-22T19:10:00.271310] [INFO ] [MAIN ] GUT: Loaded 15779 existing records. [2025-09-22T19:10:00.446362] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:10:00.446695] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-22T19:10:00.446753] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-22T19:10:00.447280] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-22T19:10:00.447376] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-22T19:10:00.527192] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-22T19:10:00.803666] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:10:01.322055] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-22T19:10:01.509424] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T19:10:02.052421] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T19:10:02.122061] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-22T19:10:02.269226] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T19:10:02.922055] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-22T19:10:03.124894] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T19:10:03.722058] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-22T19:10:04.387465] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T19:10:04.394844] [INFO ] [REMOTE ] GTLS: Full fetch complete (61417 records). [2025-09-22T19:10:04.395018] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-22T19:10:04.527139] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-22T19:10:04.814006] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-22T19:10:04.814211] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-22T19:10:04.815209] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-22T19:10:04.815436] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-22T19:10:04.828390] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-22T19:10:04.827917] [DEBUG] [LOCAL ] GTLS: Trimmed 61417 records to 43065 (keeping 200 days of data) [2025-09-22T19:10:05.087010] [DEBUG] [LOCAL ] GTLS: Primary data saved (43065 records). [2025-09-22T19:10:05.087148] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-22T19:10:05.087233] [INFO ] [MAIN ] Update Progress: 981/2372 symbols completed. GTLS took 35.4s. Estimated remaining: 3h 4m 22s. Rate: 7.5 symbols/min [2025-09-22T19:10:05.258115] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:10:05.292425] [DEBUG] [LOCAL ] GVA: Loaded 34588 existing records from primary storage. [2025-09-22T19:10:05.292569] [INFO ] [MAIN ] GVA: Loaded 34588 existing records. [2025-09-22T19:10:05.327194] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-22T19:10:05.474967] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:10:05.475211] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-22T19:10:05.475260] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-22T19:10:05.476470] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-22T19:10:05.476531] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-22T19:10:05.827814] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:10:06.079061] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-22T19:10:06.122060] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-22T19:10:06.339286] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-22T19:10:06.347715] [INFO ] [REMOTE ] GTES: Full fetch complete (74002 records). [2025-09-22T19:10:06.347841] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-22T19:10:06.771196] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-22T19:10:06.771317] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-22T19:10:06.772250] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-22T19:10:06.772314] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-22T19:10:06.773747] [DEBUG] [LOCAL ] GTES: Trimmed 74002 records to 50703 (keeping 200 days of data) [2025-09-22T19:10:06.936136] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-22T19:10:07.072046] [DEBUG] [LOCAL ] GTES: Primary data saved (50703 records). [2025-09-22T19:10:07.072197] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-22T19:10:07.072282] [INFO ] [MAIN ] Update Progress: 982/2372 symbols completed. GTES took 40.4s. Estimated remaining: 3h 4m 5s. Rate: 7.6 symbols/min [2025-09-22T19:10:07.245865] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:10:07.262252] [DEBUG] [LOCAL ] GWH: Loaded 15335 existing records from primary storage. [2025-09-22T19:10:07.262378] [INFO ] [MAIN ] GWH: Loaded 15335 existing records. [2025-09-22T19:10:07.437386] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:10:07.437691] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-22T19:10:07.437749] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-22T19:10:07.438253] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-22T19:10:07.438313] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-22T19:10:07.724992] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-22T19:10:07.762523] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T19:10:07.822023] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:10:07.841617] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T19:10:08.522068] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-22T19:10:08.594695] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T19:10:09.322055] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-22T19:10:09.630864] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T19:10:09.812209] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-22T19:10:10.122055] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-22T19:10:10.871792] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T19:10:10.922021] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-22T19:10:11.722048] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-22T19:10:11.874817] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T19:10:12.522048] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-22T19:10:12.580157] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T19:10:13.136321] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T19:10:13.322062] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-22T19:10:14.122148] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-22T19:10:14.171050] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T19:10:14.922102] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-22T19:10:15.062457] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-22T19:10:15.722122] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-22T19:10:16.240780] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T19:10:16.390737] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-22T19:10:16.522087] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-22T19:10:17.303462] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T19:10:17.322024] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-22T19:10:18.122074] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-22T19:10:18.393774] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T19:10:18.397301] [INFO ] [REMOTE ] GUT: Full fetch complete (23065 records). [2025-09-22T19:10:18.397404] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-22T19:10:18.814342] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-22T19:10:18.814450] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-22T19:10:18.815439] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-22T19:10:18.815511] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-22T19:10:18.816429] [DEBUG] [LOCAL ] GUT: Trimmed 23065 records to 15525 (keeping 200 days of data) [2025-09-22T19:10:18.919374] [DEBUG] [LOCAL ] GUT: Primary data saved (15525 records). [2025-09-22T19:10:18.919587] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-22T19:10:18.919725] [INFO ] [MAIN ] Update Progress: 983/2372 symbols completed. GUT took 18.9s. Estimated remaining: 3h 4m 3s. Rate: 7.5 symbols/min [2025-09-22T19:10:18.932759] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-22T19:10:19.122455] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:10:19.123982] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T19:10:19.172298] [DEBUG] [LOCAL ] GWRE: Loaded 41935 existing records from primary storage. [2025-09-22T19:10:19.172564] [INFO ] [MAIN ] GWRE: Loaded 41935 existing records. [2025-09-22T19:10:19.357093] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:10:19.357450] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-22T19:10:19.357503] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-22T19:10:19.358873] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-22T19:10:19.358937] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-22T19:10:19.732231] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-22T19:10:19.740453] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:10:19.798420] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T19:10:20.449238] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-22T19:10:20.522063] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-22T19:10:21.322080] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-22T19:10:22.044906] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-22T19:10:22.115271] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T19:10:22.125404] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-22T19:10:22.922106] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-22T19:10:23.218366] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T19:10:23.722102] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-22T19:10:23.816501] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T19:10:24.522188] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-22T19:10:25.084554] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T19:10:25.322092] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-22T19:10:25.593474] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T19:10:25.596259] [INFO ] [REMOTE ] GUG: Full fetch complete (20056 records). [2025-09-22T19:10:25.596335] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-22T19:10:26.030185] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-22T19:10:26.030347] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-22T19:10:26.031378] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-22T19:10:26.031469] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-22T19:10:26.032634] [DEBUG] [LOCAL ] GUG: Trimmed 20056 records to 12212 (keeping 200 days of data) [2025-09-22T19:10:26.126615] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-22T19:10:26.126436] [DEBUG] [LOCAL ] GUG: Primary data saved (12212 records). [2025-09-22T19:10:26.128157] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-22T19:10:26.128288] [INFO ] [MAIN ] Update Progress: 984/2372 symbols completed. GUG took 31.1s. Estimated remaining: 3h 3m 54s. Rate: 7.5 symbols/min [2025-09-22T19:10:26.389167] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:10:26.435315] [DEBUG] [LOCAL ] GWW: Loaded 20360 existing records from primary storage. [2025-09-22T19:10:26.435604] [INFO ] [MAIN ] GWW: Loaded 20360 existing records. [2025-09-22T19:10:26.730887] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:10:26.731492] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-22T19:10:26.731691] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-22T19:10:26.732821] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-22T19:10:26.732955] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-22T19:10:26.914113] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T19:10:26.924523] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-22T19:10:27.235212] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:10:27.722136] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-22T19:10:27.943849] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T19:10:27.944220] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T19:10:28.522133] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-22T19:10:28.581902] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T19:10:29.322126] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-22T19:10:29.867310] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T19:10:30.122129] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-22T19:10:30.327370] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T19:10:30.922151] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-22T19:10:31.722136] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-22T19:10:31.885337] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T19:10:32.086334] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T19:10:32.522115] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-22T19:10:32.585238] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T19:10:33.322092] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-22T19:10:33.913825] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T19:10:34.122114] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-22T19:10:34.922082] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-22T19:10:34.934583] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T19:10:35.070919] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T19:10:35.722176] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-22T19:10:35.978969] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-22T19:10:36.522146] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-22T19:10:37.213689] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T19:10:37.322117] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-22T19:10:37.747383] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T19:10:38.122120] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-22T19:10:38.179140] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T19:10:38.922126] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-22T19:10:39.247300] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-22T19:10:39.663079] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T19:10:39.666225] [INFO ] [REMOTE ] GWH: Full fetch complete (20617 records). [2025-09-22T19:10:39.666308] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-22T19:10:39.729097] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-22T19:10:40.090270] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-22T19:10:40.090383] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-22T19:10:40.091406] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-22T19:10:40.091479] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-22T19:10:40.092458] [DEBUG] [LOCAL ] GWH: Trimmed 20617 records to 15311 (keeping 200 days of data) [2025-09-22T19:10:40.190156] [DEBUG] [LOCAL ] GWH: Primary data saved (15311 records). [2025-09-22T19:10:40.190382] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-22T19:10:40.190511] [INFO ] [MAIN ] Update Progress: 985/2372 symbols completed. GWH took 33.1s. Estimated remaining: 3h 3m 55s. Rate: 7.5 symbols/min [2025-09-22T19:10:40.371869] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:10:40.418706] [DEBUG] [LOCAL ] GXO: Loaded 48518 existing records from primary storage. [2025-09-22T19:10:40.418882] [INFO ] [MAIN ] GXO: Loaded 48518 existing records. [2025-09-22T19:10:40.526963] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-22T19:10:40.608941] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:10:40.609196] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-22T19:10:40.609245] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-22T19:10:40.610630] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-22T19:10:40.610725] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-22T19:10:40.992332] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:10:41.246539] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T19:10:41.322080] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-22T19:10:42.122088] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-22T19:10:42.356308] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T19:10:42.922127] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-22T19:10:43.010819] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T19:10:43.228593] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T19:10:43.234169] [INFO ] [REMOTE ] GVA: Full fetch complete (48855 records). [2025-09-22T19:10:43.234337] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-22T19:10:43.639725] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-22T19:10:43.639872] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-22T19:10:43.640672] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-22T19:10:43.640739] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-22T19:10:43.644780] [DEBUG] [LOCAL ] GVA: Trimmed 48855 records to 33963 (keeping 200 days of data) [2025-09-22T19:10:43.734994] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-22T19:10:43.858365] [DEBUG] [LOCAL ] GVA: Primary data saved (33963 records). [2025-09-22T19:10:43.858530] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-22T19:10:43.858620] [INFO ] [MAIN ] Update Progress: 986/2372 symbols completed. GVA took 38.8s. Estimated remaining: 3h 3m 41s. Rate: 7.5 symbols/min [2025-09-22T19:10:44.031935] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:10:44.035702] [DEBUG] [LOCAL ] GYLD: Loaded 1576 existing records from primary storage. [2025-09-22T19:10:44.035784] [INFO ] [MAIN ] GYLD: Loaded 1576 existing records. [2025-09-22T19:10:44.241953] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:10:44.243950] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T19:10:44.244375] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-22T19:10:44.252508] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-22T19:10:44.253079] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-22T19:10:44.253148] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-22T19:10:44.529725] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-22T19:10:44.613983] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:10:44.741704] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T19:10:45.322071] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-22T19:10:46.044591] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T19:10:46.122068] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-22T19:10:46.504087] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-22T19:10:46.825683] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T19:10:46.922082] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-22T19:10:47.272368] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-22T19:10:47.722089] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-22T19:10:48.522077] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-22T19:10:49.322069] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-22T19:10:49.413117] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T19:10:49.420191] [INFO ] [REMOTE ] GWRE: Full fetch complete (61618 records). [2025-09-22T19:10:49.420460] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-22T19:10:49.828463] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-22T19:10:49.828560] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-22T19:10:49.829425] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-22T19:10:49.829616] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-22T19:10:49.831205] [DEBUG] [LOCAL ] GWRE: Trimmed 61618 records to 41190 (keeping 200 days of data) [2025-09-22T19:10:50.093280] [DEBUG] [LOCAL ] GWRE: Primary data saved (41190 records). [2025-09-22T19:10:50.093416] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-22T19:10:50.093504] [INFO ] [MAIN ] Update Progress: 987/2372 symbols completed. GWRE took 31.2s. Estimated remaining: 3h 3m 30s. Rate: 7.5 symbols/min [2025-09-22T19:10:50.127130] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-22T19:10:50.280867] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:10:50.312581] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T19:10:50.364813] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T19:10:50.386616] [DEBUG] [LOCAL ] H: Loaded 45614 existing records from primary storage. [2025-09-22T19:10:50.386790] [INFO ] [MAIN ] H: Loaded 45614 existing records. [2025-09-22T19:10:50.562827] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:10:50.563112] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-22T19:10:50.563160] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-22T19:10:50.564582] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-22T19:10:50.564667] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-22T19:10:50.651091] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-22T19:10:50.928541] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:10:50.925309] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-22T19:10:51.722065] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-22T19:10:52.074079] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T19:10:52.288361] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T19:10:52.522117] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-22T19:10:52.945610] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-22T19:10:53.322079] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-22T19:10:54.122053] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-22T19:10:54.673041] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T19:10:54.922054] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-22T19:10:55.256965] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T19:10:55.284387] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-22T19:10:55.722061] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-22T19:10:56.522066] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-22T19:10:56.951084] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-22T19:10:57.049951] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T19:10:57.322067] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-22T19:10:58.122079] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-22T19:10:58.585473] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T19:10:58.922049] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-22T19:10:59.105019] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-22T19:10:59.722059] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-22T19:11:00.365839] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T19:11:00.422753] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T19:11:00.522057] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-22T19:11:01.322074] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-22T19:11:01.783681] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-22T19:11:02.122026] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-22T19:11:02.309315] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T19:11:02.613572] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T19:11:02.922068] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-22T19:11:03.443354] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-22T19:11:03.444305] [INFO ] [REMOTE ] GYLD: Full fetch complete (2041 records). [2025-09-22T19:11:03.444389] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-22T19:11:03.727407] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-22T19:11:03.820828] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-22T19:11:03.820925] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-22T19:11:03.821047] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-22T19:11:03.821106] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-22T19:11:03.821481] [DEBUG] [LOCAL ] GYLD: Trimmed 2041 records to 1553 (keeping 200 days of data) [2025-09-22T19:11:03.832598] [DEBUG] [LOCAL ] GYLD: Primary data saved (1553 records). [2025-09-22T19:11:03.832706] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-22T19:11:03.832859] [INFO ] [MAIN ] Update Progress: 988/2372 symbols completed. GYLD took 20.0s. Estimated remaining: 3h 3m 30s. Rate: 7.5 symbols/min [2025-09-22T19:11:04.002703] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:11:04.051201] [DEBUG] [LOCAL ] HAE: Loaded 40186 existing records from primary storage. [2025-09-22T19:11:04.051436] [INFO ] [MAIN ] HAE: Loaded 40186 existing records. [2025-09-22T19:11:04.230812] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:11:04.231065] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-22T19:11:04.231113] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-22T19:11:04.232028] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-22T19:11:04.232090] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-22T19:11:04.527235] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-22T19:11:04.599233] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:11:05.057694] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T19:11:05.064734] [INFO ] [REMOTE ] GXO: Full fetch complete (70128 records). [2025-09-22T19:11:05.064855] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-22T19:11:05.327233] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-22T19:11:05.470991] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-22T19:11:05.471143] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-22T19:11:05.473068] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-22T19:11:05.473149] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-22T19:11:05.474753] [DEBUG] [LOCAL ] GXO: Trimmed 70128 records to 47683 (keeping 200 days of data) [2025-09-22T19:11:05.759431] [DEBUG] [LOCAL ] GXO: Primary data saved (47683 records). [2025-09-22T19:11:05.759569] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-22T19:11:05.759723] [INFO ] [MAIN ] Update Progress: 989/2372 symbols completed. GXO took 25.6s. Estimated remaining: 3h 3m 14s. Rate: 7.5 symbols/min [2025-09-22T19:11:05.931518] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:11:05.989395] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T19:11:05.998535] [DEBUG] [LOCAL ] HAFN: Loaded 44465 existing records from primary storage. [2025-09-22T19:11:05.999213] [INFO ] [MAIN ] HAFN: Loaded 44465 existing records. [2025-09-22T19:11:06.127224] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-22T19:11:06.181957] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:11:06.182222] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-22T19:11:06.182271] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-22T19:11:06.183408] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-22T19:11:06.183479] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-22T19:11:06.566899] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:11:06.583742] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T19:11:06.922074] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-22T19:11:07.418417] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T19:11:07.722058] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-22T19:11:07.849482] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T19:11:08.522074] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-22T19:11:08.976201] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-22T19:11:09.322062] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-22T19:11:10.122092] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-22T19:11:10.393278] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T19:11:10.627536] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T19:11:10.922060] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-22T19:11:11.385614] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T19:11:11.389447] [INFO ] [REMOTE ] GWW: Full fetch complete (29190 records). [2025-09-22T19:11:11.389565] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-22T19:11:11.727223] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-22T19:11:11.810995] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-22T19:11:11.811125] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-22T19:11:11.811964] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-22T19:11:11.812067] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-22T19:11:11.816152] [DEBUG] [LOCAL ] GWW: Trimmed 29190 records to 19947 (keeping 200 days of data) [2025-09-22T19:11:11.967966] [DEBUG] [LOCAL ] GWW: Primary data saved (19947 records). [2025-09-22T19:11:11.968134] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-22T19:11:11.968295] [INFO ] [MAIN ] Update Progress: 990/2372 symbols completed. GWW took 45.8s. Estimated remaining: 3h 3m 4s. Rate: 7.5 symbols/min [2025-09-22T19:11:12.150717] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:11:12.217859] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-22T19:11:12.218033] [INFO ] [MAIN ] HAL: Loaded 54498 existing records. [2025-09-22T19:11:12.414196] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:11:12.414724] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-22T19:11:12.414978] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-22T19:11:12.416328] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-22T19:11:12.416419] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-22T19:11:12.526303] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-22T19:11:12.622932] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T19:11:12.826798] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:11:13.322064] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-22T19:11:13.571587] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T19:11:13.605007] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T19:11:14.122046] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-22T19:11:14.655057] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T19:11:14.922117] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-22T19:11:15.722073] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-22T19:11:16.052610] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-22T19:11:16.522069] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-22T19:11:16.633244] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T19:11:16.945829] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T19:11:17.322073] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-22T19:11:18.122071] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-22T19:11:18.209996] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T19:11:18.563374] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T19:11:18.922059] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-22T19:11:19.722061] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-22T19:11:19.795989] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T19:11:20.522038] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-22T19:11:20.820457] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T19:11:21.322033] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-22T19:11:21.471840] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T19:11:21.742112] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T19:11:22.122063] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-22T19:11:22.922155] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-22T19:11:23.285030] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T19:11:23.722058] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-22T19:11:23.779745] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T19:11:24.333668] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T19:11:24.522057] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-22T19:11:25.322038] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-22T19:11:25.785600] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-22T19:11:26.122057] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-22T19:11:26.165689] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T19:11:26.697724] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T19:11:26.922057] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-22T19:11:27.722064] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-22T19:11:28.073085] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T19:11:28.351414] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T19:11:28.522025] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-22T19:11:29.322083] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-22T19:11:29.390993] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T19:11:29.727086] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T19:11:30.122054] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-22T19:11:30.922078] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-22T19:11:31.113577] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T19:11:31.672786] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T19:11:31.679852] [INFO ] [REMOTE ] HAE: Full fetch complete (57619 records). [2025-09-22T19:11:31.679955] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-22T19:11:31.728485] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-22T19:11:32.081146] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-22T19:11:32.081250] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-22T19:11:32.082064] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-22T19:11:32.082133] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-22T19:11:32.083423] [DEBUG] [LOCAL ] HAE: Trimmed 57619 records to 39515 (keeping 200 days of data) [2025-09-22T19:11:32.328971] [DEBUG] [LOCAL ] HAE: Primary data saved (39515 records). [2025-09-22T19:11:32.329115] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-22T19:11:32.329253] [INFO ] [MAIN ] Update Progress: 991/2372 symbols completed. HAE took 28.5s. Estimated remaining: 3h 3m 13s. Rate: 7.5 symbols/min [2025-09-22T19:11:32.517134] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:11:32.528684] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-22T19:11:32.548458] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T19:11:32.600718] [DEBUG] [LOCAL ] HASI: Loaded 47924 existing records from primary storage. [2025-09-22T19:11:32.600892] [INFO ] [MAIN ] HASI: Loaded 47924 existing records. [2025-09-22T19:11:32.789516] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:11:32.789875] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-22T19:11:32.789926] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-22T19:11:32.791099] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-22T19:11:32.791190] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-22T19:11:33.157777] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:11:33.331952] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-22T19:11:33.339041] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T19:11:34.122119] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-22T19:11:34.717582] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-22T19:11:34.896011] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T19:11:34.922016] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-22T19:11:35.473839] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T19:11:35.722068] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-22T19:11:36.121911] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-22T19:11:36.522053] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-22T19:11:36.998772] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T19:11:37.322033] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-22T19:11:38.122091] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-22T19:11:38.512371] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-22T19:11:38.805497] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T19:11:38.922086] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-22T19:11:39.278173] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T19:11:39.286073] [INFO ] [REMOTE ] H: Full fetch complete (61681 records). [2025-09-22T19:11:39.286271] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-22T19:11:39.727266] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-22T19:11:39.884709] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-22T19:11:39.884977] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-22T19:11:39.886849] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-22T19:11:39.886951] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-22T19:11:39.888991] [DEBUG] [LOCAL ] H: Trimmed 61681 records to 44926 (keeping 200 days of data) [2025-09-22T19:11:40.226443] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T19:11:40.282823] [DEBUG] [LOCAL ] H: Primary data saved (44926 records). [2025-09-22T19:11:40.282994] [INFO ] [MAIN ] H: Full history saved. [2025-09-22T19:11:40.283105] [INFO ] [MAIN ] Update Progress: 992/2372 symbols completed. H took 50.2s. Estimated remaining: 3h 3m 5s. Rate: 7.5 symbols/min [2025-09-22T19:11:40.497944] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:11:40.532052] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-22T19:11:40.555064] [DEBUG] [LOCAL ] HAYW: Loaded 49501 existing records from primary storage. [2025-09-22T19:11:40.555203] [INFO ] [MAIN ] HAYW: Loaded 49501 existing records. [2025-09-22T19:11:40.741043] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:11:40.741348] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-22T19:11:40.741397] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-22T19:11:40.742432] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-22T19:11:40.742494] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-22T19:11:41.122896] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:11:41.218338] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T19:11:41.225069] [INFO ] [REMOTE ] HAFN: Full fetch complete (66040 records). [2025-09-22T19:11:41.225219] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-22T19:11:41.327201] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-22T19:11:41.662128] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-22T19:11:41.662221] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-22T19:11:41.663106] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-22T19:11:41.663175] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-22T19:11:41.666803] [DEBUG] [LOCAL ] HAFN: Trimmed 66040 records to 43630 (keeping 200 days of data) [2025-09-22T19:11:41.934212] [DEBUG] [LOCAL ] HAFN: Primary data saved (43630 records). [2025-09-22T19:11:41.934364] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-22T19:11:41.934495] [INFO ] [MAIN ] Update Progress: 993/2372 symbols completed. HAFN took 36.2s. Estimated remaining: 3h 2m 48s. Rate: 7.5 symbols/min [2025-09-22T19:11:42.132995] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-22T19:11:42.165776] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:11:42.176866] [DEBUG] [LOCAL ] HBB: Loaded 7028 existing records from primary storage. [2025-09-22T19:11:42.176984] [INFO ] [MAIN ] HBB: Loaded 7028 existing records. [2025-09-22T19:11:42.359865] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:11:42.360210] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-22T19:11:42.360358] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-22T19:11:42.360827] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-22T19:11:42.360943] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-22T19:11:42.783168] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:11:42.784446] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-22T19:11:42.857367] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-22T19:11:42.922012] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-22T19:11:43.722067] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-22T19:11:44.168195] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-22T19:11:44.178449] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-22T19:11:44.178794] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-22T19:11:44.525433] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-22T19:11:44.550574] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T19:11:44.659619] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-22T19:11:44.659747] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-22T19:11:44.660771] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-22T19:11:44.660842] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-22T19:11:44.662968] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-09-22T19:11:45.029276] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-22T19:11:45.029442] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-22T19:11:45.029557] [INFO ] [MAIN ] Update Progress: 994/2372 symbols completed. HAL took 33.1s. Estimated remaining: 3h 2m 34s. Rate: 7.5 symbols/min [2025-09-22T19:11:45.190137] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-22T19:11:45.224595] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:11:45.259357] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T19:11:45.314021] [DEBUG] [LOCAL ] HBI: Loaded 53802 existing records from primary storage. [2025-09-22T19:11:45.314178] [INFO ] [MAIN ] HBI: Loaded 53802 existing records. [2025-09-22T19:11:45.327189] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-22T19:11:45.493764] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:11:45.494028] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-22T19:11:45.494076] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-22T19:11:45.495226] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-22T19:11:45.495287] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-22T19:11:45.849810] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:11:46.122096] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-22T19:11:46.922111] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-22T19:11:47.068118] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T19:11:47.457901] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T19:11:47.722071] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-22T19:11:48.355348] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T19:11:48.353281] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-22T19:11:48.522092] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-22T19:11:48.992828] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-22T19:11:49.322075] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-22T19:11:50.122064] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-22T19:11:50.922051] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-22T19:11:50.956928] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T19:11:51.509362] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T19:11:51.722052] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-22T19:11:52.131715] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T19:11:52.160078] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-22T19:11:52.522067] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-22T19:11:53.322060] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-22T19:11:54.008288] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T19:11:54.122088] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-22T19:11:54.899382] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T19:11:54.922009] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-22T19:11:55.719255] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T19:11:55.728602] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-22T19:11:56.516461] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T19:11:56.525887] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-22T19:11:56.604244] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-22T19:11:57.322067] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-22T19:11:58.068860] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T19:11:58.122022] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-22T19:11:58.457265] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T19:11:58.922142] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-22T19:11:59.630918] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T19:11:59.722121] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-22T19:11:59.887484] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T19:12:00.522059] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-22T19:12:01.322071] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-22T19:12:01.454244] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T19:12:01.683373] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-22T19:12:02.068862] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T19:12:02.122076] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-22T19:12:02.922059] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-22T19:12:03.732629] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-22T19:12:03.735521] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T19:12:04.444888] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T19:12:04.522020] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-22T19:12:04.586296] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T19:12:05.230499] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T19:12:05.322050] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-22T19:12:05.883798] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T19:12:05.884993] [INFO ] [REMOTE ] HBB: Full fetch complete (10027 records). [2025-09-22T19:12:05.885064] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-22T19:12:06.127258] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-22T19:12:06.251530] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-22T19:12:06.251624] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-22T19:12:06.251925] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-22T19:12:06.251971] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-22T19:12:06.252447] [DEBUG] [LOCAL ] HBB: Trimmed 10027 records to 6937 (keeping 200 days of data) [2025-09-22T19:12:06.295819] [DEBUG] [LOCAL ] HBB: Primary data saved (6937 records). [2025-09-22T19:12:06.295938] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-22T19:12:06.296019] [INFO ] [MAIN ] Update Progress: 995/2372 symbols completed. HBB took 24.4s. Estimated remaining: 3h 2m 44s. Rate: 7.5 symbols/min [2025-09-22T19:12:06.467533] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:12:06.522224] [DEBUG] [LOCAL ] HBM: Loaded 53681 existing records from primary storage. [2025-09-22T19:12:06.522403] [INFO ] [MAIN ] HBM: Loaded 53681 existing records. [2025-09-22T19:12:06.703604] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:12:06.703897] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-22T19:12:06.703947] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-22T19:12:06.705192] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-22T19:12:06.705252] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-22T19:12:06.928296] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-22T19:12:07.077484] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:12:07.722050] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-22T19:12:07.826470] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T19:12:07.833881] [INFO ] [REMOTE ] HASI: Full fetch complete (67918 records). [2025-09-22T19:12:07.834029] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-22T19:12:08.228706] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-22T19:12:08.228812] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-22T19:12:08.229694] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-22T19:12:08.229757] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-22T19:12:08.231117] [DEBUG] [LOCAL ] HASI: Trimmed 67918 records to 47201 (keeping 200 days of data) [2025-09-22T19:12:08.531409] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-22T19:12:08.531328] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T19:12:08.551188] [DEBUG] [LOCAL ] HASI: Primary data saved (47201 records). [2025-09-22T19:12:08.551568] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-22T19:12:08.551694] [INFO ] [MAIN ] Update Progress: 996/2372 symbols completed. HASI took 36.2s. Estimated remaining: 3h 2m 28s. Rate: 7.5 symbols/min [2025-09-22T19:12:08.583630] [INFO ] [REMOTE ] HAYW: Full fetch complete (71032 records). [2025-09-22T19:12:08.589096] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-22T19:12:08.949913] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:12:09.158846] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-22T19:12:09.158947] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-22T19:12:09.159809] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-22T19:12:09.159953] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-22T19:12:09.172630] [DEBUG] [LOCAL ] HAYW: Trimmed 71032 records to 48763 (keeping 200 days of data) [2025-09-22T19:12:09.251527] [DEBUG] [LOCAL ] HCA: Loaded 48109 existing records from primary storage. [2025-09-22T19:12:09.278477] [INFO ] [MAIN ] HCA: Loaded 48109 existing records. [2025-09-22T19:12:09.490962] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:12:09.491393] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-22T19:12:09.491762] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-22T19:12:09.493590] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-22T19:12:09.493708] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-22T19:12:09.964561] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-22T19:12:10.047636] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-22T19:12:10.096185] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:12:10.122104] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-22T19:12:10.127206] [DEBUG] [LOCAL ] HAYW: Primary data saved (48763 records). [2025-09-22T19:12:10.127350] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-22T19:12:10.127472] [INFO ] [MAIN ] Update Progress: 997/2372 symbols completed. HAYW took 29.8s. Estimated remaining: 3h 2m 11s. Rate: 7.5 symbols/min [2025-09-22T19:12:10.177141] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T19:12:10.922105] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-22T19:12:11.881072] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:12:11.890985] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-22T19:12:12.162637] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-22T19:12:12.312435] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T19:12:12.522061] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-22T19:12:13.332453] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-22T19:12:13.335400] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T19:12:13.880373] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T19:12:14.122104] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-22T19:12:14.882988] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T19:12:14.893121] [INFO ] [REMOTE ] HBI: Full fetch complete (76912 records). [2025-09-22T19:12:14.893269] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-22T19:12:14.927115] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-22T19:12:15.303789] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-22T19:12:15.303927] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-22T19:12:15.305349] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-22T19:12:15.305438] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-22T19:12:15.308892] [DEBUG] [LOCAL ] HBI: Trimmed 76912 records to 53019 (keeping 200 days of data) [2025-09-22T19:12:15.639024] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T19:12:15.661267] [DEBUG] [LOCAL ] HBI: Primary data saved (53019 records). [2025-09-22T19:12:15.661395] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-22T19:12:15.661478] [INFO ] [MAIN ] Update Progress: 998/2372 symbols completed. HBI took 30.6s. Estimated remaining: 3h 2m 0s. Rate: 7.5 symbols/min [2025-09-22T19:12:15.722030] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-22T19:12:16.765351] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T19:12:16.782624] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-22T19:12:17.495417] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T19:12:17.506596] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-22T19:12:18.275323] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T19:12:18.285389] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-22T19:12:19.253970] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T19:12:19.265180] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-22T19:12:21.168294] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-09-22T19:12:21.179027] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-22T19:12:21.659172] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-22T19:12:21.670131] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-22T19:12:23.617018] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-22T19:12:23.627164] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-22T19:12:24.446672] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-22T19:12:24.458481] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-22T19:12:25.059840] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T19:12:25.069415] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-22T19:12:26.409371] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T19:12:26.420481] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-22T19:12:26.780204] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T19:12:26.791109] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-22T19:12:27.906786] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T19:12:27.915206] [INFO ] [REMOTE ] HBM: Full fetch complete (76034 records). [2025-09-22T19:12:27.915340] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-22T19:12:28.311010] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-22T19:12:28.311179] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-22T19:12:28.312329] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-22T19:12:28.312530] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-22T19:12:28.314364] [DEBUG] [LOCAL ] HBM: Trimmed 76034 records to 52908 (keeping 200 days of data) [2025-09-22T19:12:28.462752] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T19:12:28.477990] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-22T19:12:28.680051] [DEBUG] [LOCAL ] HBM: Primary data saved (52908 records). [2025-09-22T19:12:28.680200] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-22T19:12:28.680285] [INFO ] [MAIN ] Update Progress: 999/2372 symbols completed. HBM took 22.4s. Estimated remaining: 3h 1m 59s. Rate: 7.5 symbols/min [2025-09-22T19:12:30.124312] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T19:12:30.131483] [INFO ] [REMOTE ] HCA: Full fetch complete (69227 records). [2025-09-22T19:12:30.131601] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-22T19:12:30.528000] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-22T19:12:30.528099] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-22T19:12:30.529086] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-22T19:12:30.529157] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-22T19:12:30.531546] [DEBUG] [LOCAL ] HCA: Trimmed 69227 records to 47317 (keeping 200 days of data) [2025-09-22T19:12:30.848054] [DEBUG] [LOCAL ] HCA: Primary data saved (47317 records). [2025-09-22T19:12:30.848240] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-22T19:12:30.848349] [INFO ] [MAIN ] Update Progress: 1000/2372 symbols completed. HCA took 22.3s. Estimated remaining: 3h 1m 43s. Rate: 7.5 symbols/min [2025-09-22T19:12:31.519258] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:12:31.537161] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:12:31.562777] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-22T19:12:31.585093] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-22T19:12:31.635074] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:12:31.639334] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-22T19:12:31.639786] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-22T19:12:31.639196] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:12:31.640684] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-22T19:12:31.640750] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-22T19:12:31.811529] [DEBUG] [LOCAL ] HCI: Loaded 14144 existing records from primary storage. [2025-09-22T19:12:31.836965] [INFO ] [MAIN ] HCI: Loaded 14144 existing records. [2025-09-22T19:12:32.111098] [DEBUG] [LOCAL ] HD: Loaded 54298 existing records from primary storage. [2025-09-22T19:12:32.131997] [INFO ] [MAIN ] HD: Loaded 54298 existing records. [2025-09-22T19:12:32.149865] [DEBUG] [LOCAL ] HCC: Loaded 46078 existing records from primary storage. [2025-09-22T19:12:32.211628] [INFO ] [MAIN ] HCC: Loaded 46078 existing records. [2025-09-22T19:12:32.492051] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:12:32.517198] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:12:32.544381] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-22T19:12:32.555045] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-22T19:12:32.576569] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-22T19:12:32.593192] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-22T19:12:32.605816] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-22T19:12:32.767241] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:12:32.831974] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:12:32.857515] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-22T19:12:32.869172] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-22T19:12:32.879741] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-22T19:12:32.890257] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-22T19:12:32.912401] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-22T19:12:32.922539] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-22T19:12:32.922891] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-22T19:12:32.922720] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-22T19:12:33.191374] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T19:12:33.211425] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-22T19:12:33.787690] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T19:12:33.852276] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-22T19:12:34.117707] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:12:34.156268] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-22T19:12:34.285752] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T19:12:34.311958] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-22T19:12:34.398696] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:12:34.399998] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-22T19:12:34.424522] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:12:34.425164] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-22T19:12:34.713338] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-22T19:12:34.714581] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-22T19:12:34.974007] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-22T19:12:34.975160] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-22T19:12:35.197290] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T19:12:35.200898] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-22T19:12:35.207583] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-22T19:12:35.208477] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-22T19:12:35.465894] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-22T19:12:35.466839] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-22T19:12:35.711720] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-22T19:12:35.722023] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-22T19:12:35.971086] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T19:12:36.026556] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T19:12:36.469691] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-22T19:12:36.483621] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T19:12:36.522036] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-22T19:12:37.322073] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-22T19:12:37.699278] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-22T19:12:37.700816] [INFO ] [REMOTE ] HCXY: Full fetch complete (605 records). [2025-09-22T19:12:37.700906] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-22T19:12:37.898767] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-22T19:12:37.898996] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:12:37.899065] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:12:37.899114] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-22T19:12:37.899187] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-22T19:12:37.899241] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-22T19:12:37.899296] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-22T19:12:37.899379] [INFO ] [MAIN ] Update Progress: 1001/2372 symbols completed. HCXY took 7.0s. Estimated remaining: 3h 1m 34s. Rate: 7.6 symbols/min [2025-09-22T19:12:38.075507] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:12:38.129805] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-22T19:12:38.133360] [DEBUG] [LOCAL ] HDB: Loaded 52707 existing records from primary storage. [2025-09-22T19:12:38.133571] [INFO ] [MAIN ] HDB: Loaded 52707 existing records. [2025-09-22T19:12:38.317703] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:12:38.317999] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-22T19:12:38.318048] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-22T19:12:38.319431] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-22T19:12:38.319492] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-22T19:12:38.755058] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:12:38.787306] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-22T19:12:38.922059] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-22T19:12:39.053996] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-22T19:12:39.722122] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-22T19:12:40.391664] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T19:12:40.522057] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-22T19:12:41.322057] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-22T19:12:42.122084] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-22T19:12:42.553990] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-22T19:12:42.608739] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T19:12:42.744856] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (3.02 seconds). [2025-09-22T19:12:42.922112] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-22T19:12:43.291006] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T19:12:43.722063] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-22T19:12:44.522069] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-22T19:12:44.989488] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T19:12:45.052613] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-22T19:12:45.322070] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-22T19:12:45.599234] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T19:12:46.122067] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-22T19:12:46.767485] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T19:12:46.922106] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-22T19:12:47.144385] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T19:12:47.722041] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-22T19:12:47.759680] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T19:12:48.522095] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-22T19:12:49.318466] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T19:12:49.327240] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-22T19:12:49.352231] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T19:12:50.122056] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-22T19:12:50.922051] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-22T19:12:50.978921] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T19:12:51.641263] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T19:12:51.722000] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-22T19:12:51.795145] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T19:12:52.522034] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-22T19:12:52.771632] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T19:12:52.774419] [INFO ] [REMOTE ] HCI: Full fetch complete (19447 records). [2025-09-22T19:12:52.774526] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-22T19:12:53.170381] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-22T19:12:53.170466] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-22T19:12:53.170966] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-22T19:12:53.171047] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-22T19:12:53.171742] [DEBUG] [LOCAL ] HCI: Trimmed 19447 records to 13850 (keeping 200 days of data) [2025-09-22T19:12:53.268632] [DEBUG] [LOCAL ] HCI: Primary data saved (13850 records). [2025-09-22T19:12:53.268805] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-22T19:12:53.268948] [INFO ] [MAIN ] Update Progress: 1002/2372 symbols completed. HCI took 22.4s. Estimated remaining: 3h 1m 36s. Rate: 7.5 symbols/min [2025-09-22T19:12:53.333752] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-22T19:12:53.461599] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:12:53.526205] [DEBUG] [LOCAL ] HE: Loaded 50053 existing records from primary storage. [2025-09-22T19:12:53.526400] [INFO ] [MAIN ] HE: Loaded 50053 existing records. [2025-09-22T19:12:53.741791] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:12:53.742212] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-22T19:12:53.742281] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-22T19:12:53.743598] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-22T19:12:53.743701] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-22T19:12:54.127331] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-22T19:12:54.132497] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:12:54.628770] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-22T19:12:54.802029] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T19:12:54.922004] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-22T19:12:55.603457] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T19:12:55.722023] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-22T19:12:56.522070] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-22T19:12:56.774425] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-22T19:12:57.322061] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-22T19:12:57.684992] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-22T19:12:58.122256] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-22T19:12:58.433741] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T19:12:58.922059] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-22T19:12:59.022509] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T19:12:59.722074] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-22T19:13:00.053709] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-22T19:13:00.522063] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-22T19:13:01.322249] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-22T19:13:01.394072] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-22T19:13:01.954860] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-22T19:13:02.122090] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-22T19:13:02.922083] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-22T19:13:03.512607] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T19:13:03.523712] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-22T19:13:03.536011] [INFO ] [REMOTE ] HCC: Full fetch complete (64207 records). [2025-09-22T19:13:03.537164] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-22T19:13:03.726732] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-22T19:13:03.882997] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (3.36 seconds). [2025-09-22T19:13:03.997973] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-22T19:13:03.998086] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-22T19:13:03.999235] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-22T19:13:03.999328] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-22T19:13:04.003954] [DEBUG] [LOCAL ] HCC: Trimmed 64207 records to 45340 (keeping 200 days of data) [2025-09-22T19:13:04.304289] [DEBUG] [LOCAL ] HCC: Primary data saved (45340 records). [2025-09-22T19:13:04.304453] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-22T19:13:04.304597] [INFO ] [MAIN ] Update Progress: 1003/2372 symbols completed. HCC took 33.5s. Estimated remaining: 3h 1m 33s. Rate: 7.5 symbols/min [2025-09-22T19:13:04.491546] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:13:04.514883] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T19:13:04.529690] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-22T19:13:04.569461] [DEBUG] [LOCAL ] HEI: Loaded 33376 existing records from primary storage. [2025-09-22T19:13:04.569614] [INFO ] [MAIN ] HEI: Loaded 33376 existing records. [2025-09-22T19:13:04.746213] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:13:04.746503] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-22T19:13:04.746550] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-22T19:13:04.747889] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-22T19:13:04.747962] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-22T19:13:05.102625] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:13:05.322036] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-22T19:13:06.115875] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-22T19:13:06.127186] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-22T19:13:06.169087] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T19:13:06.536618] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T19:13:06.922065] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-22T19:13:07.722088] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-22T19:13:07.919914] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T19:13:08.415140] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T19:13:08.522117] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-22T19:13:09.322068] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-22T19:13:09.477964] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T19:13:10.096505] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T19:13:10.122016] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-22T19:13:10.922110] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-22T19:13:11.125855] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T19:13:11.134369] [INFO ] [REMOTE ] HDB: Full fetch complete (75231 records). [2025-09-22T19:13:11.134508] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-22T19:13:11.555247] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-22T19:13:11.555452] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-22T19:13:11.556558] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-22T19:13:11.556779] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-22T19:13:11.558472] [DEBUG] [LOCAL ] HDB: Trimmed 75231 records to 51938 (keeping 200 days of data) [2025-09-22T19:13:11.700451] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T19:13:11.730599] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-22T19:13:11.934323] [DEBUG] [LOCAL ] HDB: Primary data saved (51938 records). [2025-09-22T19:13:11.934493] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-22T19:13:11.934635] [INFO ] [MAIN ] Update Progress: 1004/2372 symbols completed. HDB took 34.0s. Estimated remaining: 3h 1m 24s. Rate: 7.5 symbols/min [2025-09-22T19:13:12.106978] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:13:12.117952] [DEBUG] [LOCAL ] HEQ: Loaded 6366 existing records from primary storage. [2025-09-22T19:13:12.118080] [INFO ] [MAIN ] HEQ: Loaded 6366 existing records. [2025-09-22T19:13:12.298571] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:13:12.298866] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-22T19:13:12.298914] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-22T19:13:12.299328] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-22T19:13:12.299387] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-22T19:13:12.549140] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-22T19:13:12.711337] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:13:12.991370] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-22T19:13:13.000016] [INFO ] [REMOTE ] HD: Full fetch complete (77441 records). [2025-09-22T19:13:13.000197] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-22T19:13:13.327178] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-22T19:13:13.401181] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-22T19:13:13.401274] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-22T19:13:13.402323] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-22T19:13:13.402388] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-22T19:13:13.403923] [DEBUG] [LOCAL ] HD: Trimmed 77441 records to 53519 (keeping 200 days of data) [2025-09-22T19:13:13.565277] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T19:13:13.810990] [DEBUG] [LOCAL ] HD: Primary data saved (53519 records). [2025-09-22T19:13:13.811633] [INFO ] [MAIN ] HD: Full history saved. [2025-09-22T19:13:13.811804] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-22T19:13:13.812005] [INFO ] [MAIN ] Update Progress: 1005/2372 symbols completed. HD took 43.0s. Estimated remaining: 3h 1m 8s. Rate: 7.5 symbols/min [2025-09-22T19:13:14.000128] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:13:14.014798] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T19:13:14.071636] [DEBUG] [LOCAL ] HESM: Loaded 48865 existing records from primary storage. [2025-09-22T19:13:14.071811] [INFO ] [MAIN ] HESM: Loaded 48865 existing records. [2025-09-22T19:13:14.132093] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-22T19:13:14.252806] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:13:14.253141] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-22T19:13:14.253198] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-22T19:13:14.254859] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-22T19:13:14.254921] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-22T19:13:14.618728] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:13:14.922079] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-22T19:13:15.520097] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T19:13:15.722035] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-22T19:13:16.071302] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T19:13:16.109863] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-22T19:13:16.522058] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-22T19:13:17.039066] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T19:13:17.322067] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-22T19:13:18.078046] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-22T19:13:18.122060] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-22T19:13:18.731803] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T19:13:18.922069] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-22T19:13:19.722094] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-22T19:13:20.223914] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T19:13:20.522058] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-22T19:13:21.083217] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-22T19:13:21.257985] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T19:13:21.322079] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-22T19:13:22.122116] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-22T19:13:22.684881] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-22T19:13:22.922112] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-22T19:13:23.609398] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T19:13:23.722045] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-22T19:13:24.484123] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T19:13:24.522010] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-22T19:13:25.193150] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T19:13:25.322073] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-22T19:13:25.998897] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T19:13:26.068141] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T19:13:26.122092] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-22T19:13:26.717193] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-22T19:13:26.922124] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-22T19:13:27.609558] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T19:13:27.611609] [INFO ] [REMOTE ] HEQ: Full fetch complete (9012 records). [2025-09-22T19:13:27.611710] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-22T19:13:27.727136] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-22T19:13:28.009660] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-22T19:13:28.009756] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-22T19:13:28.010078] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-22T19:13:28.010163] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-22T19:13:28.010766] [DEBUG] [LOCAL ] HEQ: Trimmed 9012 records to 6186 (keeping 200 days of data) [2025-09-22T19:13:28.049172] [DEBUG] [LOCAL ] HEQ: Primary data saved (6186 records). [2025-09-22T19:13:28.049293] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-22T19:13:28.049401] [INFO ] [MAIN ] Update Progress: 1006/2372 symbols completed. HEQ took 16.1s. Estimated remaining: 3h 1m 9s. Rate: 7.5 symbols/min [2025-09-22T19:13:28.229193] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:13:28.229419] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-22T19:13:28.229475] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-22T19:13:28.229588] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-22T19:13:28.229628] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-22T19:13:28.229710] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-22T19:13:28.229752] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-22T19:13:28.523348] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-22T19:13:28.602831] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:13:29.327162] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-22T19:13:29.337980] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T19:13:29.658305] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-22T19:13:30.122034] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-22T19:13:30.922064] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-22T19:13:31.294317] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-22T19:13:31.383032] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T19:13:31.427343] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T19:13:31.722080] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-22T19:13:32.522066] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-22T19:13:33.322057] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-22T19:13:33.365445] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T19:13:33.629421] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-22T19:13:33.814747] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T19:13:34.122106] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-22T19:13:34.376084] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-22T19:13:34.922066] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-22T19:13:35.722063] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-22T19:13:35.969997] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-22T19:13:36.455516] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T19:13:36.460366] [INFO ] [REMOTE ] HEI: Full fetch complete (49191 records). [2025-09-22T19:13:36.460467] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-22T19:13:36.527187] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-22T19:13:36.855494] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-22T19:13:36.855596] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-22T19:13:36.856416] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-22T19:13:36.856512] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-22T19:13:36.857628] [DEBUG] [LOCAL ] HEI: Trimmed 49191 records to 32667 (keeping 200 days of data) [2025-09-22T19:13:37.060706] [DEBUG] [LOCAL ] HEI: Primary data saved (32667 records). [2025-09-22T19:13:37.060846] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-22T19:13:37.060931] [INFO ] [MAIN ] Update Progress: 1007/2372 symbols completed. HEI took 32.8s. Estimated remaining: 3h 1m 2s. Rate: 7.5 symbols/min [2025-09-22T19:13:37.231286] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:13:37.231466] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-22T19:13:37.231502] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-22T19:13:37.231670] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-22T19:13:37.231747] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-22T19:13:37.231838] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-22T19:13:37.231897] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-22T19:13:37.331945] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-22T19:13:37.606301] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:13:38.122057] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-22T19:13:38.181343] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T19:13:38.366054] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-22T19:13:38.922024] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-22T19:13:39.048341] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T19:13:39.056259] [INFO ] [REMOTE ] HE: Full fetch complete (72492 records). [2025-09-22T19:13:39.056392] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-22T19:13:39.456060] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-22T19:13:39.456157] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-22T19:13:39.457127] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-22T19:13:39.457193] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-22T19:13:39.458685] [DEBUG] [LOCAL ] HE: Trimmed 72492 records to 49245 (keeping 200 days of data) [2025-09-22T19:13:39.730085] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-22T19:13:39.763028] [DEBUG] [LOCAL ] HE: Primary data saved (49245 records). [2025-09-22T19:13:39.763190] [INFO ] [MAIN ] HE: Full history saved. [2025-09-22T19:13:39.763309] [INFO ] [MAIN ] Update Progress: 1008/2372 symbols completed. HE took 46.5s. Estimated remaining: 3h 0m 47s. Rate: 7.5 symbols/min [2025-09-22T19:13:39.933801] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:13:39.952163] [DEBUG] [LOCAL ] HFRO: Loaded 17764 existing records from primary storage. [2025-09-22T19:13:39.952291] [INFO ] [MAIN ] HFRO: Loaded 17764 existing records. [2025-09-22T19:13:40.182019] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-22T19:13:40.192193] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:13:40.192435] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-22T19:13:40.192483] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-22T19:13:40.193136] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-22T19:13:40.193196] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-22T19:13:40.527991] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-22T19:13:40.552170] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:13:40.613096] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T19:13:41.030177] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-22T19:13:41.322051] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-22T19:13:42.122034] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-22T19:13:42.154511] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T19:13:42.531349] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-22T19:13:42.922105] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-22T19:13:43.167489] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-22T19:13:43.722066] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-22T19:13:43.990236] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-22T19:13:44.522153] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-22T19:13:44.954433] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T19:13:45.322064] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-22T19:13:45.601250] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-22T19:13:46.122056] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-22T19:13:46.397099] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-22T19:13:46.922070] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-22T19:13:47.722085] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-22T19:13:48.065539] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-22T19:13:48.066454] [INFO ] [REMOTE ] HF: Full fetch complete (508 records). [2025-09-22T19:13:48.066534] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-22T19:13:48.066968] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T19:13:48.067053] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:13:48.067098] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:13:48.067164] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-22T19:13:48.067238] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-22T19:13:48.067301] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-22T19:13:48.067364] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-22T19:13:48.067443] [INFO ] [MAIN ] Update Progress: 1009/2372 symbols completed. HF took 20.0s. Estimated remaining: 3h 0m 39s. Rate: 7.5 symbols/min [2025-09-22T19:13:48.266524] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:13:48.282163] [DEBUG] [LOCAL ] HGER: Loaded 12933 existing records from primary storage. [2025-09-22T19:13:48.282297] [INFO ] [MAIN ] HGER: Loaded 12933 existing records. [2025-09-22T19:13:48.497856] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T19:13:48.503533] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:13:48.514248] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-22T19:13:48.514373] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-22T19:13:48.515425] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-22T19:13:48.515489] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-22T19:13:48.527167] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-22T19:13:48.885487] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:13:48.915062] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-22T19:13:49.322064] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-22T19:13:50.059317] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T19:13:50.122031] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-22T19:13:50.922097] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-22T19:13:50.973828] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T19:13:51.218810] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-22T19:13:51.722061] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-22T19:13:52.522053] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-22T19:13:52.730305] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T19:13:53.234723] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-22T19:13:53.322074] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-22T19:13:53.734230] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-22T19:13:54.122055] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-22T19:13:54.851370] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T19:13:54.922031] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-22T19:13:55.534590] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T19:13:55.722055] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-22T19:13:56.522053] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-22T19:13:56.965320] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T19:13:57.322046] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-22T19:13:57.393080] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T19:13:58.122053] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-22T19:13:58.381727] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T19:13:58.598113] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-22T19:13:58.599038] [INFO ] [REMOTE ] HFND: Full fetch complete (1805 records). [2025-09-22T19:13:58.599105] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-22T19:13:58.790333] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-22T19:13:58.790528] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:13:58.790600] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:13:58.790700] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-22T19:13:58.790774] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-22T19:13:58.790812] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-22T19:13:58.790881] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-22T19:13:58.790969] [INFO ] [MAIN ] Update Progress: 1010/2372 symbols completed. HFND took 21.7s. Estimated remaining: 3h 0m 35s. Rate: 7.5 symbols/min [2025-09-22T19:13:58.927132] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-22T19:13:58.974518] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:13:58.986570] [DEBUG] [LOCAL ] HGLB: Loaded 9853 existing records from primary storage. [2025-09-22T19:13:58.986735] [INFO ] [MAIN ] HGLB: Loaded 9853 existing records. [2025-09-22T19:13:59.180960] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:13:59.181288] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-22T19:13:59.181347] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-22T19:13:59.181902] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-22T19:13:59.181964] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-22T19:13:59.562560] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:13:59.722054] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-22T19:13:59.875751] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T19:14:00.522059] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-22T19:14:00.613824] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T19:14:01.322057] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-22T19:14:01.348985] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T19:14:02.066333] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T19:14:02.122045] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-22T19:14:02.922058] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-22T19:14:03.073128] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T19:14:03.722052] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-22T19:14:04.414828] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T19:14:04.522071] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-22T19:14:04.706973] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-22T19:14:05.246695] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T19:14:05.322058] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-22T19:14:06.122108] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-22T19:14:06.751763] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T19:14:06.760904] [INFO ] [REMOTE ] HESM: Full fetch complete (68666 records). [2025-09-22T19:14:06.761056] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-22T19:14:06.937267] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-22T19:14:07.218637] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T19:14:07.222381] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-22T19:14:07.229085] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-22T19:14:07.230488] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-22T19:14:07.230771] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-22T19:14:07.232543] [DEBUG] [LOCAL ] HESM: Trimmed 68666 records to 48154 (keeping 200 days of data) [2025-09-22T19:14:07.536834] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-22T19:14:07.538627] [DEBUG] [LOCAL ] HESM: Primary data saved (48154 records). [2025-09-22T19:14:07.538905] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-22T19:14:07.542160] [INFO ] [MAIN ] Update Progress: 1011/2372 symbols completed. HESM took 53.7s. Estimated remaining: 3h 0m 28s. Rate: 7.5 symbols/min [2025-09-22T19:14:07.723224] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:14:07.723379] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-22T19:14:07.743326] [DEBUG] [LOCAL ] HGTY: Loaded 13154 existing records from primary storage. [2025-09-22T19:14:07.743475] [INFO ] [MAIN ] HGTY: Loaded 13154 existing records. [2025-09-22T19:14:07.929564] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:14:07.929878] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-22T19:14:07.929935] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-22T19:14:07.930423] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-22T19:14:07.930487] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-22T19:14:08.317057] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:14:08.522062] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-22T19:14:08.532805] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T19:14:09.040002] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-22T19:14:09.322065] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-22T19:14:10.122072] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-22T19:14:10.136161] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T19:14:10.140391] [INFO ] [REMOTE ] HFRO: Full fetch complete (28777 records). [2025-09-22T19:14:10.140513] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-22T19:14:10.519351] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-22T19:14:10.519442] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-22T19:14:10.520022] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-22T19:14:10.520082] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-22T19:14:10.521762] [DEBUG] [LOCAL ] HFRO: Trimmed 28777 records to 17449 (keeping 200 days of data) [2025-09-22T19:14:10.622734] [DEBUG] [LOCAL ] HFRO: Primary data saved (17449 records). [2025-09-22T19:14:10.622886] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-22T19:14:10.622970] [INFO ] [MAIN ] Update Progress: 1012/2372 symbols completed. HFRO took 30.9s. Estimated remaining: 3h 0m 14s. Rate: 7.5 symbols/min [2025-09-22T19:14:10.797366] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:14:10.806233] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T19:14:10.846872] [DEBUG] [LOCAL ] HGV: Loaded 47765 existing records from primary storage. [2025-09-22T19:14:10.847011] [INFO ] [MAIN ] HGV: Loaded 47765 existing records. [2025-09-22T19:14:10.927231] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-22T19:14:11.026834] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:14:11.027046] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-22T19:14:11.027094] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-22T19:14:11.028396] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-22T19:14:11.028460] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-22T19:14:11.384220] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:14:11.722064] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-22T19:14:11.886339] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T19:14:12.522033] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-22T19:14:12.538416] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-22T19:14:13.291132] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T19:14:13.322051] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-22T19:14:14.122120] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-22T19:14:14.387737] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T19:14:14.908323] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T19:14:14.921998] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-22T19:14:15.722102] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-22T19:14:15.896549] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T19:14:16.252020] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-22T19:14:16.522088] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-22T19:14:17.322033] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-22T19:14:17.374785] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-22T19:14:18.122067] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-22T19:14:18.559324] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T19:14:18.821952] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T19:14:18.922101] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-22T19:14:19.722118] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-22T19:14:19.792910] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T19:14:19.796177] [INFO ] [REMOTE ] HGLB: Full fetch complete (14296 records). [2025-09-22T19:14:19.796399] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-22T19:14:20.295318] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-22T19:14:20.295447] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-22T19:14:20.296174] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-22T19:14:20.296250] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-22T19:14:20.297213] [DEBUG] [LOCAL ] HGLB: Trimmed 14296 records to 9732 (keeping 200 days of data) [2025-09-22T19:14:20.369499] [DEBUG] [LOCAL ] HGLB: Primary data saved (9732 records). [2025-09-22T19:14:20.369732] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-22T19:14:20.369872] [INFO ] [MAIN ] Update Progress: 1013/2372 symbols completed. HGLB took 21.6s. Estimated remaining: 3h 0m 8s. Rate: 7.5 symbols/min [2025-09-22T19:14:20.524128] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-22T19:14:20.623669] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:14:20.634617] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-22T19:14:20.672781] [DEBUG] [LOCAL ] HHH: Loaded 33300 existing records from primary storage. [2025-09-22T19:14:20.672936] [INFO ] [MAIN ] HHH: Loaded 33300 existing records. [2025-09-22T19:14:20.860170] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:14:20.860508] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-22T19:14:20.860567] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-22T19:14:20.861807] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-22T19:14:20.861924] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-22T19:14:21.216722] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:14:21.322020] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-22T19:14:22.117758] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T19:14:22.125498] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-22T19:14:22.490990] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T19:14:22.922032] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-22T19:14:23.267298] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T19:14:23.271063] [INFO ] [REMOTE ] HGER: Full fetch complete (15952 records). [2025-09-22T19:14:23.271135] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-22T19:14:23.407247] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-22T19:14:23.657819] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-22T19:14:23.657904] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-22T19:14:23.658294] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-22T19:14:23.658334] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-22T19:14:23.658954] [DEBUG] [LOCAL ] HGER: Trimmed 15952 records to 12907 (keeping 200 days of data) [2025-09-22T19:14:23.722302] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-22T19:14:23.742287] [DEBUG] [LOCAL ] HGER: Primary data saved (12907 records). [2025-09-22T19:14:23.742465] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-22T19:14:23.742585] [INFO ] [MAIN ] Update Progress: 1014/2372 symbols completed. HGER took 35.7s. Estimated remaining: 2h 59m 54s. Rate: 7.5 symbols/min [2025-09-22T19:14:23.936130] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:14:23.976119] [DEBUG] [LOCAL ] HI: Loaded 35665 existing records from primary storage. [2025-09-22T19:14:23.976283] [INFO ] [MAIN ] HI: Loaded 35665 existing records. [2025-09-22T19:14:24.158982] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:14:24.159193] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-22T19:14:24.159240] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-22T19:14:24.160387] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-22T19:14:24.160447] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-22T19:14:24.525211] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-22T19:14:24.549984] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:14:24.558077] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T19:14:25.322064] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-22T19:14:25.908484] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T19:14:26.054774] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T19:14:26.122099] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-22T19:14:26.922071] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-22T19:14:27.722057] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-22T19:14:27.777922] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T19:14:27.811594] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-22T19:14:28.522075] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-22T19:14:28.967397] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T19:14:29.120127] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T19:14:29.322088] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-22T19:14:30.112425] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T19:14:30.121994] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-22T19:14:30.922104] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-22T19:14:31.208172] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T19:14:31.722115] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-22T19:14:31.954076] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T19:14:32.522100] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-22T19:14:32.871163] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T19:14:32.875268] [INFO ] [REMOTE ] HGTY: Full fetch complete (17116 records). [2025-09-22T19:14:32.875349] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-22T19:14:33.261065] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-22T19:14:33.261149] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-22T19:14:33.261530] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-22T19:14:33.261569] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-22T19:14:33.262235] [DEBUG] [LOCAL ] HGTY: Trimmed 17116 records to 13004 (keeping 200 days of data) [2025-09-22T19:14:33.322254] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-22T19:14:33.342414] [DEBUG] [LOCAL ] HGTY: Primary data saved (13004 records). [2025-09-22T19:14:33.342511] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-22T19:14:33.342591] [INFO ] [MAIN ] Update Progress: 1015/2372 symbols completed. HGTY took 25.8s. Estimated remaining: 2h 59m 49s. Rate: 7.5 symbols/min [2025-09-22T19:14:33.513193] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:14:33.565693] [DEBUG] [LOCAL ] HIG: Loaded 52033 existing records from primary storage. [2025-09-22T19:14:33.565833] [INFO ] [MAIN ] HIG: Loaded 52033 existing records. [2025-09-22T19:14:33.751191] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:14:33.751776] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-22T19:14:33.751853] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-22T19:14:33.764787] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-22T19:14:33.766835] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-22T19:14:33.832812] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T19:14:34.127518] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-22T19:14:34.131805] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:14:34.636760] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T19:14:34.922096] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-22T19:14:35.376997] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T19:14:35.722050] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-22T19:14:36.183816] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T19:14:36.522097] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-22T19:14:37.074810] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T19:14:37.322052] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-22T19:14:38.122033] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-22T19:14:38.207273] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T19:14:38.922061] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-22T19:14:38.971692] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T19:14:39.243818] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T19:14:39.722095] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-22T19:14:40.522070] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-22T19:14:40.642083] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T19:14:41.150911] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T19:14:41.322097] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-22T19:14:41.826357] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T19:14:42.122110] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-22T19:14:42.399564] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T19:14:42.922071] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-22T19:14:43.528761] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T19:14:43.722060] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-22T19:14:44.334715] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T19:14:44.522089] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-22T19:14:45.322067] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-22T19:14:45.468372] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T19:14:46.024011] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T19:14:46.122037] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-22T19:14:46.761715] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T19:14:46.922073] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-22T19:14:47.212547] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T19:14:47.722051] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-22T19:14:48.496296] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T19:14:48.522008] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-22T19:14:48.739080] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T19:14:49.322061] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-22T19:14:50.122126] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-22T19:14:50.248365] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T19:14:50.255542] [INFO ] [REMOTE ] HGV: Full fetch complete (65661 records). [2025-09-22T19:14:50.255713] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-22T19:14:50.649208] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-22T19:14:50.649293] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-22T19:14:50.650228] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-22T19:14:50.650292] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-22T19:14:50.651617] [DEBUG] [LOCAL ] HGV: Trimmed 65661 records to 47015 (keeping 200 days of data) [2025-09-22T19:14:50.832144] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T19:14:50.922408] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-22T19:14:50.999142] [DEBUG] [LOCAL ] HGV: Primary data saved (47015 records). [2025-09-22T19:14:50.999268] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-22T19:14:50.999350] [INFO ] [MAIN ] Update Progress: 1016/2372 symbols completed. HGV took 40.4s. Estimated remaining: 2h 59m 54s. Rate: 7.5 symbols/min [2025-09-22T19:14:51.167599] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:14:51.209248] [DEBUG] [LOCAL ] HII: Loaded 36225 existing records from primary storage. [2025-09-22T19:14:51.209428] [INFO ] [MAIN ] HII: Loaded 36225 existing records. [2025-09-22T19:14:51.393666] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:14:51.393945] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-22T19:14:51.394001] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-22T19:14:51.395416] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-22T19:14:51.395477] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-22T19:14:51.728207] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-22T19:14:51.761451] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:14:52.199373] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T19:14:52.528276] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-22T19:14:52.534249] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-22T19:14:53.199326] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T19:14:53.204711] [INFO ] [REMOTE ] HHH: Full fetch complete (44993 records). [2025-09-22T19:14:53.204808] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-22T19:14:53.327257] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-22T19:14:53.605932] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-22T19:14:53.606011] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-22T19:14:53.606729] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-22T19:14:53.606983] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-22T19:14:53.608017] [DEBUG] [LOCAL ] HHH: Trimmed 44993 records to 32676 (keeping 200 days of data) [2025-09-22T19:14:53.821241] [DEBUG] [LOCAL ] HHH: Primary data saved (32676 records). [2025-09-22T19:14:53.821381] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-22T19:14:53.821466] [INFO ] [MAIN ] Update Progress: 1017/2372 symbols completed. HHH took 33.5s. Estimated remaining: 2h 59m 39s. Rate: 7.5 symbols/min [2025-09-22T19:14:54.008013] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T19:14:54.036096] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:14:54.101063] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-22T19:14:54.101207] [INFO ] [MAIN ] HIMS: Loaded 54597 existing records. [2025-09-22T19:14:54.127187] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-22T19:14:54.296334] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:14:54.296597] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-22T19:14:54.296668] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-22T19:14:54.298162] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-22T19:14:54.298223] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-22T19:14:54.677785] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:14:54.922026] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-22T19:14:54.990562] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T19:14:55.585904] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T19:14:55.591698] [INFO ] [REMOTE ] HI: Full fetch complete (49617 records). [2025-09-22T19:14:55.591806] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-22T19:14:55.735213] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-22T19:14:55.994081] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-22T19:14:55.994181] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-22T19:14:55.995041] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-22T19:14:55.995112] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-22T19:14:55.996370] [DEBUG] [LOCAL ] HI: Trimmed 49617 records to 35066 (keeping 200 days of data) [2025-09-22T19:14:56.223666] [DEBUG] [LOCAL ] HI: Primary data saved (35066 records). [2025-09-22T19:14:56.223824] [INFO ] [MAIN ] HI: Full history saved. [2025-09-22T19:14:56.223910] [INFO ] [MAIN ] Update Progress: 1018/2372 symbols completed. HI took 32.5s. Estimated remaining: 2h 59m 23s. Rate: 7.5 symbols/min [2025-09-22T19:14:56.402129] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:14:56.425745] [DEBUG] [LOCAL ] HIO: Loaded 24386 existing records from primary storage. [2025-09-22T19:14:56.425914] [INFO ] [MAIN ] HIO: Loaded 24386 existing records. [2025-09-22T19:14:56.527323] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-22T19:14:56.624659] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:14:56.624994] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-22T19:14:56.625055] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-22T19:14:56.625833] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-22T19:14:56.625893] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-22T19:14:56.983547] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:14:57.144393] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-22T19:14:57.322053] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-22T19:14:57.468675] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T19:14:58.122077] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-22T19:14:58.406509] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T19:14:58.922080] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-22T19:14:59.361115] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T19:14:59.485046] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-22T19:14:59.722060] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-22T19:15:00.522058] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-22T19:15:00.643391] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T19:15:00.680437] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T19:15:01.322076] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-22T19:15:01.969178] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T19:15:02.122074] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-22T19:15:02.617205] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T19:15:02.922090] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-22T19:15:03.722184] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-22T19:15:04.522081] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-22T19:15:05.453742] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (3.33 seconds). [2025-09-22T19:15:05.465593] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-22T19:15:06.214283] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T19:15:06.221636] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-22T19:15:06.528988] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-09-22T19:15:06.655465] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (3.73 seconds). [2025-09-22T19:15:06.922136] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-22T19:15:07.175031] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-22T19:15:07.464611] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-22T19:15:07.722060] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-22T19:15:08.441542] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T19:15:08.522041] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-22T19:15:08.745673] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-22T19:15:09.322064] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-22T19:15:10.067885] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T19:15:10.122083] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-22T19:15:10.335811] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-22T19:15:10.922116] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-22T19:15:11.722082] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-22T19:15:12.475255] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-22T19:15:12.522019] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-22T19:15:12.769136] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T19:15:12.777165] [INFO ] [REMOTE ] HIG: Full fetch complete (73260 records). [2025-09-22T19:15:12.777334] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-22T19:15:12.975983] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T19:15:13.211433] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-22T19:15:13.211525] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-22T19:15:13.212558] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-22T19:15:13.212681] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-22T19:15:13.214226] [DEBUG] [LOCAL ] HIG: Trimmed 73260 records to 51259 (keeping 200 days of data) [2025-09-22T19:15:13.334251] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-22T19:15:13.569056] [DEBUG] [LOCAL ] HIG: Primary data saved (51259 records). [2025-09-22T19:15:13.569222] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-22T19:15:13.569390] [INFO ] [MAIN ] Update Progress: 1019/2372 symbols completed. HIG took 40.2s. Estimated remaining: 2h 59m 28s. Rate: 7.5 symbols/min [2025-09-22T19:15:13.743505] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:15:13.767821] [DEBUG] [LOCAL ] HIPO: Loaded 23241 existing records from primary storage. [2025-09-22T19:15:13.767965] [INFO ] [MAIN ] HIPO: Loaded 23241 existing records. [2025-09-22T19:15:13.952760] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:15:13.953034] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-22T19:15:13.953084] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-22T19:15:13.953779] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-22T19:15:13.953864] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-22T19:15:14.122760] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-22T19:15:14.370940] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:15:14.583423] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T19:15:14.922068] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-22T19:15:15.072982] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-22T19:15:15.104934] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T19:15:15.722062] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-22T19:15:16.296952] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T19:15:16.522103] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-22T19:15:16.650301] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T19:15:16.656867] [INFO ] [REMOTE ] HIO: Full fetch complete (36754 records). [2025-09-22T19:15:16.656978] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-22T19:15:17.037158] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-22T19:15:17.037243] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-22T19:15:17.037889] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-22T19:15:17.037963] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-22T19:15:17.039200] [DEBUG] [LOCAL ] HIO: Trimmed 36754 records to 23761 (keeping 200 days of data) [2025-09-22T19:15:17.190211] [DEBUG] [LOCAL ] HIO: Primary data saved (23761 records). [2025-09-22T19:15:17.190365] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-22T19:15:17.190489] [INFO ] [MAIN ] Update Progress: 1020/2372 symbols completed. HIO took 21.0s. Estimated remaining: 2h 59m 14s. Rate: 7.5 symbols/min [2025-09-22T19:15:17.327236] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-22T19:15:17.379791] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:15:17.434694] [DEBUG] [LOCAL ] HIW: Loaded 45529 existing records from primary storage. [2025-09-22T19:15:17.434853] [INFO ] [MAIN ] HIW: Loaded 45529 existing records. [2025-09-22T19:15:17.614834] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:15:17.615115] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-22T19:15:17.615171] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-22T19:15:17.616316] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-22T19:15:17.616388] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-22T19:15:17.968099] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:15:18.122058] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-22T19:15:18.922028] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-22T19:15:19.101292] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T19:15:19.699778] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-09-22T19:15:19.722039] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-22T19:15:20.076347] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T19:15:20.442928] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-22T19:15:20.522011] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-22T19:15:21.322049] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-22T19:15:21.785712] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T19:15:22.122073] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-22T19:15:22.406336] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-22T19:15:22.922026] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-22T19:15:22.941414] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T19:15:22.946883] [INFO ] [REMOTE ] HII: Full fetch complete (53409 records). [2025-09-22T19:15:22.946981] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-22T19:15:23.337963] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-22T19:15:23.338092] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-22T19:15:23.338887] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-22T19:15:23.338980] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-22T19:15:23.341565] [DEBUG] [LOCAL ] HII: Trimmed 53409 records to 35414 (keeping 200 days of data) [2025-09-22T19:15:23.482476] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T19:15:23.622258] [DEBUG] [LOCAL ] HII: Primary data saved (35414 records). [2025-09-22T19:15:23.622402] [INFO ] [MAIN ] HII: Full history saved. [2025-09-22T19:15:23.622529] [INFO ] [MAIN ] Update Progress: 1021/2372 symbols completed. HII took 32.6s. Estimated remaining: 2h 59m 4s. Rate: 7.5 symbols/min [2025-09-22T19:15:23.726427] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-22T19:15:23.798575] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:15:23.821226] [DEBUG] [LOCAL ] HIX: Loaded 20504 existing records from primary storage. [2025-09-22T19:15:23.821361] [INFO ] [MAIN ] HIX: Loaded 20504 existing records. [2025-09-22T19:15:23.999215] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:15:23.999530] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-22T19:15:23.999579] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-22T19:15:24.000365] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-22T19:15:24.000426] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-22T19:15:24.318077] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T19:15:24.406115] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:15:24.522094] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-22T19:15:25.322056] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-22T19:15:25.758987] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T19:15:26.122119] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-22T19:15:26.568451] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-22T19:15:26.648438] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T19:15:26.922027] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-22T19:15:27.243511] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T19:15:27.722073] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-22T19:15:28.304893] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T19:15:28.522061] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-22T19:15:29.322074] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-22T19:15:29.600922] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T19:15:30.133380] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-22T19:15:30.138967] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-22T19:15:30.922057] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-22T19:15:31.098313] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T19:15:31.252273] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T19:15:31.722058] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-22T19:15:32.522071] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-22T19:15:33.160415] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T19:15:33.322096] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-22T19:15:33.346255] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T19:15:33.732571] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-22T19:15:33.741699] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-22T19:15:33.741894] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-22T19:15:34.127297] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-22T19:15:34.319672] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-22T19:15:34.319817] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-22T19:15:34.321863] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-22T19:15:34.321995] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-22T19:15:34.324364] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-09-22T19:15:34.713729] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T19:15:34.779080] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-22T19:15:34.779248] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-22T19:15:34.779367] [INFO ] [MAIN ] Update Progress: 1022/2372 symbols completed. HIMS took 41.0s. Estimated remaining: 2h 59m 1s. Rate: 7.5 symbols/min [2025-09-22T19:15:34.927245] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-22T19:15:34.961707] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:15:34.986386] [DEBUG] [LOCAL ] HKD: Loaded 18304 existing records from primary storage. [2025-09-22T19:15:34.986530] [INFO ] [MAIN ] HKD: Loaded 18304 existing records. [2025-09-22T19:15:35.168085] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:15:35.168383] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-22T19:15:35.168471] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-22T19:15:35.169080] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-22T19:15:35.169141] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-22T19:15:35.552349] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T19:15:35.613316] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:15:35.722045] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-22T19:15:35.743196] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T19:15:36.522056] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-22T19:15:37.036803] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T19:15:37.266198] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T19:15:37.322041] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-22T19:15:38.122013] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-22T19:15:38.510313] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T19:15:38.922025] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-22T19:15:38.969564] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T19:15:39.722061] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-22T19:15:40.206589] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T19:15:40.522052] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-22T19:15:41.026804] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T19:15:41.322042] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-22T19:15:41.601136] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T19:15:42.122082] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-22T19:15:42.372174] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T19:15:42.922070] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-22T19:15:43.566310] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T19:15:43.577691] [INFO ] [REMOTE ] HIW: Full fetch complete (64690 records). [2025-09-22T19:15:43.578128] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-22T19:15:43.729569] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-22T19:15:43.996628] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-22T19:15:43.996749] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-22T19:15:43.997710] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-22T19:15:43.997775] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-22T19:15:43.999481] [DEBUG] [LOCAL ] HIW: Trimmed 64690 records to 44755 (keeping 200 days of data) [2025-09-22T19:15:44.268722] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T19:15:44.329108] [DEBUG] [LOCAL ] HIW: Primary data saved (44755 records). [2025-09-22T19:15:44.329248] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-22T19:15:44.329333] [INFO ] [MAIN ] Update Progress: 1023/2372 symbols completed. HIW took 27.1s. Estimated remaining: 2h 58m 55s. Rate: 7.5 symbols/min [2025-09-22T19:15:44.499691] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:15:44.529725] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-22T19:15:44.552063] [DEBUG] [LOCAL ] HL: Loaded 54450 existing records from primary storage. [2025-09-22T19:15:44.552207] [INFO ] [MAIN ] HL: Loaded 54450 existing records. [2025-09-22T19:15:44.730584] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:15:44.730859] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-22T19:15:44.730929] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-22T19:15:44.732341] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-22T19:15:44.732402] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-22T19:15:44.931086] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T19:15:45.137213] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:15:45.322065] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-22T19:15:45.544335] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T19:15:46.122069] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-22T19:15:46.922097] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-22T19:15:47.219152] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T19:15:47.254019] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-22T19:15:47.722065] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-22T19:15:48.075397] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T19:15:48.522255] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-22T19:15:49.322079] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-22T19:15:49.581981] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T19:15:49.621621] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T19:15:49.966548] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T19:15:50.122061] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-22T19:15:50.922078] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-22T19:15:51.722076] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-22T19:15:52.027427] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-22T19:15:52.230419] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T19:15:52.522113] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-22T19:15:52.750886] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-22T19:15:52.754186] [INFO ] [REMOTE ] HIX: Full fetch complete (30700 records). [2025-09-22T19:15:52.754266] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-22T19:15:53.143810] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-22T19:15:53.143898] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-22T19:15:53.144527] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-22T19:15:53.144565] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-22T19:15:53.145341] [DEBUG] [LOCAL ] HIX: Trimmed 30700 records to 20268 (keeping 200 days of data) [2025-09-22T19:15:53.266395] [DEBUG] [LOCAL ] HIX: Primary data saved (20268 records). [2025-09-22T19:15:53.266529] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-22T19:15:53.266679] [INFO ] [MAIN ] Update Progress: 1024/2372 symbols completed. HIX took 29.6s. Estimated remaining: 2h 58m 48s. Rate: 7.5 symbols/min [2025-09-22T19:15:53.331897] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-22T19:15:53.456216] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:15:53.498956] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T19:15:53.521076] [DEBUG] [LOCAL ] HLF: Loaded 49588 existing records from primary storage. [2025-09-22T19:15:53.521245] [INFO ] [MAIN ] HLF: Loaded 49588 existing records. [2025-09-22T19:15:53.719505] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:15:53.719807] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-22T19:15:53.719862] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-22T19:15:53.720906] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-22T19:15:53.720968] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-22T19:15:54.103483] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:15:54.122061] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-22T19:15:54.574517] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T19:15:54.922107] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-22T19:15:55.722068] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-22T19:15:56.031259] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T19:15:56.051929] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T19:15:56.055854] [INFO ] [REMOTE ] HIPO: Full fetch complete (31768 records). [2025-09-22T19:15:56.055937] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-22T19:15:56.433693] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-22T19:15:56.433778] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-22T19:15:56.434352] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-22T19:15:56.434392] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-22T19:15:56.435231] [DEBUG] [LOCAL ] HIPO: Trimmed 31768 records to 22871 (keeping 200 days of data) [2025-09-22T19:15:56.525709] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-22T19:15:56.576875] [DEBUG] [LOCAL ] HIPO: Primary data saved (22871 records). [2025-09-22T19:15:56.576998] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-22T19:15:56.577077] [INFO ] [MAIN ] Update Progress: 1025/2372 symbols completed. HIPO took 43.0s. Estimated remaining: 2h 58m 34s. Rate: 7.5 symbols/min [2025-09-22T19:15:56.756701] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:15:56.767887] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T19:15:56.807308] [DEBUG] [LOCAL ] HLI: Loaded 31874 existing records from primary storage. [2025-09-22T19:15:56.807448] [INFO ] [MAIN ] HLI: Loaded 31874 existing records. [2025-09-22T19:15:56.986277] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:15:56.986553] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-22T19:15:56.986601] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-22T19:15:56.987439] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-22T19:15:56.987500] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-22T19:15:57.331068] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-22T19:15:57.366739] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:15:58.122103] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-22T19:15:58.512825] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T19:15:58.922065] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-22T19:15:59.009709] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T19:15:59.098155] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-22T19:15:59.103309] [INFO ] [REMOTE ] HKD: Full fetch complete (28692 records). [2025-09-22T19:15:59.103599] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-22T19:15:59.480709] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-22T19:15:59.480794] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-22T19:15:59.481470] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-22T19:15:59.481528] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-22T19:15:59.482248] [DEBUG] [LOCAL ] HKD: Trimmed 28692 records to 18201 (keeping 200 days of data) [2025-09-22T19:15:59.588124] [DEBUG] [LOCAL ] HKD: Primary data saved (18201 records). [2025-09-22T19:15:59.588285] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-22T19:15:59.588373] [INFO ] [MAIN ] Update Progress: 1026/2372 symbols completed. HKD took 24.8s. Estimated remaining: 2h 58m 19s. Rate: 7.5 symbols/min [2025-09-22T19:15:59.731031] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-22T19:15:59.763811] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:15:59.792871] [DEBUG] [LOCAL ] HLIO: Loaded 28501 existing records from primary storage. [2025-09-22T19:15:59.793011] [INFO ] [MAIN ] HLIO: Loaded 28501 existing records. [2025-09-22T19:15:59.968474] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:15:59.968806] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-22T19:15:59.968862] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-22T19:15:59.969666] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-22T19:15:59.969729] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-22T19:16:00.323581] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:16:00.522066] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-22T19:16:00.825709] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T19:16:01.322023] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-22T19:16:01.651795] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-22T19:16:02.092917] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T19:16:02.122053] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-22T19:16:02.409510] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T19:16:02.922096] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-22T19:16:03.632405] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T19:16:03.722071] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-22T19:16:03.941095] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T19:16:04.522074] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-22T19:16:04.573872] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T19:16:05.322073] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-22T19:16:05.535573] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T19:16:06.122106] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-22T19:16:06.922100] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-22T19:16:07.038789] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T19:16:07.722039] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-22T19:16:07.867492] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T19:16:08.200453] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-22T19:16:08.522081] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-22T19:16:08.701136] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T19:16:09.322048] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-22T19:16:09.778908] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T19:16:10.122076] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-22T19:16:10.369871] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T19:16:10.922073] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-22T19:16:11.436363] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T19:16:11.722089] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-22T19:16:12.522033] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-22T19:16:12.569927] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T19:16:12.645605] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T19:16:13.322064] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-22T19:16:13.707619] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-22T19:16:14.122083] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-22T19:16:14.839795] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T19:16:14.922110] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-22T19:16:15.551438] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T19:16:15.722102] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-22T19:16:15.946953] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T19:16:16.522111] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-22T19:16:17.292306] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T19:16:17.322045] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-22T19:16:17.762100] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T19:16:18.122138] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-22T19:16:18.803290] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T19:16:18.922106] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-22T19:16:19.479257] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-22T19:16:19.722181] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-22T19:16:20.522044] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-22T19:16:20.964346] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-22T19:16:21.014141] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T19:16:21.322013] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-22T19:16:21.695790] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T19:16:21.699758] [INFO ] [REMOTE ] HLIO: Full fetch complete (36111 records). [2025-09-22T19:16:21.699851] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-22T19:16:22.086089] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-22T19:16:22.086194] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-22T19:16:22.086858] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-22T19:16:22.086922] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-22T19:16:22.087806] [DEBUG] [LOCAL ] HLIO: Trimmed 36111 records to 28176 (keeping 200 days of data) [2025-09-22T19:16:22.142324] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-22T19:16:22.260831] [DEBUG] [LOCAL ] HLIO: Primary data saved (28176 records). [2025-09-22T19:16:22.260965] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-22T19:16:22.261119] [INFO ] [MAIN ] Update Progress: 1027/2372 symbols completed. HLIO took 22.7s. Estimated remaining: 2h 58m 31s. Rate: 7.5 symbols/min [2025-09-22T19:16:22.431366] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:16:22.463716] [DEBUG] [LOCAL ] HLLY: Loaded 33735 existing records from primary storage. [2025-09-22T19:16:22.463851] [INFO ] [MAIN ] HLLY: Loaded 33735 existing records. [2025-09-22T19:16:22.644969] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:16:22.645242] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-22T19:16:22.645315] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-22T19:16:22.646295] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-22T19:16:22.646360] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-22T19:16:22.930671] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-22T19:16:23.019076] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:16:23.444279] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-22T19:16:23.474069] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T19:16:23.722045] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-22T19:16:24.522111] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-22T19:16:24.575958] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T19:16:24.583914] [INFO ] [REMOTE ] HLF: Full fetch complete (71445 records). [2025-09-22T19:16:24.584092] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-22T19:16:24.981210] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-22T19:16:24.981288] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-22T19:16:24.982191] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-22T19:16:24.982256] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-22T19:16:24.983611] [DEBUG] [LOCAL ] HLF: Trimmed 71445 records to 48773 (keeping 200 days of data) [2025-09-22T19:16:25.267884] [DEBUG] [LOCAL ] HLF: Primary data saved (48773 records). [2025-09-22T19:16:25.268063] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-22T19:16:25.268170] [INFO ] [MAIN ] Update Progress: 1028/2372 symbols completed. HLF took 32.0s. Estimated remaining: 2h 58m 16s. Rate: 7.5 symbols/min [2025-09-22T19:16:25.334281] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-22T19:16:25.453110] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:16:25.506833] [DEBUG] [LOCAL ] HLN: Loaded 53862 existing records from primary storage. [2025-09-22T19:16:25.507000] [INFO ] [MAIN ] HLN: Loaded 53862 existing records. [2025-09-22T19:16:25.693774] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:16:25.694149] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-22T19:16:25.694225] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-22T19:16:25.695501] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-22T19:16:25.695563] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-22T19:16:25.849441] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-22T19:16:26.123102] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-22T19:16:26.150706] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T19:16:26.169045] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:16:26.170197] [INFO ] [REMOTE ] HLI: Full fetch complete (45194 records). [2025-09-22T19:16:26.170282] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-22T19:16:26.579756] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-22T19:16:26.579860] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-22T19:16:26.580752] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-22T19:16:26.580817] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-22T19:16:26.581882] [DEBUG] [LOCAL ] HLI: Trimmed 45194 records to 31269 (keeping 200 days of data) [2025-09-22T19:16:26.795244] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T19:16:26.824537] [DEBUG] [LOCAL ] HLI: Primary data saved (31269 records). [2025-09-22T19:16:26.824681] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-22T19:16:26.824779] [INFO ] [MAIN ] Update Progress: 1029/2372 symbols completed. HLI took 30.2s. Estimated remaining: 2h 58m 0s. Rate: 7.5 symbols/min [2025-09-22T19:16:26.927231] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-22T19:16:27.001198] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:16:27.053689] [DEBUG] [LOCAL ] HLT: Loaded 51521 existing records from primary storage. [2025-09-22T19:16:27.053849] [INFO ] [MAIN ] HLT: Loaded 51521 existing records. [2025-09-22T19:16:27.285569] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:16:27.285955] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-22T19:16:27.286028] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-22T19:16:27.287553] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-22T19:16:27.287679] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-22T19:16:27.727344] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-22T19:16:27.843819] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:16:28.284162] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-22T19:16:28.297895] [INFO ] [REMOTE ] HL: Full fetch complete (77652 records). [2025-09-22T19:16:28.298128] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-22T19:16:28.534415] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-22T19:16:28.773580] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-22T19:16:28.773802] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-22T19:16:28.775012] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-22T19:16:28.775163] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-22T19:16:28.805117] [DEBUG] [LOCAL ] HL: Trimmed 77652 records to 53670 (keeping 200 days of data) [2025-09-22T19:16:28.806790] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T19:16:29.148527] [DEBUG] [LOCAL ] HL: Primary data saved (53670 records). [2025-09-22T19:16:29.148726] [INFO ] [MAIN ] HL: Full history saved. [2025-09-22T19:16:29.148828] [INFO ] [MAIN ] Update Progress: 1030/2372 symbols completed. HL took 44.8s. Estimated remaining: 2h 57m 45s. Rate: 7.6 symbols/min [2025-09-22T19:16:29.331678] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:16:29.331869] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-22T19:16:29.350684] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T19:16:29.402401] [DEBUG] [LOCAL ] HLX: Loaded 48858 existing records from primary storage. [2025-09-22T19:16:29.402596] [INFO ] [MAIN ] HLX: Loaded 48858 existing records. [2025-09-22T19:16:29.605874] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:16:29.606198] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-22T19:16:29.606263] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-22T19:16:29.608186] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-22T19:16:29.608249] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-22T19:16:29.971000] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:16:30.122070] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-22T19:16:30.305081] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T19:16:30.922116] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-22T19:16:31.130973] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-22T19:16:31.442241] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T19:16:31.722114] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-22T19:16:32.522133] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-22T19:16:32.589878] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T19:16:32.661029] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T19:16:33.322059] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-22T19:16:34.122101] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-22T19:16:34.197346] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T19:16:34.669225] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T19:16:34.922062] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-22T19:16:35.642448] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T19:16:35.722097] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-22T19:16:36.342754] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T19:16:36.522065] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-22T19:16:37.322080] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-22T19:16:37.435335] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T19:16:37.853819] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T19:16:38.122049] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-22T19:16:38.922080] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-22T19:16:39.727162] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-22T19:16:39.743502] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-22T19:16:40.268087] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-22T19:16:40.522071] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-22T19:16:40.894311] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-22T19:16:41.322070] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-22T19:16:42.055992] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-22T19:16:42.128293] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-22T19:16:42.151130] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T19:16:42.478311] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T19:16:42.922083] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-22T19:16:43.722036] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-22T19:16:43.843549] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T19:16:44.522030] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-22T19:16:44.586403] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T19:16:45.026225] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T19:16:45.322054] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-22T19:16:45.431406] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-22T19:16:46.122175] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-22T19:16:46.922113] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-22T19:16:47.080281] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T19:16:47.617175] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T19:16:47.722054] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-22T19:16:48.291471] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T19:16:48.522066] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-22T19:16:49.322043] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-22T19:16:49.483301] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T19:16:50.122085] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-22T19:16:50.235626] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T19:16:50.853112] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T19:16:50.859311] [INFO ] [REMOTE ] HLLY: Full fetch complete (46257 records). [2025-09-22T19:16:50.859456] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-22T19:16:50.927284] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-22T19:16:51.308357] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-22T19:16:51.308446] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-22T19:16:51.309226] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-22T19:16:51.309295] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-22T19:16:51.310442] [DEBUG] [LOCAL ] HLLY: Trimmed 46257 records to 33370 (keeping 200 days of data) [2025-09-22T19:16:51.522730] [DEBUG] [LOCAL ] HLLY: Primary data saved (33370 records). [2025-09-22T19:16:51.523075] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-22T19:16:51.523383] [INFO ] [MAIN ] Update Progress: 1031/2372 symbols completed. HLLY took 29.3s. Estimated remaining: 2h 57m 56s. Rate: 7.5 symbols/min [2025-09-22T19:16:51.703153] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:16:51.732335] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-22T19:16:51.754827] [DEBUG] [LOCAL ] HMC: Loaded 47743 existing records from primary storage. [2025-09-22T19:16:51.754995] [INFO ] [MAIN ] HMC: Loaded 47743 existing records. [2025-09-22T19:16:51.951289] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:16:51.951767] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-22T19:16:51.951880] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-22T19:16:51.953118] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-22T19:16:51.953277] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-22T19:16:52.151222] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-22T19:16:52.414044] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:16:52.447797] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T19:16:52.522010] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-22T19:16:53.159446] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T19:16:53.322066] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-22T19:16:54.122062] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-22T19:16:54.382516] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T19:16:54.568341] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T19:16:54.580295] [INFO ] [REMOTE ] HLX: Full fetch complete (69115 records). [2025-09-22T19:16:54.580465] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-22T19:16:54.936687] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-22T19:16:54.998272] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-22T19:16:54.998360] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-22T19:16:54.999257] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-22T19:16:54.999337] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-22T19:16:55.002301] [DEBUG] [LOCAL ] HLX: Trimmed 69115 records to 48084 (keeping 200 days of data) [2025-09-22T19:16:55.300441] [DEBUG] [LOCAL ] HLX: Primary data saved (48084 records). [2025-09-22T19:16:55.300622] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-22T19:16:55.301054] [INFO ] [MAIN ] Update Progress: 1032/2372 symbols completed. HLX took 26.2s. Estimated remaining: 2h 57m 42s. Rate: 7.5 symbols/min [2025-09-22T19:16:55.490414] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:16:55.519846] [DEBUG] [LOCAL ] HMN: Loaded 23567 existing records from primary storage. [2025-09-22T19:16:55.519995] [INFO ] [MAIN ] HMN: Loaded 23567 existing records. [2025-09-22T19:16:55.723211] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-22T19:16:55.723438] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:16:55.725118] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-22T19:16:55.725225] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-22T19:16:55.726183] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-22T19:16:55.726288] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-22T19:16:56.101021] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:16:56.522074] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-22T19:16:57.100267] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-22T19:16:57.322069] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-22T19:16:57.409152] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-22T19:16:57.706979] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T19:16:58.122039] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-22T19:16:58.179439] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-22T19:16:58.659477] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T19:16:58.922048] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-22T19:16:59.516365] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T19:16:59.524721] [INFO ] [REMOTE ] HLN: Full fetch complete (76760 records). [2025-09-22T19:16:59.524861] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-22T19:16:59.727169] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-22T19:16:59.937434] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-22T19:16:59.937583] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-22T19:16:59.938534] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-22T19:16:59.938597] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-22T19:16:59.941366] [DEBUG] [LOCAL ] HLN: Trimmed 76760 records to 53089 (keeping 200 days of data) [2025-09-22T19:17:00.278487] [DEBUG] [LOCAL ] HLN: Primary data saved (53089 records). [2025-09-22T19:17:00.278621] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-22T19:17:00.278822] [INFO ] [MAIN ] Update Progress: 1033/2372 symbols completed. HLN took 35.0s. Estimated remaining: 2h 57m 30s. Rate: 7.5 symbols/min [2025-09-22T19:17:00.450347] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:17:00.509347] [DEBUG] [LOCAL ] HMY: Loaded 53905 existing records from primary storage. [2025-09-22T19:17:00.509493] [INFO ] [MAIN ] HMY: Loaded 53905 existing records. [2025-09-22T19:17:00.541055] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-22T19:17:00.716692] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:17:00.717092] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-22T19:17:00.717284] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-22T19:17:00.718889] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-22T19:17:00.719070] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-22T19:17:00.863912] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-22T19:17:01.120531] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:17:01.322014] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-22T19:17:01.496149] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T19:17:01.497160] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T19:17:01.509925] [INFO ] [REMOTE ] HLT: Full fetch complete (73440 records). [2025-09-22T19:17:01.510092] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-22T19:17:01.931231] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-22T19:17:01.931566] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-22T19:17:01.932557] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-22T19:17:01.932621] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-22T19:17:01.934103] [DEBUG] [LOCAL ] HLT: Trimmed 73440 records to 50774 (keeping 200 days of data) [2025-09-22T19:17:02.129679] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-22T19:17:02.265875] [DEBUG] [LOCAL ] HLT: Primary data saved (50774 records). [2025-09-22T19:17:02.266015] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-22T19:17:02.266134] [INFO ] [MAIN ] Update Progress: 1034/2372 symbols completed. HLT took 35.4s. Estimated remaining: 2h 57m 15s. Rate: 7.5 symbols/min [2025-09-22T19:17:02.434291] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:17:02.434511] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-22T19:17:02.434566] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-22T19:17:02.434769] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-22T19:17:02.434832] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-22T19:17:02.434875] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-22T19:17:02.434907] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-22T19:17:02.795229] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:17:02.922017] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-22T19:17:03.039688] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T19:17:03.131681] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:17:03.131972] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-22T19:17:03.727132] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-22T19:17:03.746866] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T19:17:04.522067] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-22T19:17:04.726805] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:17:04.727141] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-22T19:17:05.322015] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-22T19:17:05.756378] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-22T19:17:06.122066] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-22T19:17:06.309170] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:17:06.309481] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-22T19:17:06.809546] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T19:17:06.922062] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-22T19:17:07.722105] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-22T19:17:08.010373] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T19:17:08.522068] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-22T19:17:08.710353] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:17:08.710714] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-22T19:17:09.328553] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-22T19:17:09.334619] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T19:17:10.122090] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-22T19:17:10.922066] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-22T19:17:11.077204] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T19:17:11.110234] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:17:11.110527] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-22T19:17:11.722155] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-22T19:17:12.201549] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-22T19:17:12.522091] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-22T19:17:12.822852] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T19:17:13.322092] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-22T19:17:14.026174] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T19:17:14.122100] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-22T19:17:14.768475] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-22T19:17:14.922074] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-22T19:17:15.654467] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T19:17:15.722019] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-22T19:17:16.522060] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-22T19:17:16.746670] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T19:17:17.002772] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T19:17:17.317004] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T19:17:17.322419] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-22T19:17:18.122053] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-22T19:17:18.922075] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-22T19:17:19.088720] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T19:17:19.722067] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-22T19:17:19.937432] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T19:17:20.527246] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-22T19:17:20.563769] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T19:17:21.322143] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-22T19:17:21.434768] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T19:17:22.122064] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-22T19:17:22.152921] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T19:17:22.913853] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T19:17:22.922011] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-22T19:17:23.722041] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-22T19:17:24.098233] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-22T19:17:24.162338] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T19:17:24.522070] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-22T19:17:24.933884] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T19:17:25.322039] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-22T19:17:25.573721] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T19:17:26.122112] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-22T19:17:26.922082] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-22T19:17:27.038486] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T19:17:27.045862] [INFO ] [REMOTE ] HNGE: Full fetch complete (25721 records). [2025-09-22T19:17:27.046021] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-22T19:17:27.233731] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 84 unique days, need 200 days [2025-09-22T19:17:27.234101] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:17:27.234180] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:17:27.234282] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-22T19:17:27.234364] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-22T19:17:27.234422] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-22T19:17:27.234501] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-22T19:17:27.234592] [INFO ] [MAIN ] Update Progress: 1035/2372 symbols completed. HNGE took 25.0s. Estimated remaining: 2h 57m 29s. Rate: 7.5 symbols/min [2025-09-22T19:17:27.408765] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:17:27.427390] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T19:17:27.460813] [DEBUG] [LOCAL ] HNI: Loaded 29351 existing records from primary storage. [2025-09-22T19:17:27.460953] [INFO ] [MAIN ] HNI: Loaded 29351 existing records. [2025-09-22T19:17:27.641718] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:17:27.641983] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-22T19:17:27.642033] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-22T19:17:27.642808] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-22T19:17:27.642872] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-22T19:17:27.727131] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-22T19:17:28.033779] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:17:28.522057] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-22T19:17:29.201299] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-22T19:17:29.209819] [INFO ] [REMOTE ] HMY: Full fetch complete (76632 records). [2025-09-22T19:17:29.209948] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-22T19:17:29.327147] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-22T19:17:29.617234] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-22T19:17:29.617370] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-22T19:17:29.618324] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-22T19:17:29.618403] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-22T19:17:29.619938] [DEBUG] [LOCAL ] HMY: Trimmed 76632 records to 53128 (keeping 200 days of data) [2025-09-22T19:17:29.752298] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-22T19:17:29.762556] [INFO ] [REMOTE ] HMC: Full fetch complete (69669 records). [2025-09-22T19:17:29.768466] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-22T19:17:29.815063] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T19:17:30.125265] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-22T19:17:30.226687] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-22T19:17:30.227089] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-22T19:17:30.228302] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-22T19:17:30.229122] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-22T19:17:30.234752] [DEBUG] [LOCAL ] HMC: Trimmed 69669 records to 46929 (keeping 200 days of data) [2025-09-22T19:17:30.420764] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T19:17:30.673282] [DEBUG] [LOCAL ] HMY: Primary data saved (53128 records). [2025-09-22T19:17:30.683173] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-22T19:17:30.683303] [INFO ] [MAIN ] Update Progress: 1036/2372 symbols completed. HMY took 30.4s. Estimated remaining: 2h 57m 15s. Rate: 7.5 symbols/min [2025-09-22T19:17:30.903140] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:17:30.917818] [DEBUG] [LOCAL ] HMC: Primary data saved (46929 records). [2025-09-22T19:17:30.918146] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-22T19:17:30.918272] [INFO ] [MAIN ] Update Progress: 1037/2372 symbols completed. HMC took 39.4s. Estimated remaining: 2h 56m 57s. Rate: 7.5 symbols/min [2025-09-22T19:17:30.921996] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-22T19:17:30.959757] [DEBUG] [LOCAL ] HOG: Loaded 52045 existing records from primary storage. [2025-09-22T19:17:30.959896] [INFO ] [MAIN ] HOG: Loaded 52045 existing records. [2025-09-22T19:17:31.159092] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:17:31.159410] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-22T19:17:31.159588] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-22T19:17:31.175936] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-22T19:17:31.176296] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-22T19:17:31.182994] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T19:17:31.557605] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:17:31.722157] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-22T19:17:32.097270] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T19:17:32.101032] [INFO ] [REMOTE ] HMN: Full fetch complete (31562 records). [2025-09-22T19:17:32.101118] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-22T19:17:32.481083] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-22T19:17:32.481186] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-22T19:17:32.481811] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-22T19:17:32.481897] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-22T19:17:32.483441] [DEBUG] [LOCAL ] HMN: Trimmed 31562 records to 23306 (keeping 200 days of data) [2025-09-22T19:17:32.542349] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-22T19:17:32.637947] [DEBUG] [LOCAL ] HMN: Primary data saved (23306 records). [2025-09-22T19:17:32.638086] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-22T19:17:32.638172] [INFO ] [MAIN ] Update Progress: 1038/2372 symbols completed. HMN took 37.3s. Estimated remaining: 2h 56m 41s. Rate: 7.6 symbols/min [2025-09-22T19:17:32.653534] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-22T19:17:33.322080] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-22T19:17:34.174447] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T19:17:34.184615] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-22T19:17:34.333029] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T19:17:34.922051] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-22T19:17:36.069841] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T19:17:36.075758] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-22T19:17:36.481773] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-22T19:17:36.522004] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-22T19:17:37.280704] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T19:17:37.322035] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-22T19:17:38.290040] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T19:17:38.301040] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-22T19:17:38.320333] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T19:17:38.922073] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-22T19:17:39.774748] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-22T19:17:39.780408] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-22T19:17:40.173103] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T19:17:40.522071] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-22T19:17:41.029902] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T19:17:41.322090] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-22T19:17:42.135828] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T19:17:42.147238] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-22T19:17:42.838489] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T19:17:42.844615] [INFO ] [REMOTE ] HNI: Full fetch complete (40927 records). [2025-09-22T19:17:42.844755] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-22T19:17:43.228335] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-22T19:17:43.228419] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-22T19:17:43.229166] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-22T19:17:43.229239] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-22T19:17:43.230318] [DEBUG] [LOCAL ] HNI: Trimmed 40927 records to 28782 (keeping 200 days of data) [2025-09-22T19:17:43.410132] [DEBUG] [LOCAL ] HNI: Primary data saved (28782 records). [2025-09-22T19:17:43.410281] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-22T19:17:43.410370] [INFO ] [MAIN ] Update Progress: 1039/2372 symbols completed. HNI took 16.2s. Estimated remaining: 2h 56m 37s. Rate: 7.5 symbols/min [2025-09-22T19:17:44.011258] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T19:17:44.022517] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-22T19:17:45.644919] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T19:17:45.655490] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-22T19:17:47.508116] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T19:17:47.519905] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-22T19:17:49.588112] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-22T19:17:49.600540] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-22T19:17:51.451326] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T19:17:51.459806] [INFO ] [REMOTE ] HOG: Full fetch complete (74250 records). [2025-09-22T19:17:51.459989] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-22T19:17:51.948743] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-22T19:17:51.948866] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-22T19:17:51.950226] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-22T19:17:51.950308] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-22T19:17:51.952388] [DEBUG] [LOCAL ] HOG: Trimmed 74250 records to 51269 (keeping 200 days of data) [2025-09-22T19:17:52.295047] [DEBUG] [LOCAL ] HOG: Primary data saved (51269 records). [2025-09-22T19:17:52.295240] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-22T19:17:52.295350] [INFO ] [MAIN ] Update Progress: 1040/2372 symbols completed. HOG took 21.6s. Estimated remaining: 2h 56m 30s. Rate: 7.5 symbols/min [2025-09-22T19:17:53.035496] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:17:53.162404] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:17:53.157739] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:17:53.184120] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:17:53.211404] [DEBUG] [LOCAL ] HOV: Loaded 13971 existing records from primary storage. [2025-09-22T19:17:53.211720] [INFO ] [MAIN ] HOV: Loaded 13971 existing records. [2025-09-22T19:17:53.299533] [DEBUG] [LOCAL ] HOMB: Loaded 44380 existing records from primary storage. [2025-09-22T19:17:53.310958] [INFO ] [MAIN ] HOMB: Loaded 44380 existing records. [2025-09-22T19:17:53.564233] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:17:53.639969] [DEBUG] [LOCAL ] HP: Loaded 52374 existing records from primary storage. [2025-09-22T19:17:53.638980] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-22T19:17:53.640265] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-22T19:17:53.640194] [INFO ] [MAIN ] HP: Loaded 52374 existing records. [2025-09-22T19:17:53.608672] [DEBUG] [LOCAL ] HOUS: Loaded 44658 existing records from primary storage. [2025-09-22T19:17:53.672245] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-22T19:17:53.698208] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-22T19:17:53.672492] [INFO ] [MAIN ] HOUS: Loaded 44658 existing records. [2025-09-22T19:17:53.743384] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:17:53.781754] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-22T19:17:53.846742] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-22T19:17:53.857379] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-22T19:17:53.916460] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-22T19:17:54.451208] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:17:54.445808] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:17:54.496043] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-22T19:17:54.496585] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-22T19:17:54.520217] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-22T19:17:54.542527] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-22T19:17:54.542343] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-22T19:17:54.605067] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-22T19:17:54.599685] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-22T19:17:54.661373] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-22T19:17:55.192546] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:17:55.122891] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:17:55.224888] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-22T19:17:55.236369] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-22T19:17:55.691451] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:17:55.713962] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-22T19:17:55.738207] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:17:55.738710] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-22T19:17:56.362131] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T19:17:56.365929] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-22T19:17:56.927869] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-22T19:17:56.930806] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-22T19:17:56.993595] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T19:17:57.003184] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-22T19:17:57.082431] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T19:17:57.092391] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-22T19:17:57.119387] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T19:17:57.128208] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-22T19:17:57.503631] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T19:17:57.507254] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-22T19:17:58.278679] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T19:17:58.288635] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-22T19:17:58.355841] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T19:17:58.366170] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-22T19:17:58.377466] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-22T19:17:58.380887] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-22T19:17:58.707585] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T19:17:58.717975] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-22T19:17:59.178095] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-22T19:17:59.181380] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-22T19:17:59.691678] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T19:17:59.701460] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-22T19:17:59.771146] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T19:17:59.781637] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-22T19:17:59.840583] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T19:17:59.842256] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T19:17:59.853539] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-22T19:18:00.522048] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-22T19:18:00.850691] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T19:18:01.236541] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T19:18:01.322097] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-22T19:18:01.575614] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T19:18:02.122094] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-22T19:18:02.401105] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T19:18:02.930922] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-22T19:18:02.949832] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T19:18:03.722077] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-22T19:18:04.522103] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-22T19:18:04.710734] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T19:18:05.112235] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-09-22T19:18:05.322066] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-22T19:18:05.652548] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-22T19:18:06.122093] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-22T19:18:06.157820] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T19:18:06.336203] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T19:18:06.922062] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-22T19:18:07.565268] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T19:18:07.722102] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-22T19:18:08.522091] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-22T19:18:08.848495] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T19:18:09.153540] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T19:18:09.322087] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-22T19:18:09.775522] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T19:18:10.122065] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-22T19:18:10.922027] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-22T19:18:11.010405] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T19:18:11.179143] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T19:18:11.181772] [INFO ] [REMOTE ] HOV: Full fetch complete (19451 records). [2025-09-22T19:18:11.181844] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-22T19:18:11.545377] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-22T19:18:11.545456] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-22T19:18:11.545906] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-22T19:18:11.545966] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-22T19:18:11.546529] [DEBUG] [LOCAL ] HOV: Trimmed 19451 records to 13753 (keeping 200 days of data) [2025-09-22T19:18:11.629083] [DEBUG] [LOCAL ] HOV: Primary data saved (13753 records). [2025-09-22T19:18:11.629235] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-22T19:18:11.629322] [INFO ] [MAIN ] Update Progress: 1041/2372 symbols completed. HOV took 19.3s. Estimated remaining: 2h 56m 37s. Rate: 7.5 symbols/min [2025-09-22T19:18:11.727155] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-22T19:18:11.807722] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:18:11.864735] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-22T19:18:11.864911] [INFO ] [MAIN ] HPE: Loaded 54477 existing records. [2025-09-22T19:18:12.041757] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:18:12.042014] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-22T19:18:12.042070] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-22T19:18:12.043523] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-22T19:18:12.043583] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-22T19:18:12.398172] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:18:12.529582] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-22T19:18:12.535114] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T19:18:13.322053] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-22T19:18:13.505809] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T19:18:14.122098] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-22T19:18:14.690004] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-22T19:18:14.744625] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T19:18:14.922124] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-22T19:18:15.692585] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T19:18:15.722096] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-22T19:18:16.293858] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T19:18:16.522117] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-22T19:18:17.322069] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-22T19:18:17.476896] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T19:18:17.484198] [INFO ] [REMOTE ] HOMB: Full fetch complete (63600 records). [2025-09-22T19:18:17.484329] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-22T19:18:17.891318] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-22T19:18:17.891413] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-22T19:18:17.892291] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-22T19:18:17.892365] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-22T19:18:17.893813] [DEBUG] [LOCAL ] HOMB: Trimmed 63600 records to 43641 (keeping 200 days of data) [2025-09-22T19:18:18.122260] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-22T19:18:18.175123] [DEBUG] [LOCAL ] HOMB: Primary data saved (43641 records). [2025-09-22T19:18:18.175282] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-22T19:18:18.175396] [INFO ] [MAIN ] Update Progress: 1042/2372 symbols completed. HOMB took 25.9s. Estimated remaining: 2h 56m 27s. Rate: 7.5 symbols/min [2025-09-22T19:18:18.351458] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:18:18.361110] [DEBUG] [LOCAL ] HPF: Loaded 7364 existing records from primary storage. [2025-09-22T19:18:18.361249] [INFO ] [MAIN ] HPF: Loaded 7364 existing records. [2025-09-22T19:18:18.545718] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:18:18.546228] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-22T19:18:18.546318] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-22T19:18:18.574445] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-22T19:18:18.578409] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-22T19:18:18.664435] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-22T19:18:18.925011] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-22T19:18:18.961763] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:18:19.722106] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-22T19:18:20.240338] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-09-22T19:18:20.241358] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-22T19:18:20.277228] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-22T19:18:20.284990] [INFO ] [REMOTE ] HOUS: Full fetch complete (62589 records). [2025-09-22T19:18:20.285133] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-22T19:18:20.527387] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-22T19:18:20.699951] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-22T19:18:20.700056] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-22T19:18:20.701012] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-22T19:18:20.701078] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-22T19:18:20.702417] [DEBUG] [LOCAL ] HOUS: Trimmed 62589 records to 44037 (keeping 200 days of data) [2025-09-22T19:18:20.943763] [DEBUG] [LOCAL ] HOUS: Primary data saved (44037 records). [2025-09-22T19:18:20.943898] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-22T19:18:20.943979] [INFO ] [MAIN ] Update Progress: 1043/2372 symbols completed. HOUS took 28.6s. Estimated remaining: 2h 56m 12s. Rate: 7.5 symbols/min [2025-09-22T19:18:21.116818] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:18:21.129508] [DEBUG] [LOCAL ] HPI: Loaded 10185 existing records from primary storage. [2025-09-22T19:18:21.129791] [INFO ] [MAIN ] HPI: Loaded 10185 existing records. [2025-09-22T19:18:21.287209] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T19:18:21.342338] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:18:21.342585] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-22T19:18:21.350744] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-22T19:18:21.351682] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-22T19:18:21.360079] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-22T19:18:21.363533] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-22T19:18:21.363604] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-22T19:18:21.396927] [INFO ] [REMOTE ] HP: Full fetch complete (73881 records). [2025-09-22T19:18:21.434787] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-22T19:18:22.116428] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:18:22.131781] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-22T19:18:22.155862] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-22T19:18:22.157680] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-22T19:18:22.158750] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-22T19:18:22.158943] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-22T19:18:22.160538] [DEBUG] [LOCAL ] HP: Trimmed 73881 records to 51601 (keeping 200 days of data) [2025-09-22T19:18:22.487758] [DEBUG] [LOCAL ] HP: Primary data saved (51601 records). [2025-09-22T19:18:22.488045] [INFO ] [MAIN ] HP: Full history saved. [2025-09-22T19:18:22.488145] [INFO ] [MAIN ] Update Progress: 1044/2372 symbols completed. HP took 30.2s. Estimated remaining: 2h 55m 56s. Rate: 7.5 symbols/min [2025-09-22T19:18:22.675132] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:18:22.724497] [DEBUG] [LOCAL ] HPP: Loaded 51503 existing records from primary storage. [2025-09-22T19:18:22.724673] [INFO ] [MAIN ] HPP: Loaded 51503 existing records. [2025-09-22T19:18:22.837447] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T19:18:22.929040] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:18:22.928821] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-22T19:18:22.930372] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-22T19:18:22.930468] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-22T19:18:22.931914] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-22T19:18:22.931991] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-22T19:18:23.317309] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:18:23.352156] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-22T19:18:23.722066] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-22T19:18:23.767761] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T19:18:24.522078] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-22T19:18:25.238358] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T19:18:25.322067] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-22T19:18:25.645769] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T19:18:25.766324] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T19:18:26.122070] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-22T19:18:26.901935] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T19:18:26.922073] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-22T19:18:27.683602] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-22T19:18:27.722070] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-22T19:18:28.522108] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-22T19:18:28.538116] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T19:18:29.322052] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-22T19:18:30.027690] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T19:18:30.122094] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-22T19:18:30.173348] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T19:18:30.598069] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-22T19:18:30.922052] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-22T19:18:31.722079] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-22T19:18:31.742092] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T19:18:32.522042] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-22T19:18:32.596159] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-22T19:18:33.247358] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T19:18:33.322034] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-22T19:18:33.991060] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-22T19:18:34.122068] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-22T19:18:34.922082] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-22T19:18:35.537035] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T19:18:35.722065] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-22T19:18:36.522100] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-22T19:18:36.947364] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-22T19:18:36.986520] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T19:18:37.272756] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T19:18:37.276089] [INFO ] [REMOTE ] HPI: Full fetch complete (13431 records). [2025-09-22T19:18:37.276165] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-22T19:18:37.327153] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-22T19:18:37.673456] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-22T19:18:37.673546] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-22T19:18:37.673913] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-22T19:18:37.673982] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-22T19:18:37.674497] [DEBUG] [LOCAL ] HPI: Trimmed 13431 records to 10105 (keeping 200 days of data) [2025-09-22T19:18:37.739982] [DEBUG] [LOCAL ] HPI: Primary data saved (10105 records). [2025-09-22T19:18:37.740124] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-22T19:18:37.740211] [INFO ] [MAIN ] Update Progress: 1045/2372 symbols completed. HPI took 16.8s. Estimated remaining: 2h 55m 57s. Rate: 7.5 symbols/min [2025-09-22T19:18:37.927631] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:18:37.983751] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-22T19:18:37.983949] [INFO ] [MAIN ] HPQ: Loaded 54448 existing records. [2025-09-22T19:18:38.127178] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-22T19:18:38.182565] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:18:38.182902] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-22T19:18:38.182954] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-22T19:18:38.185007] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-22T19:18:38.185071] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-22T19:18:38.589188] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:18:38.783944] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T19:18:38.922089] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-22T19:18:39.273799] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T19:18:39.722076] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-22T19:18:40.522101] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-22T19:18:40.595345] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T19:18:41.325055] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-22T19:18:41.328283] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T19:18:41.346840] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-22T19:18:42.122069] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-22T19:18:42.922042] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-22T19:18:43.371835] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-22T19:18:43.722053] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-22T19:18:43.847909] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T19:18:44.522032] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-22T19:18:44.648870] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T19:18:45.225506] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-22T19:18:45.293929] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T19:18:45.322003] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-22T19:18:46.122077] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-22T19:18:46.922066] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-22T19:18:47.095676] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T19:18:47.722048] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-22T19:18:48.125373] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-22T19:18:48.269579] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T19:18:48.522056] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-22T19:18:49.322049] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-22T19:18:49.777498] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-22T19:18:49.958486] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T19:18:49.960406] [INFO ] [REMOTE ] HPF: Full fetch complete (10817 records). [2025-09-22T19:18:49.960509] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-22T19:18:50.136416] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-22T19:18:50.327995] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-22T19:18:50.328072] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-22T19:18:50.328327] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-22T19:18:50.328366] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-22T19:18:50.329290] [DEBUG] [LOCAL ] HPF: Trimmed 10817 records to 7280 (keeping 200 days of data) [2025-09-22T19:18:50.376813] [DEBUG] [LOCAL ] HPF: Primary data saved (7280 records). [2025-09-22T19:18:50.376939] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-22T19:18:50.377069] [INFO ] [MAIN ] Update Progress: 1046/2372 symbols completed. HPF took 32.2s. Estimated remaining: 2h 55m 55s. Rate: 7.5 symbols/min [2025-09-22T19:18:50.569171] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:18:50.598054] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-22T19:18:50.610702] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-22T19:18:50.610951] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-22T19:18:50.650983] [DEBUG] [LOCAL ] HPS: Loaded 10420 existing records from primary storage. [2025-09-22T19:18:50.677529] [INFO ] [MAIN ] HPS: Loaded 10420 existing records. [2025-09-22T19:18:50.936843] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-22T19:18:51.034700] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:18:51.039969] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-22T19:18:51.040032] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-22T19:18:51.040562] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-22T19:18:51.040625] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-22T19:18:51.607591] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-22T19:18:51.638065] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-22T19:18:51.639307] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-22T19:18:51.645303] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-22T19:18:51.708406] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-09-22T19:18:51.730959] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:18:51.732143] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-22T19:18:52.117210] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-22T19:18:52.154485] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-22T19:18:52.154691] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-22T19:18:52.154914] [INFO ] [MAIN ] Update Progress: 1047/2372 symbols completed. HPE took 40.5s. Estimated remaining: 2h 55m 40s. Rate: 7.5 symbols/min [2025-09-22T19:18:52.330283] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:18:52.339967] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-22T19:18:52.367984] [DEBUG] [LOCAL ] HQH: Loaded 25294 existing records from primary storage. [2025-09-22T19:18:52.368115] [INFO ] [MAIN ] HQH: Loaded 25294 existing records. [2025-09-22T19:18:52.523636] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-22T19:18:52.545994] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:18:52.547728] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-22T19:18:52.547785] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-22T19:18:52.549216] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-22T19:18:52.549284] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-22T19:18:52.968518] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:18:53.153406] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-22T19:18:53.322038] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-22T19:18:53.857220] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T19:18:54.122054] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-22T19:18:54.922025] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-22T19:18:55.253495] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T19:18:55.722064] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-22T19:18:55.969854] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T19:18:56.002606] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T19:18:56.522046] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-22T19:18:57.322030] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-22T19:18:57.466545] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T19:18:57.943049] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T19:18:57.971280] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T19:18:57.981099] [INFO ] [REMOTE ] HPP: Full fetch complete (73356 records). [2025-09-22T19:18:57.981328] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-22T19:18:58.134638] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-22T19:18:58.418444] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-22T19:18:58.418573] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-22T19:18:58.419812] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-22T19:18:58.419919] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-22T19:18:58.424793] [DEBUG] [LOCAL ] HPP: Trimmed 73356 records to 50793 (keeping 200 days of data) [2025-09-22T19:18:58.759233] [DEBUG] [LOCAL ] HPP: Primary data saved (50793 records). [2025-09-22T19:18:58.759597] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-22T19:18:58.759764] [INFO ] [MAIN ] Update Progress: 1048/2372 symbols completed. HPP took 36.3s. Estimated remaining: 2h 55m 30s. Rate: 7.5 symbols/min [2025-09-22T19:18:58.922764] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-22T19:18:58.944064] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:18:58.966790] [DEBUG] [LOCAL ] HQL: Loaded 16379 existing records from primary storage. [2025-09-22T19:18:58.966922] [INFO ] [MAIN ] HQL: Loaded 16379 existing records. [2025-09-22T19:18:59.152741] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:18:59.153047] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-22T19:18:59.153122] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-22T19:18:59.153881] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-22T19:18:59.153954] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-22T19:18:59.530922] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:18:59.690626] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T19:18:59.722004] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-22T19:19:00.164321] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-22T19:19:00.351857] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T19:19:00.522098] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-22T19:19:01.322086] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-22T19:19:01.523006] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-22T19:19:02.122065] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-22T19:19:02.922078] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-22T19:19:03.247811] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T19:19:03.311739] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T19:19:03.433218] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-22T19:19:03.722060] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-22T19:19:04.471514] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T19:19:04.522022] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-22T19:19:05.322064] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-22T19:19:05.363959] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T19:19:06.122076] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-22T19:19:06.922096] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-22T19:19:07.051988] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T19:19:07.496280] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-22T19:19:07.504775] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-22T19:19:07.504899] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-22T19:19:07.727229] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-22T19:19:07.908424] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-22T19:19:07.908514] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-22T19:19:07.909474] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-22T19:19:07.909541] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-22T19:19:07.912449] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 53668 (keeping 200 days of data) [2025-09-22T19:19:08.039417] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T19:19:08.297478] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-09-22T19:19:08.297676] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-22T19:19:08.297823] [INFO ] [MAIN ] Update Progress: 1049/2372 symbols completed. HPQ took 30.6s. Estimated remaining: 2h 55m 24s. Rate: 7.5 symbols/min [2025-09-22T19:19:08.475369] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:19:08.534109] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-22T19:19:08.539573] [DEBUG] [LOCAL ] HR: Loaded 52730 existing records from primary storage. [2025-09-22T19:19:08.539765] [INFO ] [MAIN ] HR: Loaded 52730 existing records. [2025-09-22T19:19:08.716692] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T19:19:08.767693] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:19:08.768061] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-22T19:19:08.768120] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-22T19:19:08.770990] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-22T19:19:08.771055] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-22T19:19:09.161474] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:19:09.322088] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-22T19:19:09.340368] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T19:19:10.122077] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-22T19:19:10.927143] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-22T19:19:10.945367] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T19:19:11.197285] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T19:19:11.199747] [INFO ] [REMOTE ] HPS: Full fetch complete (15198 records). [2025-09-22T19:19:11.199819] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-22T19:19:11.595048] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-22T19:19:11.595136] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-22T19:19:11.595525] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-22T19:19:11.595566] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-22T19:19:11.596188] [DEBUG] [LOCAL ] HPS: Trimmed 15198 records to 10262 (keeping 200 days of data) [2025-09-22T19:19:11.668171] [DEBUG] [LOCAL ] HPS: Primary data saved (10262 records). [2025-09-22T19:19:11.668324] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-22T19:19:11.668416] [INFO ] [MAIN ] Update Progress: 1050/2372 symbols completed. HPS took 21.3s. Estimated remaining: 2h 55m 10s. Rate: 7.5 symbols/min [2025-09-22T19:19:11.729555] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-22T19:19:11.863112] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:19:11.936148] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T19:19:11.937168] [DEBUG] [LOCAL ] HRB: Loaded 49332 existing records from primary storage. [2025-09-22T19:19:11.937369] [INFO ] [MAIN ] HRB: Loaded 49332 existing records. [2025-09-22T19:19:12.124059] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:19:12.124312] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-22T19:19:12.124381] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-22T19:19:12.125976] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-22T19:19:12.126038] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-22T19:19:12.485364] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:19:12.522004] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-22T19:19:13.322065] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-22T19:19:13.442864] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T19:19:14.122074] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-22T19:19:14.155359] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T19:19:14.271839] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T19:19:14.922108] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-22T19:19:15.721338] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T19:19:15.730384] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-22T19:19:16.480053] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T19:19:16.522103] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-22T19:19:16.866320] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-22T19:19:17.322076] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-22T19:19:18.122069] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-22T19:19:18.922076] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-22T19:19:19.152752] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-22T19:19:19.480170] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T19:19:19.722028] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-22T19:19:19.759991] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-22T19:19:20.522097] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-22T19:19:20.693713] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T19:19:21.015331] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-22T19:19:21.322037] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-22T19:19:22.122011] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-22T19:19:22.238307] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T19:19:22.296953] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T19:19:22.922016] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-22T19:19:23.118399] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T19:19:23.722103] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-22T19:19:24.522046] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-22T19:19:24.589183] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T19:19:24.934483] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T19:19:25.322022] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-22T19:19:25.376665] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-22T19:19:26.122058] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-22T19:19:26.842184] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T19:19:26.868539] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:19:26.922112] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-22T19:19:27.722132] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-22T19:19:28.365090] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T19:19:28.522070] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-22T19:19:29.322085] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-22T19:19:29.384067] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T19:19:30.122056] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-22T19:19:30.281481] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T19:19:30.341210] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T19:19:30.922050] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-22T19:19:30.953325] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T19:19:30.956475] [INFO ] [REMOTE ] HQL: Full fetch complete (24099 records). [2025-09-22T19:19:30.956555] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-22T19:19:31.367179] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-22T19:19:31.367282] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-22T19:19:31.367901] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-22T19:19:31.367966] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-22T19:19:31.368733] [DEBUG] [LOCAL ] HQL: Trimmed 24099 records to 15995 (keeping 200 days of data) [2025-09-22T19:19:31.475373] [DEBUG] [LOCAL ] HQL: Primary data saved (15995 records). [2025-09-22T19:19:31.475524] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-22T19:19:31.475611] [INFO ] [MAIN ] Update Progress: 1051/2372 symbols completed. HQL took 32.7s. Estimated remaining: 2h 55m 17s. Rate: 7.5 symbols/min [2025-09-22T19:19:31.660858] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:19:31.661026] [DEBUG] [LOCAL ] HRI: No existing data file found in primary storage. [2025-09-22T19:19:31.661080] [WARN ] [MAIN ] HRI: No existing data found, performing full refresh instead. [2025-09-22T19:19:31.661222] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-22T19:19:31.661282] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-22T19:19:31.661350] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-09-22T19:19:31.661386] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-22T19:19:31.729523] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-22T19:19:32.058262] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:19:32.073946] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T19:19:32.522082] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-22T19:19:33.322052] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-22T19:19:33.406069] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T19:19:33.889239] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T19:19:34.122107] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-22T19:19:34.479375] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T19:19:34.483277] [INFO ] [REMOTE ] HQH: Full fetch complete (37295 records). [2025-09-22T19:19:34.483355] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-22T19:19:34.861094] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-22T19:19:34.861216] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-22T19:19:34.861935] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-22T19:19:34.862024] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-22T19:19:34.862970] [DEBUG] [LOCAL ] HQH: Trimmed 37295 records to 24877 (keeping 200 days of data) [2025-09-22T19:19:34.929030] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-22T19:19:35.024502] [DEBUG] [LOCAL ] HQH: Primary data saved (24877 records). [2025-09-22T19:19:35.024616] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-22T19:19:35.024754] [INFO ] [MAIN ] Update Progress: 1052/2372 symbols completed. HQH took 42.9s. Estimated remaining: 2h 55m 4s. Rate: 7.5 symbols/min [2025-09-22T19:19:35.194329] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:19:35.251372] [DEBUG] [LOCAL ] HRL: Loaded 53857 existing records from primary storage. [2025-09-22T19:19:35.251541] [INFO ] [MAIN ] HRL: Loaded 53857 existing records. [2025-09-22T19:19:35.429938] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:19:35.430157] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-22T19:19:35.430205] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-22T19:19:35.431603] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-22T19:19:35.431686] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-22T19:19:35.727128] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-22T19:19:35.787480] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:19:35.925147] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T19:19:36.456030] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T19:19:36.522027] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-22T19:19:36.775938] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T19:19:37.322062] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-22T19:19:38.122071] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-22T19:19:38.922079] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-22T19:19:39.492588] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (2.97 seconds). [2025-09-22T19:19:39.667182] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-22T19:19:39.675376] [INFO ] [REMOTE ] HR: Full fetch complete (74803 records). [2025-09-22T19:19:39.675509] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-22T19:19:39.739749] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-22T19:19:40.084778] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-22T19:19:40.084977] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-22T19:19:40.086077] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-22T19:19:40.086233] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-22T19:19:40.096681] [DEBUG] [LOCAL ] HR: Trimmed 74803 records to 51967 (keeping 200 days of data) [2025-09-22T19:19:40.103938] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-22T19:19:40.430915] [DEBUG] [LOCAL ] HR: Primary data saved (51967 records). [2025-09-22T19:19:40.431059] [INFO ] [MAIN ] HR: Full history saved. [2025-09-22T19:19:40.431152] [INFO ] [MAIN ] Update Progress: 1053/2372 symbols completed. HR took 32.1s. Estimated remaining: 2h 54m 53s. Rate: 7.5 symbols/min [2025-09-22T19:19:40.530328] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-22T19:19:40.603259] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:19:40.639806] [DEBUG] [LOCAL ] HRTG: Loaded 32937 existing records from primary storage. [2025-09-22T19:19:40.639961] [INFO ] [MAIN ] HRTG: Loaded 32937 existing records. [2025-09-22T19:19:40.822236] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:19:40.822704] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-22T19:19:40.822772] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-22T19:19:40.823735] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-22T19:19:40.823796] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-22T19:19:41.037093] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-22T19:19:41.229958] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:19:41.281443] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T19:19:41.289481] [INFO ] [REMOTE ] HRB: Full fetch complete (69806 records). [2025-09-22T19:19:41.289614] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-22T19:19:41.327112] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-22T19:19:41.696269] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-22T19:19:41.696413] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-22T19:19:41.697346] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-22T19:19:41.697430] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-22T19:19:41.699275] [DEBUG] [LOCAL ] HRB: Trimmed 69806 records to 48621 (keeping 200 days of data) [2025-09-22T19:19:41.814395] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T19:19:42.035980] [DEBUG] [LOCAL ] HRB: Primary data saved (48621 records). [2025-09-22T19:19:42.036120] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-22T19:19:42.036209] [INFO ] [MAIN ] Update Progress: 1054/2372 symbols completed. HRB took 30.4s. Estimated remaining: 2h 54m 37s. Rate: 7.5 symbols/min [2025-09-22T19:19:42.127115] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-22T19:19:42.211795] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:19:42.263216] [DEBUG] [LOCAL ] HSBC: Loaded 51975 existing records from primary storage. [2025-09-22T19:19:42.263371] [INFO ] [MAIN ] HSBC: Loaded 51975 existing records. [2025-09-22T19:19:42.446448] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:19:42.446743] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-22T19:19:42.446798] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-22T19:19:42.448094] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-22T19:19:42.448154] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-22T19:19:42.817689] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:19:42.922021] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-22T19:19:43.217918] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T19:19:43.481442] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-22T19:19:43.722043] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-22T19:19:44.127155] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T19:19:44.522058] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-22T19:19:45.322020] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-22T19:19:45.363075] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T19:19:46.099245] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T19:19:46.122018] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-22T19:19:46.201171] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T19:19:46.922070] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-22T19:19:47.621694] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T19:19:47.722034] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-22T19:19:47.903773] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-22T19:19:48.522062] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-22T19:19:49.207918] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T19:19:49.322065] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-22T19:19:50.122077] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-22T19:19:50.311315] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T19:19:50.670226] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T19:19:50.922049] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-22T19:19:51.152679] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T19:19:51.722057] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-22T19:19:52.522062] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-22T19:19:52.924921] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T19:19:53.056714] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T19:19:53.322073] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-22T19:19:53.645630] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T19:19:54.122103] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-22T19:19:54.600191] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T19:19:54.922055] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-22T19:19:55.190735] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T19:19:55.722063] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-22T19:19:56.284179] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T19:19:56.522087] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-22T19:19:57.322051] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-22T19:19:57.626409] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T19:19:57.809780] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T19:19:57.814865] [INFO ] [REMOTE ] HRI: Full fetch complete (45816 records). [2025-09-22T19:19:57.814985] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-22T19:19:58.127137] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-22T19:19:58.200353] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-22T19:19:58.200433] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-22T19:19:58.201298] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-22T19:19:58.201363] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-22T19:19:58.202415] [DEBUG] [LOCAL ] HRI: Trimmed 45816 records to 33152 (keeping 200 days of data) [2025-09-22T19:19:58.417008] [DEBUG] [LOCAL ] HRI: Primary data saved (33152 records). [2025-09-22T19:19:58.417191] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-22T19:19:58.417288] [INFO ] [MAIN ] Update Progress: 1055/2372 symbols completed. HRI took 26.9s. Estimated remaining: 2h 54m 39s. Rate: 7.5 symbols/min [2025-09-22T19:19:58.623306] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:19:58.640924] [DEBUG] [LOCAL ] HSHP: Loaded 16012 existing records from primary storage. [2025-09-22T19:19:58.641081] [INFO ] [MAIN ] HSHP: Loaded 16012 existing records. [2025-09-22T19:19:58.833146] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:19:58.833449] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-22T19:19:58.833507] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-22T19:19:58.834293] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-22T19:19:58.834353] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-22T19:19:58.931463] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-22T19:19:59.230267] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:19:59.302521] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-22T19:19:59.477823] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T19:19:59.722034] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-22T19:20:00.522016] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-22T19:20:00.576707] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T19:20:00.876416] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T19:20:01.322065] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-22T19:20:02.122247] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-22T19:20:02.481119] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T19:20:02.922141] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-22T19:20:03.079510] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T19:20:03.085634] [INFO ] [REMOTE ] HRTG: Full fetch complete (41972 records). [2025-09-22T19:20:03.085831] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-22T19:20:03.283766] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T19:20:03.481877] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-22T19:20:03.481962] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-22T19:20:03.482696] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-22T19:20:03.482760] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-22T19:20:03.483750] [DEBUG] [LOCAL ] HRTG: Trimmed 41972 records to 32764 (keeping 200 days of data) [2025-09-22T19:20:03.683537] [DEBUG] [LOCAL ] HRTG: Primary data saved (32764 records). [2025-09-22T19:20:03.683795] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-22T19:20:03.683907] [INFO ] [MAIN ] Update Progress: 1056/2372 symbols completed. HRTG took 23.3s. Estimated remaining: 2h 54m 28s. Rate: 7.5 symbols/min [2025-09-22T19:20:03.728430] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-22T19:20:03.862348] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:20:03.916969] [DEBUG] [LOCAL ] HSY: Loaded 51230 existing records from primary storage. [2025-09-22T19:20:03.917128] [INFO ] [MAIN ] HSY: Loaded 51230 existing records. [2025-09-22T19:20:04.101479] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:20:04.101811] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-22T19:20:04.101870] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-22T19:20:04.103218] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-22T19:20:04.103281] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-22T19:20:04.469819] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:20:04.522038] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-22T19:20:05.292006] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-22T19:20:05.322005] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-22T19:20:05.556934] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T19:20:06.122105] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-22T19:20:06.399974] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T19:20:06.922027] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-22T19:20:07.162226] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T19:20:07.349433] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-22T19:20:07.722068] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-22T19:20:08.522048] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-22T19:20:08.589800] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T19:20:09.098478] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T19:20:09.322067] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-22T19:20:09.538998] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-22T19:20:10.122092] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-22T19:20:10.922035] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-22T19:20:11.142475] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T19:20:11.572790] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T19:20:11.722061] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-22T19:20:12.522053] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-22T19:20:12.954115] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-22T19:20:13.322029] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-22T19:20:13.493950] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T19:20:13.593848] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-22T19:20:14.122078] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-22T19:20:14.840748] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T19:20:14.922060] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-22T19:20:15.059056] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T19:20:15.722136] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-22T19:20:16.522041] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-22T19:20:16.713349] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T19:20:16.724635] [INFO ] [REMOTE ] HRL: Full fetch complete (76687 records). [2025-09-22T19:20:16.724815] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-22T19:20:17.146541] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-22T19:20:17.146739] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-22T19:20:17.147723] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-22T19:20:17.147790] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-22T19:20:17.151974] [DEBUG] [LOCAL ] HRL: Trimmed 76687 records to 53077 (keeping 200 days of data) [2025-09-22T19:20:17.330015] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-22T19:20:17.489959] [DEBUG] [LOCAL ] HRL: Primary data saved (53077 records). [2025-09-22T19:20:17.490140] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-22T19:20:17.490238] [INFO ] [MAIN ] Update Progress: 1057/2372 symbols completed. HRL took 42.5s. Estimated remaining: 2h 54m 27s. Rate: 7.5 symbols/min [2025-09-22T19:20:17.666681] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:20:17.666974] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-22T19:20:17.667088] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-22T19:20:17.667369] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-22T19:20:17.667549] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-22T19:20:17.667682] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-22T19:20:17.667747] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-22T19:20:17.796392] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-22T19:20:18.065763] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:20:18.122004] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-22T19:20:18.305209] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:20:18.305531] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-22T19:20:18.325665] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T19:20:18.922075] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-22T19:20:19.722076] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-22T19:20:20.335069] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (3.81 seconds). [2025-09-22T19:20:20.342508] [INFO ] [REMOTE ] HSBC: Full fetch complete (73208 records). [2025-09-22T19:20:20.342667] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-22T19:20:20.343630] [FATAL] [VALIDATOR ] HSBC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T19:20:20.343742] [FATAL] [MAIN ] HSBC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:20:20.343786] [WARN ] [MAIN ] HSBC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:20:20.343826] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-22T19:20:20.343884] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-09-22T19:20:20.343919] [INFO ] [LOCAL ] HSBC: Starting deletion of derivative data. [2025-09-22T19:20:20.344385] [DEBUG] [LOCAL ] HSBC: Deleted derivative data file. [2025-09-22T19:20:20.344484] [INFO ] [MAIN ] Update Progress: 1058/2372 symbols completed. HSBC took 38.3s. Estimated remaining: 2h 54m 13s. Rate: 7.5 symbols/min [2025-09-22T19:20:20.514417] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:20:20.522848] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-22T19:20:20.530115] [DEBUG] [LOCAL ] HTD: Loaded 13659 existing records from primary storage. [2025-09-22T19:20:20.530294] [INFO ] [MAIN ] HTD: Loaded 13659 existing records. [2025-09-22T19:20:20.715515] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:20:20.725876] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T19:20:20.725963] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-22T19:20:20.730151] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-22T19:20:20.731398] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-22T19:20:20.731537] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-22T19:20:20.765024] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:20:20.802607] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-22T19:20:21.118666] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:20:21.168185] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-22T19:20:21.322078] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-22T19:20:21.626085] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-22T19:20:22.122065] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-22T19:20:22.922070] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-22T19:20:23.005852] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T19:20:23.539883] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T19:20:23.722076] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-22T19:20:24.522100] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-22T19:20:24.763972] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T19:20:24.767051] [INFO ] [REMOTE ] HSHP: Full fetch complete (23548 records). [2025-09-22T19:20:24.767131] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-22T19:20:25.134624] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-22T19:20:25.134732] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-22T19:20:25.135266] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-22T19:20:25.135330] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-22T19:20:25.136009] [DEBUG] [LOCAL ] HSHP: Trimmed 23548 records to 15572 (keeping 200 days of data) [2025-09-22T19:20:25.225126] [DEBUG] [LOCAL ] HSHP: Primary data saved (15572 records). [2025-09-22T19:20:25.225286] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-22T19:20:25.225388] [INFO ] [MAIN ] Update Progress: 1059/2372 symbols completed. HSHP took 26.8s. Estimated remaining: 2h 54m 1s. Rate: 7.5 symbols/min [2025-09-22T19:20:25.327175] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-22T19:20:25.403471] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:20:25.403713] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-22T19:20:25.403780] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-22T19:20:25.403946] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-22T19:20:25.404002] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-22T19:20:25.404076] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-22T19:20:25.404150] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-22T19:20:25.766139] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:20:26.122216] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-22T19:20:26.125557] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-22T19:20:26.361148] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T19:20:26.480512] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-22T19:20:26.922063] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-22T19:20:27.537521] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T19:20:27.722120] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-22T19:20:28.018692] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-22T19:20:28.522127] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-22T19:20:29.322083] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-22T19:20:29.362050] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T19:20:29.617482] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-22T19:20:30.122102] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-22T19:20:30.456913] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-22T19:20:30.922090] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-22T19:20:31.722076] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-22T19:20:31.838120] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-22T19:20:32.522058] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-22T19:20:33.322068] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-22T19:20:33.418263] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-22T19:20:33.524392] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T19:20:33.737718] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-22T19:20:34.122099] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-22T19:20:34.741025] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T19:20:34.922061] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-22T19:20:35.722066] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-22T19:20:35.755970] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T19:20:36.522051] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-22T19:20:36.837348] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-22T19:20:37.322054] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-22T19:20:37.561731] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T19:20:37.647876] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-22T19:20:38.122073] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-22T19:20:38.595512] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T19:20:38.922059] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-22T19:20:39.172469] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-22T19:20:39.722069] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-22T19:20:40.522053] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-22T19:20:41.261218] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-22T19:20:41.327511] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-22T19:20:41.347239] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T19:20:42.122021] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-22T19:20:42.155514] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T19:20:42.827322] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T19:20:42.922045] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-22T19:20:43.442071] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-22T19:20:43.722062] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-22T19:20:44.522076] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-22T19:20:44.559244] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T19:20:45.322070] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-22T19:20:46.086288] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T19:20:46.089140] [INFO ] [REMOTE ] HTD: Full fetch complete (18810 records). [2025-09-22T19:20:46.089238] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-22T19:20:46.127191] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-22T19:20:46.426215] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-22T19:20:46.520235] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-22T19:20:46.520350] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-22T19:20:46.521292] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-22T19:20:46.521436] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-22T19:20:46.550846] [DEBUG] [LOCAL ] HTD: Trimmed 18810 records to 13500 (keeping 200 days of data) [2025-09-22T19:20:46.553937] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T19:20:46.651718] [DEBUG] [LOCAL ] HTD: Primary data saved (13500 records). [2025-09-22T19:20:46.651910] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-22T19:20:46.652063] [INFO ] [MAIN ] Update Progress: 1060/2372 symbols completed. HTD took 26.3s. Estimated remaining: 2h 54m 10s. Rate: 7.5 symbols/min [2025-09-22T19:20:46.852582] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:20:46.906891] [DEBUG] [LOCAL ] HTGC: Loaded 48422 existing records from primary storage. [2025-09-22T19:20:46.907067] [INFO ] [MAIN ] HTGC: Loaded 48422 existing records. [2025-09-22T19:20:46.927971] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-22T19:20:47.119520] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:20:47.119880] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-22T19:20:47.119975] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-22T19:20:47.122001] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-22T19:20:47.122062] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-22T19:20:47.481804] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:20:47.717193] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-22T19:20:47.722068] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-22T19:20:48.522071] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-22T19:20:48.600553] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T19:20:48.602679] [INFO ] [REMOTE ] HTB: Full fetch complete (7417 records). [2025-09-22T19:20:48.602750] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-22T19:20:48.811929] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 142 unique days, need 200 days [2025-09-22T19:20:48.812222] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:20:48.812306] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:20:48.812373] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-22T19:20:48.812461] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-22T19:20:48.812505] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-22T19:20:48.812548] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-22T19:20:48.812635] [INFO ] [MAIN ] Update Progress: 1061/2372 symbols completed. HTB took 31.3s. Estimated remaining: 2h 53m 55s. Rate: 7.5 symbols/min [2025-09-22T19:20:48.927675] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-22T19:20:48.937671] [INFO ] [REMOTE ] HTFC: Full fetch complete (861 records). [2025-09-22T19:20:48.940463] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-22T19:20:48.941219] [FATAL] [VALIDATOR ] HTFC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T19:20:48.941726] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:20:48.947301] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:20:48.957755] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-22T19:20:48.957950] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-22T19:20:48.963261] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-22T19:20:48.988315] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-22T19:20:49.017431] [INFO ] [MAIN ] Update Progress: 1062/2372 symbols completed. HTFC took 23.8s. Estimated remaining: 2h 53m 37s. Rate: 7.5 symbols/min [2025-09-22T19:20:49.017203] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:20:49.201905] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:20:49.216451] [DEBUG] [LOCAL ] HTH: Loaded 33269 existing records from primary storage. [2025-09-22T19:20:49.216830] [INFO ] [MAIN ] HTH: Loaded 33269 existing records. [2025-09-22T19:20:49.327195] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-22T19:20:49.413752] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:20:49.414009] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-22T19:20:49.414065] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-22T19:20:49.415563] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-22T19:20:49.415710] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-22T19:20:49.532638] [DEBUG] [LOCAL ] HUBB: Loaded 38022 existing records from primary storage. [2025-09-22T19:20:49.538582] [INFO ] [MAIN ] HUBB: Loaded 38022 existing records. [2025-09-22T19:20:49.940040] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:20:49.971739] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-22T19:20:49.983408] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-22T19:20:50.005278] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:20:50.006463] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-22T19:20:50.006674] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-22T19:20:50.127245] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-22T19:20:50.375316] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:20:50.922064] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-22T19:20:51.364903] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-22T19:20:51.374755] [INFO ] [REMOTE ] HSY: Full fetch complete (73852 records). [2025-09-22T19:20:51.374943] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-22T19:20:51.724138] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-22T19:20:51.790750] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-22T19:20:51.790867] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-22T19:20:51.793588] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-22T19:20:51.793783] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-22T19:20:51.797065] [DEBUG] [LOCAL ] HSY: Trimmed 73852 records to 50458 (keeping 200 days of data) [2025-09-22T19:20:51.929284] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T19:20:52.112131] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T19:20:52.191847] [DEBUG] [LOCAL ] HSY: Primary data saved (50458 records). [2025-09-22T19:20:52.191992] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-22T19:20:52.192146] [INFO ] [MAIN ] Update Progress: 1063/2372 symbols completed. HSY took 48.5s. Estimated remaining: 2h 53m 24s. Rate: 7.5 symbols/min [2025-09-22T19:20:52.364268] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:20:52.408637] [DEBUG] [LOCAL ] HUBS: Loaded 40384 existing records from primary storage. [2025-09-22T19:20:52.408827] [INFO ] [MAIN ] HUBS: Loaded 40384 existing records. [2025-09-22T19:20:52.527246] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-22T19:20:52.610341] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:20:52.610695] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-22T19:20:52.610763] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-22T19:20:52.611869] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-22T19:20:52.611955] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-22T19:20:52.977409] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:20:52.995232] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T19:20:53.322047] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-22T19:20:54.041929] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T19:20:54.122002] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-22T19:20:54.782109] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T19:20:54.922062] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-22T19:20:55.722120] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-22T19:20:56.361001] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T19:20:56.393954] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-22T19:20:56.522053] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-22T19:20:56.873990] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T19:20:57.322007] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-22T19:20:57.875318] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T19:20:58.122015] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-22T19:20:58.586019] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T19:20:58.922114] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-22T19:20:59.530521] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T19:20:59.722119] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-22T19:21:00.451783] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T19:21:00.522018] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-22T19:21:01.322041] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-22T19:21:02.181222] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-22T19:21:02.202876] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-22T19:21:02.534578] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T19:21:02.922085] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-22T19:21:03.722129] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-22T19:21:04.065827] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-09-22T19:21:04.522137] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-22T19:21:04.826698] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-22T19:21:05.243121] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-22T19:21:05.322055] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-22T19:21:05.534007] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T19:21:06.001932] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T19:21:06.122088] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-22T19:21:06.904754] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T19:21:06.922007] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-22T19:21:07.722091] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-22T19:21:07.899795] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T19:21:08.304335] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T19:21:08.522052] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-22T19:21:08.575249] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T19:21:09.322069] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-22T19:21:10.078993] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T19:21:10.122073] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-22T19:21:10.927282] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-22T19:21:10.938509] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T19:21:11.722035] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-22T19:21:11.762221] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T19:21:11.974388] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T19:21:11.985263] [INFO ] [REMOTE ] HUBB: Full fetch complete (53471 records). [2025-09-22T19:21:11.985422] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-22T19:21:12.373043] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-22T19:21:12.373124] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-22T19:21:12.373962] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-22T19:21:12.374027] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-22T19:21:12.375249] [DEBUG] [LOCAL ] HUBB: Trimmed 53471 records to 37308 (keeping 200 days of data) [2025-09-22T19:21:12.558253] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-22T19:21:12.622770] [DEBUG] [LOCAL ] HUBB: Primary data saved (37308 records). [2025-09-22T19:21:12.622910] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-22T19:21:12.623013] [INFO ] [MAIN ] Update Progress: 1064/2372 symbols completed. HUBB took 23.6s. Estimated remaining: 2h 53m 31s. Rate: 7.5 symbols/min [2025-09-22T19:21:12.804420] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:21:12.856805] [DEBUG] [LOCAL ] HUM: Loaded 49586 existing records from primary storage. [2025-09-22T19:21:12.856947] [INFO ] [MAIN ] HUM: Loaded 49586 existing records. [2025-09-22T19:21:13.062472] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:21:13.064391] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T19:21:13.063527] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-22T19:21:13.071630] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-22T19:21:13.073634] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-22T19:21:13.073728] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-22T19:21:13.329241] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-22T19:21:13.436268] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:21:14.122092] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-22T19:21:14.202953] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T19:21:14.922182] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-22T19:21:15.722080] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-22T19:21:15.824213] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-22T19:21:16.285974] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-22T19:21:16.522110] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-22T19:21:17.322078] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-22T19:21:17.354455] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T19:21:17.403434] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-22T19:21:17.552073] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T19:21:18.122119] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-22T19:21:18.922084] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-22T19:21:19.367614] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T19:21:19.415319] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-22T19:21:19.722113] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-22T19:21:20.490705] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T19:21:20.522005] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-22T19:21:21.123890] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T19:21:21.322057] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-22T19:21:22.011509] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T19:21:22.122101] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-22T19:21:22.922116] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-22T19:21:23.078275] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T19:21:23.084744] [INFO ] [REMOTE ] HUBS: Full fetch complete (55510 records). [2025-09-22T19:21:23.084902] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-22T19:21:23.520933] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-22T19:21:23.521202] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-22T19:21:23.522072] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-22T19:21:23.522247] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-22T19:21:23.523868] [DEBUG] [LOCAL ] HUBS: Trimmed 55510 records to 39661 (keeping 200 days of data) [2025-09-22T19:21:23.645259] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T19:21:23.741732] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-22T19:21:23.813493] [DEBUG] [LOCAL ] HUBS: Primary data saved (39661 records). [2025-09-22T19:21:23.813678] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-22T19:21:23.813789] [INFO ] [MAIN ] Update Progress: 1065/2372 symbols completed. HUBS took 31.6s. Estimated remaining: 2h 53m 27s. Rate: 7.5 symbols/min [2025-09-22T19:21:23.991396] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:21:24.047615] [DEBUG] [LOCAL ] HUN: Loaded 53978 existing records from primary storage. [2025-09-22T19:21:24.047822] [INFO ] [MAIN ] HUN: Loaded 53978 existing records. [2025-09-22T19:21:24.231003] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:21:24.231258] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-22T19:21:24.231304] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-22T19:21:24.232808] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-22T19:21:24.232870] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-22T19:21:24.529149] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-22T19:21:24.603275] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:21:24.628424] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T19:21:25.322160] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-22T19:21:25.838108] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-22T19:21:26.122145] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-22T19:21:26.295074] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T19:21:26.304090] [INFO ] [REMOTE ] HTGC: Full fetch complete (68089 records). [2025-09-22T19:21:26.304348] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-22T19:21:26.691274] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-22T19:21:26.691359] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-22T19:21:26.692299] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-22T19:21:26.692385] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-22T19:21:26.696497] [DEBUG] [LOCAL ] HTGC: Trimmed 68089 records to 47623 (keeping 200 days of data) [2025-09-22T19:21:26.932807] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-22T19:21:27.022751] [DEBUG] [LOCAL ] HTGC: Primary data saved (47623 records). [2025-09-22T19:21:27.022910] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-22T19:21:27.023023] [INFO ] [MAIN ] Update Progress: 1066/2372 symbols completed. HTGC took 40.4s. Estimated remaining: 2h 53m 13s. Rate: 7.5 symbols/min [2025-09-22T19:21:27.198240] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:21:27.228211] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T19:21:27.279997] [DEBUG] [LOCAL ] HUYA: Loaded 45033 existing records from primary storage. [2025-09-22T19:21:27.280164] [INFO ] [MAIN ] HUYA: Loaded 45033 existing records. [2025-09-22T19:21:27.455546] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:21:27.455811] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-22T19:21:27.455874] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-22T19:21:27.456888] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-22T19:21:27.456948] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-22T19:21:27.733130] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-22T19:21:27.817565] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:21:27.911216] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T19:21:27.916425] [INFO ] [REMOTE ] HTH: Full fetch complete (46486 records). [2025-09-22T19:21:27.916514] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-22T19:21:28.315457] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-22T19:21:28.315572] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-22T19:21:28.316565] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-22T19:21:28.316658] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-22T19:21:28.317938] [DEBUG] [LOCAL ] HTH: Trimmed 46486 records to 32579 (keeping 200 days of data) [2025-09-22T19:21:28.522538] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-22T19:21:28.531451] [DEBUG] [LOCAL ] HTH: Primary data saved (32579 records). [2025-09-22T19:21:28.531608] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-22T19:21:28.531755] [INFO ] [MAIN ] Update Progress: 1067/2372 symbols completed. HTH took 39.7s. Estimated remaining: 2h 52m 57s. Rate: 7.5 symbols/min [2025-09-22T19:21:28.735094] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:21:28.753301] [DEBUG] [LOCAL ] HVT: Loaded 16524 existing records from primary storage. [2025-09-22T19:21:28.753434] [INFO ] [MAIN ] HVT: Loaded 16524 existing records. [2025-09-22T19:21:28.927741] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:21:28.927997] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-22T19:21:28.928046] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-22T19:21:28.928507] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-22T19:21:28.928568] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-22T19:21:29.296422] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:21:29.322005] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-22T19:21:29.825580] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-22T19:21:29.935585] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-22T19:21:29.966509] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T19:21:30.012748] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T19:21:30.122109] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-22T19:21:30.922081] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-22T19:21:31.722021] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-22T19:21:31.909456] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T19:21:32.446604] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T19:21:32.481725] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T19:21:32.522011] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-22T19:21:33.322062] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-22T19:21:34.071905] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T19:21:34.122014] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-22T19:21:34.922067] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-22T19:21:35.024781] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T19:21:35.384917] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T19:21:35.722056] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-22T19:21:36.522030] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-22T19:21:36.886979] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T19:21:37.322061] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-22T19:21:37.428342] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T19:21:37.485356] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T19:21:38.122064] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-22T19:21:38.653005] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T19:21:38.922067] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-22T19:21:39.722083] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-22T19:21:39.801194] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T19:21:39.926286] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T19:21:40.522065] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-22T19:21:41.304744] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T19:21:41.322010] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-22T19:21:42.122119] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-22T19:21:42.615534] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-22T19:21:42.623885] [INFO ] [REMOTE ] HUM: Full fetch complete (70967 records). [2025-09-22T19:21:42.624043] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-22T19:21:42.924614] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-22T19:21:43.041183] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-22T19:21:43.041359] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-22T19:21:43.042567] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-22T19:21:43.042726] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-22T19:21:43.044322] [DEBUG] [LOCAL ] HUM: Trimmed 70967 records to 48899 (keeping 200 days of data) [2025-09-22T19:21:43.160663] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T19:21:43.218328] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T19:21:43.407559] [DEBUG] [LOCAL ] HUM: Primary data saved (48899 records). [2025-09-22T19:21:43.407726] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-22T19:21:43.407822] [INFO ] [MAIN ] Update Progress: 1068/2372 symbols completed. HUM took 30.8s. Estimated remaining: 2h 52m 58s. Rate: 7.5 symbols/min [2025-09-22T19:21:43.576614] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:21:43.630357] [DEBUG] [LOCAL ] HWM: Loaded 53803 existing records from primary storage. [2025-09-22T19:21:43.630502] [INFO ] [MAIN ] HWM: Loaded 53803 existing records. [2025-09-22T19:21:43.731184] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-22T19:21:43.815626] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:21:43.815904] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-22T19:21:43.815964] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-22T19:21:43.817274] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-22T19:21:43.817334] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-22T19:21:44.180488] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:21:44.522022] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-22T19:21:44.804752] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T19:21:44.954915] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-22T19:21:45.322051] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-22T19:21:45.878138] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T19:21:46.122066] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-22T19:21:46.301904] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T19:21:46.922118] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-22T19:21:47.722130] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-22T19:21:47.820669] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T19:21:48.481979] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T19:21:48.522037] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-22T19:21:49.332460] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-22T19:21:49.338441] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T19:21:50.122021] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-22T19:21:50.180120] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-22T19:21:50.264087] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T19:21:50.922054] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-22T19:21:51.722051] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-22T19:21:51.944521] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T19:21:51.964794] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T19:21:52.522076] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-22T19:21:53.322122] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-22T19:21:53.430381] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T19:21:53.433340] [INFO ] [REMOTE ] HVT: Full fetch complete (23783 records). [2025-09-22T19:21:53.433419] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-22T19:21:53.865106] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-22T19:21:53.890174] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-22T19:21:53.890464] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-22T19:21:53.891106] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-22T19:21:53.891676] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-22T19:21:53.892670] [DEBUG] [LOCAL ] HVT: Trimmed 23783 records to 16157 (keeping 200 days of data) [2025-09-22T19:21:53.993423] [DEBUG] [LOCAL ] HVT: Primary data saved (16157 records). [2025-09-22T19:21:53.993601] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-22T19:21:53.993720] [INFO ] [MAIN ] Update Progress: 1069/2372 symbols completed. HVT took 25.5s. Estimated remaining: 2h 52m 53s. Rate: 7.5 symbols/min [2025-09-22T19:21:54.136424] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-22T19:21:54.168746] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:21:54.213576] [DEBUG] [LOCAL ] HXL: Loaded 46858 existing records from primary storage. [2025-09-22T19:21:54.213755] [INFO ] [MAIN ] HXL: Loaded 46858 existing records. [2025-09-22T19:21:54.395846] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:21:54.396136] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-22T19:21:54.396184] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-22T19:21:54.397169] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-22T19:21:54.397230] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-22T19:21:54.801460] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:21:54.901315] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T19:21:54.922019] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-22T19:21:55.722019] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-22T19:21:55.939846] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T19:21:56.522155] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-22T19:21:56.633031] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T19:21:56.641072] [INFO ] [REMOTE ] HUYA: Full fetch complete (63833 records). [2025-09-22T19:21:56.641206] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-22T19:21:57.025507] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-22T19:21:57.025607] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-22T19:21:57.026499] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-22T19:21:57.026677] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-22T19:21:57.028593] [DEBUG] [LOCAL ] HUYA: Trimmed 63833 records to 44445 (keeping 200 days of data) [2025-09-22T19:21:57.263512] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T19:21:57.322573] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-22T19:21:57.331041] [DEBUG] [LOCAL ] HUYA: Primary data saved (44445 records). [2025-09-22T19:21:57.331126] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-22T19:21:57.331204] [INFO ] [MAIN ] Update Progress: 1070/2372 symbols completed. HUYA took 30.3s. Estimated remaining: 2h 52m 39s. Rate: 7.5 symbols/min [2025-09-22T19:21:57.508484] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:21:57.520284] [DEBUG] [LOCAL ] HY: Loaded 10589 existing records from primary storage. [2025-09-22T19:21:57.520393] [INFO ] [MAIN ] HY: Loaded 10589 existing records. [2025-09-22T19:21:57.699341] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:21:57.699592] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-22T19:21:57.699680] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-22T19:21:57.700149] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-22T19:21:57.700208] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-22T19:21:58.054428] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:21:58.087469] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T19:21:58.122000] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-22T19:21:58.922038] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-22T19:21:59.162047] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T19:21:59.170347] [INFO ] [REMOTE ] HUN: Full fetch complete (76594 records). [2025-09-22T19:21:59.170485] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-22T19:21:59.594273] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-22T19:21:59.594389] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-22T19:21:59.595399] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-22T19:21:59.595470] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-22T19:21:59.597148] [DEBUG] [LOCAL ] HUN: Trimmed 76594 records to 53203 (keeping 200 days of data) [2025-09-22T19:21:59.722605] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-22T19:21:59.859842] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T19:21:59.979359] [DEBUG] [LOCAL ] HUN: Primary data saved (53203 records). [2025-09-22T19:21:59.979521] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-22T19:21:59.979610] [INFO ] [MAIN ] Update Progress: 1071/2372 symbols completed. HUN took 36.2s. Estimated remaining: 2h 52m 25s. Rate: 7.5 symbols/min [2025-09-22T19:22:00.155714] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:22:00.155935] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-22T19:22:00.155994] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-22T19:22:00.156145] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-22T19:22:00.156191] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-22T19:22:00.156236] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-22T19:22:00.156271] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-22T19:22:00.519091] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:22:00.521998] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-22T19:22:00.626332] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T19:22:00.637207] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-22T19:22:00.786377] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-22T19:22:01.322037] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-22T19:22:02.122092] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-22T19:22:02.196814] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T19:22:02.922105] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-22T19:22:03.495854] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T19:22:03.722089] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-22T19:22:03.742334] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T19:22:04.522121] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-22T19:22:04.813419] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-22T19:22:05.119258] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:22:05.322053] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-22T19:22:06.039336] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-22T19:22:06.122015] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-22T19:22:06.503631] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-22T19:22:06.922075] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-22T19:22:07.722120] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-22T19:22:07.838766] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T19:22:08.016443] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-22T19:22:08.522119] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-22T19:22:09.322066] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-22T19:22:09.641870] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-22T19:22:10.122072] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-22T19:22:10.529159] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T19:22:10.702536] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T19:22:10.922057] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-22T19:22:11.642967] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T19:22:11.722065] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-22T19:22:12.047746] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-22T19:22:12.522065] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-22T19:22:12.976677] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T19:22:13.322041] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-22T19:22:13.750814] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-22T19:22:14.122061] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-22T19:22:14.922100] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-22T19:22:15.484057] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T19:22:15.714373] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T19:22:15.725418] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-22T19:22:16.522087] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-22T19:22:16.614958] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T19:22:16.762108] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-22T19:22:17.322092] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-22T19:22:17.628971] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-22T19:22:17.629663] [INFO ] [REMOTE ] HYAC: Full fetch complete (868 records). [2025-09-22T19:22:17.629738] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-22T19:22:17.816480] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-22T19:22:17.816729] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:22:17.816802] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:22:17.816877] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-22T19:22:17.816964] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-22T19:22:17.817058] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-22T19:22:17.817137] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-22T19:22:17.817221] [INFO ] [MAIN ] Update Progress: 1072/2372 symbols completed. HYAC took 17.8s. Estimated remaining: 2h 52m 29s. Rate: 7.5 symbols/min [2025-09-22T19:22:18.012974] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:22:18.013210] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-22T19:22:18.013269] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-22T19:22:18.013432] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-22T19:22:18.013502] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-22T19:22:18.013566] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-22T19:22:18.013610] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-22T19:22:18.126037] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-22T19:22:18.398277] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:22:18.922112] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-22T19:22:19.246814] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-22T19:22:19.722073] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-22T19:22:19.812007] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T19:22:20.522116] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-22T19:22:20.850524] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-22T19:22:21.322031] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-22T19:22:21.649943] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T19:22:22.122082] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-22T19:22:22.224258] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T19:22:22.227024] [INFO ] [REMOTE ] HY: Full fetch complete (15214 records). [2025-09-22T19:22:22.227120] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-22T19:22:22.587396] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-22T19:22:22.587479] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-22T19:22:22.587712] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-22T19:22:22.587772] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-22T19:22:22.588260] [DEBUG] [LOCAL ] HY: Trimmed 15214 records to 10144 (keeping 200 days of data) [2025-09-22T19:22:22.648140] [DEBUG] [LOCAL ] HY: Primary data saved (10144 records). [2025-09-22T19:22:22.648243] [INFO ] [MAIN ] HY: Full history saved. [2025-09-22T19:22:22.648334] [INFO ] [MAIN ] Update Progress: 1073/2372 symbols completed. HY took 25.3s. Estimated remaining: 2h 52m 17s. Rate: 7.5 symbols/min [2025-09-22T19:22:22.816057] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:22:22.828423] [DEBUG] [LOCAL ] HYI: Loaded 8995 existing records from primary storage. [2025-09-22T19:22:22.828537] [INFO ] [MAIN ] HYI: Loaded 8995 existing records. [2025-09-22T19:22:22.927270] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-22T19:22:23.013058] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:22:23.013348] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-22T19:22:23.013409] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-22T19:22:23.013923] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-22T19:22:23.013982] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-22T19:22:23.272756] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-22T19:22:23.381859] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:22:23.690108] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T19:22:23.722026] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-22T19:22:24.522063] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-22T19:22:24.920992] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-22T19:22:25.322060] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-22T19:22:25.371350] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T19:22:25.661467] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-22T19:22:26.122077] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-22T19:22:26.922062] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-22T19:22:27.207584] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-22T19:22:27.681037] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T19:22:27.722052] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-22T19:22:28.522124] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-22T19:22:29.206849] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T19:22:29.248007] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T19:22:29.322066] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-22T19:22:29.676045] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-22T19:22:30.122100] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-22T19:22:30.436779] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-22T19:22:30.922049] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-22T19:22:31.295774] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-22T19:22:31.296484] [INFO ] [REMOTE ] HYBX: Full fetch complete (821 records). [2025-09-22T19:22:31.296552] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-22T19:22:31.486031] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-22T19:22:31.486266] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:22:31.486338] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:22:31.486420] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-22T19:22:31.486537] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-22T19:22:31.486597] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-22T19:22:31.486676] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-22T19:22:31.486762] [INFO ] [MAIN ] Update Progress: 1074/2372 symbols completed. HYBX took 13.7s. Estimated remaining: 2h 52m 10s. Rate: 7.5 symbols/min [2025-09-22T19:22:31.662017] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:22:31.697221] [DEBUG] [LOCAL ] HYT: Loaded 33598 existing records from primary storage. [2025-09-22T19:22:31.697366] [INFO ] [MAIN ] HYT: Loaded 33598 existing records. [2025-09-22T19:22:31.727783] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-22T19:22:31.884672] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:22:31.884951] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-22T19:22:31.885041] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-22T19:22:31.886058] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-22T19:22:31.886120] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-22T19:22:32.262922] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:22:32.519738] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-22T19:22:32.522327] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-22T19:22:33.198570] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T19:22:33.322059] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-22T19:22:34.122054] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-22T19:22:34.922031] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-22T19:22:34.960092] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T19:22:35.722010] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-22T19:22:35.842169] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T19:22:35.849697] [INFO ] [REMOTE ] HXL: Full fetch complete (66087 records). [2025-09-22T19:22:35.849830] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-22T19:22:36.251313] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-22T19:22:36.251557] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-22T19:22:36.252731] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-22T19:22:36.252830] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-22T19:22:36.278528] [DEBUG] [LOCAL ] HXL: Trimmed 66087 records to 46127 (keeping 200 days of data) [2025-09-22T19:22:36.281071] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T19:22:36.522365] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-22T19:22:36.596852] [DEBUG] [LOCAL ] HXL: Primary data saved (46127 records). [2025-09-22T19:22:36.597025] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-22T19:22:36.597127] [INFO ] [MAIN ] Update Progress: 1075/2372 symbols completed. HXL took 42.6s. Estimated remaining: 2h 51m 59s. Rate: 7.5 symbols/min [2025-09-22T19:22:36.804286] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:22:36.809117] [DEBUG] [LOCAL ] HYTR: Loaded 3252 existing records from primary storage. [2025-09-22T19:22:36.809204] [INFO ] [MAIN ] HYTR: Loaded 3252 existing records. [2025-09-22T19:22:37.009389] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:22:37.009970] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-22T19:22:37.010040] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-22T19:22:37.010353] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-22T19:22:37.010423] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-22T19:22:37.327144] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-22T19:22:37.403902] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:22:37.554499] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T19:22:37.583106] [INFO ] [REMOTE ] HWM: Full fetch complete (76647 records). [2025-09-22T19:22:37.583501] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-22T19:22:37.585009] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T19:22:37.987353] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-22T19:22:37.987433] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-22T19:22:37.988395] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-22T19:22:37.988459] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-22T19:22:37.991280] [DEBUG] [LOCAL ] HWM: Trimmed 76647 records to 53021 (keeping 200 days of data) [2025-09-22T19:22:38.122084] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-22T19:22:38.202693] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T19:22:38.377377] [DEBUG] [LOCAL ] HWM: Primary data saved (53021 records). [2025-09-22T19:22:38.377568] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-22T19:22:38.377704] [INFO ] [MAIN ] Update Progress: 1076/2372 symbols completed. HWM took 55.0s. Estimated remaining: 2h 51m 44s. Rate: 7.5 symbols/min [2025-09-22T19:22:38.571315] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:22:38.593466] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-22T19:22:38.610044] [DEBUG] [LOCAL ] HZO: Loaded 29856 existing records from primary storage. [2025-09-22T19:22:38.610200] [INFO ] [MAIN ] HZO: Loaded 29856 existing records. [2025-09-22T19:22:38.803116] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:22:38.803385] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-22T19:22:38.803432] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-22T19:22:38.804120] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-22T19:22:38.804184] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-22T19:22:38.927258] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-22T19:22:39.195151] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:22:39.717247] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T19:22:39.721989] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-22T19:22:40.522105] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-22T19:22:40.578078] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T19:22:41.322048] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-22T19:22:41.910148] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T19:22:42.048457] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T19:22:42.122009] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-22T19:22:42.652442] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-22T19:22:42.922059] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-22T19:22:43.722065] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-22T19:22:44.085717] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T19:22:44.522058] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-22T19:22:44.724198] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-22T19:22:45.322049] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-22T19:22:45.809195] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T19:22:45.914546] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-22T19:22:46.122070] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-22T19:22:46.922067] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-22T19:22:47.455529] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-22T19:22:47.727185] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-22T19:22:47.741971] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T19:22:48.522092] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-22T19:22:48.902818] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T19:22:49.286000] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T19:22:49.322080] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-22T19:22:50.070375] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:22:50.122055] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-22T19:22:50.922054] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-22T19:22:51.063686] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T19:22:51.722091] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-22T19:22:52.522060] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-22T19:22:53.322091] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-22T19:23:03.925153] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (12.20 seconds). [2025-09-22T19:23:03.926844] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-22T19:23:05.101559] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (12.58 seconds). [2025-09-22T19:23:05.108593] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-22T19:23:05.272822] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (14.35 seconds). [2025-09-22T19:23:05.280202] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-22T19:23:05.865142] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (12.54 seconds). [2025-09-22T19:23:05.866828] [INFO ] [REMOTE ] HYI: Full fetch complete (12831 records). [2025-09-22T19:23:05.866912] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-22T19:23:06.256736] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-22T19:23:06.256883] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-22T19:23:06.257561] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-22T19:23:06.257738] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-22T19:23:06.258767] [DEBUG] [LOCAL ] HYI: Trimmed 12831 records to 8846 (keeping 200 days of data) [2025-09-22T19:23:06.339006] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T19:23:06.364346] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-22T19:23:06.363634] [DEBUG] [LOCAL ] HYI: Primary data saved (8846 records). [2025-09-22T19:23:06.365830] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-22T19:23:06.366113] [INFO ] [MAIN ] Update Progress: 1077/2372 symbols completed. HYI took 43.7s. Estimated remaining: 2h 51m 60s. Rate: 7.5 symbols/min [2025-09-22T19:23:06.395388] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-22T19:23:06.404947] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-22T19:23:07.168600] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (3.24 seconds). [2025-09-22T19:23:07.170814] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-22T19:23:07.725089] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-22T19:23:07.726669] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-22T19:23:07.817109] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T19:23:07.825343] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-22T19:23:07.850527] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T19:23:07.856856] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-22T19:23:08.046122] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-22T19:23:08.047500] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-22T19:23:08.540533] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-22T19:23:08.542042] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-22T19:23:08.891009] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T19:23:08.905591] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-22T19:23:08.931347] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-22T19:23:08.932674] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-22T19:23:09.248347] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T19:23:09.255729] [INFO ] [REMOTE ] HYT: Full fetch complete (46825 records). [2025-09-22T19:23:09.255869] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-22T19:23:09.558682] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-22T19:23:09.565683] [INFO ] [REMOTE ] HYTR: Full fetch complete (4414 records). [2025-09-22T19:23:09.576084] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-22T19:23:09.763000] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-22T19:23:09.766717] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-22T19:23:09.767608] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-22T19:23:09.768065] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-22T19:23:09.849274] [DEBUG] [LOCAL ] HYT: Trimmed 46825 records to 33218 (keeping 200 days of data) [2025-09-22T19:23:10.146273] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-22T19:23:10.147072] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-22T19:23:10.147671] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-22T19:23:10.148025] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-22T19:23:10.152272] [DEBUG] [LOCAL ] HYTR: Trimmed 4414 records to 3174 (keeping 200 days of data) [2025-09-22T19:23:10.183445] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T19:23:10.198016] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-22T19:23:10.207732] [DEBUG] [LOCAL ] HYTR: Primary data saved (3174 records). [2025-09-22T19:23:10.208349] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-22T19:23:10.208741] [INFO ] [MAIN ] Update Progress: 1078/2372 symbols completed. HYTR took 33.6s. Estimated remaining: 2h 51m 47s. Rate: 7.5 symbols/min [2025-09-22T19:23:10.311771] [DEBUG] [LOCAL ] HYT: Primary data saved (33218 records). [2025-09-22T19:23:10.311930] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-22T19:23:10.312034] [INFO ] [MAIN ] Update Progress: 1079/2372 symbols completed. HYT took 38.8s. Estimated remaining: 2h 51m 29s. Rate: 7.5 symbols/min [2025-09-22T19:23:11.155832] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T19:23:11.162279] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-22T19:23:12.328856] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T19:23:12.334065] [INFO ] [REMOTE ] HZO: Full fetch complete (40502 records). [2025-09-22T19:23:12.334160] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-22T19:23:12.791495] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-22T19:23:12.791681] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-22T19:23:12.792403] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-22T19:23:12.792450] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-22T19:23:12.794362] [DEBUG] [LOCAL ] HZO: Trimmed 40502 records to 29378 (keeping 200 days of data) [2025-09-22T19:23:12.975202] [DEBUG] [LOCAL ] HZO: Primary data saved (29378 records). [2025-09-22T19:23:12.975357] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-22T19:23:12.975457] [INFO ] [MAIN ] Update Progress: 1080/2372 symbols completed. HZO took 34.6s. Estimated remaining: 2h 51m 15s. Rate: 7.5 symbols/min [2025-09-22T19:23:13.629799] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:23:13.616253] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:23:13.636390] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:23:13.711612] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:23:13.717470] [DEBUG] [LOCAL ] IAE: Loaded 5839 existing records from primary storage. [2025-09-22T19:23:13.717599] [INFO ] [MAIN ] IAE: Loaded 5839 existing records. [2025-09-22T19:23:13.986019] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:23:14.002886] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-22T19:23:14.004430] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-22T19:23:14.020723] [DEBUG] [LOCAL ] IAG: Loaded 54213 existing records from primary storage. [2025-09-22T19:23:14.021054] [INFO ] [MAIN ] IAG: Loaded 54213 existing records. [2025-09-22T19:23:14.033847] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-22T19:23:14.033771] [DEBUG] [LOCAL ] IBN: Loaded 53699 existing records from primary storage. [2025-09-22T19:23:14.044739] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-22T19:23:14.054331] [INFO ] [MAIN ] IBN: Loaded 53699 existing records. [2025-09-22T19:23:14.306878] [DEBUG] [LOCAL ] IBM: Loaded 54389 existing records from primary storage. [2025-09-22T19:23:14.358626] [INFO ] [MAIN ] IBM: Loaded 54389 existing records. [2025-09-22T19:23:14.516490] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:23:14.699409] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:23:14.699566] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-22T19:23:14.767705] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-22T19:23:14.752147] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-22T19:23:14.828502] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-22T19:23:14.804387] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-22T19:23:14.829215] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-22T19:23:14.862245] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-22T19:23:14.915693] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-22T19:23:15.116697] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:23:15.235402] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-22T19:23:15.279702] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:23:15.285006] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-22T19:23:15.295792] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-22T19:23:15.295504] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-22T19:23:15.321758] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-22T19:23:15.895386] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:23:15.942670] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-22T19:23:16.116353] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:23:16.122599] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T19:23:16.143897] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-22T19:23:16.146773] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-22T19:23:16.228494] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:23:16.228907] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-22T19:23:16.732961] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-22T19:23:16.734753] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-22T19:23:17.405300] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T19:23:17.407395] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-22T19:23:17.857377] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T19:23:17.869483] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-22T19:23:17.905861] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:23:17.917325] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-22T19:23:17.995005] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T19:23:17.996797] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T19:23:18.011518] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-22T19:23:18.010998] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-22T19:23:18.491871] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-22T19:23:18.493595] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-22T19:23:19.142074] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T19:23:19.144061] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-22T19:23:19.501427] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T19:23:19.512276] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-22T19:23:19.544467] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-22T19:23:19.546610] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-22T19:23:19.735731] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T19:23:19.746287] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-22T19:23:19.935507] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T19:23:19.946196] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-22T19:23:20.255245] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T19:23:20.257360] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-22T19:23:20.773314] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-22T19:23:20.775507] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-22T19:23:21.086820] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T19:23:21.172225] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T19:23:21.322082] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-22T19:23:21.404937] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-22T19:23:21.407994] [INFO ] [REMOTE ] IAE: Full fetch complete (8563 records). [2025-09-22T19:23:21.408177] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-22T19:23:21.840581] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-22T19:23:21.840840] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-22T19:23:21.841283] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-22T19:23:21.841445] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-22T19:23:21.842429] [DEBUG] [LOCAL ] IAE: Trimmed 8563 records to 5843 (keeping 200 days of data) [2025-09-22T19:23:21.881984] [DEBUG] [LOCAL ] IAE: Primary data saved (5843 records). [2025-09-22T19:23:21.882195] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-22T19:23:21.882338] [INFO ] [MAIN ] Update Progress: 1081/2372 symbols completed. IAE took 8.9s. Estimated remaining: 2h 51m 8s. Rate: 7.5 symbols/min [2025-09-22T19:23:22.082567] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:23:22.101990] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-22T19:23:22.122006] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-22T19:23:22.161132] [DEBUG] [LOCAL ] IBP: Loaded 29938 existing records from primary storage. [2025-09-22T19:23:22.161300] [INFO ] [MAIN ] IBP: Loaded 29938 existing records. [2025-09-22T19:23:22.350754] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:23:22.351021] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-22T19:23:22.351071] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-22T19:23:22.352216] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-22T19:23:22.352280] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-22T19:23:22.733212] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:23:22.927227] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-22T19:23:22.952766] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T19:23:23.722074] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-22T19:23:24.326199] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-22T19:23:24.358817] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-22T19:23:24.522064] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-22T19:23:25.322039] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-22T19:23:25.494128] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T19:23:25.531019] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T19:23:26.122092] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-22T19:23:26.922042] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-22T19:23:26.987547] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T19:23:27.722069] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-22T19:23:28.503087] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-22T19:23:28.522023] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-22T19:23:28.867864] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T19:23:29.322623] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-22T19:23:29.322519] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T19:23:30.122096] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-22T19:23:30.671481] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-22T19:23:30.922060] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-22T19:23:31.164051] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T19:23:31.355070] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T19:23:31.722061] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-22T19:23:32.522108] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-22T19:23:32.938894] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-22T19:23:33.322067] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-22T19:23:33.471753] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T19:23:33.793167] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T19:23:34.122049] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-22T19:23:34.922061] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-22T19:23:35.422904] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-22T19:23:35.722137] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-22T19:23:35.834591] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T19:23:36.523174] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-22T19:23:36.529004] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T19:23:37.322055] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-22T19:23:38.122146] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-22T19:23:38.164833] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-22T19:23:38.369382] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T19:23:38.774327] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T19:23:38.922097] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-22T19:23:39.596933] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T19:23:39.722068] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-22T19:23:40.530277] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-22T19:23:40.565474] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T19:23:41.322048] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-22T19:23:41.820390] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T19:23:41.857526] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-22T19:23:41.866339] [INFO ] [REMOTE ] IBM: Full fetch complete (77615 records). [2025-09-22T19:23:41.866528] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-22T19:23:42.128158] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-22T19:23:42.263912] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-22T19:23:42.264399] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-22T19:23:42.265419] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-22T19:23:42.265575] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-22T19:23:42.267132] [DEBUG] [LOCAL ] IBM: Trimmed 77615 records to 53638 (keeping 200 days of data) [2025-09-22T19:23:42.619657] [DEBUG] [LOCAL ] IBM: Primary data saved (53638 records). [2025-09-22T19:23:42.619825] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-22T19:23:42.621529] [INFO ] [MAIN ] Update Progress: 1082/2372 symbols completed. IBM took 29.6s. Estimated remaining: 2h 51m 16s. Rate: 7.5 symbols/min [2025-09-22T19:23:42.796193] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:23:42.839077] [DEBUG] [LOCAL ] IBTA: Loaded 38885 existing records from primary storage. [2025-09-22T19:23:42.839218] [INFO ] [MAIN ] IBTA: Loaded 38885 existing records. [2025-09-22T19:23:42.928871] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-22T19:23:43.033565] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:23:43.034321] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-22T19:23:43.034532] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-22T19:23:43.035769] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-22T19:23:43.035832] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-22T19:23:43.347376] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-22T19:23:43.380142] [INFO ] [REMOTE ] IAG: Full fetch complete (77198 records). [2025-09-22T19:23:43.409232] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-22T19:23:43.446673] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:23:43.723802] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-22T19:23:43.862008] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-22T19:23:43.862111] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-22T19:23:43.863242] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-22T19:23:43.863325] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-22T19:23:43.887253] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T19:23:43.886184] [DEBUG] [LOCAL ] IAG: Trimmed 77198 records to 53442 (keeping 200 days of data) [2025-09-22T19:23:43.896129] [INFO ] [REMOTE ] IBN: Full fetch complete (76259 records). [2025-09-22T19:23:43.896232] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-22T19:23:44.542345] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-22T19:23:44.543308] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-22T19:23:44.545380] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-22T19:23:44.545834] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-22T19:23:44.554539] [DEBUG] [LOCAL ] IBN: Trimmed 76259 records to 52896 (keeping 200 days of data) [2025-09-22T19:23:44.577506] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T19:23:44.639776] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-22T19:23:44.909810] [DEBUG] [LOCAL ] IAG: Primary data saved (53442 records). [2025-09-22T19:23:44.910514] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-22T19:23:44.910698] [INFO ] [MAIN ] Update Progress: 1083/2372 symbols completed. IAG took 31.9s. Estimated remaining: 2h 51m 1s. Rate: 7.5 symbols/min [2025-09-22T19:23:45.105025] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:23:45.184218] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T19:23:45.211020] [DEBUG] [LOCAL ] IBN: Primary data saved (52896 records). [2025-09-22T19:23:45.211194] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-22T19:23:45.211306] [INFO ] [MAIN ] Update Progress: 1084/2372 symbols completed. IBN took 32.2s. Estimated remaining: 2h 50m 44s. Rate: 7.5 symbols/min [2025-09-22T19:23:45.325485] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-22T19:23:45.416101] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:23:45.437432] [DEBUG] [LOCAL ] ICE: Loaded 53803 existing records from primary storage. [2025-09-22T19:23:45.437811] [INFO ] [MAIN ] ICE: Loaded 53803 existing records. [2025-09-22T19:23:45.648427] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:23:45.648763] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-22T19:23:45.648842] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-22T19:23:45.650490] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-22T19:23:45.650557] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-22T19:23:45.792427] [DEBUG] [LOCAL ] ICL: Loaded 39503 existing records from primary storage. [2025-09-22T19:23:45.812187] [INFO ] [MAIN ] ICL: Loaded 39503 existing records. [2025-09-22T19:23:46.229066] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:23:46.252596] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:23:46.253255] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-22T19:23:46.254392] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-22T19:23:46.254470] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-22T19:23:46.261956] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-22T19:23:46.272373] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-22T19:23:46.279016] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T19:23:46.613476] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T19:23:46.682770] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:23:46.922096] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-22T19:23:47.722061] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-22T19:23:48.064183] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T19:23:48.122719] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T19:23:48.522104] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-22T19:23:49.247866] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T19:23:49.322012] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-22T19:23:49.860964] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T19:23:50.122049] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-22T19:23:50.608901] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T19:23:50.613586] [INFO ] [REMOTE ] IBP: Full fetch complete (41049 records). [2025-09-22T19:23:50.613708] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-22T19:23:50.927147] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-22T19:23:50.997493] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-22T19:23:50.997581] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-22T19:23:50.998289] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-22T19:23:50.998368] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-22T19:23:50.999501] [DEBUG] [LOCAL ] IBP: Trimmed 41049 records to 29382 (keeping 200 days of data) [2025-09-22T19:23:51.193669] [DEBUG] [LOCAL ] IBP: Primary data saved (29382 records). [2025-09-22T19:23:51.193807] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-22T19:23:51.193893] [INFO ] [MAIN ] Update Progress: 1085/2372 symbols completed. IBP took 29.3s. Estimated remaining: 2h 50m 34s. Rate: 7.5 symbols/min [2025-09-22T19:23:51.366364] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:23:51.427271] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T19:23:51.470411] [DEBUG] [LOCAL ] IDA: Loaded 32459 existing records from primary storage. [2025-09-22T19:23:51.470551] [INFO ] [MAIN ] IDA: Loaded 32459 existing records. [2025-09-22T19:23:51.647808] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:23:51.648064] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-22T19:23:51.648112] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-22T19:23:51.648987] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-22T19:23:51.649047] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-22T19:23:51.727110] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-22T19:23:52.009924] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:23:52.522075] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-22T19:23:52.787166] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-22T19:23:52.971374] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T19:23:53.322055] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-22T19:23:53.731163] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T19:23:54.122152] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-22T19:23:54.560271] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T19:23:54.922121] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-22T19:23:55.376726] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T19:23:55.722107] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-22T19:23:56.087403] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T19:23:56.522066] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-22T19:23:57.327159] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-22T19:23:57.342117] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T19:23:57.713936] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T19:23:58.122053] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-22T19:23:58.521219] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T19:23:58.922041] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-22T19:23:59.722063] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-22T19:23:59.886381] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T19:24:00.297268] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T19:24:00.522068] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-22T19:24:00.903386] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-22T19:24:01.322056] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-22T19:24:02.122036] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-22T19:24:02.242804] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T19:24:02.922073] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-22T19:24:03.722074] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-22T19:24:04.975067] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (3.65 seconds). [2025-09-22T19:24:04.987054] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-22T19:24:05.014009] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-22T19:24:05.087347] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-22T19:24:05.322074] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-22T19:24:05.486439] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T19:24:06.122161] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-22T19:24:06.550727] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T19:24:06.874769] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T19:24:06.922000] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-22T19:24:07.338018] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T19:24:07.722057] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-22T19:24:08.512163] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T19:24:08.522304] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-22T19:24:09.189466] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T19:24:09.322011] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-22T19:24:09.978243] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T19:24:10.122024] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-22T19:24:10.841082] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T19:24:10.922010] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-22T19:24:11.522571] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T19:24:11.722067] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-22T19:24:11.888440] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-22T19:24:12.522078] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-22T19:24:12.974221] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T19:24:13.322090] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-22T19:24:13.900367] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T19:24:13.907311] [INFO ] [REMOTE ] IDA: Full fetch complete (44600 records). [2025-09-22T19:24:13.907524] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-22T19:24:14.130739] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-22T19:24:14.486550] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-22T19:24:14.486727] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-22T19:24:14.488178] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-22T19:24:14.488278] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-22T19:24:14.489939] [DEBUG] [LOCAL ] IDA: Trimmed 44600 records to 31959 (keeping 200 days of data) [2025-09-22T19:24:14.751170] [DEBUG] [LOCAL ] IDA: Primary data saved (31959 records). [2025-09-22T19:24:14.751335] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-22T19:24:14.751427] [INFO ] [MAIN ] Update Progress: 1086/2372 symbols completed. IDA took 23.6s. Estimated remaining: 2h 50m 44s. Rate: 7.5 symbols/min [2025-09-22T19:24:14.930689] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:24:14.927603] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-22T19:24:14.942386] [DEBUG] [LOCAL ] IDE: Loaded 8501 existing records from primary storage. [2025-09-22T19:24:14.942523] [INFO ] [MAIN ] IDE: Loaded 8501 existing records. [2025-09-22T19:24:15.128574] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:24:15.128912] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-22T19:24:15.128970] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-22T19:24:15.129343] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-22T19:24:15.129409] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-22T19:24:15.491349] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:24:15.708551] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-22T19:24:15.722003] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-22T19:24:16.115463] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-22T19:24:16.522059] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-22T19:24:16.718374] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T19:24:16.726931] [INFO ] [REMOTE ] ICL: Full fetch complete (56436 records). [2025-09-22T19:24:16.727095] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-22T19:24:17.129834] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-22T19:24:17.130043] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-22T19:24:17.130992] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-22T19:24:17.131056] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-22T19:24:17.132309] [DEBUG] [LOCAL ] ICL: Trimmed 56436 records to 38776 (keeping 200 days of data) [2025-09-22T19:24:17.233615] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-22T19:24:17.342067] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-22T19:24:17.380684] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T19:24:17.420698] [DEBUG] [LOCAL ] ICL: Primary data saved (38776 records). [2025-09-22T19:24:17.420850] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-22T19:24:17.420942] [INFO ] [MAIN ] Update Progress: 1087/2372 symbols completed. ICL took 32.2s. Estimated remaining: 2h 50m 30s. Rate: 7.5 symbols/min [2025-09-22T19:24:17.611227] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:24:17.629169] [DEBUG] [LOCAL ] IDT: Loaded 17777 existing records from primary storage. [2025-09-22T19:24:17.629305] [INFO ] [MAIN ] IDT: Loaded 17777 existing records. [2025-09-22T19:24:17.812760] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:24:17.813035] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-22T19:24:17.813089] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-22T19:24:17.813626] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-22T19:24:17.813719] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-22T19:24:18.127142] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-22T19:24:18.183517] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:24:18.779868] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T19:24:18.849855] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T19:24:18.856774] [INFO ] [REMOTE ] IBTA: Full fetch complete (50486 records). [2025-09-22T19:24:18.856873] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-22T19:24:18.927269] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-22T19:24:19.249139] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-22T19:24:19.249301] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-22T19:24:19.250105] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-22T19:24:19.250169] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-22T19:24:19.251577] [DEBUG] [LOCAL ] IBTA: Trimmed 50486 records to 38115 (keeping 200 days of data) [2025-09-22T19:24:19.476219] [DEBUG] [LOCAL ] IBTA: Primary data saved (38115 records). [2025-09-22T19:24:19.476366] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-22T19:24:19.476456] [INFO ] [MAIN ] Update Progress: 1088/2372 symbols completed. IBTA took 36.9s. Estimated remaining: 2h 50m 15s. Rate: 7.5 symbols/min [2025-09-22T19:24:19.672120] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:24:19.716950] [DEBUG] [LOCAL ] IEX: Loaded 38987 existing records from primary storage. [2025-09-22T19:24:19.717094] [INFO ] [MAIN ] IEX: Loaded 38987 existing records. [2025-09-22T19:24:19.728317] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-22T19:24:19.916405] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:24:19.916900] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-22T19:24:19.917013] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-22T19:24:19.918007] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-22T19:24:19.918067] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-22T19:24:20.016151] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T19:24:20.300519] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:24:20.522071] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-22T19:24:21.322050] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-22T19:24:21.447547] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T19:24:21.459510] [INFO ] [REMOTE ] ICE: Full fetch complete (76757 records). [2025-09-22T19:24:21.459722] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-22T19:24:21.905437] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-22T19:24:21.905694] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-22T19:24:21.906863] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-22T19:24:21.906984] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-22T19:24:21.915106] [DEBUG] [LOCAL ] ICE: Trimmed 76757 records to 53023 (keeping 200 days of data) [2025-09-22T19:24:21.928481] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T19:24:22.129336] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-22T19:24:22.166434] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T19:24:22.289286] [DEBUG] [LOCAL ] ICE: Primary data saved (53023 records). [2025-09-22T19:24:22.289444] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-22T19:24:22.289533] [INFO ] [MAIN ] Update Progress: 1089/2372 symbols completed. ICE took 37.4s. Estimated remaining: 2h 50m 1s. Rate: 7.5 symbols/min [2025-09-22T19:24:22.463074] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:24:22.513724] [DEBUG] [LOCAL ] IFF: Loaded 51702 existing records from primary storage. [2025-09-22T19:24:22.513941] [INFO ] [MAIN ] IFF: Loaded 51702 existing records. [2025-09-22T19:24:22.697886] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:24:22.698150] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-22T19:24:22.698199] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-22T19:24:22.699279] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-22T19:24:22.699341] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-22T19:24:22.928320] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-22T19:24:23.074416] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:24:23.500704] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T19:24:23.515773] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-22T19:24:23.722073] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-22T19:24:24.522072] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-22T19:24:25.135363] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T19:24:25.322036] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-22T19:24:25.999257] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T19:24:26.122008] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-22T19:24:26.879230] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T19:24:26.922003] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-22T19:24:27.644446] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T19:24:27.722044] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-22T19:24:28.522115] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-22T19:24:29.322033] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-22T19:24:29.689937] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T19:24:29.800776] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-09-22T19:24:30.122028] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-22T19:24:30.146116] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T19:24:30.175065] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-22T19:24:30.922053] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-22T19:24:31.588040] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T19:24:31.722044] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-22T19:24:31.940470] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-22T19:24:32.522092] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-22T19:24:33.322034] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-22T19:24:33.590922] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T19:24:33.735055] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T19:24:34.039321] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-22T19:24:34.122058] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-22T19:24:34.922092] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-22T19:24:35.123458] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T19:24:35.722061] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-22T19:24:36.294375] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T19:24:36.483396] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T19:24:36.522062] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-22T19:24:37.322063] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-22T19:24:37.921535] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T19:24:38.087160] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T19:24:38.122028] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-22T19:24:38.922109] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-22T19:24:39.722070] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-22T19:24:39.781327] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T19:24:40.401345] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T19:24:40.494372] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T19:24:40.522013] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-22T19:24:41.322055] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-22T19:24:42.122035] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-22T19:24:42.365188] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T19:24:42.392757] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T19:24:42.922053] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-22T19:24:43.216449] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T19:24:43.722054] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-22T19:24:44.522037] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-22T19:24:44.657501] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T19:24:44.665792] [INFO ] [REMOTE ] IFF: Full fetch complete (72751 records). [2025-09-22T19:24:44.665963] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-22T19:24:45.061180] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T19:24:45.082729] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-22T19:24:45.082809] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-22T19:24:45.083975] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-22T19:24:45.084163] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-22T19:24:45.085534] [DEBUG] [LOCAL ] IFF: Trimmed 72751 records to 50956 (keeping 200 days of data) [2025-09-22T19:24:45.324752] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-22T19:24:45.340175] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T19:24:45.417150] [DEBUG] [LOCAL ] IFF: Primary data saved (50956 records). [2025-09-22T19:24:45.417307] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-22T19:24:45.417399] [INFO ] [MAIN ] Update Progress: 1090/2372 symbols completed. IFF took 23.1s. Estimated remaining: 2h 50m 11s. Rate: 7.5 symbols/min [2025-09-22T19:24:45.586740] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:24:45.607967] [DEBUG] [LOCAL ] IFN: Loaded 18547 existing records from primary storage. [2025-09-22T19:24:45.608092] [INFO ] [MAIN ] IFN: Loaded 18547 existing records. [2025-09-22T19:24:45.783677] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:24:45.783950] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-22T19:24:45.784092] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-22T19:24:45.784694] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-22T19:24:45.784753] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-22T19:24:46.123719] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-22T19:24:46.144556] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:24:46.922065] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-22T19:24:46.977378] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T19:24:47.103145] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T19:24:47.544011] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T19:24:47.545943] [INFO ] [REMOTE ] IDE: Full fetch complete (12696 records). [2025-09-22T19:24:47.546065] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-22T19:24:47.734523] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-22T19:24:47.923792] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-22T19:24:47.923873] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-22T19:24:47.924160] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-22T19:24:47.924199] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-22T19:24:47.924726] [DEBUG] [LOCAL ] IDE: Trimmed 12696 records to 8405 (keeping 200 days of data) [2025-09-22T19:24:47.977371] [DEBUG] [LOCAL ] IDE: Primary data saved (8405 records). [2025-09-22T19:24:47.977510] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-22T19:24:47.977604] [INFO ] [MAIN ] Update Progress: 1091/2372 symbols completed. IDE took 33.2s. Estimated remaining: 2h 49m 57s. Rate: 7.5 symbols/min [2025-09-22T19:24:48.151904] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:24:48.176678] [DEBUG] [LOCAL ] IFS: Loaded 23385 existing records from primary storage. [2025-09-22T19:24:48.176871] [INFO ] [MAIN ] IFS: Loaded 23385 existing records. [2025-09-22T19:24:48.356245] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:24:48.356563] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-22T19:24:48.356614] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-22T19:24:48.357427] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-22T19:24:48.357489] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-22T19:24:48.532027] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-22T19:24:48.721478] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:24:49.322043] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-22T19:24:49.518584] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T19:24:49.738265] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T19:24:50.122110] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-22T19:24:50.238867] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T19:24:50.882899] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T19:24:50.886227] [INFO ] [REMOTE ] IDT: Full fetch complete (22447 records). [2025-09-22T19:24:50.886303] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-22T19:24:50.927273] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-22T19:24:51.257882] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-22T19:24:51.258024] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-22T19:24:51.258479] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-22T19:24:51.258519] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-22T19:24:51.259177] [DEBUG] [LOCAL ] IDT: Trimmed 22447 records to 17600 (keeping 200 days of data) [2025-09-22T19:24:51.367588] [DEBUG] [LOCAL ] IDT: Primary data saved (17600 records). [2025-09-22T19:24:51.367766] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-22T19:24:51.367858] [INFO ] [MAIN ] Update Progress: 1092/2372 symbols completed. IDT took 33.9s. Estimated remaining: 2h 49m 43s. Rate: 7.5 symbols/min [2025-09-22T19:24:51.548925] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:24:51.560558] [DEBUG] [LOCAL ] IGA: Loaded 9829 existing records from primary storage. [2025-09-22T19:24:51.560725] [INFO ] [MAIN ] IGA: Loaded 9829 existing records. [2025-09-22T19:24:51.722481] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-22T19:24:51.745226] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:24:51.745508] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-22T19:24:51.745557] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-22T19:24:51.745998] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-22T19:24:51.746059] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-22T19:24:52.048675] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T19:24:52.130346] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:24:52.522010] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-22T19:24:52.692761] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T19:24:53.322037] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-22T19:24:53.729199] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T19:24:53.735586] [INFO ] [REMOTE ] IEX: Full fetch complete (53252 records). [2025-09-22T19:24:53.735746] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-22T19:24:53.906424] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-22T19:24:54.147193] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-22T19:24:54.166805] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-22T19:24:54.166894] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-22T19:24:54.167704] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-22T19:24:54.167768] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-22T19:24:54.169175] [DEBUG] [LOCAL ] IEX: Trimmed 53252 records to 38423 (keeping 200 days of data) [2025-09-22T19:24:54.414037] [DEBUG] [LOCAL ] IEX: Primary data saved (38423 records). [2025-09-22T19:24:54.414186] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-22T19:24:54.416064] [INFO ] [MAIN ] Update Progress: 1093/2372 symbols completed. IEX took 34.9s. Estimated remaining: 2h 49m 30s. Rate: 7.5 symbols/min [2025-09-22T19:24:54.584714] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:24:54.606226] [DEBUG] [LOCAL ] IGD: Loaded 19486 existing records from primary storage. [2025-09-22T19:24:54.606364] [INFO ] [MAIN ] IGD: Loaded 19486 existing records. [2025-09-22T19:24:54.786295] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:24:54.786594] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-22T19:24:54.786696] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-22T19:24:54.787394] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-22T19:24:54.787453] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-22T19:24:54.929125] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-22T19:24:55.161527] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:24:55.279368] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-22T19:24:55.563248] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-22T19:24:55.722063] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-22T19:24:56.522090] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-22T19:24:56.715199] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-22T19:24:57.322073] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-22T19:24:57.370165] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T19:24:58.122074] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-22T19:24:58.389146] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T19:24:58.922028] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-22T19:24:58.973198] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T19:24:59.722048] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-22T19:25:00.020609] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T19:25:00.522055] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-22T19:25:00.947180] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T19:25:01.322019] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-22T19:25:01.637274] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T19:25:02.122063] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-22T19:25:02.324270] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T19:25:02.922020] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-22T19:25:03.226300] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T19:25:03.722117] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-22T19:25:03.922124] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T19:25:04.507803] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T19:25:04.521995] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-22T19:25:05.322043] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-22T19:25:05.395828] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T19:25:06.122020] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-22T19:25:06.495825] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T19:25:06.850569] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T19:25:06.922089] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-22T19:25:07.722084] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-22T19:25:08.246961] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T19:25:08.522140] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-22T19:25:08.654585] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-22T19:25:09.322056] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-22T19:25:09.625527] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T19:25:09.898359] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T19:25:10.122066] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-22T19:25:10.922077] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-22T19:25:11.140055] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-22T19:25:11.722062] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-22T19:25:11.832583] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-22T19:25:12.522056] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-22T19:25:13.087147] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T19:25:13.322069] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-22T19:25:13.628402] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T19:25:13.795709] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-22T19:25:14.122094] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-22T19:25:14.922079] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-22T19:25:15.167994] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T19:25:15.171051] [INFO ] [REMOTE ] IFN: Full fetch complete (28983 records). [2025-09-22T19:25:15.171156] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-22T19:25:15.572538] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-22T19:25:15.572680] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-22T19:25:15.573488] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-22T19:25:15.573555] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-22T19:25:15.574487] [DEBUG] [LOCAL ] IFN: Trimmed 28983 records to 18150 (keeping 200 days of data) [2025-09-22T19:25:15.695826] [DEBUG] [LOCAL ] IFN: Primary data saved (18150 records). [2025-09-22T19:25:15.695972] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-22T19:25:15.696147] [INFO ] [MAIN ] Update Progress: 1094/2372 symbols completed. IFN took 30.3s. Estimated remaining: 2h 49m 37s. Rate: 7.5 symbols/min [2025-09-22T19:25:15.727496] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-22T19:25:15.909834] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:25:15.932900] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T19:25:15.945160] [DEBUG] [LOCAL ] IGI: Loaded 3784 existing records from primary storage. [2025-09-22T19:25:15.945319] [INFO ] [MAIN ] IGI: Loaded 3784 existing records. [2025-09-22T19:25:16.132922] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:25:16.133199] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-22T19:25:16.133249] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-22T19:25:16.133587] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-22T19:25:16.133679] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-22T19:25:16.496415] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:25:16.522005] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-22T19:25:16.979552] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-22T19:25:17.024822] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-22T19:25:17.029410] [INFO ] [REMOTE ] IFS: Full fetch complete (31366 records). [2025-09-22T19:25:17.029604] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-22T19:25:17.327137] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-22T19:25:17.427421] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-22T19:25:17.427502] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-22T19:25:17.428194] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-22T19:25:17.428258] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-22T19:25:17.429110] [DEBUG] [LOCAL ] IFS: Trimmed 31366 records to 23060 (keeping 200 days of data) [2025-09-22T19:25:17.577976] [DEBUG] [LOCAL ] IFS: Primary data saved (23060 records). [2025-09-22T19:25:17.578116] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-22T19:25:17.578236] [INFO ] [MAIN ] Update Progress: 1095/2372 symbols completed. IFS took 29.6s. Estimated remaining: 2h 49m 22s. Rate: 7.5 symbols/min [2025-09-22T19:25:17.759570] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:25:17.795692] [DEBUG] [LOCAL ] IGR: Loaded 31042 existing records from primary storage. [2025-09-22T19:25:17.795836] [INFO ] [MAIN ] IGR: Loaded 31042 existing records. [2025-09-22T19:25:17.882701] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-22T19:25:18.001596] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:25:18.001916] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-22T19:25:18.001967] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-22T19:25:18.003075] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-22T19:25:18.003164] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-22T19:25:18.127185] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-22T19:25:18.407309] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:25:18.638626] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-22T19:25:18.922065] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-22T19:25:19.722110] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-22T19:25:20.162201] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-22T19:25:20.163561] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T19:25:20.522108] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-22T19:25:21.322066] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-22T19:25:21.422457] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T19:25:21.424630] [INFO ] [REMOTE ] IGA: Full fetch complete (13538 records). [2025-09-22T19:25:21.424843] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-22T19:25:21.821659] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-22T19:25:21.821805] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-22T19:25:21.822197] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-22T19:25:21.822301] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-22T19:25:21.822917] [DEBUG] [LOCAL ] IGA: Trimmed 13538 records to 9666 (keeping 200 days of data) [2025-09-22T19:25:21.888427] [DEBUG] [LOCAL ] IGA: Primary data saved (9666 records). [2025-09-22T19:25:21.888554] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-22T19:25:21.888739] [INFO ] [MAIN ] Update Progress: 1096/2372 symbols completed. IGA took 30.5s. Estimated remaining: 2h 49m 10s. Rate: 7.5 symbols/min [2025-09-22T19:25:22.069225] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:25:22.075109] [DEBUG] [LOCAL ] IH: Loaded 3638 existing records from primary storage. [2025-09-22T19:25:22.075221] [INFO ] [MAIN ] IH: Loaded 3638 existing records. [2025-09-22T19:25:22.127235] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-22T19:25:22.276234] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:25:22.276480] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-22T19:25:22.276547] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-22T19:25:22.276855] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-22T19:25:22.276925] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-22T19:25:22.455584] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T19:25:22.680050] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:25:22.922071] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-22T19:25:23.499129] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-22T19:25:23.727701] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-22T19:25:23.739138] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T19:25:24.170374] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T19:25:24.522080] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-22T19:25:24.946972] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-22T19:25:25.322040] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-22T19:25:25.667199] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-22T19:25:26.122113] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-22T19:25:26.717943] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T19:25:26.922062] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-22T19:25:27.359333] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-22T19:25:27.722054] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-22T19:25:28.522066] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-22T19:25:28.681944] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T19:25:29.009618] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T19:25:29.322048] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-22T19:25:29.929551] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T19:25:30.122066] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-22T19:25:30.571398] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T19:25:30.573482] [INFO ] [REMOTE ] IGI: Full fetch complete (5228 records). [2025-09-22T19:25:30.573770] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-22T19:25:30.927304] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-22T19:25:31.018816] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-22T19:25:31.018896] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-22T19:25:31.019102] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-22T19:25:31.019165] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-22T19:25:31.020226] [DEBUG] [LOCAL ] IGI: Trimmed 5228 records to 3702 (keeping 200 days of data) [2025-09-22T19:25:31.044606] [DEBUG] [LOCAL ] IGI: Primary data saved (3702 records). [2025-09-22T19:25:31.044779] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-22T19:25:31.044946] [INFO ] [MAIN ] Update Progress: 1097/2372 symbols completed. IGI took 15.3s. Estimated remaining: 2h 49m 3s. Rate: 7.5 symbols/min [2025-09-22T19:25:31.218697] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:25:31.229739] [DEBUG] [LOCAL ] IHD: Loaded 7308 existing records from primary storage. [2025-09-22T19:25:31.229901] [INFO ] [MAIN ] IHD: Loaded 7308 existing records. [2025-09-22T19:25:31.419568] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:25:31.419841] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-22T19:25:31.419893] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-22T19:25:31.420251] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-22T19:25:31.420311] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-22T19:25:31.727266] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-22T19:25:31.794712] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:25:31.816136] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T19:25:32.522074] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-22T19:25:32.569591] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T19:25:33.322072] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-22T19:25:33.894275] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T19:25:34.122057] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-22T19:25:34.398696] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-22T19:25:34.922055] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-22T19:25:34.996919] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T19:25:35.722067] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-22T19:25:35.991621] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-22T19:25:36.457523] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-22T19:25:36.522054] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-22T19:25:37.322044] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-22T19:25:37.907738] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-22T19:25:38.043359] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T19:25:38.122047] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-22T19:25:38.922066] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-22T19:25:39.203239] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-22T19:25:39.722058] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-22T19:25:40.251302] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T19:25:40.476572] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T19:25:40.481060] [INFO ] [REMOTE ] IGD: Full fetch complete (29326 records). [2025-09-22T19:25:40.481187] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-22T19:25:40.527194] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-22T19:25:40.866018] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-22T19:25:40.866160] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-22T19:25:40.866813] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-22T19:25:40.866876] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-22T19:25:40.867667] [DEBUG] [LOCAL ] IGD: Trimmed 29326 records to 18971 (keeping 200 days of data) [2025-09-22T19:25:40.990537] [DEBUG] [LOCAL ] IGD: Primary data saved (18971 records). [2025-09-22T19:25:40.990779] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-22T19:25:40.990931] [INFO ] [MAIN ] Update Progress: 1098/2372 symbols completed. IGD took 46.6s. Estimated remaining: 2h 48m 58s. Rate: 7.5 symbols/min [2025-09-22T19:25:41.169447] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:25:41.199125] [DEBUG] [LOCAL ] IHG: Loaded 25214 existing records from primary storage. [2025-09-22T19:25:41.199268] [INFO ] [MAIN ] IHG: Loaded 25214 existing records. [2025-09-22T19:25:41.327628] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-22T19:25:41.316915] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T19:25:41.420038] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:25:41.420558] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-22T19:25:41.420619] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-22T19:25:41.421738] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-22T19:25:41.421805] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-22T19:25:41.826775] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:25:42.122049] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-22T19:25:42.178920] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T19:25:42.638194] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-22T19:25:42.922058] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-22T19:25:43.658784] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T19:25:43.722048] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-22T19:25:44.163538] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T19:25:44.522064] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-22T19:25:44.965242] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-22T19:25:45.322058] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-22T19:25:46.061949] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T19:25:46.122064] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-22T19:25:46.922019] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-22T19:25:47.043731] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T19:25:47.722054] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-22T19:25:48.220287] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-22T19:25:48.225305] [INFO ] [REMOTE ] IGR: Full fetch complete (45834 records). [2025-09-22T19:25:48.225401] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-22T19:25:48.524191] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-22T19:25:48.617389] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-22T19:25:48.617491] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-22T19:25:48.618322] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-22T19:25:48.618401] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-22T19:25:48.619512] [DEBUG] [LOCAL ] IGR: Trimmed 45834 records to 30584 (keeping 200 days of data) [2025-09-22T19:25:48.719402] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T19:25:48.823033] [DEBUG] [LOCAL ] IGR: Primary data saved (30584 records). [2025-09-22T19:25:48.823168] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-22T19:25:48.823251] [INFO ] [MAIN ] Update Progress: 1099/2372 symbols completed. IGR took 31.2s. Estimated remaining: 2h 48m 50s. Rate: 7.5 symbols/min [2025-09-22T19:25:48.992492] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:25:49.035024] [DEBUG] [LOCAL ] IHS: Loaded 39559 existing records from primary storage. [2025-09-22T19:25:49.035164] [INFO ] [MAIN ] IHS: Loaded 39559 existing records. [2025-09-22T19:25:49.166836] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T19:25:49.226635] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:25:49.227809] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-22T19:25:49.227867] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-22T19:25:49.229359] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-22T19:25:49.229420] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-22T19:25:49.322009] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-22T19:25:49.583828] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:25:50.122060] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-22T19:25:50.599403] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T19:25:50.922089] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-22T19:25:51.615298] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T19:25:51.650968] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-22T19:25:51.721997] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-22T19:25:52.522027] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-22T19:25:52.907384] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T19:25:53.271410] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T19:25:53.322005] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-22T19:25:54.090966] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T19:25:54.122056] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-22T19:25:54.922034] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-22T19:25:55.309862] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T19:25:55.465310] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-22T19:25:55.722062] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-22T19:25:56.522081] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-22T19:25:56.789429] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T19:25:56.994172] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-22T19:25:57.322043] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-22T19:25:58.122080] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-22T19:25:58.650579] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T19:25:58.872914] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:25:58.922064] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-22T19:25:59.463954] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-22T19:25:59.466363] [INFO ] [REMOTE ] IHD: Full fetch complete (11968 records). [2025-09-22T19:25:59.466458] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-22T19:25:59.727218] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-22T19:25:59.843413] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-22T19:25:59.843503] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-22T19:25:59.843835] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-22T19:25:59.843898] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-22T19:25:59.844487] [DEBUG] [LOCAL ] IHD: Trimmed 11968 records to 7246 (keeping 200 days of data) [2025-09-22T19:25:59.888974] [DEBUG] [LOCAL ] IHD: Primary data saved (7246 records). [2025-09-22T19:25:59.889129] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-22T19:25:59.889220] [INFO ] [MAIN ] Update Progress: 1100/2372 symbols completed. IHD took 28.8s. Estimated remaining: 2h 48m 45s. Rate: 7.5 symbols/min [2025-09-22T19:26:00.058089] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:26:00.066804] [DEBUG] [LOCAL ] IIF: Loaded 5891 existing records from primary storage. [2025-09-22T19:26:00.066904] [INFO ] [MAIN ] IIF: Loaded 5891 existing records. [2025-09-22T19:26:00.248445] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:26:00.248768] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-22T19:26:00.248827] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-22T19:26:00.249205] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-22T19:26:00.249276] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-22T19:26:00.527211] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-22T19:26:00.629840] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:26:01.034884] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T19:26:01.322043] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-22T19:26:01.517249] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T19:26:02.122117] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-22T19:26:02.709571] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T19:26:02.919276] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T19:26:02.925256] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-22T19:26:03.683366] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T19:26:03.722049] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-22T19:26:04.512803] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T19:26:04.522007] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-22T19:26:05.322038] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-22T19:26:05.831982] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T19:26:05.894923] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T19:26:05.896056] [INFO ] [REMOTE ] IH: Full fetch complete (4930 records). [2025-09-22T19:26:05.896125] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-22T19:26:06.127158] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-22T19:26:06.264594] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-22T19:26:06.264693] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-22T19:26:06.264869] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-22T19:26:06.264974] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-22T19:26:06.265410] [DEBUG] [LOCAL ] IH: Trimmed 4930 records to 3545 (keeping 200 days of data) [2025-09-22T19:26:06.285450] [DEBUG] [LOCAL ] IH: Primary data saved (3545 records). [2025-09-22T19:26:06.285514] [INFO ] [MAIN ] IH: Full history saved. [2025-09-22T19:26:06.285583] [INFO ] [MAIN ] Update Progress: 1101/2372 symbols completed. IH took 44.4s. Estimated remaining: 2h 48m 35s. Rate: 7.5 symbols/min [2025-09-22T19:26:06.457314] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:26:06.482125] [DEBUG] [LOCAL ] IIIN: Loaded 17183 existing records from primary storage. [2025-09-22T19:26:06.482262] [INFO ] [MAIN ] IIIN: Loaded 17183 existing records. [2025-09-22T19:26:06.660059] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:26:06.660358] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-22T19:26:06.660435] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-22T19:26:06.661199] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-22T19:26:06.661261] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-22T19:26:06.927211] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-22T19:26:07.027251] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:26:07.722112] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-22T19:26:07.844601] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T19:26:07.941031] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T19:26:08.522080] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-22T19:26:08.794265] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T19:26:09.322075] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-22T19:26:09.721404] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T19:26:09.725503] [INFO ] [REMOTE ] IHG: Full fetch complete (33503 records). [2025-09-22T19:26:09.725677] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-22T19:26:10.102056] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-22T19:26:10.102142] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-22T19:26:10.102781] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-22T19:26:10.102843] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-22T19:26:10.103600] [DEBUG] [LOCAL ] IHG: Trimmed 33503 records to 24753 (keeping 200 days of data) [2025-09-22T19:26:10.167769] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-22T19:26:10.271670] [DEBUG] [LOCAL ] IHG: Primary data saved (24753 records). [2025-09-22T19:26:10.271820] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-22T19:26:10.271906] [INFO ] [MAIN ] Update Progress: 1102/2372 symbols completed. IHG took 29.3s. Estimated remaining: 2h 48m 23s. Rate: 7.5 symbols/min [2025-09-22T19:26:10.468924] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:26:10.485139] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T19:26:10.503184] [DEBUG] [LOCAL ] IIM: Loaded 16141 existing records from primary storage. [2025-09-22T19:26:10.503307] [INFO ] [MAIN ] IIM: Loaded 16141 existing records. [2025-09-22T19:26:10.683145] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:26:10.683410] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-22T19:26:10.683503] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-22T19:26:10.684148] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-22T19:26:10.684209] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-22T19:26:10.927195] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-22T19:26:11.006060] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T19:26:11.083427] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:26:11.722139] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-22T19:26:12.402427] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T19:26:12.522047] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-22T19:26:12.551302] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T19:26:13.322042] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-22T19:26:13.631227] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T19:26:14.122080] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-22T19:26:14.819446] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T19:26:14.922066] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-22T19:26:15.223481] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T19:26:15.722057] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-22T19:26:16.347716] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T19:26:16.377162] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T19:26:16.522077] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-22T19:26:17.322068] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-22T19:26:17.923710] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T19:26:17.929316] [INFO ] [REMOTE ] IHS: Full fetch complete (52512 records). [2025-09-22T19:26:17.929442] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-22T19:26:18.130936] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-22T19:26:18.413043] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-22T19:26:18.414182] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-22T19:26:18.414087] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T19:26:18.415368] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-22T19:26:18.420273] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-22T19:26:18.422502] [DEBUG] [LOCAL ] IHS: Trimmed 52512 records to 38999 (keeping 200 days of data) [2025-09-22T19:26:18.649886] [DEBUG] [LOCAL ] IHS: Primary data saved (38999 records). [2025-09-22T19:26:18.650063] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-22T19:26:18.650166] [INFO ] [MAIN ] Update Progress: 1103/2372 symbols completed. IHS took 29.8s. Estimated remaining: 2h 48m 15s. Rate: 7.5 symbols/min [2025-09-22T19:26:18.822797] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:26:18.854108] [DEBUG] [LOCAL ] IIPR: Loaded 30143 existing records from primary storage. [2025-09-22T19:26:18.854259] [INFO ] [MAIN ] IIPR: Loaded 30143 existing records. [2025-09-22T19:26:18.927209] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-22T19:26:19.043965] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:26:19.044337] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-22T19:26:19.044476] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-22T19:26:19.045511] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-22T19:26:19.045577] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-22T19:26:19.434465] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:26:19.448311] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T19:26:19.722081] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-22T19:26:19.853458] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-22T19:26:20.522082] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-22T19:26:20.813185] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T19:26:21.322031] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-22T19:26:21.400615] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T19:26:21.902499] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-22T19:26:22.122101] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-22T19:26:22.747962] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T19:26:22.922067] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-22T19:26:23.543558] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-22T19:26:23.722083] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-22T19:26:24.522032] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-22T19:26:24.832563] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T19:26:25.322073] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-22T19:26:25.343467] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-22T19:26:26.122059] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-22T19:26:26.813883] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T19:26:26.878728] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T19:26:26.922018] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-22T19:26:27.722075] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-22T19:26:28.279835] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T19:26:28.404456] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T19:26:28.522097] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-22T19:26:29.322052] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-22T19:26:29.511745] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-22T19:26:29.879609] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-22T19:26:30.122075] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-22T19:26:30.922055] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-22T19:26:31.211977] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T19:26:31.480786] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T19:26:31.481981] [INFO ] [REMOTE ] IIF: Full fetch complete (9654 records). [2025-09-22T19:26:31.482054] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-22T19:26:31.727158] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-22T19:26:31.879677] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-22T19:26:31.879806] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-22T19:26:31.880137] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-22T19:26:31.880198] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-22T19:26:31.880615] [DEBUG] [LOCAL ] IIF: Trimmed 9654 records to 5789 (keeping 200 days of data) [2025-09-22T19:26:31.915730] [DEBUG] [LOCAL ] IIF: Primary data saved (5789 records). [2025-09-22T19:26:31.915879] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-22T19:26:31.915966] [INFO ] [MAIN ] Update Progress: 1104/2372 symbols completed. IIF took 32.0s. Estimated remaining: 2h 48m 14s. Rate: 7.5 symbols/min [2025-09-22T19:26:32.096082] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:26:32.149303] [DEBUG] [LOCAL ] IMAX: Loaded 43331 existing records from primary storage. [2025-09-22T19:26:32.149442] [INFO ] [MAIN ] IMAX: Loaded 43331 existing records. [2025-09-22T19:26:32.326740] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:26:32.327032] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-22T19:26:32.327090] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-22T19:26:32.328274] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-22T19:26:32.328334] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-22T19:26:32.527310] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-22T19:26:32.629763] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T19:26:32.674896] [INFO ] [REMOTE ] IIIN: Full fetch complete (25209 records). [2025-09-22T19:26:32.682207] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-22T19:26:32.739195] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:26:33.133110] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-22T19:26:33.133189] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-22T19:26:33.133725] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-22T19:26:33.133785] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-22T19:26:33.135417] [DEBUG] [LOCAL ] IIIN: Trimmed 25209 records to 16813 (keeping 200 days of data) [2025-09-22T19:26:33.249622] [DEBUG] [LOCAL ] IIIN: Primary data saved (16813 records). [2025-09-22T19:26:33.249805] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-22T19:26:33.249893] [INFO ] [MAIN ] Update Progress: 1105/2372 symbols completed. IIIN took 27.0s. Estimated remaining: 2h 47m 58s. Rate: 7.5 symbols/min [2025-09-22T19:26:33.327173] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-22T19:26:33.421170] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:26:33.475743] [DEBUG] [LOCAL ] INFA: Loaded 50875 existing records from primary storage. [2025-09-22T19:26:33.475891] [INFO ] [MAIN ] INFA: Loaded 50875 existing records. [2025-09-22T19:26:33.653873] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:26:33.654128] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-22T19:26:33.654175] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-22T19:26:33.655413] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-22T19:26:33.655474] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-22T19:26:34.032593] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:26:34.060625] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T19:26:34.122015] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-22T19:26:34.149795] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T19:26:34.922070] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-22T19:26:35.158309] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-22T19:26:35.722085] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-22T19:26:35.824249] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T19:26:36.522055] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-22T19:26:36.910983] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-22T19:26:37.322105] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-22T19:26:37.448942] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T19:26:38.122068] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-22T19:26:38.698403] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T19:26:38.885528] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T19:26:38.922077] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-22T19:26:39.722074] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-22T19:26:40.146547] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T19:26:40.522067] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-22T19:26:41.120204] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T19:26:41.262122] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-22T19:26:41.322035] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-22T19:26:42.122026] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-22T19:26:42.434412] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T19:26:42.437801] [INFO ] [REMOTE ] IIM: Full fetch complete (25374 records). [2025-09-22T19:26:42.437880] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-22T19:26:42.812217] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-22T19:26:42.812319] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-22T19:26:42.812911] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-22T19:26:42.812975] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-22T19:26:42.813691] [DEBUG] [LOCAL ] IIM: Trimmed 25374 records to 15903 (keeping 200 days of data) [2025-09-22T19:26:42.911504] [DEBUG] [LOCAL ] IIM: Primary data saved (15903 records). [2025-09-22T19:26:42.911671] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-22T19:26:42.911779] [INFO ] [MAIN ] Update Progress: 1106/2372 symbols completed. IIM took 32.6s. Estimated remaining: 2h 47m 52s. Rate: 7.5 symbols/min [2025-09-22T19:26:42.927162] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-22T19:26:43.110925] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:26:43.173711] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-22T19:26:43.173861] [INFO ] [MAIN ] INFY: Loaded 54378 existing records. [2025-09-22T19:26:43.367805] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:26:43.368088] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-22T19:26:43.368155] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-22T19:26:43.369827] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-22T19:26:43.369904] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-22T19:26:43.688047] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T19:26:43.706257] [INFO ] [REMOTE ] IIPR: Full fetch complete (44074 records). [2025-09-22T19:26:43.721704] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-22T19:26:43.744320] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-22T19:26:43.799255] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:26:44.166963] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-22T19:26:44.167050] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-22T19:26:44.167857] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-22T19:26:44.167927] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-22T19:26:44.169090] [DEBUG] [LOCAL ] IIPR: Trimmed 44074 records to 29620 (keeping 200 days of data) [2025-09-22T19:26:44.354508] [DEBUG] [LOCAL ] IIPR: Primary data saved (29620 records). [2025-09-22T19:26:44.354666] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-22T19:26:44.354788] [INFO ] [MAIN ] Update Progress: 1107/2372 symbols completed. IIPR took 25.7s. Estimated remaining: 2h 47m 37s. Rate: 7.5 symbols/min [2025-09-22T19:26:44.532932] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:26:44.529326] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-22T19:26:44.556596] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T19:26:44.613063] [DEBUG] [LOCAL ] ING: Loaded 51617 existing records from primary storage. [2025-09-22T19:26:44.613206] [INFO ] [MAIN ] ING: Loaded 51617 existing records. [2025-09-22T19:26:44.791909] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:26:44.792162] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-22T19:26:44.792209] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-22T19:26:44.793464] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-22T19:26:44.793524] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-22T19:26:45.169661] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:26:45.245199] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T19:26:45.322060] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-22T19:26:46.122063] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-22T19:26:46.365772] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T19:26:46.922060] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-22T19:26:47.079692] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:26:47.727210] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-22T19:26:47.755959] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T19:26:48.522056] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-22T19:26:48.618037] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T19:26:49.322133] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-22T19:26:49.485820] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T19:26:49.862442] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T19:26:50.122063] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-22T19:26:50.922044] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-22T19:26:51.029815] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T19:26:51.492499] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T19:26:51.722061] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-22T19:26:52.522105] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-22T19:26:52.591401] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T19:26:53.322067] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-22T19:26:53.608132] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T19:26:54.122111] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-22T19:26:54.622175] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-22T19:26:54.922098] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-22T19:26:55.118107] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T19:26:55.722098] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-22T19:26:55.966711] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T19:26:56.522108] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-22T19:26:56.878287] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T19:26:57.199882] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T19:26:57.322062] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-22T19:26:58.122062] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-22T19:26:58.498398] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T19:26:58.922032] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-22T19:26:59.179811] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T19:26:59.432575] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T19:26:59.722091] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-22T19:27:00.084761] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T19:27:00.522057] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-22T19:27:01.323537] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-22T19:27:01.326997] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T19:27:02.122061] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-22T19:27:02.587001] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-22T19:27:02.922064] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-22T19:27:03.722110] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-22T19:27:03.834813] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-22T19:27:04.522087] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-22T19:27:04.656557] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T19:27:05.276349] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-09-22T19:27:05.322009] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-22T19:27:05.772337] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-22T19:27:06.122026] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-22T19:27:06.165367] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T19:27:06.667099] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T19:27:06.922070] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-22T19:27:07.692202] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T19:27:07.722022] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-22T19:27:08.308875] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T19:27:08.522092] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-22T19:27:08.997231] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T19:27:09.322077] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-22T19:27:09.983260] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T19:27:09.991335] [INFO ] [REMOTE ] ING: Full fetch complete (73634 records). [2025-09-22T19:27:09.991507] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-22T19:27:10.134320] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-22T19:27:10.396983] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-22T19:27:10.397090] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-22T19:27:10.398053] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-22T19:27:10.398116] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-22T19:27:10.399615] [DEBUG] [LOCAL ] ING: Trimmed 73634 records to 50823 (keeping 200 days of data) [2025-09-22T19:27:10.689288] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T19:27:10.775632] [DEBUG] [LOCAL ] ING: Primary data saved (50823 records). [2025-09-22T19:27:10.775797] [INFO ] [MAIN ] ING: Full history saved. [2025-09-22T19:27:10.775892] [INFO ] [MAIN ] Update Progress: 1108/2372 symbols completed. ING took 26.4s. Estimated remaining: 2h 47m 50s. Rate: 7.5 symbols/min [2025-09-22T19:27:10.923290] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-22T19:27:10.959445] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:27:10.992404] [DEBUG] [LOCAL ] INGM: Loaded 29659 existing records from primary storage. [2025-09-22T19:27:10.992569] [INFO ] [MAIN ] INGM: Loaded 29659 existing records. [2025-09-22T19:27:11.205047] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:27:11.205441] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-22T19:27:11.205540] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-22T19:27:11.206899] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-22T19:27:11.206993] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-22T19:27:11.581201] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:27:11.641713] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T19:27:11.722091] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-22T19:27:12.533794] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-22T19:27:12.540549] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T19:27:13.301313] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T19:27:13.308406] [INFO ] [REMOTE ] IMAX: Full fetch complete (59432 records). [2025-09-22T19:27:13.308545] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-22T19:27:13.330520] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-22T19:27:13.717514] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-22T19:27:13.717604] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-22T19:27:13.718509] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-22T19:27:13.718677] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-22T19:27:13.719919] [DEBUG] [LOCAL ] IMAX: Trimmed 59432 records to 42779 (keeping 200 days of data) [2025-09-22T19:27:13.973680] [DEBUG] [LOCAL ] IMAX: Primary data saved (42779 records). [2025-09-22T19:27:13.973815] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-22T19:27:13.973898] [INFO ] [MAIN ] Update Progress: 1109/2372 symbols completed. IMAX took 42.1s. Estimated remaining: 2h 47m 36s. Rate: 7.5 symbols/min [2025-09-22T19:27:14.125146] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-22T19:27:14.143695] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:27:14.184179] [DEBUG] [LOCAL ] INGR: Loaded 33927 existing records from primary storage. [2025-09-22T19:27:14.184314] [INFO ] [MAIN ] INGR: Loaded 33927 existing records. [2025-09-22T19:27:14.375264] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:27:14.375571] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-22T19:27:14.375621] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-22T19:27:14.376574] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-22T19:27:14.376788] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-22T19:27:14.886923] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:27:14.922112] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-22T19:27:15.049759] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-22T19:27:15.058404] [INFO ] [REMOTE ] INFA: Full fetch complete (71925 records). [2025-09-22T19:27:15.058614] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-22T19:27:15.571784] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-22T19:27:15.571919] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-22T19:27:15.573490] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-22T19:27:15.573592] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-22T19:27:15.575774] [DEBUG] [LOCAL ] INFA: Trimmed 71925 records to 50099 (keeping 200 days of data) [2025-09-22T19:27:15.987731] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T19:27:15.998246] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-22T19:27:16.003761] [DEBUG] [LOCAL ] INFA: Primary data saved (50099 records). [2025-09-22T19:27:16.004639] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-22T19:27:16.005040] [INFO ] [MAIN ] Update Progress: 1110/2372 symbols completed. INFA took 42.8s. Estimated remaining: 2h 47m 22s. Rate: 7.5 symbols/min [2025-09-22T19:27:16.143547] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T19:27:16.225475] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:27:16.265349] [DEBUG] [LOCAL ] INN: Loaded 42564 existing records from primary storage. [2025-09-22T19:27:16.265562] [INFO ] [MAIN ] INN: Loaded 42564 existing records. [2025-09-22T19:27:16.453000] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:27:16.453350] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-22T19:27:16.453532] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-22T19:27:16.454702] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-22T19:27:16.454767] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-22T19:27:16.523346] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-22T19:27:16.668273] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-22T19:27:16.768405] [INFO ] [REMOTE ] INFY: Full fetch complete (77535 records). [2025-09-22T19:27:16.792177] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-22T19:27:16.964688] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:27:17.209739] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T19:27:17.305362] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-22T19:27:17.305443] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-22T19:27:17.306448] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-22T19:27:17.306512] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-22T19:27:17.308008] [DEBUG] [LOCAL ] INFY: Trimmed 77535 records to 53601 (keeping 200 days of data) [2025-09-22T19:27:17.362051] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-22T19:27:17.631482] [DEBUG] [LOCAL ] INFY: Primary data saved (53601 records). [2025-09-22T19:27:17.631615] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-22T19:27:17.631725] [INFO ] [MAIN ] Update Progress: 1111/2372 symbols completed. INFY took 34.7s. Estimated remaining: 2h 47m 6s. Rate: 7.5 symbols/min [2025-09-22T19:27:17.805183] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:27:17.805397] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-22T19:27:17.805495] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-22T19:27:17.805936] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-22T19:27:17.805993] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-22T19:27:17.812508] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-22T19:27:17.827860] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-22T19:27:17.893779] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T19:27:18.127137] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-22T19:27:18.198060] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:27:18.592428] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T19:27:18.922114] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-22T19:27:19.709029] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T19:27:19.721999] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-22T19:27:20.186582] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T19:27:20.522113] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-22T19:27:20.732680] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:27:20.733037] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-22T19:27:21.236564] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T19:27:21.322031] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-22T19:27:22.122093] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-22T19:27:22.771825] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T19:27:22.922064] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-22T19:27:23.146299] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-22T19:27:23.722057] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-22T19:27:24.254246] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T19:27:24.522101] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-22T19:27:24.893746] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-22T19:27:25.322068] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-22T19:27:25.413996] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T19:27:26.122063] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-22T19:27:26.922060] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-22T19:27:27.525476] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-22T19:27:27.658423] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T19:27:27.722066] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-22T19:27:28.522052] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-22T19:27:28.641079] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T19:27:28.887206] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T19:27:29.322054] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-22T19:27:29.678927] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T19:27:30.122088] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-22T19:27:30.630480] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T19:27:30.922056] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-22T19:27:31.524929] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:27:31.722087] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-22T19:27:32.327711] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T19:27:32.522063] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-22T19:27:33.139595] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T19:27:33.322056] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-22T19:27:34.069037] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T19:27:34.075605] [INFO ] [REMOTE ] INGR: Full fetch complete (49744 records). [2025-09-22T19:27:34.075852] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-22T19:27:34.127189] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-22T19:27:34.526387] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-22T19:27:34.526539] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-22T19:27:34.527703] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-22T19:27:34.527802] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-22T19:27:34.545678] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T19:27:34.551584] [DEBUG] [LOCAL ] INGR: Trimmed 49744 records to 33393 (keeping 200 days of data) [2025-09-22T19:27:34.781344] [DEBUG] [LOCAL ] INGR: Primary data saved (33393 records). [2025-09-22T19:27:34.781503] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-22T19:27:34.781631] [INFO ] [MAIN ] Update Progress: 1112/2372 symbols completed. INGR took 20.8s. Estimated remaining: 2h 47m 9s. Rate: 7.5 symbols/min [2025-09-22T19:27:34.932001] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-22T19:27:35.016799] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:27:35.055721] [DEBUG] [LOCAL ] INSP: Loaded 37158 existing records from primary storage. [2025-09-22T19:27:35.055926] [INFO ] [MAIN ] INSP: Loaded 37158 existing records. [2025-09-22T19:27:35.254701] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:27:35.255238] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-22T19:27:35.255320] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-22T19:27:35.256188] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-22T19:27:35.256257] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-22T19:27:35.630054] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:27:35.728001] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-22T19:27:35.748337] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T19:27:36.109083] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T19:27:36.522100] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-22T19:27:37.098244] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T19:27:37.322067] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-22T19:27:37.728814] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T19:27:38.122091] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-22T19:27:38.601823] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T19:27:38.922051] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-22T19:27:39.722055] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-22T19:27:39.781060] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T19:27:39.924877] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T19:27:40.522061] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-22T19:27:40.558101] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T19:27:41.322078] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-22T19:27:42.122067] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-22T19:27:42.189836] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T19:27:42.387900] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T19:27:42.392091] [INFO ] [REMOTE ] INGM: Full fetch complete (42045 records). [2025-09-22T19:27:42.392197] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-22T19:27:42.776148] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-22T19:27:42.776245] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-22T19:27:42.777314] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-22T19:27:42.777378] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-22T19:27:42.782828] [DEBUG] [LOCAL ] INGM: Trimmed 42045 records to 28926 (keeping 200 days of data) [2025-09-22T19:27:42.935548] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-22T19:27:42.969075] [DEBUG] [LOCAL ] INGM: Primary data saved (28926 records). [2025-09-22T19:27:42.969188] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-22T19:27:42.969307] [INFO ] [MAIN ] Update Progress: 1113/2372 symbols completed. INGM took 32.2s. Estimated remaining: 2h 47m 1s. Rate: 7.5 symbols/min [2025-09-22T19:27:43.148491] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:27:43.192597] [DEBUG] [LOCAL ] INSW: Loaded 41250 existing records from primary storage. [2025-09-22T19:27:43.197976] [INFO ] [MAIN ] INSW: Loaded 41250 existing records. [2025-09-22T19:27:43.283496] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T19:27:43.394410] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:27:43.394724] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-22T19:27:43.394784] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-22T19:27:43.395708] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-22T19:27:43.395782] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-22T19:27:43.727240] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-22T19:27:43.765445] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:27:44.382715] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T19:27:44.522056] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-22T19:27:44.856949] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T19:27:45.322081] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-22T19:27:45.694791] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T19:27:46.122112] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-22T19:27:46.922059] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-22T19:27:47.018428] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T19:27:47.121250] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T19:27:47.722113] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-22T19:27:47.939184] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-22T19:27:48.522086] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-22T19:27:49.308918] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T19:27:49.322004] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-22T19:27:49.738207] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T19:27:49.742784] [INFO ] [REMOTE ] INR: Full fetch complete (32679 records). [2025-09-22T19:27:49.742874] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-22T19:27:49.944697] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 161 unique days, need 200 days [2025-09-22T19:27:49.945238] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:27:49.945322] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:27:49.945395] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-22T19:27:49.945476] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-22T19:27:49.945553] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-22T19:27:49.945634] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-22T19:27:49.945910] [INFO ] [MAIN ] Update Progress: 1114/2372 symbols completed. INR took 32.3s. Estimated remaining: 2h 46m 52s. Rate: 7.5 symbols/min [2025-09-22T19:27:50.114171] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:27:50.122037] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-22T19:27:50.191515] [DEBUG] [LOCAL ] INVH: Loaded 53917 existing records from primary storage. [2025-09-22T19:27:50.191718] [INFO ] [MAIN ] INVH: Loaded 53917 existing records. [2025-09-22T19:27:50.373899] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:27:50.374183] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-22T19:27:50.374237] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-22T19:27:50.375739] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-22T19:27:50.375806] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-22T19:27:50.761053] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:27:50.785707] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T19:27:50.922010] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-22T19:27:51.419174] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T19:27:51.722074] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-22T19:27:52.522083] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-22T19:27:52.573444] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T19:27:53.079164] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T19:27:53.322055] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-22T19:27:54.122045] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-22T19:27:54.154798] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T19:27:54.892103] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T19:27:54.922023] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-22T19:27:55.528510] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T19:27:55.722124] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-22T19:27:56.327218] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T19:27:56.522127] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-22T19:27:57.132451] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T19:27:57.322068] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-22T19:27:58.021617] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T19:27:58.029605] [INFO ] [REMOTE ] INN: Full fetch complete (57836 records). [2025-09-22T19:27:58.029780] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-22T19:27:58.131716] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-22T19:27:58.441670] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-22T19:27:58.441847] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-22T19:27:58.442729] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-22T19:27:58.442814] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-22T19:27:58.444480] [DEBUG] [LOCAL ] INN: Trimmed 57836 records to 41951 (keeping 200 days of data) [2025-09-22T19:27:58.471377] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T19:27:58.724836] [DEBUG] [LOCAL ] INN: Primary data saved (41951 records). [2025-09-22T19:27:58.724970] [INFO ] [MAIN ] INN: Full history saved. [2025-09-22T19:27:58.725098] [INFO ] [MAIN ] Update Progress: 1115/2372 symbols completed. INN took 42.7s. Estimated remaining: 2h 46m 45s. Rate: 7.5 symbols/min [2025-09-22T19:27:58.894769] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:27:58.926247] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-22T19:27:58.928421] [DEBUG] [LOCAL ] INVX: Loaded 29676 existing records from primary storage. [2025-09-22T19:27:58.928597] [INFO ] [MAIN ] INVX: Loaded 29676 existing records. [2025-09-22T19:27:59.117366] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:27:59.117723] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-22T19:27:59.117782] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-22T19:27:59.118627] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-22T19:27:59.118733] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-22T19:27:59.477606] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:27:59.563859] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T19:27:59.722034] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-22T19:28:00.522073] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-22T19:28:00.724106] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T19:28:01.248470] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T19:28:01.322022] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-22T19:28:01.766500] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T19:28:02.122068] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-22T19:28:02.527209] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T19:28:02.922093] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-22T19:28:03.722115] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-22T19:28:03.770818] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T19:28:04.363329] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T19:28:04.370529] [INFO ] [REMOTE ] INSP: Full fetch complete (52240 records). [2025-09-22T19:28:04.370719] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-22T19:28:04.527271] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-22T19:28:04.780116] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-22T19:28:04.780293] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-22T19:28:04.781369] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-22T19:28:04.781553] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-22T19:28:04.783354] [DEBUG] [LOCAL ] INSP: Trimmed 52240 records to 36812 (keeping 200 days of data) [2025-09-22T19:28:04.902597] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T19:28:05.059460] [DEBUG] [LOCAL ] INSP: Primary data saved (36812 records). [2025-09-22T19:28:05.059623] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-22T19:28:05.059792] [INFO ] [MAIN ] Update Progress: 1116/2372 symbols completed. INSP took 30.3s. Estimated remaining: 2h 46m 35s. Rate: 7.5 symbols/min [2025-09-22T19:28:05.236798] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:28:05.299884] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-22T19:28:05.300119] [INFO ] [MAIN ] IONQ: Loaded 54568 existing records. [2025-09-22T19:28:05.327292] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-22T19:28:05.489230] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:28:05.489508] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-22T19:28:05.489560] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-22T19:28:05.492054] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-22T19:28:05.492147] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-22T19:28:05.850116] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:28:06.122082] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-22T19:28:06.399393] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T19:28:06.635444] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T19:28:06.922071] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-22T19:28:07.722133] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-22T19:28:08.522095] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-22T19:28:08.806482] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T19:28:08.902081] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-22T19:28:09.060988] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T19:28:09.322083] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-22T19:28:10.093324] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T19:28:10.122022] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-22T19:28:10.922079] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-22T19:28:11.712147] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-22T19:28:11.722179] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-22T19:28:11.812903] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T19:28:11.821878] [INFO ] [REMOTE ] INSW: Full fetch complete (60889 records). [2025-09-22T19:28:11.821999] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-22T19:28:12.204165] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-22T19:28:12.204241] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-22T19:28:12.205082] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-22T19:28:12.205145] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-22T19:28:12.206347] [DEBUG] [LOCAL ] INSW: Trimmed 60889 records to 40407 (keeping 200 days of data) [2025-09-22T19:28:12.461062] [DEBUG] [LOCAL ] INSW: Primary data saved (40407 records). [2025-09-22T19:28:12.461210] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-22T19:28:12.461328] [INFO ] [MAIN ] Update Progress: 1117/2372 symbols completed. INSW took 29.5s. Estimated remaining: 2h 46m 27s. Rate: 7.5 symbols/min [2025-09-22T19:28:12.522010] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-22T19:28:12.663876] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T19:28:12.917889] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T19:28:13.322064] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-22T19:28:14.122171] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-22T19:28:14.809342] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-22T19:28:14.845180] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T19:28:14.922020] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-22T19:28:15.722098] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-22T19:28:15.942564] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T19:28:16.227943] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T19:28:16.522121] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-22T19:28:17.322057] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-22T19:28:18.144577] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-22T19:28:18.157757] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-22T19:28:18.184225] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T19:28:18.281508] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T19:28:18.922137] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-22T19:28:19.722107] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-22T19:28:19.972413] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T19:28:20.522058] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-22T19:28:20.931403] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-22T19:28:21.260304] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T19:28:21.269069] [INFO ] [REMOTE ] INVH: Full fetch complete (76677 records). [2025-09-22T19:28:21.269248] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-22T19:28:21.334101] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-22T19:28:21.674264] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-22T19:28:21.674490] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-22T19:28:21.675590] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-22T19:28:21.675702] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-22T19:28:21.695407] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T19:28:21.702991] [DEBUG] [LOCAL ] INVH: Trimmed 76677 records to 53139 (keeping 200 days of data) [2025-09-22T19:28:22.035338] [DEBUG] [LOCAL ] INVH: Primary data saved (53139 records). [2025-09-22T19:28:22.035535] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-22T19:28:22.035673] [INFO ] [MAIN ] Update Progress: 1118/2372 symbols completed. INVH took 32.1s. Estimated remaining: 2h 46m 21s. Rate: 7.5 symbols/min [2025-09-22T19:28:22.122165] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-22T19:28:23.203624] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T19:28:23.208419] [INFO ] [REMOTE ] INVX: Full fetch complete (44455 records). [2025-09-22T19:28:23.208561] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-22T19:28:23.649714] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-22T19:28:23.649866] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-22T19:28:23.650907] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-22T19:28:23.650998] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-22T19:28:23.652959] [DEBUG] [LOCAL ] INVX: Trimmed 44455 records to 28990 (keeping 200 days of data) [2025-09-22T19:28:23.795382] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-22T19:28:23.812076] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-22T19:28:23.889418] [DEBUG] [LOCAL ] INVX: Primary data saved (28990 records). [2025-09-22T19:28:23.889681] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-22T19:28:23.889820] [INFO ] [MAIN ] Update Progress: 1119/2372 symbols completed. INVX took 25.2s. Estimated remaining: 2h 46m 6s. Rate: 7.5 symbols/min [2025-09-22T19:28:26.186711] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-22T19:28:26.197738] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-22T19:28:28.992173] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-22T19:28:29.004386] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-22T19:28:31.634820] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-22T19:28:31.646496] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-22T19:28:34.328034] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-22T19:28:34.336302] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-22T19:28:34.336418] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-22T19:28:34.731060] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-22T19:28:34.731144] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-22T19:28:34.732101] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-22T19:28:34.732164] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-22T19:28:34.733562] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-09-22T19:28:35.050706] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-09-22T19:28:35.050839] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-22T19:28:35.050932] [INFO ] [MAIN ] Update Progress: 1120/2372 symbols completed. IONQ took 30.0s. Estimated remaining: 2h 46m 1s. Rate: 7.5 symbols/min [2025-09-22T19:28:35.540753] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:28:35.656112] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:28:35.687534] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:28:35.751025] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:28:35.771224] [DEBUG] [LOCAL ] IPI: Loaded 21673 existing records from primary storage. [2025-09-22T19:28:35.771415] [INFO ] [MAIN ] IPI: Loaded 21673 existing records. [2025-09-22T19:28:36.026191] [DEBUG] [LOCAL ] IOT: Loaded 54252 existing records from primary storage. [2025-09-22T19:28:36.033592] [INFO ] [MAIN ] IOT: Loaded 54252 existing records. [2025-09-22T19:28:36.033371] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:28:36.093288] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-22T19:28:36.099757] [DEBUG] [LOCAL ] IPG: Loaded 54113 existing records from primary storage. [2025-09-22T19:28:36.117867] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-22T19:28:36.123232] [INFO ] [MAIN ] IPG: Loaded 54113 existing records. [2025-09-22T19:28:36.128978] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-22T19:28:36.134343] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-22T19:28:36.213052] [DEBUG] [LOCAL ] IP: Loaded 54109 existing records from primary storage. [2025-09-22T19:28:36.235016] [INFO ] [MAIN ] IP: Loaded 54109 existing records. [2025-09-22T19:28:36.554245] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:28:36.585852] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-22T19:28:36.591127] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-22T19:28:36.668293] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-22T19:28:36.674311] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-22T19:28:36.885552] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:28:36.950073] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-22T19:28:36.965682] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:28:37.020911] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-22T19:28:37.020991] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-22T19:28:37.026289] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-22T19:28:37.044506] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-22T19:28:37.049773] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-22T19:28:37.044460] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-22T19:28:37.108547] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-22T19:28:37.413142] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:28:37.449695] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-22T19:28:37.814975] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:28:37.834252] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-22T19:28:38.150414] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:28:38.167378] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-22T19:28:38.170606] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:28:38.170880] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-22T19:28:38.690169] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T19:28:38.695080] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-22T19:28:39.436471] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T19:28:39.440360] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-22T19:28:39.596580] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:28:39.607906] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-22T19:28:39.691532] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T19:28:39.702727] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-22T19:28:40.000437] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T19:28:40.011190] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-22T19:28:40.414886] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T19:28:40.419176] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-22T19:28:41.163295] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T19:28:41.173896] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-22T19:28:41.328559] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T19:28:41.340222] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-22T19:28:41.423396] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T19:28:41.434348] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-22T19:28:41.554200] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T19:28:41.559636] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-22T19:28:42.445777] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T19:28:42.451155] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-22T19:28:42.660159] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T19:28:42.670478] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-22T19:28:42.931515] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T19:28:42.942497] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-22T19:28:42.971304] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T19:28:42.981496] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-22T19:28:48.131937] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (5.46 seconds). [2025-09-22T19:28:48.143726] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-22T19:28:48.380618] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (5.93 seconds). [2025-09-22T19:28:48.386615] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-22T19:28:48.949371] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (6.01 seconds). [2025-09-22T19:28:48.961050] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-22T19:28:48.992470] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (6.01 seconds). [2025-09-22T19:28:49.004003] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-22T19:28:49.339999] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T19:28:49.345501] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-22T19:28:49.665783] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T19:28:49.678101] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-22T19:28:50.036835] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T19:28:50.041910] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-22T19:28:50.629111] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T19:28:50.641690] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-22T19:28:50.740064] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T19:28:50.751465] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-22T19:28:51.072203] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-22T19:28:51.077156] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-22T19:28:51.527457] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T19:28:51.538825] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-22T19:28:52.112754] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T19:28:52.125161] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-22T19:28:52.159259] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T19:28:52.164452] [INFO ] [REMOTE ] IPI: Full fetch complete (28892 records). [2025-09-22T19:28:52.164730] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-22T19:28:52.287897] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T19:28:52.332062] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-22T19:28:52.598942] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-22T19:28:52.599026] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-22T19:28:52.599624] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-22T19:28:52.599698] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-22T19:28:52.600459] [DEBUG] [LOCAL ] IPI: Trimmed 28892 records to 21232 (keeping 200 days of data) [2025-09-22T19:28:52.724428] [DEBUG] [LOCAL ] IPI: Primary data saved (21232 records). [2025-09-22T19:28:52.724561] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-22T19:28:52.724663] [INFO ] [MAIN ] Update Progress: 1121/2372 symbols completed. IPI took 17.7s. Estimated remaining: 2h 46m 4s. Rate: 7.5 symbols/min [2025-09-22T19:28:52.896548] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:28:52.914675] [DEBUG] [LOCAL ] IQI: Loaded 18200 existing records from primary storage. [2025-09-22T19:28:52.914811] [INFO ] [MAIN ] IQI: Loaded 18200 existing records. [2025-09-22T19:28:53.096282] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:28:53.096754] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-22T19:28:53.096845] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-22T19:28:53.097526] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-22T19:28:53.097587] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-22T19:28:53.464869] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:28:53.482986] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-22T19:28:53.499941] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T19:28:53.512148] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-22T19:28:54.188673] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-22T19:28:54.199702] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-22T19:28:54.367224] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-22T19:28:54.378252] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-22T19:28:54.637522] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T19:28:54.642562] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-22T19:28:55.079797] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T19:28:55.095842] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-22T19:28:55.382856] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T19:28:55.722037] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-22T19:28:55.804825] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T19:28:56.184323] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T19:28:56.522031] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-22T19:28:56.651109] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T19:28:56.772828] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-22T19:28:57.322074] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-22T19:28:58.122059] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-22T19:28:58.480929] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T19:28:58.922028] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-22T19:28:59.077608] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T19:28:59.523355] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T19:28:59.531993] [INFO ] [REMOTE ] IPG: Full fetch complete (77248 records). [2025-09-22T19:28:59.532145] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-22T19:28:59.731516] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-22T19:28:59.938799] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-22T19:28:59.938881] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-22T19:28:59.939846] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-22T19:28:59.939911] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-22T19:28:59.941441] [DEBUG] [LOCAL ] IPG: Trimmed 77248 records to 53332 (keeping 200 days of data) [2025-09-22T19:29:00.281200] [DEBUG] [LOCAL ] IPG: Primary data saved (53332 records). [2025-09-22T19:29:00.281376] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-22T19:29:00.281478] [INFO ] [MAIN ] Update Progress: 1122/2372 symbols completed. IPG took 25.2s. Estimated remaining: 2h 45m 56s. Rate: 7.5 symbols/min [2025-09-22T19:29:00.452801] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:29:00.509948] [DEBUG] [LOCAL ] IQV: Loaded 51146 existing records from primary storage. [2025-09-22T19:29:00.510093] [INFO ] [MAIN ] IQV: Loaded 51146 existing records. [2025-09-22T19:29:00.531764] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-22T19:29:00.714272] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:29:00.715904] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T19:29:00.720078] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-22T19:29:00.720185] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-22T19:29:00.722133] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-22T19:29:00.722199] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-22T19:29:00.924620] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T19:29:01.032256] [INFO ] [REMOTE ] IOT: Full fetch complete (77378 records). [2025-09-22T19:29:01.043031] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-22T19:29:01.258948] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:29:01.327263] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-22T19:29:01.638486] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-22T19:29:01.638621] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-22T19:29:01.640475] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-22T19:29:01.640599] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-22T19:29:01.642791] [DEBUG] [LOCAL ] IOT: Trimmed 77378 records to 53472 (keeping 200 days of data) [2025-09-22T19:29:02.111370] [DEBUG] [LOCAL ] IOT: Primary data saved (53472 records). [2025-09-22T19:29:02.111638] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-22T19:29:02.111813] [INFO ] [MAIN ] Update Progress: 1123/2372 symbols completed. IOT took 27.1s. Estimated remaining: 2h 45m 41s. Rate: 7.5 symbols/min [2025-09-22T19:29:02.129518] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-22T19:29:02.374624] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:29:02.399185] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T19:29:02.451134] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-22T19:29:02.462521] [INFO ] [REMOTE ] IP: Full fetch complete (77044 records). [2025-09-22T19:29:02.462966] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-22T19:29:02.854438] [DEBUG] [LOCAL ] IR: Loaded 53476 existing records from primary storage. [2025-09-22T19:29:02.858368] [INFO ] [MAIN ] IR: Loaded 53476 existing records. [2025-09-22T19:29:02.932865] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-22T19:29:03.135265] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-22T19:29:03.150936] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-22T19:29:03.152332] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-22T19:29:03.161432] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-22T19:29:03.162005] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:29:03.163035] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-22T19:29:03.163349] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-22T19:29:03.163906] [DEBUG] [LOCAL ] IP: Trimmed 77044 records to 53326 (keeping 200 days of data) [2025-09-22T19:29:03.165501] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-22T19:29:03.165599] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-22T19:29:03.706440] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:29:03.768805] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-22T19:29:03.885406] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:29:03.981543] [DEBUG] [LOCAL ] IP: Primary data saved (53326 records). [2025-09-22T19:29:03.981764] [INFO ] [MAIN ] IP: Full history saved. [2025-09-22T19:29:03.981891] [INFO ] [MAIN ] Update Progress: 1124/2372 symbols completed. IP took 28.9s. Estimated remaining: 2h 45m 26s. Rate: 7.5 symbols/min [2025-09-22T19:29:04.127366] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-22T19:29:04.205860] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:29:04.255829] [DEBUG] [LOCAL ] IRM: Loaded 50281 existing records from primary storage. [2025-09-22T19:29:04.256019] [INFO ] [MAIN ] IRM: Loaded 50281 existing records. [2025-09-22T19:29:04.445364] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:29:04.445703] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-22T19:29:04.445761] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-22T19:29:04.447332] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-22T19:29:04.447395] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-22T19:29:04.527349] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-22T19:29:04.838948] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:29:05.322062] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-22T19:29:05.528954] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T19:29:05.653725] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T19:29:06.122106] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-22T19:29:06.922051] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-22T19:29:07.058089] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T19:29:07.466757] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T19:29:07.722094] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-22T19:29:08.432506] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T19:29:08.522042] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-22T19:29:08.767720] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T19:29:09.322083] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-22T19:29:10.110606] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T19:29:10.122003] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-22T19:29:10.671733] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T19:29:10.922140] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-22T19:29:11.024735] [DEBUG] [REMOTE ] IQI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-22T19:29:11.025208] [WARN ] [REMOTE ] IQI: No data returned for month 2025-08 [2025-09-22T19:29:11.722036] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-22T19:29:11.895226] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T19:29:12.522074] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-22T19:29:12.867163] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T19:29:12.870401] [INFO ] [REMOTE ] IQI: Full fetch complete (24028 records). [2025-09-22T19:29:12.870477] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-22T19:29:13.058064] [WARN ] [VALIDATOR ] IQI: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-22T19:29:13.058477] [FATAL] [MAIN ] IQI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:29:13.058552] [WARN ] [MAIN ] IQI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:29:13.058612] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-22T19:29:13.058743] [DEBUG] [LOCAL ] IQI: No primary data file found to delete. [2025-09-22T19:29:13.058799] [INFO ] [LOCAL ] IQI: Starting deletion of derivative data. [2025-09-22T19:29:13.059356] [DEBUG] [LOCAL ] IQI: Deleted derivative data file. [2025-09-22T19:29:13.059464] [INFO ] [MAIN ] Update Progress: 1125/2372 symbols completed. IQI took 20.3s. Estimated remaining: 2h 45m 20s. Rate: 7.5 symbols/min [2025-09-22T19:29:13.232837] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:29:13.254542] [DEBUG] [LOCAL ] IRS: Loaded 21712 existing records from primary storage. [2025-09-22T19:29:13.254700] [INFO ] [MAIN ] IRS: Loaded 21712 existing records. [2025-09-22T19:29:13.330230] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-22T19:29:13.438820] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:29:13.439051] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-22T19:29:13.439099] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-22T19:29:13.439830] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-22T19:29:13.439890] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-22T19:29:13.802630] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:29:14.122023] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-22T19:29:14.179491] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T19:29:14.763621] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T19:29:14.922060] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-22T19:29:15.722043] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-22T19:29:16.048164] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T19:29:16.378331] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T19:29:16.487546] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T19:29:16.522017] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-22T19:29:17.322071] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-22T19:29:18.122075] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-22T19:29:18.227845] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T19:29:18.912248] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T19:29:18.923761] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-22T19:29:19.661529] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T19:29:19.722056] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-22T19:29:20.522067] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-22T19:29:20.761290] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T19:29:21.289737] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T19:29:21.322012] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-22T19:29:22.122051] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-22T19:29:22.178460] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T19:29:22.922062] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-22T19:29:23.021335] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T19:29:23.289411] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T19:29:23.722076] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-22T19:29:24.504632] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T19:29:24.522018] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-22T19:29:25.268208] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T19:29:25.322075] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-22T19:29:26.122022] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-22T19:29:26.209901] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T19:29:26.922044] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-22T19:29:27.090623] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T19:29:27.722072] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-22T19:29:27.869904] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T19:29:28.356400] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T19:29:28.522060] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-22T19:29:29.163371] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T19:29:29.170775] [INFO ] [REMOTE ] IQV: Full fetch complete (72439 records). [2025-09-22T19:29:29.170934] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-22T19:29:29.334550] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-22T19:29:29.573505] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-22T19:29:29.573597] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-22T19:29:29.574813] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-22T19:29:29.574881] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-22T19:29:29.576430] [DEBUG] [LOCAL ] IQV: Trimmed 72439 records to 50377 (keeping 200 days of data) [2025-09-22T19:29:29.888912] [DEBUG] [LOCAL ] IQV: Primary data saved (50377 records). [2025-09-22T19:29:29.889079] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-22T19:29:29.889172] [INFO ] [MAIN ] Update Progress: 1126/2372 symbols completed. IQV took 29.6s. Estimated remaining: 2h 45m 22s. Rate: 7.5 symbols/min [2025-09-22T19:29:30.091278] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:29:30.122053] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-22T19:29:30.143119] [DEBUG] [LOCAL ] IRT: Loaded 51127 existing records from primary storage. [2025-09-22T19:29:30.143271] [INFO ] [MAIN ] IRT: Loaded 51127 existing records. [2025-09-22T19:29:30.332199] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:29:30.332767] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-22T19:29:30.332843] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-22T19:29:30.334318] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-22T19:29:30.334384] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-22T19:29:30.487326] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-22T19:29:30.738407] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T19:29:30.781249] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:29:30.922030] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-22T19:29:31.607476] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T19:29:31.722052] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-22T19:29:32.480837] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T19:29:32.522060] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-22T19:29:33.261230] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T19:29:33.271009] [INFO ] [REMOTE ] IRM: Full fetch complete (72294 records). [2025-09-22T19:29:33.271201] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-22T19:29:33.329728] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-22T19:29:33.669562] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-22T19:29:33.669680] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-22T19:29:33.670611] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-22T19:29:33.670688] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-22T19:29:33.673736] [DEBUG] [LOCAL ] IRM: Trimmed 72294 records to 49510 (keeping 200 days of data) [2025-09-22T19:29:33.982853] [DEBUG] [LOCAL ] IRM: Primary data saved (49510 records). [2025-09-22T19:29:33.982996] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-22T19:29:33.983079] [INFO ] [MAIN ] Update Progress: 1127/2372 symbols completed. IRM took 30.0s. Estimated remaining: 2h 45m 9s. Rate: 7.5 symbols/min [2025-09-22T19:29:34.132077] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-22T19:29:34.166276] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:29:34.201913] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T19:29:34.223338] [DEBUG] [LOCAL ] ISD: Loaded 16019 existing records from primary storage. [2025-09-22T19:29:34.223478] [INFO ] [MAIN ] ISD: Loaded 16019 existing records. [2025-09-22T19:29:34.406848] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:29:34.407176] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-22T19:29:34.407233] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-22T19:29:34.407855] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-22T19:29:34.407916] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-22T19:29:34.767277] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:29:34.922005] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-22T19:29:35.056065] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T19:29:35.067840] [INFO ] [REMOTE ] IR: Full fetch complete (76054 records). [2025-09-22T19:29:35.067997] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-22T19:29:35.352522] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T19:29:35.492277] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-22T19:29:35.492357] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-22T19:29:35.493316] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-22T19:29:35.493401] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-22T19:29:35.495583] [DEBUG] [LOCAL ] IR: Trimmed 76054 records to 52696 (keeping 200 days of data) [2025-09-22T19:29:35.726226] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-22T19:29:35.831477] [DEBUG] [LOCAL ] IR: Primary data saved (52696 records). [2025-09-22T19:29:35.831721] [INFO ] [MAIN ] IR: Full history saved. [2025-09-22T19:29:35.831860] [INFO ] [MAIN ] Update Progress: 1128/2372 symbols completed. IR took 33.7s. Estimated remaining: 2h 44m 55s. Rate: 7.5 symbols/min [2025-09-22T19:29:36.029437] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:29:36.031073] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T19:29:36.079417] [DEBUG] [LOCAL ] IT: Loaded 41777 existing records from primary storage. [2025-09-22T19:29:36.079603] [INFO ] [MAIN ] IT: Loaded 41777 existing records. [2025-09-22T19:29:36.257824] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:29:36.258180] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-22T19:29:36.258249] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-22T19:29:36.259559] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-22T19:29:36.259636] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-22T19:29:36.528369] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-22T19:29:36.619923] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:29:36.976815] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-22T19:29:37.322043] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-22T19:29:37.385136] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T19:29:38.122069] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-22T19:29:38.763629] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T19:29:38.845797] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-22T19:29:38.922096] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-22T19:29:39.722106] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-22T19:29:39.934789] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T19:29:40.522069] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-22T19:29:40.648527] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-22T19:29:41.322023] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-22T19:29:41.454570] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T19:29:42.122122] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-22T19:29:42.922061] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-22T19:29:42.991701] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T19:29:43.222272] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T19:29:43.722053] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-22T19:29:44.260617] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T19:29:44.522077] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-22T19:29:45.322055] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-22T19:29:45.517051] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T19:29:45.543845] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T19:29:46.122145] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-22T19:29:46.289538] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T19:29:46.922106] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-22T19:29:47.273981] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T19:29:47.722090] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-22T19:29:48.189265] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T19:29:48.194933] [INFO ] [REMOTE ] IRS: Full fetch complete (32182 records). [2025-09-22T19:29:48.195058] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-22T19:29:48.527676] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-22T19:29:48.578512] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-22T19:29:48.578595] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-22T19:29:48.579247] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-22T19:29:48.579310] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-22T19:29:48.580524] [DEBUG] [LOCAL ] IRS: Trimmed 32182 records to 21606 (keeping 200 days of data) [2025-09-22T19:29:48.734108] [DEBUG] [LOCAL ] IRS: Primary data saved (21606 records). [2025-09-22T19:29:48.734282] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-22T19:29:48.734682] [INFO ] [MAIN ] Update Progress: 1129/2372 symbols completed. IRS took 35.7s. Estimated remaining: 2h 44m 52s. Rate: 7.5 symbols/min [2025-09-22T19:29:48.922604] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:29:48.935552] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T19:29:48.977855] [DEBUG] [LOCAL ] ITGR: Loaded 32189 existing records from primary storage. [2025-09-22T19:29:48.978009] [INFO ] [MAIN ] ITGR: Loaded 32189 existing records. [2025-09-22T19:29:49.152584] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:29:49.152870] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-22T19:29:49.152919] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-22T19:29:49.153874] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-22T19:29:49.153946] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-22T19:29:49.333382] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-22T19:29:49.520611] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:29:49.985957] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T19:29:50.122104] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-22T19:29:50.922043] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-22T19:29:50.978341] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T19:29:51.049102] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-22T19:29:51.722114] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-22T19:29:51.973259] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T19:29:52.522078] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-22T19:29:53.322073] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-22T19:29:53.476928] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T19:29:53.962747] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T19:29:54.122129] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-22T19:29:54.188284] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T19:29:54.922106] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-22T19:29:55.722136] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-22T19:29:55.880763] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T19:29:56.441397] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-22T19:29:56.444413] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T19:29:56.522120] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-22T19:29:57.322054] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-22T19:29:57.625402] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T19:29:58.051023] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T19:29:58.122136] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-22T19:29:58.922086] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-22T19:29:59.506159] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T19:29:59.722142] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-22T19:30:00.427822] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T19:30:00.430436] [INFO ] [REMOTE ] ISD: Full fetch complete (23864 records). [2025-09-22T19:30:00.430542] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-22T19:30:00.527768] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-22T19:30:00.813883] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-22T19:30:00.814000] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-22T19:30:00.814598] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-22T19:30:00.814723] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-22T19:30:00.816091] [DEBUG] [LOCAL ] ISD: Trimmed 23864 records to 15668 (keeping 200 days of data) [2025-09-22T19:30:00.937143] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T19:30:00.966888] [DEBUG] [LOCAL ] ISD: Primary data saved (15668 records). [2025-09-22T19:30:00.967062] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-22T19:30:00.967185] [INFO ] [MAIN ] Update Progress: 1130/2372 symbols completed. ISD took 27.0s. Estimated remaining: 2h 44m 49s. Rate: 7.5 symbols/min [2025-09-22T19:30:01.153455] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:30:01.153973] [DEBUG] [LOCAL ] ITT: No existing data file found in primary storage. [2025-09-22T19:30:01.154030] [WARN ] [MAIN ] ITT: No existing data found, performing full refresh instead. [2025-09-22T19:30:01.154248] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-22T19:30:01.154300] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-22T19:30:01.154344] [DEBUG] [LOCAL ] ITT: No primary data file found to delete. [2025-09-22T19:30:01.154377] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-22T19:30:01.330896] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-22T19:30:01.594538] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:30:01.977146] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T19:30:02.122091] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-22T19:30:02.922099] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-22T19:30:03.722128] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-22T19:30:05.392380] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (4.06 seconds). [2025-09-22T19:30:05.401210] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-22T19:30:06.668937] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-22T19:30:06.677230] [INFO ] [REMOTE ] IRT: Full fetch complete (72317 records). [2025-09-22T19:30:06.677414] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-22T19:30:07.128905] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-22T19:30:07.129083] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-22T19:30:07.130487] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-22T19:30:07.130716] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-22T19:30:07.132522] [DEBUG] [LOCAL ] IRT: Trimmed 72317 records to 50393 (keeping 200 days of data) [2025-09-22T19:30:07.399708] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-22T19:30:07.412013] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-22T19:30:07.511741] [DEBUG] [LOCAL ] IRT: Primary data saved (50393 records). [2025-09-22T19:30:07.511889] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-22T19:30:07.512001] [INFO ] [MAIN ] Update Progress: 1131/2372 symbols completed. IRT took 37.6s. Estimated remaining: 2h 44m 39s. Rate: 7.5 symbols/min [2025-09-22T19:30:07.698707] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:30:07.754426] [DEBUG] [LOCAL ] ITUB: Loaded 54074 existing records from primary storage. [2025-09-22T19:30:07.754586] [INFO ] [MAIN ] ITUB: Loaded 54074 existing records. [2025-09-22T19:30:07.954369] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:30:07.954706] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-22T19:30:07.954765] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-22T19:30:07.956874] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-22T19:30:07.956948] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-22T19:30:08.351724] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:30:08.353072] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-22T19:30:09.495430] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-22T19:30:09.506304] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-22T19:30:09.878264] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (7.76 seconds). [2025-09-22T19:30:09.903363] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-22T19:30:09.906028] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (6.98 seconds). [2025-09-22T19:30:09.912264] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-22T19:30:10.201068] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T19:30:10.212033] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-22T19:30:11.068806] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T19:30:11.076141] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-22T19:30:11.222978] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T19:30:11.229920] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-22T19:30:11.357083] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T19:30:11.364547] [INFO ] [REMOTE ] IT: Full fetch complete (55043 records). [2025-09-22T19:30:11.364701] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-22T19:30:11.753260] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-22T19:30:11.753369] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-22T19:30:11.754244] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-22T19:30:11.754308] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-22T19:30:11.755581] [DEBUG] [LOCAL ] IT: Trimmed 55043 records to 41446 (keeping 200 days of data) [2025-09-22T19:30:12.016290] [DEBUG] [LOCAL ] IT: Primary data saved (41446 records). [2025-09-22T19:30:12.016422] [INFO ] [MAIN ] IT: Full history saved. [2025-09-22T19:30:12.016541] [INFO ] [MAIN ] Update Progress: 1132/2372 symbols completed. IT took 36.2s. Estimated remaining: 2h 44m 28s. Rate: 7.5 symbols/min [2025-09-22T19:30:12.213800] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:30:12.230079] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-22T19:30:12.241510] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-22T19:30:12.291960] [DEBUG] [LOCAL ] ITW: Loaded 47147 existing records from primary storage. [2025-09-22T19:30:12.292131] [INFO ] [MAIN ] ITW: Loaded 47147 existing records. [2025-09-22T19:30:12.485787] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:30:12.502566] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-22T19:30:12.502706] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-22T19:30:12.502426] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T19:30:12.508301] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-22T19:30:12.508977] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-22T19:30:12.530110] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-22T19:30:12.760160] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T19:30:12.906693] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:30:13.322064] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-22T19:30:14.122072] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-22T19:30:14.491256] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T19:30:14.897029] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-22T19:30:14.922111] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-22T19:30:15.308326] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T19:30:15.727142] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-22T19:30:15.736134] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-22T19:30:15.878433] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:30:16.522090] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-22T19:30:17.322083] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-22T19:30:17.686434] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T19:30:18.041131] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T19:30:18.122081] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-22T19:30:18.882805] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T19:30:18.922022] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-22T19:30:19.722029] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-22T19:30:19.917850] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T19:30:20.433965] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T19:30:20.522038] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-22T19:30:20.793572] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T19:30:20.798790] [INFO ] [REMOTE ] ITGR: Full fetch complete (41181 records). [2025-09-22T19:30:20.798901] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-22T19:30:21.182873] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-22T19:30:21.182958] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-22T19:30:21.183748] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-22T19:30:21.183815] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-22T19:30:21.184888] [DEBUG] [LOCAL ] ITGR: Trimmed 41181 records to 31574 (keeping 200 days of data) [2025-09-22T19:30:21.348319] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-22T19:30:21.395579] [DEBUG] [LOCAL ] ITGR: Primary data saved (31574 records). [2025-09-22T19:30:21.395759] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-22T19:30:21.395855] [INFO ] [MAIN ] Update Progress: 1133/2372 symbols completed. ITGR took 32.7s. Estimated remaining: 2h 44m 21s. Rate: 7.5 symbols/min [2025-09-22T19:30:21.562282] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:30:21.605588] [DEBUG] [LOCAL ] IVR: Loaded 48461 existing records from primary storage. [2025-09-22T19:30:21.605789] [INFO ] [MAIN ] IVR: Loaded 48461 existing records. [2025-09-22T19:30:21.840939] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:30:21.841278] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-22T19:30:21.841330] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-22T19:30:21.842365] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-22T19:30:21.842426] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-22T19:30:22.130444] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-22T19:30:22.215912] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:30:22.267815] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T19:30:22.922067] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-22T19:30:23.201111] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T19:30:23.490244] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T19:30:23.722065] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-22T19:30:24.522070] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-22T19:30:24.684256] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:30:24.758120] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T19:30:25.322062] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-22T19:30:26.125439] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-22T19:30:26.154627] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T19:30:26.599764] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T19:30:26.922057] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-22T19:30:27.722060] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-22T19:30:28.051344] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-22T19:30:28.522063] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-22T19:30:29.322066] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-22T19:30:29.552987] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-22T19:30:29.612609] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T19:30:29.978979] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T19:30:30.122060] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-22T19:30:30.216505] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T19:30:30.922054] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-22T19:30:31.722067] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-22T19:30:31.959450] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T19:30:32.527206] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-22T19:30:32.551679] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T19:30:32.635016] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T19:30:32.639834] [INFO ] [REMOTE ] ITT: Full fetch complete (46713 records). [2025-09-22T19:30:32.639961] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-22T19:30:33.028379] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-22T19:30:33.028483] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-22T19:30:33.029389] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-22T19:30:33.029459] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-22T19:30:33.030712] [DEBUG] [LOCAL ] ITT: Trimmed 46713 records to 33181 (keeping 200 days of data) [2025-09-22T19:30:33.245595] [DEBUG] [LOCAL ] ITT: Primary data saved (33181 records). [2025-09-22T19:30:33.245772] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-22T19:30:33.245858] [INFO ] [MAIN ] Update Progress: 1134/2372 symbols completed. ITT took 32.3s. Estimated remaining: 2h 44m 18s. Rate: 7.5 symbols/min [2025-09-22T19:30:33.327162] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-22T19:30:33.420787] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:30:33.457978] [DEBUG] [LOCAL ] IVT: Loaded 31539 existing records from primary storage. [2025-09-22T19:30:33.458114] [INFO ] [MAIN ] IVT: Loaded 31539 existing records. [2025-09-22T19:30:33.636519] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:30:33.636771] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-22T19:30:33.636831] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-22T19:30:33.637715] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-22T19:30:33.637775] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-22T19:30:33.995091] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:30:34.122019] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-22T19:30:34.456035] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T19:30:34.809622] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T19:30:34.922036] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-22T19:30:35.375077] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-22T19:30:35.722052] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-22T19:30:36.509733] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T19:30:36.522014] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-22T19:30:37.322053] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-22T19:30:37.495080] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T19:30:38.122048] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-22T19:30:38.142237] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T19:30:38.149204] [INFO ] [REMOTE ] ITW: Full fetch complete (66602 records). [2025-09-22T19:30:38.149325] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-22T19:30:38.551785] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-22T19:30:38.552065] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-22T19:30:38.553165] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-22T19:30:38.553401] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-22T19:30:38.555102] [DEBUG] [LOCAL ] ITW: Trimmed 66602 records to 46386 (keeping 200 days of data) [2025-09-22T19:30:38.682740] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T19:30:38.881335] [DEBUG] [LOCAL ] ITW: Primary data saved (46386 records). [2025-09-22T19:30:38.881482] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-22T19:30:38.881574] [INFO ] [MAIN ] Update Progress: 1135/2372 symbols completed. ITW took 26.9s. Estimated remaining: 2h 44m 7s. Rate: 7.5 symbols/min [2025-09-22T19:30:38.927337] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-22T19:30:39.058611] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:30:39.114839] [DEBUG] [LOCAL ] IVZ: Loaded 53923 existing records from primary storage. [2025-09-22T19:30:39.115057] [INFO ] [MAIN ] IVZ: Loaded 53923 existing records. [2025-09-22T19:30:39.301215] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:30:39.301502] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-22T19:30:39.301564] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-22T19:30:39.302844] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-22T19:30:39.302904] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-22T19:30:39.671710] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:30:39.724257] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-22T19:30:39.727288] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T19:30:40.228151] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T19:30:40.522050] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-22T19:30:41.322060] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-22T19:30:41.604166] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T19:30:41.612514] [INFO ] [REMOTE ] ITUB: Full fetch complete (77158 records). [2025-09-22T19:30:41.612698] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-22T19:30:42.043679] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-22T19:30:42.043872] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-22T19:30:42.044984] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-22T19:30:42.045142] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-22T19:30:42.074546] [DEBUG] [LOCAL ] ITUB: Trimmed 77158 records to 53299 (keeping 200 days of data) [2025-09-22T19:30:42.076497] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T19:30:42.142006] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-22T19:30:42.412805] [DEBUG] [LOCAL ] ITUB: Primary data saved (53299 records). [2025-09-22T19:30:42.412976] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-22T19:30:42.413068] [INFO ] [MAIN ] Update Progress: 1136/2372 symbols completed. ITUB took 34.9s. Estimated remaining: 2h 43m 54s. Rate: 7.5 symbols/min [2025-09-22T19:30:42.596964] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:30:42.621634] [DEBUG] [LOCAL ] IX: Loaded 23105 existing records from primary storage. [2025-09-22T19:30:42.621789] [INFO ] [MAIN ] IX: Loaded 23105 existing records. [2025-09-22T19:30:42.809417] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:30:42.809739] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-22T19:30:42.809795] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-22T19:30:42.810365] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-22T19:30:42.810424] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-22T19:30:42.927155] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-22T19:30:43.191164] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:30:43.214633] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T19:30:43.251143] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T19:30:43.722088] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-22T19:30:44.522072] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-22T19:30:44.726938] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-22T19:30:44.801623] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T19:30:44.994069] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-22T19:30:45.322087] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-22T19:30:46.122055] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-22T19:30:46.651674] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T19:30:46.922124] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-22T19:30:47.487788] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T19:30:47.722067] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-22T19:30:48.522025] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-22T19:30:48.730560] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T19:30:48.922172] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T19:30:49.270098] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T19:30:49.322071] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-22T19:30:50.122078] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-22T19:30:50.511094] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-22T19:30:50.922057] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-22T19:30:51.722090] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-22T19:30:51.832957] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T19:30:52.184792] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T19:30:52.522110] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-22T19:30:53.322025] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-22T19:30:53.372632] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T19:30:53.756832] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T19:30:53.875128] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T19:30:54.122071] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-22T19:30:54.922067] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-22T19:30:55.424149] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T19:30:55.722063] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-22T19:30:56.522064] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-22T19:30:56.670712] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T19:30:56.941774] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T19:30:56.947047] [INFO ] [REMOTE ] IVT: Full fetch complete (45585 records). [2025-09-22T19:30:56.947171] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-22T19:30:57.328044] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-22T19:30:57.364752] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-22T19:30:57.364835] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-22T19:30:57.365591] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-22T19:30:57.365675] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-22T19:30:57.366730] [DEBUG] [LOCAL ] IVT: Trimmed 45585 records to 30914 (keeping 200 days of data) [2025-09-22T19:30:57.561285] [DEBUG] [LOCAL ] IVT: Primary data saved (30914 records). [2025-09-22T19:30:57.561427] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-22T19:30:57.561512] [INFO ] [MAIN ] Update Progress: 1137/2372 symbols completed. IVT took 24.3s. Estimated remaining: 2h 43m 54s. Rate: 7.5 symbols/min [2025-09-22T19:30:57.736773] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:30:57.754705] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T19:30:57.802760] [DEBUG] [LOCAL ] J: Loaded 41236 existing records from primary storage. [2025-09-22T19:30:57.802925] [INFO ] [MAIN ] J: Loaded 41236 existing records. [2025-09-22T19:30:57.985449] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:30:57.985732] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-22T19:30:57.985789] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-22T19:30:57.986992] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-22T19:30:57.987054] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-22T19:30:58.127214] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-22T19:30:58.356048] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:30:58.737044] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T19:30:58.745119] [INFO ] [REMOTE ] IVR: Full fetch complete (68917 records). [2025-09-22T19:30:58.745272] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-22T19:30:58.928000] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-22T19:30:59.149855] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-22T19:30:59.149947] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-22T19:30:59.150869] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-22T19:30:59.150983] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-22T19:30:59.152470] [DEBUG] [LOCAL ] IVR: Trimmed 68917 records to 47819 (keeping 200 days of data) [2025-09-22T19:30:59.438479] [DEBUG] [LOCAL ] IVR: Primary data saved (47819 records). [2025-09-22T19:30:59.438637] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-22T19:30:59.438797] [INFO ] [MAIN ] Update Progress: 1138/2372 symbols completed. IVR took 38.0s. Estimated remaining: 2h 43m 40s. Rate: 7.5 symbols/min [2025-09-22T19:30:59.620506] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:30:59.640216] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T19:30:59.686972] [DEBUG] [LOCAL ] JBGS: Loaded 43083 existing records from primary storage. [2025-09-22T19:30:59.687144] [INFO ] [MAIN ] JBGS: Loaded 43083 existing records. [2025-09-22T19:30:59.730181] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-22T19:30:59.872853] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:30:59.873119] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-22T19:30:59.873168] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-22T19:30:59.874515] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-22T19:30:59.874576] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-22T19:31:00.245067] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:31:00.522019] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-22T19:31:00.745546] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T19:31:01.322060] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-22T19:31:02.085474] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T19:31:02.122067] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-22T19:31:02.924684] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-22T19:31:02.938384] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T19:31:03.139168] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T19:31:03.722053] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-22T19:31:04.234535] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (4.50 seconds). [2025-09-22T19:31:04.522101] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-22T19:31:04.883251] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T19:31:04.920347] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-22T19:31:05.322074] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-22T19:31:05.410296] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T19:31:06.122073] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-22T19:31:06.672988] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T19:31:06.922076] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-22T19:31:07.545970] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T19:31:07.722063] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-22T19:31:08.042344] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T19:31:08.522126] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-22T19:31:08.925967] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T19:31:09.322113] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-22T19:31:09.440500] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-22T19:31:10.070036] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:31:10.122096] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-22T19:31:10.922096] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-22T19:31:11.273593] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T19:31:11.277010] [INFO ] [REMOTE ] IX: Full fetch complete (26702 records). [2025-09-22T19:31:11.277105] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-22T19:31:11.674901] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-22T19:31:11.675053] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-22T19:31:11.675616] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-22T19:31:11.675689] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-22T19:31:11.676426] [DEBUG] [LOCAL ] IX: Trimmed 26702 records to 22628 (keeping 200 days of data) [2025-09-22T19:31:11.726052] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-22T19:31:11.815549] [DEBUG] [LOCAL ] IX: Primary data saved (22628 records). [2025-09-22T19:31:11.815723] [INFO ] [MAIN ] IX: Full history saved. [2025-09-22T19:31:11.815823] [INFO ] [MAIN ] Update Progress: 1139/2372 symbols completed. IX took 29.4s. Estimated remaining: 2h 43m 36s. Rate: 7.5 symbols/min [2025-09-22T19:31:11.989120] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:31:12.034087] [DEBUG] [LOCAL ] JBI: Loaded 44819 existing records from primary storage. [2025-09-22T19:31:12.034303] [INFO ] [MAIN ] JBI: Loaded 44819 existing records. [2025-09-22T19:31:12.213415] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:31:12.213744] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-22T19:31:12.213813] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-22T19:31:12.214976] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-22T19:31:12.215077] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-22T19:31:12.530109] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-22T19:31:12.571463] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:31:12.768022] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T19:31:12.776535] [INFO ] [REMOTE ] IVZ: Full fetch complete (76733 records). [2025-09-22T19:31:12.776729] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-22T19:31:13.216377] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-22T19:31:13.216485] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-22T19:31:13.217610] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-22T19:31:13.217833] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-22T19:31:13.229982] [DEBUG] [LOCAL ] IVZ: Trimmed 76733 records to 53143 (keeping 200 days of data) [2025-09-22T19:31:13.246909] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T19:31:13.348202] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-22T19:31:13.600792] [DEBUG] [LOCAL ] IVZ: Primary data saved (53143 records). [2025-09-22T19:31:13.600941] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-22T19:31:13.601030] [INFO ] [MAIN ] Update Progress: 1140/2372 symbols completed. IVZ took 34.7s. Estimated remaining: 2h 43m 22s. Rate: 7.5 symbols/min [2025-09-22T19:31:13.772014] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:31:13.819014] [DEBUG] [LOCAL ] JBL: Loaded 49097 existing records from primary storage. [2025-09-22T19:31:13.819212] [INFO ] [MAIN ] JBL: Loaded 49097 existing records. [2025-09-22T19:31:14.026579] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:31:14.026995] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-22T19:31:14.027128] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-22T19:31:14.035682] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-22T19:31:14.035787] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-22T19:31:14.126455] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-22T19:31:14.127713] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T19:31:14.418750] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:31:14.886344] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T19:31:14.922060] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-22T19:31:15.691939] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T19:31:15.722000] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-22T19:31:16.522084] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-22T19:31:16.641959] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T19:31:17.044070] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T19:31:17.322012] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-22T19:31:18.037126] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T19:31:18.122051] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-22T19:31:18.530778] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T19:31:18.922109] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-22T19:31:19.520447] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T19:31:19.722123] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-22T19:31:20.374888] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T19:31:20.522009] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-22T19:31:21.002376] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-22T19:31:21.322064] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-22T19:31:21.728310] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T19:31:22.122056] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-22T19:31:22.887623] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T19:31:22.922027] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-22T19:31:23.722110] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-22T19:31:23.823498] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T19:31:23.830425] [INFO ] [REMOTE ] JBGS: Full fetch complete (58949 records). [2025-09-22T19:31:23.830534] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-22T19:31:24.231228] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-22T19:31:24.231327] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-22T19:31:24.232292] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-22T19:31:24.232411] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-22T19:31:24.234575] [DEBUG] [LOCAL ] JBGS: Trimmed 58949 records to 42420 (keeping 200 days of data) [2025-09-22T19:31:24.356335] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T19:31:24.522873] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-22T19:31:24.558252] [DEBUG] [LOCAL ] JBGS: Primary data saved (42420 records). [2025-09-22T19:31:24.558416] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-22T19:31:24.558535] [INFO ] [MAIN ] Update Progress: 1141/2372 symbols completed. JBGS took 25.1s. Estimated remaining: 2h 43m 17s. Rate: 7.5 symbols/min [2025-09-22T19:31:24.737210] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:31:24.763424] [DEBUG] [LOCAL ] JBND: Loaded 25580 existing records from primary storage. [2025-09-22T19:31:24.763593] [INFO ] [MAIN ] JBND: Loaded 25580 existing records. [2025-09-22T19:31:24.940465] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:31:24.940752] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-22T19:31:24.940808] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-22T19:31:24.941594] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-22T19:31:24.941694] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-22T19:31:25.304230] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:31:25.328205] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-22T19:31:25.333455] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-22T19:31:26.067627] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T19:31:26.121999] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-22T19:31:26.160222] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T19:31:26.922053] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-22T19:31:27.705274] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T19:31:27.722012] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-22T19:31:28.433263] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T19:31:28.522032] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-22T19:31:28.853784] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T19:31:29.322059] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-22T19:31:29.998081] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T19:31:30.122056] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-22T19:31:30.785307] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T19:31:30.922088] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-22T19:31:31.449032] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T19:31:31.722110] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-22T19:31:32.228894] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T19:31:32.522069] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-22T19:31:33.224546] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T19:31:33.322058] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-22T19:31:33.487528] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T19:31:34.122058] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-22T19:31:34.922069] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-22T19:31:35.115692] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T19:31:35.153430] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T19:31:35.722097] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-22T19:31:36.362084] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T19:31:36.522090] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-22T19:31:37.094639] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T19:31:37.322073] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-22T19:31:38.032736] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T19:31:38.122017] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-22T19:31:38.301790] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T19:31:38.922081] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-22T19:31:39.523718] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T19:31:39.532703] [INFO ] [REMOTE ] J: Full fetch complete (59205 records). [2025-09-22T19:31:39.532880] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-22T19:31:39.733812] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-22T19:31:39.945070] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-22T19:31:39.945177] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-22T19:31:39.946417] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-22T19:31:39.946518] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-22T19:31:39.950944] [DEBUG] [LOCAL ] J: Trimmed 59205 records to 40502 (keeping 200 days of data) [2025-09-22T19:31:40.224523] [DEBUG] [LOCAL ] J: Primary data saved (40502 records). [2025-09-22T19:31:40.224708] [INFO ] [MAIN ] J: Full history saved. [2025-09-22T19:31:40.226407] [INFO ] [MAIN ] Update Progress: 1142/2372 symbols completed. J took 42.7s. Estimated remaining: 2h 43m 17s. Rate: 7.5 symbols/min [2025-09-22T19:31:40.404842] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:31:40.405136] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-22T19:31:40.405206] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-22T19:31:40.405461] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-22T19:31:40.405524] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-22T19:31:40.405568] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-22T19:31:40.405612] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-22T19:31:40.526324] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-22T19:31:40.743857] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T19:31:40.830436] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:31:41.322049] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-22T19:31:41.559798] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T19:31:41.589181] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T19:31:41.598350] [INFO ] [REMOTE ] JBL: Full fetch complete (69840 records). [2025-09-22T19:31:41.598483] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-22T19:31:42.002163] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-22T19:31:42.002283] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-22T19:31:42.003433] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-22T19:31:42.003580] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-22T19:31:42.008405] [DEBUG] [LOCAL ] JBL: Trimmed 69840 records to 48357 (keeping 200 days of data) [2025-09-22T19:31:42.122195] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-22T19:31:42.339440] [DEBUG] [LOCAL ] JBL: Primary data saved (48357 records). [2025-09-22T19:31:42.339604] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-22T19:31:42.339853] [INFO ] [MAIN ] Update Progress: 1143/2372 symbols completed. JBL took 28.7s. Estimated remaining: 2h 43m 3s. Rate: 7.5 symbols/min [2025-09-22T19:31:42.518479] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:31:42.518819] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-22T19:31:42.518923] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-22T19:31:42.519150] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-22T19:31:42.519286] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-22T19:31:42.519353] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-22T19:31:42.519400] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-22T19:31:42.816168] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T19:31:42.863932] [INFO ] [REMOTE ] JBI: Full fetch complete (64627 records). [2025-09-22T19:31:42.874402] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-22T19:31:42.932290] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-22T19:31:42.936206] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:31:43.232238] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:31:43.262490] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-22T19:31:43.272946] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-22T19:31:43.387407] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-22T19:31:43.387493] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-22T19:31:43.388364] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-22T19:31:43.388429] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-22T19:31:43.390113] [DEBUG] [LOCAL ] JBI: Trimmed 64627 records to 44019 (keeping 200 days of data) [2025-09-22T19:31:43.668525] [DEBUG] [LOCAL ] JBI: Primary data saved (44019 records). [2025-09-22T19:31:43.669060] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-22T19:31:43.669293] [INFO ] [MAIN ] Update Progress: 1144/2372 symbols completed. JBI took 31.9s. Estimated remaining: 2h 42m 48s. Rate: 7.5 symbols/min [2025-09-22T19:31:43.727292] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-22T19:31:43.846862] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:31:43.861512] [DEBUG] [LOCAL ] JCE: Loaded 6521 existing records from primary storage. [2025-09-22T19:31:43.861688] [INFO ] [MAIN ] JCE: Loaded 6521 existing records. [2025-09-22T19:31:44.008174] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:31:44.029106] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-22T19:31:44.052255] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:31:44.053112] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-22T19:31:44.053277] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-22T19:31:44.053853] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-22T19:31:44.053919] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-22T19:31:44.421393] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:31:44.522015] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-22T19:31:45.143900] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-22T19:31:45.322062] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-22T19:31:45.942628] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T19:31:46.122086] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-22T19:31:46.922063] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-22T19:31:47.114809] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:31:47.115157] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-22T19:31:47.169748] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T19:31:47.722097] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-22T19:31:48.522012] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-22T19:31:48.998012] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T19:31:49.040332] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-22T19:31:49.322063] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-22T19:31:49.517841] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:31:49.518176] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-22T19:31:50.122086] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-22T19:31:50.922063] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-22T19:31:51.118486] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:31:51.118869] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-22T19:31:51.223220] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T19:31:51.722113] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-22T19:31:52.522124] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-22T19:31:52.729760] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T19:31:52.981756] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T19:31:53.322052] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-22T19:31:54.122076] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-22T19:31:54.446285] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T19:31:54.686575] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T19:31:54.922085] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-22T19:31:55.722099] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-22T19:31:55.892803] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T19:31:55.920135] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:31:55.920545] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-22T19:31:56.522129] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-22T19:31:57.322064] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-22T19:31:57.893758] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T19:31:57.959470] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T19:31:57.964750] [INFO ] [REMOTE ] JBND: Full fetch complete (33130 records). [2025-09-22T19:31:57.964850] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-22T19:31:58.125793] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-22T19:31:58.361101] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-22T19:31:58.361438] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-22T19:31:58.362125] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-22T19:31:58.362188] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-22T19:31:58.363168] [DEBUG] [LOCAL ] JBND: Trimmed 33130 records to 25326 (keeping 200 days of data) [2025-09-22T19:31:58.463622] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:31:58.464872] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-22T19:31:58.538147] [DEBUG] [LOCAL ] JBND: Primary data saved (25326 records). [2025-09-22T19:31:58.538302] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-22T19:31:58.538447] [INFO ] [MAIN ] Update Progress: 1145/2372 symbols completed. JBND took 34.0s. Estimated remaining: 2h 42m 47s. Rate: 7.5 symbols/min [2025-09-22T19:31:58.706781] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:31:58.764195] [DEBUG] [LOCAL ] JCI: Loaded 54330 existing records from primary storage. [2025-09-22T19:31:58.764361] [INFO ] [MAIN ] JCI: Loaded 54330 existing records. [2025-09-22T19:31:58.923608] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-22T19:31:58.944763] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:31:58.944937] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-22T19:31:58.944984] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-22T19:31:58.946773] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-22T19:31:58.946834] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-22T19:31:59.304618] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:31:59.722060] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-22T19:31:59.908540] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T19:32:00.427628] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T19:32:00.522091] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-22T19:32:01.322085] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-22T19:32:02.130783] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-22T19:32:02.137841] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T19:32:02.714406] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-22T19:32:02.922044] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-22T19:32:03.144434] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T19:32:03.722110] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-22T19:32:04.379948] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T19:32:04.522173] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-22T19:32:05.133115] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T19:32:05.186085] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T19:32:05.322072] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-22T19:32:06.122087] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-22T19:32:06.922137] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-22T19:32:07.092593] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T19:32:07.104228] [INFO ] [REMOTE ] JCE: Full fetch complete (9041 records). [2025-09-22T19:32:07.118091] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-22T19:32:07.119775] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T19:32:07.203088] [INFO ] [REMOTE ] JBS: Full fetch complete (25983 records). [2025-09-22T19:32:07.227602] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-22T19:32:07.636833] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 68 unique days, need 200 days [2025-09-22T19:32:07.637819] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:32:07.653805] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:32:07.682582] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-22T19:32:07.724909] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-22T19:32:07.718320] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-22T19:32:07.725208] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-22T19:32:07.726257] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-22T19:32:07.726319] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-22T19:32:07.726454] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-22T19:32:07.726602] [INFO ] [MAIN ] Update Progress: 1146/2372 symbols completed. JBS took 27.5s. Estimated remaining: 2h 42m 41s. Rate: 7.5 symbols/min [2025-09-22T19:32:07.726984] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-22T19:32:07.727353] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-22T19:32:07.791319] [DEBUG] [LOCAL ] JCE: Trimmed 9041 records to 6457 (keeping 200 days of data) [2025-09-22T19:32:07.931963] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:32:07.943061] [DEBUG] [LOCAL ] JCE: Primary data saved (6457 records). [2025-09-22T19:32:07.943211] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-22T19:32:07.943336] [INFO ] [MAIN ] Update Progress: 1147/2372 symbols completed. JCE took 24.3s. Estimated remaining: 2h 42m 25s. Rate: 7.5 symbols/min [2025-09-22T19:32:08.119433] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:32:08.159867] [DEBUG] [LOCAL ] JEF: Loaded 50767 existing records from primary storage. [2025-09-22T19:32:08.160049] [INFO ] [MAIN ] JEF: Loaded 50767 existing records. [2025-09-22T19:32:08.374334] [DEBUG] [LOCAL ] JELD: Loaded 46906 existing records from primary storage. [2025-09-22T19:32:08.374496] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:32:08.374795] [INFO ] [MAIN ] JELD: Loaded 46906 existing records. [2025-09-22T19:32:08.375049] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-22T19:32:08.407984] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-22T19:32:08.452847] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-22T19:32:08.468898] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-22T19:32:08.668818] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:32:08.678669] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-22T19:32:08.689046] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-22T19:32:08.765391] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-22T19:32:08.802394] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-22T19:32:09.069610] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:32:09.099872] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-22T19:32:09.099462] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-22T19:32:09.330998] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-22T19:32:09.387698] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:32:09.677275] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T19:32:10.122063] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-22T19:32:10.520078] [DEBUG] [REMOTE ] JEF: Error fetching primary data for 2024-12: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-22T19:32:10.520241] [WARN ] [REMOTE ] JEF: No data returned for month 2024-12 [2025-09-22T19:32:10.646907] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T19:32:10.922081] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-22T19:32:11.447547] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T19:32:11.722067] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-22T19:32:12.361038] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T19:32:12.522113] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-22T19:32:13.322035] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-22T19:32:13.537747] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T19:32:13.701215] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T19:32:14.122060] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-22T19:32:14.841858] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T19:32:14.922061] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-22T19:32:15.612584] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T19:32:15.722031] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-22T19:32:16.316583] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T19:32:16.322749] [INFO ] [REMOTE ] JBTM: Full fetch complete (41544 records). [2025-09-22T19:32:16.322907] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-22T19:32:16.518941] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-22T19:32:16.519538] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:32:16.519611] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:32:16.519714] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-22T19:32:16.519817] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-22T19:32:16.519857] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-22T19:32:16.519896] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-22T19:32:16.519972] [INFO ] [MAIN ] Update Progress: 1148/2372 symbols completed. JBTM took 34.2s. Estimated remaining: 2h 42m 17s. Rate: 7.5 symbols/min [2025-09-22T19:32:16.526677] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-22T19:32:16.695301] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:32:16.706518] [DEBUG] [LOCAL ] JEQ: Loaded 9163 existing records from primary storage. [2025-09-22T19:32:16.706618] [INFO ] [MAIN ] JEQ: Loaded 9163 existing records. [2025-09-22T19:32:16.894510] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:32:16.894783] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-22T19:32:16.894838] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-22T19:32:16.895247] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-22T19:32:16.895308] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-22T19:32:17.280833] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:32:17.322011] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-22T19:32:17.547617] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T19:32:17.868273] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-22T19:32:18.122106] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-22T19:32:18.429194] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T19:32:18.922070] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-22T19:32:19.722071] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-22T19:32:20.037216] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T19:32:20.522066] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-22T19:32:20.879107] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T19:32:21.309570] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T19:32:21.322011] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-22T19:32:21.822221] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T19:32:21.896604] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T19:32:22.122075] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-22T19:32:22.922059] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-22T19:32:23.483082] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T19:32:23.717014] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T19:32:23.729433] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-22T19:32:24.522064] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-22T19:32:25.322026] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-22T19:32:25.411772] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T19:32:25.938786] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T19:32:26.122051] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-22T19:32:26.216254] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T19:32:26.922065] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-22T19:32:27.722093] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-22T19:32:27.927604] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T19:32:28.522052] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-22T19:32:28.736186] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T19:32:28.967290] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T19:32:29.080940] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T19:32:29.322043] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-22T19:32:30.122059] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-22T19:32:30.702582] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T19:32:30.834825] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T19:32:30.922016] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-22T19:32:31.418297] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-22T19:32:31.722057] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-22T19:32:32.522089] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-22T19:32:33.322065] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-22T19:32:33.404384] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T19:32:33.954210] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-22T19:32:34.122112] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-22T19:32:34.349782] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T19:32:34.922055] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-22T19:32:35.361436] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T19:32:35.722057] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-22T19:32:36.522062] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-22T19:32:36.640723] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T19:32:36.648897] [INFO ] [REMOTE ] JEF: Full fetch complete (65640 records). [2025-09-22T19:32:36.649037] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-22T19:32:36.842076] [WARN ] [VALIDATOR ] JEF: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-22T19:32:36.842810] [FATAL] [MAIN ] JEF: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:32:36.842888] [WARN ] [MAIN ] JEF: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:32:36.842963] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-22T19:32:36.843035] [DEBUG] [LOCAL ] JEF: No primary data file found to delete. [2025-09-22T19:32:36.843071] [INFO ] [LOCAL ] JEF: Starting deletion of derivative data. [2025-09-22T19:32:36.843607] [DEBUG] [LOCAL ] JEF: Deleted derivative data file. [2025-09-22T19:32:36.843764] [INFO ] [MAIN ] Update Progress: 1149/2372 symbols completed. JEF took 29.1s. Estimated remaining: 2h 42m 23s. Rate: 7.5 symbols/min [2025-09-22T19:32:37.015665] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:32:37.046848] [DEBUG] [LOCAL ] JFR: Loaded 31079 existing records from primary storage. [2025-09-22T19:32:37.046992] [INFO ] [MAIN ] JFR: Loaded 31079 existing records. [2025-09-22T19:32:37.235898] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:32:37.236199] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-22T19:32:37.236289] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-22T19:32:37.237012] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-22T19:32:37.237074] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-22T19:32:37.327133] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-22T19:32:37.609954] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:32:37.643394] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T19:32:37.716544] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T19:32:37.942268] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T19:32:38.122048] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-22T19:32:38.922077] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-22T19:32:39.537224] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T19:32:39.665215] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T19:32:39.666975] [INFO ] [REMOTE ] JEQ: Full fetch complete (11349 records). [2025-09-22T19:32:39.667047] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-22T19:32:39.727165] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-22T19:32:40.062238] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-22T19:32:40.062354] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-22T19:32:40.062635] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-22T19:32:40.062726] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-22T19:32:40.063227] [DEBUG] [LOCAL ] JEQ: Trimmed 11349 records to 9079 (keeping 200 days of data) [2025-09-22T19:32:40.116231] [DEBUG] [LOCAL ] JEQ: Primary data saved (9079 records). [2025-09-22T19:32:40.116372] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-22T19:32:40.116462] [INFO ] [MAIN ] Update Progress: 1150/2372 symbols completed. JEQ took 23.6s. Estimated remaining: 2h 42m 10s. Rate: 7.5 symbols/min [2025-09-22T19:32:40.289547] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:32:40.302553] [DEBUG] [LOCAL ] JGH: Loaded 11148 existing records from primary storage. [2025-09-22T19:32:40.302696] [INFO ] [MAIN ] JGH: Loaded 11148 existing records. [2025-09-22T19:32:40.483099] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:32:40.483352] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-22T19:32:40.483403] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-22T19:32:40.483863] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-22T19:32:40.483922] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-22T19:32:40.527204] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-22T19:32:40.904200] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:32:41.322031] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-22T19:32:41.354275] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T19:32:41.972515] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T19:32:42.122051] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-22T19:32:42.922020] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-22T19:32:42.962328] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T19:32:43.624839] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T19:32:43.686586] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T19:32:43.722011] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-22T19:32:44.346814] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T19:32:44.522065] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-22T19:32:45.322053] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-22T19:32:46.122110] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-22T19:32:46.168759] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T19:32:46.176111] [INFO ] [REMOTE ] JELD: Full fetch complete (63323 records). [2025-09-22T19:32:46.176257] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-22T19:32:46.605341] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-22T19:32:46.605593] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-22T19:32:46.606749] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-22T19:32:46.606982] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-22T19:32:46.615080] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-22T19:32:46.619625] [DEBUG] [LOCAL ] JELD: Trimmed 63323 records to 46169 (keeping 200 days of data) [2025-09-22T19:32:46.758428] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T19:32:46.910983] [DEBUG] [LOCAL ] JELD: Primary data saved (46169 records). [2025-09-22T19:32:46.911152] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-22T19:32:46.911250] [INFO ] [MAIN ] Update Progress: 1151/2372 symbols completed. JELD took 39.0s. Estimated remaining: 2h 42m 0s. Rate: 7.5 symbols/min [2025-09-22T19:32:46.927145] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-22T19:32:47.082945] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:32:47.131836] [DEBUG] [LOCAL ] JHG: Loaded 48849 existing records from primary storage. [2025-09-22T19:32:47.132008] [INFO ] [MAIN ] JHG: Loaded 48849 existing records. [2025-09-22T19:32:47.311304] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:32:47.311613] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-22T19:32:47.311693] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-22T19:32:47.313533] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-22T19:32:47.313594] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-22T19:32:47.668154] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:32:47.722004] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-22T19:32:48.522161] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-22T19:32:48.927065] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T19:32:48.936290] [INFO ] [REMOTE ] JCI: Full fetch complete (77402 records). [2025-09-22T19:32:48.936493] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-22T19:32:49.244693] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T19:32:49.330041] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-22T19:32:49.379198] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-22T19:32:49.379270] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-22T19:32:49.380225] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-22T19:32:49.380289] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-22T19:32:49.381923] [DEBUG] [LOCAL ] JCI: Trimmed 77402 records to 53548 (keeping 200 days of data) [2025-09-22T19:32:49.645743] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-22T19:32:49.746071] [DEBUG] [LOCAL ] JCI: Primary data saved (53548 records). [2025-09-22T19:32:49.746211] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-22T19:32:49.746291] [INFO ] [MAIN ] Update Progress: 1152/2372 symbols completed. JCI took 51.2s. Estimated remaining: 2h 41m 47s. Rate: 7.5 symbols/min [2025-09-22T19:32:49.920823] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:32:49.926312] [DEBUG] [LOCAL ] JHI: Loaded 3819 existing records from primary storage. [2025-09-22T19:32:49.926392] [INFO ] [MAIN ] JHI: Loaded 3819 existing records. [2025-09-22T19:32:50.102398] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:32:50.102613] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-22T19:32:50.102686] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-22T19:32:50.103000] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-22T19:32:50.103058] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-22T19:32:50.133805] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-22T19:32:50.365461] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T19:32:50.477211] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:32:50.922049] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-22T19:32:51.109549] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-22T19:32:51.253993] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-22T19:32:51.722111] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-22T19:32:52.522108] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-22T19:32:52.707154] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T19:32:52.918296] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-22T19:32:53.322099] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-22T19:32:54.122082] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-22T19:32:54.185759] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T19:32:54.922145] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-22T19:32:55.361109] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T19:32:55.722066] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-22T19:32:56.348282] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T19:32:56.522028] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-22T19:32:56.997739] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T19:32:57.322106] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-22T19:32:57.733166] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T19:32:57.775658] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-22T19:32:58.122070] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-22T19:32:58.922107] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-22T19:32:59.722033] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-22T19:32:59.816254] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T19:33:00.206876] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T19:33:00.212524] [INFO ] [REMOTE ] JFR: Full fetch complete (47957 records). [2025-09-22T19:33:00.212685] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-22T19:33:00.360523] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-22T19:33:00.527484] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-22T19:33:00.663447] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-22T19:33:00.663533] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-22T19:33:00.664318] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-22T19:33:00.664405] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-22T19:33:00.665498] [DEBUG] [LOCAL ] JFR: Trimmed 47957 records to 30377 (keeping 200 days of data) [2025-09-22T19:33:00.850486] [DEBUG] [LOCAL ] JFR: Primary data saved (30377 records). [2025-09-22T19:33:00.850662] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-22T19:33:00.850778] [INFO ] [MAIN ] Update Progress: 1153/2372 symbols completed. JFR took 24.0s. Estimated remaining: 2h 41m 42s. Rate: 7.5 symbols/min [2025-09-22T19:33:01.027808] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:33:01.032720] [DEBUG] [LOCAL ] JHS: Loaded 2951 existing records from primary storage. [2025-09-22T19:33:01.032832] [INFO ] [MAIN ] JHS: Loaded 2951 existing records. [2025-09-22T19:33:01.214346] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:33:01.214621] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-22T19:33:01.214698] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-22T19:33:01.214976] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-22T19:33:01.215069] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-22T19:33:01.327225] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-22T19:33:01.583310] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:33:02.122131] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-22T19:33:02.619345] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T19:33:02.922077] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-22T19:33:02.999744] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-22T19:33:03.458554] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T19:33:03.722092] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-22T19:33:04.499708] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T19:33:04.522103] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-22T19:33:04.965512] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-22T19:33:05.115856] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T19:33:05.322107] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-22T19:33:06.122059] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-22T19:33:06.918176] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T19:33:06.927145] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-22T19:33:06.950819] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T19:33:07.517134] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T19:33:07.722083] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-22T19:33:08.230149] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-22T19:33:08.522065] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-22T19:33:09.050331] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-22T19:33:09.322056] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-22T19:33:09.964376] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T19:33:10.122047] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-22T19:33:10.922079] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-22T19:33:11.074611] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T19:33:11.077203] [INFO ] [REMOTE ] JGH: Full fetch complete (14730 records). [2025-09-22T19:33:11.077272] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-22T19:33:11.470270] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-22T19:33:11.470355] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-22T19:33:11.470771] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-22T19:33:11.470835] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-22T19:33:11.471400] [DEBUG] [LOCAL ] JGH: Trimmed 14730 records to 10943 (keeping 200 days of data) [2025-09-22T19:33:11.549763] [DEBUG] [LOCAL ] JGH: Primary data saved (10943 records). [2025-09-22T19:33:11.549925] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-22T19:33:11.550018] [INFO ] [MAIN ] Update Progress: 1154/2372 symbols completed. JGH took 31.4s. Estimated remaining: 2h 41m 37s. Rate: 7.5 symbols/min [2025-09-22T19:33:11.719912] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:33:11.722099] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-22T19:33:11.776442] [DEBUG] [LOCAL ] JHX: Loaded 49724 existing records from primary storage. [2025-09-22T19:33:11.776604] [INFO ] [MAIN ] JHX: Loaded 49724 existing records. [2025-09-22T19:33:11.953830] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:33:11.954091] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-22T19:33:11.954139] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-22T19:33:11.955259] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-22T19:33:11.955319] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-22T19:33:12.225446] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T19:33:12.326188] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:33:12.522039] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-22T19:33:12.627562] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T19:33:13.315745] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-22T19:33:13.321992] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-22T19:33:14.122087] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-22T19:33:14.536159] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T19:33:14.922056] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-22T19:33:15.709133] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T19:33:15.722008] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-22T19:33:16.306804] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T19:33:16.334332] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T19:33:16.522018] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-22T19:33:17.322068] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-22T19:33:17.789115] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T19:33:17.844092] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T19:33:18.122073] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-22T19:33:18.631739] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-22T19:33:18.922083] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-22T19:33:19.722073] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-22T19:33:20.514680] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T19:33:20.522034] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-22T19:33:20.523095] [INFO ] [REMOTE ] JHG: Full fetch complete (68527 records). [2025-09-22T19:33:20.523172] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-22T19:33:20.950353] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T19:33:20.977764] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-22T19:33:20.978141] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-22T19:33:20.979071] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-22T19:33:20.979136] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-22T19:33:20.980426] [DEBUG] [LOCAL ] JHG: Trimmed 68527 records to 48043 (keeping 200 days of data) [2025-09-22T19:33:21.199359] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T19:33:21.282745] [DEBUG] [LOCAL ] JHG: Primary data saved (48043 records). [2025-09-22T19:33:21.282887] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-22T19:33:21.282970] [INFO ] [MAIN ] Update Progress: 1155/2372 symbols completed. JHG took 34.4s. Estimated remaining: 2h 41m 31s. Rate: 7.5 symbols/min [2025-09-22T19:33:21.327146] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-22T19:33:21.460839] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:33:21.480122] [DEBUG] [LOCAL ] JILL: Loaded 16934 existing records from primary storage. [2025-09-22T19:33:21.480247] [INFO ] [MAIN ] JILL: Loaded 16934 existing records. [2025-09-22T19:33:21.661669] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:33:21.661965] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-22T19:33:21.662024] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-22T19:33:21.662606] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-22T19:33:21.662699] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-22T19:33:21.886270] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-22T19:33:22.034764] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:33:22.122009] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-22T19:33:22.922060] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-22T19:33:22.976532] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T19:33:23.722060] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-22T19:33:24.272589] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T19:33:24.325883] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T19:33:24.522089] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-22T19:33:25.226251] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-22T19:33:25.227698] [INFO ] [REMOTE ] JHI: Full fetch complete (5276 records). [2025-09-22T19:33:25.227771] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-22T19:33:25.327192] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-22T19:33:25.588389] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-22T19:33:25.588464] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-22T19:33:25.588619] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-22T19:33:25.588697] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-22T19:33:25.589089] [DEBUG] [LOCAL ] JHI: Trimmed 5276 records to 3589 (keeping 200 days of data) [2025-09-22T19:33:25.613510] [DEBUG] [LOCAL ] JHI: Primary data saved (3589 records). [2025-09-22T19:33:25.613579] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-22T19:33:25.613675] [INFO ] [MAIN ] Update Progress: 1156/2372 symbols completed. JHI took 35.9s. Estimated remaining: 2h 41m 19s. Rate: 7.5 symbols/min [2025-09-22T19:33:25.783812] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:33:25.824343] [DEBUG] [LOCAL ] JKS: Loaded 40779 existing records from primary storage. [2025-09-22T19:33:25.824484] [INFO ] [MAIN ] JKS: Loaded 40779 existing records. [2025-09-22T19:33:26.004825] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:33:26.005154] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-22T19:33:26.005215] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-22T19:33:26.006198] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-22T19:33:26.006260] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-22T19:33:26.127231] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-22T19:33:26.297932] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T19:33:26.377586] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:33:26.922059] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-22T19:33:27.722027] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-22T19:33:27.980892] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T19:33:27.991380] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T19:33:28.207110] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-22T19:33:28.522101] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-22T19:33:28.956424] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T19:33:29.322068] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-22T19:33:30.070674] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T19:33:30.072088] [INFO ] [REMOTE ] JHS: Full fetch complete (4465 records). [2025-09-22T19:33:30.072159] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-22T19:33:30.127322] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-22T19:33:30.429172] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-22T19:33:30.429248] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-22T19:33:30.429384] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-22T19:33:30.429423] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-22T19:33:30.429819] [DEBUG] [LOCAL ] JHS: Trimmed 4465 records to 2890 (keeping 200 days of data) [2025-09-22T19:33:30.447434] [DEBUG] [LOCAL ] JHS: Primary data saved (2890 records). [2025-09-22T19:33:30.447534] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-22T19:33:30.447621] [INFO ] [MAIN ] Update Progress: 1157/2372 symbols completed. JHS took 29.6s. Estimated remaining: 2h 41m 8s. Rate: 7.5 symbols/min [2025-09-22T19:33:30.922103] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-22T19:33:31.674609] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T19:33:31.722011] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-22T19:33:31.946510] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T19:33:32.351419] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T19:33:32.522057] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-22T19:33:33.322029] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-22T19:33:33.632556] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T19:33:34.122090] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-22T19:33:34.923200] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-22T19:33:34.927067] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T19:33:35.052499] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T19:33:35.722065] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-22T19:33:36.400620] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T19:33:36.522066] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-22T19:33:37.322094] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-22T19:33:37.586490] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T19:33:37.861493] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-22T19:33:38.031766] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T19:33:38.122020] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-22T19:33:38.922066] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-22T19:33:39.672138] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T19:33:39.722062] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-22T19:33:40.522171] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-22T19:33:40.643969] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T19:33:40.654404] [INFO ] [REMOTE ] JHX: Full fetch complete (56355 records). [2025-09-22T19:33:40.654752] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-22T19:33:41.069622] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-22T19:33:41.069755] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-22T19:33:41.070688] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-22T19:33:41.070756] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-22T19:33:41.072224] [DEBUG] [LOCAL ] JHX: Trimmed 56355 records to 49815 (keeping 200 days of data) [2025-09-22T19:33:41.395085] [DEBUG] [LOCAL ] JHX: Primary data saved (49815 records). [2025-09-22T19:33:41.395345] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-22T19:33:41.395512] [INFO ] [MAIN ] Update Progress: 1158/2372 symbols completed. JHX took 29.8s. Estimated remaining: 2h 41m 3s. Rate: 7.5 symbols/min [2025-09-22T19:33:41.427936] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T19:33:41.437407] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-22T19:33:41.491536] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T19:33:41.496016] [INFO ] [REMOTE ] JILL: Full fetch complete (23105 records). [2025-09-22T19:33:41.496196] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-22T19:33:41.867560] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-22T19:33:41.867669] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-22T19:33:41.868175] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-22T19:33:41.868215] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-22T19:33:41.868991] [DEBUG] [LOCAL ] JILL: Trimmed 23105 records to 16727 (keeping 200 days of data) [2025-09-22T19:33:41.970739] [DEBUG] [LOCAL ] JILL: Primary data saved (16727 records). [2025-09-22T19:33:41.970881] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-22T19:33:41.970975] [INFO ] [MAIN ] Update Progress: 1159/2372 symbols completed. JILL took 20.7s. Estimated remaining: 2h 40m 48s. Rate: 7.5 symbols/min [2025-09-22T19:33:43.020673] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T19:33:43.031801] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-22T19:33:44.481233] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T19:33:44.489576] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-22T19:33:45.966007] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T19:33:45.974263] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-22T19:33:47.329028] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T19:33:47.338357] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-22T19:33:48.703309] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T19:33:48.711047] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-22T19:33:49.865708] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T19:33:49.872012] [INFO ] [REMOTE ] JKS: Full fetch complete (59582 records). [2025-09-22T19:33:49.872142] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-22T19:33:50.297329] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-22T19:33:50.297430] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-22T19:33:50.298771] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-22T19:33:50.298866] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-22T19:33:50.300293] [DEBUG] [LOCAL ] JKS: Trimmed 59582 records to 40152 (keeping 200 days of data) [2025-09-22T19:33:50.604395] [DEBUG] [LOCAL ] JKS: Primary data saved (40152 records). [2025-09-22T19:33:50.604598] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-22T19:33:50.605027] [INFO ] [MAIN ] Update Progress: 1160/2372 symbols completed. JKS took 25.0s. Estimated remaining: 2h 40m 40s. Rate: 7.5 symbols/min [2025-09-22T19:33:51.289616] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:33:51.482330] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:33:51.597588] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:33:51.629138] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:33:51.629914] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-22T19:33:51.629969] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-22T19:33:51.630092] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-22T19:33:51.630131] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-22T19:33:51.630171] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-22T19:33:51.630202] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-22T19:33:51.781809] [DEBUG] [LOCAL ] JLS: Loaded 4152 existing records from primary storage. [2025-09-22T19:33:51.787275] [INFO ] [MAIN ] JLS: Loaded 4152 existing records. [2025-09-22T19:33:51.999495] [DEBUG] [LOCAL ] JLL: Loaded 32790 existing records from primary storage. [2025-09-22T19:33:52.011140] [DEBUG] [LOCAL ] JMIA: Loaded 51198 existing records from primary storage. [2025-09-22T19:33:52.057973] [INFO ] [MAIN ] JLL: Loaded 32790 existing records. [2025-09-22T19:33:52.168905] [INFO ] [MAIN ] JMIA: Loaded 51198 existing records. [2025-09-22T19:33:52.214346] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:33:52.281985] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-22T19:33:52.326830] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-22T19:33:52.338489] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-22T19:33:52.419181] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-22T19:33:52.537236] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:33:52.603965] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-22T19:33:52.746596] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:33:52.779766] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:33:52.825519] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-22T19:33:52.825670] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-22T19:33:52.825821] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-22T19:33:52.825734] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-22T19:33:52.904832] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-22T19:33:52.877073] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-22T19:33:52.911582] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-22T19:33:52.911787] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-22T19:33:53.332143] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:33:53.392581] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-22T19:33:53.383275] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-22T19:33:53.513715] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-22T19:33:53.843732] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:33:53.858092] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-22T19:33:53.894329] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:33:53.894753] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-22T19:33:53.950092] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-22T19:33:53.951396] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-22T19:33:54.112503] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-22T19:33:54.114141] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-22T19:33:54.310693] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-22T19:33:54.312300] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-22T19:33:54.569109] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T19:33:54.571049] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-22T19:33:54.649362] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-22T19:33:54.650478] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-22T19:33:55.008157] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T19:33:55.010475] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-22T19:33:55.093521] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-22T19:33:55.095038] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-22T19:33:55.210939] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T19:33:55.558718] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-22T19:33:55.563428] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T19:33:55.722120] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-22T19:33:56.012026] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-22T19:33:56.210490] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-22T19:33:56.522128] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-22T19:33:57.322103] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-22T19:33:57.808286] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-22T19:33:58.122072] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-22T19:33:58.357899] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T19:33:58.922091] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-22T19:33:58.940737] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T19:33:59.722076] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-22T19:33:59.801788] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T19:34:00.287675] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T19:34:00.522068] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-22T19:34:01.322073] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-22T19:34:01.745612] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T19:34:02.087671] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T19:34:02.122052] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-22T19:34:02.922056] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-22T19:34:03.370204] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-22T19:34:03.558342] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T19:34:03.722063] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-22T19:34:04.168636] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-22T19:34:04.522154] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-22T19:34:05.152524] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-22T19:34:05.322043] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-22T19:34:06.122057] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-22T19:34:06.572355] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T19:34:06.573273] [INFO ] [REMOTE ] JMM: Full fetch complete (2296 records). [2025-09-22T19:34:06.573366] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-22T19:34:06.767404] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-22T19:34:06.767803] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:34:06.767895] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:34:06.768109] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-22T19:34:06.768317] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-22T19:34:06.768428] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-22T19:34:06.768561] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-22T19:34:06.768715] [INFO ] [MAIN ] Update Progress: 1161/2372 symbols completed. JMM took 16.2s. Estimated remaining: 2h 40m 41s. Rate: 7.5 symbols/min [2025-09-22T19:34:06.924879] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-22T19:34:06.972154] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:34:06.975571] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T19:34:07.056763] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-22T19:34:07.056974] [INFO ] [MAIN ] JNJ: Loaded 54533 existing records. [2025-09-22T19:34:07.238397] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:34:07.238679] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-22T19:34:07.238741] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-22T19:34:07.240251] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-22T19:34:07.240327] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-22T19:34:07.608271] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:34:07.722083] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-22T19:34:08.270925] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T19:34:08.282038] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T19:34:08.283765] [INFO ] [REMOTE ] JLS: Full fetch complete (5757 records). [2025-09-22T19:34:08.283907] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-22T19:34:08.531860] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-22T19:34:08.676037] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-22T19:34:08.676119] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-22T19:34:08.676306] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-22T19:34:08.676347] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-22T19:34:08.676786] [DEBUG] [LOCAL ] JLS: Trimmed 5757 records to 4074 (keeping 200 days of data) [2025-09-22T19:34:08.707204] [DEBUG] [LOCAL ] JLS: Primary data saved (4074 records). [2025-09-22T19:34:08.707326] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-22T19:34:08.707456] [INFO ] [MAIN ] Update Progress: 1162/2372 symbols completed. JLS took 18.1s. Estimated remaining: 2h 40m 27s. Rate: 7.5 symbols/min [2025-09-22T19:34:08.913509] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:34:08.993183] [DEBUG] [LOCAL ] JOBY: Loaded 54578 existing records from primary storage. [2025-09-22T19:34:08.993410] [INFO ] [MAIN ] JOBY: Loaded 54578 existing records. [2025-09-22T19:34:09.174487] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:34:09.174787] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-22T19:34:09.174844] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-22T19:34:09.176541] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-22T19:34:09.176635] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-22T19:34:09.327329] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-22T19:34:09.543716] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:34:10.122072] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-22T19:34:10.503318] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-22T19:34:10.836823] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T19:34:10.922052] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-22T19:34:11.722132] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-22T19:34:12.412568] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T19:34:12.523989] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-22T19:34:12.530697] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-22T19:34:13.322061] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-22T19:34:13.880487] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T19:34:14.106436] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-22T19:34:14.122008] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-22T19:34:14.922061] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-22T19:34:15.599158] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-22T19:34:15.722055] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-22T19:34:16.359704] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-22T19:34:16.522066] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-22T19:34:16.665088] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T19:34:17.322065] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-22T19:34:17.934838] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-22T19:34:18.122032] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-22T19:34:18.579594] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T19:34:18.657322] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-22T19:34:18.922057] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-22T19:34:19.722071] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-22T19:34:20.187301] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T19:34:20.348602] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-22T19:34:20.522051] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-22T19:34:21.322083] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-22T19:34:21.923545] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-22T19:34:22.016536] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T19:34:22.122088] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-22T19:34:22.922093] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-22T19:34:23.594936] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-22T19:34:23.686823] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T19:34:23.722051] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-22T19:34:24.337554] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T19:34:24.342758] [INFO ] [REMOTE ] JLL: Full fetch complete (44848 records). [2025-09-22T19:34:24.342851] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-22T19:34:24.533188] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-22T19:34:24.732761] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-22T19:34:24.732867] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-22T19:34:24.733748] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-22T19:34:24.733816] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-22T19:34:24.735130] [DEBUG] [LOCAL ] JLL: Trimmed 44848 records to 32228 (keeping 200 days of data) [2025-09-22T19:34:24.956904] [DEBUG] [LOCAL ] JLL: Primary data saved (32228 records). [2025-09-22T19:34:24.957071] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-22T19:34:24.959252] [INFO ] [MAIN ] Update Progress: 1163/2372 symbols completed. JLL took 34.3s. Estimated remaining: 2h 40m 27s. Rate: 7.5 symbols/min [2025-09-22T19:34:25.137443] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:34:25.172262] [DEBUG] [LOCAL ] JOE: Loaded 25189 existing records from primary storage. [2025-09-22T19:34:25.173072] [INFO ] [MAIN ] JOE: Loaded 25189 existing records. [2025-09-22T19:34:25.327302] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-22T19:34:25.362614] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:34:25.363047] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-22T19:34:25.363151] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-22T19:34:25.364136] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-22T19:34:25.364199] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-22T19:34:25.728722] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:34:25.763049] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T19:34:26.122043] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-22T19:34:26.922023] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-22T19:34:26.999750] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-22T19:34:27.560936] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-22T19:34:27.722115] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-22T19:34:28.115166] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-22T19:34:28.126135] [INFO ] [REMOTE ] JMIA: Full fetch complete (73225 records). [2025-09-22T19:34:28.126286] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-22T19:34:28.460268] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T19:34:28.527253] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-22T19:34:28.589747] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-22T19:34:28.589987] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-22T19:34:28.591082] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-22T19:34:28.591150] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-22T19:34:28.593095] [DEBUG] [LOCAL ] JMIA: Trimmed 73225 records to 50473 (keeping 200 days of data) [2025-09-22T19:34:28.906995] [DEBUG] [LOCAL ] JMIA: Primary data saved (50473 records). [2025-09-22T19:34:28.907145] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-22T19:34:28.907265] [INFO ] [MAIN ] Update Progress: 1164/2372 symbols completed. JMIA took 38.3s. Estimated remaining: 2h 40m 15s. Rate: 7.5 symbols/min [2025-09-22T19:34:29.084765] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:34:29.093321] [DEBUG] [LOCAL ] JOF: Loaded 7259 existing records from primary storage. [2025-09-22T19:34:29.093424] [INFO ] [MAIN ] JOF: Loaded 7259 existing records. [2025-09-22T19:34:29.269979] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:34:29.270262] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-22T19:34:29.270311] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-22T19:34:29.270829] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-22T19:34:29.270888] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-22T19:34:29.335978] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-22T19:34:29.643547] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:34:29.747558] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-22T19:34:29.864915] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T19:34:30.122064] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-22T19:34:30.922071] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-22T19:34:31.722039] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-22T19:34:31.748005] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T19:34:31.847902] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-22T19:34:32.171927] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-22T19:34:32.522127] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-22T19:34:32.774968] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-22T19:34:33.322081] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-22T19:34:33.899754] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T19:34:34.122060] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-22T19:34:34.922022] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-22T19:34:35.293162] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-22T19:34:35.354956] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T19:34:35.722051] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-22T19:34:36.522122] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-22T19:34:36.867753] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T19:34:36.946497] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T19:34:37.322055] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-22T19:34:38.122048] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-22T19:34:38.324294] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-22T19:34:38.650894] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T19:34:38.922066] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-22T19:34:39.595450] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T19:34:39.722046] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-22T19:34:40.350913] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-22T19:34:40.522071] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-22T19:34:40.563494] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-22T19:34:41.322068] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-22T19:34:42.122087] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-22T19:34:42.507328] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-22T19:34:42.783855] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T19:34:42.922104] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-22T19:34:43.554870] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (3.03 seconds). [2025-09-22T19:34:43.567418] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-22T19:34:43.567593] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-22T19:34:43.722263] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-22T19:34:43.890591] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-22T19:34:43.991510] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-22T19:34:43.991588] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-22T19:34:43.992558] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-22T19:34:43.992633] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-22T19:34:43.994148] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53799 (keeping 200 days of data) [2025-09-22T19:34:44.318635] [DEBUG] [LOCAL ] JOBY: Primary data saved (53799 records). [2025-09-22T19:34:44.318823] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-22T19:34:44.318916] [INFO ] [MAIN ] Update Progress: 1165/2372 symbols completed. JOBY took 35.6s. Estimated remaining: 2h 40m 15s. Rate: 7.5 symbols/min [2025-09-22T19:34:44.486374] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:34:44.522794] [DEBUG] [LOCAL ] JPC: Loaded 37802 existing records from primary storage. [2025-09-22T19:34:44.522074] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-22T19:34:44.523768] [INFO ] [MAIN ] JPC: Loaded 37802 existing records. [2025-09-22T19:34:44.703606] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:34:44.703871] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-22T19:34:44.703930] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-22T19:34:44.705057] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-22T19:34:44.705118] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-22T19:34:45.060801] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:34:45.322061] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-22T19:34:45.792387] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T19:34:45.828527] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T19:34:45.955859] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-22T19:34:45.964967] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-22T19:34:45.965194] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-22T19:34:46.127164] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-22T19:34:46.421883] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-22T19:34:46.421977] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-22T19:34:46.422972] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-22T19:34:46.423038] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-22T19:34:46.424515] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-09-22T19:34:46.769578] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-22T19:34:46.769747] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-22T19:34:46.769842] [INFO ] [MAIN ] Update Progress: 1166/2372 symbols completed. JNJ took 40.0s. Estimated remaining: 2h 40m 1s. Rate: 7.5 symbols/min [2025-09-22T19:34:46.926306] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-22T19:34:46.966189] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T19:34:46.965266] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:34:47.026973] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-22T19:34:47.027174] [INFO ] [MAIN ] JPM: Loaded 54574 existing records. [2025-09-22T19:34:47.217597] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:34:47.217896] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-22T19:34:47.217946] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-22T19:34:47.219622] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-22T19:34:47.219719] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-22T19:34:47.575683] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:34:47.722073] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-22T19:34:48.522073] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-22T19:34:48.718975] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T19:34:49.322012] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-22T19:34:49.636504] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T19:34:49.818765] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-22T19:34:50.122066] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-22T19:34:50.751932] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T19:34:50.871584] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:34:50.922075] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-22T19:34:51.722045] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-22T19:34:51.835610] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T19:34:51.839559] [INFO ] [REMOTE ] JOE: Full fetch complete (36382 records). [2025-09-22T19:34:51.839684] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-22T19:34:52.213171] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-22T19:34:52.213288] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-22T19:34:52.213972] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-22T19:34:52.214034] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-22T19:34:52.214859] [DEBUG] [LOCAL ] JOE: Trimmed 36382 records to 24699 (keeping 200 days of data) [2025-09-22T19:34:52.372213] [DEBUG] [LOCAL ] JOE: Primary data saved (24699 records). [2025-09-22T19:34:52.372346] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-22T19:34:52.372428] [INFO ] [MAIN ] Update Progress: 1167/2372 symbols completed. JOE took 27.4s. Estimated remaining: 2h 39m 51s. Rate: 7.5 symbols/min [2025-09-22T19:34:52.523767] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-22T19:34:52.543283] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:34:52.577182] [DEBUG] [LOCAL ] JQC: Loaded 34392 existing records from primary storage. [2025-09-22T19:34:52.577390] [INFO ] [MAIN ] JQC: Loaded 34392 existing records. [2025-09-22T19:34:52.753922] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:34:52.754177] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-22T19:34:52.754224] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-22T19:34:52.755336] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-22T19:34:52.755397] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-22T19:34:53.113088] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:34:53.322023] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-22T19:34:53.895089] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T19:34:54.019953] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-22T19:34:54.122039] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-22T19:34:54.308241] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T19:34:54.922113] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-22T19:34:55.694765] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T19:34:55.696733] [INFO ] [REMOTE ] JOF: Full fetch complete (9482 records). [2025-09-22T19:34:55.696806] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-22T19:34:55.728372] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-22T19:34:56.070965] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-22T19:34:56.071047] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-22T19:34:56.071333] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-22T19:34:56.071373] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-22T19:34:56.071883] [DEBUG] [LOCAL ] JOF: Trimmed 9482 records to 7137 (keeping 200 days of data) [2025-09-22T19:34:56.117034] [DEBUG] [LOCAL ] JOF: Primary data saved (7137 records). [2025-09-22T19:34:56.117178] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-22T19:34:56.117267] [INFO ] [MAIN ] Update Progress: 1168/2372 symbols completed. JOF took 27.2s. Estimated remaining: 2h 39m 39s. Rate: 7.5 symbols/min [2025-09-22T19:34:56.309072] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:34:56.346051] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-22T19:34:56.362832] [DEBUG] [LOCAL ] JRI: Loaded 15354 existing records from primary storage. [2025-09-22T19:34:56.363000] [INFO ] [MAIN ] JRI: Loaded 15354 existing records. [2025-09-22T19:34:56.534772] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-22T19:34:56.558168] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:34:56.558446] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-22T19:34:56.558504] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-22T19:34:56.559090] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-22T19:34:56.559151] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-22T19:34:56.927985] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:34:57.322018] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-22T19:34:57.413106] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T19:34:58.122085] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-22T19:34:58.763247] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T19:34:58.922030] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-22T19:34:59.043809] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-22T19:34:59.067017] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T19:34:59.722058] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-22T19:34:59.905631] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-22T19:35:00.522051] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-22T19:35:01.318991] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T19:35:01.327276] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-22T19:35:01.567466] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T19:35:02.122113] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-22T19:35:02.922077] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-22T19:35:03.117007] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T19:35:03.722046] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-22T19:35:03.856687] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-22T19:35:04.258359] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T19:35:04.522113] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-22T19:35:05.130857] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T19:35:05.148574] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T19:35:05.322087] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-22T19:35:06.122132] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-22T19:35:06.654453] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T19:35:06.922056] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-22T19:35:07.722056] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-22T19:35:08.382903] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T19:35:08.454418] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-22T19:35:08.522005] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-22T19:35:08.652550] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-22T19:35:09.322060] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-22T19:35:10.122071] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-22T19:35:10.161754] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T19:35:10.460081] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T19:35:10.922058] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-22T19:35:11.531484] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T19:35:11.722088] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-22T19:35:12.491486] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T19:35:12.522016] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-22T19:35:12.913326] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T19:35:13.322059] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-22T19:35:13.579411] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-22T19:35:14.122054] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-22T19:35:14.549731] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T19:35:14.760958] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T19:35:14.922057] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-22T19:35:15.722108] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-22T19:35:16.522089] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-22T19:35:16.850593] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T19:35:16.854431] [INFO ] [REMOTE ] JRI: Full fetch complete (23148 records). [2025-09-22T19:35:16.854552] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-22T19:35:17.244054] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-22T19:35:17.244174] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-22T19:35:17.244885] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-22T19:35:17.244963] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-22T19:35:17.246626] [DEBUG] [LOCAL ] JRI: Trimmed 23148 records to 15004 (keeping 200 days of data) [2025-09-22T19:35:17.315782] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-22T19:35:17.327010] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-22T19:35:17.402168] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T19:35:17.421151] [DEBUG] [LOCAL ] JRI: Primary data saved (15004 records). [2025-09-22T19:35:17.421291] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-22T19:35:17.421395] [INFO ] [MAIN ] Update Progress: 1169/2372 symbols completed. JRI took 21.3s. Estimated remaining: 2h 39m 44s. Rate: 7.5 symbols/min [2025-09-22T19:35:17.598619] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:35:17.610824] [DEBUG] [LOCAL ] JRS: Loaded 11214 existing records from primary storage. [2025-09-22T19:35:17.610925] [INFO ] [MAIN ] JRS: Loaded 11214 existing records. [2025-09-22T19:35:17.798746] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:35:17.799053] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-22T19:35:17.799127] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-22T19:35:17.799637] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-22T19:35:17.799758] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-22T19:35:18.128602] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-22T19:35:18.169584] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:35:18.500268] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T19:35:18.506334] [INFO ] [REMOTE ] JPC: Full fetch complete (55736 records). [2025-09-22T19:35:18.506469] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-22T19:35:18.888045] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-22T19:35:18.888126] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-22T19:35:18.888949] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-22T19:35:18.889013] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-22T19:35:18.890186] [DEBUG] [LOCAL ] JPC: Trimmed 55736 records to 37152 (keeping 200 days of data) [2025-09-22T19:35:18.940746] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-22T19:35:19.111370] [DEBUG] [LOCAL ] JPC: Primary data saved (37152 records). [2025-09-22T19:35:19.111508] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-22T19:35:19.111608] [INFO ] [MAIN ] Update Progress: 1170/2372 symbols completed. JPC took 34.8s. Estimated remaining: 2h 39m 30s. Rate: 7.5 symbols/min [2025-09-22T19:35:19.288447] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:35:19.332466] [DEBUG] [LOCAL ] JXN: Loaded 46816 existing records from primary storage. [2025-09-22T19:35:19.332600] [INFO ] [MAIN ] JXN: Loaded 46816 existing records. [2025-09-22T19:35:19.475220] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T19:35:19.532905] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:35:19.533119] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-22T19:35:19.533176] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-22T19:35:19.534452] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-22T19:35:19.534513] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-22T19:35:19.727153] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-22T19:35:19.895870] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:35:20.522042] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-22T19:35:20.807212] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T19:35:21.013360] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-22T19:35:21.021800] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-22T19:35:21.021923] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-22T19:35:21.323768] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-22T19:35:21.420803] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-22T19:35:21.420883] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-22T19:35:21.421886] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-22T19:35:21.421952] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-22T19:35:21.423412] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-09-22T19:35:21.762253] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-22T19:35:21.762386] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-22T19:35:21.762500] [INFO ] [MAIN ] Update Progress: 1171/2372 symbols completed. JPM took 35.0s. Estimated remaining: 2h 39m 17s. Rate: 7.5 symbols/min [2025-09-22T19:35:21.936976] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:35:22.007892] [DEBUG] [LOCAL ] K: Loaded 50518 existing records from primary storage. [2025-09-22T19:35:22.009339] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T19:35:22.009459] [INFO ] [MAIN ] K: Loaded 50518 existing records. [2025-09-22T19:35:22.127099] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-22T19:35:22.199929] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:35:22.200141] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-22T19:35:22.200189] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-22T19:35:22.201253] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-22T19:35:22.201318] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-22T19:35:22.562020] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:35:22.690525] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T19:35:22.922097] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-22T19:35:22.957372] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T19:35:23.722096] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-22T19:35:24.415003] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T19:35:24.522044] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-22T19:35:25.148890] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T19:35:25.322059] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-22T19:35:25.983251] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T19:35:26.122011] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-22T19:35:26.584210] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T19:35:26.589343] [INFO ] [REMOTE ] JQC: Full fetch complete (48631 records). [2025-09-22T19:35:26.589450] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-22T19:35:26.932902] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-22T19:35:26.986762] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-22T19:35:26.986844] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-22T19:35:26.987687] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-22T19:35:26.987751] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-22T19:35:26.988966] [DEBUG] [LOCAL ] JQC: Trimmed 48631 records to 33859 (keeping 200 days of data) [2025-09-22T19:35:27.186473] [DEBUG] [LOCAL ] JQC: Primary data saved (33859 records). [2025-09-22T19:35:27.186695] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-22T19:35:27.186826] [INFO ] [MAIN ] Update Progress: 1172/2372 symbols completed. JQC took 34.8s. Estimated remaining: 2h 39m 6s. Rate: 7.5 symbols/min [2025-09-22T19:35:27.370429] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:35:27.388446] [DEBUG] [LOCAL ] KAI: Loaded 13884 existing records from primary storage. [2025-09-22T19:35:27.388581] [INFO ] [MAIN ] KAI: Loaded 13884 existing records. [2025-09-22T19:35:27.587363] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:35:27.587956] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-22T19:35:27.588105] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-22T19:35:27.588883] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-22T19:35:27.588952] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-22T19:35:27.723719] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-22T19:35:28.010346] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:35:28.012778] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T19:35:28.526609] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-22T19:35:28.529516] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T19:35:28.796757] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T19:35:29.322064] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-22T19:35:29.588230] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T19:35:30.122072] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-22T19:35:30.909672] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T19:35:30.922011] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-22T19:35:31.019609] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T19:35:31.693612] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-22T19:35:31.722076] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-22T19:35:32.522086] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-22T19:35:32.552969] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T19:35:33.322053] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-22T19:35:34.127143] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-22T19:35:34.142720] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T19:35:34.927085] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-22T19:35:34.929160] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T19:35:34.978763] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T19:35:35.722026] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-22T19:35:35.960784] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T19:35:36.522039] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-22T19:35:36.683954] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T19:35:37.322027] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-22T19:35:37.368983] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-22T19:35:38.122029] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-22T19:35:38.370220] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T19:35:38.922054] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-22T19:35:39.466144] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-22T19:35:39.504594] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T19:35:39.722059] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-22T19:35:40.479790] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T19:35:40.482191] [INFO ] [REMOTE ] JRS: Full fetch complete (16033 records). [2025-09-22T19:35:40.482265] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-22T19:35:40.527157] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-22T19:35:40.855413] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-22T19:35:40.855496] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-22T19:35:40.855897] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-22T19:35:40.855972] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-22T19:35:40.856535] [DEBUG] [LOCAL ] JRS: Trimmed 16033 records to 11083 (keeping 200 days of data) [2025-09-22T19:35:40.926160] [DEBUG] [LOCAL ] JRS: Primary data saved (11083 records). [2025-09-22T19:35:40.926293] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-22T19:35:40.926380] [INFO ] [MAIN ] Update Progress: 1173/2372 symbols completed. JRS took 23.5s. Estimated remaining: 2h 39m 4s. Rate: 7.5 symbols/min [2025-09-22T19:35:41.100507] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:35:41.146818] [DEBUG] [LOCAL ] KAR: Loaded 40650 existing records from primary storage. [2025-09-22T19:35:41.146964] [INFO ] [MAIN ] KAR: Loaded 40650 existing records. [2025-09-22T19:35:41.331785] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-22T19:35:41.337935] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:35:41.338935] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-22T19:35:41.339018] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-22T19:35:41.340523] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-22T19:35:41.340590] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-22T19:35:41.712740] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:35:42.122058] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-22T19:35:42.220991] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T19:35:42.624478] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T19:35:42.922108] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-22T19:35:43.434817] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T19:35:43.722060] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-22T19:35:44.384016] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T19:35:44.522039] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-22T19:35:45.280952] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T19:35:45.322013] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-22T19:35:46.131478] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-22T19:35:46.137503] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T19:35:46.450705] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T19:35:46.922094] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-22T19:35:47.722076] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-22T19:35:47.778441] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T19:35:47.846353] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T19:35:48.522019] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-22T19:35:48.694178] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T19:35:49.322058] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-22T19:35:50.034938] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T19:35:50.122067] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-22T19:35:50.217574] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T19:35:50.922091] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-22T19:35:51.722112] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-22T19:35:51.762357] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T19:35:52.127600] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T19:35:52.440036] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-22T19:35:52.522039] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-22T19:35:53.324511] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T19:35:53.323330] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-22T19:35:54.122076] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-22T19:35:54.922136] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-22T19:35:55.034914] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T19:35:55.044735] [INFO ] [REMOTE ] JXN: Full fetch complete (65295 records). [2025-09-22T19:35:55.044876] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-22T19:35:55.453038] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-22T19:35:55.453120] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-22T19:35:55.454009] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-22T19:35:55.454146] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-22T19:35:55.456707] [DEBUG] [LOCAL ] JXN: Trimmed 65295 records to 46037 (keeping 200 days of data) [2025-09-22T19:35:55.726432] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-22T19:35:55.735342] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T19:35:55.813392] [DEBUG] [LOCAL ] JXN: Primary data saved (46037 records). [2025-09-22T19:35:55.813586] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-22T19:35:55.813863] [INFO ] [MAIN ] Update Progress: 1174/2372 symbols completed. JXN took 36.7s. Estimated remaining: 2h 39m 3s. Rate: 7.5 symbols/min [2025-09-22T19:35:55.946135] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-22T19:35:55.997725] [INFO ] [REMOTE ] KAI: Full fetch complete (18745 records). [2025-09-22T19:35:56.015175] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-22T19:35:56.016846] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:35:56.322942] [DEBUG] [LOCAL ] KB: Loaded 24706 existing records from primary storage. [2025-09-22T19:35:56.328741] [INFO ] [MAIN ] KB: Loaded 24706 existing records. [2025-09-22T19:35:56.529003] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-22T19:35:56.523638] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-22T19:35:56.530191] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-22T19:35:56.559182] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-22T19:35:56.574587] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-22T19:35:56.599426] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:35:56.599862] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-22T19:35:56.599938] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-22T19:35:56.601017] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-22T19:35:56.601107] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-22T19:35:56.633407] [DEBUG] [LOCAL ] KAI: Trimmed 18745 records to 13617 (keeping 200 days of data) [2025-09-22T19:35:57.073466] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:35:57.090720] [DEBUG] [LOCAL ] KAI: Primary data saved (13617 records). [2025-09-22T19:35:57.090872] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-22T19:35:57.091012] [INFO ] [MAIN ] Update Progress: 1175/2372 symbols completed. KAI took 29.9s. Estimated remaining: 2h 38m 48s. Rate: 7.5 symbols/min [2025-09-22T19:35:57.320976] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:35:57.322062] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-22T19:35:57.349813] [DEBUG] [LOCAL ] KBDC: Loaded 20999 existing records from primary storage. [2025-09-22T19:35:57.349958] [INFO ] [MAIN ] KBDC: Loaded 20999 existing records. [2025-09-22T19:35:57.567955] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:35:57.571186] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-22T19:35:57.571289] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-22T19:35:57.573713] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-22T19:35:57.573620] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T19:35:57.573905] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-22T19:35:57.937999] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:35:57.987155] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T19:35:58.122069] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-22T19:35:58.221911] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T19:35:58.922076] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-22T19:35:59.261034] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T19:35:59.722083] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-22T19:36:00.031761] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-22T19:36:00.522121] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-22T19:36:00.656861] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-22T19:36:01.322062] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-22T19:36:02.122064] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-22T19:36:02.609255] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-22T19:36:02.922068] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-22T19:36:03.722067] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-22T19:36:03.917151] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-22T19:36:04.522030] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-22T19:36:04.839477] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-22T19:36:04.911912] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T19:36:05.322066] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-22T19:36:05.660173] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-22T19:36:05.671176] [INFO ] [REMOTE ] K: Full fetch complete (71818 records). [2025-09-22T19:36:05.671334] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-22T19:36:06.077811] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-22T19:36:06.078011] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-22T19:36:06.080157] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-22T19:36:06.080262] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-22T19:36:06.098083] [DEBUG] [LOCAL ] K: Trimmed 71818 records to 49811 (keeping 200 days of data) [2025-09-22T19:36:06.112951] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T19:36:06.122372] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-22T19:36:06.460511] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T19:36:06.486611] [DEBUG] [LOCAL ] K: Primary data saved (49811 records). [2025-09-22T19:36:06.486998] [INFO ] [MAIN ] K: Full history saved. [2025-09-22T19:36:06.487156] [INFO ] [MAIN ] Update Progress: 1176/2372 symbols completed. K took 44.7s. Estimated remaining: 2h 38m 42s. Rate: 7.5 symbols/min [2025-09-22T19:36:06.668271] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:36:06.720359] [DEBUG] [LOCAL ] KBH: Loaded 49581 existing records from primary storage. [2025-09-22T19:36:06.720519] [INFO ] [MAIN ] KBH: Loaded 49581 existing records. [2025-09-22T19:36:06.920227] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:36:06.920529] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-22T19:36:06.920605] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-22T19:36:06.921915] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-22T19:36:06.922044] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-22T19:36:06.922197] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-22T19:36:07.230681] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T19:36:07.316823] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:36:07.722071] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-22T19:36:07.976427] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T19:36:08.522092] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-22T19:36:09.226778] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T19:36:09.322061] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-22T19:36:09.842983] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T19:36:10.122076] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-22T19:36:10.597505] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T19:36:10.604822] [INFO ] [REMOTE ] KAR: Full fetch complete (56618 records). [2025-09-22T19:36:10.605004] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-22T19:36:10.927121] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-22T19:36:11.009722] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-22T19:36:11.009863] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-22T19:36:11.010723] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-22T19:36:11.010785] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-22T19:36:11.012518] [DEBUG] [LOCAL ] KAR: Trimmed 56618 records to 39949 (keeping 200 days of data) [2025-09-22T19:36:11.260562] [DEBUG] [LOCAL ] KAR: Primary data saved (39949 records). [2025-09-22T19:36:11.260743] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-22T19:36:11.260869] [INFO ] [MAIN ] Update Progress: 1177/2372 symbols completed. KAR took 30.3s. Estimated remaining: 2h 38m 31s. Rate: 7.5 symbols/min [2025-09-22T19:36:11.434772] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:36:11.457197] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T19:36:11.509707] [DEBUG] [LOCAL ] KBR: Loaded 48981 existing records from primary storage. [2025-09-22T19:36:11.509862] [INFO ] [MAIN ] KBR: Loaded 48981 existing records. [2025-09-22T19:36:11.695236] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:36:11.695535] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-22T19:36:11.695585] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-22T19:36:11.697005] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-22T19:36:11.697069] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-22T19:36:11.729047] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-22T19:36:12.074716] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:36:12.141682] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T19:36:12.522053] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-22T19:36:12.792155] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-22T19:36:13.322066] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-22T19:36:14.122019] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-22T19:36:14.514950] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T19:36:14.539267] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T19:36:14.922059] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-22T19:36:15.722058] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-22T19:36:16.522082] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-22T19:36:17.093090] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-22T19:36:17.096638] [INFO ] [REMOTE ] KB: Full fetch complete (34909 records). [2025-09-22T19:36:17.096801] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-22T19:36:17.513364] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-22T19:36:17.513706] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-22T19:36:17.514910] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-22T19:36:17.516533] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-22T19:36:17.516438] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (3.39 seconds). [2025-09-22T19:36:17.526841] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-22T19:36:17.527999] [DEBUG] [LOCAL ] KB: Trimmed 34909 records to 24236 (keeping 200 days of data) [2025-09-22T19:36:17.680678] [DEBUG] [LOCAL ] KB: Primary data saved (24236 records). [2025-09-22T19:36:17.680815] [INFO ] [MAIN ] KB: Full history saved. [2025-09-22T19:36:17.680921] [INFO ] [MAIN ] Update Progress: 1178/2372 symbols completed. KB took 21.9s. Estimated remaining: 2h 38m 21s. Rate: 7.5 symbols/min [2025-09-22T19:36:17.855192] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:36:17.870262] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T19:36:17.933582] [DEBUG] [LOCAL ] KD: Loaded 53065 existing records from primary storage. [2025-09-22T19:36:17.933760] [INFO ] [MAIN ] KD: Loaded 53065 existing records. [2025-09-22T19:36:18.124053] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-22T19:36:18.124248] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:36:18.125810] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-22T19:36:18.125896] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-22T19:36:18.127586] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-22T19:36:18.127683] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-22T19:36:18.523187] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:36:18.550074] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-22T19:36:18.760826] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T19:36:18.897025] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T19:36:18.922010] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-22T19:36:19.722063] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-22T19:36:20.522094] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-22T19:36:20.603765] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T19:36:20.763050] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T19:36:21.322062] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-22T19:36:22.036453] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T19:36:22.122076] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-22T19:36:22.415202] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T19:36:22.922083] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-22T19:36:23.722061] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-22T19:36:23.811603] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T19:36:24.522114] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-22T19:36:24.745002] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T19:36:25.097283] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T19:36:25.322078] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-22T19:36:25.765416] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T19:36:25.771213] [INFO ] [REMOTE ] KBDC: Full fetch complete (27725 records). [2025-09-22T19:36:25.771384] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-22T19:36:26.127571] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-22T19:36:26.168592] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-22T19:36:26.168713] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-22T19:36:26.169355] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-22T19:36:26.169423] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-22T19:36:26.170436] [DEBUG] [LOCAL ] KBDC: Trimmed 27725 records to 20592 (keeping 200 days of data) [2025-09-22T19:36:26.311888] [DEBUG] [LOCAL ] KBDC: Primary data saved (20592 records). [2025-09-22T19:36:26.312028] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-22T19:36:26.312123] [INFO ] [MAIN ] Update Progress: 1179/2372 symbols completed. KBDC took 29.2s. Estimated remaining: 2h 38m 14s. Rate: 7.5 symbols/min [2025-09-22T19:36:26.484134] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:36:26.491060] [DEBUG] [LOCAL ] KEN: Loaded 4795 existing records from primary storage. [2025-09-22T19:36:26.491179] [INFO ] [MAIN ] KEN: Loaded 4795 existing records. [2025-09-22T19:36:26.671500] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:36:26.671788] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-22T19:36:26.671845] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-22T19:36:26.672166] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-22T19:36:26.672228] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-22T19:36:26.929400] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-22T19:36:27.062482] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:36:27.116685] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T19:36:27.622828] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T19:36:27.722128] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-22T19:36:28.522172] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-22T19:36:29.069535] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-22T19:36:29.209396] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-22T19:36:29.278063] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T19:36:29.322075] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-22T19:36:30.122084] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-22T19:36:30.694378] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T19:36:30.718051] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T19:36:30.922076] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-22T19:36:31.722129] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-22T19:36:32.514282] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T19:36:32.523713] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-22T19:36:32.899130] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-22T19:36:33.322063] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-22T19:36:33.426287] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T19:36:34.122075] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-22T19:36:34.922090] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-22T19:36:35.009300] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T19:36:35.722787] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-22T19:36:35.731784] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T19:36:36.236823] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T19:36:36.522077] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-22T19:36:37.322064] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-22T19:36:37.375511] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T19:36:38.041313] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T19:36:38.122073] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-22T19:36:38.676312] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-22T19:36:38.809909] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T19:36:38.922073] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-22T19:36:39.722074] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-22T19:36:40.522064] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-22T19:36:40.590528] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T19:36:40.598443] [INFO ] [REMOTE ] KBR: Full fetch complete (69829 records). [2025-09-22T19:36:40.598620] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-22T19:36:41.012622] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-22T19:36:41.012759] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-22T19:36:41.013758] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-22T19:36:41.013835] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-22T19:36:41.015357] [DEBUG] [LOCAL ] KBR: Trimmed 69829 records to 48204 (keeping 200 days of data) [2025-09-22T19:36:41.317199] [DEBUG] [LOCAL ] KBR: Primary data saved (48204 records). [2025-09-22T19:36:41.317412] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-22T19:36:41.317518] [INFO ] [MAIN ] Update Progress: 1180/2372 symbols completed. KBR took 30.1s. Estimated remaining: 2h 38m 13s. Rate: 7.5 symbols/min [2025-09-22T19:36:41.349303] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-22T19:36:41.496461] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:36:41.525471] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T19:36:41.562797] [DEBUG] [LOCAL ] KEP: Loaded 30662 existing records from primary storage. [2025-09-22T19:36:41.562941] [INFO ] [MAIN ] KEP: Loaded 30662 existing records. [2025-09-22T19:36:41.737848] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:36:41.738149] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-22T19:36:41.738214] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-22T19:36:41.741725] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-22T19:36:41.741786] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-22T19:36:42.101297] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:36:42.122001] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-22T19:36:42.140763] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T19:36:42.301734] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T19:36:42.922082] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-22T19:36:43.627777] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T19:36:43.722027] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-22T19:36:44.532687] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-22T19:36:44.539620] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T19:36:44.671492] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T19:36:45.001497] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T19:36:45.322078] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-22T19:36:46.122061] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-22T19:36:46.592783] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-22T19:36:46.922046] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-22T19:36:47.111824] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T19:36:47.541989] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T19:36:47.722057] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-22T19:36:48.282568] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-22T19:36:48.522053] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-22T19:36:49.322071] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-22T19:36:49.815201] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-22T19:36:49.816396] [INFO ] [REMOTE ] KEN: Full fetch complete (5974 records). [2025-09-22T19:36:49.816464] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-22T19:36:50.127182] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-22T19:36:50.188411] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-22T19:36:50.188498] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-22T19:36:50.188694] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-22T19:36:50.188757] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-22T19:36:50.189749] [DEBUG] [LOCAL ] KEN: Trimmed 5974 records to 4763 (keeping 200 days of data) [2025-09-22T19:36:50.218701] [DEBUG] [LOCAL ] KEN: Primary data saved (4763 records). [2025-09-22T19:36:50.218856] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-22T19:36:50.218944] [INFO ] [MAIN ] Update Progress: 1181/2372 symbols completed. KEN took 23.9s. Estimated remaining: 2h 38m 6s. Rate: 7.5 symbols/min [2025-09-22T19:36:50.392113] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:36:50.442825] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-22T19:36:50.462436] [INFO ] [REMOTE ] KBH: Full fetch complete (70456 records). [2025-09-22T19:36:50.462684] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-22T19:36:50.463334] [DEBUG] [LOCAL ] KEX: Loaded 38420 existing records from primary storage. [2025-09-22T19:36:50.463589] [INFO ] [MAIN ] KEX: Loaded 38420 existing records. [2025-09-22T19:36:50.850813] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:36:50.878626] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-22T19:36:50.913005] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-22T19:36:50.924833] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-22T19:36:50.945951] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-22T19:36:50.970361] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-22T19:36:51.212201] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-22T19:36:51.241853] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-22T19:36:51.263216] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-22T19:36:51.280972] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-22T19:36:51.404941] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T19:36:51.410361] [DEBUG] [LOCAL ] KBH: Trimmed 70456 records to 48917 (keeping 200 days of data) [2025-09-22T19:36:51.582151] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:36:51.722312] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-22T19:36:51.794526] [DEBUG] [LOCAL ] KBH: Primary data saved (48917 records). [2025-09-22T19:36:51.794713] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-22T19:36:51.794814] [INFO ] [MAIN ] Update Progress: 1182/2372 symbols completed. KBH took 45.3s. Estimated remaining: 2h 37m 52s. Rate: 7.5 symbols/min [2025-09-22T19:36:51.964059] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:36:51.964208] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-22T19:36:51.964244] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-22T19:36:51.964382] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-22T19:36:51.964424] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-22T19:36:51.964464] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-22T19:36:51.964495] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-22T19:36:52.340191] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:36:52.513016] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T19:36:52.523723] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-22T19:36:53.323071] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-22T19:36:53.335560] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T19:36:53.384958] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T19:36:54.122111] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-22T19:36:54.922073] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-22T19:36:55.107531] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T19:36:55.369471] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T19:36:55.722075] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-22T19:36:56.186745] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T19:36:56.522104] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-22T19:36:57.322034] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-22T19:36:57.627228] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-22T19:36:57.635499] [INFO ] [REMOTE ] KD: Full fetch complete (75573 records). [2025-09-22T19:36:57.635620] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-22T19:36:58.030368] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-22T19:36:58.030472] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-22T19:36:58.031450] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-22T19:36:58.031626] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-22T19:36:58.033375] [DEBUG] [LOCAL ] KD: Trimmed 75573 records to 52291 (keeping 200 days of data) [2025-09-22T19:36:58.122468] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-22T19:36:58.356864] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T19:36:58.387837] [DEBUG] [LOCAL ] KD: Primary data saved (52291 records). [2025-09-22T19:36:58.387946] [INFO ] [MAIN ] KD: Full history saved. [2025-09-22T19:36:58.388026] [INFO ] [MAIN ] Update Progress: 1183/2372 symbols completed. KD took 40.7s. Estimated remaining: 2h 37m 42s. Rate: 7.5 symbols/min [2025-09-22T19:36:58.579144] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:36:58.622989] [DEBUG] [LOCAL ] KEYS: Loaded 44107 existing records from primary storage. [2025-09-22T19:36:58.623131] [INFO ] [MAIN ] KEYS: Loaded 44107 existing records. [2025-09-22T19:36:58.744884] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T19:36:58.830361] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:36:58.830629] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-22T19:36:58.830709] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-22T19:36:58.831770] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-22T19:36:58.831831] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-22T19:36:58.931629] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-22T19:36:59.225537] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:36:59.262083] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T19:36:59.722061] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-22T19:37:00.522043] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-22T19:37:00.667159] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T19:37:01.247800] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T19:37:01.322055] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-22T19:37:01.928673] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T19:37:02.122071] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-22T19:37:02.589503] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T19:37:02.922161] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-22T19:37:03.443297] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T19:37:03.722066] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-22T19:37:04.391801] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T19:37:04.522106] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-22T19:37:04.825315] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T19:37:05.322054] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-22T19:37:05.994789] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T19:37:06.122018] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-22T19:37:06.500167] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T19:37:06.505374] [INFO ] [REMOTE ] KEP: Full fetch complete (41562 records). [2025-09-22T19:37:06.505588] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-22T19:37:06.889076] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-22T19:37:06.889174] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-22T19:37:06.889906] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-22T19:37:06.890015] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-22T19:37:06.891089] [DEBUG] [LOCAL ] KEP: Trimmed 41562 records to 30456 (keeping 200 days of data) [2025-09-22T19:37:06.943839] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-22T19:37:07.076467] [DEBUG] [LOCAL ] KEP: Primary data saved (30456 records). [2025-09-22T19:37:07.076612] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-22T19:37:07.076727] [INFO ] [MAIN ] Update Progress: 1184/2372 symbols completed. KEP took 25.8s. Estimated remaining: 2h 37m 35s. Rate: 7.5 symbols/min [2025-09-22T19:37:07.242604] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:37:07.246926] [DEBUG] [LOCAL ] KF: Loaded 2520 existing records from primary storage. [2025-09-22T19:37:07.247004] [INFO ] [MAIN ] KF: Loaded 2520 existing records. [2025-09-22T19:37:07.420886] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:37:07.421125] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-22T19:37:07.421171] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-22T19:37:07.421418] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-22T19:37:07.421478] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-22T19:37:07.723839] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-22T19:37:07.783217] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:37:07.859424] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T19:37:08.522054] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-22T19:37:08.556799] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T19:37:09.073751] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T19:37:09.305613] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-22T19:37:09.322020] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-22T19:37:09.811263] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-22T19:37:10.122058] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-22T19:37:10.561291] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T19:37:10.922070] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-22T19:37:11.324012] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-22T19:37:11.722094] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-22T19:37:12.522070] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-22T19:37:13.058249] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-22T19:37:13.298742] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T19:37:13.322007] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-22T19:37:13.882536] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T19:37:14.122053] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-22T19:37:14.922112] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-22T19:37:15.527077] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T19:37:15.722032] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-22T19:37:15.755676] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T19:37:16.168328] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-22T19:37:16.522050] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-22T19:37:16.973134] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-22T19:37:17.322054] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-22T19:37:18.122062] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-22T19:37:18.187528] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T19:37:18.188470] [INFO ] [REMOTE ] KF: Full fetch complete (3897 records). [2025-09-22T19:37:18.188539] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-22T19:37:18.562383] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-22T19:37:18.562489] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-22T19:37:18.562661] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-22T19:37:18.562721] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-22T19:37:18.563088] [DEBUG] [LOCAL ] KF: Trimmed 3897 records to 2480 (keeping 200 days of data) [2025-09-22T19:37:18.578627] [DEBUG] [LOCAL ] KF: Primary data saved (2480 records). [2025-09-22T19:37:18.578721] [INFO ] [MAIN ] KF: Full history saved. [2025-09-22T19:37:18.578799] [INFO ] [MAIN ] Update Progress: 1185/2372 symbols completed. KF took 11.5s. Estimated remaining: 2h 37m 31s. Rate: 7.5 symbols/min [2025-09-22T19:37:18.753599] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:37:18.773971] [DEBUG] [LOCAL ] KFRC: Loaded 19497 existing records from primary storage. [2025-09-22T19:37:18.774099] [INFO ] [MAIN ] KFRC: Loaded 19497 existing records. [2025-09-22T19:37:18.927182] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-22T19:37:18.960566] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:37:18.960852] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-22T19:37:18.960903] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-22T19:37:18.961584] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-22T19:37:18.961673] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-22T19:37:19.329794] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:37:19.722056] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-22T19:37:20.051308] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-22T19:37:20.522113] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-22T19:37:20.592297] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T19:37:21.207921] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T19:37:21.322008] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-22T19:37:22.040602] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T19:37:22.122101] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-22T19:37:22.762310] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T19:37:22.922066] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-22T19:37:23.722033] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-22T19:37:23.903812] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T19:37:24.508177] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T19:37:24.522032] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-22T19:37:25.322080] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-22T19:37:25.425718] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T19:37:25.436394] [INFO ] [REMOTE ] KEX: Full fetch complete (55281 records). [2025-09-22T19:37:25.436567] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-22T19:37:25.849116] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-22T19:37:25.849231] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-22T19:37:25.850144] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-22T19:37:25.850209] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-22T19:37:25.851364] [DEBUG] [LOCAL ] KEX: Trimmed 55281 records to 37878 (keeping 200 days of data) [2025-09-22T19:37:25.974835] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T19:37:26.122258] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-22T19:37:26.129347] [DEBUG] [LOCAL ] KEX: Primary data saved (37878 records). [2025-09-22T19:37:26.129689] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-22T19:37:26.129792] [INFO ] [MAIN ] Update Progress: 1186/2372 symbols completed. KEX took 35.9s. Estimated remaining: 2h 37m 22s. Rate: 7.5 symbols/min [2025-09-22T19:37:26.301771] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:37:26.311881] [DEBUG] [LOCAL ] KFS: Loaded 8270 existing records from primary storage. [2025-09-22T19:37:26.312005] [INFO ] [MAIN ] KFS: Loaded 8270 existing records. [2025-09-22T19:37:26.490837] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:37:26.491111] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-22T19:37:26.491160] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-22T19:37:26.491610] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-22T19:37:26.491712] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-22T19:37:26.807318] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T19:37:26.878936] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:37:26.922034] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-22T19:37:27.493076] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T19:37:27.642516] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T19:37:27.722039] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-22T19:37:28.351489] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-22T19:37:28.522046] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-22T19:37:29.322092] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-22T19:37:29.871372] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T19:37:30.122123] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-22T19:37:30.222842] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T19:37:30.922087] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-22T19:37:31.605051] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T19:37:31.612194] [INFO ] [REMOTE ] KEYS: Full fetch complete (63015 records). [2025-09-22T19:37:31.612364] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-22T19:37:31.727147] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-22T19:37:32.016999] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-22T19:37:32.017125] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-22T19:37:32.018111] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-22T19:37:32.018178] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-22T19:37:32.019474] [DEBUG] [LOCAL ] KEYS: Trimmed 63015 records to 43401 (keeping 200 days of data) [2025-09-22T19:37:32.285991] [DEBUG] [LOCAL ] KEYS: Primary data saved (43401 records). [2025-09-22T19:37:32.286147] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-22T19:37:32.286244] [INFO ] [MAIN ] Update Progress: 1187/2372 symbols completed. KEYS took 33.9s. Estimated remaining: 2h 37m 13s. Rate: 7.5 symbols/min [2025-09-22T19:37:32.467568] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:37:32.500047] [DEBUG] [LOCAL ] KFY: Loaded 31278 existing records from primary storage. [2025-09-22T19:37:32.500259] [INFO ] [MAIN ] KFY: Loaded 31278 existing records. [2025-09-22T19:37:32.531166] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-22T19:37:32.673082] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T19:37:32.704503] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:37:32.709086] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-22T19:37:32.709188] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-22T19:37:32.710854] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-22T19:37:32.710925] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-22T19:37:32.914789] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T19:37:33.135594] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:37:33.221180] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-22T19:37:33.322004] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-22T19:37:33.953268] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T19:37:34.122071] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-22T19:37:34.644539] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T19:37:34.922178] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-22T19:37:35.722073] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-22T19:37:35.928111] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T19:37:36.404856] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-22T19:37:36.522062] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-22T19:37:37.322084] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-22T19:37:38.122056] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-22T19:37:38.130634] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T19:37:38.271788] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T19:37:38.922068] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-22T19:37:39.496771] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T19:37:39.722104] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-22T19:37:40.392925] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T19:37:40.401816] [INFO ] [REMOTE ] KEY: Full fetch complete (77253 records). [2025-09-22T19:37:40.401964] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-22T19:37:40.527128] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-22T19:37:40.624251] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T19:37:40.625173] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:37:40.625268] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:37:40.625371] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-22T19:37:40.625453] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-22T19:37:40.625492] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-22T19:37:40.625548] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-22T19:37:40.625638] [INFO ] [MAIN ] Update Progress: 1188/2372 symbols completed. KEY took 48.8s. Estimated remaining: 2h 37m 5s. Rate: 7.5 symbols/min [2025-09-22T19:37:40.797252] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:37:40.851697] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-22T19:37:40.851847] [INFO ] [MAIN ] KGC: Loaded 54479 existing records. [2025-09-22T19:37:41.028329] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T19:37:41.054791] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:37:41.054977] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-22T19:37:41.055060] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-22T19:37:41.057381] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-22T19:37:41.057443] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-22T19:37:41.328469] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-22T19:37:41.409805] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:37:41.580920] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T19:37:41.809163] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-22T19:37:42.122045] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-22T19:37:42.922022] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-22T19:37:43.263744] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T19:37:43.722060] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-22T19:37:43.962049] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T19:37:44.522098] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-22T19:37:44.602403] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T19:37:45.273998] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:37:45.322065] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-22T19:37:46.122122] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-22T19:37:46.922152] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-22T19:37:47.523991] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:37:47.574594] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-22T19:37:47.722295] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-22T19:37:47.840631] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T19:37:47.842834] [INFO ] [REMOTE ] KFS: Full fetch complete (10423 records). [2025-09-22T19:37:47.842911] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-22T19:37:48.207767] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-22T19:37:48.207851] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-22T19:37:48.208098] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-22T19:37:48.208136] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-22T19:37:48.208581] [DEBUG] [LOCAL ] KFS: Trimmed 10423 records to 8242 (keeping 200 days of data) [2025-09-22T19:37:48.255843] [DEBUG] [LOCAL ] KFS: Primary data saved (8242 records). [2025-09-22T19:37:48.255970] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-22T19:37:48.256056] [INFO ] [MAIN ] Update Progress: 1189/2372 symbols completed. KFS took 22.1s. Estimated remaining: 2h 36m 57s. Rate: 7.5 symbols/min [2025-09-22T19:37:48.434961] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:37:48.480711] [DEBUG] [LOCAL ] KGS: Loaded 46501 existing records from primary storage. [2025-09-22T19:37:48.480890] [INFO ] [MAIN ] KGS: Loaded 46501 existing records. [2025-09-22T19:37:48.525083] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-22T19:37:48.686983] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T19:37:48.687215] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:37:48.692870] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-22T19:37:48.693285] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-22T19:37:48.694465] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-22T19:37:48.694527] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-22T19:37:49.087220] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:37:49.322067] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-22T19:37:50.122063] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-22T19:37:50.438317] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-22T19:37:50.471339] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T19:37:50.922064] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-22T19:37:51.586943] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T19:37:51.722099] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-22T19:37:52.527136] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-22T19:37:52.543795] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T19:37:52.895666] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T19:37:52.899817] [INFO ] [REMOTE ] KFRC: Full fetch complete (25136 records). [2025-09-22T19:37:52.899893] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-22T19:37:53.298901] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-22T19:37:53.298998] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-22T19:37:53.299529] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-22T19:37:53.299591] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-22T19:37:53.300333] [DEBUG] [LOCAL ] KFRC: Trimmed 25136 records to 19257 (keeping 200 days of data) [2025-09-22T19:37:53.354300] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-22T19:37:53.426079] [DEBUG] [LOCAL ] KFRC: Primary data saved (19257 records). [2025-09-22T19:37:53.426224] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-22T19:37:53.426420] [INFO ] [MAIN ] Update Progress: 1190/2372 symbols completed. KFRC took 34.8s. Estimated remaining: 2h 36m 46s. Rate: 7.5 symbols/min [2025-09-22T19:37:53.654406] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:37:53.711226] [DEBUG] [LOCAL ] KIM: Loaded 53850 existing records from primary storage. [2025-09-22T19:37:53.711380] [INFO ] [MAIN ] KIM: Loaded 53850 existing records. [2025-09-22T19:37:53.848721] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T19:37:53.940779] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:37:53.941073] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-22T19:37:53.941145] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-22T19:37:53.942458] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-22T19:37:53.942520] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-22T19:37:54.123589] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-22T19:37:54.332495] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:37:54.912727] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T19:37:54.922065] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-22T19:37:55.722017] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-22T19:37:56.028225] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T19:37:56.453944] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T19:37:56.522096] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-22T19:37:57.121445] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T19:37:57.322082] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-22T19:37:58.122036] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-22T19:37:58.242674] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T19:37:58.922078] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-22T19:37:58.962253] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T19:37:59.158979] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T19:37:59.722062] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-22T19:38:00.522097] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-22T19:38:01.037277] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-22T19:38:01.201543] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-22T19:38:01.322032] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-22T19:38:02.127724] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-22T19:38:02.149032] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T19:38:02.922074] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-22T19:38:03.412357] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-22T19:38:03.722069] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-22T19:38:03.759455] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T19:38:04.522035] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-22T19:38:04.556470] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T19:38:05.322023] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-22T19:38:05.730157] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-22T19:38:05.755444] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T19:38:06.122091] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-22T19:38:06.922076] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-22T19:38:07.064697] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T19:38:07.579237] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T19:38:07.722063] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-22T19:38:08.236704] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T19:38:08.243094] [INFO ] [REMOTE ] KFY: Full fetch complete (43819 records). [2025-09-22T19:38:08.243253] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-22T19:38:08.527139] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-22T19:38:08.636619] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-22T19:38:08.636746] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-22T19:38:08.637637] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-22T19:38:08.637772] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-22T19:38:08.642974] [DEBUG] [LOCAL ] KFY: Trimmed 43819 records to 30690 (keeping 200 days of data) [2025-09-22T19:38:08.853008] [DEBUG] [LOCAL ] KFY: Primary data saved (30690 records). [2025-09-22T19:38:08.853203] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-22T19:38:08.853411] [INFO ] [MAIN ] Update Progress: 1191/2372 symbols completed. KFY took 36.6s. Estimated remaining: 2h 36m 45s. Rate: 7.5 symbols/min [2025-09-22T19:38:09.046162] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:38:09.074318] [DEBUG] [LOCAL ] KIO: Loaded 21731 existing records from primary storage. [2025-09-22T19:38:09.074497] [INFO ] [MAIN ] KIO: Loaded 21731 existing records. [2025-09-22T19:38:09.262543] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:38:09.262831] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-22T19:38:09.262883] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-22T19:38:09.263485] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-22T19:38:09.263563] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-22T19:38:09.330540] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-22T19:38:09.647722] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:38:09.683136] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T19:38:10.016098] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T19:38:10.122065] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-22T19:38:10.922055] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-22T19:38:11.275954] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T19:38:11.722075] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-22T19:38:11.982084] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T19:38:12.074322] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T19:38:12.522058] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-22T19:38:13.327149] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-22T19:38:13.347012] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-22T19:38:14.122025] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-22T19:38:14.317970] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T19:38:14.922025] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-22T19:38:15.112141] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T19:38:15.152963] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-22T19:38:15.722071] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-22T19:38:16.522073] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-22T19:38:16.987466] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-22T19:38:16.998602] [INFO ] [REMOTE ] KGC: Full fetch complete (77690 records). [2025-09-22T19:38:16.998816] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-22T19:38:17.325999] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-22T19:38:17.424692] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-22T19:38:17.425248] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-22T19:38:17.426587] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-22T19:38:17.426836] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-22T19:38:17.461226] [DEBUG] [LOCAL ] KGC: Trimmed 77690 records to 53699 (keeping 200 days of data) [2025-09-22T19:38:17.462923] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T19:38:17.490925] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T19:38:17.824272] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-22T19:38:17.824410] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-22T19:38:17.824561] [INFO ] [MAIN ] Update Progress: 1192/2372 symbols completed. KGC took 37.2s. Estimated remaining: 2h 36m 38s. Rate: 7.5 symbols/min [2025-09-22T19:38:18.003199] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:38:18.003679] [DEBUG] [LOCAL ] KKR: No existing data file found in primary storage. [2025-09-22T19:38:18.003735] [WARN ] [MAIN ] KKR: No existing data found, performing full refresh instead. [2025-09-22T19:38:18.003932] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-22T19:38:18.003983] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-22T19:38:18.004026] [DEBUG] [LOCAL ] KKR: No primary data file found to delete. [2025-09-22T19:38:18.004058] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-22T19:38:18.127181] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-22T19:38:18.395729] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:38:18.922053] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-22T19:38:19.054959] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T19:38:19.310204] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T19:38:19.722076] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-22T19:38:20.522083] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-22T19:38:20.823494] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-22T19:38:21.322069] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-22T19:38:21.408904] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T19:38:21.419911] [INFO ] [REMOTE ] KGS: Full fetch complete (65781 records). [2025-09-22T19:38:21.420101] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-22T19:38:21.834273] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-22T19:38:21.834429] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-22T19:38:21.835824] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-22T19:38:21.835890] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-22T19:38:21.840229] [DEBUG] [LOCAL ] KGS: Trimmed 65781 records to 45789 (keeping 200 days of data) [2025-09-22T19:38:22.143358] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-22T19:38:22.146484] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T19:38:22.192699] [DEBUG] [LOCAL ] KGS: Primary data saved (45789 records). [2025-09-22T19:38:22.193332] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-22T19:38:22.193453] [INFO ] [MAIN ] Update Progress: 1193/2372 symbols completed. KGS took 33.9s. Estimated remaining: 2h 36m 27s. Rate: 7.5 symbols/min [2025-09-22T19:38:22.373031] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:38:22.382418] [DEBUG] [LOCAL ] KKRS: Loaded 5784 existing records from primary storage. [2025-09-22T19:38:22.382553] [INFO ] [MAIN ] KKRS: Loaded 5784 existing records. [2025-09-22T19:38:22.572197] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:38:22.572494] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-22T19:38:22.572544] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-22T19:38:22.572942] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-22T19:38:22.573002] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-22T19:38:22.934723] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-22T19:38:22.940502] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:38:23.019872] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T19:38:23.058490] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T19:38:23.722046] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-22T19:38:24.478794] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T19:38:24.491555] [INFO ] [REMOTE ] KIM: Full fetch complete (76817 records). [2025-09-22T19:38:24.492559] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-22T19:38:24.527238] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-22T19:38:24.887043] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-22T19:38:24.887289] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-22T19:38:24.888362] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-22T19:38:24.888479] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-22T19:38:24.903408] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T19:38:24.912528] [DEBUG] [LOCAL ] KIM: Trimmed 76817 records to 53071 (keeping 200 days of data) [2025-09-22T19:38:25.254799] [DEBUG] [LOCAL ] KIM: Primary data saved (53071 records). [2025-09-22T19:38:25.254942] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-22T19:38:25.258420] [INFO ] [MAIN ] Update Progress: 1194/2372 symbols completed. KIM took 31.8s. Estimated remaining: 2h 36m 14s. Rate: 7.5 symbols/min [2025-09-22T19:38:25.327109] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-22T19:38:25.431931] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:38:25.432449] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-22T19:38:25.432504] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-22T19:38:25.432690] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-22T19:38:25.432743] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-22T19:38:25.432789] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-22T19:38:25.432821] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-22T19:38:25.631621] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T19:38:25.815889] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:38:26.122034] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-22T19:38:26.319114] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:26.319379] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-22T19:38:26.922031] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-22T19:38:27.140064] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-22T19:38:27.507668] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-22T19:38:27.722058] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-22T19:38:27.905333] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:27.905690] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-22T19:38:28.522035] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-22T19:38:29.089710] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T19:38:29.322015] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-22T19:38:29.509781] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:29.509998] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-22T19:38:30.122054] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-22T19:38:30.686866] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T19:38:30.922061] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-22T19:38:31.132086] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:31.132518] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-22T19:38:31.722080] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-22T19:38:32.522082] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-22T19:38:33.322117] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-22T19:38:33.520993] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T19:38:34.122132] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-22T19:38:34.922138] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-22T19:38:34.948793] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:34.949174] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-22T19:38:35.722089] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-22T19:38:36.140135] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-22T19:38:36.235587] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T19:38:36.522097] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-22T19:38:36.920991] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T19:38:37.322087] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-22T19:38:37.769070] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T19:38:37.974862] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (4.65 seconds). [2025-09-22T19:38:37.991235] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-22T19:38:38.122059] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-22T19:38:38.922088] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-22T19:38:39.436239] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-22T19:38:39.722085] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-22T19:38:40.161909] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-22T19:38:40.522096] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-22T19:38:40.572286] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T19:38:41.322081] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-22T19:38:41.914942] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-22T19:38:42.122064] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-22T19:38:42.321551] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T19:38:42.721892] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-22T19:38:42.723141] [INFO ] [REMOTE ] KKRS: Full fetch complete (8077 records). [2025-09-22T19:38:42.723217] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-22T19:38:42.927210] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-22T19:38:43.089616] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-22T19:38:43.089719] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-22T19:38:43.089943] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-22T19:38:43.089983] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-22T19:38:43.090396] [DEBUG] [LOCAL ] KKRS: Trimmed 8077 records to 5760 (keeping 200 days of data) [2025-09-22T19:38:43.124856] [DEBUG] [LOCAL ] KKRS: Primary data saved (5760 records). [2025-09-22T19:38:43.124943] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-22T19:38:43.125039] [INFO ] [MAIN ] Update Progress: 1195/2372 symbols completed. KKRS took 20.9s. Estimated remaining: 2h 36m 16s. Rate: 7.5 symbols/min [2025-09-22T19:38:43.316516] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:38:43.316781] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-22T19:38:43.316836] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-22T19:38:43.317000] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-22T19:38:43.317063] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-22T19:38:43.317138] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-22T19:38:43.317212] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-22T19:38:43.670513] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:38:43.722000] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-22T19:38:43.919202] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T19:38:43.924728] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:43.925506] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-22T19:38:44.522046] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-22T19:38:45.322085] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-22T19:38:45.726180] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T19:38:45.729900] [INFO ] [REMOTE ] KIO: Full fetch complete (30845 records). [2025-09-22T19:38:45.729994] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-22T19:38:46.106213] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-22T19:38:46.106301] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-22T19:38:46.106946] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-22T19:38:46.107008] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-22T19:38:46.107864] [DEBUG] [LOCAL ] KIO: Trimmed 30845 records to 21326 (keeping 200 days of data) [2025-09-22T19:38:46.164279] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-22T19:38:46.250106] [DEBUG] [LOCAL ] KIO: Primary data saved (21326 records). [2025-09-22T19:38:46.250261] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-22T19:38:46.250389] [INFO ] [MAIN ] Update Progress: 1196/2372 symbols completed. KIO took 37.4s. Estimated remaining: 2h 36m 3s. Rate: 7.5 symbols/min [2025-09-22T19:38:46.419706] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:38:46.442726] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T19:38:46.469775] [DEBUG] [LOCAL ] KLC: Loaded 36718 existing records from primary storage. [2025-09-22T19:38:46.469904] [INFO ] [MAIN ] KLC: Loaded 36718 existing records. [2025-09-22T19:38:46.647688] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:38:46.647939] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-22T19:38:46.647995] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-22T19:38:46.648842] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-22T19:38:46.648901] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-22T19:38:46.926622] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-22T19:38:47.012483] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:38:47.569597] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:47.569944] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-22T19:38:47.722079] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-22T19:38:48.522140] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-22T19:38:48.944155] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-22T19:38:49.276468] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:38:49.366892] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-22T19:38:49.386150] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T19:38:50.122065] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-22T19:38:50.922070] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-22T19:38:51.123604] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:51.124017] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-22T19:38:51.286283] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T19:38:51.317110] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-22T19:38:51.722093] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-22T19:38:52.522023] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-22T19:38:52.870193] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T19:38:53.322067] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-22T19:38:54.127140] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-22T19:38:54.142303] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T19:38:54.348958] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:54.349360] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-22T19:38:54.793745] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T19:38:54.922067] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-22T19:38:55.722026] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-22T19:38:55.867548] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T19:38:55.869772] [INFO ] [REMOTE ] KKRT: Full fetch complete (8386 records). [2025-09-22T19:38:55.869867] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-22T19:38:55.962610] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:55.990680] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-22T19:38:56.074260] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 79 unique days, need 200 days [2025-09-22T19:38:56.074569] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:38:56.074684] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:38:56.074782] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-22T19:38:56.074872] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-22T19:38:56.074912] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-22T19:38:56.074970] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-22T19:38:56.075085] [INFO ] [MAIN ] Update Progress: 1197/2372 symbols completed. KKRT took 30.8s. Estimated remaining: 2h 35m 57s. Rate: 7.5 symbols/min [2025-09-22T19:38:56.522061] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-22T19:38:56.707535] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:56.707921] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-22T19:38:57.322069] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-22T19:38:58.122111] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-22T19:38:58.696731] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:58.697104] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-22T19:38:58.922098] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-22T19:38:59.115194] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:38:59.115753] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-22T19:38:59.722110] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-22T19:38:59.770866] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-22T19:38:59.781232] [INFO ] [REMOTE ] KKR: Full fetch complete (77442 records). [2025-09-22T19:38:59.781513] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-22T19:39:00.271722] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-22T19:39:00.271837] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-22T19:39:00.272896] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-22T19:39:00.272966] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-22T19:39:00.274547] [DEBUG] [LOCAL ] KKR: Trimmed 77442 records to 53505 (keeping 200 days of data) [2025-09-22T19:39:00.522303] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-22T19:39:00.650149] [DEBUG] [LOCAL ] KKR: Primary data saved (53505 records). [2025-09-22T19:39:00.650342] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-22T19:39:00.650438] [INFO ] [MAIN ] Update Progress: 1198/2372 symbols completed. KKR took 42.8s. Estimated remaining: 2h 35m 46s. Rate: 7.5 symbols/min [2025-09-22T19:39:00.759118] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:39:00.759429] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-22T19:39:01.284740] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T19:39:01.322012] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-22T19:39:02.122125] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-22T19:39:02.771319] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T19:39:02.776365] [INFO ] [REMOTE ] KLAR: Full fetch complete (3291 records). [2025-09-22T19:39:02.776505] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-22T19:39:02.957869] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 9 unique days, need 200 days [2025-09-22T19:39:02.958087] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:39:02.958157] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:39:02.958228] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-22T19:39:02.958292] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-22T19:39:02.958328] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-22T19:39:02.958392] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-22T19:39:02.958471] [INFO ] [MAIN ] Update Progress: 1199/2372 symbols completed. KLAR took 19.8s. Estimated remaining: 2h 35m 32s. Rate: 7.5 symbols/min [2025-09-22T19:39:03.257638] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T19:39:03.265612] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-22T19:39:04.640323] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T19:39:04.649003] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-22T19:39:06.086587] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T19:39:06.094432] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-22T19:39:07.575964] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T19:39:07.584923] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-22T19:39:09.075494] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T19:39:09.081380] [INFO ] [REMOTE ] KLC: Full fetch complete (50770 records). [2025-09-22T19:39:09.081495] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-22T19:39:09.483121] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-22T19:39:09.483213] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-22T19:39:09.484679] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-22T19:39:09.484744] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-22T19:39:09.486177] [DEBUG] [LOCAL ] KLC: Trimmed 50770 records to 36380 (keeping 200 days of data) [2025-09-22T19:39:09.694241] [DEBUG] [LOCAL ] KLC: Primary data saved (36380 records). [2025-09-22T19:39:09.694381] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-22T19:39:09.694466] [INFO ] [MAIN ] Update Progress: 1200/2372 symbols completed. KLC took 23.4s. Estimated remaining: 2h 35m 23s. Rate: 7.5 symbols/min [2025-09-22T19:39:10.317667] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:39:10.309345] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:39:10.418700] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:39:10.422237] [DEBUG] [LOCAL ] KMPB: Loaded 3656 existing records from primary storage. [2025-09-22T19:39:10.397706] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:39:10.422429] [INFO ] [MAIN ] KMPB: Loaded 3656 existing records. [2025-09-22T19:39:10.646561] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:39:10.647047] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-22T19:39:10.647105] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-22T19:39:10.647471] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-22T19:39:10.660250] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-22T19:39:10.686393] [DEBUG] [LOCAL ] KLG: Loaded 42547 existing records from primary storage. [2025-09-22T19:39:10.735506] [INFO ] [MAIN ] KLG: Loaded 42547 existing records. [2025-09-22T19:39:10.787220] [DEBUG] [LOCAL ] KMPR: Loaded 38460 existing records from primary storage. [2025-09-22T19:39:10.818123] [INFO ] [MAIN ] KMPR: Loaded 38460 existing records. [2025-09-22T19:39:11.012848] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-22T19:39:11.039363] [INFO ] [MAIN ] KMI: Loaded 54473 existing records. [2025-09-22T19:39:11.455883] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:39:11.500950] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-22T19:39:11.516087] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-22T19:39:11.475508] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:39:11.545576] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-22T19:39:11.587751] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-22T19:39:11.612834] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-22T19:39:11.612925] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:39:11.623741] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-22T19:39:11.675406] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-22T19:39:11.761861] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-22T19:39:11.762020] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-22T19:39:11.788264] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-22T19:39:11.794201] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:39:11.799929] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-22T19:39:11.800321] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-22T19:39:11.800634] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-22T19:39:12.546176] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:39:12.561983] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-22T19:39:12.665319] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T19:39:12.687030] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-22T19:39:12.818462] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:39:12.823841] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:39:12.824561] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-22T19:39:12.824842] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-22T19:39:13.308680] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T19:39:13.309933] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-22T19:39:13.783173] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T19:39:13.788888] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-22T19:39:13.808723] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-22T19:39:13.809923] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-22T19:39:14.242442] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T19:39:14.244165] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-22T19:39:14.596032] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T19:39:14.605234] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-22T19:39:14.839031] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-22T19:39:14.840491] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-22T19:39:14.877503] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-22T19:39:14.922000] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-22T19:39:14.943778] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T19:39:15.292529] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-22T19:39:15.722026] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-22T19:39:16.125521] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T19:39:16.522118] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-22T19:39:16.677089] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T19:39:17.154419] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-22T19:39:17.322049] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-22T19:39:17.966832] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T19:39:18.122037] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-22T19:39:18.735686] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-22T19:39:18.922035] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-22T19:39:19.037119] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T19:39:19.722111] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-22T19:39:20.164411] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T19:39:20.522040] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-22T19:39:21.054560] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T19:39:21.322081] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-22T19:39:22.122096] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-22T19:39:22.456074] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T19:39:22.895542] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T19:39:22.922012] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-22T19:39:23.424049] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T19:39:23.722100] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-22T19:39:24.168740] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-22T19:39:24.170211] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T19:39:24.522040] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-22T19:39:25.092602] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-22T19:39:25.322087] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-22T19:39:25.857060] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-22T19:39:25.858100] [INFO ] [REMOTE ] KMPB: Full fetch complete (4864 records). [2025-09-22T19:39:25.858168] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-22T19:39:26.127354] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-22T19:39:26.223295] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-22T19:39:26.223496] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-22T19:39:26.223753] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-22T19:39:26.223816] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-22T19:39:26.224340] [DEBUG] [LOCAL ] KMPB: Trimmed 4864 records to 3581 (keeping 200 days of data) [2025-09-22T19:39:26.246853] [DEBUG] [LOCAL ] KMPB: Primary data saved (3581 records). [2025-09-22T19:39:26.246949] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-22T19:39:26.247030] [INFO ] [MAIN ] Update Progress: 1201/2372 symbols completed. KMPB took 16.6s. Estimated remaining: 2h 35m 24s. Rate: 7.5 symbols/min [2025-09-22T19:39:26.423239] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:39:26.468742] [DEBUG] [LOCAL ] KMT: Loaded 43803 existing records from primary storage. [2025-09-22T19:39:26.468911] [INFO ] [MAIN ] KMT: Loaded 43803 existing records. [2025-09-22T19:39:26.651941] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:39:26.652200] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-22T19:39:26.652268] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-22T19:39:26.653567] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-22T19:39:26.653667] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-22T19:39:26.928283] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-22T19:39:27.018203] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:39:27.722075] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-22T19:39:27.794333] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T19:39:28.488167] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T19:39:28.522067] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-22T19:39:29.038465] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T19:39:29.322058] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-22T19:39:30.033108] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T19:39:30.122057] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-22T19:39:30.717842] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T19:39:30.922081] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-22T19:39:31.270225] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T19:39:31.722099] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-22T19:39:32.522086] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-22T19:39:32.678599] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T19:39:33.170421] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T19:39:33.322072] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-22T19:39:34.122087] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-22T19:39:34.245807] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T19:39:34.409222] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T19:39:34.922071] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-22T19:39:35.279092] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T19:39:35.722125] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-22T19:39:36.522048] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-22T19:39:36.760584] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T19:39:37.322058] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-22T19:39:37.376522] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T19:39:37.765965] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T19:39:38.122068] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-22T19:39:38.922082] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-22T19:39:39.455573] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-22T19:39:39.718354] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T19:39:39.725008] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-22T19:39:39.726603] [INFO ] [REMOTE ] KMPR: Full fetch complete (50267 records). [2025-09-22T19:39:39.726717] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-22T19:39:40.134930] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-22T19:39:40.135161] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-22T19:39:40.136061] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-22T19:39:40.136141] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-22T19:39:40.137365] [DEBUG] [LOCAL ] KMPR: Trimmed 50267 records to 38145 (keeping 200 days of data) [2025-09-22T19:39:40.281386] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T19:39:40.411304] [DEBUG] [LOCAL ] KMPR: Primary data saved (38145 records). [2025-09-22T19:39:40.411450] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-22T19:39:40.411539] [INFO ] [MAIN ] Update Progress: 1202/2372 symbols completed. KMPR took 30.7s. Estimated remaining: 2h 35m 22s. Rate: 7.5 symbols/min [2025-09-22T19:39:40.527270] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-22T19:39:40.585907] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:39:40.642231] [DEBUG] [LOCAL ] KMX: Loaded 53867 existing records from primary storage. [2025-09-22T19:39:40.642435] [INFO ] [MAIN ] KMX: Loaded 53867 existing records. [2025-09-22T19:39:40.825717] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:39:40.826004] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-22T19:39:40.826056] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-22T19:39:40.827497] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-22T19:39:40.827565] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-22T19:39:41.197026] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:39:41.322054] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-22T19:39:41.740548] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T19:39:42.122043] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-22T19:39:42.219313] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T19:39:42.227762] [INFO ] [REMOTE ] KLG: Full fetch complete (61775 records). [2025-09-22T19:39:42.227907] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-22T19:39:42.641727] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-22T19:39:42.641843] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-22T19:39:42.642742] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-22T19:39:42.642826] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-22T19:39:42.644282] [DEBUG] [LOCAL ] KLG: Trimmed 61775 records to 41901 (keeping 200 days of data) [2025-09-22T19:39:42.761606] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T19:39:42.922195] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-22T19:39:42.953053] [DEBUG] [LOCAL ] KLG: Primary data saved (41901 records). [2025-09-22T19:39:42.953194] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-22T19:39:42.953289] [INFO ] [MAIN ] Update Progress: 1203/2372 symbols completed. KLG took 33.3s. Estimated remaining: 2h 35m 8s. Rate: 7.5 symbols/min [2025-09-22T19:39:43.138208] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:39:43.176853] [DEBUG] [LOCAL ] KN: Loaded 39680 existing records from primary storage. [2025-09-22T19:39:43.176997] [INFO ] [MAIN ] KN: Loaded 39680 existing records. [2025-09-22T19:39:43.352364] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:39:43.352632] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-22T19:39:43.352721] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-22T19:39:43.353962] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-22T19:39:43.354022] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-22T19:39:43.711060] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:39:43.722001] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-22T19:39:44.124202] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T19:39:44.134252] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-22T19:39:44.134449] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-22T19:39:44.537782] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-22T19:39:44.538299] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-22T19:39:44.539289] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-22T19:39:44.540331] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-22T19:39:44.540712] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-22T19:39:44.566011] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T19:39:44.574416] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-09-22T19:39:44.903782] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-09-22T19:39:44.903918] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-22T19:39:44.904001] [INFO ] [MAIN ] Update Progress: 1204/2372 symbols completed. KMI took 35.2s. Estimated remaining: 2h 34m 55s. Rate: 7.5 symbols/min [2025-09-22T19:39:45.107331] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:39:45.142184] [DEBUG] [LOCAL ] KNF: Loaded 36245 existing records from primary storage. [2025-09-22T19:39:45.142318] [INFO ] [MAIN ] KNF: Loaded 36245 existing records. [2025-09-22T19:39:45.323114] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-22T19:39:45.326946] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:39:45.327893] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-22T19:39:45.327944] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-22T19:39:45.329113] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-22T19:39:45.329175] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-22T19:39:45.719405] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:39:45.720973] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-22T19:39:46.122032] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-22T19:39:46.299425] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:39:46.871682] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T19:39:46.922022] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-22T19:39:47.410978] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T19:39:47.722114] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-22T19:39:48.238020] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T19:39:48.522132] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-22T19:39:49.322091] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-22T19:39:49.399465] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T19:39:49.741676] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T19:39:49.748640] [INFO ] [REMOTE ] KMT: Full fetch complete (61903 records). [2025-09-22T19:39:49.748912] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-22T19:39:50.127159] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-22T19:39:50.147419] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-22T19:39:50.147501] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-22T19:39:50.148369] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-22T19:39:50.149215] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-22T19:39:50.150586] [DEBUG] [LOCAL ] KMT: Trimmed 61903 records to 43079 (keeping 200 days of data) [2025-09-22T19:39:50.399427] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T19:39:50.447337] [DEBUG] [LOCAL ] KMT: Primary data saved (43079 records). [2025-09-22T19:39:50.447456] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-22T19:39:50.447535] [INFO ] [MAIN ] Update Progress: 1205/2372 symbols completed. KMT took 24.2s. Estimated remaining: 2h 34m 44s. Rate: 7.5 symbols/min [2025-09-22T19:39:50.621687] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:39:50.632855] [DEBUG] [LOCAL ] KNOP: Loaded 10092 existing records from primary storage. [2025-09-22T19:39:50.632969] [INFO ] [MAIN ] KNOP: Loaded 10092 existing records. [2025-09-22T19:39:50.817067] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:39:50.817346] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-22T19:39:50.817393] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-22T19:39:50.817882] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-22T19:39:50.817954] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-22T19:39:50.923240] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-22T19:39:51.186845] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:39:51.722051] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-22T19:39:51.871856] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T19:39:52.287631] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T19:39:52.522082] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-22T19:39:52.991312] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T19:39:53.322082] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-22T19:39:54.122119] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-22T19:39:54.278167] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T19:39:54.600011] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T19:39:54.922135] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-22T19:39:55.423866] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T19:39:55.651342] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T19:39:55.722013] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-22T19:39:56.522051] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-22T19:39:56.583466] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T19:39:57.322063] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-22T19:39:57.885899] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T19:39:58.032255] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T19:39:58.122065] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-22T19:39:58.922071] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-22T19:39:59.722081] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-22T19:40:00.033764] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T19:40:00.161236] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T19:40:00.522086] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-22T19:40:01.014890] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T19:40:01.322080] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-22T19:40:01.970404] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T19:40:02.114184] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T19:40:02.122052] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-22T19:40:02.922072] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-22T19:40:03.050245] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-22T19:40:03.722056] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-22T19:40:04.315671] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T19:40:04.522034] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-22T19:40:04.539124] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T19:40:05.322086] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-22T19:40:05.972063] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T19:40:06.122017] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-22T19:40:06.646183] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T19:40:06.922069] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-22T19:40:07.503339] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T19:40:07.722058] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-22T19:40:08.310935] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-22T19:40:08.522034] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-22T19:40:08.594052] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T19:40:09.322047] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-22T19:40:09.971160] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T19:40:09.977482] [INFO ] [REMOTE ] KN: Full fetch complete (56260 records). [2025-09-22T19:40:09.977592] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-22T19:40:10.127116] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-22T19:40:10.388713] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-22T19:40:10.388832] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-22T19:40:10.398580] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-22T19:40:10.398728] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-22T19:40:10.400868] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T19:40:10.404989] [DEBUG] [LOCAL ] KN: Trimmed 56260 records to 38942 (keeping 200 days of data) [2025-09-22T19:40:10.635132] [DEBUG] [LOCAL ] KN: Primary data saved (38942 records). [2025-09-22T19:40:10.635283] [INFO ] [MAIN ] KN: Full history saved. [2025-09-22T19:40:10.635423] [INFO ] [MAIN ] Update Progress: 1206/2372 symbols completed. KN took 27.7s. Estimated remaining: 2h 34m 48s. Rate: 7.5 symbols/min [2025-09-22T19:40:10.803022] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:40:10.824092] [DEBUG] [LOCAL ] KNSL: Loaded 18452 existing records from primary storage. [2025-09-22T19:40:10.824222] [INFO ] [MAIN ] KNSL: Loaded 18452 existing records. [2025-09-22T19:40:10.924236] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-22T19:40:11.005919] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:40:11.006159] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-22T19:40:11.006207] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-22T19:40:11.006933] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-22T19:40:11.006993] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-22T19:40:11.379923] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:40:11.722061] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-22T19:40:11.764942] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T19:40:12.019317] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T19:40:12.522051] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-22T19:40:12.743401] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T19:40:13.322059] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-22T19:40:14.122027] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-22T19:40:14.466235] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T19:40:14.509030] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T19:40:14.922049] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-22T19:40:15.096170] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T19:40:15.098353] [INFO ] [REMOTE ] KNOP: Full fetch complete (14719 records). [2025-09-22T19:40:15.098468] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-22T19:40:15.483911] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-22T19:40:15.484066] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-22T19:40:15.484562] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-22T19:40:15.484701] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-22T19:40:15.487709] [DEBUG] [LOCAL ] KNOP: Trimmed 14719 records to 9908 (keeping 200 days of data) [2025-09-22T19:40:15.552610] [DEBUG] [LOCAL ] KNOP: Primary data saved (9908 records). [2025-09-22T19:40:15.552801] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-22T19:40:15.553061] [INFO ] [MAIN ] Update Progress: 1207/2372 symbols completed. KNOP took 25.1s. Estimated remaining: 2h 34m 37s. Rate: 7.5 symbols/min [2025-09-22T19:40:15.729330] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:40:15.727205] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-22T19:40:15.792987] [DEBUG] [LOCAL ] KNTK: Loaded 46851 existing records from primary storage. [2025-09-22T19:40:15.793166] [INFO ] [MAIN ] KNTK: Loaded 46851 existing records. [2025-09-22T19:40:15.983072] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:40:15.983371] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-22T19:40:15.983428] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-22T19:40:15.985147] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-22T19:40:15.985222] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-22T19:40:16.395514] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:40:16.418545] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T19:40:16.522007] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-22T19:40:16.903290] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T19:40:17.322036] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-22T19:40:17.646036] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T19:40:18.122088] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-22T19:40:18.829605] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T19:40:18.922079] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-22T19:40:19.520585] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T19:40:19.722136] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-22T19:40:19.934768] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T19:40:20.522156] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-22T19:40:21.134057] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T19:40:21.322067] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-22T19:40:22.060333] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T19:40:22.066567] [INFO ] [REMOTE ] KNF: Full fetch complete (50169 records). [2025-09-22T19:40:22.066694] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-22T19:40:22.127332] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-22T19:40:22.499125] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-22T19:40:22.499214] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-22T19:40:22.499999] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-22T19:40:22.500073] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-22T19:40:22.501430] [DEBUG] [LOCAL ] KNF: Trimmed 50169 records to 35762 (keeping 200 days of data) [2025-09-22T19:40:22.749350] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T19:40:22.760437] [DEBUG] [LOCAL ] KNF: Primary data saved (35762 records). [2025-09-22T19:40:22.760943] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-22T19:40:22.761085] [INFO ] [MAIN ] Update Progress: 1208/2372 symbols completed. KNF took 37.9s. Estimated remaining: 2h 34m 29s. Rate: 7.5 symbols/min [2025-09-22T19:40:22.948959] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:40:22.923410] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-22T19:40:23.009671] [DEBUG] [LOCAL ] KNX: Loaded 53366 existing records from primary storage. [2025-09-22T19:40:23.009853] [INFO ] [MAIN ] KNX: Loaded 53366 existing records. [2025-09-22T19:40:23.209503] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:40:23.209870] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-22T19:40:23.210035] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-22T19:40:23.211637] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-22T19:40:23.211742] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-22T19:40:23.364885] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T19:40:23.624728] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:40:23.722100] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-22T19:40:24.208630] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T19:40:24.522100] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-22T19:40:25.322069] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-22T19:40:25.390788] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T19:40:26.122045] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-22T19:40:26.165120] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T19:40:26.613065] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-22T19:40:26.922059] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-22T19:40:27.722042] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-22T19:40:27.790892] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T19:40:28.522038] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-22T19:40:28.609920] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T19:40:29.322080] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-22T19:40:29.526639] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T19:40:29.541549] [INFO ] [REMOTE ] KMX: Full fetch complete (75914 records). [2025-09-22T19:40:29.541813] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-22T19:40:29.966784] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-22T19:40:29.966949] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-22T19:40:29.967978] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-22T19:40:29.968044] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-22T19:40:29.969887] [DEBUG] [LOCAL ] KMX: Trimmed 75914 records to 53109 (keeping 200 days of data) [2025-09-22T19:40:30.153275] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-22T19:40:30.239288] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T19:40:30.342733] [DEBUG] [LOCAL ] KMX: Primary data saved (53109 records). [2025-09-22T19:40:30.342894] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-22T19:40:30.342988] [INFO ] [MAIN ] Update Progress: 1209/2372 symbols completed. KMX took 49.9s. Estimated remaining: 2h 34m 20s. Rate: 7.5 symbols/min [2025-09-22T19:40:30.526680] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:40:30.596055] [DEBUG] [LOCAL ] KO: Loaded 54598 existing records from primary storage. [2025-09-22T19:40:30.596226] [INFO ] [MAIN ] KO: Loaded 54598 existing records. [2025-09-22T19:40:30.810870] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:40:30.814900] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-22T19:40:30.816262] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-22T19:40:30.816165] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T19:40:30.827731] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-22T19:40:30.827808] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-22T19:40:30.927196] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-22T19:40:31.204884] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:40:31.216004] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T19:40:31.722061] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-22T19:40:32.522034] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-22T19:40:32.721996] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T19:40:33.322192] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-22T19:40:34.122036] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-22T19:40:34.298935] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T19:40:34.441354] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-22T19:40:34.861796] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T19:40:34.910632] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T19:40:34.922023] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-22T19:40:35.722076] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-22T19:40:36.522043] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-22T19:40:36.634089] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T19:40:36.641999] [INFO ] [REMOTE ] KNTK: Full fetch complete (63789 records). [2025-09-22T19:40:36.642175] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-22T19:40:37.043988] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-22T19:40:37.044071] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-22T19:40:37.045011] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-22T19:40:37.045111] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-22T19:40:37.046438] [DEBUG] [LOCAL ] KNTK: Trimmed 63789 records to 46086 (keeping 200 days of data) [2025-09-22T19:40:37.331681] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-22T19:40:37.343606] [DEBUG] [LOCAL ] KNTK: Primary data saved (46086 records). [2025-09-22T19:40:37.343728] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-22T19:40:37.343834] [INFO ] [MAIN ] Update Progress: 1210/2372 symbols completed. KNTK took 21.8s. Estimated remaining: 2h 34m 11s. Rate: 7.5 symbols/min [2025-09-22T19:40:37.517609] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:40:37.558029] [DEBUG] [LOCAL ] KODK: Loaded 44070 existing records from primary storage. [2025-09-22T19:40:37.558169] [INFO ] [MAIN ] KODK: Loaded 44070 existing records. [2025-09-22T19:40:37.734255] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:40:37.734676] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-22T19:40:37.734765] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-22T19:40:37.736099] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-22T19:40:37.736165] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-22T19:40:38.161075] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:40:38.161796] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-22T19:40:38.298582] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-22T19:40:38.372811] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T19:40:38.502184] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-22T19:40:38.922119] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-22T19:40:39.722128] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-22T19:40:39.879260] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T19:40:39.941295] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T19:40:40.522085] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-22T19:40:41.322033] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-22T19:40:41.536821] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T19:40:42.122233] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-22T19:40:42.413251] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T19:40:42.418046] [INFO ] [REMOTE ] KNSL: Full fetch complete (26766 records). [2025-09-22T19:40:42.418216] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-22T19:40:42.824552] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-22T19:40:42.824672] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-22T19:40:42.825362] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-22T19:40:42.825425] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-22T19:40:42.826166] [DEBUG] [LOCAL ] KNSL: Trimmed 26766 records to 18127 (keeping 200 days of data) [2025-09-22T19:40:42.923143] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-22T19:40:42.987583] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-22T19:40:42.989957] [DEBUG] [LOCAL ] KNSL: Primary data saved (18127 records). [2025-09-22T19:40:43.000006] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-22T19:40:43.000438] [INFO ] [MAIN ] Update Progress: 1211/2372 symbols completed. KNSL took 32.4s. Estimated remaining: 2h 34m 1s. Rate: 7.5 symbols/min [2025-09-22T19:40:43.174583] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:40:43.205671] [DEBUG] [LOCAL ] KOF: Loaded 26373 existing records from primary storage. [2025-09-22T19:40:43.205854] [INFO ] [MAIN ] KOF: Loaded 26373 existing records. [2025-09-22T19:40:43.399158] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:40:43.399444] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-22T19:40:43.399515] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-22T19:40:43.400320] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-22T19:40:43.400381] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-22T19:40:43.727478] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-22T19:40:43.778013] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:40:43.818321] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T19:40:44.491073] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T19:40:44.522104] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-22T19:40:45.322123] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-22T19:40:45.469405] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-22T19:40:46.122091] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-22T19:40:46.405727] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-22T19:40:46.922176] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-22T19:40:46.992719] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T19:40:47.290847] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T19:40:47.722220] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-22T19:40:48.400101] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T19:40:48.522078] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-22T19:40:49.322107] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-22T19:40:49.417704] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T19:40:49.900105] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T19:40:50.122103] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-22T19:40:50.922066] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-22T19:40:51.722196] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-22T19:40:51.887545] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T19:40:51.916943] [INFO ] [REMOTE ] KNX: Full fetch complete (75679 records). [2025-09-22T19:40:51.936166] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-22T19:40:51.980461] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-22T19:40:52.414791] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T19:40:52.420161] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-22T19:40:52.420712] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-22T19:40:52.422091] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-22T19:40:52.422173] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-22T19:40:52.423564] [DEBUG] [LOCAL ] KNX: Trimmed 75679 records to 52594 (keeping 200 days of data) [2025-09-22T19:40:52.522194] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-22T19:40:52.749586] [DEBUG] [LOCAL ] KNX: Primary data saved (52594 records). [2025-09-22T19:40:52.749756] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-22T19:40:52.749847] [INFO ] [MAIN ] Update Progress: 1212/2372 symbols completed. KNX took 30.0s. Estimated remaining: 2h 33m 55s. Rate: 7.5 symbols/min [2025-09-22T19:40:52.918338] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:40:52.936968] [DEBUG] [LOCAL ] KOP: Loaded 18334 existing records from primary storage. [2025-09-22T19:40:52.937093] [INFO ] [MAIN ] KOP: Loaded 18334 existing records. [2025-09-22T19:40:53.130432] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:40:53.142870] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T19:40:53.141968] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-22T19:40:53.151996] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-22T19:40:53.153069] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-22T19:40:53.153133] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-22T19:40:53.332028] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-22T19:40:53.536168] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:40:53.582162] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T19:40:54.122062] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-22T19:40:54.881429] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T19:40:54.922060] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-22T19:40:55.173391] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T19:40:55.722071] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-22T19:40:56.522047] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-22T19:40:56.688894] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T19:40:57.322043] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-22T19:40:57.433691] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-22T19:40:57.554523] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T19:40:58.122111] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-22T19:40:58.804350] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T19:40:58.845328] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T19:40:58.922017] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-22T19:40:59.722067] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-22T19:40:59.970419] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T19:41:00.522044] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-22T19:41:01.314732] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T19:41:01.324332] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-22T19:41:02.107056] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T19:41:02.122014] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-22T19:41:02.429041] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T19:41:02.922066] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-22T19:41:03.019846] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T19:41:03.722081] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-22T19:41:04.522255] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-22T19:41:04.522158] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-22T19:41:05.322028] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-22T19:41:05.352988] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-22T19:41:05.907509] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T19:41:06.122059] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-22T19:41:06.758460] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T19:41:06.922067] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-22T19:41:07.722087] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-22T19:41:07.758771] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T19:41:07.765429] [INFO ] [REMOTE ] KODK: Full fetch complete (63653 records). [2025-09-22T19:41:07.765572] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-22T19:41:08.170015] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-22T19:41:08.170128] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-22T19:41:08.171050] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-22T19:41:08.171117] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-22T19:41:08.172598] [DEBUG] [LOCAL ] KODK: Trimmed 63653 records to 43420 (keeping 200 days of data) [2025-09-22T19:41:08.407756] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T19:41:08.438981] [DEBUG] [LOCAL ] KODK: Primary data saved (43420 records). [2025-09-22T19:41:08.439126] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-22T19:41:08.439211] [INFO ] [MAIN ] Update Progress: 1213/2372 symbols completed. KODK took 31.1s. Estimated remaining: 2h 33m 54s. Rate: 7.5 symbols/min [2025-09-22T19:41:08.531010] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-22T19:41:08.616263] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:41:08.620072] [DEBUG] [LOCAL ] KORE: Loaded 1975 existing records from primary storage. [2025-09-22T19:41:08.620191] [INFO ] [MAIN ] KORE: Loaded 1975 existing records. [2025-09-22T19:41:08.796985] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:41:08.797244] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-22T19:41:08.797301] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-22T19:41:08.797507] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-22T19:41:08.797566] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-22T19:41:09.189462] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:41:09.273569] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-22T19:41:09.322049] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-22T19:41:10.122056] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-22T19:41:10.663915] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T19:41:10.668572] [INFO ] [REMOTE ] KOF: Full fetch complete (36955 records). [2025-09-22T19:41:10.668689] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-22T19:41:10.930140] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-22T19:41:11.080024] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-22T19:41:11.080989] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T19:41:11.080673] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-22T19:41:11.084917] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-22T19:41:11.085610] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-22T19:41:11.086536] [DEBUG] [LOCAL ] KOF: Trimmed 36955 records to 25911 (keeping 200 days of data) [2025-09-22T19:41:11.257356] [DEBUG] [LOCAL ] KOF: Primary data saved (25911 records). [2025-09-22T19:41:11.257514] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-22T19:41:11.257605] [INFO ] [MAIN ] Update Progress: 1214/2372 symbols completed. KOF took 28.3s. Estimated remaining: 2h 33m 41s. Rate: 7.5 symbols/min [2025-09-22T19:41:11.429974] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:41:11.487080] [DEBUG] [LOCAL ] KOS: Loaded 53842 existing records from primary storage. [2025-09-22T19:41:11.487239] [INFO ] [MAIN ] KOS: Loaded 53842 existing records. [2025-09-22T19:41:11.666997] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:41:11.667329] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-22T19:41:11.667405] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-22T19:41:11.669063] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-22T19:41:11.669130] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-22T19:41:11.733167] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-22T19:41:12.043093] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:41:12.058835] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T19:41:12.328218] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T19:41:12.522067] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-22T19:41:13.322049] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-22T19:41:13.519889] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T19:41:13.822672] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-22T19:41:14.122070] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-22T19:41:14.922022] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-22T19:41:15.334676] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T19:41:15.338520] [INFO ] [REMOTE ] KOP: Full fetch complete (25438 records). [2025-09-22T19:41:15.338620] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-22T19:41:15.423918] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-22T19:41:15.721473] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-22T19:41:15.721570] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-22T19:41:15.722211] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-22T19:41:15.722140] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-22T19:41:15.723236] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-22T19:41:15.723990] [DEBUG] [LOCAL ] KOP: Trimmed 25438 records to 17960 (keeping 200 days of data) [2025-09-22T19:41:15.839754] [DEBUG] [LOCAL ] KOP: Primary data saved (17960 records). [2025-09-22T19:41:15.839919] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-22T19:41:15.840013] [INFO ] [MAIN ] Update Progress: 1215/2372 symbols completed. KOP took 23.1s. Estimated remaining: 2h 33m 30s. Rate: 7.5 symbols/min [2025-09-22T19:41:16.032523] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:41:16.084020] [DEBUG] [LOCAL ] KR: Loaded 54462 existing records from primary storage. [2025-09-22T19:41:16.084189] [INFO ] [MAIN ] KR: Loaded 54462 existing records. [2025-09-22T19:41:16.289576] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:41:16.289901] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-22T19:41:16.289957] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-22T19:41:16.291760] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-22T19:41:16.291824] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-22T19:41:16.531258] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-22T19:41:16.670442] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:41:17.029296] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T19:41:17.322044] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-22T19:41:17.429842] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (9.71 seconds). [2025-09-22T19:41:17.511857] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T19:41:17.687251] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-22T19:41:18.122055] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-22T19:41:18.922095] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-22T19:41:19.722040] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-22T19:41:19.755609] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T19:41:20.522054] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-22T19:41:20.970745] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T19:41:21.322045] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-22T19:41:21.585281] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-22T19:41:21.775106] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-22T19:41:21.806355] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-22T19:41:22.122057] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-22T19:41:22.611734] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T19:41:22.922058] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-22T19:41:23.536571] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T19:41:23.537549] [INFO ] [REMOTE ] KORE: Full fetch complete (6099 records). [2025-09-22T19:41:23.537621] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-22T19:41:23.723632] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-22T19:41:23.954576] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-22T19:41:23.954733] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-22T19:41:23.955077] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-22T19:41:23.955154] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-22T19:41:23.955561] [DEBUG] [LOCAL ] KORE: Trimmed 6099 records to 1940 (keeping 200 days of data) [2025-09-22T19:41:23.967352] [DEBUG] [LOCAL ] KORE: Primary data saved (1940 records). [2025-09-22T19:41:23.967416] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-22T19:41:23.967489] [INFO ] [MAIN ] Update Progress: 1216/2372 symbols completed. KORE took 15.5s. Estimated remaining: 2h 33m 23s. Rate: 7.5 symbols/min [2025-09-22T19:41:24.138424] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:41:24.184071] [DEBUG] [LOCAL ] KRC: Loaded 49159 existing records from primary storage. [2025-09-22T19:41:24.184238] [INFO ] [MAIN ] KRC: Loaded 49159 existing records. [2025-09-22T19:41:24.364570] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:41:24.364880] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-22T19:41:24.364948] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-22T19:41:24.366860] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-22T19:41:24.366932] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-22T19:41:24.536050] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-22T19:41:24.737152] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:41:25.322023] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-22T19:41:25.789205] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-22T19:41:26.122131] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-22T19:41:26.861776] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T19:41:26.922013] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-22T19:41:27.300244] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-22T19:41:27.309058] [INFO ] [REMOTE ] KO: Full fetch complete (77604 records). [2025-09-22T19:41:27.309211] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-22T19:41:27.553778] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T19:41:27.554605] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:41:27.554793] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:41:27.554967] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-22T19:41:27.555130] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-22T19:41:27.555260] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-22T19:41:27.555933] [DEBUG] [LOCAL ] KO: Deleted derivative data file. [2025-09-22T19:41:27.556183] [INFO ] [MAIN ] Update Progress: 1217/2372 symbols completed. KO took 57.2s. Estimated remaining: 2h 33m 10s. Rate: 7.5 symbols/min [2025-09-22T19:41:27.754704] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-22T19:41:27.777637] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:41:27.780923] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T19:41:27.829486] [DEBUG] [LOCAL ] KREF: Loaded 37539 existing records from primary storage. [2025-09-22T19:41:27.829671] [INFO ] [MAIN ] KREF: Loaded 37539 existing records. [2025-09-22T19:41:28.051402] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:41:28.051708] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-22T19:41:28.051766] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-22T19:41:28.052718] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-22T19:41:28.052781] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-22T19:41:28.459312] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:41:28.485749] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T19:41:28.522041] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-22T19:41:29.322025] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-22T19:41:29.576010] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T19:41:29.847518] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T19:41:30.122059] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-22T19:41:30.586183] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T19:41:30.922056] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-22T19:41:31.612629] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T19:41:31.722047] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-22T19:41:32.522027] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-22T19:41:32.862489] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T19:41:32.981361] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T19:41:33.322054] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-22T19:41:34.065318] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T19:41:34.122011] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-22T19:41:34.532551] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T19:41:34.922103] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-22T19:41:35.722049] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-22T19:41:35.841984] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T19:41:36.387913] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T19:41:36.522108] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-22T19:41:37.204551] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T19:41:37.322078] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-22T19:41:38.122027] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-22T19:41:38.404629] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T19:41:38.922066] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-22T19:41:39.082355] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T19:41:39.291846] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T19:41:39.722130] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-22T19:41:40.522176] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-22T19:41:40.692590] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T19:41:41.143170] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T19:41:41.322068] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-22T19:41:42.025140] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T19:41:42.122126] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-22T19:41:42.853617] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T19:41:42.922073] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-22T19:41:43.533795] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T19:41:43.722084] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-22T19:41:44.522033] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-22T19:41:44.860519] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T19:41:45.277187] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T19:41:45.322025] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-22T19:41:46.002760] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T19:41:46.122054] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-22T19:41:46.922048] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-22T19:41:46.989428] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T19:41:47.124306] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T19:41:47.722071] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-22T19:41:48.431563] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T19:41:48.522076] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-22T19:41:49.015999] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T19:41:49.021895] [INFO ] [REMOTE ] KREF: Full fetch complete (51631 records). [2025-09-22T19:41:49.022020] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-22T19:41:49.327192] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-22T19:41:49.421596] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-22T19:41:49.421733] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-22T19:41:49.422702] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-22T19:41:49.422771] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-22T19:41:49.424214] [DEBUG] [LOCAL ] KREF: Trimmed 51631 records to 37002 (keeping 200 days of data) [2025-09-22T19:41:49.659798] [DEBUG] [LOCAL ] KREF: Primary data saved (37002 records). [2025-09-22T19:41:49.659950] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-22T19:41:49.660042] [INFO ] [MAIN ] Update Progress: 1218/2372 symbols completed. KREF took 22.1s. Estimated remaining: 2h 33m 16s. Rate: 7.5 symbols/min [2025-09-22T19:41:49.834726] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:41:49.894690] [DEBUG] [LOCAL ] KRG: Loaded 49895 existing records from primary storage. [2025-09-22T19:41:49.894908] [INFO ] [MAIN ] KRG: Loaded 49895 existing records. [2025-09-22T19:41:50.076175] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:41:50.076532] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-22T19:41:50.076602] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-22T19:41:50.078630] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-22T19:41:50.078713] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-22T19:41:50.144962] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-22T19:41:50.451092] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:41:50.573899] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T19:41:50.809501] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T19:41:50.922027] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-22T19:41:51.555268] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T19:41:51.722058] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-22T19:41:52.522070] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-22T19:41:52.694366] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T19:41:52.703468] [INFO ] [REMOTE ] KOS: Full fetch complete (76832 records). [2025-09-22T19:41:52.703683] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-22T19:41:53.108698] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-22T19:41:53.108840] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-22T19:41:53.110232] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-22T19:41:53.110308] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-22T19:41:53.112555] [DEBUG] [LOCAL ] KOS: Trimmed 76832 records to 53066 (keeping 200 days of data) [2025-09-22T19:41:53.336163] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-22T19:41:53.458534] [DEBUG] [LOCAL ] KOS: Primary data saved (53066 records). [2025-09-22T19:41:53.458738] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-22T19:41:53.458864] [INFO ] [MAIN ] Update Progress: 1219/2372 symbols completed. KOS took 42.2s. Estimated remaining: 2h 33m 4s. Rate: 7.5 symbols/min [2025-09-22T19:41:53.642128] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:41:53.642479] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-22T19:41:53.642600] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-22T19:41:53.643031] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-22T19:41:53.643243] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-22T19:41:53.643420] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-22T19:41:53.643520] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-22T19:41:53.807341] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-22T19:41:54.113313] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:41:54.122000] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-22T19:41:54.198937] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T19:41:54.208005] [INFO ] [REMOTE ] KRC: Full fetch complete (69552 records). [2025-09-22T19:41:54.208141] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-22T19:41:54.317555] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:41:54.341933] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-22T19:41:54.673336] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-22T19:41:54.673551] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-22T19:41:54.674589] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-22T19:41:54.674689] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-22T19:41:54.676158] [DEBUG] [LOCAL ] KRC: Trimmed 69552 records to 48433 (keeping 200 days of data) [2025-09-22T19:41:54.922100] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-22T19:41:54.932119] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T19:41:55.023813] [DEBUG] [LOCAL ] KRC: Primary data saved (48433 records). [2025-09-22T19:41:55.023960] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-22T19:41:55.024048] [INFO ] [MAIN ] Update Progress: 1220/2372 symbols completed. KRC took 31.1s. Estimated remaining: 2h 32m 50s. Rate: 7.5 symbols/min [2025-09-22T19:41:55.200989] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:41:55.229002] [DEBUG] [LOCAL ] KRO: Loaded 26145 existing records from primary storage. [2025-09-22T19:41:55.229152] [INFO ] [MAIN ] KRO: Loaded 26145 existing records. [2025-09-22T19:41:55.410861] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:41:55.411188] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-22T19:41:55.411249] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-22T19:41:55.412107] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-22T19:41:55.412168] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-22T19:41:55.731606] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-22T19:41:55.773499] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:41:56.522058] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-22T19:41:56.762963] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:41:56.763729] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-22T19:41:56.973036] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-22T19:41:56.984444] [INFO ] [REMOTE ] KR: Full fetch complete (77679 records). [2025-09-22T19:41:56.984575] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-22T19:41:57.324039] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-22T19:41:57.410899] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-22T19:41:57.411034] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-22T19:41:57.413056] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-22T19:41:57.413160] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-22T19:41:57.415905] [DEBUG] [LOCAL ] KR: Trimmed 77679 records to 53682 (keeping 200 days of data) [2025-09-22T19:41:57.543572] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T19:41:57.806363] [DEBUG] [LOCAL ] KR: Primary data saved (53682 records). [2025-09-22T19:41:57.806539] [INFO ] [MAIN ] KR: Full history saved. [2025-09-22T19:41:57.806687] [INFO ] [MAIN ] Update Progress: 1221/2372 symbols completed. KR took 42.0s. Estimated remaining: 2h 32m 37s. Rate: 7.5 symbols/min [2025-09-22T19:41:57.979056] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:41:58.020197] [DEBUG] [LOCAL ] KRP: Loaded 38635 existing records from primary storage. [2025-09-22T19:41:58.020395] [INFO ] [MAIN ] KRP: Loaded 38635 existing records. [2025-09-22T19:41:58.127205] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-22T19:41:58.204938] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:41:58.205248] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-22T19:41:58.205298] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-22T19:41:58.206357] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-22T19:41:58.206416] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-22T19:41:58.563249] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:41:58.589386] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T19:41:58.922064] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-22T19:41:58.968988] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T19:41:59.722074] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-22T19:42:00.061115] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T19:42:00.522100] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-22T19:42:01.322035] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-22T19:42:01.360924] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T19:42:02.122021] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-22T19:42:02.611936] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-22T19:42:02.922085] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-22T19:42:03.722087] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-22T19:42:04.040921] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-22T19:42:04.522081] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-22T19:42:04.547021] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-22T19:42:05.134883] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T19:42:05.233985] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-22T19:42:05.322046] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-22T19:42:06.122024] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-22T19:42:06.226404] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T19:42:06.270839] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T19:42:06.922053] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-22T19:42:07.699594] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T19:42:07.722054] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-22T19:42:07.759205] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T19:42:08.522097] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-22T19:42:09.272028] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T19:42:09.322018] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-22T19:42:09.761222] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-22T19:42:10.122088] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-22T19:42:10.922109] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-22T19:42:11.111148] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T19:42:11.475294] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T19:42:11.713057] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T19:42:11.721992] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-22T19:42:12.522043] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-22T19:42:13.322056] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-22T19:42:13.437413] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T19:42:14.122123] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-22T19:42:14.922083] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-22T19:42:15.160687] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-22T19:42:15.312714] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T19:42:15.497560] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-22T19:42:15.722160] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-22T19:42:16.522119] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-22T19:42:16.570530] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T19:42:17.094125] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T19:42:17.102083] [INFO ] [REMOTE ] KRMN: Full fetch complete (49192 records). [2025-09-22T19:42:17.102259] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-22T19:42:17.305929] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 152 unique days, need 200 days [2025-09-22T19:42:17.306951] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:42:17.307077] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:42:17.307236] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-22T19:42:17.307368] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-22T19:42:17.307476] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-22T19:42:17.307576] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-22T19:42:17.307800] [INFO ] [MAIN ] Update Progress: 1222/2372 symbols completed. KRMN took 23.8s. Estimated remaining: 2h 32m 40s. Rate: 7.5 symbols/min [2025-09-22T19:42:17.329479] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-22T19:42:17.492933] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:42:17.564487] [DEBUG] [LOCAL ] KSS: Loaded 54391 existing records from primary storage. [2025-09-22T19:42:17.564666] [INFO ] [MAIN ] KSS: Loaded 54391 existing records. [2025-09-22T19:42:17.754426] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:42:17.755144] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-22T19:42:17.755236] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-22T19:42:17.756820] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-22T19:42:17.756892] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-22T19:42:17.882332] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T19:42:18.128945] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-22T19:42:18.152783] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:42:18.918023] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T19:42:18.926044] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-22T19:42:19.450262] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T19:42:19.722024] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-22T19:42:20.522053] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-22T19:42:20.862238] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-22T19:42:20.893779] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T19:42:21.322021] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-22T19:42:21.787208] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T19:42:21.792400] [INFO ] [REMOTE ] KRO: Full fetch complete (34744 records). [2025-09-22T19:42:21.792490] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-22T19:42:22.127151] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-22T19:42:22.165793] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-22T19:42:22.165870] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-22T19:42:22.166501] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-22T19:42:22.166541] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-22T19:42:22.167449] [DEBUG] [LOCAL ] KRO: Trimmed 34744 records to 25937 (keeping 200 days of data) [2025-09-22T19:42:22.339965] [DEBUG] [LOCAL ] KRO: Primary data saved (25937 records). [2025-09-22T19:42:22.340480] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-22T19:42:22.340747] [INFO ] [MAIN ] Update Progress: 1223/2372 symbols completed. KRO took 27.3s. Estimated remaining: 2h 32m 29s. Rate: 7.5 symbols/min [2025-09-22T19:42:22.512776] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:42:22.562278] [DEBUG] [LOCAL ] KT: Loaded 46373 existing records from primary storage. [2025-09-22T19:42:22.562420] [INFO ] [MAIN ] KT: Loaded 46373 existing records. [2025-09-22T19:42:22.799603] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:42:22.799868] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-22T19:42:22.799916] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-22T19:42:22.800875] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-22T19:42:22.800935] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-22T19:42:22.927147] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-22T19:42:23.170808] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:42:23.194227] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T19:42:23.231965] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-22T19:42:23.722062] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-22T19:42:24.522058] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-22T19:42:24.835947] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-22T19:42:25.322048] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-22T19:42:25.560125] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T19:42:25.593889] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-22T19:42:26.122104] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-22T19:42:26.922027] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-22T19:42:26.992698] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T19:42:27.591429] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T19:42:27.722057] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-22T19:42:28.459481] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T19:42:28.522015] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-22T19:42:29.322118] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-22T19:42:29.361558] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T19:42:29.373621] [INFO ] [REMOTE ] KRG: Full fetch complete (70897 records). [2025-09-22T19:42:29.373860] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-22T19:42:29.775826] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-22T19:42:29.775921] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-22T19:42:29.776903] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-22T19:42:29.776969] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-22T19:42:29.778452] [DEBUG] [LOCAL ] KRG: Trimmed 70897 records to 49118 (keeping 200 days of data) [2025-09-22T19:42:30.098772] [DEBUG] [LOCAL ] KRG: Primary data saved (49118 records). [2025-09-22T19:42:30.099232] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-22T19:42:30.099368] [INFO ] [MAIN ] Update Progress: 1224/2372 symbols completed. KRG took 40.4s. Estimated remaining: 2h 32m 21s. Rate: 7.5 symbols/min [2025-09-22T19:42:30.130680] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-22T19:42:30.240582] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T19:42:30.326914] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:42:30.376071] [DEBUG] [LOCAL ] KTB: Loaded 41933 existing records from primary storage. [2025-09-22T19:42:30.376218] [INFO ] [MAIN ] KTB: Loaded 41933 existing records. [2025-09-22T19:42:30.556107] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:42:30.556407] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-22T19:42:30.556458] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-22T19:42:30.557982] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-22T19:42:30.558043] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-22T19:42:30.943960] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:42:30.944197] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-22T19:42:30.961236] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T19:42:30.967233] [INFO ] [REMOTE ] KRP: Full fetch complete (54872 records). [2025-09-22T19:42:30.967362] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-22T19:42:31.378107] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-22T19:42:31.378195] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-22T19:42:31.379088] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-22T19:42:31.379155] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-22T19:42:31.380386] [DEBUG] [LOCAL ] KRP: Trimmed 54872 records to 37738 (keeping 200 days of data) [2025-09-22T19:42:31.633019] [DEBUG] [LOCAL ] KRP: Primary data saved (37738 records). [2025-09-22T19:42:31.633165] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-22T19:42:31.633281] [INFO ] [MAIN ] Update Progress: 1225/2372 symbols completed. KRP took 33.8s. Estimated remaining: 2h 32m 7s. Rate: 7.5 symbols/min [2025-09-22T19:42:31.731500] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-22T19:42:31.825491] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:42:31.840199] [DEBUG] [LOCAL ] KTF: Loaded 13320 existing records from primary storage. [2025-09-22T19:42:31.840321] [INFO ] [MAIN ] KTF: Loaded 13320 existing records. [2025-09-22T19:42:32.026337] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:42:32.026955] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-22T19:42:32.027076] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-22T19:42:32.027789] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-22T19:42:32.027856] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-22T19:42:32.353616] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-22T19:42:32.439500] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:42:32.522037] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-22T19:42:32.636849] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T19:42:33.157202] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-22T19:42:33.173366] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-22T19:42:33.322052] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-22T19:42:34.086326] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T19:42:34.122065] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-22T19:42:34.918869] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T19:42:34.921992] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-22T19:42:35.722028] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-22T19:42:35.819196] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T19:42:36.522052] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-22T19:42:37.322030] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-22T19:42:37.496371] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T19:42:37.794959] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-22T19:42:38.122072] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-22T19:42:38.547374] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T19:42:38.922135] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-22T19:42:38.933670] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T19:42:39.722110] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-22T19:42:40.522039] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-22T19:42:40.535800] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T19:42:41.004560] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-22T19:42:41.322033] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-22T19:42:42.122067] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-22T19:42:42.280822] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T19:42:42.922090] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-22T19:42:42.957364] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T19:42:43.347866] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-22T19:42:43.722098] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-22T19:42:44.461117] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T19:42:44.522042] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-22T19:42:45.322027] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-22T19:42:45.375112] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T19:42:46.017817] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-22T19:42:46.122026] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-22T19:42:46.234021] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T19:42:46.922048] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-22T19:42:47.051432] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T19:42:47.053507] [INFO ] [REMOTE ] KTF: Full fetch complete (18363 records). [2025-09-22T19:42:47.053582] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-22T19:42:47.415365] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-22T19:42:47.415446] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-22T19:42:47.415860] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-22T19:42:47.415934] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-22T19:42:47.416514] [DEBUG] [LOCAL ] KTF: Trimmed 18363 records to 13028 (keeping 200 days of data) [2025-09-22T19:42:47.494828] [DEBUG] [LOCAL ] KTF: Primary data saved (13028 records). [2025-09-22T19:42:47.494980] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-22T19:42:47.495094] [INFO ] [MAIN ] Update Progress: 1226/2372 symbols completed. KTF took 15.9s. Estimated remaining: 2h 32m 7s. Rate: 7.5 symbols/min [2025-09-22T19:42:47.667043] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:42:47.667258] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-22T19:42:47.667301] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-22T19:42:47.667455] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-22T19:42:47.667508] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-22T19:42:47.667575] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-22T19:42:47.667609] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-22T19:42:47.729508] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-22T19:42:48.023863] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:42:48.522013] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-22T19:42:48.948787] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-22T19:42:49.132970] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-22T19:42:49.317168] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T19:42:49.326046] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-22T19:42:50.122104] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-22T19:42:50.844509] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T19:42:50.922037] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-22T19:42:51.704724] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T19:42:51.722028] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-22T19:42:52.452926] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T19:42:52.522047] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-22T19:42:53.177507] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T19:42:53.185194] [INFO ] [REMOTE ] KT: Full fetch complete (66833 records). [2025-09-22T19:42:53.185363] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-22T19:42:53.327447] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-22T19:42:53.641556] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-22T19:42:53.641671] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-22T19:42:53.642563] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-22T19:42:53.642608] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-22T19:42:53.643985] [DEBUG] [LOCAL ] KT: Trimmed 66833 records to 45662 (keeping 200 days of data) [2025-09-22T19:42:53.932639] [DEBUG] [LOCAL ] KT: Primary data saved (45662 records). [2025-09-22T19:42:53.932879] [INFO ] [MAIN ] KT: Full history saved. [2025-09-22T19:42:53.933063] [INFO ] [MAIN ] Update Progress: 1227/2372 symbols completed. KT took 31.6s. Estimated remaining: 2h 31m 57s. Rate: 7.5 symbols/min [2025-09-22T19:42:54.129976] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-22T19:42:54.135239] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:42:54.189358] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-22T19:42:54.189505] [INFO ] [MAIN ] KVUE: Loaded 54447 existing records. [2025-09-22T19:42:54.396173] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:42:54.401349] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T19:42:54.400197] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-22T19:42:54.410783] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-22T19:42:54.420773] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T19:42:54.423745] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-22T19:42:54.424629] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-22T19:42:54.817123] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:42:54.922087] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-22T19:42:55.722114] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-22T19:42:56.148362] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T19:42:56.522095] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-22T19:42:56.742482] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T19:42:56.958963] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T19:42:57.322060] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-22T19:42:58.122123] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-22T19:42:58.683364] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T19:42:58.710153] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-22T19:42:58.718822] [INFO ] [REMOTE ] KSS: Full fetch complete (77642 records). [2025-09-22T19:42:58.718978] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-22T19:42:58.927187] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-22T19:42:59.124291] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-22T19:42:59.124435] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-22T19:42:59.125998] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-22T19:42:59.126173] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-22T19:42:59.138807] [DEBUG] [LOCAL ] KSS: Trimmed 77642 records to 53610 (keeping 200 days of data) [2025-09-22T19:42:59.158444] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T19:42:59.499414] [DEBUG] [LOCAL ] KSS: Primary data saved (53610 records). [2025-09-22T19:42:59.499661] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-22T19:42:59.499778] [INFO ] [MAIN ] Update Progress: 1228/2372 symbols completed. KSS took 42.2s. Estimated remaining: 2h 31m 47s. Rate: 7.5 symbols/min [2025-09-22T19:42:59.671024] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:42:59.723394] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-22T19:42:59.726568] [DEBUG] [LOCAL ] KVYO: Loaded 50569 existing records from primary storage. [2025-09-22T19:42:59.726873] [INFO ] [MAIN ] KVYO: Loaded 50569 existing records. [2025-09-22T19:42:59.909111] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:42:59.909344] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-22T19:42:59.909392] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-22T19:42:59.910500] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-22T19:42:59.910561] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-22T19:43:00.276164] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:43:00.373057] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T19:43:00.522023] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-22T19:43:01.322058] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-22T19:43:01.528463] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-22T19:43:02.108359] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T19:43:02.122011] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-22T19:43:02.922060] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-22T19:43:03.020025] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T19:43:03.722125] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-22T19:43:04.024090] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T19:43:04.107919] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T19:43:04.522069] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-22T19:43:05.287113] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T19:43:05.322047] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-22T19:43:05.793714] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T19:43:05.799747] [INFO ] [REMOTE ] KTB: Full fetch complete (57391 records). [2025-09-22T19:43:05.799858] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-22T19:43:06.135739] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-22T19:43:06.190512] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-22T19:43:06.190671] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-22T19:43:06.191503] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-22T19:43:06.191547] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-22T19:43:06.192828] [DEBUG] [LOCAL ] KTB: Trimmed 57391 records to 41193 (keeping 200 days of data) [2025-09-22T19:43:06.454207] [DEBUG] [LOCAL ] KTB: Primary data saved (41193 records). [2025-09-22T19:43:06.454341] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-22T19:43:06.454427] [INFO ] [MAIN ] Update Progress: 1229/2372 symbols completed. KTB took 36.4s. Estimated remaining: 2h 31m 38s. Rate: 7.5 symbols/min [2025-09-22T19:43:06.625516] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:43:06.663969] [DEBUG] [LOCAL ] KW: Loaded 41246 existing records from primary storage. [2025-09-22T19:43:06.664112] [INFO ] [MAIN ] KW: Loaded 41246 existing records. [2025-09-22T19:43:06.852308] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:43:06.852730] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-22T19:43:06.852788] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-22T19:43:06.853757] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-22T19:43:06.853880] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-22T19:43:06.934169] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-22T19:43:07.179737] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T19:43:07.263756] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:43:07.722022] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-22T19:43:07.913118] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T19:43:08.072900] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T19:43:08.522058] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-22T19:43:09.322057] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-22T19:43:09.458212] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T19:43:10.122036] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-22T19:43:10.558736] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-22T19:43:10.674530] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T19:43:10.922087] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-22T19:43:11.465303] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T19:43:11.722101] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-22T19:43:12.088683] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T19:43:12.220145] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T19:43:12.522164] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-22T19:43:13.322121] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-22T19:43:14.122122] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-22T19:43:14.282888] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T19:43:14.922062] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-22T19:43:15.083240] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T19:43:15.112071] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T19:43:15.722049] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-22T19:43:16.522087] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-22T19:43:16.651328] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T19:43:17.322064] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-22T19:43:17.643413] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T19:43:18.015612] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T19:43:18.122066] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-22T19:43:18.697009] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T19:43:18.922156] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-22T19:43:19.641504] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T19:43:19.722056] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-22T19:43:20.452049] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T19:43:20.522018] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-22T19:43:21.307682] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T19:43:21.322012] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-22T19:43:22.122073] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-22T19:43:22.377212] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T19:43:22.385481] [INFO ] [REMOTE ] KVUE: Full fetch complete (77669 records). [2025-09-22T19:43:22.385602] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-22T19:43:22.609606] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-22T19:43:22.805789] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-22T19:43:22.815880] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-22T19:43:22.822489] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-22T19:43:22.830184] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-22T19:43:22.836378] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T19:43:22.845492] [DEBUG] [LOCAL ] KVUE: Trimmed 77669 records to 53667 (keeping 200 days of data) [2025-09-22T19:43:22.938740] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-22T19:43:23.188941] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-09-22T19:43:23.189095] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-22T19:43:23.189182] [INFO ] [MAIN ] Update Progress: 1230/2372 symbols completed. KVUE took 29.3s. Estimated remaining: 2h 31m 38s. Rate: 7.5 symbols/min [2025-09-22T19:43:23.389194] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:43:23.408105] [DEBUG] [LOCAL ] KWR: Loaded 17129 existing records from primary storage. [2025-09-22T19:43:23.408226] [INFO ] [MAIN ] KWR: Loaded 17129 existing records. [2025-09-22T19:43:23.583440] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:43:23.583739] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-22T19:43:23.583796] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-22T19:43:23.584349] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-22T19:43:23.584410] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-22T19:43:23.727272] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-22T19:43:23.941066] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:43:24.301370] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-22T19:43:24.522113] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-22T19:43:24.926722] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-22T19:43:25.322034] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-22T19:43:25.676575] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T19:43:25.745189] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T19:43:26.122126] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-22T19:43:26.922046] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-22T19:43:27.133677] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T19:43:27.722126] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-22T19:43:28.394673] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T19:43:28.522028] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-22T19:43:29.322085] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-22T19:43:29.466447] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T19:43:29.474802] [INFO ] [REMOTE ] KVYO: Full fetch complete (71336 records). [2025-09-22T19:43:29.474956] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-22T19:43:29.897630] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-22T19:43:29.899696] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-22T19:43:29.900620] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-22T19:43:29.901878] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T19:43:29.901247] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-22T19:43:29.908535] [INFO ] [REMOTE ] KW: Full fetch complete (56740 records). [2025-09-22T19:43:29.908758] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-22T19:43:29.941914] [DEBUG] [LOCAL ] KVYO: Trimmed 71336 records to 49852 (keeping 200 days of data) [2025-09-22T19:43:30.127260] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-22T19:43:30.433116] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-22T19:43:30.433789] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-22T19:43:30.435274] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-22T19:43:30.436086] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-22T19:43:30.494597] [DEBUG] [LOCAL ] KW: Trimmed 56740 records to 40648 (keeping 200 days of data) [2025-09-22T19:43:30.500185] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T19:43:30.782033] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-22T19:43:30.867678] [DEBUG] [LOCAL ] KW: Primary data saved (40648 records). [2025-09-22T19:43:30.868997] [INFO ] [MAIN ] KW: Full history saved. [2025-09-22T19:43:30.869364] [INFO ] [MAIN ] Update Progress: 1231/2372 symbols completed. KW took 24.4s. Estimated remaining: 2h 31m 30s. Rate: 7.5 symbols/min [2025-09-22T19:43:30.927099] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-22T19:43:31.055542] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:43:31.058340] [DEBUG] [LOCAL ] KVYO: Primary data saved (49852 records). [2025-09-22T19:43:31.058416] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-22T19:43:31.058490] [INFO ] [MAIN ] Update Progress: 1232/2372 symbols completed. KVYO took 31.6s. Estimated remaining: 2h 31m 15s. Rate: 7.5 symbols/min [2025-09-22T19:43:31.245949] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:43:31.256881] [DEBUG] [LOCAL ] KYN: Loaded 30875 existing records from primary storage. [2025-09-22T19:43:31.257009] [INFO ] [MAIN ] KYN: Loaded 30875 existing records. [2025-09-22T19:43:31.455480] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:43:31.455774] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-22T19:43:31.455829] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-22T19:43:31.457019] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-22T19:43:31.457153] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-22T19:43:31.552617] [DEBUG] [LOCAL ] L: Loaded 41511 existing records from primary storage. [2025-09-22T19:43:31.575739] [INFO ] [MAIN ] L: Loaded 41511 existing records. [2025-09-22T19:43:31.737112] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-22T19:43:31.980061] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:43:32.006756] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-22T19:43:32.066456] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T19:43:32.072175] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-22T19:43:32.072023] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:43:32.077121] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-22T19:43:32.077187] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-22T19:43:32.434377] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:43:32.525392] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-22T19:43:32.526994] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T19:43:32.528463] [INFO ] [REMOTE ] KUKE: Full fetch complete (7894 records). [2025-09-22T19:43:32.528533] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-22T19:43:32.709304] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T19:43:32.709532] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:43:32.709600] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:43:32.709699] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-22T19:43:32.709770] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-22T19:43:32.709808] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-22T19:43:32.709864] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-22T19:43:32.709944] [INFO ] [MAIN ] Update Progress: 1233/2372 symbols completed. KUKE took 45.2s. Estimated remaining: 2h 31m 1s. Rate: 7.5 symbols/min [2025-09-22T19:43:32.879590] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:43:32.933484] [DEBUG] [LOCAL ] LAC: Loaded 53062 existing records from primary storage. [2025-09-22T19:43:32.933671] [INFO ] [MAIN ] LAC: Loaded 53062 existing records. [2025-09-22T19:43:33.119373] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:43:33.119597] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-22T19:43:33.119665] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-22T19:43:33.120715] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-22T19:43:33.120777] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-22T19:43:33.333789] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-22T19:43:33.486894] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:43:34.074535] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T19:43:34.122041] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-22T19:43:34.922089] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-22T19:43:34.972415] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T19:43:35.160254] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T19:43:35.722066] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-22T19:43:36.522057] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-22T19:43:36.926429] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-22T19:43:37.076492] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T19:43:37.322098] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-22T19:43:37.609855] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T19:43:38.122095] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-22T19:43:38.922085] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-22T19:43:39.193128] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T19:43:39.303098] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-22T19:43:39.722024] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-22T19:43:40.189387] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T19:43:40.522029] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-22T19:43:40.697493] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-22T19:43:41.322064] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-22T19:43:42.117057] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T19:43:42.124520] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-22T19:43:42.625332] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T19:43:42.922058] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-22T19:43:43.094430] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-22T19:43:43.722086] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-22T19:43:44.479007] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T19:43:44.522009] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-22T19:43:45.322085] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-22T19:43:45.581248] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T19:43:46.111018] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T19:43:46.122418] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-22T19:43:46.343848] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T19:43:46.922063] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-22T19:43:47.722128] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-22T19:43:47.981724] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T19:43:48.522088] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-22T19:43:48.641237] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T19:43:49.282077] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T19:43:49.322007] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-22T19:43:49.409001] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-22T19:43:50.122113] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-22T19:43:50.933868] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-22T19:43:50.935440] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T19:43:51.233578] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T19:43:51.722057] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-22T19:43:52.522098] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-22T19:43:52.775468] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T19:43:52.921774] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T19:43:53.322065] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-22T19:43:53.762860] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T19:43:54.082922] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T19:43:54.085754] [INFO ] [REMOTE ] KWR: Full fetch complete (24001 records). [2025-09-22T19:43:54.085839] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-22T19:43:54.127303] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-22T19:43:54.466780] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-22T19:43:54.466868] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-22T19:43:54.467389] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-22T19:43:54.467428] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-22T19:43:54.468082] [DEBUG] [LOCAL ] KWR: Trimmed 24001 records to 16817 (keeping 200 days of data) [2025-09-22T19:43:54.571506] [DEBUG] [LOCAL ] KWR: Primary data saved (16817 records). [2025-09-22T19:43:54.571675] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-22T19:43:54.571781] [INFO ] [MAIN ] Update Progress: 1234/2372 symbols completed. KWR took 31.4s. Estimated remaining: 2h 31m 6s. Rate: 7.5 symbols/min [2025-09-22T19:43:54.742160] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:43:54.767276] [DEBUG] [LOCAL ] LAD: Loaded 24380 existing records from primary storage. [2025-09-22T19:43:54.767422] [INFO ] [MAIN ] LAD: Loaded 24380 existing records. [2025-09-22T19:43:54.925021] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-22T19:43:54.954876] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:43:54.955139] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-22T19:43:54.955219] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-22T19:43:54.956096] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-22T19:43:54.956161] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-22T19:43:55.315246] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:43:55.703196] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T19:43:55.722066] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-22T19:43:56.522029] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-22T19:43:56.830978] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T19:43:56.892631] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T19:43:57.322069] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-22T19:43:57.972383] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T19:43:58.122087] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-22T19:43:58.660260] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T19:43:58.922120] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-22T19:43:59.169691] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T19:43:59.722126] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-22T19:44:00.095565] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T19:44:00.522133] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-22T19:44:01.322015] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-22T19:44:01.429129] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T19:44:01.433717] [INFO ] [REMOTE ] KYN: Full fetch complete (45061 records). [2025-09-22T19:44:01.433806] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-22T19:44:01.837621] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-22T19:44:01.837744] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-22T19:44:01.838988] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-22T19:44:01.839051] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-22T19:44:01.840036] [DEBUG] [LOCAL ] KYN: Trimmed 45061 records to 30236 (keeping 200 days of data) [2025-09-22T19:44:02.030607] [DEBUG] [LOCAL ] KYN: Primary data saved (30236 records). [2025-09-22T19:44:02.030760] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-22T19:44:02.030849] [INFO ] [MAIN ] Update Progress: 1235/2372 symbols completed. KYN took 31.2s. Estimated remaining: 2h 30m 58s. Rate: 7.5 symbols/min [2025-09-22T19:44:02.127519] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-22T19:44:02.211739] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:44:02.250551] [DEBUG] [LOCAL ] LADR: Loaded 39244 existing records from primary storage. [2025-09-22T19:44:02.250725] [INFO ] [MAIN ] LADR: Loaded 39244 existing records. [2025-09-22T19:44:02.431485] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:44:02.432306] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-22T19:44:02.432364] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-22T19:44:02.433477] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-22T19:44:02.448458] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-22T19:44:02.532387] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-22T19:44:02.839550] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:44:02.878744] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T19:44:02.885237] [INFO ] [REMOTE ] L: Full fetch complete (59535 records). [2025-09-22T19:44:02.885356] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-22T19:44:02.927891] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-22T19:44:03.278080] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-22T19:44:03.278385] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-22T19:44:03.279373] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-22T19:44:03.279496] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-22T19:44:03.281087] [DEBUG] [LOCAL ] L: Trimmed 59535 records to 40967 (keeping 200 days of data) [2025-09-22T19:44:03.391214] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-22T19:44:03.559538] [DEBUG] [LOCAL ] L: Primary data saved (40967 records). [2025-09-22T19:44:03.559693] [INFO ] [MAIN ] L: Full history saved. [2025-09-22T19:44:03.559848] [INFO ] [MAIN ] Update Progress: 1236/2372 symbols completed. L took 32.5s. Estimated remaining: 2h 30m 44s. Rate: 7.5 symbols/min [2025-09-22T19:44:03.727623] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-22T19:44:03.730253] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:44:03.736186] [DEBUG] [LOCAL ] LANV: Loaded 2699 existing records from primary storage. [2025-09-22T19:44:03.736363] [INFO ] [MAIN ] LANV: Loaded 2699 existing records. [2025-09-22T19:44:03.913339] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:44:03.913577] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-22T19:44:03.913624] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-22T19:44:03.913911] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-22T19:44:03.913969] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-22T19:44:04.289095] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:44:04.310732] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T19:44:04.522013] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-22T19:44:05.151821] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T19:44:05.322105] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-22T19:44:05.983300] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T19:44:05.984312] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-22T19:44:06.122138] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-22T19:44:06.922089] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-22T19:44:07.686191] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T19:44:07.722059] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-22T19:44:07.722827] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T19:44:08.522117] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-22T19:44:09.038967] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-22T19:44:09.322104] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-22T19:44:09.901219] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-22T19:44:09.916588] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T19:44:10.122052] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-22T19:44:10.572756] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-22T19:44:10.922101] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-22T19:44:11.722057] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-22T19:44:12.063559] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-22T19:44:12.522038] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-22T19:44:12.849492] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T19:44:13.322122] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-22T19:44:13.901438] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T19:44:14.122030] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-22T19:44:14.357429] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T19:44:14.922064] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-22T19:44:15.258838] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T19:44:15.722095] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-22T19:44:16.140685] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T19:44:16.522113] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-22T19:44:16.922465] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-22T19:44:17.209713] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T19:44:17.322062] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-22T19:44:17.796188] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-22T19:44:18.122061] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-22T19:44:18.922057] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-22T19:44:19.251547] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T19:44:19.722090] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-22T19:44:20.214891] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T19:44:20.522062] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-22T19:44:21.322060] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-22T19:44:21.636271] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T19:44:21.642179] [INFO ] [REMOTE ] LAD: Full fetch complete (35281 records). [2025-09-22T19:44:21.642369] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-22T19:44:21.759855] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T19:44:21.935536] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-22T19:44:21.993550] [INFO ] [REMOTE ] LAC: Full fetch complete (75960 records). [2025-09-22T19:44:21.993794] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-22T19:44:22.145886] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-22T19:44:22.191289] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-22T19:44:22.191408] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-22T19:44:22.192110] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-22T19:44:22.192677] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-22T19:44:22.266351] [DEBUG] [LOCAL ] LAD: Trimmed 35281 records to 23764 (keeping 200 days of data) [2025-09-22T19:44:22.634954] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-22T19:44:22.635819] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-22T19:44:22.637025] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-22T19:44:22.637575] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-22T19:44:22.644221] [DEBUG] [LOCAL ] LAC: Trimmed 75960 records to 52302 (keeping 200 days of data) [2025-09-22T19:44:22.789976] [DEBUG] [LOCAL ] LAD: Primary data saved (23764 records). [2025-09-22T19:44:22.790990] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-22T19:44:22.791389] [INFO ] [MAIN ] Update Progress: 1237/2372 symbols completed. LAD took 28.2s. Estimated remaining: 2h 30m 46s. Rate: 7.5 symbols/min [2025-09-22T19:44:22.922057] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-22T19:44:23.027171] [DEBUG] [LOCAL ] LAC: Primary data saved (52302 records). [2025-09-22T19:44:23.027360] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-22T19:44:23.027670] [INFO ] [MAIN ] Update Progress: 1238/2372 symbols completed. LAC took 50.3s. Estimated remaining: 2h 30m 31s. Rate: 7.5 symbols/min [2025-09-22T19:44:23.608404] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T19:44:23.647548] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T19:44:23.649025] [INFO ] [REMOTE ] LANV: Full fetch complete (4380 records). [2025-09-22T19:44:23.649096] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-22T19:44:23.727156] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-22T19:44:24.030230] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-22T19:44:24.030327] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-22T19:44:24.030474] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-22T19:44:24.030513] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-22T19:44:24.030933] [DEBUG] [LOCAL ] LANV: Trimmed 4380 records to 2697 (keeping 200 days of data) [2025-09-22T19:44:24.053447] [DEBUG] [LOCAL ] LANV: Primary data saved (2697 records). [2025-09-22T19:44:24.053588] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-22T19:44:24.053790] [INFO ] [MAIN ] Update Progress: 1239/2372 symbols completed. LANV took 20.5s. Estimated remaining: 2h 30m 17s. Rate: 7.5 symbols/min [2025-09-22T19:44:25.002136] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T19:44:25.011955] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-22T19:44:26.360167] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T19:44:26.368850] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-22T19:44:27.994315] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T19:44:28.001458] [INFO ] [REMOTE ] LADR: Full fetch complete (54925 records). [2025-09-22T19:44:28.001583] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-22T19:44:28.399194] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-22T19:44:28.399339] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-22T19:44:28.400218] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-22T19:44:28.400285] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-22T19:44:28.401569] [DEBUG] [LOCAL ] LADR: Trimmed 54925 records to 38703 (keeping 200 days of data) [2025-09-22T19:44:28.639189] [DEBUG] [LOCAL ] LADR: Primary data saved (38703 records). [2025-09-22T19:44:28.639340] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-22T19:44:28.639454] [INFO ] [MAIN ] Update Progress: 1240/2372 symbols completed. LADR took 26.6s. Estimated remaining: 2h 30m 6s. Rate: 7.5 symbols/min [2025-09-22T19:44:29.273341] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:44:29.378054] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:44:29.383342] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:44:29.390363] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-22T19:44:29.418766] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-22T19:44:29.423605] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:44:29.424846] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-22T19:44:29.425209] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-22T19:44:29.425372] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-22T19:44:29.425430] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-22T19:44:29.603467] [DEBUG] [LOCAL ] LAW: Loaded 14108 existing records from primary storage. [2025-09-22T19:44:29.643149] [INFO ] [MAIN ] LAW: Loaded 14108 existing records. [2025-09-22T19:44:29.695895] [DEBUG] [LOCAL ] LB: Loaded 38376 existing records from primary storage. [2025-09-22T19:44:29.749728] [INFO ] [MAIN ] LB: Loaded 38376 existing records. [2025-09-22T19:44:29.930265] [DEBUG] [LOCAL ] LAZ: Loaded 46085 existing records from primary storage. [2025-09-22T19:44:30.005381] [INFO ] [MAIN ] LAZ: Loaded 46085 existing records. [2025-09-22T19:44:30.203171] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:44:30.248833] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-22T19:44:30.357594] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:44:30.382522] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-22T19:44:30.386271] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-22T19:44:30.386163] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:44:30.396934] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-22T19:44:30.402566] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-22T19:44:30.413250] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-22T19:44:30.408053] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-22T19:44:30.484292] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-22T19:44:30.516117] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:44:30.529611] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-22T19:44:30.552638] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-22T19:44:30.644513] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:44:30.638988] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-22T19:44:30.684622] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-22T19:44:30.700580] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-22T19:44:30.742947] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-22T19:44:30.751680] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-22T19:44:31.498385] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:44:31.539335] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-22T19:44:31.561439] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:44:31.569144] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-22T19:44:31.659014] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:44:31.659558] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-22T19:44:31.672046] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-22T19:44:31.675677] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-22T19:44:32.550720] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T19:44:32.554799] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-22T19:44:32.974710] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T19:44:32.983849] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-22T19:44:33.035766] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T19:44:33.045476] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-22T19:44:33.222776] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T19:44:33.322011] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-22T19:44:33.491267] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T19:44:34.122076] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-22T19:44:34.301482] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T19:44:34.445869] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:44:34.908249] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T19:44:34.922026] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-22T19:44:35.031069] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T19:44:35.722055] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-22T19:44:36.434212] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T19:44:36.522006] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-22T19:44:36.929766] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T19:44:37.322030] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-22T19:44:38.047507] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T19:44:38.122004] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-22T19:44:38.606122] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-22T19:44:38.922065] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-22T19:44:39.660142] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T19:44:39.722119] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-22T19:44:39.755578] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T19:44:40.522125] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-22T19:44:41.266292] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T19:44:41.322009] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-22T19:44:41.796393] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T19:44:42.122084] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-22T19:44:42.761077] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T19:44:42.879129] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T19:44:42.922012] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-22T19:44:43.722052] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-22T19:44:44.522077] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-22T19:44:44.582169] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T19:44:45.238909] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T19:44:45.322041] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-22T19:44:45.516047] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T19:44:46.122073] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-22T19:44:46.537291] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T19:44:46.922070] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-22T19:44:47.651620] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T19:44:47.722004] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-22T19:44:48.522074] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-22T19:44:48.566787] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T19:44:49.031703] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T19:44:49.038847] [INFO ] [REMOTE ] LAZ: Full fetch complete (65788 records). [2025-09-22T19:44:49.038962] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-22T19:44:49.332097] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-22T19:44:49.430580] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-22T19:44:49.430844] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-22T19:44:49.431789] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-22T19:44:49.431869] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-22T19:44:49.433340] [DEBUG] [LOCAL ] LAZ: Trimmed 65788 records to 45362 (keeping 200 days of data) [2025-09-22T19:44:49.542943] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T19:44:49.735064] [DEBUG] [LOCAL ] LAZ: Primary data saved (45362 records). [2025-09-22T19:44:49.735228] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-22T19:44:49.735398] [INFO ] [MAIN ] Update Progress: 1241/2372 symbols completed. LAZ took 21.1s. Estimated remaining: 2h 30m 10s. Rate: 7.5 symbols/min [2025-09-22T19:44:49.905698] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:44:49.962573] [DEBUG] [LOCAL ] LBRT: Loaded 53697 existing records from primary storage. [2025-09-22T19:44:49.962740] [INFO ] [MAIN ] LBRT: Loaded 53697 existing records. [2025-09-22T19:44:50.135403] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-22T19:44:50.141346] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:44:50.142359] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-22T19:44:50.142409] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-22T19:44:50.144256] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-22T19:44:50.144317] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-22T19:44:50.505518] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:44:50.863702] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T19:44:50.921999] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-22T19:44:51.722105] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-22T19:44:51.824017] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T19:44:52.455474] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T19:44:52.460771] [INFO ] [REMOTE ] LB: Full fetch complete (56006 records). [2025-09-22T19:44:52.460866] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-22T19:44:52.527224] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-22T19:44:52.855710] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-22T19:44:52.855803] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-22T19:44:52.856626] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-22T19:44:52.856701] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-22T19:44:52.857934] [DEBUG] [LOCAL ] LB: Trimmed 56006 records to 37682 (keeping 200 days of data) [2025-09-22T19:44:53.103610] [DEBUG] [LOCAL ] LB: Primary data saved (37682 records). [2025-09-22T19:44:53.103828] [INFO ] [MAIN ] LB: Full history saved. [2025-09-22T19:44:53.103948] [INFO ] [MAIN ] Update Progress: 1242/2372 symbols completed. LB took 24.5s. Estimated remaining: 2h 29m 57s. Rate: 7.5 symbols/min [2025-09-22T19:44:53.276996] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:44:53.327878] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-22T19:44:53.330672] [DEBUG] [LOCAL ] LC: Loaded 48747 existing records from primary storage. [2025-09-22T19:44:53.330909] [INFO ] [MAIN ] LC: Loaded 48747 existing records. [2025-09-22T19:44:53.523721] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:44:53.524086] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-22T19:44:53.524155] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-22T19:44:53.548397] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-22T19:44:53.548516] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-22T19:44:53.618324] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-22T19:44:53.959897] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:44:53.969966] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T19:44:54.122034] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-22T19:44:54.253321] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T19:44:54.922115] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-22T19:44:55.722097] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-22T19:44:55.772487] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T19:44:56.412865] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T19:44:56.522030] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-22T19:44:57.322033] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-22T19:44:57.362441] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T19:44:58.093847] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T19:44:58.122015] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-22T19:44:58.219980] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T19:44:58.922033] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-22T19:44:59.054083] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T19:44:59.057155] [INFO ] [REMOTE ] LAW: Full fetch complete (20723 records). [2025-09-22T19:44:59.057238] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-22T19:44:59.426188] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-22T19:44:59.426281] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-22T19:44:59.426751] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-22T19:44:59.426824] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-22T19:44:59.427545] [DEBUG] [LOCAL ] LAW: Trimmed 20723 records to 13887 (keeping 200 days of data) [2025-09-22T19:44:59.506843] [DEBUG] [LOCAL ] LAW: Primary data saved (13887 records). [2025-09-22T19:44:59.506996] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-22T19:44:59.507100] [INFO ] [MAIN ] Update Progress: 1243/2372 symbols completed. LAW took 30.9s. Estimated remaining: 2h 29m 48s. Rate: 7.5 symbols/min [2025-09-22T19:44:59.680157] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:44:59.710355] [DEBUG] [LOCAL ] LCII: Loaded 29177 existing records from primary storage. [2025-09-22T19:44:59.710488] [INFO ] [MAIN ] LCII: Loaded 29177 existing records. [2025-09-22T19:44:59.731545] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-22T19:44:59.897755] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:44:59.897991] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-22T19:44:59.898038] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-22T19:44:59.899214] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-22T19:44:59.899276] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-22T19:45:00.307459] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:45:00.336009] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T19:45:00.522047] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-22T19:45:01.322081] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-22T19:45:01.628501] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T19:45:01.677240] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T19:45:02.122078] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-22T19:45:02.922064] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-22T19:45:03.727168] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-22T19:45:03.741504] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-22T19:45:04.522057] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-22T19:45:05.094816] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-22T19:45:05.102300] [INFO ] [REMOTE ] LAR: Full fetch complete (54015 records). [2025-09-22T19:45:05.102427] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-22T19:45:05.298205] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-22T19:45:05.298858] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:45:05.298967] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:45:05.299150] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-22T19:45:05.299313] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-22T19:45:05.299379] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-22T19:45:05.299476] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-22T19:45:05.299708] [INFO ] [MAIN ] Update Progress: 1244/2372 symbols completed. LAR took 36.7s. Estimated remaining: 2h 29m 38s. Rate: 7.5 symbols/min [2025-09-22T19:45:05.475463] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:45:05.503913] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-22T19:45:05.514542] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-22T19:45:05.559792] [DEBUG] [LOCAL ] LDI: Loaded 44135 existing records from primary storage. [2025-09-22T19:45:05.559958] [INFO ] [MAIN ] LDI: Loaded 44135 existing records. [2025-09-22T19:45:05.783191] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:45:05.783761] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-22T19:45:05.783839] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-22T19:45:05.791298] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-22T19:45:05.798864] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-22T19:45:05.873624] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-22T19:45:06.127184] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-22T19:45:06.182953] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:45:06.324212] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T19:45:06.909616] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:45:06.922015] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-22T19:45:07.306937] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T19:45:07.722153] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-22T19:45:08.522085] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-22T19:45:08.699512] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T19:45:09.322059] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-22T19:45:09.604248] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T19:45:10.007908] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T19:45:10.122075] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-22T19:45:10.796237] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T19:45:10.922050] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-22T19:45:11.722054] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-22T19:45:11.983702] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T19:45:12.522115] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-22T19:45:12.626993] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T19:45:13.052264] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T19:45:13.322061] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-22T19:45:14.122072] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-22T19:45:14.294969] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T19:45:14.922107] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-22T19:45:15.298755] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-22T19:45:15.722077] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-22T19:45:16.168866] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-22T19:45:16.522087] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-22T19:45:17.322071] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-22T19:45:17.376538] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-22T19:45:18.069824] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T19:45:18.122065] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-22T19:45:18.172037] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-22T19:45:18.922072] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-22T19:45:19.110244] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T19:45:19.302204] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T19:45:19.722055] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-22T19:45:20.522056] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-22T19:45:20.691988] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T19:45:21.122773] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T19:45:21.322025] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-22T19:45:21.692948] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T19:45:22.122069] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-22T19:45:22.922055] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-22T19:45:23.080958] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T19:45:23.089730] [INFO ] [REMOTE ] LBRT: Full fetch complete (76497 records). [2025-09-22T19:45:23.089940] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-22T19:45:23.504842] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-22T19:45:23.504937] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-22T19:45:23.506159] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-22T19:45:23.506234] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-22T19:45:23.507999] [DEBUG] [LOCAL ] LBRT: Trimmed 76497 records to 52920 (keeping 200 days of data) [2025-09-22T19:45:23.637341] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T19:45:23.722949] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-22T19:45:23.884901] [DEBUG] [LOCAL ] LBRT: Primary data saved (52920 records). [2025-09-22T19:45:23.885079] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-22T19:45:23.885213] [INFO ] [MAIN ] Update Progress: 1245/2372 symbols completed. LBRT took 34.1s. Estimated remaining: 2h 29m 40s. Rate: 7.5 symbols/min [2025-09-22T19:45:24.064113] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:45:24.118738] [DEBUG] [LOCAL ] LDOS: Loaded 46704 existing records from primary storage. [2025-09-22T19:45:24.118880] [INFO ] [MAIN ] LDOS: Loaded 46704 existing records. [2025-09-22T19:45:24.327533] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:45:24.328065] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-22T19:45:24.328149] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-22T19:45:24.329877] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-22T19:45:24.329945] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-22T19:45:24.519396] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T19:45:24.534998] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-22T19:45:24.619157] [INFO ] [REMOTE ] LC: Full fetch complete (70265 records). [2025-09-22T19:45:24.633727] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-22T19:45:24.908826] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:45:25.078372] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T19:45:25.317937] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-22T19:45:25.318055] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-22T19:45:25.319598] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-22T19:45:25.319704] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-22T19:45:25.321839] [DEBUG] [LOCAL ] LC: Trimmed 70265 records to 47959 (keeping 200 days of data) [2025-09-22T19:45:25.322101] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-22T19:45:25.638105] [DEBUG] [LOCAL ] LC: Primary data saved (47959 records). [2025-09-22T19:45:25.638327] [INFO ] [MAIN ] LC: Full history saved. [2025-09-22T19:45:25.638461] [INFO ] [MAIN ] Update Progress: 1246/2372 symbols completed. LC took 32.5s. Estimated remaining: 2h 29m 26s. Rate: 7.5 symbols/min [2025-09-22T19:45:25.824598] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:45:25.842781] [DEBUG] [LOCAL ] LDP: Loaded 13351 existing records from primary storage. [2025-09-22T19:45:25.842979] [INFO ] [MAIN ] LDP: Loaded 13351 existing records. [2025-09-22T19:45:26.030397] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:45:26.030737] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-22T19:45:26.030846] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-22T19:45:26.031558] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-22T19:45:26.031620] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-22T19:45:26.126134] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-22T19:45:26.298805] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T19:45:26.449708] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:45:26.922079] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-22T19:45:27.153768] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T19:45:27.722035] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-22T19:45:28.172118] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-22T19:45:28.421505] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T19:45:28.522582] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-22T19:45:28.987021] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T19:45:29.322073] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-22T19:45:30.122079] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-22T19:45:30.320303] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-22T19:45:30.611576] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T19:45:30.922062] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-22T19:45:31.136856] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-22T19:45:31.140622] [INFO ] [REMOTE ] LCII: Full fetch complete (38950 records). [2025-09-22T19:45:31.140731] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-22T19:45:31.510102] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-22T19:45:31.510182] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-22T19:45:31.510865] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-22T19:45:31.510928] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-22T19:45:31.511791] [DEBUG] [LOCAL ] LCII: Trimmed 38950 records to 28723 (keeping 200 days of data) [2025-09-22T19:45:31.691268] [DEBUG] [LOCAL ] LCII: Primary data saved (28723 records). [2025-09-22T19:45:31.691414] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-22T19:45:31.691499] [INFO ] [MAIN ] Update Progress: 1247/2372 symbols completed. LCII took 32.2s. Estimated remaining: 2h 29m 17s. Rate: 7.5 symbols/min [2025-09-22T19:45:31.729279] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-22T19:45:31.887287] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:45:31.932038] [DEBUG] [LOCAL ] LEA: Loaded 42546 existing records from primary storage. [2025-09-22T19:45:31.932254] [INFO ] [MAIN ] LEA: Loaded 42546 existing records. [2025-09-22T19:45:32.111212] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:45:32.111499] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-22T19:45:32.111557] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-22T19:45:32.112897] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-22T19:45:32.112962] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-22T19:45:32.487285] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:45:32.522095] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-22T19:45:32.603513] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T19:45:33.322092] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-22T19:45:33.720945] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-22T19:45:33.735484] [INFO ] [REMOTE ] LDI: Full fetch complete (60037 records). [2025-09-22T19:45:33.735824] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-22T19:45:34.135297] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-22T19:45:34.203900] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-22T19:45:34.204040] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-22T19:45:34.205544] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-22T19:45:34.205861] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-22T19:45:34.233849] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T19:45:34.237481] [DEBUG] [LOCAL ] LDI: Trimmed 60037 records to 43700 (keeping 200 days of data) [2025-09-22T19:45:34.514392] [DEBUG] [LOCAL ] LDI: Primary data saved (43700 records). [2025-09-22T19:45:34.514556] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-22T19:45:34.514674] [INFO ] [MAIN ] Update Progress: 1248/2372 symbols completed. LDI took 29.2s. Estimated remaining: 2h 29m 4s. Rate: 7.5 symbols/min [2025-09-22T19:45:34.684212] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:45:34.733163] [DEBUG] [LOCAL ] LEG: Loaded 51158 existing records from primary storage. [2025-09-22T19:45:34.733338] [INFO ] [MAIN ] LEG: Loaded 51158 existing records. [2025-09-22T19:45:34.918101] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:45:34.918713] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-22T19:45:34.918817] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-22T19:45:34.920181] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-22T19:45:34.920244] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-22T19:45:34.931608] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-22T19:45:35.267334] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-22T19:45:35.333329] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:45:35.349142] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T19:45:35.722121] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-22T19:45:36.405254] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T19:45:36.524117] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-22T19:45:36.526906] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T19:45:37.316123] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T19:45:37.322003] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-22T19:45:38.122116] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-22T19:45:38.238796] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-22T19:45:38.922084] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-22T19:45:39.436768] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T19:45:39.722075] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-22T19:45:40.522088] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-22T19:45:40.722563] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T19:45:41.322067] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-22T19:45:41.412974] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T19:45:42.122060] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-22T19:45:42.182207] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T19:45:42.224683] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-22T19:45:42.922168] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-22T19:45:43.722034] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-22T19:45:43.834830] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T19:45:43.871352] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T19:45:44.522083] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-22T19:45:44.926980] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T19:45:45.322069] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-22T19:45:46.122024] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-22T19:45:46.160509] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T19:45:46.532952] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T19:45:46.922054] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-22T19:45:47.707515] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T19:45:47.722003] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-22T19:45:47.892822] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T19:45:48.522041] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-22T19:45:48.667193] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T19:45:49.322055] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-22T19:45:49.899637] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T19:45:50.122062] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-22T19:45:50.192147] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T19:45:50.922058] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-22T19:45:51.663270] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T19:45:51.722073] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-22T19:45:52.407711] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T19:45:52.522043] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-22T19:45:53.228833] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T19:45:53.322098] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-22T19:45:54.122064] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-22T19:45:54.293439] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T19:45:54.874975] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T19:45:54.922076] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-22T19:45:55.456064] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T19:45:55.722060] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-22T19:45:56.246169] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T19:45:56.522070] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-22T19:45:57.322425] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-22T19:45:57.325290] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T19:45:57.333000] [INFO ] [REMOTE ] LEA: Full fetch complete (61008 records). [2025-09-22T19:45:57.333126] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-22T19:45:57.460254] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T19:45:57.489328] [INFO ] [REMOTE ] LDP: Full fetch complete (19430 records). [2025-09-22T19:45:57.507730] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-22T19:45:58.084485] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-22T19:45:58.090565] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-22T19:45:58.096598] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-22T19:45:58.101863] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-22T19:45:58.130057] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-22T19:45:58.180600] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-22T19:45:58.181046] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-22T19:45:58.181337] [DEBUG] [LOCAL ] LEA: Trimmed 61008 records to 41859 (keeping 200 days of data) [2025-09-22T19:45:58.181775] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-22T19:45:58.182311] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-22T19:45:58.183619] [DEBUG] [LOCAL ] LDP: Trimmed 19430 records to 13072 (keeping 200 days of data) [2025-09-22T19:45:58.369067] [DEBUG] [LOCAL ] LDP: Primary data saved (13072 records). [2025-09-22T19:45:58.369801] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-22T19:45:58.370626] [INFO ] [MAIN ] Update Progress: 1249/2372 symbols completed. LDP took 32.7s. Estimated remaining: 2h 29m 10s. Rate: 7.5 symbols/min [2025-09-22T19:45:58.642373] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:45:58.733456] [DEBUG] [LOCAL ] LEA: Primary data saved (41859 records). [2025-09-22T19:45:58.733703] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-22T19:45:58.733819] [INFO ] [MAIN ] Update Progress: 1250/2372 symbols completed. LEA took 27.0s. Estimated remaining: 2h 28m 56s. Rate: 7.5 symbols/min [2025-09-22T19:45:58.852462] [DEBUG] [LOCAL ] LEN: Loaded 53964 existing records from primary storage. [2025-09-22T19:45:58.879176] [INFO ] [MAIN ] LEN: Loaded 53964 existing records. [2025-09-22T19:45:58.956858] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:45:59.159622] [DEBUG] [LOCAL ] LEO: Loaded 17935 existing records from primary storage. [2025-09-22T19:45:59.180774] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-22T19:45:59.203168] [INFO ] [MAIN ] LEO: Loaded 17935 existing records. [2025-09-22T19:45:59.203060] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:45:59.240383] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-22T19:45:59.240490] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-22T19:45:59.259345] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-22T19:45:59.275700] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-22T19:45:59.288168] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-22T19:45:59.531846] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:45:59.577461] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-22T19:45:59.603361] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-22T19:45:59.662191] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-22T19:45:59.694602] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-22T19:45:59.923392] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:45:59.964122] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-22T19:46:00.185297] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:46:00.210857] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-22T19:46:00.522064] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-22T19:46:01.124274] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T19:46:01.322042] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-22T19:46:01.559010] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T19:46:02.122098] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-22T19:46:02.178332] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T19:46:02.187489] [INFO ] [REMOTE ] LDOS: Full fetch complete (67839 records). [2025-09-22T19:46:02.187795] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-22T19:46:02.549959] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T19:46:02.648436] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-22T19:46:02.648545] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-22T19:46:02.649500] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-22T19:46:02.649569] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-22T19:46:02.651058] [DEBUG] [LOCAL ] LDOS: Trimmed 67839 records to 45918 (keeping 200 days of data) [2025-09-22T19:46:02.934243] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-22T19:46:02.957016] [DEBUG] [LOCAL ] LDOS: Primary data saved (45918 records). [2025-09-22T19:46:02.957162] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-22T19:46:02.957260] [INFO ] [MAIN ] Update Progress: 1251/2372 symbols completed. LDOS took 39.1s. Estimated remaining: 2h 28m 44s. Rate: 7.5 symbols/min [2025-09-22T19:46:03.127583] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:46:03.180434] [DEBUG] [LOCAL ] LEVI: Loaded 52245 existing records from primary storage. [2025-09-22T19:46:03.180593] [INFO ] [MAIN ] LEVI: Loaded 52245 existing records. [2025-09-22T19:46:03.358885] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:46:03.359126] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-22T19:46:03.359175] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-22T19:46:03.360431] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-22T19:46:03.360491] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-22T19:46:03.729300] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-22T19:46:03.736444] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:46:03.823971] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T19:46:04.002950] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T19:46:04.522062] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-22T19:46:05.322070] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-22T19:46:05.559484] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-22T19:46:05.592255] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-22T19:46:06.122068] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-22T19:46:06.922026] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-22T19:46:07.234261] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-22T19:46:07.243332] [INFO ] [REMOTE ] LEG: Full fetch complete (73206 records). [2025-09-22T19:46:07.248712] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-22T19:46:07.256250] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T19:46:07.672783] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-22T19:46:07.672887] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-22T19:46:07.673854] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-22T19:46:07.673920] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-22T19:46:07.678622] [DEBUG] [LOCAL ] LEG: Trimmed 73206 records to 50389 (keeping 200 days of data) [2025-09-22T19:46:07.734977] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-22T19:46:07.995715] [DEBUG] [LOCAL ] LEG: Primary data saved (50389 records). [2025-09-22T19:46:07.995862] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-22T19:46:07.995978] [INFO ] [MAIN ] Update Progress: 1252/2372 symbols completed. LEG took 33.5s. Estimated remaining: 2h 28m 34s. Rate: 7.5 symbols/min [2025-09-22T19:46:08.179452] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:46:08.199790] [DEBUG] [LOCAL ] LFT: Loaded 18069 existing records from primary storage. [2025-09-22T19:46:08.199931] [INFO ] [MAIN ] LFT: Loaded 18069 existing records. [2025-09-22T19:46:08.382032] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:46:08.382588] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-22T19:46:08.382677] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-22T19:46:08.383292] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-22T19:46:08.383352] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-22T19:46:08.525588] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-22T19:46:08.785939] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:46:08.802943] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T19:46:08.817412] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T19:46:09.322085] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-22T19:46:10.122019] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-22T19:46:10.336956] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T19:46:10.376264] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T19:46:10.922192] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-22T19:46:11.032587] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-22T19:46:11.722159] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-22T19:46:11.753490] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T19:46:12.522124] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-22T19:46:13.322032] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-22T19:46:13.455914] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T19:46:14.129395] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-22T19:46:14.173217] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T19:46:14.185508] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T19:46:14.910238] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T19:46:14.922033] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-22T19:46:15.722046] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-22T19:46:16.040993] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T19:46:16.522064] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-22T19:46:17.322046] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-22T19:46:17.561583] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T19:46:17.608614] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T19:46:18.122084] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-22T19:46:18.889308] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T19:46:18.922013] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-22T19:46:19.157353] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T19:46:19.160566] [INFO ] [REMOTE ] LEO: Full fetch complete (27115 records). [2025-09-22T19:46:19.160720] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-22T19:46:19.597792] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-22T19:46:19.597922] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-22T19:46:19.598584] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-22T19:46:19.598721] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-22T19:46:19.600071] [DEBUG] [LOCAL ] LEO: Trimmed 27115 records to 17610 (keeping 200 days of data) [2025-09-22T19:46:19.722914] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-22T19:46:19.722820] [DEBUG] [LOCAL ] LEO: Primary data saved (17610 records). [2025-09-22T19:46:19.724077] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-22T19:46:19.724277] [INFO ] [MAIN ] Update Progress: 1253/2372 symbols completed. LEO took 21.0s. Estimated remaining: 2h 28m 29s. Rate: 7.5 symbols/min [2025-09-22T19:46:19.924974] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:46:19.942157] [DEBUG] [LOCAL ] LGI: Loaded 10308 existing records from primary storage. [2025-09-22T19:46:19.942302] [INFO ] [MAIN ] LGI: Loaded 10308 existing records. [2025-09-22T19:46:20.143855] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:46:20.144145] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-22T19:46:20.144203] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-22T19:46:20.144600] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-22T19:46:20.144722] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-22T19:46:20.544522] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-22T19:46:20.551881] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:46:20.590072] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T19:46:20.676734] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T19:46:21.322069] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-22T19:46:22.122070] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-22T19:46:22.400207] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T19:46:22.922070] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-22T19:46:23.111932] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T19:46:23.146525] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T19:46:23.722065] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-22T19:46:24.522026] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-22T19:46:24.568911] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T19:46:24.718789] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T19:46:25.322054] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-22T19:46:25.603539] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T19:46:26.122047] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-22T19:46:26.922052] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-22T19:46:27.146413] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T19:46:27.238433] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T19:46:27.531677] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T19:46:27.722076] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-22T19:46:28.522017] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-22T19:46:28.592541] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-22T19:46:29.322062] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-22T19:46:30.122058] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-22T19:46:30.445811] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T19:46:30.895284] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T19:46:30.921999] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-22T19:46:31.190533] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T19:46:31.722082] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-22T19:46:32.522085] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-22T19:46:32.759813] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T19:46:32.762453] [INFO ] [REMOTE ] LFT: Full fetch complete (23889 records). [2025-09-22T19:46:32.762523] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-22T19:46:32.923887] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-22T19:46:33.188549] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-22T19:46:33.188665] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-22T19:46:33.189193] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-22T19:46:33.189235] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-22T19:46:33.190954] [DEBUG] [LOCAL ] LFT: Trimmed 23889 records to 17970 (keeping 200 days of data) [2025-09-22T19:46:33.307433] [DEBUG] [LOCAL ] LFT: Primary data saved (17970 records). [2025-09-22T19:46:33.307613] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-22T19:46:33.307833] [INFO ] [MAIN ] Update Progress: 1254/2372 symbols completed. LFT took 25.3s. Estimated remaining: 2h 28m 26s. Rate: 7.5 symbols/min [2025-09-22T19:46:33.330145] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-22T19:46:33.487704] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:46:33.537171] [DEBUG] [LOCAL ] LH: Loaded 39293 existing records from primary storage. [2025-09-22T19:46:33.537314] [INFO ] [MAIN ] LH: Loaded 39293 existing records. [2025-09-22T19:46:33.724729] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:46:33.725259] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-22T19:46:33.725318] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-22T19:46:33.726456] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-22T19:46:33.726519] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-22T19:46:34.093450] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:46:34.122009] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-22T19:46:34.137332] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T19:46:34.380567] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T19:46:34.922084] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-22T19:46:35.529272] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T19:46:35.722109] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-22T19:46:35.765701] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T19:46:36.522121] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-22T19:46:37.322057] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-22T19:46:37.887049] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-22T19:46:37.898989] [INFO ] [REMOTE ] LEN: Full fetch complete (76978 records). [2025-09-22T19:46:37.899160] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-22T19:46:38.132608] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-22T19:46:38.312612] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-22T19:46:38.312763] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-22T19:46:38.314026] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-22T19:46:38.314166] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-22T19:46:38.336262] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T19:46:38.343627] [DEBUG] [LOCAL ] LEN: Trimmed 76978 records to 53191 (keeping 200 days of data) [2025-09-22T19:46:38.688941] [DEBUG] [LOCAL ] LEN: Primary data saved (53191 records). [2025-09-22T19:46:38.689085] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-22T19:46:38.689206] [INFO ] [MAIN ] Update Progress: 1255/2372 symbols completed. LEN took 40.3s. Estimated remaining: 2h 28m 16s. Rate: 7.5 symbols/min [2025-09-22T19:46:38.864603] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:46:38.922104] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-22T19:46:38.923974] [DEBUG] [LOCAL ] LHX: Loaded 49633 existing records from primary storage. [2025-09-22T19:46:38.924130] [INFO ] [MAIN ] LHX: Loaded 49633 existing records. [2025-09-22T19:46:39.109081] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:46:39.116440] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-22T19:46:39.116692] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-22T19:46:39.130328] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-22T19:46:39.119045] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T19:46:39.130608] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-22T19:46:39.236055] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T19:46:39.530546] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:46:39.722055] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-22T19:46:40.484434] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T19:46:40.515814] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T19:46:40.522007] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-22T19:46:41.322030] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-22T19:46:41.341918] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T19:46:42.122126] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-22T19:46:42.922077] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-22T19:46:42.956139] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T19:46:43.477845] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T19:46:43.722021] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-22T19:46:43.976242] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T19:46:43.984357] [INFO ] [REMOTE ] LEVI: Full fetch complete (74436 records). [2025-09-22T19:46:43.984493] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-22T19:46:44.385502] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-22T19:46:44.385584] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-22T19:46:44.386556] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-22T19:46:44.386622] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-22T19:46:44.388080] [DEBUG] [LOCAL ] LEVI: Trimmed 74436 records to 51526 (keeping 200 days of data) [2025-09-22T19:46:44.522601] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-22T19:46:44.643530] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T19:46:44.747106] [DEBUG] [LOCAL ] LEVI: Primary data saved (51526 records). [2025-09-22T19:46:44.747251] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-22T19:46:44.747353] [INFO ] [MAIN ] Update Progress: 1256/2372 symbols completed. LEVI took 41.8s. Estimated remaining: 2h 28m 6s. Rate: 7.5 symbols/min [2025-09-22T19:46:44.918638] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:46:44.947524] [DEBUG] [LOCAL ] LII: Loaded 29065 existing records from primary storage. [2025-09-22T19:46:44.947680] [INFO ] [MAIN ] LII: Loaded 29065 existing records. [2025-09-22T19:46:45.127683] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:46:45.127946] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-22T19:46:45.128015] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-22T19:46:45.128825] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-22T19:46:45.128886] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-22T19:46:45.330089] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-22T19:46:45.500090] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:46:46.057159] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T19:46:46.122130] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-22T19:46:46.450725] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T19:46:46.453066] [INFO ] [REMOTE ] LGI: Full fetch complete (14263 records). [2025-09-22T19:46:46.453192] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-22T19:46:46.937390] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-22T19:46:46.991579] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-22T19:46:46.991692] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-22T19:46:46.992061] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-22T19:46:46.992116] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-22T19:46:46.992728] [DEBUG] [LOCAL ] LGI: Trimmed 14263 records to 10075 (keeping 200 days of data) [2025-09-22T19:46:47.061964] [DEBUG] [LOCAL ] LGI: Primary data saved (10075 records). [2025-09-22T19:46:47.062110] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-22T19:46:47.062197] [INFO ] [MAIN ] Update Progress: 1257/2372 symbols completed. LGI took 27.3s. Estimated remaining: 2h 27m 53s. Rate: 7.5 symbols/min [2025-09-22T19:46:47.257568] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:46:47.307490] [DEBUG] [LOCAL ] LION: Loaded 43038 existing records from primary storage. [2025-09-22T19:46:47.307695] [INFO ] [MAIN ] LION: Loaded 43038 existing records. [2025-09-22T19:46:47.500059] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:46:47.500423] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-22T19:46:47.500493] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-22T19:46:47.506541] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-22T19:46:47.515767] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T19:46:47.515157] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-22T19:46:47.732403] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-22T19:46:47.886397] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:46:48.522105] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-22T19:46:48.663454] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T19:46:49.322110] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-22T19:46:49.358445] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T19:46:49.614170] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T19:46:50.122134] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-22T19:46:50.853970] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T19:46:50.922011] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-22T19:46:51.202370] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T19:46:51.722086] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-22T19:46:52.522039] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-22T19:46:52.639880] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T19:46:52.784507] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T19:46:53.322049] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-22T19:46:53.992719] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T19:46:54.122052] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-22T19:46:54.922035] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-22T19:46:55.052081] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T19:46:55.711395] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T19:46:55.722009] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-22T19:46:55.882099] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T19:46:56.522068] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-22T19:46:57.322069] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-22T19:46:57.504149] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T19:46:57.996374] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T19:46:58.122034] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-22T19:46:58.685290] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T19:46:58.922025] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-22T19:46:59.722020] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-22T19:46:59.724587] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T19:47:00.247639] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T19:47:00.252632] [INFO ] [REMOTE ] LH: Full fetch complete (54842 records). [2025-09-22T19:47:00.252769] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-22T19:47:00.527322] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-22T19:47:00.655069] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-22T19:47:00.655167] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-22T19:47:00.656129] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-22T19:47:00.656194] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-22T19:47:00.657390] [DEBUG] [LOCAL ] LH: Trimmed 54842 records to 38477 (keeping 200 days of data) [2025-09-22T19:47:00.790845] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T19:47:00.945819] [DEBUG] [LOCAL ] LH: Primary data saved (38477 records). [2025-09-22T19:47:00.945984] [INFO ] [MAIN ] LH: Full history saved. [2025-09-22T19:47:00.947675] [INFO ] [MAIN ] Update Progress: 1258/2372 symbols completed. LH took 27.6s. Estimated remaining: 2h 27m 50s. Rate: 7.5 symbols/min [2025-09-22T19:47:01.119200] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:47:01.126456] [DEBUG] [LOCAL ] LITB: Loaded 4328 existing records from primary storage. [2025-09-22T19:47:01.126577] [INFO ] [MAIN ] LITB: Loaded 4328 existing records. [2025-09-22T19:47:01.310102] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:47:01.310375] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-22T19:47:01.310423] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-22T19:47:01.310749] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-22T19:47:01.310809] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-22T19:47:01.331223] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-22T19:47:01.676716] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:47:01.928545] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:47:02.122063] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-22T19:47:02.625898] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-22T19:47:02.922115] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-22T19:47:03.722020] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-22T19:47:04.102741] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-22T19:47:04.341297] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T19:47:04.522093] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-22T19:47:05.061866] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-22T19:47:05.315416] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T19:47:05.325155] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-22T19:47:06.122103] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-22T19:47:06.922086] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-22T19:47:07.194391] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T19:47:07.328285] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T19:47:07.722074] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-22T19:47:08.106510] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T19:47:08.522043] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-22T19:47:09.210810] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T19:47:09.322045] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-22T19:47:09.760483] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T19:47:09.789045] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-22T19:47:10.122055] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-22T19:47:10.922070] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-22T19:47:11.356616] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T19:47:11.375932] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T19:47:11.722098] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-22T19:47:12.522080] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-22T19:47:12.900981] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T19:47:13.140400] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T19:47:13.322061] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-22T19:47:14.122083] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-22T19:47:14.610501] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T19:47:14.615207] [INFO ] [REMOTE ] LII: Full fetch complete (41164 records). [2025-09-22T19:47:14.615297] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-22T19:47:14.927266] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-22T19:47:15.007765] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-22T19:47:15.007847] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-22T19:47:15.008763] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-22T19:47:15.008836] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-22T19:47:15.012737] [DEBUG] [LOCAL ] LII: Trimmed 41164 records to 28510 (keeping 200 days of data) [2025-09-22T19:47:15.194268] [DEBUG] [LOCAL ] LII: Primary data saved (28510 records). [2025-09-22T19:47:15.194416] [INFO ] [MAIN ] LII: Full history saved. [2025-09-22T19:47:15.194504] [INFO ] [MAIN ] Update Progress: 1259/2372 symbols completed. LII took 30.4s. Estimated remaining: 2h 27m 48s. Rate: 7.5 symbols/min [2025-09-22T19:47:15.369867] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:47:15.424735] [DEBUG] [LOCAL ] LLY: Loaded 54077 existing records from primary storage. [2025-09-22T19:47:15.424905] [INFO ] [MAIN ] LLY: Loaded 54077 existing records. [2025-09-22T19:47:15.603354] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:47:15.603637] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-22T19:47:15.603718] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-22T19:47:15.605101] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-22T19:47:15.605161] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-22T19:47:15.727050] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-22T19:47:15.951520] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T19:47:16.019700] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:47:16.021560] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T19:47:16.028631] [INFO ] [REMOTE ] LHX: Full fetch complete (70840 records). [2025-09-22T19:47:16.028758] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-22T19:47:16.413931] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-22T19:47:16.414009] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-22T19:47:16.414923] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-22T19:47:16.414987] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-22T19:47:16.416391] [DEBUG] [LOCAL ] LHX: Trimmed 70840 records to 48812 (keeping 200 days of data) [2025-09-22T19:47:16.522188] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-22T19:47:16.732444] [DEBUG] [LOCAL ] LHX: Primary data saved (48812 records). [2025-09-22T19:47:16.732581] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-22T19:47:16.732686] [INFO ] [MAIN ] Update Progress: 1260/2372 symbols completed. LHX took 38.0s. Estimated remaining: 2h 27m 34s. Rate: 7.5 symbols/min [2025-09-22T19:47:16.904867] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:47:16.958277] [DEBUG] [LOCAL ] LMND: Loaded 52648 existing records from primary storage. [2025-09-22T19:47:16.958445] [INFO ] [MAIN ] LMND: Loaded 52648 existing records. [2025-09-22T19:47:17.138191] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:47:17.138406] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-22T19:47:17.138454] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-22T19:47:17.139578] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-22T19:47:17.139640] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-22T19:47:17.339078] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-22T19:47:17.510999] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:47:17.539806] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T19:47:17.957014] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T19:47:18.122051] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-22T19:47:18.591257] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-22T19:47:18.922015] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-22T19:47:19.020186] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-22T19:47:19.722085] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-22T19:47:20.522077] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-22T19:47:20.636890] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T19:47:21.322071] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-22T19:47:22.122090] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-22T19:47:22.250205] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-22T19:47:22.280266] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:47:22.563050] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-22T19:47:22.922064] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-22T19:47:23.141766] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-22T19:47:23.149344] [INFO ] [REMOTE ] LION: Full fetch complete (53572 records). [2025-09-22T19:47:23.149448] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-22T19:47:23.543240] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-22T19:47:23.543319] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-22T19:47:23.544132] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-22T19:47:23.544195] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-22T19:47:23.545390] [DEBUG] [LOCAL ] LION: Trimmed 53572 records to 42858 (keeping 200 days of data) [2025-09-22T19:47:23.742058] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-22T19:47:23.794496] [DEBUG] [LOCAL ] LION: Primary data saved (42858 records). [2025-09-22T19:47:23.794640] [INFO ] [MAIN ] LION: Full history saved. [2025-09-22T19:47:23.794768] [INFO ] [MAIN ] Update Progress: 1261/2372 symbols completed. LION took 36.7s. Estimated remaining: 2h 27m 26s. Rate: 7.5 symbols/min [2025-09-22T19:47:23.969235] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:47:24.021844] [DEBUG] [LOCAL ] LMT: Loaded 50702 existing records from primary storage. [2025-09-22T19:47:24.022015] [INFO ] [MAIN ] LMT: Loaded 50702 existing records. [2025-09-22T19:47:24.199178] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:47:24.199436] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-22T19:47:24.199485] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-22T19:47:24.200927] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-22T19:47:24.200988] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-22T19:47:24.529200] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-22T19:47:24.559433] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:47:24.899346] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-22T19:47:25.049008] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-22T19:47:25.327062] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-22T19:47:25.332687] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T19:47:26.122065] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-22T19:47:26.922063] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-22T19:47:27.636013] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T19:47:27.637523] [INFO ] [REMOTE ] LITB: Full fetch complete (5546 records). [2025-09-22T19:47:27.637593] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-22T19:47:27.731554] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-22T19:47:28.032630] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-22T19:47:28.032842] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-22T19:47:28.033068] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-22T19:47:28.033206] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-22T19:47:28.033954] [DEBUG] [LOCAL ] LITB: Trimmed 5546 records to 4300 (keeping 200 days of data) [2025-09-22T19:47:28.059467] [DEBUG] [LOCAL ] LITB: Primary data saved (4300 records). [2025-09-22T19:47:28.059900] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-22T19:47:28.060012] [INFO ] [MAIN ] Update Progress: 1262/2372 symbols completed. LITB took 27.1s. Estimated remaining: 2h 27m 14s. Rate: 7.5 symbols/min [2025-09-22T19:47:28.181832] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-22T19:47:28.311372] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:47:28.346054] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-22T19:47:28.399986] [DEBUG] [LOCAL ] LNC: Loaded 52409 existing records from primary storage. [2025-09-22T19:47:28.400185] [INFO ] [MAIN ] LNC: Loaded 52409 existing records. [2025-09-22T19:47:28.527270] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-22T19:47:28.602870] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:47:28.603208] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-22T19:47:28.603261] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-22T19:47:28.604484] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-22T19:47:28.604545] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-22T19:47:28.961378] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:47:29.322031] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-22T19:47:29.717618] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-22T19:47:30.122101] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-22T19:47:30.786081] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T19:47:30.803033] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-22T19:47:30.922094] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-22T19:47:31.722083] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-22T19:47:31.953838] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T19:47:32.516606] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T19:47:32.526023] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-22T19:47:33.322065] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-22T19:47:34.122037] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-22T19:47:34.311241] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-22T19:47:34.478193] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T19:47:34.922070] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-22T19:47:34.976776] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T19:47:35.722088] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-22T19:47:36.109198] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-22T19:47:36.452775] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T19:47:36.522026] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-22T19:47:37.275415] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T19:47:37.322062] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-22T19:47:38.122071] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-22T19:47:38.585685] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-22T19:47:38.707019] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T19:47:38.922084] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-22T19:47:39.722094] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-22T19:47:40.490343] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-22T19:47:40.522305] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-22T19:47:40.909821] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T19:47:41.126759] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T19:47:41.322073] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-22T19:47:42.122075] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-22T19:47:42.350813] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T19:47:42.922020] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-22T19:47:43.031167] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T19:47:43.722086] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-22T19:47:43.835460] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T19:47:44.522102] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-22T19:47:44.808490] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T19:47:45.322010] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-22T19:47:45.394086] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T19:47:46.122057] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-22T19:47:46.309818] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T19:47:46.922062] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-22T19:47:47.599588] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-22T19:47:47.608939] [INFO ] [REMOTE ] LMND: Full fetch complete (75266 records). [2025-09-22T19:47:47.609128] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-22T19:47:47.727153] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-22T19:47:48.014074] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-22T19:47:48.014170] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-22T19:47:48.015189] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-22T19:47:48.015256] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-22T19:47:48.016885] [DEBUG] [LOCAL ] LMND: Trimmed 75266 records to 51870 (keeping 200 days of data) [2025-09-22T19:47:48.358817] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-22T19:47:48.384169] [DEBUG] [LOCAL ] LMND: Primary data saved (51870 records). [2025-09-22T19:47:48.384302] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-22T19:47:48.384383] [INFO ] [MAIN ] Update Progress: 1263/2372 symbols completed. LMND took 31.7s. Estimated remaining: 2h 27m 17s. Rate: 7.5 symbols/min [2025-09-22T19:47:48.528969] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-22T19:47:48.601997] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T19:47:48.600024] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:47:48.620281] [DEBUG] [LOCAL ] LND: Loaded 5257 existing records from primary storage. [2025-09-22T19:47:48.620395] [INFO ] [MAIN ] LND: Loaded 5257 existing records. [2025-09-22T19:47:48.797034] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:47:48.797352] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-22T19:47:48.797418] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-22T19:47:48.798066] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-22T19:47:48.798125] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-22T19:47:49.189619] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:47:49.322066] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-22T19:47:50.021300] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-22T19:47:50.122058] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-22T19:47:50.929197] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-22T19:47:50.933147] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T19:47:50.942745] [INFO ] [REMOTE ] LNC: Full fetch complete (73976 records). [2025-09-22T19:47:50.942943] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-22T19:47:51.392354] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-22T19:47:51.392505] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-22T19:47:51.393768] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-22T19:47:51.393856] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-22T19:47:51.396704] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-22T19:47:51.409358] [DEBUG] [LOCAL ] LNC: Trimmed 73976 records to 51637 (keeping 200 days of data) [2025-09-22T19:47:51.734420] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-22T19:47:51.760566] [DEBUG] [LOCAL ] LNC: Primary data saved (51637 records). [2025-09-22T19:47:51.760795] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-22T19:47:51.761049] [INFO ] [MAIN ] Update Progress: 1264/2372 symbols completed. LNC took 23.7s. Estimated remaining: 2h 27m 5s. Rate: 7.5 symbols/min [2025-09-22T19:47:51.947776] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T19:47:51.951274] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:47:52.012761] [DEBUG] [LOCAL ] LNG: Loaded 52311 existing records from primary storage. [2025-09-22T19:47:52.012942] [INFO ] [MAIN ] LNG: Loaded 52311 existing records. [2025-09-22T19:47:52.194872] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:47:52.195155] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-22T19:47:52.195212] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-22T19:47:52.197222] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-22T19:47:52.197286] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-22T19:47:52.533563] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-22T19:47:52.565960] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:47:52.604941] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-22T19:47:53.291965] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T19:47:53.322006] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-22T19:47:54.122096] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-22T19:47:54.453545] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-22T19:47:54.824382] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-22T19:47:54.922015] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-22T19:47:55.417413] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-22T19:47:55.539413] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T19:47:55.722034] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-22T19:47:56.522061] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-22T19:47:57.322082] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-22T19:47:58.019758] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T19:47:58.089982] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-22T19:47:58.100287] [INFO ] [REMOTE ] LLY: Full fetch complete (77253 records). [2025-09-22T19:47:58.100463] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-22T19:47:58.132445] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-22T19:47:58.519379] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-22T19:47:58.519584] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-22T19:47:58.520762] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-22T19:47:58.520874] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-22T19:47:58.522819] [DEBUG] [LOCAL ] LLY: Trimmed 77253 records to 53294 (keeping 200 days of data) [2025-09-22T19:47:58.662574] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-22T19:47:58.672382] [INFO ] [REMOTE ] LMT: Full fetch complete (72556 records). [2025-09-22T19:47:58.673278] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-22T19:47:58.933594] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-22T19:47:59.113432] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-22T19:47:59.114207] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-22T19:47:59.116080] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-22T19:47:59.116537] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-22T19:47:59.123094] [DEBUG] [LOCAL ] LMT: Trimmed 72556 records to 49955 (keeping 200 days of data) [2025-09-22T19:47:59.575672] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-22T19:47:59.665079] [DEBUG] [LOCAL ] LLY: Primary data saved (53294 records). [2025-09-22T19:47:59.667577] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-22T19:47:59.668090] [INFO ] [MAIN ] Update Progress: 1265/2372 symbols completed. LLY took 44.5s. Estimated remaining: 2h 26m 57s. Rate: 7.5 symbols/min [2025-09-22T19:47:59.734361] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-22T19:47:59.823558] [DEBUG] [LOCAL ] LMT: Primary data saved (49955 records). [2025-09-22T19:47:59.832290] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-22T19:47:59.837527] [INFO ] [MAIN ] Update Progress: 1266/2372 symbols completed. LMT took 36.0s. Estimated remaining: 2h 26m 43s. Rate: 7.5 symbols/min [2025-09-22T19:47:59.888382] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:48:00.039905] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:48:00.040274] [DEBUG] [LOCAL ] LNN: Loaded 11397 existing records from primary storage. [2025-09-22T19:48:00.040563] [INFO ] [MAIN ] LNN: Loaded 11397 existing records. [2025-09-22T19:48:00.229025] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:48:00.229296] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-22T19:48:00.229432] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-22T19:48:00.239422] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-22T19:48:00.239723] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-22T19:48:00.358373] [DEBUG] [LOCAL ] LOAR: Loaded 42056 existing records from primary storage. [2025-09-22T19:48:00.362467] [INFO ] [MAIN ] LOAR: Loaded 42056 existing records. [2025-09-22T19:48:00.617503] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-22T19:48:00.650437] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T19:48:00.723788] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-22T19:48:00.850338] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:48:00.851227] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-22T19:48:00.851336] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-22T19:48:00.857448] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-22T19:48:00.862669] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-22T19:48:01.036249] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:48:01.292108] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:48:01.322000] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-22T19:48:02.122085] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-22T19:48:02.922140] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-22T19:48:03.541582] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-09-22T19:48:03.722171] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-22T19:48:04.052682] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-22T19:48:04.376596] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-22T19:48:04.522017] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-22T19:48:04.789760] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T19:48:05.033040] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-22T19:48:05.322034] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-22T19:48:05.950091] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-22T19:48:06.122039] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-22T19:48:06.325548] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T19:48:06.922064] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-22T19:48:07.722140] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-22T19:48:08.007514] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T19:48:08.071464] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T19:48:08.377135] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T19:48:08.378391] [INFO ] [REMOTE ] LND: Full fetch complete (8885 records). [2025-09-22T19:48:08.378461] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-22T19:48:08.522466] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-22T19:48:08.747748] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-22T19:48:08.747829] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-22T19:48:08.748065] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-22T19:48:08.748105] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-22T19:48:08.748533] [DEBUG] [LOCAL ] LND: Trimmed 8885 records to 5026 (keeping 200 days of data) [2025-09-22T19:48:08.780053] [DEBUG] [LOCAL ] LND: Primary data saved (5026 records). [2025-09-22T19:48:08.780131] [INFO ] [MAIN ] LND: Full history saved. [2025-09-22T19:48:08.780225] [INFO ] [MAIN ] Update Progress: 1267/2372 symbols completed. LND took 20.4s. Estimated remaining: 2h 26m 35s. Rate: 7.5 symbols/min [2025-09-22T19:48:08.959135] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:48:09.001994] [DEBUG] [LOCAL ] LOB: Loaded 27973 existing records from primary storage. [2025-09-22T19:48:09.002130] [INFO ] [MAIN ] LOB: Loaded 27973 existing records. [2025-09-22T19:48:09.178930] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:48:09.179218] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-22T19:48:09.179271] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-22T19:48:09.180082] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-22T19:48:09.180167] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-22T19:48:09.327184] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-22T19:48:09.550791] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:48:09.849134] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T19:48:10.122078] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-22T19:48:10.213404] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T19:48:10.922053] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-22T19:48:11.513905] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T19:48:11.722100] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-22T19:48:12.522081] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-22T19:48:12.588426] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T19:48:12.909934] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T19:48:13.322057] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-22T19:48:14.122136] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-22T19:48:14.751119] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-22T19:48:14.839537] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T19:48:14.922098] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-22T19:48:15.722097] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-22T19:48:15.909353] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T19:48:16.093465] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-22T19:48:16.522017] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-22T19:48:17.322022] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-22T19:48:17.437197] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T19:48:18.122070] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-22T19:48:18.173300] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T19:48:18.393539] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T19:48:18.922086] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-22T19:48:19.698527] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T19:48:19.722005] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-22T19:48:20.522068] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-22T19:48:20.596462] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T19:48:21.180128] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T19:48:21.322057] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-22T19:48:21.671342] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T19:48:22.122092] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-22T19:48:22.801211] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T19:48:22.922022] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-22T19:48:23.260508] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T19:48:23.722080] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-22T19:48:24.032627] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T19:48:24.522063] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-22T19:48:25.322030] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-22T19:48:25.519526] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T19:48:25.527682] [INFO ] [REMOTE ] LNG: Full fetch complete (74660 records). [2025-09-22T19:48:25.527832] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-22T19:48:25.885501] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T19:48:26.004107] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-22T19:48:26.004376] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-22T19:48:26.005423] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-22T19:48:26.005506] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-22T19:48:26.007398] [DEBUG] [LOCAL ] LNG: Trimmed 74660 records to 51517 (keeping 200 days of data) [2025-09-22T19:48:26.129057] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-22T19:48:26.359140] [DEBUG] [LOCAL ] LNG: Primary data saved (51517 records). [2025-09-22T19:48:26.359296] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-22T19:48:26.360889] [INFO ] [MAIN ] Update Progress: 1268/2372 symbols completed. LNG took 34.6s. Estimated remaining: 2h 26m 36s. Rate: 7.5 symbols/min [2025-09-22T19:48:26.546116] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:48:26.554547] [DEBUG] [LOCAL ] LOCL: Loaded 3558 existing records from primary storage. [2025-09-22T19:48:26.554704] [INFO ] [MAIN ] LOCL: Loaded 3558 existing records. [2025-09-22T19:48:26.748304] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:48:26.748771] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-22T19:48:26.748848] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-22T19:48:26.749357] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-22T19:48:26.749515] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-22T19:48:26.927620] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-22T19:48:27.151426] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T19:48:27.149470] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:48:27.409260] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-22T19:48:27.722026] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-22T19:48:28.024102] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T19:48:28.318037] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-22T19:48:28.522046] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-22T19:48:29.322071] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-22T19:48:29.689870] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-22T19:48:30.122098] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-22T19:48:30.308176] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T19:48:30.314879] [INFO ] [REMOTE ] LOAR: Full fetch complete (56281 records). [2025-09-22T19:48:30.315011] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-22T19:48:30.715001] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-22T19:48:30.715126] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-22T19:48:30.715990] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-22T19:48:30.716058] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-22T19:48:30.717402] [DEBUG] [LOCAL ] LOAR: Trimmed 56281 records to 41710 (keeping 200 days of data) [2025-09-22T19:48:30.928740] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-22T19:48:30.965307] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T19:48:30.999364] [DEBUG] [LOCAL ] LOAR: Primary data saved (41710 records). [2025-09-22T19:48:30.999484] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-22T19:48:30.999563] [INFO ] [MAIN ] Update Progress: 1269/2372 symbols completed. LOAR took 31.2s. Estimated remaining: 2h 26m 25s. Rate: 7.5 symbols/min [2025-09-22T19:48:31.172550] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:48:31.205876] [DEBUG] [LOCAL ] LOMA: Loaded 32010 existing records from primary storage. [2025-09-22T19:48:31.206033] [INFO ] [MAIN ] LOMA: Loaded 32010 existing records. [2025-09-22T19:48:31.387213] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-22T19:48:31.400670] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:48:31.400845] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-22T19:48:31.400892] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-22T19:48:31.402068] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-22T19:48:31.402129] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-22T19:48:31.726763] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-22T19:48:31.763542] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:48:32.522043] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-22T19:48:32.834396] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T19:48:33.322114] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-22T19:48:34.092697] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T19:48:34.122099] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-22T19:48:34.154376] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T19:48:34.922092] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-22T19:48:35.505023] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T19:48:35.722076] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-22T19:48:35.805732] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T19:48:35.808771] [INFO ] [REMOTE ] LNN: Full fetch complete (15507 records). [2025-09-22T19:48:35.808877] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-22T19:48:36.195607] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-22T19:48:36.195732] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-22T19:48:36.196082] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-22T19:48:36.196123] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-22T19:48:36.196674] [DEBUG] [LOCAL ] LNN: Trimmed 15507 records to 11247 (keeping 200 days of data) [2025-09-22T19:48:36.272409] [DEBUG] [LOCAL ] LNN: Primary data saved (11247 records). [2025-09-22T19:48:36.272577] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-22T19:48:36.272694] [INFO ] [MAIN ] Update Progress: 1270/2372 symbols completed. LNN took 36.6s. Estimated remaining: 2h 26m 15s. Rate: 7.5 symbols/min [2025-09-22T19:48:36.453325] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:48:36.518053] [DEBUG] [LOCAL ] LOW: Loaded 53729 existing records from primary storage. [2025-09-22T19:48:36.518231] [INFO ] [MAIN ] LOW: Loaded 53729 existing records. [2025-09-22T19:48:36.529412] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-22T19:48:36.709227] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:48:36.709666] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-22T19:48:36.709739] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-22T19:48:36.711243] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-22T19:48:36.711315] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-22T19:48:37.091576] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:48:37.115720] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T19:48:37.322078] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-22T19:48:37.851523] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T19:48:38.122065] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-22T19:48:38.546091] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T19:48:38.922154] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-22T19:48:39.517621] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:48:39.722096] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-22T19:48:40.522093] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-22T19:48:40.614130] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T19:48:40.969763] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-22T19:48:40.984061] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T19:48:40.988781] [INFO ] [REMOTE ] LOB: Full fetch complete (37510 records). [2025-09-22T19:48:40.988879] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-22T19:48:41.332997] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-22T19:48:41.385623] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-22T19:48:41.385748] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-22T19:48:41.386539] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-22T19:48:41.386609] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-22T19:48:41.387635] [DEBUG] [LOCAL ] LOB: Trimmed 37510 records to 27551 (keeping 200 days of data) [2025-09-22T19:48:41.568674] [DEBUG] [LOCAL ] LOB: Primary data saved (27551 records). [2025-09-22T19:48:41.568876] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-22T19:48:41.568992] [INFO ] [MAIN ] Update Progress: 1271/2372 symbols completed. LOB took 32.8s. Estimated remaining: 2h 26m 4s. Rate: 7.5 symbols/min [2025-09-22T19:48:41.752729] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:48:41.797383] [DEBUG] [LOCAL ] LPG: Loaded 40939 existing records from primary storage. [2025-09-22T19:48:41.797527] [INFO ] [MAIN ] LPG: Loaded 40939 existing records. [2025-09-22T19:48:41.976946] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:48:41.977230] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-22T19:48:41.977294] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-22T19:48:41.978538] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-22T19:48:41.978599] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-22T19:48:42.129992] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-22T19:48:42.371739] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:48:42.568539] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-22T19:48:42.922071] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-22T19:48:42.984147] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-22T19:48:43.722092] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-22T19:48:44.007063] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T19:48:44.051724] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-22T19:48:44.522070] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-22T19:48:44.953830] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-22T19:48:45.322073] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-22T19:48:45.776831] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-22T19:48:46.122055] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-22T19:48:46.922051] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-22T19:48:47.364751] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T19:48:47.722054] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-22T19:48:48.197200] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-22T19:48:48.400501] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T19:48:48.522077] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-22T19:48:49.277458] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T19:48:49.279045] [INFO ] [REMOTE ] LOCL: Full fetch complete (4825 records). [2025-09-22T19:48:49.279116] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-22T19:48:49.331967] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-22T19:48:49.646287] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-22T19:48:49.646376] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-22T19:48:49.646555] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-22T19:48:49.646593] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-22T19:48:49.646994] [DEBUG] [LOCAL ] LOCL: Trimmed 4825 records to 3572 (keeping 200 days of data) [2025-09-22T19:48:49.667223] [DEBUG] [LOCAL ] LOCL: Primary data saved (3572 records). [2025-09-22T19:48:49.667313] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-22T19:48:49.667392] [INFO ] [MAIN ] Update Progress: 1272/2372 symbols completed. LOCL took 23.3s. Estimated remaining: 2h 25m 57s. Rate: 7.5 symbols/min [2025-09-22T19:48:49.867156] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:48:49.902925] [DEBUG] [LOCAL ] LPL: Loaded 25507 existing records from primary storage. [2025-09-22T19:48:49.903079] [INFO ] [MAIN ] LPL: Loaded 25507 existing records. [2025-09-22T19:48:50.082260] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:48:50.082532] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-22T19:48:50.082580] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-22T19:48:50.083199] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-22T19:48:50.083261] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-22T19:48:50.127188] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-22T19:48:50.463868] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:48:50.922043] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-22T19:48:51.252077] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T19:48:51.722012] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-22T19:48:51.824201] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T19:48:51.996031] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T19:48:52.522048] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-22T19:48:53.322038] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-22T19:48:53.384704] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T19:48:53.729832] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-22T19:48:54.122067] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-22T19:48:54.526802] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T19:48:54.922059] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-22T19:48:55.722075] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-22T19:48:56.110112] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T19:48:56.401502] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T19:48:56.522020] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-22T19:48:56.995526] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T19:48:57.322052] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-22T19:48:58.122958] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T19:48:58.122085] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-22T19:48:58.795773] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T19:48:58.802468] [INFO ] [REMOTE ] LOMA: Full fetch complete (48087 records). [2025-09-22T19:48:58.802564] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-22T19:48:58.927135] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-22T19:48:59.233097] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-22T19:48:59.233224] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-22T19:48:59.234081] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-22T19:48:59.234145] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-22T19:48:59.235273] [DEBUG] [LOCAL ] LOMA: Trimmed 48087 records to 31689 (keeping 200 days of data) [2025-09-22T19:48:59.417665] [DEBUG] [LOCAL ] LOMA: Primary data saved (31689 records). [2025-09-22T19:48:59.417813] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-22T19:48:59.417900] [INFO ] [MAIN ] Update Progress: 1273/2372 symbols completed. LOMA took 28.4s. Estimated remaining: 2h 25m 50s. Rate: 7.5 symbols/min [2025-09-22T19:48:59.588379] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:48:59.626585] [DEBUG] [LOCAL ] LPX: Loaded 40396 existing records from primary storage. [2025-09-22T19:48:59.626784] [INFO ] [MAIN ] LPX: Loaded 40396 existing records. [2025-09-22T19:48:59.727372] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-22T19:48:59.814815] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:48:59.815109] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-22T19:48:59.815188] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-22T19:48:59.816356] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-22T19:48:59.816422] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-22T19:49:00.197726] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:49:00.210845] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T19:49:00.244181] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-22T19:49:00.522096] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-22T19:49:01.320156] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T19:49:01.328549] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-22T19:49:01.347525] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T19:49:02.122112] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-22T19:49:02.904461] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T19:49:02.922029] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-22T19:49:03.256079] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T19:49:03.722107] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-22T19:49:04.146941] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T19:49:04.522050] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-22T19:49:04.903445] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T19:49:05.322056] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-22T19:49:06.122050] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-22T19:49:06.462569] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T19:49:06.716469] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T19:49:06.922041] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-22T19:49:07.172194] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T19:49:07.722048] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-22T19:49:08.522019] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-22T19:49:08.836968] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T19:49:09.124354] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-22T19:49:09.322048] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-22T19:49:10.050458] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T19:49:10.122026] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-22T19:49:10.922035] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-22T19:49:11.327753] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-22T19:49:11.699587] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T19:49:11.722001] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-22T19:49:12.165679] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T19:49:12.522064] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-22T19:49:13.077806] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T19:49:13.322049] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-22T19:49:14.076606] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T19:49:14.122015] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-22T19:49:14.803771] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T19:49:14.922102] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-22T19:49:15.405241] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T19:49:15.411590] [INFO ] [REMOTE ] LPG: Full fetch complete (60065 records). [2025-09-22T19:49:15.411745] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-22T19:49:15.727425] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-22T19:49:15.840838] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-22T19:49:15.840926] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-22T19:49:15.841859] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-22T19:49:15.841922] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-22T19:49:15.843158] [DEBUG] [LOCAL ] LPG: Trimmed 60065 records to 40243 (keeping 200 days of data) [2025-09-22T19:49:16.094272] [DEBUG] [LOCAL ] LPG: Primary data saved (40243 records). [2025-09-22T19:49:16.094412] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-22T19:49:16.094496] [INFO ] [MAIN ] Update Progress: 1274/2372 symbols completed. LPG took 34.5s. Estimated remaining: 2h 25m 50s. Rate: 7.5 symbols/min [2025-09-22T19:49:16.262902] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:49:16.304250] [DEBUG] [LOCAL ] LRN: Loaded 40764 existing records from primary storage. [2025-09-22T19:49:16.304397] [INFO ] [MAIN ] LRN: Loaded 40764 existing records. [2025-09-22T19:49:16.487967] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:49:16.488383] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-22T19:49:16.488458] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-22T19:49:16.489512] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-22T19:49:16.489573] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-22T19:49:16.527249] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-22T19:49:16.855702] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:49:16.909693] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-22T19:49:16.950937] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T19:49:17.322100] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-22T19:49:17.417417] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-22T19:49:18.122073] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-22T19:49:18.922087] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-22T19:49:19.024956] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T19:49:19.033245] [INFO ] [REMOTE ] LOW: Full fetch complete (76468 records). [2025-09-22T19:49:19.033379] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-22T19:49:19.457116] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-22T19:49:19.457312] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-22T19:49:19.458539] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-22T19:49:19.458683] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-22T19:49:19.482344] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T19:49:19.490404] [DEBUG] [LOCAL ] LOW: Trimmed 76468 records to 52956 (keeping 200 days of data) [2025-09-22T19:49:19.722253] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-22T19:49:19.847226] [DEBUG] [LOCAL ] LOW: Primary data saved (52956 records). [2025-09-22T19:49:19.847421] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-22T19:49:19.847518] [INFO ] [MAIN ] Update Progress: 1275/2372 symbols completed. LOW took 43.6s. Estimated remaining: 2h 25m 38s. Rate: 7.5 symbols/min [2025-09-22T19:49:20.024443] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:49:20.071420] [DEBUG] [LOCAL ] LSPD: Loaded 44246 existing records from primary storage. [2025-09-22T19:49:20.071598] [INFO ] [MAIN ] LSPD: Loaded 44246 existing records. [2025-09-22T19:49:20.256380] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:49:20.256927] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-22T19:49:20.257004] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-22T19:49:20.257973] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-22T19:49:20.258035] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-22T19:49:20.529841] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-22T19:49:20.545205] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-22T19:49:20.668445] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:49:20.913855] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T19:49:21.322086] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-22T19:49:22.050741] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T19:49:22.122045] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-22T19:49:22.922067] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-22T19:49:23.065534] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T19:49:23.570588] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T19:49:23.722098] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-22T19:49:24.402869] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T19:49:24.522108] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-22T19:49:25.300852] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T19:49:25.307143] [INFO ] [REMOTE ] LPX: Full fetch complete (58361 records). [2025-09-22T19:49:25.307261] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-22T19:49:25.329175] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-22T19:49:25.712378] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-22T19:49:25.712502] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-22T19:49:25.713684] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-22T19:49:25.713800] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-22T19:49:25.732582] [DEBUG] [LOCAL ] LPX: Trimmed 58361 records to 39748 (keeping 200 days of data) [2025-09-22T19:49:25.736899] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T19:49:25.990588] [DEBUG] [LOCAL ] LPX: Primary data saved (39748 records). [2025-09-22T19:49:25.990779] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-22T19:49:25.990896] [INFO ] [MAIN ] Update Progress: 1276/2372 symbols completed. LPX took 26.6s. Estimated remaining: 2h 25m 29s. Rate: 7.5 symbols/min [2025-09-22T19:49:26.131723] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-22T19:49:26.166159] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:49:26.197360] [DEBUG] [LOCAL ] LTC: Loaded 30403 existing records from primary storage. [2025-09-22T19:49:26.197500] [INFO ] [MAIN ] LTC: Loaded 30403 existing records. [2025-09-22T19:49:26.393358] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:49:26.393756] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-22T19:49:26.393835] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-22T19:49:26.394577] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-22T19:49:26.394682] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-22T19:49:26.817882] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:49:26.922113] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-22T19:49:26.967132] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T19:49:26.974450] [INFO ] [REMOTE ] LPL: Full fetch complete (34376 records). [2025-09-22T19:49:26.974634] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-22T19:49:27.519307] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-22T19:49:27.519416] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-22T19:49:27.520286] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-22T19:49:27.520357] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-22T19:49:27.521564] [DEBUG] [LOCAL ] LPL: Trimmed 34376 records to 25401 (keeping 200 days of data) [2025-09-22T19:49:27.683801] [DEBUG] [LOCAL ] LPL: Primary data saved (25401 records). [2025-09-22T19:49:27.683975] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-22T19:49:27.684074] [INFO ] [MAIN ] Update Progress: 1277/2372 symbols completed. LPL took 38.0s. Estimated remaining: 2h 25m 15s. Rate: 7.5 symbols/min [2025-09-22T19:49:27.722142] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-22T19:49:27.725932] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T19:49:28.258950] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T19:49:28.522128] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-22T19:49:28.794797] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T19:49:29.322059] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-22T19:49:29.795331] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T19:49:30.122033] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-22T19:49:30.619864] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T19:49:30.922078] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-22T19:49:31.602863] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T19:49:31.722074] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-22T19:49:32.112897] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T19:49:32.522140] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-22T19:49:33.317183] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T19:49:33.325000] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-22T19:49:33.858392] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T19:49:34.122058] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-22T19:49:34.922070] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-22T19:49:34.964437] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T19:49:35.488392] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T19:49:35.722125] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-22T19:49:36.428109] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T19:49:36.522052] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-22T19:49:37.073362] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T19:49:37.322057] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-22T19:49:38.047275] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T19:49:38.122013] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-22T19:49:38.502807] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T19:49:38.922068] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-22T19:49:39.530336] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T19:49:39.536723] [INFO ] [REMOTE ] LRN: Full fetch complete (58377 records). [2025-09-22T19:49:39.536837] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-22T19:49:39.722987] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-22T19:49:39.935903] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-22T19:49:39.936029] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-22T19:49:39.936959] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-22T19:49:39.937025] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-22T19:49:39.938425] [DEBUG] [LOCAL ] LRN: Trimmed 58377 records to 40065 (keeping 200 days of data) [2025-09-22T19:49:40.190462] [DEBUG] [LOCAL ] LRN: Primary data saved (40065 records). [2025-09-22T19:49:40.190595] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-22T19:49:40.190702] [INFO ] [MAIN ] Update Progress: 1278/2372 symbols completed. LRN took 24.1s. Estimated remaining: 2h 25m 11s. Rate: 7.5 symbols/min [2025-09-22T19:49:40.520204] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T19:49:40.530371] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-22T19:49:41.037013] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T19:49:41.322051] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-22T19:49:42.020610] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T19:49:42.122011] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-22T19:49:42.681192] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T19:49:42.922113] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-22T19:49:43.695458] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T19:49:43.722068] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-22T19:49:44.073527] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T19:49:44.079154] [INFO ] [REMOTE ] LTC: Full fetch complete (42775 records). [2025-09-22T19:49:44.079303] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-22T19:49:44.459330] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-22T19:49:44.459416] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-22T19:49:44.460181] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-22T19:49:44.460246] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-22T19:49:44.461293] [DEBUG] [LOCAL ] LTC: Trimmed 42775 records to 29864 (keeping 200 days of data) [2025-09-22T19:49:44.654292] [DEBUG] [LOCAL ] LTC: Primary data saved (29864 records). [2025-09-22T19:49:44.654456] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-22T19:49:44.654565] [INFO ] [MAIN ] Update Progress: 1279/2372 symbols completed. LTC took 18.7s. Estimated remaining: 2h 25m 0s. Rate: 7.5 symbols/min [2025-09-22T19:49:44.926311] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T19:49:44.935344] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-22T19:49:46.443739] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T19:49:46.452525] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-22T19:49:48.097733] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T19:49:48.104469] [INFO ] [REMOTE ] LSPD: Full fetch complete (61655 records). [2025-09-22T19:49:48.104630] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-22T19:49:48.491703] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-22T19:49:48.491790] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-22T19:49:48.492633] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-22T19:49:48.492725] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-22T19:49:48.493965] [DEBUG] [LOCAL ] LSPD: Trimmed 61655 records to 43453 (keeping 200 days of data) [2025-09-22T19:49:48.748491] [DEBUG] [LOCAL ] LSPD: Primary data saved (43453 records). [2025-09-22T19:49:48.748626] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-22T19:49:48.748745] [INFO ] [MAIN ] Update Progress: 1280/2372 symbols completed. LSPD took 28.9s. Estimated remaining: 2h 24m 49s. Rate: 7.5 symbols/min [2025-09-22T19:49:49.411084] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:49:49.407179] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:49:49.424846] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-22T19:49:49.465560] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:49:49.466440] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:49:49.427633] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-22T19:49:49.467541] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-22T19:49:49.467666] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-22T19:49:49.467778] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-22T19:49:49.468040] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-22T19:49:49.744701] [DEBUG] [LOCAL ] LU: Loaded 49686 existing records from primary storage. [2025-09-22T19:49:49.755495] [INFO ] [MAIN ] LU: Loaded 49686 existing records. [2025-09-22T19:49:49.975415] [DEBUG] [LOCAL ] LTM: Loaded 36215 existing records from primary storage. [2025-09-22T19:49:49.975588] [DEBUG] [LOCAL ] LTH: Loaded 52690 existing records from primary storage. [2025-09-22T19:49:49.979623] [INFO ] [MAIN ] LTM: Loaded 36215 existing records. [2025-09-22T19:49:49.979525] [INFO ] [MAIN ] LTH: Loaded 52690 existing records. [2025-09-22T19:49:50.287042] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:49:50.283763] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:49:50.297765] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-22T19:49:50.332807] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-22T19:49:50.343340] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-22T19:49:50.365191] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-22T19:49:50.381500] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-22T19:49:50.604221] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:49:50.596993] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:49:50.633510] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-22T19:49:50.633399] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-22T19:49:50.633691] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-22T19:49:50.633732] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-22T19:49:50.640093] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-22T19:49:50.640212] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-22T19:49:50.640046] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-22T19:49:50.640344] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-22T19:49:51.458055] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:49:51.488948] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-22T19:49:51.603743] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:49:51.676308] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-22T19:49:51.676001] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:49:51.688267] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-22T19:49:51.692038] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T19:49:51.697301] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-22T19:49:52.729870] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T19:49:52.734618] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-22T19:49:53.079165] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T19:49:53.091056] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-22T19:49:53.206905] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T19:49:53.216809] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-22T19:49:53.286513] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T19:49:53.296227] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-22T19:49:53.960514] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T19:49:53.965834] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-22T19:49:54.402159] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T19:49:54.409883] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-22T19:49:54.457307] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T19:49:54.757112] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T19:49:54.802574] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T19:49:54.922057] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-22T19:49:55.662465] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-22T19:49:55.722005] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-22T19:49:55.858789] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-22T19:49:56.522099] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-22T19:49:56.901336] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T19:49:57.322059] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-22T19:49:57.747950] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T19:49:58.122026] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-22T19:49:58.554669] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T19:49:58.922112] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-22T19:49:59.506173] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T19:49:59.722070] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-22T19:50:00.422990] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T19:50:00.522075] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-22T19:50:00.857994] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T19:50:01.322076] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-22T19:50:01.836627] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T19:50:02.122147] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-22T19:50:02.475987] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T19:50:02.922106] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-22T19:50:03.722130] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-22T19:50:03.836934] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T19:50:03.994266] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T19:50:04.522144] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-22T19:50:04.932030] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-22T19:50:05.322101] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-22T19:50:05.704466] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T19:50:05.709072] [INFO ] [REMOTE ] LUCK: Full fetch complete (39990 records). [2025-09-22T19:50:05.709290] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-22T19:50:05.910220] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-22T19:50:05.910771] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:50:05.910862] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:50:05.910956] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-22T19:50:05.911081] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-22T19:50:05.911154] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-22T19:50:05.911269] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-22T19:50:05.911487] [INFO ] [MAIN ] Update Progress: 1281/2372 symbols completed. LUCK took 17.2s. Estimated remaining: 2h 24m 49s. Rate: 7.5 symbols/min [2025-09-22T19:50:06.094094] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:50:06.122089] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-22T19:50:06.172278] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-22T19:50:06.172533] [INFO ] [MAIN ] LUMN: Loaded 54414 existing records. [2025-09-22T19:50:06.355622] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:50:06.355889] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-22T19:50:06.355936] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-22T19:50:06.357422] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-22T19:50:06.357499] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-22T19:50:06.739378] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:50:06.771216] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T19:50:06.922063] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-22T19:50:07.694400] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T19:50:07.722003] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-22T19:50:08.221921] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T19:50:08.522065] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-22T19:50:09.322037] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-22T19:50:09.507893] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T19:50:10.122090] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-22T19:50:10.640601] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-22T19:50:10.922064] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-22T19:50:11.249377] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T19:50:11.257892] [INFO ] [REMOTE ] LTM: Full fetch complete (46670 records). [2025-09-22T19:50:11.258024] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-22T19:50:11.718007] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-22T19:50:11.718117] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-22T19:50:11.718981] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-22T19:50:11.719100] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-22T19:50:11.730507] [DEBUG] [LOCAL ] LTM: Trimmed 46670 records to 36009 (keeping 200 days of data) [2025-09-22T19:50:11.730303] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-22T19:50:11.753047] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T19:50:11.977217] [DEBUG] [LOCAL ] LTM: Primary data saved (36009 records). [2025-09-22T19:50:11.977368] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-22T19:50:11.977460] [INFO ] [MAIN ] Update Progress: 1282/2372 symbols completed. LTM took 23.2s. Estimated remaining: 2h 24m 39s. Rate: 7.5 symbols/min [2025-09-22T19:50:12.144820] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:50:12.205386] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-22T19:50:12.205564] [INFO ] [MAIN ] LUV: Loaded 54469 existing records. [2025-09-22T19:50:12.380407] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:50:12.380716] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-22T19:50:12.380773] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-22T19:50:12.382509] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-22T19:50:12.382570] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-22T19:50:12.527280] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-22T19:50:12.745352] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:50:12.892877] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-22T19:50:13.153448] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T19:50:13.322060] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-22T19:50:14.122024] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-22T19:50:14.294347] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T19:50:14.922087] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-22T19:50:15.209777] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T19:50:15.722028] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-22T19:50:15.855725] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T19:50:16.364319] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T19:50:16.522100] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-22T19:50:17.270813] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T19:50:17.322063] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-22T19:50:17.893795] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T19:50:18.122095] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-22T19:50:18.922032] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-22T19:50:19.107352] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T19:50:19.671914] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T19:50:19.722053] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-22T19:50:20.522016] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-22T19:50:20.584120] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T19:50:21.322035] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-22T19:50:21.389845] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T19:50:21.834580] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T19:50:21.842624] [INFO ] [REMOTE ] LU: Full fetch complete (70442 records). [2025-09-22T19:50:21.842825] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-22T19:50:22.127256] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-22T19:50:22.249251] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-22T19:50:22.249580] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-22T19:50:22.250584] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-22T19:50:22.250671] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-22T19:50:22.257083] [DEBUG] [LOCAL ] LU: Trimmed 70442 records to 48994 (keeping 200 days of data) [2025-09-22T19:50:22.543738] [DEBUG] [LOCAL ] LU: Primary data saved (48994 records). [2025-09-22T19:50:22.543886] [INFO ] [MAIN ] LU: Full history saved. [2025-09-22T19:50:22.544057] [INFO ] [MAIN ] Update Progress: 1283/2372 symbols completed. LU took 33.8s. Estimated remaining: 2h 24m 34s. Rate: 7.5 symbols/min [2025-09-22T19:50:22.717659] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:50:22.717863] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-22T19:50:22.717997] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-22T19:50:22.718113] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-22T19:50:22.718152] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-22T19:50:22.718194] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-22T19:50:22.718226] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-22T19:50:22.929245] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-22T19:50:23.089101] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:50:23.184299] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T19:50:23.722064] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-22T19:50:23.912352] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T19:50:23.927371] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:50:23.928373] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-22T19:50:24.522041] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-22T19:50:24.785854] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:50:24.786172] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-22T19:50:24.946858] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-22T19:50:25.322057] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-22T19:50:26.122061] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-22T19:50:26.922074] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-22T19:50:27.234898] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T19:50:27.599871] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T19:50:27.608763] [INFO ] [REMOTE ] LTH: Full fetch complete (73825 records). [2025-09-22T19:50:27.608928] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-22T19:50:27.727359] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-22T19:50:28.043137] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-22T19:50:28.043234] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-22T19:50:28.044248] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-22T19:50:28.044319] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-22T19:50:28.046499] [DEBUG] [LOCAL ] LTH: Trimmed 73825 records to 51890 (keeping 200 days of data) [2025-09-22T19:50:28.367623] [DEBUG] [LOCAL ] LTH: Primary data saved (51890 records). [2025-09-22T19:50:28.367809] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-22T19:50:28.367945] [INFO ] [MAIN ] Update Progress: 1284/2372 symbols completed. LTH took 39.6s. Estimated remaining: 2h 24m 24s. Rate: 7.5 symbols/min [2025-09-22T19:50:28.522197] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-22T19:50:28.540557] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:50:28.601170] [DEBUG] [LOCAL ] LVS: Loaded 54347 existing records from primary storage. [2025-09-22T19:50:28.601375] [INFO ] [MAIN ] LVS: Loaded 54347 existing records. [2025-09-22T19:50:28.778970] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:50:28.779289] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-22T19:50:28.779338] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-22T19:50:28.780949] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-22T19:50:28.781012] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-22T19:50:28.812733] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:50:28.863707] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-22T19:50:29.149496] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:50:29.183466] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-22T19:50:29.322025] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-22T19:50:29.769520] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-22T19:50:30.122098] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-22T19:50:30.317894] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:50:30.318214] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-22T19:50:30.922086] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-22T19:50:31.251664] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T19:50:31.722046] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-22T19:50:32.522043] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-22T19:50:32.678251] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T19:50:33.322060] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-22T19:50:33.492250] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T19:50:33.523193] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:50:33.523490] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-22T19:50:34.122049] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-22T19:50:34.309923] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T19:50:34.922057] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-22T19:50:35.152137] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T19:50:35.722072] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-22T19:50:36.522082] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-22T19:50:36.931712] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-22T19:50:37.322082] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-22T19:50:37.682548] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T19:50:38.122029] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-22T19:50:38.201566] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T19:50:38.387288] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T19:50:38.922069] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-22T19:50:39.722138] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-22T19:50:40.110333] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-22T19:50:40.522062] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-22T19:50:40.946496] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T19:50:41.296507] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T19:50:41.322011] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-22T19:50:41.565615] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T19:50:41.898279] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T19:50:42.122044] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-22T19:50:42.922058] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-22T19:50:43.722059] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-22T19:50:44.342469] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-22T19:50:44.351288] [INFO ] [REMOTE ] LUMN: Full fetch complete (77634 records). [2025-09-22T19:50:44.351428] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-22T19:50:44.523044] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-22T19:50:44.766562] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-22T19:50:44.766745] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-22T19:50:44.767857] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-22T19:50:44.767955] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-22T19:50:44.769499] [DEBUG] [LOCAL ] LUMN: Trimmed 77634 records to 53634 (keeping 200 days of data) [2025-09-22T19:50:44.907241] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-22T19:50:44.918149] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-22T19:50:44.919446] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-22T19:50:45.440915] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-22T19:50:45.441605] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-22T19:50:45.443103] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-22T19:50:45.443784] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-22T19:50:45.449588] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 53689 (keeping 200 days of data) [2025-09-22T19:50:45.663367] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T19:50:45.681103] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-22T19:50:45.711224] [DEBUG] [LOCAL ] LUMN: Primary data saved (53634 records). [2025-09-22T19:50:45.711838] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-22T19:50:45.711963] [INFO ] [MAIN ] Update Progress: 1285/2372 symbols completed. LUMN took 39.8s. Estimated remaining: 2h 24m 24s. Rate: 7.5 symbols/min [2025-09-22T19:50:45.994055] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:50:46.017587] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T19:50:46.030118] [INFO ] [REMOTE ] LUXE: Full fetch complete (12855 records). [2025-09-22T19:50:46.041089] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-22T19:50:46.041465] [DEBUG] [LOCAL ] LVWR: Loaded 17439 existing records from primary storage. [2025-09-22T19:50:46.048019] [INFO ] [MAIN ] LVWR: Loaded 17439 existing records. [2025-09-22T19:50:46.446446] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 99 unique days, need 200 days [2025-09-22T19:50:46.452257] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:50:46.470880] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:50:46.495199] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-22T19:50:46.496233] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-22T19:50:46.496570] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-22T19:50:46.497215] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-22T19:50:46.496038] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:50:46.497921] [INFO ] [MAIN ] Update Progress: 1286/2372 symbols completed. LUXE took 24.0s. Estimated remaining: 2h 24m 10s. Rate: 7.5 symbols/min [2025-09-22T19:50:46.498948] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-22T19:50:46.499506] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-22T19:50:46.511369] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-22T19:50:46.532043] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-22T19:50:46.926044] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:50:47.211188] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:50:47.212540] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-22T19:50:47.237784] [DEBUG] [LOCAL ] LW: Loaded 52035 existing records from primary storage. [2025-09-22T19:50:47.238736] [INFO ] [MAIN ] LW: Loaded 52035 existing records. [2025-09-22T19:50:47.346133] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-09-22T19:50:47.351986] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-22T19:50:47.357221] [INFO ] [MAIN ] Update Progress: 1287/2372 symbols completed. LUV took 35.4s. Estimated remaining: 2h 23m 56s. Rate: 7.5 symbols/min [2025-09-22T19:50:47.501987] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:50:47.526831] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-22T19:50:47.526952] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-22T19:50:47.544692] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-22T19:50:47.560426] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-22T19:50:47.655472] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:50:47.818958] [DEBUG] [LOCAL ] LXFR: Loaded 17450 existing records from primary storage. [2025-09-22T19:50:47.819937] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-22T19:50:47.835119] [INFO ] [MAIN ] LXFR: Loaded 17450 existing records. [2025-09-22T19:50:47.853560] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-22T19:50:48.242698] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:50:48.249475] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-22T19:50:48.249043] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:50:48.254127] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-22T19:50:48.254588] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-22T19:50:48.270567] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-22T19:50:48.271624] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-22T19:50:48.271727] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-22T19:50:48.530052] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-22T19:50:48.638780] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T19:50:48.644574] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:50:49.322052] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-22T19:50:49.894147] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T19:50:49.996083] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T19:50:50.122030] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-22T19:50:50.297257] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T19:50:50.749469] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T19:50:50.922059] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-22T19:50:51.722057] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-22T19:50:52.292610] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-22T19:50:52.522015] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-22T19:50:52.631701] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T19:50:53.322019] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-22T19:50:53.659809] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T19:50:54.122053] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-22T19:50:54.922019] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-22T19:50:54.989418] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T19:50:55.722026] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-22T19:50:55.790251] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T19:50:56.522042] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-22T19:50:56.739967] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T19:50:56.861905] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T19:50:57.322056] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-22T19:50:57.640944] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T19:50:58.122083] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-22T19:50:58.387581] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T19:50:58.922062] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-22T19:50:59.170058] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T19:50:59.722052] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-22T19:51:00.522032] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-22T19:51:00.574967] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T19:51:00.673260] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T19:51:01.322067] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-22T19:51:01.666539] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T19:51:01.670524] [INFO ] [REMOTE ] LVWR: Full fetch complete (19709 records). [2025-09-22T19:51:01.670614] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-22T19:51:02.074839] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-22T19:51:02.074927] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-22T19:51:02.075483] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-22T19:51:02.075546] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-22T19:51:02.076284] [DEBUG] [LOCAL ] LVWR: Trimmed 19709 records to 17418 (keeping 200 days of data) [2025-09-22T19:51:02.124546] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-22T19:51:02.182408] [DEBUG] [LOCAL ] LVWR: Primary data saved (17418 records). [2025-09-22T19:51:02.182619] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-22T19:51:02.182775] [INFO ] [MAIN ] Update Progress: 1288/2372 symbols completed. LVWR took 16.5s. Estimated remaining: 2h 23m 54s. Rate: 7.5 symbols/min [2025-09-22T19:51:02.358855] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:51:02.411096] [DEBUG] [LOCAL ] LXP: Loaded 51359 existing records from primary storage. [2025-09-22T19:51:02.411262] [INFO ] [MAIN ] LXP: Loaded 51359 existing records. [2025-09-22T19:51:02.591504] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:51:02.591834] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-22T19:51:02.591885] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-22T19:51:02.593279] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-22T19:51:02.593341] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-22T19:51:02.924995] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-22T19:51:02.941050] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T19:51:02.972846] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:51:03.722096] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-22T19:51:04.522056] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-22T19:51:05.481868] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T19:51:05.486878] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-22T19:51:05.577113] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (3.45 seconds). [2025-09-22T19:51:05.715807] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-09-22T19:51:06.142998] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-22T19:51:06.164631] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T19:51:06.494313] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T19:51:06.922099] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-22T19:51:07.722056] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-22T19:51:07.949573] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T19:51:08.500149] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T19:51:08.522009] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-22T19:51:09.322097] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-22T19:51:09.375132] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T19:51:09.383442] [INFO ] [REMOTE ] LVS: Full fetch complete (77515 records). [2025-09-22T19:51:09.383604] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-22T19:51:09.776976] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-22T19:51:09.777095] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-22T19:51:09.778125] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-22T19:51:09.778190] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-22T19:51:09.779725] [DEBUG] [LOCAL ] LVS: Trimmed 77515 records to 53567 (keeping 200 days of data) [2025-09-22T19:51:10.124956] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-22T19:51:10.132250] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T19:51:10.153357] [DEBUG] [LOCAL ] LVS: Primary data saved (53567 records). [2025-09-22T19:51:10.153508] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-22T19:51:10.153673] [INFO ] [MAIN ] Update Progress: 1289/2372 symbols completed. LVS took 41.8s. Estimated remaining: 2h 23m 46s. Rate: 7.5 symbols/min [2025-09-22T19:51:10.325237] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:51:10.356235] [DEBUG] [LOCAL ] LXU: Loaded 32691 existing records from primary storage. [2025-09-22T19:51:10.356370] [INFO ] [MAIN ] LXU: Loaded 32691 existing records. [2025-09-22T19:51:10.538696] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:51:10.538995] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-22T19:51:10.539048] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-22T19:51:10.540069] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-22T19:51:10.540130] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-22T19:51:10.903347] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:51:10.922003] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-22T19:51:10.987629] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T19:51:11.148532] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T19:51:11.722093] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-22T19:51:11.985229] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T19:51:12.522035] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-22T19:51:12.745216] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T19:51:13.322073] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-22T19:51:13.965728] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T19:51:14.122081] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-22T19:51:14.213683] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T19:51:14.922109] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-22T19:51:15.722123] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-22T19:51:15.930241] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T19:51:16.522044] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-22T19:51:16.603431] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T19:51:16.779677] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T19:51:16.782503] [INFO ] [REMOTE ] LXFR: Full fetch complete (25064 records). [2025-09-22T19:51:16.782586] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-22T19:51:17.180275] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-22T19:51:17.180371] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-22T19:51:17.180901] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-22T19:51:17.180962] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-22T19:51:17.181613] [DEBUG] [LOCAL ] LXFR: Trimmed 25064 records to 17038 (keeping 200 days of data) [2025-09-22T19:51:17.286608] [DEBUG] [LOCAL ] LXFR: Primary data saved (17038 records). [2025-09-22T19:51:17.286801] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-22T19:51:17.286904] [INFO ] [MAIN ] Update Progress: 1290/2372 symbols completed. LXFR took 29.9s. Estimated remaining: 2h 23m 37s. Rate: 7.5 symbols/min [2025-09-22T19:51:17.330556] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-22T19:51:17.459688] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:51:17.511193] [DEBUG] [LOCAL ] LYB: Loaded 54378 existing records from primary storage. [2025-09-22T19:51:17.511363] [INFO ] [MAIN ] LYB: Loaded 54378 existing records. [2025-09-22T19:51:17.686856] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:51:17.687148] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-22T19:51:17.687196] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-22T19:51:17.688518] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-22T19:51:17.688579] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-22T19:51:18.054761] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:51:18.122054] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-22T19:51:18.232457] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T19:51:18.922079] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-22T19:51:19.070595] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T19:51:19.722158] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-22T19:51:19.908630] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T19:51:20.325017] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T19:51:20.472852] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-22T19:51:20.522098] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-22T19:51:21.322099] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-22T19:51:22.122112] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-22T19:51:22.181372] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T19:51:22.550728] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T19:51:22.922077] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-22T19:51:23.722066] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-22T19:51:23.805139] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T19:51:23.813108] [INFO ] [REMOTE ] LW: Full fetch complete (74624 records). [2025-09-22T19:51:23.813241] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-22T19:51:24.203017] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-22T19:51:24.203105] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-22T19:51:24.204081] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-22T19:51:24.204146] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-22T19:51:24.205757] [DEBUG] [LOCAL ] LW: Trimmed 74624 records to 51236 (keeping 200 days of data) [2025-09-22T19:51:24.524083] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-22T19:51:24.552187] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T19:51:24.574523] [DEBUG] [LOCAL ] LW: Primary data saved (51236 records). [2025-09-22T19:51:24.574667] [INFO ] [MAIN ] LW: Full history saved. [2025-09-22T19:51:24.574786] [INFO ] [MAIN ] Update Progress: 1291/2372 symbols completed. LW took 38.1s. Estimated remaining: 2h 23m 28s. Rate: 7.5 symbols/min [2025-09-22T19:51:24.758891] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:51:24.816423] [DEBUG] [LOCAL ] LYG: Loaded 53679 existing records from primary storage. [2025-09-22T19:51:24.816739] [INFO ] [MAIN ] LYG: Loaded 53679 existing records. [2025-09-22T19:51:25.009582] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:51:25.010048] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-22T19:51:25.010189] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-22T19:51:25.019909] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-22T19:51:25.033024] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-22T19:51:25.076637] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T19:51:25.327205] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-22T19:51:25.448589] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:51:26.122071] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-22T19:51:26.263042] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T19:51:26.923298] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-22T19:51:26.929812] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T19:51:27.722117] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-22T19:51:27.815201] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T19:51:28.527177] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-22T19:51:28.556544] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T19:51:29.322104] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-22T19:51:29.818990] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-22T19:51:30.122093] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-22T19:51:30.922142] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-22T19:51:31.179816] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-22T19:51:31.413023] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-22T19:51:31.722115] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-22T19:51:31.888423] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T19:51:32.522037] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-22T19:51:32.734495] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T19:51:33.327316] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-22T19:51:33.359693] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T19:51:33.813488] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-22T19:51:34.122073] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-22T19:51:34.922108] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-22T19:51:35.307457] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T19:51:35.427046] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T19:51:35.722048] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-22T19:51:36.522064] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-22T19:51:36.573360] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T19:51:36.584853] [INFO ] [REMOTE ] LXP: Full fetch complete (72411 records). [2025-09-22T19:51:36.585127] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-22T19:51:36.992610] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-22T19:51:36.992730] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-22T19:51:36.993763] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-22T19:51:36.993832] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-22T19:51:36.995522] [DEBUG] [LOCAL ] LXP: Trimmed 72411 records to 50627 (keeping 200 days of data) [2025-09-22T19:51:37.303331] [DEBUG] [LOCAL ] LXP: Primary data saved (50627 records). [2025-09-22T19:51:37.303557] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-22T19:51:37.303758] [INFO ] [MAIN ] Update Progress: 1292/2372 symbols completed. LXP took 35.1s. Estimated remaining: 2h 23m 24s. Rate: 7.5 symbols/min [2025-09-22T19:51:37.327455] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-22T19:51:37.541079] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:51:37.536836] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-22T19:51:37.606799] [DEBUG] [LOCAL ] LYV: Loaded 52036 existing records from primary storage. [2025-09-22T19:51:37.606987] [INFO ] [MAIN ] LYV: Loaded 52036 existing records. [2025-09-22T19:51:37.800867] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:51:37.801132] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-22T19:51:37.801191] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-22T19:51:37.802615] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-22T19:51:37.802712] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-22T19:51:38.129568] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-22T19:51:38.171057] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:51:38.344252] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T19:51:38.575731] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T19:51:38.580248] [INFO ] [REMOTE ] LXU: Full fetch complete (44830 records). [2025-09-22T19:51:38.580370] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-22T19:51:38.929621] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-22T19:51:38.974476] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-22T19:51:38.974568] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-22T19:51:38.975382] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-22T19:51:38.975447] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-22T19:51:38.976599] [DEBUG] [LOCAL ] LXU: Trimmed 44830 records to 32066 (keeping 200 days of data) [2025-09-22T19:51:39.178204] [DEBUG] [LOCAL ] LXU: Primary data saved (32066 records). [2025-09-22T19:51:39.178355] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-22T19:51:39.178453] [INFO ] [MAIN ] Update Progress: 1293/2372 symbols completed. LXU took 29.0s. Estimated remaining: 2h 23m 11s. Rate: 7.5 symbols/min [2025-09-22T19:51:39.366553] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:51:39.402962] [DEBUG] [LOCAL ] LZB: Loaded 36007 existing records from primary storage. [2025-09-22T19:51:39.403125] [INFO ] [MAIN ] LZB: Loaded 36007 existing records. [2025-09-22T19:51:39.580972] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:51:39.581218] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-22T19:51:39.581293] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-22T19:51:39.582356] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-22T19:51:39.582445] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-22T19:51:39.722738] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-22T19:51:39.954085] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:51:39.988280] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T19:51:40.522110] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-22T19:51:40.888128] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T19:51:41.322066] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-22T19:51:41.673337] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T19:51:42.122136] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-22T19:51:42.269195] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T19:51:42.922066] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-22T19:51:43.227207] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T19:51:43.714124] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T19:51:43.723412] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-22T19:51:44.522066] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-22T19:51:44.736497] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T19:51:45.034212] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T19:51:45.322071] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-22T19:51:46.122075] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-22T19:51:46.922166] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-22T19:51:47.125857] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-22T19:51:47.135007] [INFO ] [REMOTE ] LYB: Full fetch complete (77450 records). [2025-09-22T19:51:47.135244] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-22T19:51:47.548357] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-22T19:51:47.560815] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-22T19:51:47.563015] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-22T19:51:47.564335] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-22T19:51:47.564625] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-22T19:51:47.574705] [DEBUG] [LOCAL ] LYB: Trimmed 77450 records to 53598 (keeping 200 days of data) [2025-09-22T19:51:47.760477] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-22T19:51:47.925468] [DEBUG] [LOCAL ] LYB: Primary data saved (53598 records). [2025-09-22T19:51:47.925739] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-22T19:51:47.925895] [INFO ] [MAIN ] Update Progress: 1294/2372 symbols completed. LYB took 30.6s. Estimated remaining: 2h 23m 4s. Rate: 7.5 symbols/min [2025-09-22T19:51:48.103457] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:51:48.140706] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-22T19:51:48.157430] [DEBUG] [LOCAL ] LZM: Loaded 13614 existing records from primary storage. [2025-09-22T19:51:48.157579] [INFO ] [MAIN ] LZM: Loaded 13614 existing records. [2025-09-22T19:51:48.337517] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:51:48.337883] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-22T19:51:48.337951] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-22T19:51:48.338500] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-22T19:51:48.338560] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-22T19:51:48.546176] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-22T19:51:48.715435] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:51:48.753894] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T19:51:48.790290] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T19:51:49.322099] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-22T19:51:50.025040] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-22T19:51:50.122109] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-22T19:51:50.515377] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-22T19:51:50.922069] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-22T19:51:51.722038] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-22T19:51:52.001529] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T19:51:52.083753] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T19:51:52.522128] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-22T19:51:53.322075] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-22T19:51:53.535517] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T19:51:53.743075] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T19:51:54.122082] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-22T19:51:54.244590] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T19:51:54.841359] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T19:51:54.922018] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-22T19:51:55.722078] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-22T19:51:56.522108] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-22T19:51:56.660335] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-22T19:51:57.123434] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T19:51:57.322033] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-22T19:51:58.122068] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-22T19:51:58.244396] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T19:51:58.253198] [INFO ] [REMOTE ] LYG: Full fetch complete (76044 records). [2025-09-22T19:51:58.253319] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-22T19:51:58.679388] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-22T19:51:58.679470] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-22T19:51:58.680461] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-22T19:51:58.680526] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-22T19:51:58.682234] [DEBUG] [LOCAL ] LYG: Trimmed 76044 records to 52882 (keeping 200 days of data) [2025-09-22T19:51:58.924225] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-22T19:51:59.002235] [DEBUG] [LOCAL ] LYG: Primary data saved (52882 records). [2025-09-22T19:51:59.002373] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-22T19:51:59.002474] [INFO ] [MAIN ] Update Progress: 1295/2372 symbols completed. LYG took 34.4s. Estimated remaining: 2h 22m 59s. Rate: 7.5 symbols/min [2025-09-22T19:51:59.188679] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:51:59.245959] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-22T19:51:59.246117] [INFO ] [MAIN ] M: Loaded 54315 existing records. [2025-09-22T19:51:59.428628] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:51:59.428985] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-22T19:51:59.429063] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-22T19:51:59.440887] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-22T19:51:59.446114] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-22T19:51:59.563463] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-22T19:51:59.728373] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-22T19:51:59.844016] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:51:59.925772] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T19:52:00.471372] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T19:52:00.522090] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-22T19:52:01.322080] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-22T19:52:01.545205] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T19:52:01.568553] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T19:52:02.122105] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-22T19:52:02.922054] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-22T19:52:03.107231] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T19:52:03.171001] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T19:52:03.696825] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T19:52:03.722062] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-22T19:52:04.522118] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-22T19:52:04.957266] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T19:52:05.322077] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-22T19:52:06.122106] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-22T19:52:06.260038] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T19:52:06.922071] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-22T19:52:07.159168] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T19:52:07.312212] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T19:52:07.722119] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-22T19:52:07.740461] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T19:52:08.522065] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-22T19:52:09.322066] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-22T19:52:09.497099] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T19:52:09.648584] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T19:52:09.654494] [INFO ] [REMOTE ] LZB: Full fetch complete (50106 records). [2025-09-22T19:52:09.654630] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-22T19:52:10.065610] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-22T19:52:10.065785] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-22T19:52:10.066691] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-22T19:52:10.066773] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-22T19:52:10.070208] [DEBUG] [LOCAL ] LZB: Trimmed 50106 records to 35557 (keeping 200 days of data) [2025-09-22T19:52:10.132885] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-22T19:52:10.305824] [DEBUG] [LOCAL ] LZB: Primary data saved (35557 records). [2025-09-22T19:52:10.305984] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-22T19:52:10.306095] [INFO ] [MAIN ] Update Progress: 1296/2372 symbols completed. LZB took 31.1s. Estimated remaining: 2h 22m 54s. Rate: 7.5 symbols/min [2025-09-22T19:52:10.492265] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:52:10.563246] [DEBUG] [LOCAL ] MA: Loaded 53357 existing records from primary storage. [2025-09-22T19:52:10.563444] [INFO ] [MAIN ] MA: Loaded 53357 existing records. [2025-09-22T19:52:10.751050] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:52:10.751490] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-22T19:52:10.751562] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-22T19:52:10.752952] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-22T19:52:10.753023] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-22T19:52:10.934938] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-22T19:52:11.123502] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T19:52:11.161377] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:52:11.191764] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T19:52:11.200448] [INFO ] [REMOTE ] LYV: Full fetch complete (73676 records). [2025-09-22T19:52:11.200671] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-22T19:52:11.605774] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-22T19:52:11.605884] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-22T19:52:11.606918] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-22T19:52:11.606983] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-22T19:52:11.609132] [DEBUG] [LOCAL ] LYV: Trimmed 73676 records to 51216 (keeping 200 days of data) [2025-09-22T19:52:11.722150] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-22T19:52:11.949901] [DEBUG] [LOCAL ] LYV: Primary data saved (51216 records). [2025-09-22T19:52:11.950073] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-22T19:52:11.950215] [INFO ] [MAIN ] Update Progress: 1297/2372 symbols completed. LYV took 34.6s. Estimated remaining: 2h 22m 40s. Rate: 7.5 symbols/min [2025-09-22T19:52:12.132554] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:52:12.190403] [DEBUG] [LOCAL ] MAA: Loaded 43601 existing records from primary storage. [2025-09-22T19:52:12.190552] [INFO ] [MAIN ] MAA: Loaded 43601 existing records. [2025-09-22T19:52:12.367288] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:52:12.367560] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-22T19:52:12.367608] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-22T19:52:12.368718] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-22T19:52:12.368790] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-22T19:52:12.527267] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-22T19:52:12.739412] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:52:12.972837] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-22T19:52:13.322058] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-22T19:52:13.412371] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T19:52:13.492622] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T19:52:14.122096] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-22T19:52:14.922036] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-22T19:52:14.961989] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T19:52:14.965767] [INFO ] [REMOTE ] LZM: Full fetch complete (17687 records). [2025-09-22T19:52:14.965846] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-22T19:52:15.376689] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-22T19:52:15.376847] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-22T19:52:15.377530] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-22T19:52:15.377636] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-22T19:52:15.389744] [DEBUG] [LOCAL ] LZM: Trimmed 17687 records to 13402 (keeping 200 days of data) [2025-09-22T19:52:15.412206] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-22T19:52:15.497926] [DEBUG] [LOCAL ] LZM: Primary data saved (13402 records). [2025-09-22T19:52:15.498078] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-22T19:52:15.498229] [INFO ] [MAIN ] Update Progress: 1298/2372 symbols completed. LZM took 27.6s. Estimated remaining: 2h 22m 29s. Rate: 7.5 symbols/min [2025-09-22T19:52:15.667921] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:52:15.727980] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-22T19:52:15.732814] [DEBUG] [LOCAL ] MAC: Loaded 50480 existing records from primary storage. [2025-09-22T19:52:15.733108] [INFO ] [MAIN ] MAC: Loaded 50480 existing records. [2025-09-22T19:52:15.912045] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:52:15.912304] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-22T19:52:15.912353] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-22T19:52:15.913758] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-22T19:52:15.913818] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-22T19:52:16.275315] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:52:16.522023] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-22T19:52:16.701027] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T19:52:17.320865] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T19:52:17.328757] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-22T19:52:18.118494] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T19:52:18.128431] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-22T19:52:18.922051] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-22T19:52:19.132253] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T19:52:19.722101] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-22T19:52:19.769081] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T19:52:20.522074] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-22T19:52:20.871498] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T19:52:21.322041] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-22T19:52:21.477406] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T19:52:22.118357] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T19:52:22.126174] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-22T19:52:22.922054] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-22T19:52:23.155182] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T19:52:23.722046] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-22T19:52:24.286776] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-22T19:52:24.323078] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:52:24.522068] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-22T19:52:25.322026] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-22T19:52:25.627997] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-22T19:52:26.122073] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-22T19:52:26.182834] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T19:52:26.922109] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-22T19:52:27.184262] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T19:52:27.635671] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T19:52:27.722127] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-22T19:52:28.522063] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-22T19:52:28.554432] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T19:52:29.322089] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-22T19:52:29.548025] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T19:52:30.122116] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-22T19:52:30.487137] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-22T19:52:30.912181] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T19:52:30.922007] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-22T19:52:31.722101] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-22T19:52:32.022175] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T19:52:32.030387] [INFO ] [REMOTE ] M: Full fetch complete (77484 records). [2025-09-22T19:52:32.030509] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-22T19:52:32.452309] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-22T19:52:32.452504] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-22T19:52:32.453539] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-22T19:52:32.453609] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-22T19:52:32.455310] [DEBUG] [LOCAL ] M: Trimmed 77484 records to 53536 (keeping 200 days of data) [2025-09-22T19:52:32.529118] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-22T19:52:32.808891] [DEBUG] [LOCAL ] M: Primary data saved (53536 records). [2025-09-22T19:52:32.809078] [INFO ] [MAIN ] M: Full history saved. [2025-09-22T19:52:32.809233] [INFO ] [MAIN ] Update Progress: 1299/2372 symbols completed. M took 33.8s. Estimated remaining: 2h 22m 28s. Rate: 7.5 symbols/min [2025-09-22T19:52:32.985274] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:52:33.020704] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-22T19:52:33.060472] [DEBUG] [LOCAL ] MAGN: Loaded 35554 existing records from primary storage. [2025-09-22T19:52:33.060606] [INFO ] [MAIN ] MAGN: Loaded 35554 existing records. [2025-09-22T19:52:33.278214] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:52:33.281055] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-22T19:52:33.281193] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-22T19:52:33.282631] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T19:52:33.285985] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-22T19:52:33.292203] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-22T19:52:33.329712] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-22T19:52:33.654809] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:52:34.059129] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T19:52:34.122044] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-22T19:52:34.922047] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-22T19:52:35.015668] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-22T19:52:35.722031] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-22T19:52:35.724810] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T19:52:36.526555] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-22T19:52:36.529094] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T19:52:37.131410] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T19:52:37.322054] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-22T19:52:38.122061] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-22T19:52:38.213695] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T19:52:38.536328] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T19:52:38.922057] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-22T19:52:39.722066] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-22T19:52:40.292547] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T19:52:40.328855] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-22T19:52:40.338020] [INFO ] [REMOTE ] MA: Full fetch complete (76271 records). [2025-09-22T19:52:40.338294] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-22T19:52:40.527292] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-22T19:52:40.783265] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-22T19:52:40.783361] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-22T19:52:40.784573] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-22T19:52:40.784693] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-22T19:52:40.787827] [DEBUG] [LOCAL ] MA: Trimmed 76271 records to 52581 (keeping 200 days of data) [2025-09-22T19:52:41.156030] [DEBUG] [LOCAL ] MA: Primary data saved (52581 records). [2025-09-22T19:52:41.156213] [INFO ] [MAIN ] MA: Full history saved. [2025-09-22T19:52:41.157887] [INFO ] [MAIN ] Update Progress: 1300/2372 symbols completed. MA took 30.9s. Estimated remaining: 2h 22m 21s. Rate: 7.5 symbols/min [2025-09-22T19:52:41.325054] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-22T19:52:41.347546] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:52:41.368376] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T19:52:41.375916] [INFO ] [REMOTE ] MAA: Full fetch complete (61065 records). [2025-09-22T19:52:41.376077] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-22T19:52:41.710750] [DEBUG] [LOCAL ] MAIN: Loaded 42093 existing records from primary storage. [2025-09-22T19:52:41.714182] [INFO ] [MAIN ] MAIN: Loaded 42093 existing records. [2025-09-22T19:52:41.922335] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-22T19:52:41.932909] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-22T19:52:41.933906] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-22T19:52:41.949634] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-22T19:52:42.013262] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:52:42.014099] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-22T19:52:42.014276] [DEBUG] [LOCAL ] MAA: Trimmed 61065 records to 42917 (keeping 200 days of data) [2025-09-22T19:52:42.014462] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-22T19:52:42.016130] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-22T19:52:42.016316] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-22T19:52:42.164560] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T19:52:42.255459] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-22T19:52:42.538900] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:52:42.695454] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T19:52:42.755608] [DEBUG] [LOCAL ] MAA: Primary data saved (42917 records). [2025-09-22T19:52:42.755771] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-22T19:52:42.755893] [INFO ] [MAIN ] Update Progress: 1301/2372 symbols completed. MAA took 30.8s. Estimated remaining: 2h 22m 8s. Rate: 7.5 symbols/min [2025-09-22T19:52:42.928629] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-22T19:52:42.932224] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:52:42.974991] [DEBUG] [LOCAL ] MAN: Loaded 44330 existing records from primary storage. [2025-09-22T19:52:42.975166] [INFO ] [MAIN ] MAN: Loaded 44330 existing records. [2025-09-22T19:52:43.158286] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:52:43.158549] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-22T19:52:43.158683] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-22T19:52:43.159858] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-22T19:52:43.159931] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-22T19:52:43.548418] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:52:43.655875] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T19:52:43.722101] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-22T19:52:44.329500] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T19:52:44.522096] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-22T19:52:45.226940] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T19:52:45.322064] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-22T19:52:45.932870] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T19:52:46.122064] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-22T19:52:46.820437] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T19:52:46.922062] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-22T19:52:47.586795] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T19:52:47.722058] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-22T19:52:48.352787] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-22T19:52:48.522061] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-22T19:52:49.151034] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T19:52:49.322049] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-22T19:52:49.705983] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T19:52:50.122057] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-22T19:52:50.922069] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-22T19:52:51.024530] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T19:52:51.722034] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-22T19:52:51.776600] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T19:52:52.198780] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T19:52:52.522116] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-22T19:52:53.314484] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T19:52:53.323931] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-22T19:52:53.964025] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T19:52:54.122063] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-22T19:52:54.482502] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T19:52:54.922080] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-22T19:52:55.722101] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-22T19:52:55.920009] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T19:52:55.928305] [INFO ] [REMOTE ] MAC: Full fetch complete (71486 records). [2025-09-22T19:52:55.928484] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-22T19:52:56.364187] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T19:52:56.364278] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-22T19:52:56.364423] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-22T19:52:56.372509] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-22T19:52:56.373011] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-22T19:52:56.374390] [DEBUG] [LOCAL ] MAC: Trimmed 71486 records to 49726 (keeping 200 days of data) [2025-09-22T19:52:56.561383] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-22T19:52:56.692992] [DEBUG] [LOCAL ] MAC: Primary data saved (49726 records). [2025-09-22T19:52:56.693160] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-22T19:52:56.693266] [INFO ] [MAIN ] Update Progress: 1302/2372 symbols completed. MAC took 41.2s. Estimated remaining: 2h 22m 5s. Rate: 7.5 symbols/min [2025-09-22T19:52:56.867139] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:52:56.895848] [DEBUG] [LOCAL ] MANU: Loaded 27676 existing records from primary storage. [2025-09-22T19:52:56.896035] [INFO ] [MAIN ] MANU: Loaded 27676 existing records. [2025-09-22T19:52:57.076880] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:52:57.077151] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-22T19:52:57.077200] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-22T19:52:57.077919] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-22T19:52:57.077980] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-22T19:52:57.332746] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-22T19:52:57.449838] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:52:57.473539] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T19:52:57.615374] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T19:52:57.620818] [INFO ] [REMOTE ] MAGN: Full fetch complete (51197 records). [2025-09-22T19:52:57.620923] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-22T19:52:58.012442] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-22T19:52:58.012553] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-22T19:52:58.013521] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-22T19:52:58.013597] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-22T19:52:58.014781] [DEBUG] [LOCAL ] MAGN: Trimmed 51197 records to 34950 (keeping 200 days of data) [2025-09-22T19:52:58.122125] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-22T19:52:58.228470] [DEBUG] [LOCAL ] MAGN: Primary data saved (34950 records). [2025-09-22T19:52:58.228617] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-22T19:52:58.228752] [INFO ] [MAIN ] Update Progress: 1303/2372 symbols completed. MAGN took 25.4s. Estimated remaining: 2h 21m 51s. Rate: 7.5 symbols/min [2025-09-22T19:52:58.469354] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:52:58.522911] [DEBUG] [LOCAL ] MAS: Loaded 53128 existing records from primary storage. [2025-09-22T19:52:58.523092] [INFO ] [MAIN ] MAS: Loaded 53128 existing records. [2025-09-22T19:52:58.727542] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:52:58.727842] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-22T19:52:58.727900] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-22T19:52:58.729210] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-22T19:52:58.729273] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-22T19:52:58.926822] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-22T19:52:59.110845] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:52:59.125899] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-22T19:52:59.155782] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T19:52:59.722046] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-22T19:53:00.522091] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-22T19:53:00.608899] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T19:53:00.856054] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-22T19:53:01.322055] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-22T19:53:02.122044] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-22T19:53:02.166942] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T19:53:02.922046] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-22T19:53:02.970986] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T19:53:03.503951] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T19:53:03.722123] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-22T19:53:04.522056] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-22T19:53:04.572827] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T19:53:04.745926] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T19:53:05.322066] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-22T19:53:05.852157] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T19:53:06.122106] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-22T19:53:06.856932] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T19:53:06.922028] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-22T19:53:07.361959] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-22T19:53:07.722112] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-22T19:53:08.522106] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-22T19:53:08.666446] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T19:53:09.322057] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-22T19:53:09.358961] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T19:53:09.726301] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T19:53:10.122083] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-22T19:53:10.922084] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-22T19:53:11.110958] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T19:53:11.722069] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-22T19:53:11.925404] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-22T19:53:12.256333] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T19:53:12.522069] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-22T19:53:13.327237] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-22T19:53:13.343749] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T19:53:14.122043] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-22T19:53:14.246174] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T19:53:14.662818] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T19:53:14.922113] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-22T19:53:15.722092] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-22T19:53:15.870881] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T19:53:16.522077] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-22T19:53:16.550210] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T19:53:16.558529] [INFO ] [REMOTE ] MAN: Full fetch complete (61701 records). [2025-09-22T19:53:16.558674] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-22T19:53:16.962623] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-22T19:53:16.963278] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-22T19:53:16.963767] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T19:53:16.964726] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-22T19:53:16.969172] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-22T19:53:16.970588] [DEBUG] [LOCAL ] MAN: Trimmed 61701 records to 43595 (keeping 200 days of data) [2025-09-22T19:53:17.237929] [DEBUG] [LOCAL ] MAN: Primary data saved (43595 records). [2025-09-22T19:53:17.238106] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-22T19:53:17.238216] [INFO ] [MAIN ] Update Progress: 1304/2372 symbols completed. MAN took 34.5s. Estimated remaining: 2h 21m 52s. Rate: 7.5 symbols/min [2025-09-22T19:53:17.328800] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-22T19:53:17.410390] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:53:17.410561] [DEBUG] [LOCAL ] MATV: No existing data file found in primary storage. [2025-09-22T19:53:17.410615] [WARN ] [MAIN ] MATV: No existing data found, performing full refresh instead. [2025-09-22T19:53:17.410795] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-22T19:53:17.410838] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-22T19:53:17.410878] [DEBUG] [LOCAL ] MATV: No primary data file found to delete. [2025-09-22T19:53:17.410910] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-22T19:53:17.764214] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:53:18.122037] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-22T19:53:18.278898] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T19:53:18.922079] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-22T19:53:19.160222] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T19:53:19.167130] [INFO ] [REMOTE ] MAIN: Full fetch complete (59665 records). [2025-09-22T19:53:19.167234] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-22T19:53:19.558315] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-22T19:53:19.558487] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-22T19:53:19.559710] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-22T19:53:19.559832] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-22T19:53:19.567904] [DEBUG] [LOCAL ] MAIN: Trimmed 59665 records to 41410 (keeping 200 days of data) [2025-09-22T19:53:19.580486] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T19:53:19.770229] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-22T19:53:19.852386] [DEBUG] [LOCAL ] MAIN: Primary data saved (41410 records). [2025-09-22T19:53:19.852521] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-22T19:53:19.852607] [INFO ] [MAIN ] Update Progress: 1305/2372 symbols completed. MAIN took 38.7s. Estimated remaining: 2h 21m 40s. Rate: 7.5 symbols/min [2025-09-22T19:53:20.083957] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:53:20.137410] [DEBUG] [LOCAL ] MATX: Loaded 32049 existing records from primary storage. [2025-09-22T19:53:20.137631] [INFO ] [MAIN ] MATX: Loaded 32049 existing records. [2025-09-22T19:53:20.436719] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:53:20.437196] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-22T19:53:20.437460] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-22T19:53:20.438619] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-22T19:53:20.438763] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-22T19:53:20.522260] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-22T19:53:20.718169] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T19:53:20.991829] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:53:21.137331] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T19:53:21.142786] [INFO ] [REMOTE ] MANU: Full fetch complete (38254 records). [2025-09-22T19:53:21.142926] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-22T19:53:21.331430] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-22T19:53:21.571207] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-22T19:53:21.571291] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-22T19:53:21.572004] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-22T19:53:21.572064] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-22T19:53:21.572924] [DEBUG] [LOCAL ] MANU: Trimmed 38254 records to 27184 (keeping 200 days of data) [2025-09-22T19:53:21.739710] [DEBUG] [LOCAL ] MANU: Primary data saved (27184 records). [2025-09-22T19:53:21.739871] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-22T19:53:21.739964] [INFO ] [MAIN ] Update Progress: 1306/2372 symbols completed. MANU took 25.0s. Estimated remaining: 2h 21m 27s. Rate: 7.5 symbols/min [2025-09-22T19:53:21.915232] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:53:21.952419] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T19:53:21.969185] [DEBUG] [LOCAL ] MAX: Loaded 31616 existing records from primary storage. [2025-09-22T19:53:21.969301] [INFO ] [MAIN ] MAX: Loaded 31616 existing records. [2025-09-22T19:53:22.125683] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-22T19:53:22.154983] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:53:22.156185] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-22T19:53:22.156268] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-22T19:53:22.157077] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-22T19:53:22.157141] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-22T19:53:22.520881] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:53:22.922031] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-22T19:53:23.275525] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T19:53:23.307255] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T19:53:23.722102] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-22T19:53:24.312203] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T19:53:24.522074] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-22T19:53:25.211428] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T19:53:25.322087] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-22T19:53:25.860155] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T19:53:26.122099] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-22T19:53:26.496207] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T19:53:26.922089] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-22T19:53:27.722031] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-22T19:53:27.984437] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T19:53:27.992921] [INFO ] [REMOTE ] MAS: Full fetch complete (74712 records). [2025-09-22T19:53:27.993047] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-22T19:53:28.351946] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T19:53:28.415552] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-22T19:53:28.415624] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-22T19:53:28.416612] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-22T19:53:28.416698] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-22T19:53:28.418630] [DEBUG] [LOCAL ] MAS: Trimmed 74712 records to 52354 (keeping 200 days of data) [2025-09-22T19:53:28.522161] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-22T19:53:28.752116] [DEBUG] [LOCAL ] MAS: Primary data saved (52354 records). [2025-09-22T19:53:28.752272] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-22T19:53:28.752386] [INFO ] [MAIN ] Update Progress: 1307/2372 symbols completed. MAS took 30.5s. Estimated remaining: 2h 21m 18s. Rate: 7.5 symbols/min [2025-09-22T19:53:28.931697] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:53:28.979379] [DEBUG] [LOCAL ] MBC: Loaded 43804 existing records from primary storage. [2025-09-22T19:53:28.979533] [INFO ] [MAIN ] MBC: Loaded 43804 existing records. [2025-09-22T19:53:29.195560] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:53:29.198349] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T19:53:29.198509] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-22T19:53:29.208041] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-22T19:53:29.210046] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-22T19:53:29.210115] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-22T19:53:29.327123] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-22T19:53:29.589080] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:53:29.603123] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T19:53:30.122068] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-22T19:53:30.542799] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T19:53:30.922056] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-22T19:53:31.529045] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T19:53:31.722062] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-22T19:53:31.977624] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T19:53:32.522055] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-22T19:53:33.161135] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T19:53:33.322068] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-22T19:53:33.825345] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T19:53:34.122137] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-22T19:53:34.628742] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T19:53:34.922064] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-22T19:53:35.662968] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T19:53:35.726107] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-22T19:53:35.730021] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T19:53:36.522056] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-22T19:53:36.965306] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T19:53:37.322057] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-22T19:53:37.892261] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T19:53:38.122020] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-22T19:53:38.259213] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-22T19:53:38.922072] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-22T19:53:39.329153] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T19:53:39.722059] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-22T19:53:40.125489] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T19:53:40.522058] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-22T19:53:41.007680] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T19:53:41.322066] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-22T19:53:41.778094] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T19:53:42.122063] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-22T19:53:42.829240] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T19:53:42.922026] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-22T19:53:43.287210] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T19:53:43.722085] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-22T19:53:44.445367] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T19:53:44.522008] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-22T19:53:45.322034] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-22T19:53:45.465426] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-22T19:53:45.998433] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T19:53:46.122064] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-22T19:53:46.531701] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T19:53:46.922056] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-22T19:53:47.541115] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T19:53:47.547143] [INFO ] [REMOTE ] MAX: Full fetch complete (45666 records). [2025-09-22T19:53:47.547249] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-22T19:53:47.726362] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-22T19:53:47.945605] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-22T19:53:47.945716] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-22T19:53:47.946496] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-22T19:53:47.946538] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-22T19:53:47.947510] [DEBUG] [LOCAL ] MAX: Trimmed 45666 records to 30950 (keeping 200 days of data) [2025-09-22T19:53:48.127095] [DEBUG] [LOCAL ] MAX: Primary data saved (30950 records). [2025-09-22T19:53:48.127233] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-22T19:53:48.127319] [INFO ] [MAIN ] Update Progress: 1308/2372 symbols completed. MAX took 26.4s. Estimated remaining: 2h 21m 20s. Rate: 7.5 symbols/min [2025-09-22T19:53:48.307842] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:53:48.327683] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T19:53:48.355575] [DEBUG] [LOCAL ] MBI: Loaded 25442 existing records from primary storage. [2025-09-22T19:53:48.355738] [INFO ] [MAIN ] MBI: Loaded 25442 existing records. [2025-09-22T19:53:48.528879] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-22T19:53:48.534559] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:53:48.535696] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-22T19:53:48.535770] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-22T19:53:48.536374] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-22T19:53:48.536435] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-22T19:53:48.907527] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:53:49.166479] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T19:53:49.172466] [INFO ] [REMOTE ] MATV: Full fetch complete (52417 records). [2025-09-22T19:53:49.172587] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-22T19:53:49.327364] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-22T19:53:49.572033] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-22T19:53:49.572128] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-22T19:53:49.573009] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-22T19:53:49.573139] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-22T19:53:49.574506] [DEBUG] [LOCAL ] MATV: Trimmed 52417 records to 37736 (keeping 200 days of data) [2025-09-22T19:53:49.807956] [DEBUG] [LOCAL ] MATV: Primary data saved (37736 records). [2025-09-22T19:53:49.808101] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-22T19:53:49.808178] [INFO ] [MAIN ] Update Progress: 1309/2372 symbols completed. MATV took 32.6s. Estimated remaining: 2h 21m 7s. Rate: 7.5 symbols/min [2025-09-22T19:53:49.981682] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:53:50.003233] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T19:53:50.048760] [DEBUG] [LOCAL ] MC: Loaded 45069 existing records from primary storage. [2025-09-22T19:53:50.048908] [INFO ] [MAIN ] MC: Loaded 45069 existing records. [2025-09-22T19:53:50.127176] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-22T19:53:50.227241] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:53:50.227480] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-22T19:53:50.227527] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-22T19:53:50.228607] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-22T19:53:50.228701] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-22T19:53:50.579497] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:53:50.814728] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T19:53:50.922018] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-22T19:53:51.498636] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T19:53:51.722046] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-22T19:53:52.388033] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T19:53:52.522118] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-22T19:53:53.055309] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T19:53:53.322063] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-22T19:53:54.068009] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T19:53:54.122000] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-22T19:53:54.508891] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T19:53:54.922066] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-22T19:53:55.493858] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T19:53:55.501168] [INFO ] [REMOTE ] MBC: Full fetch complete (62447 records). [2025-09-22T19:53:55.501282] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-22T19:53:55.724382] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-22T19:53:55.897105] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-22T19:53:55.903802] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-22T19:53:55.914581] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-22T19:53:55.915961] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-22T19:53:55.916556] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T19:53:55.923330] [DEBUG] [LOCAL ] MBC: Trimmed 62447 records to 43106 (keeping 200 days of data) [2025-09-22T19:53:56.174829] [DEBUG] [LOCAL ] MBC: Primary data saved (43106 records). [2025-09-22T19:53:56.174968] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-22T19:53:56.175053] [INFO ] [MAIN ] Update Progress: 1310/2372 symbols completed. MBC took 27.4s. Estimated remaining: 2h 20m 57s. Rate: 7.5 symbols/min [2025-09-22T19:53:56.343412] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:53:56.355938] [DEBUG] [LOCAL ] MCB: Loaded 11984 existing records from primary storage. [2025-09-22T19:53:56.356037] [INFO ] [MAIN ] MCB: Loaded 11984 existing records. [2025-09-22T19:53:56.532525] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:53:56.527682] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-22T19:53:56.533662] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-22T19:53:56.533726] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-22T19:53:56.534117] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-22T19:53:56.534177] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-22T19:53:56.889608] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:53:56.924038] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T19:53:56.928927] [INFO ] [REMOTE ] MATX: Full fetch complete (42500 records). [2025-09-22T19:53:56.929049] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-22T19:53:57.323563] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-22T19:53:57.323328] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-22T19:53:57.323707] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-22T19:53:57.325364] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-22T19:53:57.325546] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-22T19:53:57.326773] [DEBUG] [LOCAL ] MATX: Trimmed 42500 records to 31663 (keeping 200 days of data) [2025-09-22T19:53:57.549847] [DEBUG] [LOCAL ] MATX: Primary data saved (31663 records). [2025-09-22T19:53:57.550079] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-22T19:53:57.551933] [INFO ] [MAIN ] Update Progress: 1311/2372 symbols completed. MATX took 37.7s. Estimated remaining: 2h 20m 44s. Rate: 7.5 symbols/min [2025-09-22T19:53:57.743114] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:53:57.743439] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-22T19:53:57.743585] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-22T19:53:57.744016] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-22T19:53:57.744166] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-22T19:53:57.744280] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-22T19:53:57.744326] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-22T19:53:58.038594] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T19:53:58.131581] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-22T19:53:58.157716] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:53:58.202201] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T19:53:58.922055] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-22T19:53:59.534218] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T19:53:59.722034] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-22T19:54:00.522077] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-22T19:54:01.135697] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-22T19:54:01.235761] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T19:54:01.322012] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-22T19:54:01.360676] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T19:54:02.122096] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-22T19:54:02.922083] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-22T19:54:03.734439] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-22T19:54:03.740154] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-22T19:54:04.135241] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T19:54:04.522079] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-22T19:54:04.837917] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-09-22T19:54:04.943604] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T19:54:05.322105] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-22T19:54:06.060254] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T19:54:06.122012] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-22T19:54:06.922068] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-22T19:54:07.238756] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-22T19:54:07.722059] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-22T19:54:07.794478] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T19:54:07.825699] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T19:54:08.522090] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-22T19:54:09.322025] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-22T19:54:09.558791] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T19:54:09.841883] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-22T19:54:10.122046] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-22T19:54:10.318729] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T19:54:10.922062] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-22T19:54:11.712776] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T19:54:11.722004] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-22T19:54:12.005111] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T19:54:12.172486] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T19:54:12.522079] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-22T19:54:13.322057] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-22T19:54:14.122114] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-22T19:54:14.885784] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T19:54:14.922072] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-22T19:54:15.471410] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-22T19:54:15.722103] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-22T19:54:15.835255] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T19:54:15.963187] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T19:54:16.522061] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-22T19:54:17.322072] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-22T19:54:17.905601] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-22T19:54:18.072326] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T19:54:18.104235] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T19:54:18.122134] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-22T19:54:18.922139] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-22T19:54:19.009287] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T19:54:19.011734] [INFO ] [REMOTE ] MCB: Full fetch complete (16327 records). [2025-09-22T19:54:19.011829] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-22T19:54:19.397406] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-22T19:54:19.397560] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-22T19:54:19.398165] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-22T19:54:19.398265] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-22T19:54:19.398949] [DEBUG] [LOCAL ] MCB: Trimmed 16327 records to 11758 (keeping 200 days of data) [2025-09-22T19:54:19.474362] [DEBUG] [LOCAL ] MCB: Primary data saved (11758 records). [2025-09-22T19:54:19.474538] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-22T19:54:19.474745] [INFO ] [MAIN ] Update Progress: 1312/2372 symbols completed. MCB took 23.3s. Estimated remaining: 2h 20m 47s. Rate: 7.5 symbols/min [2025-09-22T19:54:19.698832] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:54:19.707763] [DEBUG] [LOCAL ] MCI: Loaded 6425 existing records from primary storage. [2025-09-22T19:54:19.707895] [INFO ] [MAIN ] MCI: Loaded 6425 existing records. [2025-09-22T19:54:19.728387] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-22T19:54:19.889716] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:54:19.889946] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-22T19:54:19.889993] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-22T19:54:19.890331] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-22T19:54:19.890390] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-22T19:54:20.281255] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:54:20.522030] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-22T19:54:20.571050] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T19:54:20.851183] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T19:54:21.111799] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-22T19:54:21.322076] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-22T19:54:22.122043] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-22T19:54:22.197113] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T19:54:22.922059] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-22T19:54:23.391912] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T19:54:23.722050] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-22T19:54:23.731935] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T19:54:24.522057] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-22T19:54:25.199164] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-22T19:54:25.246634] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T19:54:25.322068] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-22T19:54:26.122086] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-22T19:54:26.574877] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-22T19:54:26.614323] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T19:54:26.620769] [INFO ] [REMOTE ] MC: Full fetch complete (62150 records). [2025-09-22T19:54:26.620904] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-22T19:54:26.927232] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-22T19:54:27.052053] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-22T19:54:27.052155] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-22T19:54:27.053137] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-22T19:54:27.053219] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-22T19:54:27.055811] [DEBUG] [LOCAL ] MC: Trimmed 62150 records to 44356 (keeping 200 days of data) [2025-09-22T19:54:27.343671] [DEBUG] [LOCAL ] MC: Primary data saved (44356 records). [2025-09-22T19:54:27.343820] [INFO ] [MAIN ] MC: Full history saved. [2025-09-22T19:54:27.343989] [INFO ] [MAIN ] Update Progress: 1313/2372 symbols completed. MC took 37.5s. Estimated remaining: 2h 20m 39s. Rate: 7.5 symbols/min [2025-09-22T19:54:27.518195] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:54:27.572055] [DEBUG] [LOCAL ] MCK: Loaded 40064 existing records from primary storage. [2025-09-22T19:54:27.572244] [INFO ] [MAIN ] MCK: Loaded 40064 existing records. [2025-09-22T19:54:27.728113] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-22T19:54:27.770546] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:54:27.770851] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-22T19:54:27.770912] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-22T19:54:27.772256] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-22T19:54:27.772705] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T19:54:27.775018] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-22T19:54:28.135787] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:54:28.522131] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-22T19:54:29.322062] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-22T19:54:29.933314] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-22T19:54:30.122073] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-22T19:54:30.244857] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T19:54:30.591406] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T19:54:30.596856] [INFO ] [REMOTE ] MBI: Full fetch complete (36806 records). [2025-09-22T19:54:30.596997] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-22T19:54:30.927218] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-22T19:54:31.001871] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-22T19:54:31.002056] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-22T19:54:31.002851] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-22T19:54:31.002914] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-22T19:54:31.003885] [DEBUG] [LOCAL ] MBI: Trimmed 36806 records to 24778 (keeping 200 days of data) [2025-09-22T19:54:31.171911] [DEBUG] [LOCAL ] MBI: Primary data saved (24778 records). [2025-09-22T19:54:31.172049] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-22T19:54:31.172153] [INFO ] [MAIN ] Update Progress: 1314/2372 symbols completed. MBI took 43.0s. Estimated remaining: 2h 20m 28s. Rate: 7.5 symbols/min [2025-09-22T19:54:31.353084] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:54:31.364904] [DEBUG] [LOCAL ] MCN: Loaded 8284 existing records from primary storage. [2025-09-22T19:54:31.365037] [INFO ] [MAIN ] MCN: Loaded 8284 existing records. [2025-09-22T19:54:31.588114] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:54:31.588419] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-22T19:54:31.588466] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-22T19:54:31.588954] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-22T19:54:31.589018] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-22T19:54:31.734136] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-22T19:54:31.899523] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-22T19:54:31.983899] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:54:32.345023] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-22T19:54:32.522059] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-22T19:54:33.059128] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T19:54:33.322065] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-22T19:54:34.122066] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-22T19:54:34.275787] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T19:54:34.286100] [INFO ] [REMOTE ] MCD: Full fetch complete (77026 records). [2025-09-22T19:54:34.286356] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-22T19:54:34.508526] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T19:54:34.509433] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:54:34.509513] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:54:34.509587] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-22T19:54:34.509692] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-22T19:54:34.509751] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-22T19:54:34.509809] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-22T19:54:34.509929] [INFO ] [MAIN ] Update Progress: 1315/2372 symbols completed. MCD took 37.0s. Estimated remaining: 2h 20m 16s. Rate: 7.5 symbols/min [2025-09-22T19:54:34.699125] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:54:34.718621] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T19:54:34.767509] [DEBUG] [LOCAL ] MCO: Loaded 40292 existing records from primary storage. [2025-09-22T19:54:34.767742] [INFO ] [MAIN ] MCO: Loaded 40292 existing records. [2025-09-22T19:54:34.922892] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-22T19:54:35.060061] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:54:35.060629] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-22T19:54:35.060850] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-22T19:54:35.062270] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-22T19:54:35.062342] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-22T19:54:35.286316] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-22T19:54:35.616921] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:54:35.669697] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:54:35.722112] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-22T19:54:36.353266] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-22T19:54:36.355154] [INFO ] [REMOTE ] MCI: Full fetch complete (9857 records). [2025-09-22T19:54:36.355233] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-22T19:54:36.528044] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-22T19:54:36.765168] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-22T19:54:36.765321] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-22T19:54:36.766141] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-22T19:54:36.766230] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-22T19:54:36.767303] [DEBUG] [LOCAL ] MCI: Trimmed 9857 records to 6370 (keeping 200 days of data) [2025-09-22T19:54:36.814879] [DEBUG] [LOCAL ] MCI: Primary data saved (6370 records). [2025-09-22T19:54:36.815110] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-22T19:54:36.815297] [INFO ] [MAIN ] Update Progress: 1316/2372 symbols completed. MCI took 17.3s. Estimated remaining: 2h 20m 4s. Rate: 7.5 symbols/min [2025-09-22T19:54:37.010806] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:54:37.026090] [DEBUG] [LOCAL ] MCR: Loaded 9047 existing records from primary storage. [2025-09-22T19:54:37.026247] [INFO ] [MAIN ] MCR: Loaded 9047 existing records. [2025-09-22T19:54:37.211214] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:54:37.211719] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-22T19:54:37.211957] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-22T19:54:37.212921] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-22T19:54:37.212984] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-22T19:54:37.327298] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-22T19:54:37.642119] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:54:37.825807] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T19:54:38.122062] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-22T19:54:38.729823] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-22T19:54:38.922056] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-22T19:54:39.098204] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T19:54:39.493501] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T19:54:39.722070] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-22T19:54:40.522066] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-22T19:54:41.204551] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T19:54:41.322050] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-22T19:54:42.024409] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T19:54:42.122025] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-22T19:54:42.222973] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T19:54:42.922055] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-22T19:54:43.722045] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-22T19:54:43.765887] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T19:54:44.522071] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-22T19:54:45.292610] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T19:54:45.310596] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T19:54:45.322011] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-22T19:54:46.122047] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-22T19:54:46.263422] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (4.14 seconds). [2025-09-22T19:54:46.716120] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T19:54:46.922058] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-22T19:54:47.335781] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T19:54:47.722032] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-22T19:54:48.349512] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T19:54:48.522017] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-22T19:54:49.325012] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-22T19:54:49.325890] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T19:54:49.567385] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T19:54:50.122105] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-22T19:54:50.895146] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-22T19:54:50.929112] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-22T19:54:50.945345] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T19:54:51.672794] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T19:54:51.722032] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-22T19:54:52.503530] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T19:54:52.522055] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-22T19:54:53.278546] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T19:54:53.322068] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-22T19:54:54.070086] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-22T19:54:54.122075] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-22T19:54:54.922076] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-22T19:54:55.722076] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-22T19:54:55.905023] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T19:54:56.473446] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T19:54:56.522012] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-22T19:54:56.631844] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T19:54:56.637688] [INFO ] [REMOTE ] MCK: Full fetch complete (57420 records). [2025-09-22T19:54:56.637798] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-22T19:54:57.022075] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-22T19:54:57.022164] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-22T19:54:57.023036] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-22T19:54:57.023128] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-22T19:54:57.024496] [DEBUG] [LOCAL ] MCK: Trimmed 57420 records to 39352 (keeping 200 days of data) [2025-09-22T19:54:57.272589] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:54:57.316957] [DEBUG] [LOCAL ] MCK: Primary data saved (39352 records). [2025-09-22T19:54:57.317113] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-22T19:54:57.317206] [INFO ] [MAIN ] Update Progress: 1317/2372 symbols completed. MCK took 30.0s. Estimated remaining: 2h 20m 6s. Rate: 7.5 symbols/min [2025-09-22T19:54:57.322011] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-22T19:54:58.117871] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-22T19:54:58.121997] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-22T19:54:58.849509] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T19:54:58.922061] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-22T19:54:59.644131] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-22T19:54:59.722106] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-22T19:55:00.407975] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T19:55:00.522037] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-22T19:55:01.265051] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T19:55:01.269549] [INFO ] [REMOTE ] MCR: Full fetch complete (14208 records). [2025-09-22T19:55:01.269844] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-22T19:55:01.332187] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-22T19:55:01.671500] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-22T19:55:01.671601] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-22T19:55:01.671996] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-22T19:55:01.672062] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-22T19:55:01.672758] [DEBUG] [LOCAL ] MCR: Trimmed 14208 records to 8813 (keeping 200 days of data) [2025-09-22T19:55:01.730301] [DEBUG] [LOCAL ] MCR: Primary data saved (8813 records). [2025-09-22T19:55:01.730460] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-22T19:55:01.730569] [INFO ] [MAIN ] Update Progress: 1318/2372 symbols completed. MCR took 24.9s. Estimated remaining: 2h 19m 55s. Rate: 7.5 symbols/min [2025-09-22T19:55:02.122129] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-22T19:55:02.890708] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T19:55:02.892509] [INFO ] [REMOTE ] MCN: Full fetch complete (11529 records). [2025-09-22T19:55:02.892671] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-22T19:55:03.042734] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T19:55:03.097008] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-22T19:55:03.318674] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-22T19:55:03.318767] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-22T19:55:03.319074] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-22T19:55:03.319114] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-22T19:55:03.319755] [DEBUG] [LOCAL ] MCN: Trimmed 11529 records to 8119 (keeping 200 days of data) [2025-09-22T19:55:03.372609] [DEBUG] [LOCAL ] MCN: Primary data saved (8119 records). [2025-09-22T19:55:03.372786] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-22T19:55:03.372881] [INFO ] [MAIN ] Update Progress: 1319/2372 symbols completed. MCN took 32.2s. Estimated remaining: 2h 19m 42s. Rate: 7.5 symbols/min [2025-09-22T19:55:04.604229] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T19:55:04.613275] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-22T19:55:06.207032] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T19:55:06.216764] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-22T19:55:07.691409] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T19:55:07.699673] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-22T19:55:09.563872] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T19:55:09.570349] [INFO ] [REMOTE ] MCO: Full fetch complete (56433 records). [2025-09-22T19:55:09.570472] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-22T19:55:09.959854] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-22T19:55:09.959963] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-22T19:55:09.960888] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-22T19:55:09.960965] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-22T19:55:09.962299] [DEBUG] [LOCAL ] MCO: Trimmed 56433 records to 39615 (keeping 200 days of data) [2025-09-22T19:55:10.220401] [DEBUG] [LOCAL ] MCO: Primary data saved (39615 records). [2025-09-22T19:55:10.220558] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-22T19:55:10.221197] [INFO ] [MAIN ] Update Progress: 1320/2372 symbols completed. MCO took 35.7s. Estimated remaining: 2h 19m 33s. Rate: 7.5 symbols/min [2025-09-22T19:55:10.857454] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:55:10.996734] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:55:11.013682] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:55:10.938590] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:55:11.024318] [DEBUG] [LOCAL ] MDST: Loaded 5577 existing records from primary storage. [2025-09-22T19:55:11.024558] [INFO ] [MAIN ] MDST: Loaded 5577 existing records. [2025-09-22T19:55:11.169990] [DEBUG] [LOCAL ] MCS: Loaded 21782 existing records from primary storage. [2025-09-22T19:55:11.196140] [INFO ] [MAIN ] MCS: Loaded 21782 existing records. [2025-09-22T19:55:11.197166] [DEBUG] [LOCAL ] MCY: Loaded 25942 existing records from primary storage. [2025-09-22T19:55:11.218853] [INFO ] [MAIN ] MCY: Loaded 25942 existing records. [2025-09-22T19:55:11.465976] [DEBUG] [LOCAL ] MD: Loaded 39347 existing records from primary storage. [2025-09-22T19:55:11.507670] [INFO ] [MAIN ] MD: Loaded 39347 existing records. [2025-09-22T19:55:11.460083] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:55:11.519521] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-22T19:55:11.563963] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-22T19:55:11.599067] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-22T19:55:11.692416] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-22T19:55:11.748329] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:55:11.840666] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-22T19:55:11.881765] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-22T19:55:11.881679] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:55:11.937736] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-22T19:55:11.943088] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-22T19:55:11.972173] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-22T19:55:11.977396] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-22T19:55:12.060000] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:55:12.070665] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-22T19:55:12.089851] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-22T19:55:12.110343] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-22T19:55:12.145144] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-22T19:55:12.249592] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-22T19:55:12.342383] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-22T19:55:12.858527] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:55:12.881970] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-22T19:55:13.353719] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:55:13.403414] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:55:13.403683] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-22T19:55:13.404014] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-22T19:55:13.487920] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:55:13.488570] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-22T19:55:13.782560] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T19:55:13.784606] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-22T19:55:14.464080] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T19:55:14.466606] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-22T19:55:14.529504] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T19:55:14.534199] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-22T19:55:14.615196] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T19:55:14.621290] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-22T19:55:14.748512] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T19:55:14.756428] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-22T19:55:15.076279] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T19:55:15.078393] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-22T19:55:15.223834] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-22T19:55:15.228216] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-22T19:55:15.751956] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T19:55:15.754366] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-22T19:55:15.775460] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T19:55:15.782949] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-22T19:55:16.182016] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T19:55:16.208067] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T19:55:16.286345] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T19:55:16.522059] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-22T19:55:16.889127] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T19:55:17.322051] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-22T19:55:17.984869] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T19:55:18.122037] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-22T19:55:18.163057] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T19:55:18.922068] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-22T19:55:19.353199] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-22T19:55:19.617612] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T19:55:19.722042] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-22T19:55:20.290692] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T19:55:20.522059] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-22T19:55:21.322047] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-22T19:55:21.593261] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T19:55:22.060382] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-22T19:55:22.122046] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-22T19:55:22.922056] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-22T19:55:23.284239] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T19:55:23.495796] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-22T19:55:23.722045] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-22T19:55:24.522114] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-22T19:55:25.192764] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T19:55:25.322024] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-22T19:55:25.497965] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T19:55:26.122047] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-22T19:55:26.775336] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T19:55:26.922099] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-22T19:55:27.389100] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T19:55:27.615418] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T19:55:27.617592] [INFO ] [REMOTE ] MDST: Full fetch complete (8381 records). [2025-09-22T19:55:27.617712] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-22T19:55:27.727180] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-22T19:55:28.028428] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-22T19:55:28.028566] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-22T19:55:28.028877] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-22T19:55:28.028953] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-22T19:55:28.029602] [DEBUG] [LOCAL ] MDST: Trimmed 8381 records to 5476 (keeping 200 days of data) [2025-09-22T19:55:28.071042] [DEBUG] [LOCAL ] MDST: Primary data saved (5476 records). [2025-09-22T19:55:28.071199] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-22T19:55:28.071315] [INFO ] [MAIN ] Update Progress: 1321/2372 symbols completed. MDST took 17.8s. Estimated remaining: 2h 19m 33s. Rate: 7.5 symbols/min [2025-09-22T19:55:28.275051] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:55:28.341252] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-22T19:55:28.341421] [INFO ] [MAIN ] MDT: Loaded 54458 existing records. [2025-09-22T19:55:28.543035] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-22T19:55:28.549788] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:55:28.551067] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-22T19:55:28.551148] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-22T19:55:28.553544] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-22T19:55:28.553710] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-22T19:55:29.116915] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:55:29.189822] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T19:55:29.322157] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-22T19:55:29.657175] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T19:55:30.122121] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-22T19:55:30.613969] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-22T19:55:30.922066] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-22T19:55:31.722060] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-22T19:55:31.984991] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T19:55:32.054596] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T19:55:32.506597] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T19:55:32.522050] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-22T19:55:33.322070] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-22T19:55:33.837762] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T19:55:34.122059] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-22T19:55:34.922026] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-22T19:55:35.214588] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-22T19:55:35.306037] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T19:55:35.310558] [INFO ] [REMOTE ] MCS: Full fetch complete (30198 records). [2025-09-22T19:55:35.310692] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-22T19:55:35.682194] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-22T19:55:35.682292] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-22T19:55:35.682925] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-22T19:55:35.682986] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-22T19:55:35.683772] [DEBUG] [LOCAL ] MCS: Trimmed 30198 records to 21239 (keeping 200 days of data) [2025-09-22T19:55:35.736310] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-22T19:55:35.814885] [DEBUG] [LOCAL ] MCS: Primary data saved (21239 records). [2025-09-22T19:55:35.815003] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-22T19:55:35.815096] [INFO ] [MAIN ] Update Progress: 1322/2372 symbols completed. MCS took 25.6s. Estimated remaining: 2h 19m 25s. Rate: 7.5 symbols/min [2025-09-22T19:55:35.993415] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:55:36.041032] [DEBUG] [LOCAL ] MDU: Loaded 48589 existing records from primary storage. [2025-09-22T19:55:36.041199] [INFO ] [MAIN ] MDU: Loaded 48589 existing records. [2025-09-22T19:55:36.225432] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:55:36.225758] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-22T19:55:36.225814] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-22T19:55:36.227144] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-22T19:55:36.227210] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-22T19:55:36.523661] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-22T19:55:36.630940] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:55:36.642049] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T19:55:36.667276] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T19:55:37.322064] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-22T19:55:38.122062] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-22T19:55:38.417101] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T19:55:38.452242] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T19:55:38.922059] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-22T19:55:39.537780] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T19:55:39.543808] [INFO ] [REMOTE ] MD: Full fetch complete (55270 records). [2025-09-22T19:55:39.543915] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-22T19:55:39.726011] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-22T19:55:39.932894] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-22T19:55:39.932984] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-22T19:55:39.933851] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-22T19:55:39.933915] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-22T19:55:39.935194] [DEBUG] [LOCAL ] MD: Trimmed 55270 records to 38643 (keeping 200 days of data) [2025-09-22T19:55:40.165974] [DEBUG] [LOCAL ] MD: Primary data saved (38643 records). [2025-09-22T19:55:40.166121] [INFO ] [MAIN ] MD: Full history saved. [2025-09-22T19:55:40.166209] [INFO ] [MAIN ] Update Progress: 1323/2372 symbols completed. MD took 29.9s. Estimated remaining: 2h 19m 14s. Rate: 7.5 symbols/min [2025-09-22T19:55:40.339813] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:55:40.350998] [DEBUG] [LOCAL ] MDV: Loaded 8942 existing records from primary storage. [2025-09-22T19:55:40.351123] [INFO ] [MAIN ] MDV: Loaded 8942 existing records. [2025-09-22T19:55:40.525556] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-22T19:55:40.530676] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:55:40.531942] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-22T19:55:40.532173] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-22T19:55:40.532785] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-22T19:55:40.532917] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-22T19:55:40.895363] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-22T19:55:40.946707] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:55:41.322045] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-22T19:55:41.654541] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-22T19:55:41.689621] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T19:55:41.940990] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-22T19:55:42.122062] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-22T19:55:42.922052] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-22T19:55:43.564692] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T19:55:43.722042] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-22T19:55:43.769933] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T19:55:44.522057] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-22T19:55:45.322050] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-22T19:55:45.739074] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T19:55:45.781512] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T19:55:46.122011] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-22T19:55:46.506736] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T19:55:46.510218] [INFO ] [REMOTE ] MCY: Full fetch complete (41716 records). [2025-09-22T19:55:46.510308] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-22T19:55:46.698611] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-22T19:55:46.910440] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-22T19:55:46.910548] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-22T19:55:46.911323] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-22T19:55:46.911398] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-22T19:55:46.912327] [DEBUG] [LOCAL ] MCY: Trimmed 41716 records to 25232 (keeping 200 days of data) [2025-09-22T19:55:46.922027] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-22T19:55:47.082482] [DEBUG] [LOCAL ] MCY: Primary data saved (25232 records). [2025-09-22T19:55:47.082618] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-22T19:55:47.082745] [INFO ] [MAIN ] Update Progress: 1324/2372 symbols completed. MCY took 36.9s. Estimated remaining: 2h 19m 5s. Rate: 7.5 symbols/min [2025-09-22T19:55:47.255279] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:55:47.272594] [DEBUG] [LOCAL ] MEC: Loaded 16915 existing records from primary storage. [2025-09-22T19:55:47.272770] [INFO ] [MAIN ] MEC: Loaded 16915 existing records. [2025-09-22T19:55:47.452932] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:55:47.453207] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-22T19:55:47.453262] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-22T19:55:47.453886] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-22T19:55:47.453951] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-22T19:55:47.727177] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-22T19:55:47.829088] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:55:47.835520] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T19:55:48.522082] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-22T19:55:49.306566] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T19:55:49.322043] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-22T19:55:49.843532] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-22T19:55:50.122130] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-22T19:55:50.321716] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-22T19:55:50.922090] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-22T19:55:51.705055] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-22T19:55:51.722026] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-22T19:55:51.833467] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T19:55:52.522075] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-22T19:55:53.322047] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-22T19:55:53.440675] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T19:55:53.442175] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T19:55:53.855817] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-22T19:55:54.122057] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-22T19:55:54.922065] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-22T19:55:55.722067] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-22T19:55:56.063233] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T19:55:56.275167] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T19:55:56.522036] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-22T19:55:56.648993] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-22T19:55:57.322074] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-22T19:55:58.127673] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-22T19:55:58.147220] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T19:55:58.922060] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-22T19:55:59.090978] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T19:55:59.144997] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T19:55:59.722091] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-22T19:56:00.429579] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T19:56:00.522110] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-22T19:56:00.672914] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-22T19:56:01.056603] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T19:56:01.322068] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-22T19:56:02.122117] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-22T19:56:02.880027] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T19:56:02.922059] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-22T19:56:03.213115] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T19:56:03.221458] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-09-22T19:56:03.221590] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-22T19:56:03.533157] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T19:56:03.550589] [INFO ] [REMOTE ] MDV: Full fetch complete (11632 records). [2025-09-22T19:56:03.560928] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-22T19:56:03.732965] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-22T19:56:03.738006] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-22T19:56:03.743915] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-22T19:56:03.786507] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-22T19:56:03.804453] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-22T19:56:03.930970] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-09-22T19:56:04.078244] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-22T19:56:04.078379] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-22T19:56:04.078697] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-22T19:56:04.103697] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-22T19:56:04.105603] [DEBUG] [LOCAL ] MDV: Trimmed 11632 records to 8806 (keeping 200 days of data) [2025-09-22T19:56:04.170999] [DEBUG] [LOCAL ] MDV: Primary data saved (8806 records). [2025-09-22T19:56:04.171811] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-22T19:56:04.172170] [INFO ] [MAIN ] Update Progress: 1325/2372 symbols completed. MDV took 24.0s. Estimated remaining: 2h 19m 5s. Rate: 7.5 symbols/min [2025-09-22T19:56:04.356185] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:56:04.385937] [DEBUG] [LOCAL ] MED: Loaded 22191 existing records from primary storage. [2025-09-22T19:56:04.387150] [INFO ] [MAIN ] MED: Loaded 22191 existing records. [2025-09-22T19:56:04.537361] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-22T19:56:04.642014] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:56:04.669680] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-22T19:56:04.670028] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-22T19:56:04.671246] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-22T19:56:04.671543] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-22T19:56:04.932563] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T19:56:05.095264] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:56:05.194394] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-09-22T19:56:05.194553] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-22T19:56:05.194678] [INFO ] [MAIN ] Update Progress: 1326/2372 symbols completed. MDT took 37.1s. Estimated remaining: 2h 18m 51s. Rate: 7.5 symbols/min [2025-09-22T19:56:05.327211] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-22T19:56:05.384743] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:56:05.421241] [DEBUG] [LOCAL ] MEG: Loaded 32614 existing records from primary storage. [2025-09-22T19:56:05.421391] [INFO ] [MAIN ] MEG: Loaded 32614 existing records. [2025-09-22T19:56:05.619435] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:56:05.619801] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-22T19:56:05.619860] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-22T19:56:05.620913] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-22T19:56:05.620977] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-22T19:56:06.016160] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:56:06.122037] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-22T19:56:06.273105] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T19:56:06.555287] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T19:56:06.922024] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-22T19:56:07.076492] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T19:56:07.722058] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-22T19:56:08.019142] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T19:56:08.522089] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-22T19:56:08.671431] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T19:56:09.322061] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-22T19:56:09.687748] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T19:56:10.122064] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-22T19:56:10.636726] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T19:56:10.922088] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-22T19:56:11.166589] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T19:56:11.722074] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-22T19:56:12.522052] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-22T19:56:12.659618] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T19:56:12.667471] [INFO ] [REMOTE ] MDU: Full fetch complete (70241 records). [2025-09-22T19:56:12.667617] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-22T19:56:13.093391] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T19:56:13.125244] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-22T19:56:13.125675] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-22T19:56:13.127012] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-22T19:56:13.127095] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-22T19:56:13.129192] [DEBUG] [LOCAL ] MDU: Trimmed 70241 records to 47873 (keeping 200 days of data) [2025-09-22T19:56:13.329494] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-22T19:56:13.441499] [DEBUG] [LOCAL ] MDU: Primary data saved (47873 records). [2025-09-22T19:56:13.441667] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-22T19:56:13.441776] [INFO ] [MAIN ] Update Progress: 1327/2372 symbols completed. MDU took 37.6s. Estimated remaining: 2h 18m 43s. Rate: 7.5 symbols/min [2025-09-22T19:56:13.612807] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:56:13.627523] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T19:56:13.650346] [DEBUG] [LOCAL ] MEGI: Loaded 20847 existing records from primary storage. [2025-09-22T19:56:13.650467] [INFO ] [MAIN ] MEGI: Loaded 20847 existing records. [2025-09-22T19:56:13.825615] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:56:13.825909] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-22T19:56:13.825957] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-22T19:56:13.826607] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-22T19:56:13.826700] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-22T19:56:14.127213] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-22T19:56:14.183129] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:56:14.594121] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T19:56:14.922056] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-22T19:56:15.328306] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T19:56:15.331270] [INFO ] [REMOTE ] MEC: Full fetch complete (22622 records). [2025-09-22T19:56:15.331343] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-22T19:56:15.705428] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-22T19:56:15.705504] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-22T19:56:15.705999] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-22T19:56:15.706059] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-22T19:56:15.706832] [DEBUG] [LOCAL ] MEC: Trimmed 22622 records to 16481 (keeping 200 days of data) [2025-09-22T19:56:15.749073] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-22T19:56:15.808573] [DEBUG] [LOCAL ] MEC: Primary data saved (16481 records). [2025-09-22T19:56:15.808767] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-22T19:56:15.808877] [INFO ] [MAIN ] Update Progress: 1328/2372 symbols completed. MEC took 28.7s. Estimated remaining: 2h 18m 31s. Rate: 7.5 symbols/min [2025-09-22T19:56:15.989765] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:56:16.025134] [DEBUG] [LOCAL ] MEI: Loaded 33152 existing records from primary storage. [2025-09-22T19:56:16.025287] [INFO ] [MAIN ] MEI: Loaded 33152 existing records. [2025-09-22T19:56:16.200906] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:56:16.201154] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-22T19:56:16.201201] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-22T19:56:16.202077] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-22T19:56:16.202136] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-22T19:56:16.525875] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-22T19:56:16.611755] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:56:16.637210] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T19:56:16.890294] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T19:56:17.322101] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-22T19:56:18.088267] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T19:56:18.122061] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-22T19:56:18.702229] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T19:56:18.922113] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-22T19:56:19.513806] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T19:56:19.722028] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-22T19:56:19.944021] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T19:56:20.522098] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-22T19:56:21.049690] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T19:56:21.322083] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-22T19:56:21.906855] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T19:56:22.122099] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-22T19:56:22.165608] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T19:56:22.922046] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-22T19:56:23.048021] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-22T19:56:23.722071] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-22T19:56:23.931730] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T19:56:24.522060] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-22T19:56:25.070925] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T19:56:25.322062] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-22T19:56:25.556098] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T19:56:26.122028] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-22T19:56:26.514378] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T19:56:26.922089] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-22T19:56:27.581957] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T19:56:27.722044] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-22T19:56:28.006368] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-22T19:56:28.382277] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-22T19:56:28.522037] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-22T19:56:29.322047] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-22T19:56:29.642254] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T19:56:30.122053] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-22T19:56:30.673603] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T19:56:30.679198] [INFO ] [REMOTE ] MEG: Full fetch complete (48312 records). [2025-09-22T19:56:30.679374] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-22T19:56:30.929940] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-22T19:56:31.082978] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-22T19:56:31.083068] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-22T19:56:31.084364] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-22T19:56:31.084443] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-22T19:56:31.085677] [DEBUG] [LOCAL ] MEG: Trimmed 48312 records to 31952 (keeping 200 days of data) [2025-09-22T19:56:31.278546] [DEBUG] [LOCAL ] MEG: Primary data saved (31952 records). [2025-09-22T19:56:31.278713] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-22T19:56:31.278854] [INFO ] [MAIN ] Update Progress: 1329/2372 symbols completed. MEG took 26.1s. Estimated remaining: 2h 18m 29s. Rate: 7.5 symbols/min [2025-09-22T19:56:31.448429] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:56:31.502170] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T19:56:31.529181] [DEBUG] [LOCAL ] MET: Loaded 54092 existing records from primary storage. [2025-09-22T19:56:31.529334] [INFO ] [MAIN ] MET: Loaded 54092 existing records. [2025-09-22T19:56:31.710394] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:56:31.710628] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-22T19:56:31.710707] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-22T19:56:31.711953] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-22T19:56:31.712013] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-22T19:56:31.727158] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-22T19:56:32.096326] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-22T19:56:32.109038] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:56:32.522099] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-22T19:56:32.755753] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T19:56:33.322069] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-22T19:56:34.132583] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-22T19:56:34.156558] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T19:56:34.186495] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T19:56:34.922035] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-22T19:56:35.234007] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T19:56:35.722055] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-22T19:56:36.142017] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T19:56:36.522067] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-22T19:56:37.290120] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T19:56:37.322022] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-22T19:56:37.637417] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T19:56:38.122132] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-22T19:56:38.425540] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T19:56:38.922059] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-22T19:56:39.722053] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-22T19:56:39.756866] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T19:56:40.201045] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T19:56:40.522018] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-22T19:56:40.855328] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T19:56:40.859010] [INFO ] [REMOTE ] MEGI: Full fetch complete (30695 records). [2025-09-22T19:56:40.859102] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-22T19:56:41.233985] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-22T19:56:41.234079] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-22T19:56:41.234867] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-22T19:56:41.234956] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-22T19:56:41.235885] [DEBUG] [LOCAL ] MEGI: Trimmed 30695 records to 20533 (keeping 200 days of data) [2025-09-22T19:56:41.333904] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-22T19:56:41.375592] [DEBUG] [LOCAL ] MEGI: Primary data saved (20533 records). [2025-09-22T19:56:41.375756] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-22T19:56:41.375955] [INFO ] [MAIN ] Update Progress: 1330/2372 symbols completed. MEGI took 27.9s. Estimated remaining: 2h 18m 23s. Rate: 7.5 symbols/min [2025-09-22T19:56:41.553390] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:56:41.600597] [DEBUG] [LOCAL ] MFA: Loaded 45843 existing records from primary storage. [2025-09-22T19:56:41.600831] [INFO ] [MAIN ] MFA: Loaded 45843 existing records. [2025-09-22T19:56:41.776959] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:56:41.777222] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-22T19:56:41.777276] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-22T19:56:41.778299] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-22T19:56:41.778360] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-22T19:56:42.151981] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-22T19:56:42.151879] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:56:42.191581] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T19:56:42.761037] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T19:56:42.906724] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T19:56:42.922008] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-22T19:56:43.722056] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-22T19:56:43.929430] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T19:56:44.522051] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-22T19:56:45.308712] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T19:56:45.321996] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-22T19:56:45.353786] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T19:56:45.359261] [INFO ] [REMOTE ] MED: Full fetch complete (33086 records). [2025-09-22T19:56:45.359363] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-22T19:56:45.745911] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-22T19:56:45.746059] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-22T19:56:45.747083] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-22T19:56:45.747201] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-22T19:56:45.749273] [DEBUG] [LOCAL ] MED: Trimmed 33086 records to 21844 (keeping 200 days of data) [2025-09-22T19:56:45.889060] [DEBUG] [LOCAL ] MED: Primary data saved (21844 records). [2025-09-22T19:56:45.889205] [INFO ] [MAIN ] MED: Full history saved. [2025-09-22T19:56:45.889335] [INFO ] [MAIN ] Update Progress: 1331/2372 symbols completed. MED took 41.7s. Estimated remaining: 2h 18m 12s. Rate: 7.5 symbols/min [2025-09-22T19:56:46.063358] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:56:46.073995] [DEBUG] [LOCAL ] MFAN: Loaded 4335 existing records from primary storage. [2025-09-22T19:56:46.074112] [INFO ] [MAIN ] MFAN: Loaded 4335 existing records. [2025-09-22T19:56:46.130137] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-22T19:56:46.260260] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:56:46.260554] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-22T19:56:46.260630] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-22T19:56:46.260929] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-22T19:56:46.260999] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-22T19:56:46.626091] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:56:46.649931] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T19:56:46.922017] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-22T19:56:47.552250] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T19:56:47.558239] [INFO ] [REMOTE ] MEI: Full fetch complete (45792 records). [2025-09-22T19:56:47.558395] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-22T19:56:47.735915] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-22T19:56:47.958111] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-22T19:56:47.958304] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-22T19:56:47.959105] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-22T19:56:47.959169] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-22T19:56:47.960311] [DEBUG] [LOCAL ] MEI: Trimmed 45792 records to 32712 (keeping 200 days of data) [2025-09-22T19:56:48.164486] [DEBUG] [LOCAL ] MEI: Primary data saved (32712 records). [2025-09-22T19:56:48.164634] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-22T19:56:48.164870] [INFO ] [MAIN ] Update Progress: 1332/2372 symbols completed. MEI took 32.4s. Estimated remaining: 2h 17m 60s. Rate: 7.5 symbols/min [2025-09-22T19:56:48.353215] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:56:48.359876] [DEBUG] [LOCAL ] MFAO: Loaded 3866 existing records from primary storage. [2025-09-22T19:56:48.359987] [INFO ] [MAIN ] MFAO: Loaded 3866 existing records. [2025-09-22T19:56:48.548166] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:56:48.548383] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-22T19:56:48.549772] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-22T19:56:48.549830] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-22T19:56:48.550120] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-22T19:56:48.550184] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-22T19:56:48.927266] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:56:48.958744] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-22T19:56:48.974626] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-22T19:56:49.322031] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-22T19:56:49.391946] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T19:56:50.122073] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-22T19:56:50.922030] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-22T19:56:51.028792] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T19:56:51.710244] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T19:56:51.727091] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-22T19:56:51.743741] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T19:56:52.522116] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-22T19:56:53.322064] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-22T19:56:53.549216] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T19:56:53.766499] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T19:56:53.972339] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T19:56:54.122067] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-22T19:56:54.922100] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-22T19:56:55.722060] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-22T19:56:55.796019] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T19:56:56.307741] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T19:56:56.531348] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-22T19:56:56.553519] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T19:56:57.322067] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-22T19:56:57.991430] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T19:56:58.055907] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T19:56:58.122023] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-22T19:56:58.922156] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-22T19:56:59.357615] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-22T19:56:59.656226] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T19:56:59.722068] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-22T19:57:00.522117] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-22T19:57:01.162378] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T19:57:01.322078] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-22T19:57:01.372574] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T19:57:02.122111] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-22T19:57:02.922090] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-22T19:57:03.612400] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T19:57:03.733420] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-22T19:57:03.736352] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-22T19:57:04.522149] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-22T19:57:04.802824] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T19:57:05.107211] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-22T19:57:05.115010] [INFO ] [REMOTE ] MFA: Full fetch complete (64643 records). [2025-09-22T19:57:05.115174] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-22T19:57:05.331297] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-22T19:57:05.516777] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-22T19:57:05.516872] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-22T19:57:05.517887] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-22T19:57:05.517954] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-22T19:57:05.519371] [DEBUG] [LOCAL ] MFA: Trimmed 64643 records to 45255 (keeping 200 days of data) [2025-09-22T19:57:05.799154] [DEBUG] [LOCAL ] MFA: Primary data saved (45255 records). [2025-09-22T19:57:05.799289] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-22T19:57:05.799400] [INFO ] [MAIN ] Update Progress: 1333/2372 symbols completed. MFA took 24.4s. Estimated remaining: 2h 17m 59s. Rate: 7.5 symbols/min [2025-09-22T19:57:05.974545] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:57:05.981183] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-22T19:57:06.032632] [DEBUG] [LOCAL ] MFC: Loaded 52127 existing records from primary storage. [2025-09-22T19:57:06.032801] [INFO ] [MAIN ] MFC: Loaded 52127 existing records. [2025-09-22T19:57:06.124867] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-22T19:57:06.220174] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:57:06.220760] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-22T19:57:06.220922] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-22T19:57:06.222582] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-22T19:57:06.222684] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-22T19:57:06.385686] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T19:57:06.497194] [INFO ] [REMOTE ] MET: Full fetch complete (77099 records). [2025-09-22T19:57:06.514611] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-22T19:57:06.722471] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:57:06.826286] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T19:57:06.930092] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-22T19:57:07.032463] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-22T19:57:07.032543] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-22T19:57:07.033568] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-22T19:57:07.033631] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-22T19:57:07.036570] [DEBUG] [LOCAL ] MET: Trimmed 77099 records to 53315 (keeping 200 days of data) [2025-09-22T19:57:07.382218] [DEBUG] [LOCAL ] MET: Primary data saved (53315 records). [2025-09-22T19:57:07.382608] [INFO ] [MAIN ] MET: Full history saved. [2025-09-22T19:57:07.382760] [INFO ] [MAIN ] Update Progress: 1334/2372 symbols completed. MET took 36.1s. Estimated remaining: 2h 17m 46s. Rate: 7.5 symbols/min [2025-09-22T19:57:07.551543] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:57:07.602258] [DEBUG] [LOCAL ] MFG: Loaded 49670 existing records from primary storage. [2025-09-22T19:57:07.602426] [INFO ] [MAIN ] MFG: Loaded 49670 existing records. [2025-09-22T19:57:07.727140] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-22T19:57:07.782956] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:57:07.783204] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-22T19:57:07.783266] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-22T19:57:07.784275] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-22T19:57:07.784336] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-22T19:57:08.139555] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:57:08.384452] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T19:57:08.409817] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T19:57:08.522016] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-22T19:57:09.322078] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-22T19:57:09.843447] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-22T19:57:10.122046] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-22T19:57:10.217366] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T19:57:10.682295] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-22T19:57:10.922076] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-22T19:57:11.722052] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-22T19:57:12.522083] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-22T19:57:12.581527] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T19:57:13.024044] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T19:57:13.066190] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-22T19:57:13.322052] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-22T19:57:14.122062] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-22T19:57:14.779152] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T19:57:14.922132] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-22T19:57:15.495177] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-22T19:57:15.722109] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-22T19:57:15.983009] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T19:57:16.163986] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-22T19:57:16.522107] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-22T19:57:17.322065] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-22T19:57:18.122143] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-22T19:57:18.922134] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-22T19:57:19.362803] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T19:57:19.451005] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-22T19:57:19.497607] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-22T19:57:19.636632] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T19:57:19.637809] [INFO ] [REMOTE ] MFAO: Full fetch complete (5235 records). [2025-09-22T19:57:19.637885] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-22T19:57:19.727223] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-22T19:57:20.003414] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-22T19:57:20.003503] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-22T19:57:20.003686] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-22T19:57:20.003757] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-22T19:57:20.004152] [DEBUG] [LOCAL ] MFAO: Trimmed 5235 records to 3825 (keeping 200 days of data) [2025-09-22T19:57:20.027833] [DEBUG] [LOCAL ] MFAO: Primary data saved (3825 records). [2025-09-22T19:57:20.027901] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-22T19:57:20.027996] [INFO ] [MAIN ] Update Progress: 1335/2372 symbols completed. MFAO took 31.9s. Estimated remaining: 2h 17m 42s. Rate: 7.5 symbols/min [2025-09-22T19:57:20.203972] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:57:20.220378] [DEBUG] [LOCAL ] MFM: Loaded 14537 existing records from primary storage. [2025-09-22T19:57:20.220519] [INFO ] [MAIN ] MFM: Loaded 14537 existing records. [2025-09-22T19:57:20.404503] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:57:20.404801] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-22T19:57:20.404852] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-22T19:57:20.405423] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-22T19:57:20.405494] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-22T19:57:20.527142] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-22T19:57:20.761094] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:57:21.328545] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-22T19:57:21.346512] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T19:57:22.122038] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-22T19:57:22.154552] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T19:57:22.185348] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T19:57:22.716822] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-22T19:57:22.718121] [INFO ] [REMOTE ] MFAN: Full fetch complete (5551 records). [2025-09-22T19:57:22.718190] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-22T19:57:22.927194] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-22T19:57:23.107554] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-22T19:57:23.107638] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-22T19:57:23.107842] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-22T19:57:23.107884] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-22T19:57:23.108310] [DEBUG] [LOCAL ] MFAN: Trimmed 5551 records to 4283 (keeping 200 days of data) [2025-09-22T19:57:23.137193] [DEBUG] [LOCAL ] MFAN: Primary data saved (4283 records). [2025-09-22T19:57:23.137354] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-22T19:57:23.137443] [INFO ] [MAIN ] Update Progress: 1336/2372 symbols completed. MFAN took 37.2s. Estimated remaining: 2h 17m 30s. Rate: 7.5 symbols/min [2025-09-22T19:57:23.314212] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:57:23.314429] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-22T19:57:23.314481] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-22T19:57:23.314675] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-22T19:57:23.314732] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-22T19:57:23.314777] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-22T19:57:23.314813] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-22T19:57:23.676886] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:57:23.722034] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-22T19:57:24.320316] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-22T19:57:24.522084] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-22T19:57:24.624977] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T19:57:25.322071] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-22T19:57:26.122023] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-22T19:57:26.159396] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T19:57:26.321320] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T19:57:26.362898] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-22T19:57:26.922114] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-22T19:57:27.164639] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-22T19:57:27.722101] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-22T19:57:28.052461] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-22T19:57:28.522120] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-22T19:57:29.305397] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T19:57:29.322014] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-22T19:57:30.122067] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-22T19:57:30.169497] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T19:57:30.922088] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-22T19:57:31.722047] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-22T19:57:31.968750] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-22T19:57:32.522071] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-22T19:57:32.562707] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-22T19:57:32.633569] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T19:57:33.322071] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-22T19:57:33.591013] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T19:57:34.122065] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-22T19:57:34.389834] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-22T19:57:34.798883] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T19:57:34.922089] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-22T19:57:35.722067] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-22T19:57:36.522077] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-22T19:57:36.599181] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T19:57:36.848572] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-22T19:57:37.322062] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-22T19:57:37.476400] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T19:57:37.576343] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-22T19:57:38.122074] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-22T19:57:38.642178] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-22T19:57:38.922093] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-22T19:57:39.503462] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-22T19:57:39.504790] [INFO ] [REMOTE ] MFSB: Full fetch complete (1522 records). [2025-09-22T19:57:39.504864] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-22T19:57:39.712850] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-22T19:57:39.713156] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:57:39.713245] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:57:39.713326] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-22T19:57:39.713406] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-22T19:57:39.713460] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-22T19:57:39.713544] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-22T19:57:39.713635] [INFO ] [MAIN ] Update Progress: 1337/2372 symbols completed. MFSB took 16.6s. Estimated remaining: 2h 17m 29s. Rate: 7.5 symbols/min [2025-09-22T19:57:39.727229] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-22T19:57:39.987971] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:57:39.988270] [DEBUG] [LOCAL ] MFSG: No existing data file found in primary storage. [2025-09-22T19:57:39.988327] [WARN ] [MAIN ] MFSG: No existing data found, performing full refresh instead. [2025-09-22T19:57:39.988491] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-22T19:57:39.988533] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-22T19:57:39.988576] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-22T19:57:39.988609] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-22T19:57:40.373234] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:57:40.522065] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-22T19:57:40.569423] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T19:57:41.322094] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-22T19:57:42.122076] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-22T19:57:42.209747] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T19:57:42.227728] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-22T19:57:42.235048] [INFO ] [REMOTE ] MFC: Full fetch complete (74277 records). [2025-09-22T19:57:42.235287] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-22T19:57:42.550447] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-22T19:57:42.671571] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-22T19:57:42.671732] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-22T19:57:42.673213] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-22T19:57:42.673289] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-22T19:57:42.675485] [DEBUG] [LOCAL ] MFC: Trimmed 74277 records to 51327 (keeping 200 days of data) [2025-09-22T19:57:42.922465] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-22T19:57:43.021257] [DEBUG] [LOCAL ] MFC: Primary data saved (51327 records). [2025-09-22T19:57:43.021475] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-22T19:57:43.021593] [INFO ] [MAIN ] Update Progress: 1338/2372 symbols completed. MFC took 37.2s. Estimated remaining: 2h 17m 17s. Rate: 7.5 symbols/min [2025-09-22T19:57:43.194589] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:57:43.194919] [DEBUG] [LOCAL ] MFSI: No existing data file found in primary storage. [2025-09-22T19:57:43.194975] [WARN ] [MAIN ] MFSI: No existing data found, performing full refresh instead. [2025-09-22T19:57:43.195208] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-22T19:57:43.195259] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-22T19:57:43.195303] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-22T19:57:43.195336] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-22T19:57:43.564846] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:57:43.722070] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-22T19:57:43.868302] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T19:57:44.267674] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-22T19:57:44.522075] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-22T19:57:45.085582] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-22T19:57:45.322082] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-22T19:57:45.873397] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T19:57:46.122057] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-22T19:57:46.544312] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T19:57:46.922105] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-22T19:57:47.540780] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T19:57:47.722041] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-22T19:57:48.407319] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T19:57:48.522052] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-22T19:57:49.249155] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T19:57:49.322041] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-22T19:57:50.094579] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T19:57:50.122011] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-22T19:57:50.800056] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T19:57:50.922082] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-22T19:57:51.722050] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-22T19:57:51.913523] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T19:57:52.522096] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-22T19:57:53.322024] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-22T19:57:53.442077] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T19:57:53.446619] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T19:57:53.456389] [INFO ] [REMOTE ] MFSI: Full fetch complete (13033 records). [2025-09-22T19:57:53.456470] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-22T19:57:53.643973] [WARN ] [VALIDATOR ] MFSI: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T19:57:53.644271] [FATAL] [MAIN ] MFSI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:57:53.644342] [WARN ] [MAIN ] MFSI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:57:53.644415] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-22T19:57:53.644480] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-22T19:57:53.644516] [INFO ] [LOCAL ] MFSI: Starting deletion of derivative data. [2025-09-22T19:57:53.644611] [DEBUG] [LOCAL ] MFSI: No derivative data file found to delete. [2025-09-22T19:57:53.644719] [INFO ] [MAIN ] Update Progress: 1339/2372 symbols completed. MFSI took 10.6s. Estimated remaining: 2h 17m 11s. Rate: 7.5 symbols/min [2025-09-22T19:57:53.751973] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T19:57:53.824283] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:57:53.824437] [DEBUG] [LOCAL ] MFSV: No existing data file found in primary storage. [2025-09-22T19:57:53.824475] [WARN ] [MAIN ] MFSV: No existing data found, performing full refresh instead. [2025-09-22T19:57:53.824621] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-22T19:57:53.824697] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-22T19:57:53.824754] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-22T19:57:53.824790] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-22T19:57:54.124010] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-22T19:57:54.211874] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:57:54.922050] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-22T19:57:55.030374] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-22T19:57:55.722052] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-22T19:57:56.384225] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-22T19:57:56.527199] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-22T19:57:56.543956] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T19:57:56.552666] [INFO ] [REMOTE ] MFG: Full fetch complete (68555 records). [2025-09-22T19:57:56.552896] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-22T19:57:56.979751] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-22T19:57:56.979840] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-22T19:57:56.980871] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-22T19:57:56.980938] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-22T19:57:56.982324] [DEBUG] [LOCAL ] MFG: Trimmed 68555 records to 49048 (keeping 200 days of data) [2025-09-22T19:57:57.275193] [DEBUG] [LOCAL ] MFG: Primary data saved (49048 records). [2025-09-22T19:57:57.281929] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-22T19:57:57.282278] [INFO ] [MAIN ] Update Progress: 1340/2372 symbols completed. MFG took 49.9s. Estimated remaining: 2h 17m 0s. Rate: 7.5 symbols/min [2025-09-22T19:57:57.283404] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T19:57:57.327157] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-22T19:57:57.333189] [INFO ] [REMOTE ] MFM: Full fetch complete (19091 records). [2025-09-22T19:57:57.359216] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-22T19:57:57.591388] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:57:57.789224] [DEBUG] [LOCAL ] MG: Loaded 17120 existing records from primary storage. [2025-09-22T19:57:57.795011] [INFO ] [MAIN ] MG: Loaded 17120 existing records. [2025-09-22T19:57:58.002977] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-22T19:57:58.026145] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-22T19:57:58.035622] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-22T19:57:58.058727] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-22T19:57:58.058551] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:57:58.063668] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T19:57:58.066097] [DEBUG] [LOCAL ] MFM: Trimmed 19091 records to 14268 (keeping 200 days of data) [2025-09-22T19:57:58.064103] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-22T19:57:58.066509] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-22T19:57:58.067248] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-22T19:57:58.067330] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-22T19:57:58.128827] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-22T19:57:58.392095] [DEBUG] [LOCAL ] MFM: Primary data saved (14268 records). [2025-09-22T19:57:58.430898] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-22T19:57:58.455851] [INFO ] [MAIN ] Update Progress: 1341/2372 symbols completed. MFM took 38.4s. Estimated remaining: 2h 16m 47s. Rate: 7.5 symbols/min [2025-09-22T19:57:58.649236] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:57:58.627921] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-22T19:57:58.748213] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:57:58.802282] [DEBUG] [LOCAL ] MGA: Loaded 51426 existing records from primary storage. [2025-09-22T19:57:58.802460] [INFO ] [MAIN ] MGA: Loaded 51426 existing records. [2025-09-22T19:57:58.927180] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-22T19:57:58.984946] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:57:58.985231] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-22T19:57:58.985308] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-22T19:57:58.987049] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-22T19:57:58.987110] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-22T19:57:59.352443] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:57:59.406705] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T19:57:59.722045] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-22T19:58:00.140117] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T19:58:00.522054] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-22T19:58:00.966222] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-22T19:58:01.322054] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-22T19:58:02.122113] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-22T19:58:02.845411] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T19:58:02.922041] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-22T19:58:03.452253] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T19:58:03.722071] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-22T19:58:03.984769] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T19:58:04.198009] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-22T19:58:04.522052] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-22T19:58:05.322041] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-22T19:58:05.428584] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T19:58:05.798391] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-22T19:58:06.122072] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-22T19:58:06.732898] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T19:58:06.922077] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-22T19:58:07.345413] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T19:58:07.722068] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-22T19:58:08.388128] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-22T19:58:08.522100] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-22T19:58:09.322070] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-22T19:58:10.122072] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-22T19:58:10.271572] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T19:58:10.365334] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T19:58:10.922066] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-22T19:58:10.951407] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T19:58:10.953310] [INFO ] [REMOTE ] MFSV: Full fetch complete (2930 records). [2025-09-22T19:58:10.953391] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-22T19:58:11.143289] [WARN ] [VALIDATOR ] MFSV: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T19:58:11.143512] [FATAL] [MAIN ] MFSV: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:58:11.143582] [WARN ] [MAIN ] MFSV: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:58:11.143676] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-22T19:58:11.143779] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-22T19:58:11.143835] [INFO ] [LOCAL ] MFSV: Starting deletion of derivative data. [2025-09-22T19:58:11.143879] [DEBUG] [LOCAL ] MFSV: No derivative data file found to delete. [2025-09-22T19:58:11.143943] [INFO ] [MAIN ] Update Progress: 1342/2372 symbols completed. MFSV took 17.5s. Estimated remaining: 2h 16m 43s. Rate: 7.5 symbols/min [2025-09-22T19:58:11.320195] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:58:11.326817] [DEBUG] [LOCAL ] MGF: Loaded 4190 existing records from primary storage. [2025-09-22T19:58:11.326917] [INFO ] [MAIN ] MGF: Loaded 4190 existing records. [2025-09-22T19:58:11.510222] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:58:11.510456] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-22T19:58:11.510503] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-22T19:58:11.510814] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-22T19:58:11.510875] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-22T19:58:11.628123] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T19:58:11.727247] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-22T19:58:11.876245] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:58:12.522092] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-22T19:58:13.118996] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-22T19:58:13.322061] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-22T19:58:13.457552] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T19:58:14.122053] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-22T19:58:14.355270] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T19:58:14.671602] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-22T19:58:14.922122] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-22T19:58:15.722058] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-22T19:58:16.522035] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-22T19:58:16.579075] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T19:58:16.722359] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T19:58:17.011227] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-22T19:58:17.322053] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-22T19:58:18.122045] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-22T19:58:18.396127] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T19:58:18.487887] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-22T19:58:18.922068] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-22T19:58:19.605637] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T19:58:19.722051] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-22T19:58:20.184277] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T19:58:20.522075] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-22T19:58:21.114500] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-22T19:58:21.116302] [INFO ] [REMOTE ] MFSG: Full fetch complete (5718 records). [2025-09-22T19:58:21.116372] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-22T19:58:21.326918] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-22T19:58:21.326828] [WARN ] [VALIDATOR ] MFSG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T19:58:21.328142] [FATAL] [MAIN ] MFSG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:58:21.328219] [WARN ] [MAIN ] MFSG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:58:21.328291] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-22T19:58:21.328366] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-22T19:58:21.328422] [INFO ] [LOCAL ] MFSG: Starting deletion of derivative data. [2025-09-22T19:58:21.328482] [DEBUG] [LOCAL ] MFSG: No derivative data file found to delete. [2025-09-22T19:58:21.328564] [INFO ] [MAIN ] Update Progress: 1343/2372 symbols completed. MFSG took 41.6s. Estimated remaining: 2h 16m 36s. Rate: 7.5 symbols/min [2025-09-22T19:58:21.509171] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:58:21.578525] [DEBUG] [LOCAL ] MGM: Loaded 54387 existing records from primary storage. [2025-09-22T19:58:21.578760] [INFO ] [MAIN ] MGM: Loaded 54387 existing records. [2025-09-22T19:58:21.754217] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:58:21.754507] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-22T19:58:21.754573] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-22T19:58:21.756681] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-22T19:58:21.756743] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-22T19:58:22.107752] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:58:22.122013] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-22T19:58:22.458171] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T19:58:22.922058] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-22T19:58:23.722080] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-22T19:58:23.971519] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T19:58:24.069674] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T19:58:24.522058] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-22T19:58:25.184385] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T19:58:25.322015] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-22T19:58:25.978742] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T19:58:26.122080] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-22T19:58:26.725694] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T19:58:26.922076] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-22T19:58:27.722038] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-22T19:58:27.806872] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T19:58:27.844624] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T19:58:28.522115] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-22T19:58:29.100165] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T19:58:29.123972] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-22T19:58:29.322076] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-22T19:58:30.122064] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-22T19:58:30.922053] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-22T19:58:30.986039] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T19:58:31.722690] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-22T19:58:31.729341] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T19:58:31.837806] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T19:58:31.841689] [INFO ] [REMOTE ] MG: Full fetch complete (24057 records). [2025-09-22T19:58:31.841820] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-22T19:58:32.238278] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-22T19:58:32.238381] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-22T19:58:32.238990] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-22T19:58:32.239059] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-22T19:58:32.240090] [DEBUG] [LOCAL ] MG: Trimmed 24057 records to 16813 (keeping 200 days of data) [2025-09-22T19:58:32.341146] [DEBUG] [LOCAL ] MG: Primary data saved (16813 records). [2025-09-22T19:58:32.341292] [INFO ] [MAIN ] MG: Full history saved. [2025-09-22T19:58:32.341381] [INFO ] [MAIN ] Update Progress: 1344/2372 symbols completed. MG took 35.1s. Estimated remaining: 2h 16m 31s. Rate: 7.5 symbols/min [2025-09-22T19:58:32.427446] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T19:58:32.527806] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-22T19:58:32.527738] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:58:32.537215] [DEBUG] [LOCAL ] MGR: Loaded 5756 existing records from primary storage. [2025-09-22T19:58:32.537373] [INFO ] [MAIN ] MGR: Loaded 5756 existing records. [2025-09-22T19:58:32.714490] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:58:32.714841] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-22T19:58:32.714896] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-22T19:58:32.715325] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-22T19:58:32.715385] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-22T19:58:33.069755] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:58:33.131302] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T19:58:33.322061] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-22T19:58:33.899430] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-22T19:58:34.122055] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-22T19:58:34.922073] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-22T19:58:35.406414] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-22T19:58:35.722068] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-22T19:58:36.018185] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T19:58:36.522059] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-22T19:58:37.280441] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T19:58:37.281822] [INFO ] [REMOTE ] MGF: Full fetch complete (5877 records). [2025-09-22T19:58:37.281899] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-22T19:58:37.327235] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-22T19:58:37.653195] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-22T19:58:37.653371] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-22T19:58:37.653666] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-22T19:58:37.653768] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-22T19:58:37.654627] [DEBUG] [LOCAL ] MGF: Trimmed 5877 records to 4108 (keeping 200 days of data) [2025-09-22T19:58:37.680156] [DEBUG] [LOCAL ] MGF: Primary data saved (4108 records). [2025-09-22T19:58:37.680284] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-22T19:58:37.680529] [INFO ] [MAIN ] Update Progress: 1345/2372 symbols completed. MGF took 26.5s. Estimated remaining: 2h 16m 21s. Rate: 7.5 symbols/min [2025-09-22T19:58:37.823186] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-22T19:58:37.845880] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-22T19:58:37.909535] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:58:37.916867] [DEBUG] [LOCAL ] MGRB: Loaded 4147 existing records from primary storage. [2025-09-22T19:58:37.916968] [INFO ] [MAIN ] MGRB: Loaded 4147 existing records. [2025-09-22T19:58:38.091025] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:58:38.091262] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-22T19:58:38.091318] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-22T19:58:38.091674] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-22T19:58:38.091735] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-22T19:58:38.122033] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-22T19:58:38.455680] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:58:38.922056] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-22T19:58:39.722139] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-22T19:58:39.869546] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T19:58:40.454360] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T19:58:40.522079] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-22T19:58:40.826195] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-22T19:58:40.955926] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T19:58:41.322047] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-22T19:58:42.122052] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-22T19:58:42.922124] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-22T19:58:42.962409] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T19:58:43.585160] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-22T19:58:43.722017] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-22T19:58:43.782981] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T19:58:43.793936] [INFO ] [REMOTE ] MGA: Full fetch complete (73706 records). [2025-09-22T19:58:43.794063] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-22T19:58:44.239737] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-22T19:58:44.239855] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-22T19:58:44.241032] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-22T19:58:44.241138] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-22T19:58:44.242812] [DEBUG] [LOCAL ] MGA: Trimmed 73706 records to 50661 (keeping 200 days of data) [2025-09-22T19:58:44.493056] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-22T19:58:44.522011] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-22T19:58:44.591063] [DEBUG] [LOCAL ] MGA: Primary data saved (50661 records). [2025-09-22T19:58:44.591223] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-22T19:58:44.591352] [INFO ] [MAIN ] Update Progress: 1346/2372 symbols completed. MGA took 46.1s. Estimated remaining: 2h 16m 12s. Rate: 7.5 symbols/min [2025-09-22T19:58:44.787677] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:58:44.793205] [DEBUG] [LOCAL ] MGRD: Loaded 2267 existing records from primary storage. [2025-09-22T19:58:44.793313] [INFO ] [MAIN ] MGRD: Loaded 2267 existing records. [2025-09-22T19:58:44.995446] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:58:44.995898] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-22T19:58:44.995973] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-22T19:58:44.996272] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-22T19:58:44.996342] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-22T19:58:45.114194] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-22T19:58:45.367977] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-22T19:58:45.454289] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:58:46.122140] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-22T19:58:46.722404] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-22T19:58:46.922118] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-22T19:58:47.410071] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-22T19:58:47.513838] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-22T19:58:47.722083] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-22T19:58:48.522074] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-22T19:58:49.063599] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-22T19:58:49.322061] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-22T19:58:49.400384] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T19:58:50.058425] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-22T19:58:50.122078] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-22T19:58:50.705422] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T19:58:50.922011] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-22T19:58:51.722060] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-22T19:58:52.064680] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T19:58:52.066168] [INFO ] [REMOTE ] MGR: Full fetch complete (8347 records). [2025-09-22T19:58:52.066260] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-22T19:58:52.348001] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-22T19:58:52.456979] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-22T19:58:52.457063] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-22T19:58:52.457310] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-22T19:58:52.457378] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-22T19:58:52.457854] [DEBUG] [LOCAL ] MGR: Trimmed 8347 records to 5660 (keeping 200 days of data) [2025-09-22T19:58:52.495521] [DEBUG] [LOCAL ] MGR: Primary data saved (5660 records). [2025-09-22T19:58:52.495680] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-22T19:58:52.495840] [INFO ] [MAIN ] Update Progress: 1347/2372 symbols completed. MGR took 20.2s. Estimated remaining: 2h 16m 4s. Rate: 7.5 symbols/min [2025-09-22T19:58:52.527137] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-22T19:58:52.669273] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:58:52.685011] [DEBUG] [LOCAL ] MGRE: Loaded 6651 existing records from primary storage. [2025-09-22T19:58:52.685170] [INFO ] [MAIN ] MGRE: Loaded 6651 existing records. [2025-09-22T19:58:52.862171] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:58:52.862437] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-22T19:58:52.862524] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-22T19:58:52.862915] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-22T19:58:52.863003] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-22T19:58:53.162271] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T19:58:53.241393] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:58:53.322024] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-22T19:58:53.761784] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-22T19:58:54.122101] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-22T19:58:54.922096] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-22T19:58:55.487199] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T19:58:55.722031] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-22T19:58:56.023057] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T19:58:56.033576] [INFO ] [REMOTE ] MGM: Full fetch complete (77596 records). [2025-09-22T19:58:56.033788] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-22T19:58:56.364866] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-22T19:58:56.469595] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-22T19:58:56.469720] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-22T19:58:56.470772] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-22T19:58:56.470840] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-22T19:58:56.475599] [DEBUG] [LOCAL ] MGM: Trimmed 77596 records to 53609 (keeping 200 days of data) [2025-09-22T19:58:56.538593] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-22T19:58:56.821144] [DEBUG] [LOCAL ] MGM: Primary data saved (53609 records). [2025-09-22T19:58:56.821300] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-22T19:58:56.821419] [INFO ] [MAIN ] Update Progress: 1348/2372 symbols completed. MGM took 35.5s. Estimated remaining: 2h 15m 53s. Rate: 7.5 symbols/min [2025-09-22T19:58:57.010225] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:58:57.077757] [DEBUG] [LOCAL ] MGY: Loaded 53216 existing records from primary storage. [2025-09-22T19:58:57.077913] [INFO ] [MAIN ] MGY: Loaded 53216 existing records. [2025-09-22T19:58:57.255447] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:58:57.255937] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-22T19:58:57.256003] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-22T19:58:57.264097] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T19:58:57.266464] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-22T19:58:57.266540] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-22T19:58:57.327232] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-22T19:58:57.675752] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:58:57.885668] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T19:58:58.122060] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-22T19:58:58.631016] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-22T19:58:58.922078] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-22T19:58:59.594465] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-22T19:58:59.722036] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-22T19:59:00.344687] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T19:59:00.522080] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-22T19:59:00.992833] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T19:59:01.322068] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-22T19:59:02.122089] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-22T19:59:02.617538] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-22T19:59:02.923773] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-22T19:59:02.931605] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T19:59:03.542741] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T19:59:03.722078] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-22T19:59:04.252168] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-22T19:59:04.522097] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-22T19:59:05.192989] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-22T19:59:05.322070] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-22T19:59:05.889348] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T19:59:06.122078] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-22T19:59:06.743810] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T19:59:06.922060] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-22T19:59:07.494629] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-22T19:59:07.722035] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-22T19:59:08.289254] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T19:59:08.290489] [INFO ] [REMOTE ] MGRB: Full fetch complete (6352 records). [2025-09-22T19:59:08.290564] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-22T19:59:08.531365] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-22T19:59:08.711133] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-22T19:59:08.711243] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-22T19:59:08.711500] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-22T19:59:08.711546] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-22T19:59:08.712025] [DEBUG] [LOCAL ] MGRB: Trimmed 6352 records to 4092 (keeping 200 days of data) [2025-09-22T19:59:08.740585] [DEBUG] [LOCAL ] MGRB: Primary data saved (4092 records). [2025-09-22T19:59:08.740856] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-22T19:59:08.741008] [INFO ] [MAIN ] Update Progress: 1349/2372 symbols completed. MGRB took 31.1s. Estimated remaining: 2h 15m 48s. Rate: 7.5 symbols/min [2025-09-22T19:59:08.951567] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:59:08.951877] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-22T19:59:08.951942] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-22T19:59:08.952214] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-22T19:59:08.952299] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-22T19:59:08.952352] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-22T19:59:08.952389] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-22T19:59:09.279442] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T19:59:09.327127] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-22T19:59:09.358544] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:59:10.122134] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-22T19:59:10.578126] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-22T19:59:10.922069] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-22T19:59:11.014269] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T19:59:11.586275] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T19:59:11.722043] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-22T19:59:12.233456] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-22T19:59:12.522112] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-22T19:59:13.213764] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T19:59:13.322065] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-22T19:59:13.542506] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:59:13.542874] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-22T19:59:14.122088] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-09-22T19:59:14.321150] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:59:14.321497] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-09-22T19:59:14.922077] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-22T19:59:15.706558] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-22T19:59:15.708263] [INFO ] [REMOTE ] MGRE: Full fetch complete (9422 records). [2025-09-22T19:59:15.708336] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-22T19:59:15.728955] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-22T19:59:16.071153] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-22T19:59:16.071239] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-22T19:59:16.071491] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-22T19:59:16.071529] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-22T19:59:16.072015] [DEBUG] [LOCAL ] MGRE: Trimmed 9422 records to 6610 (keeping 200 days of data) [2025-09-22T19:59:16.112015] [DEBUG] [LOCAL ] MGRE: Primary data saved (6610 records). [2025-09-22T19:59:16.112139] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-22T19:59:16.112248] [INFO ] [MAIN ] Update Progress: 1350/2372 symbols completed. MGRE took 23.6s. Estimated remaining: 2h 15m 40s. Rate: 7.5 symbols/min [2025-09-22T19:59:16.275734] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T19:59:16.297381] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:59:16.312947] [DEBUG] [LOCAL ] MHD: Loaded 12423 existing records from primary storage. [2025-09-22T19:59:16.313118] [INFO ] [MAIN ] MHD: Loaded 12423 existing records. [2025-09-22T19:59:16.489210] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:59:16.489481] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-22T19:59:16.489532] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-22T19:59:16.490094] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-22T19:59:16.490154] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-22T19:59:16.527260] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-22T19:59:16.847024] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:59:17.322076] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-22T19:59:18.122143] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-22T19:59:18.253633] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T19:59:18.325484] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-22T19:59:18.494428] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-22T19:59:18.495384] [INFO ] [REMOTE ] MGRD: Full fetch complete (3496 records). [2025-09-22T19:59:18.495500] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-22T19:59:18.852460] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-22T19:59:18.852542] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-22T19:59:18.852684] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-22T19:59:18.852743] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-22T19:59:18.853089] [DEBUG] [LOCAL ] MGRD: Trimmed 3496 records to 2208 (keeping 200 days of data) [2025-09-22T19:59:18.866809] [DEBUG] [LOCAL ] MGRD: Primary data saved (2208 records). [2025-09-22T19:59:18.866882] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-22T19:59:18.866957] [INFO ] [MAIN ] Update Progress: 1351/2372 symbols completed. MGRD took 34.3s. Estimated remaining: 2h 15m 28s. Rate: 7.5 symbols/min [2025-09-22T19:59:18.931715] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-22T19:59:19.042976] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:59:19.053864] [DEBUG] [LOCAL ] MHF: Loaded 8671 existing records from primary storage. [2025-09-22T19:59:19.053958] [INFO ] [MAIN ] MHF: Loaded 8671 existing records. [2025-09-22T19:59:19.230691] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:59:19.230946] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-22T19:59:19.231004] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-22T19:59:19.231412] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-22T19:59:19.231473] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-22T19:59:19.584295] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:59:19.722070] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-22T19:59:20.531496] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-22T19:59:20.560145] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T19:59:20.580417] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T19:59:20.754496] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:59:20.754899] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-22T19:59:21.322057] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-22T19:59:22.122061] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-22T19:59:22.803559] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T19:59:22.908285] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T19:59:22.922103] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-22T19:59:23.682794] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T19:59:23.722066] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-22T19:59:24.522029] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-22T19:59:24.595556] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T19:59:25.322096] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-22T19:59:25.367797] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T19:59:26.122108] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-22T19:59:26.211693] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T19:59:26.824680] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-22T19:59:26.922104] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-22T19:59:27.722067] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-22T19:59:27.838740] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T19:59:27.930436] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:59:27.930946] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-22T19:59:28.522073] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-22T19:59:29.142743] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-22T19:59:29.322070] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-22T19:59:29.930731] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T19:59:30.122057] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-22T19:59:30.924215] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-22T19:59:30.927557] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T19:59:31.125613] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:59:31.126138] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-22T19:59:31.722067] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-22T19:59:32.422615] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T19:59:32.522049] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-22T19:59:33.307525] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-22T19:59:33.322006] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-22T19:59:34.122107] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-22T19:59:34.242061] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T19:59:34.244362] [INFO ] [REMOTE ] MHF: Full fetch complete (12803 records). [2025-09-22T19:59:34.244442] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-22T19:59:34.623516] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-22T19:59:34.623605] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-22T19:59:34.623933] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-22T19:59:34.624007] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-22T19:59:34.624569] [DEBUG] [LOCAL ] MHF: Trimmed 12803 records to 8591 (keeping 200 days of data) [2025-09-22T19:59:34.675575] [DEBUG] [LOCAL ] MHF: Primary data saved (8591 records). [2025-09-22T19:59:34.675805] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-22T19:59:34.675927] [INFO ] [MAIN ] Update Progress: 1352/2372 symbols completed. MHF took 15.8s. Estimated remaining: 2h 15m 26s. Rate: 7.5 symbols/min [2025-09-22T19:59:34.875372] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:59:34.884386] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T19:59:34.922001] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-22T19:59:34.937850] [DEBUG] [LOCAL ] MHK: Loaded 43183 existing records from primary storage. [2025-09-22T19:59:34.938033] [INFO ] [MAIN ] MHK: Loaded 43183 existing records. [2025-09-22T19:59:35.140575] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:59:35.140869] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-22T19:59:35.140920] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-22T19:59:35.142211] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-22T19:59:35.142275] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-22T19:59:35.536706] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:59:35.722027] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-22T19:59:35.801700] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T19:59:35.911940] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:59:35.912265] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-22T19:59:36.522044] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-22T19:59:36.706536] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T19:59:36.706921] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-22T19:59:37.322046] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-22T19:59:38.122067] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-22T19:59:38.873114] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T19:59:38.922035] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-22T19:59:39.188792] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-22T19:59:39.722045] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-22T19:59:39.766151] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T19:59:40.522016] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-22T19:59:40.550785] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T19:59:41.322022] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-22T19:59:41.462915] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T19:59:41.467077] [INFO ] [REMOTE ] MHD: Full fetch complete (18794 records). [2025-09-22T19:59:41.467166] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-22T19:59:41.832578] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-22T19:59:41.832684] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-22T19:59:41.833303] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-22T19:59:41.833380] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-22T19:59:41.834118] [DEBUG] [LOCAL ] MHD: Trimmed 18794 records to 12106 (keeping 200 days of data) [2025-09-22T19:59:41.916122] [DEBUG] [LOCAL ] MHD: Primary data saved (12106 records). [2025-09-22T19:59:41.916354] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-22T19:59:41.916476] [INFO ] [MAIN ] Update Progress: 1353/2372 symbols completed. MHD took 25.8s. Estimated remaining: 2h 15m 17s. Rate: 7.5 symbols/min [2025-09-22T19:59:42.089180] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:59:42.089341] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-22T19:59:42.089377] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-22T19:59:42.089601] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-22T19:59:42.089689] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-22T19:59:42.089758] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-22T19:59:42.089791] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-22T19:59:42.127175] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-22T19:59:42.462766] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:59:42.688502] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T19:59:42.922052] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-22T19:59:43.252223] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-22T19:59:43.719360] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T19:59:43.723125] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-22T19:59:44.056573] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-22T19:59:44.522064] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-22T19:59:45.322086] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-22T19:59:46.122154] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-22T19:59:46.135300] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T19:59:46.683325] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T19:59:46.690212] [INFO ] [REMOTE ] MH: Full fetch complete (11830 records). [2025-09-22T19:59:46.690338] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-22T19:59:46.899634] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 42 unique days, need 200 days [2025-09-22T19:59:46.899987] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-22T19:59:46.900069] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-22T19:59:46.900143] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-22T19:59:46.900213] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-22T19:59:46.900249] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-22T19:59:46.900289] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-22T19:59:46.900351] [INFO ] [MAIN ] Update Progress: 1354/2372 symbols completed. MH took 38.2s. Estimated remaining: 2h 15m 7s. Rate: 7.5 symbols/min [2025-09-22T19:59:46.931634] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-22T19:59:47.089976] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:59:47.104188] [DEBUG] [LOCAL ] MHN: Loaded 7887 existing records from primary storage. [2025-09-22T19:59:47.104349] [INFO ] [MAIN ] MHN: Loaded 7887 existing records. [2025-09-22T19:59:47.302904] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:59:47.303357] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-22T19:59:47.303428] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-22T19:59:47.303966] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-22T19:59:47.304117] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-22T19:59:47.351453] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T19:59:47.500923] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T19:59:47.718402] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:59:47.722001] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-22T19:59:48.522745] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-22T19:59:48.524725] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-22T19:59:49.322067] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-22T19:59:50.122063] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-22T19:59:50.166962] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T19:59:50.168044] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T19:59:50.922058] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-22T19:59:51.666898] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T19:59:51.732190] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-22T19:59:51.736417] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T19:59:52.522070] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-22T19:59:52.862605] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-22T19:59:53.322054] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-22T19:59:53.498600] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T19:59:53.507196] [INFO ] [REMOTE ] MGY: Full fetch complete (75504 records). [2025-09-22T19:59:53.507368] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-22T19:59:53.790771] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T19:59:53.915260] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-22T19:59:53.915353] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-22T19:59:53.916458] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-22T19:59:53.916529] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-22T19:59:53.918097] [DEBUG] [LOCAL ] MGY: Trimmed 75504 records to 52428 (keeping 200 days of data) [2025-09-22T19:59:54.138154] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-22T19:59:54.257080] [DEBUG] [LOCAL ] MGY: Primary data saved (52428 records). [2025-09-22T19:59:54.257276] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-22T19:59:54.257397] [INFO ] [MAIN ] Update Progress: 1355/2372 symbols completed. MGY took 57.4s. Estimated remaining: 2h 14m 59s. Rate: 7.5 symbols/min [2025-09-22T19:59:54.429548] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T19:59:54.454706] [DEBUG] [LOCAL ] MHO: Loaded 24873 existing records from primary storage. [2025-09-22T19:59:54.454844] [INFO ] [MAIN ] MHO: Loaded 24873 existing records. [2025-09-22T19:59:54.636004] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T19:59:54.636304] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-22T19:59:54.636353] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-22T19:59:54.637047] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-22T19:59:54.637121] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-22T19:59:54.899391] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-22T19:59:54.923163] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-22T19:59:55.029432] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T19:59:55.722073] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-22T19:59:56.527683] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-22T19:59:56.539116] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T19:59:56.609542] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T19:59:57.064067] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-22T19:59:57.322065] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-22T19:59:58.107538] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T19:59:58.122005] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-22T19:59:58.837927] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T19:59:58.922047] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-22T19:59:59.631279] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T19:59:59.722014] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-22T20:00:00.490525] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T20:00:00.522006] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-22T20:00:01.324551] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-22T20:00:01.328882] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-22T20:00:02.122071] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-22T20:00:02.854225] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T20:00:02.922069] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-22T20:00:03.722122] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-22T20:00:04.522354] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-22T20:00:04.740431] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-22T20:00:05.304236] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T20:00:05.306556] [INFO ] [REMOTE ] MHN: Full fetch complete (11993 records). [2025-09-22T20:00:05.306714] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-22T20:00:05.341962] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-22T20:00:05.818808] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-22T20:00:05.818929] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-22T20:00:05.819354] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-22T20:00:05.819401] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-22T20:00:05.820202] [DEBUG] [LOCAL ] MHN: Trimmed 11993 records to 7771 (keeping 200 days of data) [2025-09-22T20:00:05.885406] [DEBUG] [LOCAL ] MHN: Primary data saved (7771 records). [2025-09-22T20:00:05.885854] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-22T20:00:05.886138] [INFO ] [MAIN ] Update Progress: 1356/2372 symbols completed. MHN took 19.0s. Estimated remaining: 2h 14m 54s. Rate: 7.5 symbols/min [2025-09-22T20:00:06.012412] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T20:00:06.126709] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:00:06.127769] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-22T20:00:06.129077] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (3.21 seconds). [2025-09-22T20:00:06.129228] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-22T20:00:06.137422] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-22T20:00:06.138709] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-22T20:00:06.138788] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-22T20:00:06.138845] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-22T20:00:06.138882] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-22T20:00:06.534878] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:00:06.922111] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-22T20:00:06.951327] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-22T20:00:07.251613] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:00:07.252044] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-22T20:00:07.291635] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T20:00:07.722107] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-09-22T20:00:07.938283] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:00:07.938723] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-09-22T20:00:08.522067] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-22T20:00:09.322069] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-22T20:00:09.603581] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:00:09.604024] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-22T20:00:09.875698] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T20:00:10.122086] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-22T20:00:10.454908] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-22T20:00:10.922068] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-22T20:00:11.398168] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-22T20:00:11.399389] [INFO ] [REMOTE ] MHLA: Full fetch complete (1551 records). [2025-09-22T20:00:11.399486] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-22T20:00:11.590505] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-22T20:00:11.590746] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:00:11.590816] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:00:11.590886] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-22T20:00:11.590954] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-22T20:00:11.590990] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-22T20:00:11.591028] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-22T20:00:11.591085] [INFO ] [MAIN ] Update Progress: 1357/2372 symbols completed. MHLA took 29.7s. Estimated remaining: 2h 14m 44s. Rate: 7.5 symbols/min [2025-09-22T20:00:11.722094] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-22T20:00:12.522091] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-22T20:00:12.943816] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T20:00:13.322063] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-22T20:00:13.514812] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:00:13.515350] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-22T20:00:14.122042] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-22T20:00:14.157011] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T20:00:14.922076] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-22T20:00:15.269401] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-22T20:00:15.722114] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-22T20:00:16.223042] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T20:00:16.522186] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-22T20:00:16.715290] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T20:00:16.988350] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:00:16.988972] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-22T20:00:17.322082] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-22T20:00:17.965036] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:00:17.965584] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-22T20:00:18.122076] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-22T20:00:18.922083] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-22T20:00:19.722174] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-22T20:00:19.801730] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T20:00:19.947416] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:00:19.947926] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-22T20:00:20.522158] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-22T20:00:20.580773] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T20:00:20.730128] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:00:20.730609] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-22T20:00:21.322109] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-22T20:00:22.122191] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-22T20:00:22.930129] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-22T20:00:22.936728] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T20:00:23.371631] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T20:00:23.722083] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-22T20:00:24.219420] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T20:00:24.522080] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-22T20:00:25.289213] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T20:00:25.296063] [INFO ] [REMOTE ] MHK: Full fetch complete (60954 records). [2025-09-22T20:00:25.296227] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-22T20:00:25.328383] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-22T20:00:25.688134] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-22T20:00:25.688317] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-22T20:00:25.689483] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-22T20:00:25.689567] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-22T20:00:25.696760] [DEBUG] [LOCAL ] MHK: Trimmed 60954 records to 42556 (keeping 200 days of data) [2025-09-22T20:00:25.707190] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T20:00:25.712229] [INFO ] [REMOTE ] MHO: Full fetch complete (37477 records). [2025-09-22T20:00:25.712346] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-22T20:00:26.361956] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-22T20:00:26.362471] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-22T20:00:26.363708] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-22T20:00:26.363804] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-22T20:00:26.367180] [DEBUG] [LOCAL ] MHO: Trimmed 37477 records to 24376 (keeping 200 days of data) [2025-09-22T20:00:26.525277] [DEBUG] [LOCAL ] MHK: Primary data saved (42556 records). [2025-09-22T20:00:26.526233] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-22T20:00:26.526689] [INFO ] [MAIN ] Update Progress: 1358/2372 symbols completed. MHK took 51.9s. Estimated remaining: 2h 14m 41s. Rate: 7.5 symbols/min [2025-09-22T20:00:26.563413] [DEBUG] [LOCAL ] MHO: Primary data saved (24376 records). [2025-09-22T20:00:26.563561] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-22T20:00:26.563674] [INFO ] [MAIN ] Update Progress: 1359/2372 symbols completed. MHO took 32.3s. Estimated remaining: 2h 14m 27s. Rate: 7.5 symbols/min [2025-09-22T20:00:26.991256] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T20:00:26.997875] [INFO ] [REMOTE ] MIAX: Full fetch complete (8198 records). [2025-09-22T20:00:26.998010] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-22T20:00:27.209131] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 27 unique days, need 200 days [2025-09-22T20:00:27.209409] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:00:27.209481] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:00:27.209554] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-22T20:00:27.209622] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-22T20:00:27.209692] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-22T20:00:27.209751] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-22T20:00:27.209813] [INFO ] [MAIN ] Update Progress: 1360/2372 symbols completed. MIAX took 21.3s. Estimated remaining: 2h 14m 14s. Rate: 7.5 symbols/min [2025-09-22T20:00:27.925170] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:00:27.981333] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:00:27.985378] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:00:28.008212] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:00:28.008540] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-22T20:00:28.008615] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-22T20:00:28.008993] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-22T20:00:28.009097] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-22T20:00:28.009202] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-22T20:00:28.009383] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-22T20:00:28.080057] [DEBUG] [LOCAL ] MITP: Loaded 2434 existing records from primary storage. [2025-09-22T20:00:28.114028] [INFO ] [MAIN ] MITP: Loaded 2434 existing records. [2025-09-22T20:00:28.119497] [DEBUG] [LOCAL ] MIN: Loaded 13288 existing records from primary storage. [2025-09-22T20:00:28.140364] [INFO ] [MAIN ] MIN: Loaded 13288 existing records. [2025-09-22T20:00:28.562923] [DEBUG] [LOCAL ] MIR: Loaded 51550 existing records from primary storage. [2025-09-22T20:00:28.675910] [INFO ] [MAIN ] MIR: Loaded 51550 existing records. [2025-09-22T20:00:28.792934] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:00:28.856747] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-22T20:00:28.847721] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:00:28.857038] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-22T20:00:28.893678] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-22T20:00:28.899185] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-22T20:00:28.923693] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-22T20:00:28.966806] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-22T20:00:29.064391] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:00:29.080780] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-22T20:00:29.075305] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-22T20:00:29.117763] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-22T20:00:29.250539] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:00:29.293431] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-22T20:00:29.317842] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-22T20:00:29.350587] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-22T20:00:29.386827] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-22T20:00:29.620006] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-22T20:00:29.676272] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-22T20:00:30.086719] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:00:30.134364] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-22T20:00:30.134004] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T20:00:30.205817] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-22T20:00:30.247543] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:00:30.254238] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-22T20:00:30.338635] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:00:30.339054] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-22T20:00:30.835836] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-22T20:00:30.841565] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T20:00:30.922068] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-22T20:00:31.093107] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T20:00:31.479299] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T20:00:31.681152] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T20:00:31.722011] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-22T20:00:32.134158] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-22T20:00:32.522057] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-22T20:00:32.974147] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T20:00:33.322057] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-22T20:00:33.671574] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-22T20:00:34.122060] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-22T20:00:34.922037] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-22T20:00:35.071568] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T20:00:35.278225] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-22T20:00:35.722070] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-22T20:00:36.056501] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-22T20:00:36.522055] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-22T20:00:37.261259] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T20:00:37.322061] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-22T20:00:37.815900] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-22T20:00:38.122074] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-22T20:00:38.552002] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T20:00:38.922113] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-22T20:00:39.427866] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-22T20:00:39.722055] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-22T20:00:40.239683] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-22T20:00:40.522073] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-22T20:00:41.322030] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-22T20:00:41.499415] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T20:00:42.122059] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-22T20:00:42.897620] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T20:00:42.922004] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-22T20:00:42.994452] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T20:00:43.722083] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-22T20:00:43.750606] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T20:00:44.274624] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-22T20:00:44.522062] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-22T20:00:44.944600] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-22T20:00:45.322055] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-22T20:00:45.803557] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-22T20:00:45.804324] [INFO ] [REMOTE ] MITN: Full fetch complete (2292 records). [2025-09-22T20:00:45.804393] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-22T20:00:46.002367] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T20:00:46.002720] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:00:46.002801] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:00:46.002881] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-22T20:00:46.002962] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-22T20:00:46.003077] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-22T20:00:46.003141] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-22T20:00:46.003202] [INFO ] [MAIN ] Update Progress: 1361/2372 symbols completed. MITN took 18.8s. Estimated remaining: 2h 14m 14s. Rate: 7.5 symbols/min [2025-09-22T20:00:46.127226] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-22T20:00:46.174223] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:00:46.197696] [DEBUG] [LOCAL ] MITT: Loaded 23333 existing records from primary storage. [2025-09-22T20:00:46.197844] [INFO ] [MAIN ] MITT: Loaded 23333 existing records. [2025-09-22T20:00:46.375072] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:00:46.375349] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-22T20:00:46.375399] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-22T20:00:46.376404] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-22T20:00:46.376465] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-22T20:00:46.668122] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-22T20:00:46.756991] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:00:46.922070] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-22T20:00:47.358560] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T20:00:47.722068] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-22T20:00:48.522110] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-22T20:00:49.055908] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T20:00:49.322049] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-22T20:00:50.063152] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T20:00:50.122034] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-22T20:00:50.572818] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T20:00:50.922082] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-22T20:00:51.454358] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T20:00:51.686316] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-22T20:00:51.722010] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-22T20:00:52.522042] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-22T20:00:52.865438] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T20:00:53.322060] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-22T20:00:53.767680] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T20:00:53.768580] [INFO ] [REMOTE ] MITP: Full fetch complete (3361 records). [2025-09-22T20:00:53.768687] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-22T20:00:54.122613] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-22T20:00:54.226015] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-22T20:00:54.226122] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-22T20:00:54.226270] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-22T20:00:54.226432] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-22T20:00:54.227084] [DEBUG] [LOCAL ] MITP: Trimmed 3361 records to 2445 (keeping 200 days of data) [2025-09-22T20:00:54.272401] [DEBUG] [LOCAL ] MITP: Primary data saved (2445 records). [2025-09-22T20:00:54.273495] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-22T20:00:54.275202] [INFO ] [MAIN ] Update Progress: 1362/2372 symbols completed. MITP took 27.1s. Estimated remaining: 2h 14m 6s. Rate: 7.5 symbols/min [2025-09-22T20:00:54.275025] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T20:00:54.479067] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:00:54.490387] [DEBUG] [LOCAL ] MIY: Loaded 6122 existing records from primary storage. [2025-09-22T20:00:54.490553] [INFO ] [MAIN ] MIY: Loaded 6122 existing records. [2025-09-22T20:00:54.670344] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:00:54.670639] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-22T20:00:54.670721] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-22T20:00:54.671090] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-22T20:00:54.671150] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-22T20:00:54.927241] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-22T20:00:55.028780] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:00:55.204251] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T20:00:55.665374] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-22T20:00:55.722051] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-22T20:00:56.495470] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T20:00:56.522034] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-22T20:00:57.007154] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-22T20:00:57.322083] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-22T20:00:58.012733] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T20:00:58.122064] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-22T20:00:58.922093] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-22T20:00:59.722040] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-22T20:00:59.807473] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T20:01:00.118929] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T20:01:00.522079] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-22T20:01:00.802414] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T20:01:00.804779] [INFO ] [REMOTE ] MIN: Full fetch complete (17887 records). [2025-09-22T20:01:00.804864] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-22T20:01:01.179212] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-22T20:01:01.179368] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-22T20:01:01.179885] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-22T20:01:01.180081] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-22T20:01:01.180863] [DEBUG] [LOCAL ] MIN: Trimmed 17887 records to 13161 (keeping 200 days of data) [2025-09-22T20:01:01.267587] [DEBUG] [LOCAL ] MIN: Primary data saved (13161 records). [2025-09-22T20:01:01.267810] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-22T20:01:01.267920] [INFO ] [MAIN ] Update Progress: 1363/2372 symbols completed. MIN took 34.1s. Estimated remaining: 2h 13m 58s. Rate: 7.5 symbols/min [2025-09-22T20:01:01.332745] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-22T20:01:01.382032] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-22T20:01:01.456040] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:01:01.517466] [DEBUG] [LOCAL ] MKC: Loaded 53211 existing records from primary storage. [2025-09-22T20:01:01.517614] [INFO ] [MAIN ] MKC: Loaded 53211 existing records. [2025-09-22T20:01:01.694072] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:01:01.694326] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-22T20:01:01.694372] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-22T20:01:01.696241] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-22T20:01:01.696302] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-22T20:01:02.060078] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:01:02.122022] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-22T20:01:02.922082] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-22T20:01:03.196042] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-22T20:01:03.389253] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T20:01:03.722066] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-22T20:01:04.358393] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T20:01:04.522097] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-22T20:01:05.171606] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T20:01:05.322013] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-22T20:01:05.585204] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T20:01:06.122070] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-22T20:01:06.922027] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-22T20:01:07.028634] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T20:01:07.030290] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-22T20:01:07.348314] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T20:01:07.722070] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-22T20:01:08.522071] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-22T20:01:09.322086] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-22T20:01:09.485795] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T20:01:09.497823] [INFO ] [REMOTE ] MIR: Full fetch complete (73403 records). [2025-09-22T20:01:09.498050] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-22T20:01:10.075220] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-22T20:01:10.075366] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-22T20:01:10.076993] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-22T20:01:10.077129] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-22T20:01:10.079125] [DEBUG] [LOCAL ] MIR: Trimmed 73403 records to 50819 (keeping 200 days of data) [2025-09-22T20:01:10.165150] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-22T20:01:10.418712] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T20:01:10.453492] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T20:01:10.576474] [DEBUG] [LOCAL ] MIR: Primary data saved (50819 records). [2025-09-22T20:01:10.576631] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-22T20:01:10.576817] [INFO ] [MAIN ] Update Progress: 1364/2372 symbols completed. MIR took 43.4s. Estimated remaining: 2h 13m 51s. Rate: 7.5 symbols/min [2025-09-22T20:01:10.768156] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:01:10.808688] [DEBUG] [LOCAL ] MKL: Loaded 34735 existing records from primary storage. [2025-09-22T20:01:10.808858] [INFO ] [MAIN ] MKL: Loaded 34735 existing records. [2025-09-22T20:01:10.919343] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T20:01:10.925410] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-22T20:01:11.008423] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:01:11.008750] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-22T20:01:11.008821] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-22T20:01:11.009928] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-22T20:01:11.009996] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-22T20:01:11.420214] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:01:11.722084] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-22T20:01:12.522107] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-22T20:01:12.746062] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T20:01:13.322070] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-22T20:01:13.491383] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T20:01:13.641497] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T20:01:14.041836] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T20:01:14.122114] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-22T20:01:14.867976] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T20:01:14.922048] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-22T20:01:15.527556] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T20:01:15.722063] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-22T20:01:16.421277] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-22T20:01:16.423116] [INFO ] [REMOTE ] MIY: Full fetch complete (9100 records). [2025-09-22T20:01:16.423205] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-22T20:01:16.527183] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-22T20:01:16.815764] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-22T20:01:16.815874] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-22T20:01:16.816279] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-22T20:01:16.816325] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-22T20:01:16.816870] [DEBUG] [LOCAL ] MIY: Trimmed 9100 records to 5997 (keeping 200 days of data) [2025-09-22T20:01:16.863543] [DEBUG] [LOCAL ] MIY: Primary data saved (5997 records). [2025-09-22T20:01:16.863776] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-22T20:01:16.863932] [INFO ] [MAIN ] Update Progress: 1365/2372 symbols completed. MIY took 22.6s. Estimated remaining: 2h 13m 41s. Rate: 7.5 symbols/min [2025-09-22T20:01:17.066386] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:01:17.143514] [DEBUG] [LOCAL ] MLI: Loaded 44630 existing records from primary storage. [2025-09-22T20:01:17.143835] [INFO ] [MAIN ] MLI: Loaded 44630 existing records. [2025-09-22T20:01:17.328824] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-22T20:01:17.337746] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:01:17.338116] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-22T20:01:17.338176] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-22T20:01:17.339757] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-22T20:01:17.339829] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-22T20:01:17.752918] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:01:18.122071] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-22T20:01:18.261567] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T20:01:18.469764] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T20:01:18.478374] [INFO ] [REMOTE ] MITT: Full fetch complete (34907 records). [2025-09-22T20:01:18.478795] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-22T20:01:18.921687] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-22T20:01:18.921780] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-22T20:01:18.923108] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-22T20:01:18.923237] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-22T20:01:18.924001] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-22T20:01:18.927470] [DEBUG] [LOCAL ] MITT: Trimmed 34907 records to 22866 (keeping 200 days of data) [2025-09-22T20:01:19.078002] [DEBUG] [LOCAL ] MITT: Primary data saved (22866 records). [2025-09-22T20:01:19.078149] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-22T20:01:19.078296] [INFO ] [MAIN ] Update Progress: 1366/2372 symbols completed. MITT took 33.1s. Estimated remaining: 2h 13m 29s. Rate: 7.5 symbols/min [2025-09-22T20:01:19.252471] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:01:19.300326] [DEBUG] [LOCAL ] MLM: Loaded 31890 existing records from primary storage. [2025-09-22T20:01:19.300481] [INFO ] [MAIN ] MLM: Loaded 31890 existing records. [2025-09-22T20:01:19.499714] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:01:19.500508] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-22T20:01:19.500742] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-22T20:01:19.502247] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-22T20:01:19.502543] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-22T20:01:19.748193] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-22T20:01:19.904303] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T20:01:19.983455] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:01:20.346743] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T20:01:20.522106] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-22T20:01:21.322042] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-22T20:01:21.550822] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T20:01:21.876945] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T20:01:22.122121] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-22T20:01:22.925702] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-22T20:01:22.928409] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T20:01:23.722057] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-22T20:01:23.825688] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T20:01:24.447752] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T20:01:24.522108] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-22T20:01:25.306425] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T20:01:25.322010] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-22T20:01:25.970575] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T20:01:26.122054] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-22T20:01:26.862062] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T20:01:26.922055] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-22T20:01:27.637884] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T20:01:27.722056] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-22T20:01:28.522116] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-22T20:01:28.810705] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T20:01:29.182181] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T20:01:29.322033] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-22T20:01:30.122054] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-22T20:01:30.289897] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T20:01:30.681809] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T20:01:30.922096] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-22T20:01:31.503514] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T20:01:31.722057] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-22T20:01:32.321948] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T20:01:32.522061] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-22T20:01:33.235816] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T20:01:33.322068] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-22T20:01:33.974247] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T20:01:34.122072] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-22T20:01:34.924426] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-22T20:01:34.927281] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T20:01:35.541372] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T20:01:35.722092] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-22T20:01:36.375721] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T20:01:36.522066] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-22T20:01:37.322059] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-22T20:01:37.541237] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T20:01:37.840580] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T20:01:38.122055] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-22T20:01:38.922068] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-22T20:01:39.082436] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T20:01:39.366010] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T20:01:39.371411] [INFO ] [REMOTE ] MKL: Full fetch complete (49713 records). [2025-09-22T20:01:39.371525] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-22T20:01:39.727262] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-22T20:01:39.797415] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-22T20:01:39.797543] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-22T20:01:39.798597] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-22T20:01:39.798700] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-22T20:01:39.799875] [DEBUG] [LOCAL ] MKL: Trimmed 49713 records to 34159 (keeping 200 days of data) [2025-09-22T20:01:40.018406] [DEBUG] [LOCAL ] MKL: Primary data saved (34159 records). [2025-09-22T20:01:40.018560] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-22T20:01:40.018691] [INFO ] [MAIN ] Update Progress: 1367/2372 symbols completed. MKL took 29.4s. Estimated remaining: 2h 13m 31s. Rate: 7.5 symbols/min [2025-09-22T20:01:40.193170] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:01:40.220313] [DEBUG] [LOCAL ] MLNK: Loaded 26172 existing records from primary storage. [2025-09-22T20:01:40.220453] [INFO ] [MAIN ] MLNK: Loaded 26172 existing records. [2025-09-22T20:01:40.402230] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:01:40.402740] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-22T20:01:40.402856] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-22T20:01:40.403552] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-22T20:01:40.403612] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-22T20:01:40.527272] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-22T20:01:40.788149] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-22T20:01:40.831976] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:01:41.194024] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T20:01:41.322069] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-22T20:01:42.119094] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T20:01:42.128348] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-22T20:01:42.201135] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T20:01:42.922116] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-22T20:01:43.413395] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T20:01:43.722067] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-22T20:01:44.522018] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-22T20:01:44.639099] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T20:01:44.648928] [INFO ] [REMOTE ] MKC: Full fetch complete (75489 records). [2025-09-22T20:01:44.649055] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-22T20:01:44.982894] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T20:01:45.087512] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-22T20:01:45.087601] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-22T20:01:45.088735] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-22T20:01:45.088802] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-22T20:01:45.090343] [DEBUG] [LOCAL ] MKC: Trimmed 75489 records to 52437 (keeping 200 days of data) [2025-09-22T20:01:45.328855] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-22T20:01:45.450953] [DEBUG] [LOCAL ] MKC: Primary data saved (52437 records). [2025-09-22T20:01:45.451106] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-22T20:01:45.451209] [INFO ] [MAIN ] Update Progress: 1368/2372 symbols completed. MKC took 44.2s. Estimated remaining: 2h 13m 21s. Rate: 7.5 symbols/min [2025-09-22T20:01:45.648084] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:01:45.653549] [DEBUG] [LOCAL ] MLP: Loaded 3069 existing records from primary storage. [2025-09-22T20:01:45.653666] [INFO ] [MAIN ] MLP: Loaded 3069 existing records. [2025-09-22T20:01:45.849488] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:01:45.850144] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-22T20:01:45.850211] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-22T20:01:45.850732] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-22T20:01:45.863117] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-22T20:01:45.938353] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T20:01:46.133804] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-22T20:01:46.256938] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:01:46.334345] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T20:01:46.922092] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-22T20:01:47.373332] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T20:01:47.529113] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-22T20:01:47.722098] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-22T20:01:48.522068] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-22T20:01:49.322058] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-22T20:01:49.345406] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T20:01:49.352851] [INFO ] [REMOTE ] MLI: Full fetch complete (63673 records). [2025-09-22T20:01:49.352958] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-22T20:01:49.815734] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-22T20:01:49.815993] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-22T20:01:49.817101] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-22T20:01:49.817818] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-22T20:01:49.818566] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T20:01:49.825961] [DEBUG] [LOCAL ] MLI: Trimmed 63673 records to 43864 (keeping 200 days of data) [2025-09-22T20:01:50.032722] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T20:01:50.121713] [DEBUG] [LOCAL ] MLI: Primary data saved (43864 records). [2025-09-22T20:01:50.121851] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-22T20:01:50.121952] [INFO ] [MAIN ] Update Progress: 1369/2372 symbols completed. MLI took 33.3s. Estimated remaining: 2h 13m 11s. Rate: 7.5 symbols/min [2025-09-22T20:01:50.122175] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-22T20:01:50.302369] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:01:50.317248] [DEBUG] [LOCAL ] MLR: Loaded 13403 existing records from primary storage. [2025-09-22T20:01:50.317375] [INFO ] [MAIN ] MLR: Loaded 13403 existing records. [2025-09-22T20:01:50.501754] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:01:50.502067] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-22T20:01:50.502138] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-22T20:01:50.502607] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-22T20:01:50.502703] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-22T20:01:50.776542] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T20:01:50.886802] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:01:50.922107] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-22T20:01:51.722034] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-22T20:01:51.798826] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T20:01:52.258227] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-22T20:01:52.522061] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-22T20:01:52.982237] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-22T20:01:53.322070] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-22T20:01:53.984440] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T20:01:54.122096] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-22T20:01:54.922068] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-22T20:01:55.367853] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T20:01:55.372453] [INFO ] [REMOTE ] MLM: Full fetch complete (45840 records). [2025-09-22T20:01:55.372574] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-22T20:01:55.498392] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T20:01:55.727181] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-22T20:01:55.779082] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-22T20:01:55.779168] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-22T20:01:55.780057] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-22T20:01:55.780133] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-22T20:01:55.781269] [DEBUG] [LOCAL ] MLM: Trimmed 45840 records to 31033 (keeping 200 days of data) [2025-09-22T20:01:55.983739] [DEBUG] [LOCAL ] MLM: Primary data saved (31033 records). [2025-09-22T20:01:55.983884] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-22T20:01:55.983970] [INFO ] [MAIN ] Update Progress: 1370/2372 symbols completed. MLM took 36.9s. Estimated remaining: 2h 13m 1s. Rate: 7.5 symbols/min [2025-09-22T20:01:56.167399] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:01:56.225865] [DEBUG] [LOCAL ] MMC: Loaded 52568 existing records from primary storage. [2025-09-22T20:01:56.226014] [INFO ] [MAIN ] MMC: Loaded 52568 existing records. [2025-09-22T20:01:56.406343] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:01:56.406607] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-22T20:01:56.406687] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-22T20:01:56.408037] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-22T20:01:56.408099] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-22T20:01:56.527115] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-22T20:01:56.777033] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:01:56.980427] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T20:01:57.032936] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-22T20:01:57.322055] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-22T20:01:58.122075] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-22T20:01:58.922115] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-22T20:01:58.959351] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T20:01:59.012773] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T20:01:59.441835] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-22T20:01:59.722059] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-22T20:02:00.522064] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-22T20:02:00.988492] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T20:02:01.322082] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-22T20:02:01.349237] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T20:02:02.122117] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-22T20:02:02.922119] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-22T20:02:03.105126] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T20:02:03.201542] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-22T20:02:03.487001] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T20:02:03.488759] [INFO ] [REMOTE ] MLP: Full fetch complete (4664 records). [2025-09-22T20:02:03.488862] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-22T20:02:03.727213] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-22T20:02:03.871130] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-22T20:02:03.871220] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-22T20:02:03.871376] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-22T20:02:03.871414] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-22T20:02:03.871831] [DEBUG] [LOCAL ] MLP: Trimmed 4664 records to 3049 (keeping 200 days of data) [2025-09-22T20:02:03.889447] [DEBUG] [LOCAL ] MLP: Primary data saved (3049 records). [2025-09-22T20:02:03.889526] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-22T20:02:03.889601] [INFO ] [MAIN ] Update Progress: 1371/2372 symbols completed. MLP took 18.4s. Estimated remaining: 2h 12m 53s. Rate: 7.5 symbols/min [2025-09-22T20:02:04.061781] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:02:04.075497] [DEBUG] [LOCAL ] MMD: Loaded 11278 existing records from primary storage. [2025-09-22T20:02:04.075674] [INFO ] [MAIN ] MMD: Loaded 11278 existing records. [2025-09-22T20:02:04.258328] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:02:04.258621] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-22T20:02:04.258713] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-22T20:02:04.259086] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-22T20:02:04.259146] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-22T20:02:04.527202] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-22T20:02:04.650722] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:02:05.235348] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T20:02:05.322057] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-22T20:02:06.122197] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-22T20:02:06.386576] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T20:02:06.407580] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T20:02:06.922101] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-22T20:02:07.155751] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T20:02:07.722128] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-22T20:02:07.795568] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T20:02:08.522074] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-22T20:02:09.322070] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-22T20:02:09.564931] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T20:02:09.589574] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T20:02:10.122095] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-22T20:02:10.207586] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T20:02:10.922088] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-22T20:02:11.365151] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T20:02:11.722063] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-22T20:02:12.522058] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-22T20:02:12.704357] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-22T20:02:12.972735] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-22T20:02:13.322078] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-22T20:02:13.632612] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T20:02:13.637784] [INFO ] [REMOTE ] MLNK: Full fetch complete (35739 records). [2025-09-22T20:02:13.637867] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-22T20:02:14.014143] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-22T20:02:14.014223] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-22T20:02:14.014915] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-22T20:02:14.014977] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-22T20:02:14.015876] [DEBUG] [LOCAL ] MLNK: Trimmed 35739 records to 25620 (keeping 200 days of data) [2025-09-22T20:02:14.122090] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-22T20:02:14.140761] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T20:02:14.188360] [DEBUG] [LOCAL ] MLNK: Primary data saved (25620 records). [2025-09-22T20:02:14.188500] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-22T20:02:14.188585] [INFO ] [MAIN ] Update Progress: 1372/2372 symbols completed. MLNK took 34.2s. Estimated remaining: 2h 12m 47s. Rate: 7.5 symbols/min [2025-09-22T20:02:14.359828] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:02:14.378043] [DEBUG] [LOCAL ] MMI: Loaded 15608 existing records from primary storage. [2025-09-22T20:02:14.378175] [INFO ] [MAIN ] MMI: Loaded 15608 existing records. [2025-09-22T20:02:14.560166] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:02:14.560492] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-22T20:02:14.560554] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-22T20:02:14.561488] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-22T20:02:14.561758] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-22T20:02:14.927182] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-22T20:02:14.931732] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:02:14.960466] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T20:02:15.722069] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-22T20:02:15.798312] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-22T20:02:16.522126] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-22T20:02:17.323439] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-22T20:02:17.323305] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T20:02:17.425510] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T20:02:17.993395] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T20:02:18.122058] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-22T20:02:18.922058] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-22T20:02:18.977358] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T20:02:19.722057] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-22T20:02:20.522142] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-22T20:02:20.655288] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T20:02:20.658142] [INFO ] [REMOTE ] MLR: Full fetch complete (18542 records). [2025-09-22T20:02:20.658218] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-22T20:02:20.986764] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-22T20:02:21.081921] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-22T20:02:21.081999] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-22T20:02:21.082524] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-22T20:02:21.082602] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-22T20:02:21.084513] [DEBUG] [LOCAL ] MLR: Trimmed 18542 records to 13064 (keeping 200 days of data) [2025-09-22T20:02:21.168163] [DEBUG] [LOCAL ] MLR: Primary data saved (13064 records). [2025-09-22T20:02:21.168307] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-22T20:02:21.168390] [INFO ] [MAIN ] Update Progress: 1373/2372 symbols completed. MLR took 31.0s. Estimated remaining: 2h 12m 38s. Rate: 7.5 symbols/min [2025-09-22T20:02:21.341194] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-22T20:02:21.345403] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:02:21.345717] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-22T20:02:21.345828] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-22T20:02:21.347083] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-22T20:02:21.347300] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-22T20:02:21.347370] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-22T20:02:21.347407] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-22T20:02:21.528600] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T20:02:21.737694] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:02:22.122071] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-22T20:02:22.192447] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T20:02:22.922121] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-22T20:02:23.722084] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-22T20:02:23.831916] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T20:02:24.106128] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T20:02:24.516805] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T20:02:24.521992] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-22T20:02:25.290074] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T20:02:25.322019] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-22T20:02:25.749761] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-22T20:02:26.122056] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-22T20:02:26.921990] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-22T20:02:27.204927] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T20:02:27.350302] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-22T20:02:27.722067] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-22T20:02:28.468194] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T20:02:28.522033] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-22T20:02:29.322064] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-22T20:02:29.488745] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T20:02:30.122093] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-22T20:02:30.830806] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T20:02:30.862330] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-22T20:02:30.922051] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-22T20:02:31.722037] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-22T20:02:31.782954] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T20:02:32.147437] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T20:02:32.522073] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-22T20:02:32.966518] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-22T20:02:33.322067] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-22T20:02:34.122073] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-22T20:02:34.155439] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T20:02:34.922055] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-22T20:02:35.273547] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-22T20:02:35.625924] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T20:02:35.634406] [INFO ] [REMOTE ] MMC: Full fetch complete (74680 records). [2025-09-22T20:02:35.634581] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-22T20:02:35.727167] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-22T20:02:36.025236] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-22T20:02:36.025332] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-22T20:02:36.026333] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-22T20:02:36.026397] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-22T20:02:36.027884] [DEBUG] [LOCAL ] MMC: Trimmed 74680 records to 51805 (keeping 200 days of data) [2025-09-22T20:02:36.361918] [DEBUG] [LOCAL ] MMC: Primary data saved (51805 records). [2025-09-22T20:02:36.362116] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-22T20:02:36.362220] [INFO ] [MAIN ] Update Progress: 1374/2372 symbols completed. MMC took 40.4s. Estimated remaining: 2h 12m 35s. Rate: 7.5 symbols/min [2025-09-22T20:02:36.527479] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-22T20:02:36.557605] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:02:36.616826] [DEBUG] [LOCAL ] MMM: Loaded 54039 existing records from primary storage. [2025-09-22T20:02:36.617027] [INFO ] [MAIN ] MMM: Loaded 54039 existing records. [2025-09-22T20:02:36.811992] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:02:36.813104] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T20:02:36.813421] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-22T20:02:36.816146] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-22T20:02:36.816907] [INFO ] [REMOTE ] MMI: Full fetch complete (20869 records). [2025-09-22T20:02:36.817050] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-22T20:02:36.848998] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-22T20:02:36.887161] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-22T20:02:37.334761] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-22T20:02:37.454171] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T20:02:37.616923] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:02:37.618146] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-22T20:02:37.618244] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-22T20:02:37.618888] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-22T20:02:37.618956] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-22T20:02:37.619907] [DEBUG] [LOCAL ] MMI: Trimmed 20869 records to 15311 (keeping 200 days of data) [2025-09-22T20:02:37.720297] [DEBUG] [LOCAL ] MMI: Primary data saved (15311 records). [2025-09-22T20:02:37.720460] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-22T20:02:37.720556] [INFO ] [MAIN ] Update Progress: 1375/2372 symbols completed. MMI took 23.5s. Estimated remaining: 2h 12m 23s. Rate: 7.5 symbols/min [2025-09-22T20:02:37.897108] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:02:37.903702] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T20:02:37.940884] [DEBUG] [LOCAL ] MMS: Loaded 34667 existing records from primary storage. [2025-09-22T20:02:37.941045] [INFO ] [MAIN ] MMS: Loaded 34667 existing records. [2025-09-22T20:02:38.124243] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-22T20:02:38.127734] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:02:38.128876] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-22T20:02:38.128936] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-22T20:02:38.130142] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-22T20:02:38.130208] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-22T20:02:38.487493] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:02:38.922122] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-22T20:02:38.939805] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T20:02:38.942217] [INFO ] [REMOTE ] MMD: Full fetch complete (18044 records). [2025-09-22T20:02:38.942308] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-22T20:02:39.326020] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-22T20:02:39.326102] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-22T20:02:39.326554] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-22T20:02:39.326593] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-22T20:02:39.327199] [DEBUG] [LOCAL ] MMD: Trimmed 18044 records to 11103 (keeping 200 days of data) [2025-09-22T20:02:39.382409] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-22T20:02:39.404474] [DEBUG] [LOCAL ] MMD: Primary data saved (11103 records). [2025-09-22T20:02:39.404625] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-22T20:02:39.404749] [INFO ] [MAIN ] Update Progress: 1376/2372 symbols completed. MMD took 35.5s. Estimated remaining: 2h 12m 10s. Rate: 7.5 symbols/min [2025-09-22T20:02:39.578185] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:02:39.590872] [DEBUG] [LOCAL ] MMT: Loaded 11600 existing records from primary storage. [2025-09-22T20:02:39.591002] [INFO ] [MAIN ] MMT: Loaded 11600 existing records. [2025-09-22T20:02:39.734895] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-22T20:02:39.777166] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:02:39.777585] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-22T20:02:39.777632] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-22T20:02:39.778331] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-22T20:02:39.778391] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-22T20:02:40.131689] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:02:40.522064] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-22T20:02:40.881354] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-22T20:02:41.322060] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-22T20:02:41.697059] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-22T20:02:42.122013] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-22T20:02:42.154918] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T20:02:42.922101] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-22T20:02:43.722022] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-22T20:02:44.143944] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-22T20:02:44.518600] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T20:02:44.523327] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-22T20:02:44.707810] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T20:02:45.283829] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T20:02:45.322064] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-22T20:02:46.122154] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-22T20:02:46.362338] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T20:02:46.922112] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-22T20:02:47.726176] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-22T20:02:47.732289] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T20:02:48.130540] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-22T20:02:48.522088] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-22T20:02:48.953690] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T20:02:49.264294] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T20:02:49.322054] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-22T20:02:50.122107] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-22T20:02:50.858297] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T20:02:50.916739] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T20:02:50.922009] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-22T20:02:51.700762] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T20:02:51.722002] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-22T20:02:52.522032] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-22T20:02:52.661186] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-22T20:02:52.910467] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-22T20:02:52.911289] [INFO ] [REMOTE ] MMKT: Full fetch complete (2134 records). [2025-09-22T20:02:52.911358] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-22T20:02:53.098894] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T20:02:53.099123] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:02:53.099176] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:02:53.099259] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-22T20:02:53.099341] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-22T20:02:53.099381] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-22T20:02:53.099423] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-22T20:02:53.099484] [INFO ] [MAIN ] Update Progress: 1377/2372 symbols completed. MMKT took 31.9s. Estimated remaining: 2h 12m 6s. Rate: 7.5 symbols/min [2025-09-22T20:02:53.269842] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:02:53.288171] [DEBUG] [LOCAL ] MMU: Loaded 17308 existing records from primary storage. [2025-09-22T20:02:53.288302] [INFO ] [MAIN ] MMU: Loaded 17308 existing records. [2025-09-22T20:02:53.327235] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-22T20:02:53.474970] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:02:53.475276] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-22T20:02:53.475330] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-22T20:02:53.476024] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-22T20:02:53.476085] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-22T20:02:53.842992] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:02:54.122087] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-22T20:02:54.850874] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T20:02:54.922070] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-22T20:02:55.722047] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-22T20:02:56.191307] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-22T20:02:56.340082] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T20:02:56.353867] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-22T20:02:56.522032] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-22T20:02:57.322054] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-22T20:02:57.845245] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-22T20:02:58.096518] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T20:02:58.098360] [INFO ] [REMOTE ] MMT: Full fetch complete (16399 records). [2025-09-22T20:02:58.098430] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-22T20:02:58.127866] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-22T20:02:58.466674] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-22T20:02:58.466758] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-22T20:02:58.467110] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-22T20:02:58.467148] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-22T20:02:58.467668] [DEBUG] [LOCAL ] MMT: Trimmed 16399 records to 11071 (keeping 200 days of data) [2025-09-22T20:02:58.533084] [DEBUG] [LOCAL ] MMT: Primary data saved (11071 records). [2025-09-22T20:02:58.533218] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-22T20:02:58.533302] [INFO ] [MAIN ] Update Progress: 1378/2372 symbols completed. MMT took 19.1s. Estimated remaining: 2h 11m 56s. Rate: 7.5 symbols/min [2025-09-22T20:02:58.706404] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:02:58.733162] [DEBUG] [LOCAL ] MNR: Loaded 25261 existing records from primary storage. [2025-09-22T20:02:58.733295] [INFO ] [MAIN ] MNR: Loaded 25261 existing records. [2025-09-22T20:02:58.912819] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:02:58.913091] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-22T20:02:58.913140] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-22T20:02:58.914170] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-22T20:02:58.914231] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-22T20:02:58.927113] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-22T20:02:59.280904] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:02:59.514807] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T20:02:59.722058] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-22T20:03:00.522087] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-22T20:03:01.091162] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-22T20:03:01.322061] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-22T20:03:01.604275] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T20:03:01.956396] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-22T20:03:02.122075] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-22T20:03:02.922096] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-22T20:03:03.722168] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-22T20:03:04.090475] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-22T20:03:04.272771] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-22T20:03:04.522054] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-22T20:03:04.752588] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T20:03:05.142736] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T20:03:05.322044] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-22T20:03:06.122064] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-22T20:03:06.459444] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T20:03:06.492434] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T20:03:06.922101] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-22T20:03:07.592572] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T20:03:07.600879] [INFO ] [REMOTE ] MMS: Full fetch complete (52325 records). [2025-09-22T20:03:07.601035] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-22T20:03:07.727746] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-22T20:03:07.810266] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T20:03:08.039221] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-22T20:03:08.039300] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-22T20:03:08.040118] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-22T20:03:08.040182] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-22T20:03:08.041515] [DEBUG] [LOCAL ] MMS: Trimmed 52325 records to 34017 (keeping 200 days of data) [2025-09-22T20:03:08.252218] [DEBUG] [LOCAL ] MMS: Primary data saved (34017 records). [2025-09-22T20:03:08.252400] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-22T20:03:08.252493] [INFO ] [MAIN ] Update Progress: 1379/2372 symbols completed. MMS took 30.5s. Estimated remaining: 2h 11m 50s. Rate: 7.5 symbols/min [2025-09-22T20:03:08.451979] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:03:08.495424] [DEBUG] [LOCAL ] MNSO: Loaded 45102 existing records from primary storage. [2025-09-22T20:03:08.495571] [INFO ] [MAIN ] MNSO: Loaded 45102 existing records. [2025-09-22T20:03:08.528437] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-22T20:03:08.681231] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:03:08.681507] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-22T20:03:08.681559] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-22T20:03:08.682982] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-22T20:03:08.683043] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-22T20:03:09.043547] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:03:09.322015] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-22T20:03:09.720903] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T20:03:09.784099] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-22T20:03:10.122081] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-22T20:03:10.922021] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-22T20:03:10.964972] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T20:03:10.991308] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T20:03:11.722119] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-22T20:03:12.522033] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-22T20:03:12.761208] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T20:03:13.029393] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-22T20:03:13.322057] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-22T20:03:13.596409] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T20:03:14.122072] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-22T20:03:14.922030] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-22T20:03:15.339205] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-22T20:03:15.349247] [INFO ] [REMOTE ] MMM: Full fetch complete (77163 records). [2025-09-22T20:03:15.349391] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-22T20:03:15.745681] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-22T20:03:15.768637] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-22T20:03:15.768932] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-22T20:03:15.770281] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-22T20:03:15.770365] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-22T20:03:15.776906] [DEBUG] [LOCAL ] MMM: Trimmed 77163 records to 53259 (keeping 200 days of data) [2025-09-22T20:03:15.920907] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-22T20:03:16.154405] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T20:03:16.287460] [DEBUG] [LOCAL ] MMM: Primary data saved (53259 records). [2025-09-22T20:03:16.287663] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-22T20:03:16.287811] [INFO ] [MAIN ] Update Progress: 1380/2372 symbols completed. MMM took 39.9s. Estimated remaining: 2h 11m 42s. Rate: 7.5 symbols/min [2025-09-22T20:03:16.511610] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:03:16.511869] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-22T20:03:16.511931] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-22T20:03:16.512092] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-22T20:03:16.512136] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-22T20:03:16.512178] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-22T20:03:16.512210] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-22T20:03:16.527186] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-22T20:03:17.046157] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:03:17.322112] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-22T20:03:17.491765] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T20:03:17.990743] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:03:17.991092] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-22T20:03:18.005047] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T20:03:18.122072] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-22T20:03:18.886224] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-22T20:03:18.922063] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-22T20:03:19.722058] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-22T20:03:19.844252] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T20:03:20.522060] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-22T20:03:21.314080] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T20:03:21.323891] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-22T20:03:21.780678] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T20:03:22.122047] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-22T20:03:22.145958] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T20:03:22.922055] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-22T20:03:23.722044] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-22T20:03:23.874376] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T20:03:24.119934] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T20:03:24.513732] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T20:03:24.517408] [INFO ] [REMOTE ] MMU: Full fetch complete (25825 records). [2025-09-22T20:03:24.517514] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-22T20:03:24.529833] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-09-22T20:03:24.831189] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:03:24.837352] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-09-22T20:03:24.915132] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-22T20:03:24.915241] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-22T20:03:24.915835] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-22T20:03:24.915938] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-22T20:03:24.917500] [DEBUG] [LOCAL ] MMU: Trimmed 25825 records to 17018 (keeping 200 days of data) [2025-09-22T20:03:25.024807] [DEBUG] [LOCAL ] MMU: Primary data saved (17018 records). [2025-09-22T20:03:25.024952] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-22T20:03:25.025123] [INFO ] [MAIN ] Update Progress: 1381/2372 symbols completed. MMU took 31.9s. Estimated remaining: 2h 11m 34s. Rate: 7.5 symbols/min [2025-09-22T20:03:25.195662] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:03:25.195897] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-22T20:03:25.195966] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-22T20:03:25.196157] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-22T20:03:25.196214] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-22T20:03:25.196275] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-22T20:03:25.196338] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-22T20:03:25.327124] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-22T20:03:25.614941] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:03:26.122057] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-22T20:03:26.922054] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-22T20:03:27.007301] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T20:03:27.129576] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:03:27.129996] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-22T20:03:27.722119] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-22T20:03:28.189545] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-22T20:03:28.522101] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-22T20:03:28.813233] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:03:28.813567] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-22T20:03:28.839782] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T20:03:29.322087] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-22T20:03:30.122115] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-22T20:03:30.461325] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T20:03:30.467352] [INFO ] [REMOTE ] MNR: Full fetch complete (37154 records). [2025-09-22T20:03:30.467456] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-22T20:03:30.862949] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-22T20:03:30.863035] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-22T20:03:30.863787] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-22T20:03:30.863860] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-22T20:03:30.864817] [DEBUG] [LOCAL ] MNR: Trimmed 37154 records to 24727 (keeping 200 days of data) [2025-09-22T20:03:30.931514] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-22T20:03:31.040873] [DEBUG] [LOCAL ] MNR: Primary data saved (24727 records). [2025-09-22T20:03:31.041028] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-22T20:03:31.041194] [INFO ] [MAIN ] Update Progress: 1382/2372 symbols completed. MNR took 32.5s. Estimated remaining: 2h 11m 25s. Rate: 7.5 symbols/min [2025-09-22T20:03:31.220193] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:03:31.270385] [DEBUG] [LOCAL ] MOD: Loaded 46432 existing records from primary storage. [2025-09-22T20:03:31.270543] [INFO ] [MAIN ] MOD: Loaded 46432 existing records. [2025-09-22T20:03:31.465996] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:03:31.466311] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-22T20:03:31.466383] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-22T20:03:31.467999] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-22T20:03:31.468085] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-22T20:03:31.512916] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:03:31.552317] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-22T20:03:31.727355] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-22T20:03:31.847120] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:03:32.522102] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-22T20:03:32.896266] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-22T20:03:33.322088] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-22T20:03:34.029513] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T20:03:34.122146] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-22T20:03:34.194327] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T20:03:34.319154] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-22T20:03:34.922134] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-22T20:03:35.626433] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T20:03:35.722111] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-22T20:03:36.522063] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-22T20:03:37.132419] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-22T20:03:37.327125] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-22T20:03:37.342403] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T20:03:38.062064] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T20:03:38.122019] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-22T20:03:38.922062] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-22T20:03:39.659425] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-22T20:03:39.722143] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-22T20:03:40.153153] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T20:03:40.522098] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-22T20:03:40.665359] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T20:03:41.322065] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-22T20:03:42.000097] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T20:03:42.128126] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-22T20:03:42.142548] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-22T20:03:42.871868] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T20:03:42.922111] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-22T20:03:43.698720] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T20:03:43.722015] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-22T20:03:44.522079] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-22T20:03:44.658089] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T20:03:45.322070] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-22T20:03:45.446699] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T20:03:46.122068] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-22T20:03:46.778796] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-22T20:03:46.848414] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T20:03:46.855732] [INFO ] [REMOTE ] MNSO: Full fetch complete (64336 records). [2025-09-22T20:03:46.855856] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-22T20:03:46.927114] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-22T20:03:47.256301] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-22T20:03:47.256444] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-22T20:03:47.257369] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-22T20:03:47.257434] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-22T20:03:47.261163] [DEBUG] [LOCAL ] MNSO: Trimmed 64336 records to 44431 (keeping 200 days of data) [2025-09-22T20:03:47.551173] [DEBUG] [LOCAL ] MNSO: Primary data saved (44431 records). [2025-09-22T20:03:47.551327] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-22T20:03:47.551434] [INFO ] [MAIN ] Update Progress: 1383/2372 symbols completed. MNSO took 39.3s. Estimated remaining: 2h 11m 23s. Rate: 7.5 symbols/min [2025-09-22T20:03:47.729672] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:03:47.728118] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-22T20:03:47.750366] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T20:03:47.757719] [INFO ] [REMOTE ] MNTN: Full fetch complete (24374 records). [2025-09-22T20:03:47.757840] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-22T20:03:47.976499] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 84 unique days, need 200 days [2025-09-22T20:03:47.992216] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:03:47.992359] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:03:47.993388] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-22T20:03:47.993519] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-22T20:03:47.993290] [DEBUG] [LOCAL ] MODG: Loaded 52376 existing records from primary storage. [2025-09-22T20:03:47.993592] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-22T20:03:47.993888] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-22T20:03:47.994023] [INFO ] [MAIN ] Update Progress: 1384/2372 symbols completed. MNTN took 31.7s. Estimated remaining: 2h 11m 10s. Rate: 7.5 symbols/min [2025-09-22T20:03:47.993827] [INFO ] [MAIN ] MODG: Loaded 52376 existing records. [2025-09-22T20:03:48.375242] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:03:48.379897] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:03:48.380679] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-22T20:03:48.380755] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-22T20:03:48.382310] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-22T20:03:48.382379] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-22T20:03:48.695411] [DEBUG] [LOCAL ] MOH: Loaded 42381 existing records from primary storage. [2025-09-22T20:03:48.695704] [INFO ] [MAIN ] MOH: Loaded 42381 existing records. [2025-09-22T20:03:48.888173] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:03:48.914818] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-22T20:03:48.970157] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:03:48.970476] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-22T20:03:48.970628] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-22T20:03:48.980665] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-22T20:03:48.986399] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-22T20:03:49.095974] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-22T20:03:49.327210] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-22T20:03:49.394226] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:03:49.850824] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-22T20:03:50.122071] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-22T20:03:50.741676] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T20:03:50.846008] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T20:03:50.922040] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-22T20:03:51.722068] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-22T20:03:52.410163] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-22T20:03:52.522057] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-22T20:03:52.861583] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-22T20:03:53.322044] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-22T20:03:53.406283] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T20:03:54.122073] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-22T20:03:54.798398] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-22T20:03:54.922037] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-22T20:03:55.075161] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T20:03:55.553434] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-22T20:03:55.722052] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-22T20:03:56.386127] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T20:03:56.522071] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-22T20:03:57.175261] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T20:03:57.322056] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-22T20:03:57.975438] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T20:03:57.982443] [INFO ] [REMOTE ] MOD: Full fetch complete (66159 records). [2025-09-22T20:03:57.982563] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-22T20:03:58.127293] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-22T20:03:58.375784] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-22T20:03:58.375871] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-22T20:03:58.376772] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-22T20:03:58.376833] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-22T20:03:58.378096] [DEBUG] [LOCAL ] MOD: Trimmed 66159 records to 45647 (keeping 200 days of data) [2025-09-22T20:03:58.660072] [DEBUG] [LOCAL ] MOD: Primary data saved (45647 records). [2025-09-22T20:03:58.660207] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-22T20:03:58.660291] [INFO ] [MAIN ] Update Progress: 1385/2372 symbols completed. MOD took 27.6s. Estimated remaining: 2h 11m 4s. Rate: 7.5 symbols/min [2025-09-22T20:03:58.840004] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:03:58.902727] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T20:03:58.926543] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-22T20:03:58.930036] [DEBUG] [LOCAL ] MOS: Loaded 54292 existing records from primary storage. [2025-09-22T20:03:58.930499] [INFO ] [MAIN ] MOS: Loaded 54292 existing records. [2025-09-22T20:03:59.110839] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:03:59.111272] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-22T20:03:59.111358] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-22T20:03:59.114508] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-22T20:03:59.114573] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-22T20:03:59.477287] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:03:59.722016] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-22T20:03:59.758338] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T20:04:00.522073] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-22T20:04:00.851241] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-22T20:04:00.864525] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-22T20:04:00.864729] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-22T20:04:01.060354] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T20:04:01.061110] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:04:01.061182] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:04:01.061257] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-22T20:04:01.061326] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-22T20:04:01.061362] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-22T20:04:01.061415] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-22T20:04:01.061554] [INFO ] [MAIN ] Update Progress: 1386/2372 symbols completed. MO took 36.0s. Estimated remaining: 2h 10m 52s. Rate: 7.5 symbols/min [2025-09-22T20:04:01.249999] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:04:01.289352] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T20:04:01.317991] [DEBUG] [LOCAL ] MOV: Loaded 22639 existing records from primary storage. [2025-09-22T20:04:01.318204] [INFO ] [MAIN ] MOV: Loaded 22639 existing records. [2025-09-22T20:04:01.330228] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-22T20:04:01.539260] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:04:01.539605] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-22T20:04:01.539693] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-22T20:04:01.542017] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-22T20:04:01.542086] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-22T20:04:01.963601] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:04:02.122097] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-22T20:04:02.200782] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T20:04:02.922033] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-22T20:04:03.036286] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T20:04:03.722022] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-22T20:04:04.274514] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-22T20:04:04.522132] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-22T20:04:04.809559] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T20:04:05.316934] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T20:04:05.325306] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-22T20:04:05.487232] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T20:04:06.122068] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-22T20:04:06.922083] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-22T20:04:07.057252] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T20:04:07.722127] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-22T20:04:07.891532] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T20:04:08.004082] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T20:04:08.522096] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-22T20:04:09.317405] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T20:04:09.326127] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-22T20:04:09.556146] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T20:04:10.122125] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-22T20:04:10.922066] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-22T20:04:11.143519] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T20:04:11.186038] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T20:04:11.722103] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-22T20:04:12.339203] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T20:04:12.522087] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-22T20:04:13.322120] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-22T20:04:13.626144] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T20:04:13.899930] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T20:04:14.122032] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-22T20:04:14.922096] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-22T20:04:15.178392] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T20:04:15.218097] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T20:04:15.722105] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-22T20:04:16.522032] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-22T20:04:16.784392] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T20:04:16.974386] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T20:04:17.322065] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-22T20:04:18.112286] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T20:04:18.123000] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-22T20:04:18.922065] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-22T20:04:19.108341] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T20:04:19.263730] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T20:04:19.722066] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-22T20:04:20.477082] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T20:04:20.485612] [INFO ] [REMOTE ] MODG: Full fetch complete (74760 records). [2025-09-22T20:04:20.485793] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-22T20:04:20.530837] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-22T20:04:20.895840] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-22T20:04:20.895925] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-22T20:04:20.896933] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-22T20:04:20.897007] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-22T20:04:20.898427] [DEBUG] [LOCAL ] MODG: Trimmed 74760 records to 51622 (keeping 200 days of data) [2025-09-22T20:04:21.195583] [DEBUG] [LOCAL ] MODG: Primary data saved (51622 records). [2025-09-22T20:04:21.195746] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-22T20:04:21.195839] [INFO ] [MAIN ] Update Progress: 1387/2372 symbols completed. MODG took 33.6s. Estimated remaining: 2h 10m 53s. Rate: 7.5 symbols/min [2025-09-22T20:04:21.327117] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-22T20:04:21.376998] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:04:21.430351] [DEBUG] [LOCAL ] MP: Loaded 54436 existing records from primary storage. [2025-09-22T20:04:21.430500] [INFO ] [MAIN ] MP: Loaded 54436 existing records. [2025-09-22T20:04:21.619829] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:04:21.630835] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-22T20:04:21.630994] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-22T20:04:21.632063] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T20:04:21.636133] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-22T20:04:21.636604] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-22T20:04:21.757933] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-22T20:04:21.788730] [INFO ] [REMOTE ] MOH: Full fetch complete (58108 records). [2025-09-22T20:04:21.811785] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-22T20:04:22.138666] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-22T20:04:22.189792] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:04:22.415019] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-22T20:04:22.415119] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-22T20:04:22.416050] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-22T20:04:22.416113] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-22T20:04:22.417425] [DEBUG] [LOCAL ] MOH: Trimmed 58108 records to 41736 (keeping 200 days of data) [2025-09-22T20:04:22.672660] [DEBUG] [LOCAL ] MOH: Primary data saved (41736 records). [2025-09-22T20:04:22.672797] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-22T20:04:22.672883] [INFO ] [MAIN ] Update Progress: 1388/2372 symbols completed. MOH took 34.6s. Estimated remaining: 2h 10m 40s. Rate: 7.5 symbols/min [2025-09-22T20:04:22.846036] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:04:22.853352] [DEBUG] [LOCAL ] MPA: Loaded 5298 existing records from primary storage. [2025-09-22T20:04:22.853458] [INFO ] [MAIN ] MPA: Loaded 5298 existing records. [2025-09-22T20:04:22.934139] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-22T20:04:23.039704] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:04:23.040202] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-22T20:04:23.040269] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-22T20:04:23.040585] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-22T20:04:23.040681] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-22T20:04:23.460144] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:04:23.463329] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-22T20:04:23.485810] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T20:04:23.489611] [INFO ] [REMOTE ] MOV: Full fetch complete (30702 records). [2025-09-22T20:04:23.489718] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-22T20:04:23.735401] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-22T20:04:23.942363] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-22T20:04:23.942448] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-22T20:04:23.943222] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-22T20:04:23.943287] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-22T20:04:23.944203] [DEBUG] [LOCAL ] MOV: Trimmed 30702 records to 22254 (keeping 200 days of data) [2025-09-22T20:04:24.093391] [DEBUG] [LOCAL ] MOV: Primary data saved (22254 records). [2025-09-22T20:04:24.093530] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-22T20:04:24.093613] [INFO ] [MAIN ] Update Progress: 1389/2372 symbols completed. MOV took 23.0s. Estimated remaining: 2h 10m 27s. Rate: 7.5 symbols/min [2025-09-22T20:04:24.277590] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:04:24.341680] [DEBUG] [LOCAL ] MPC: Loaded 52917 existing records from primary storage. [2025-09-22T20:04:24.341858] [INFO ] [MAIN ] MPC: Loaded 52917 existing records. [2025-09-22T20:04:24.462513] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T20:04:24.549764] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-22T20:04:24.550139] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:04:24.551630] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-22T20:04:24.551772] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-22T20:04:24.553445] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-22T20:04:24.553511] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-22T20:04:24.967322] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:04:24.989004] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-22T20:04:25.322065] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-22T20:04:25.801737] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T20:04:26.122029] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-22T20:04:26.398715] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-22T20:04:26.922095] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-22T20:04:27.722147] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-22T20:04:27.811523] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T20:04:28.522028] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-22T20:04:28.734804] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T20:04:29.219787] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-22T20:04:29.320623] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T20:04:29.328093] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-22T20:04:30.122178] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-22T20:04:30.618190] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-22T20:04:30.922051] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-22T20:04:31.181606] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T20:04:31.722093] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-22T20:04:32.522111] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-22T20:04:32.983108] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-22T20:04:33.322018] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-22T20:04:33.803257] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-22T20:04:34.122034] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-22T20:04:34.399292] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T20:04:34.693413] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T20:04:34.826602] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T20:04:34.922063] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-22T20:04:35.722066] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-22T20:04:36.522106] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-22T20:04:36.732604] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-22T20:04:36.741912] [INFO ] [REMOTE ] MOS: Full fetch complete (77448 records). [2025-09-22T20:04:36.742126] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-22T20:04:37.148560] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-22T20:04:37.148686] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-22T20:04:37.149936] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-22T20:04:37.150001] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-22T20:04:37.151464] [DEBUG] [LOCAL ] MOS: Trimmed 77448 records to 53506 (keeping 200 days of data) [2025-09-22T20:04:37.328103] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-22T20:04:37.486704] [DEBUG] [LOCAL ] MOS: Primary data saved (53506 records). [2025-09-22T20:04:37.487031] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-22T20:04:37.487130] [INFO ] [MAIN ] Update Progress: 1390/2372 symbols completed. MOS took 38.8s. Estimated remaining: 2h 10m 23s. Rate: 7.5 symbols/min [2025-09-22T20:04:37.605077] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T20:04:37.705522] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:04:37.757514] [DEBUG] [LOCAL ] MPLX: Loaded 51533 existing records from primary storage. [2025-09-22T20:04:37.757688] [INFO ] [MAIN ] MPLX: Loaded 51533 existing records. [2025-09-22T20:04:37.935850] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:04:37.936148] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-22T20:04:37.936195] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-22T20:04:37.937279] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-22T20:04:37.937339] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-22T20:04:38.058678] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T20:04:38.124487] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-22T20:04:38.307834] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:04:38.783943] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-22T20:04:38.922081] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-22T20:04:39.666716] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-22T20:04:39.722138] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-22T20:04:40.145943] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T20:04:40.522125] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-22T20:04:41.322074] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-22T20:04:42.038279] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T20:04:42.122907] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-22T20:04:42.128740] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-22T20:04:42.922050] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-22T20:04:43.142610] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T20:04:43.722085] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-22T20:04:43.875831] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T20:04:44.522139] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-22T20:04:45.212809] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T20:04:45.237721] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-22T20:04:45.327160] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-22T20:04:45.343894] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-22T20:04:45.954126] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-22T20:04:46.122108] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-22T20:04:46.922062] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-22T20:04:47.722087] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-22T20:04:48.388927] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-22T20:04:48.390264] [INFO ] [REMOTE ] MPA: Full fetch complete (7103 records). [2025-09-22T20:04:48.390334] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-22T20:04:48.522907] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-22T20:04:48.792149] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-22T20:04:48.792317] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-22T20:04:48.792597] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-22T20:04:48.792966] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-22T20:04:48.794169] [DEBUG] [LOCAL ] MPA: Trimmed 7103 records to 5242 (keeping 200 days of data) [2025-09-22T20:04:48.847637] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-22T20:04:48.906037] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T20:04:48.919484] [DEBUG] [LOCAL ] MPA: Primary data saved (5242 records). [2025-09-22T20:04:48.919794] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-22T20:04:48.919903] [INFO ] [MAIN ] Update Progress: 1391/2372 symbols completed. MPA took 26.2s. Estimated remaining: 2h 10m 18s. Rate: 7.5 symbols/min [2025-09-22T20:04:49.104488] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:04:49.114371] [DEBUG] [LOCAL ] MPV: Loaded 5262 existing records from primary storage. [2025-09-22T20:04:49.114603] [INFO ] [MAIN ] MPV: Loaded 5262 existing records. [2025-09-22T20:04:49.317478] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:04:49.317846] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-22T20:04:49.317904] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-22T20:04:49.318248] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-22T20:04:49.318311] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-22T20:04:49.329888] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-22T20:04:49.694477] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:04:50.122103] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-22T20:04:50.206236] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T20:04:50.901246] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-22T20:04:50.922050] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-22T20:04:51.603716] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T20:04:51.722076] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-22T20:04:52.083340] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-22T20:04:52.480998] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T20:04:52.522090] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-22T20:04:53.322140] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-22T20:04:54.122116] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-22T20:04:54.321160] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-22T20:04:54.922034] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-22T20:04:55.086498] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-22T20:04:55.094817] [INFO ] [REMOTE ] MP: Full fetch complete (77298 records). [2025-09-22T20:04:55.094937] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-22T20:04:55.504027] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-22T20:04:55.504140] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-22T20:04:55.505373] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-22T20:04:55.505444] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-22T20:04:55.507094] [DEBUG] [LOCAL ] MP: Trimmed 77298 records to 53662 (keeping 200 days of data) [2025-09-22T20:04:55.725395] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-22T20:04:55.842212] [DEBUG] [LOCAL ] MP: Primary data saved (53662 records). [2025-09-22T20:04:55.842377] [INFO ] [MAIN ] MP: Full history saved. [2025-09-22T20:04:55.842465] [INFO ] [MAIN ] Update Progress: 1392/2372 symbols completed. MP took 34.6s. Estimated remaining: 2h 10m 9s. Rate: 7.5 symbols/min [2025-09-22T20:04:56.037726] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:04:56.052790] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T20:04:56.115386] [DEBUG] [LOCAL ] MPW: Loaded 54280 existing records from primary storage. [2025-09-22T20:04:56.115552] [INFO ] [MAIN ] MPW: Loaded 54280 existing records. [2025-09-22T20:04:56.305247] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:04:56.305512] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-22T20:04:56.305562] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-22T20:04:56.307034] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-22T20:04:56.307097] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-22T20:04:56.413987] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T20:04:56.531259] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-22T20:04:56.695291] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:04:56.726301] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T20:04:57.322059] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-22T20:04:58.122070] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-22T20:04:58.613683] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-22T20:04:58.622021] [INFO ] [REMOTE ] MPC: Full fetch complete (75892 records). [2025-09-22T20:04:58.622155] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-22T20:04:58.927209] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-22T20:04:59.018739] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-22T20:04:59.018824] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-22T20:04:59.019872] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-22T20:04:59.019939] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-22T20:04:59.022269] [DEBUG] [LOCAL ] MPC: Trimmed 75892 records to 52129 (keeping 200 days of data) [2025-09-22T20:04:59.360022] [DEBUG] [LOCAL ] MPC: Primary data saved (52129 records). [2025-09-22T20:04:59.360273] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-22T20:04:59.360400] [INFO ] [MAIN ] Update Progress: 1393/2372 symbols completed. MPC took 35.3s. Estimated remaining: 2h 9m 58s. Rate: 7.5 symbols/min [2025-09-22T20:04:59.498576] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-22T20:04:59.577957] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:04:59.583923] [DEBUG] [LOCAL ] MPX: Loaded 4326 existing records from primary storage. [2025-09-22T20:04:59.584017] [INFO ] [MAIN ] MPX: Loaded 4326 existing records. [2025-09-22T20:04:59.690878] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T20:04:59.731852] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-22T20:04:59.774915] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:04:59.775199] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-22T20:04:59.775274] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-22T20:04:59.775515] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-22T20:04:59.775575] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-22T20:05:00.156790] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:05:00.189178] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-22T20:05:00.325339] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-22T20:05:00.522094] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-22T20:05:01.005694] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-22T20:05:01.322015] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-22T20:05:02.010117] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-22T20:05:02.122059] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-22T20:05:02.922095] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-22T20:05:03.572248] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T20:05:03.722132] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-22T20:05:04.148994] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-22T20:05:04.370059] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T20:05:04.522122] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-22T20:05:05.322055] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-22T20:05:05.943411] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T20:05:06.122050] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-22T20:05:06.331416] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T20:05:06.766295] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-22T20:05:06.922060] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-22T20:05:07.558802] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T20:05:07.722059] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-22T20:05:08.522133] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-22T20:05:09.322033] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-22T20:05:09.460496] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T20:05:09.461800] [INFO ] [REMOTE ] MPV: Full fetch complete (8092 records). [2025-09-22T20:05:09.461870] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-22T20:05:09.826554] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-22T20:05:09.826639] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-22T20:05:09.827003] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-22T20:05:09.827048] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-22T20:05:09.827483] [DEBUG] [LOCAL ] MPV: Trimmed 8092 records to 5174 (keeping 200 days of data) [2025-09-22T20:05:09.859151] [DEBUG] [LOCAL ] MPV: Primary data saved (5174 records). [2025-09-22T20:05:09.859237] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-22T20:05:09.859318] [INFO ] [MAIN ] Update Progress: 1394/2372 symbols completed. MPV took 20.9s. Estimated remaining: 2h 9m 52s. Rate: 7.5 symbols/min [2025-09-22T20:05:10.035226] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:05:10.045307] [DEBUG] [LOCAL ] MQT: Loaded 8527 existing records from primary storage. [2025-09-22T20:05:10.045420] [INFO ] [MAIN ] MQT: Loaded 8527 existing records. [2025-09-22T20:05:10.123145] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-22T20:05:10.236738] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:05:10.237229] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-22T20:05:10.237303] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-22T20:05:10.237902] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-22T20:05:10.238095] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-22T20:05:10.380154] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-22T20:05:10.647173] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:05:10.769211] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T20:05:10.922061] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-22T20:05:11.507570] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-22T20:05:11.705573] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-22T20:05:11.722011] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-22T20:05:12.470920] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T20:05:12.522044] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-22T20:05:13.322076] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-22T20:05:14.122101] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-22T20:05:14.517187] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T20:05:14.878534] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T20:05:14.922027] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-22T20:05:15.189568] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T20:05:15.722055] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-22T20:05:16.522057] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-22T20:05:16.788132] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T20:05:17.299844] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T20:05:17.322014] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-22T20:05:17.526885] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T20:05:17.943501] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-22T20:05:18.122057] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-22T20:05:18.545792] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-22T20:05:18.922047] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-22T20:05:19.500431] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T20:05:19.722053] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-22T20:05:20.522072] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-22T20:05:21.322029] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-22T20:05:21.384332] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T20:05:21.516500] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T20:05:21.527802] [INFO ] [REMOTE ] MPLX: Full fetch complete (73977 records). [2025-09-22T20:05:21.527997] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-22T20:05:21.927596] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-22T20:05:21.927750] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-22T20:05:21.929143] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-22T20:05:21.934122] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-22T20:05:21.935775] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-22T20:05:21.939045] [DEBUG] [LOCAL ] MPLX: Trimmed 73977 records to 50758 (keeping 200 days of data) [2025-09-22T20:05:22.143775] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-22T20:05:22.293863] [DEBUG] [LOCAL ] MPLX: Primary data saved (50758 records). [2025-09-22T20:05:22.294037] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-22T20:05:22.294152] [INFO ] [MAIN ] Update Progress: 1395/2372 symbols completed. MPLX took 44.8s. Estimated remaining: 2h 9m 47s. Rate: 7.5 symbols/min [2025-09-22T20:05:22.471185] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:05:22.489288] [DEBUG] [LOCAL ] MQY: Loaded 17048 existing records from primary storage. [2025-09-22T20:05:22.489455] [INFO ] [MAIN ] MQY: Loaded 17048 existing records. [2025-09-22T20:05:22.667103] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:05:22.667364] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-22T20:05:22.667426] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-22T20:05:22.668150] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-22T20:05:22.668209] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-22T20:05:22.922843] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-22T20:05:22.970155] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T20:05:23.053687] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:05:23.722136] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-22T20:05:24.522061] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-22T20:05:24.562521] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T20:05:24.849564] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T20:05:25.322052] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-22T20:05:25.370225] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T20:05:26.122045] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-22T20:05:26.469563] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T20:05:26.721345] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-22T20:05:26.922112] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-22T20:05:27.722084] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-22T20:05:28.522033] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-22T20:05:28.807875] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T20:05:28.955002] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-22T20:05:29.115471] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-22T20:05:29.116600] [INFO ] [REMOTE ] MPX: Full fetch complete (6841 records). [2025-09-22T20:05:29.116694] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-22T20:05:29.327191] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-22T20:05:29.474853] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-22T20:05:29.474927] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-22T20:05:29.475121] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-22T20:05:29.475185] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-22T20:05:29.475581] [DEBUG] [LOCAL ] MPX: Trimmed 6841 records to 4229 (keeping 200 days of data) [2025-09-22T20:05:29.502243] [DEBUG] [LOCAL ] MPX: Primary data saved (4229 records). [2025-09-22T20:05:29.502369] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-22T20:05:29.502457] [INFO ] [MAIN ] Update Progress: 1396/2372 symbols completed. MPX took 30.1s. Estimated remaining: 2h 9m 38s. Rate: 7.5 symbols/min [2025-09-22T20:05:29.677979] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:05:29.719382] [DEBUG] [LOCAL ] MRC: Loaded 38199 existing records from primary storage. [2025-09-22T20:05:29.719534] [INFO ] [MAIN ] MRC: Loaded 38199 existing records. [2025-09-22T20:05:29.896692] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:05:29.897001] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-22T20:05:29.897063] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-22T20:05:29.898714] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-22T20:05:29.898775] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-22T20:05:30.127306] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-22T20:05:30.255241] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:05:30.529167] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T20:05:30.922059] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-22T20:05:31.722076] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-22T20:05:32.137416] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-22T20:05:32.235210] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T20:05:32.522020] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-22T20:05:32.824082] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T20:05:33.322068] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-22T20:05:34.041557] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T20:05:34.117970] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-22T20:05:34.120932] [INFO ] [REMOTE ] MQT: Full fetch complete (13309 records). [2025-09-22T20:05:34.121017] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-22T20:05:34.127144] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-22T20:05:34.555153] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-22T20:05:34.555241] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-22T20:05:34.555564] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-22T20:05:34.555602] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-22T20:05:34.556115] [DEBUG] [LOCAL ] MQT: Trimmed 13309 records to 8375 (keeping 200 days of data) [2025-09-22T20:05:34.609795] [DEBUG] [LOCAL ] MQT: Primary data saved (8375 records). [2025-09-22T20:05:34.609917] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-22T20:05:34.610029] [INFO ] [MAIN ] Update Progress: 1397/2372 symbols completed. MQT took 24.8s. Estimated remaining: 2h 9m 28s. Rate: 7.5 symbols/min [2025-09-22T20:05:34.922109] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-22T20:05:35.592626] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T20:05:35.722074] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-22T20:05:35.879419] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T20:05:36.522103] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-22T20:05:37.062574] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T20:05:37.152580] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-22T20:05:37.322047] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-22T20:05:38.122036] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-22T20:05:38.282965] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T20:05:38.922096] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-22T20:05:39.732469] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-22T20:05:39.735063] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T20:05:39.853152] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T20:05:40.522079] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-22T20:05:41.239054] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T20:05:41.322025] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-22T20:05:41.935225] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T20:05:42.122022] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-22T20:05:42.502397] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T20:05:42.507582] [INFO ] [REMOTE ] MQY: Full fetch complete (27250 records). [2025-09-22T20:05:42.507707] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-22T20:05:42.878149] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-22T20:05:42.878245] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-22T20:05:42.878846] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-22T20:05:42.878933] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-22T20:05:42.879606] [DEBUG] [LOCAL ] MQY: Trimmed 27250 records to 16777 (keeping 200 days of data) [2025-09-22T20:05:42.929228] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-22T20:05:42.994488] [DEBUG] [LOCAL ] MQY: Primary data saved (16777 records). [2025-09-22T20:05:42.994610] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-22T20:05:42.994791] [INFO ] [MAIN ] Update Progress: 1398/2372 symbols completed. MQY took 20.7s. Estimated remaining: 2h 9m 21s. Rate: 7.5 symbols/min [2025-09-22T20:05:43.424879] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T20:05:43.722032] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-22T20:05:44.654717] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T20:05:44.663553] [INFO ] [REMOTE ] MPW: Full fetch complete (77529 records). [2025-09-22T20:05:44.663724] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-22T20:05:45.082179] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-22T20:05:45.082260] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-22T20:05:45.083272] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-22T20:05:45.083364] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-22T20:05:45.085028] [DEBUG] [LOCAL ] MPW: Trimmed 77529 records to 53504 (keeping 200 days of data) [2025-09-22T20:05:45.338836] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-22T20:05:45.350281] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-22T20:05:45.456422] [DEBUG] [LOCAL ] MPW: Primary data saved (53504 records). [2025-09-22T20:05:45.456557] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-22T20:05:45.456638] [INFO ] [MAIN ] Update Progress: 1399/2372 symbols completed. MPW took 49.6s. Estimated remaining: 2h 9m 9s. Rate: 7.5 symbols/min [2025-09-22T20:05:46.656977] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T20:05:46.664862] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-22T20:05:48.128868] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T20:05:48.135727] [INFO ] [REMOTE ] MRC: Full fetch complete (54317 records). [2025-09-22T20:05:48.135830] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-22T20:05:48.527722] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-22T20:05:48.527807] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-22T20:05:48.528676] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-22T20:05:48.528740] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-22T20:05:48.530116] [DEBUG] [LOCAL ] MRC: Trimmed 54317 records to 37550 (keeping 200 days of data) [2025-09-22T20:05:48.775738] [DEBUG] [LOCAL ] MRC: Primary data saved (37550 records). [2025-09-22T20:05:48.776029] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-22T20:05:48.776167] [INFO ] [MAIN ] Update Progress: 1400/2372 symbols completed. MRC took 19.3s. Estimated remaining: 2h 8m 58s. Rate: 7.5 symbols/min [2025-09-22T20:05:49.479379] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:05:49.469591] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:05:49.534377] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:05:49.543133] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-22T20:05:49.566678] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:05:49.566865] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-22T20:05:49.571007] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-22T20:05:49.574739] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-22T20:05:49.574817] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-22T20:05:49.574878] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-22T20:05:49.717301] [DEBUG] [LOCAL ] MSA: Loaded 19039 existing records from primary storage. [2025-09-22T20:05:49.754498] [INFO ] [MAIN ] MSA: Loaded 19039 existing records. [2025-09-22T20:05:50.070381] [DEBUG] [LOCAL ] MS: Loaded 54474 existing records from primary storage. [2025-09-22T20:05:50.087311] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-22T20:05:50.106879] [INFO ] [MAIN ] MS: Loaded 54474 existing records. [2025-09-22T20:05:50.127796] [INFO ] [MAIN ] MRK: Loaded 54569 existing records. [2025-09-22T20:05:50.237863] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:05:50.271127] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-22T20:05:50.378849] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:05:50.466667] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-22T20:05:50.470772] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-22T20:05:50.493122] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-22T20:05:50.509118] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-22T20:05:50.729457] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:05:50.729611] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:05:50.770046] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-22T20:05:50.771327] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:05:50.771450] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-22T20:05:50.772053] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-22T20:05:50.782625] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-22T20:05:50.788219] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-22T20:05:50.793911] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-09-22T20:05:50.799096] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-22T20:05:50.813967] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-22T20:05:50.833826] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-22T20:05:50.833674] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-22T20:05:51.160573] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:05:51.202515] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-09-22T20:05:51.264064] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-22T20:05:51.421018] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:05:51.497126] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-22T20:05:51.842628] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:05:51.858537] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-22T20:05:51.883179] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:05:51.883525] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-22T20:05:52.709482] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T20:05:52.714812] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-22T20:05:52.904983] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T20:05:52.912814] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-22T20:05:53.638464] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T20:05:53.642033] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-22T20:05:53.829698] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T20:05:53.845214] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-22T20:05:53.844409] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-22T20:05:54.122061] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-22T20:05:54.611561] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T20:05:54.740287] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T20:05:54.922133] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-22T20:05:55.722014] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-22T20:05:55.862667] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-22T20:05:56.111490] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T20:05:56.185776] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-22T20:05:56.522119] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-22T20:05:57.327290] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-22T20:05:57.331145] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T20:05:58.122059] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-22T20:05:58.504455] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-22T20:05:58.922139] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-22T20:05:59.336087] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T20:05:59.565544] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-22T20:05:59.722050] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-22T20:06:00.522084] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-22T20:06:00.617894] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T20:06:01.322038] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-22T20:06:01.489550] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T20:06:01.622521] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T20:06:02.122073] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-22T20:06:02.922107] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-22T20:06:03.723087] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-22T20:06:03.724993] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T20:06:04.490436] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (3.17 seconds). [2025-09-22T20:06:04.522009] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-22T20:06:05.322033] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-22T20:06:05.599307] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T20:06:05.742551] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-22T20:06:06.122028] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-22T20:06:06.329924] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T20:06:06.724990] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-22T20:06:06.922107] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-22T20:06:07.722051] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-22T20:06:07.776076] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T20:06:08.522114] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-22T20:06:09.058273] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-22T20:06:09.322028] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-22T20:06:09.552856] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-22T20:06:09.657202] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T20:06:10.122093] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-22T20:06:10.922020] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-22T20:06:11.243142] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T20:06:11.492814] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T20:06:11.722064] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-22T20:06:12.522080] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-22T20:06:12.613220] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-22T20:06:12.828543] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T20:06:12.832155] [INFO ] [REMOTE ] MSA: Full fetch complete (25656 records). [2025-09-22T20:06:12.832257] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-22T20:06:13.201756] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-22T20:06:13.201871] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-22T20:06:13.202495] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-22T20:06:13.202545] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-22T20:06:13.203705] [DEBUG] [LOCAL ] MSA: Trimmed 25656 records to 18724 (keeping 200 days of data) [2025-09-22T20:06:13.321471] [DEBUG] [LOCAL ] MSA: Primary data saved (18724 records). [2025-09-22T20:06:13.321621] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-22T20:06:13.321766] [INFO ] [MAIN ] Update Progress: 1401/2372 symbols completed. MSA took 24.5s. Estimated remaining: 2h 9m 1s. Rate: 7.5 symbols/min [2025-09-22T20:06:13.333550] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-22T20:06:13.496155] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:06:13.506175] [DEBUG] [LOCAL ] MSB: Loaded 8043 existing records from primary storage. [2025-09-22T20:06:13.506286] [INFO ] [MAIN ] MSB: Loaded 8043 existing records. [2025-09-22T20:06:13.684595] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:06:13.684896] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-22T20:06:13.684951] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-22T20:06:13.685448] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-22T20:06:13.685508] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-22T20:06:14.037857] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:06:14.122044] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-22T20:06:14.330290] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T20:06:14.922109] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-22T20:06:15.727286] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-22T20:06:15.766204] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-22T20:06:15.792346] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T20:06:15.801272] [INFO ] [REMOTE ] MRP: Full fetch complete (53882 records). [2025-09-22T20:06:15.801426] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-22T20:06:16.008546] [WARN ] [VALIDATOR ] MRP: Validation failed - insufficient historical data. Have 156 unique days, need 200 days [2025-09-22T20:06:16.009543] [FATAL] [MAIN ] MRP: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:06:16.009632] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:06:16.009755] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-22T20:06:16.009856] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-22T20:06:16.009915] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-22T20:06:16.010003] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-22T20:06:16.010129] [INFO ] [MAIN ] Update Progress: 1402/2372 symbols completed. MRP took 27.2s. Estimated remaining: 2h 8m 50s. Rate: 7.5 symbols/min [2025-09-22T20:06:16.281897] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:06:16.282355] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-22T20:06:16.282427] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-22T20:06:16.282614] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-22T20:06:16.282709] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-22T20:06:16.282774] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-22T20:06:16.282815] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-22T20:06:16.527306] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-22T20:06:16.831126] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:06:17.322098] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-22T20:06:17.543489] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-22T20:06:17.717167] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-22T20:06:17.888757] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T20:06:18.122051] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-22T20:06:18.567759] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T20:06:18.922049] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-22T20:06:19.608689] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-09-22T20:06:19.722063] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-22T20:06:20.282778] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T20:06:20.522038] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-22T20:06:20.575435] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T20:06:20.583988] [INFO ] [REMOTE ] MS: Full fetch complete (77718 records). [2025-09-22T20:06:20.584177] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-22T20:06:20.980122] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T20:06:20.984019] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-22T20:06:20.985677] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-22T20:06:20.986888] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-22T20:06:20.986973] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-22T20:06:20.988454] [DEBUG] [LOCAL ] MS: Trimmed 77718 records to 53693 (keeping 200 days of data) [2025-09-22T20:06:21.322255] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-22T20:06:21.339177] [DEBUG] [LOCAL ] MS: Primary data saved (53693 records). [2025-09-22T20:06:21.339317] [INFO ] [MAIN ] MS: Full history saved. [2025-09-22T20:06:21.339405] [INFO ] [MAIN ] Update Progress: 1403/2372 symbols completed. MS took 32.6s. Estimated remaining: 2h 8m 40s. Rate: 7.5 symbols/min [2025-09-22T20:06:21.510306] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:06:21.544634] [DEBUG] [LOCAL ] MSCI: Loaded 35459 existing records from primary storage. [2025-09-22T20:06:21.544801] [INFO ] [MAIN ] MSCI: Loaded 35459 existing records. [2025-09-22T20:06:21.686520] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-22T20:06:21.751131] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:06:21.751381] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-22T20:06:21.751429] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-22T20:06:21.752739] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-22T20:06:21.752802] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-22T20:06:22.112788] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:06:22.122008] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-22T20:06:22.465603] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-22T20:06:22.922069] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-22T20:06:23.722053] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-22T20:06:24.066460] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-22T20:06:24.396216] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T20:06:24.522086] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-22T20:06:25.322112] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-22T20:06:25.757107] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-22T20:06:25.951025] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T20:06:26.122080] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-22T20:06:26.922066] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-22T20:06:27.196357] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T20:06:27.351828] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T20:06:27.722074] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-22T20:06:28.522110] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-22T20:06:29.322075] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-22T20:06:30.122032] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-22T20:06:30.207879] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T20:06:30.267226] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T20:06:30.699791] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-22T20:06:30.702083] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-09-22T20:06:30.712878] [INFO ] [REMOTE ] MSC: Full fetch complete (2486 records). [2025-09-22T20:06:30.713637] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-22T20:06:30.762881] [INFO ] [REMOTE ] MRK: Full fetch complete (77856 records). [2025-09-22T20:06:30.784692] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-22T20:06:30.923751] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-22T20:06:31.034960] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-22T20:06:31.056033] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:06:31.076497] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:06:31.083167] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-22T20:06:31.087774] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-22T20:06:31.087976] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-22T20:06:31.094042] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-22T20:06:31.095832] [INFO ] [MAIN ] Update Progress: 1404/2372 symbols completed. MSC took 15.1s. Estimated remaining: 2h 8m 33s. Rate: 7.5 symbols/min [2025-09-22T20:06:31.511479] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:06:31.534876] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-22T20:06:31.534968] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-22T20:06:31.536132] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-22T20:06:31.536218] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-22T20:06:31.537991] [DEBUG] [LOCAL ] MRK: Trimmed 77856 records to 53789 (keeping 200 days of data) [2025-09-22T20:06:31.555060] [DEBUG] [LOCAL ] MSD: Loaded 15868 existing records from primary storage. [2025-09-22T20:06:31.555261] [INFO ] [MAIN ] MSD: Loaded 15868 existing records. [2025-09-22T20:06:31.747395] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-22T20:06:31.857725] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:06:31.860681] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-22T20:06:31.861034] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-22T20:06:31.862451] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-22T20:06:31.862793] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-22T20:06:32.246756] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:06:32.509982] [DEBUG] [LOCAL ] MRK: Primary data saved (53789 records). [2025-09-22T20:06:32.510276] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-22T20:06:32.510435] [INFO ] [MAIN ] Update Progress: 1405/2372 symbols completed. MRK took 43.7s. Estimated remaining: 2h 8m 21s. Rate: 7.5 symbols/min [2025-09-22T20:06:32.527205] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-22T20:06:32.697310] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T20:06:32.761789] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:06:32.762953] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-22T20:06:32.812531] [DEBUG] [LOCAL ] MSDL: Loaded 38691 existing records from primary storage. [2025-09-22T20:06:32.812816] [INFO ] [MAIN ] MSDL: Loaded 38691 existing records. [2025-09-22T20:06:33.013527] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:06:33.013947] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-22T20:06:33.014008] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-22T20:06:33.015403] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-22T20:06:33.015520] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-22T20:06:33.329850] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-22T20:06:33.405805] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T20:06:33.448975] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:06:34.122123] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-22T20:06:34.203465] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T20:06:34.923161] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-22T20:06:34.926476] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T20:06:35.722126] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-22T20:06:36.304256] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-22T20:06:36.346201] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T20:06:36.522148] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-22T20:06:37.077831] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T20:06:37.322121] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-22T20:06:38.122130] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-22T20:06:38.864160] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-22T20:06:38.886145] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T20:06:38.922060] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-22T20:06:39.722181] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-22T20:06:40.228718] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T20:06:40.242176] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-22T20:06:40.522097] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-22T20:06:41.322112] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-22T20:06:41.631721] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T20:06:41.871057] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-22T20:06:42.122099] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-22T20:06:42.922043] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-22T20:06:42.989507] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T20:06:43.722065] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-22T20:06:44.235151] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T20:06:44.289936] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T20:06:44.522098] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-22T20:06:45.322058] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-22T20:06:46.077078] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-22T20:06:46.122030] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-22T20:06:46.277902] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T20:06:46.899293] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T20:06:46.922031] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-22T20:06:47.722060] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-22T20:06:48.031352] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T20:06:48.311483] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-22T20:06:48.522083] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-22T20:06:49.322067] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-22T20:06:49.955922] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T20:06:50.122039] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-22T20:06:50.854911] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T20:06:50.922118] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-22T20:06:51.702503] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T20:06:51.722007] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-22T20:06:51.755773] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T20:06:51.761051] [INFO ] [REMOTE ] MSD: Full fetch complete (22075 records). [2025-09-22T20:06:51.761167] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-22T20:06:52.146800] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-22T20:06:52.146883] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-22T20:06:52.147358] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-22T20:06:52.147397] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-22T20:06:52.148056] [DEBUG] [LOCAL ] MSD: Trimmed 22075 records to 15603 (keeping 200 days of data) [2025-09-22T20:06:52.240935] [DEBUG] [LOCAL ] MSD: Primary data saved (15603 records). [2025-09-22T20:06:52.241138] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-22T20:06:52.241262] [INFO ] [MAIN ] Update Progress: 1406/2372 symbols completed. MSD took 21.1s. Estimated remaining: 2h 8m 21s. Rate: 7.5 symbols/min [2025-09-22T20:06:52.413757] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:06:52.441087] [DEBUG] [LOCAL ] MSGE: Loaded 27557 existing records from primary storage. [2025-09-22T20:06:52.441245] [INFO ] [MAIN ] MSGE: Loaded 27557 existing records. [2025-09-22T20:06:52.527312] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-22T20:06:52.629245] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:06:52.629515] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-22T20:06:52.629564] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-22T20:06:52.630486] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-22T20:06:52.630547] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-22T20:06:52.991860] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:06:53.230767] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T20:06:53.322032] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-22T20:06:53.809352] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T20:06:53.816234] [INFO ] [REMOTE ] MSCI: Full fetch complete (50165 records). [2025-09-22T20:06:53.816358] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-22T20:06:54.127184] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-22T20:06:54.242402] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-22T20:06:54.242505] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-22T20:06:54.243421] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-22T20:06:54.243488] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-22T20:06:54.244744] [DEBUG] [LOCAL ] MSCI: Trimmed 50165 records to 34854 (keeping 200 days of data) [2025-09-22T20:06:54.470177] [DEBUG] [LOCAL ] MSCI: Primary data saved (34854 records). [2025-09-22T20:06:54.470323] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-22T20:06:54.470408] [INFO ] [MAIN ] Update Progress: 1407/2372 symbols completed. MSCI took 33.1s. Estimated remaining: 2h 8m 9s. Rate: 7.5 symbols/min [2025-09-22T20:06:54.649890] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:06:54.675535] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T20:06:54.696492] [DEBUG] [LOCAL ] MSGS: Loaded 17066 existing records from primary storage. [2025-09-22T20:06:54.696633] [INFO ] [MAIN ] MSGS: Loaded 17066 existing records. [2025-09-22T20:06:54.871938] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:06:54.872238] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-22T20:06:54.872295] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-22T20:06:54.872985] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-22T20:06:54.873045] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-22T20:06:54.934438] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-22T20:06:55.233804] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:06:55.501857] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T20:06:55.722118] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-22T20:06:56.239277] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-22T20:06:56.241332] [INFO ] [REMOTE ] MSB: Full fetch complete (12846 records). [2025-09-22T20:06:56.241405] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-22T20:06:56.542472] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-22T20:06:56.561061] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T20:06:56.657351] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-22T20:06:56.657428] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-22T20:06:56.657744] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-22T20:06:56.657805] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-22T20:06:56.658268] [DEBUG] [LOCAL ] MSB: Trimmed 12846 records to 7852 (keeping 200 days of data) [2025-09-22T20:06:56.713923] [DEBUG] [LOCAL ] MSB: Primary data saved (7852 records). [2025-09-22T20:06:56.714065] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-22T20:06:56.714153] [INFO ] [MAIN ] Update Progress: 1408/2372 symbols completed. MSB took 43.4s. Estimated remaining: 2h 7m 57s. Rate: 7.5 symbols/min [2025-09-22T20:06:56.880901] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:06:56.929111] [DEBUG] [LOCAL ] MSI: Loaded 41240 existing records from primary storage. [2025-09-22T20:06:56.929317] [INFO ] [MAIN ] MSI: Loaded 41240 existing records. [2025-09-22T20:06:57.103790] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:06:57.104053] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-22T20:06:57.104101] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-22T20:06:57.105443] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-22T20:06:57.105508] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-22T20:06:57.327291] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-22T20:06:57.465332] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:06:57.846008] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T20:06:58.122056] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-22T20:06:58.386849] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-22T20:06:58.922093] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-22T20:06:59.245524] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T20:06:59.722085] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-22T20:07:00.091864] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T20:07:00.522084] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-22T20:07:01.004996] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-22T20:07:01.322060] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-22T20:07:01.351013] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T20:07:02.122063] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-22T20:07:02.930572] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-22T20:07:02.935989] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T20:07:03.008903] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T20:07:03.503139] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T20:07:03.722085] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-22T20:07:04.522055] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-22T20:07:05.251374] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T20:07:05.322062] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-22T20:07:05.592195] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T20:07:06.122056] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-22T20:07:06.324633] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T20:07:06.922067] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-22T20:07:07.515273] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T20:07:07.722065] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-22T20:07:08.211741] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T20:07:08.218761] [INFO ] [REMOTE ] MSDL: Full fetch complete (54157 records). [2025-09-22T20:07:08.218933] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-22T20:07:08.522946] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-22T20:07:08.648737] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-22T20:07:08.649189] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-22T20:07:08.650282] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-22T20:07:08.650521] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-22T20:07:08.652008] [DEBUG] [LOCAL ] MSDL: Trimmed 54157 records to 38008 (keeping 200 days of data) [2025-09-22T20:07:08.762869] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T20:07:08.916211] [DEBUG] [LOCAL ] MSDL: Primary data saved (38008 records). [2025-09-22T20:07:08.916378] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-22T20:07:08.916473] [INFO ] [MAIN ] Update Progress: 1409/2372 symbols completed. MSDL took 36.4s. Estimated remaining: 2h 7m 52s. Rate: 7.5 symbols/min [2025-09-22T20:07:09.137753] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:07:09.138100] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-22T20:07:09.138160] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-22T20:07:09.138330] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-22T20:07:09.138390] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-22T20:07:09.138468] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-22T20:07:09.138512] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-22T20:07:09.322144] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-22T20:07:09.717245] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:07:09.891093] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T20:07:10.122078] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-22T20:07:10.287027] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T20:07:10.922090] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-22T20:07:11.722084] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-22T20:07:11.775008] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T20:07:11.817958] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T20:07:11.964529] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:07:11.964863] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-22T20:07:12.522091] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-09-22T20:07:13.002438] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T20:07:13.322040] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-22T20:07:14.122026] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-22T20:07:14.284788] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T20:07:14.922028] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-22T20:07:15.157254] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T20:07:15.722019] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-22T20:07:15.824129] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T20:07:16.522069] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-22T20:07:16.859186] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-22T20:07:17.322063] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-22T20:07:17.889145] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T20:07:18.013575] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T20:07:18.122010] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-22T20:07:18.922064] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-22T20:07:19.095567] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T20:07:19.722092] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-22T20:07:20.375374] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T20:07:20.380297] [INFO ] [REMOTE ] MSGE: Full fetch complete (40183 records). [2025-09-22T20:07:20.380381] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-22T20:07:20.527199] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-22T20:07:20.762217] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-22T20:07:20.762302] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-22T20:07:20.763043] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-22T20:07:20.763104] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-22T20:07:20.763962] [DEBUG] [LOCAL ] MSGE: Trimmed 40183 records to 27081 (keeping 200 days of data) [2025-09-22T20:07:20.940726] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T20:07:20.943564] [DEBUG] [LOCAL ] MSGE: Primary data saved (27081 records). [2025-09-22T20:07:20.948051] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-22T20:07:20.948370] [INFO ] [MAIN ] Update Progress: 1410/2372 symbols completed. MSGE took 28.7s. Estimated remaining: 2h 7m 47s. Rate: 7.5 symbols/min [2025-09-22T20:07:21.119030] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:07:21.161246] [DEBUG] [LOCAL ] MSM: Loaded 35948 existing records from primary storage. [2025-09-22T20:07:21.161443] [INFO ] [MAIN ] MSM: Loaded 35948 existing records. [2025-09-22T20:07:21.328210] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-22T20:07:21.349448] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:07:21.350917] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-22T20:07:21.350980] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-22T20:07:21.352491] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-22T20:07:21.352556] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-22T20:07:21.488317] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T20:07:21.735400] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:07:22.122004] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-22T20:07:22.145380] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T20:07:22.149135] [INFO ] [REMOTE ] MSGS: Full fetch complete (22244 records). [2025-09-22T20:07:22.149214] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-22T20:07:22.552198] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-22T20:07:22.552277] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-22T20:07:22.552750] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-22T20:07:22.552811] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-22T20:07:22.553752] [DEBUG] [LOCAL ] MSGS: Trimmed 22244 records to 16853 (keeping 200 days of data) [2025-09-22T20:07:22.662134] [DEBUG] [LOCAL ] MSGS: Primary data saved (16853 records). [2025-09-22T20:07:22.662282] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-22T20:07:22.662419] [INFO ] [MAIN ] Update Progress: 1411/2372 symbols completed. MSGS took 28.2s. Estimated remaining: 2h 7m 35s. Rate: 7.5 symbols/min [2025-09-22T20:07:22.829897] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:07:22.884700] [DEBUG] [LOCAL ] MT: Loaded 51525 existing records from primary storage. [2025-09-22T20:07:22.884859] [INFO ] [MAIN ] MT: Loaded 51525 existing records. [2025-09-22T20:07:22.927185] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-22T20:07:23.064217] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:07:23.064477] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-22T20:07:23.064525] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-22T20:07:23.066187] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-22T20:07:23.066248] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-22T20:07:23.426859] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:07:23.582153] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-22T20:07:23.607687] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T20:07:23.722016] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-22T20:07:24.522053] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-22T20:07:25.322051] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-22T20:07:26.122109] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-22T20:07:26.312832] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-22T20:07:26.922077] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-22T20:07:27.201933] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T20:07:27.227040] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T20:07:27.489771] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-22T20:07:27.722068] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-22T20:07:28.522083] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-22T20:07:28.674578] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T20:07:29.041293] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T20:07:29.322066] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-22T20:07:30.030165] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T20:07:30.122018] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-22T20:07:30.270382] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T20:07:30.922058] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-22T20:07:31.447494] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T20:07:31.722066] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-22T20:07:32.253054] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T20:07:32.259390] [INFO ] [REMOTE ] MSI: Full fetch complete (58561 records). [2025-09-22T20:07:32.259530] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-22T20:07:32.528957] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-22T20:07:32.676778] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-22T20:07:32.676867] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-22T20:07:32.677752] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-22T20:07:32.677856] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-22T20:07:32.681191] [DEBUG] [LOCAL ] MSI: Trimmed 58561 records to 40595 (keeping 200 days of data) [2025-09-22T20:07:32.949816] [DEBUG] [LOCAL ] MSI: Primary data saved (40595 records). [2025-09-22T20:07:32.949954] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-22T20:07:32.950094] [INFO ] [MAIN ] Update Progress: 1412/2372 symbols completed. MSI took 36.2s. Estimated remaining: 2h 7m 28s. Rate: 7.5 symbols/min [2025-09-22T20:07:33.139336] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:07:33.181583] [DEBUG] [LOCAL ] MTAL: Loaded 36734 existing records from primary storage. [2025-09-22T20:07:33.181761] [INFO ] [MAIN ] MTAL: Loaded 36734 existing records. [2025-09-22T20:07:33.335793] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-22T20:07:33.370123] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:07:33.370811] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-22T20:07:33.370950] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-22T20:07:33.380819] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-22T20:07:33.394289] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-22T20:07:33.428682] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T20:07:33.764601] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:07:34.061672] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T20:07:34.122029] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-22T20:07:34.270578] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T20:07:34.922096] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-22T20:07:35.644864] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T20:07:35.722032] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-22T20:07:35.978937] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T20:07:36.522121] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-22T20:07:37.147925] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T20:07:37.322068] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-22T20:07:37.839005] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T20:07:38.122073] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-22T20:07:38.922082] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-22T20:07:39.286732] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T20:07:39.722030] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-22T20:07:40.054729] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T20:07:40.058391] [INFO ] [REMOTE ] MSIF: Full fetch complete (15948 records). [2025-09-22T20:07:40.058480] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-22T20:07:40.238529] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-09-22T20:07:40.238867] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:07:40.238949] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:07:40.239022] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-22T20:07:40.239099] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-22T20:07:40.239171] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-22T20:07:40.239295] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-22T20:07:40.239446] [INFO ] [MAIN ] Update Progress: 1413/2372 symbols completed. MSIF took 31.3s. Estimated remaining: 2h 7m 20s. Rate: 7.5 symbols/min [2025-09-22T20:07:40.407557] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:07:40.480567] [DEBUG] [LOCAL ] MTB: Loaded 47970 existing records from primary storage. [2025-09-22T20:07:40.480754] [INFO ] [MAIN ] MTB: Loaded 47970 existing records. [2025-09-22T20:07:40.526152] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-22T20:07:40.670202] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:07:40.670956] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-22T20:07:40.671036] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-22T20:07:40.681726] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-22T20:07:40.694072] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-22T20:07:40.768949] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T20:07:41.073338] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:07:41.107729] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-22T20:07:41.322077] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-22T20:07:42.122092] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-22T20:07:42.198592] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T20:07:42.922062] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-22T20:07:43.032963] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T20:07:43.725597] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-22T20:07:43.727944] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T20:07:44.163947] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T20:07:44.522083] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-22T20:07:45.322033] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-22T20:07:45.420126] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T20:07:45.673945] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T20:07:46.122057] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-22T20:07:46.865500] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T20:07:46.872501] [INFO ] [REMOTE ] MSM: Full fetch complete (51976 records). [2025-09-22T20:07:46.872719] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-22T20:07:46.932846] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-22T20:07:47.298922] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-22T20:07:47.299067] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-22T20:07:47.300039] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-22T20:07:47.300121] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-22T20:07:47.303499] [DEBUG] [LOCAL ] MSM: Trimmed 51976 records to 35425 (keeping 200 days of data) [2025-09-22T20:07:47.462792] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T20:07:47.607570] [DEBUG] [LOCAL ] MSM: Primary data saved (35425 records). [2025-09-22T20:07:47.607981] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-22T20:07:47.608212] [INFO ] [MAIN ] Update Progress: 1414/2372 symbols completed. MSM took 26.7s. Estimated remaining: 2h 7m 11s. Rate: 7.5 symbols/min [2025-09-22T20:07:47.727157] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-22T20:07:47.791753] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:07:47.814151] [DEBUG] [LOCAL ] MTD: Loaded 15506 existing records from primary storage. [2025-09-22T20:07:47.814337] [INFO ] [MAIN ] MTD: Loaded 15506 existing records. [2025-09-22T20:07:48.016362] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:07:48.016717] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-22T20:07:48.016775] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-22T20:07:48.017501] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-22T20:07:48.017562] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-22T20:07:48.401732] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:07:48.522042] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-22T20:07:48.560115] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T20:07:49.024826] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T20:07:49.322056] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-22T20:07:50.122095] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-22T20:07:50.337976] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T20:07:50.922034] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-22T20:07:51.156183] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T20:07:51.505176] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T20:07:51.722059] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-22T20:07:52.362206] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T20:07:52.522049] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-22T20:07:53.001799] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T20:07:53.322038] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-22T20:07:54.122098] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-22T20:07:54.209368] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T20:07:54.624554] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T20:07:54.922052] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-22T20:07:55.722066] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-22T20:07:55.789101] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-22T20:07:55.908495] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T20:07:56.522056] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-22T20:07:56.935913] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-22T20:07:57.322059] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-22T20:07:57.437159] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T20:07:58.122090] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-22T20:07:58.883801] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T20:07:58.922015] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-22T20:07:59.722042] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-22T20:08:00.093128] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-22T20:08:00.378854] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T20:08:00.522108] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-22T20:08:00.564218] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T20:08:01.322066] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-22T20:08:02.122071] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-22T20:08:02.348346] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T20:08:02.359924] [INFO ] [REMOTE ] MT: Full fetch complete (73455 records). [2025-09-22T20:08:02.360167] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-22T20:08:02.868749] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-22T20:08:02.869165] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-22T20:08:02.870622] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-22T20:08:02.870762] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-22T20:08:02.873489] [DEBUG] [LOCAL ] MT: Trimmed 73455 records to 50759 (keeping 200 days of data) [2025-09-22T20:08:02.950567] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-22T20:08:03.055139] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T20:08:03.195381] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T20:08:03.381080] [DEBUG] [LOCAL ] MT: Primary data saved (50759 records). [2025-09-22T20:08:03.381313] [INFO ] [MAIN ] MT: Full history saved. [2025-09-22T20:08:03.381443] [INFO ] [MAIN ] Update Progress: 1415/2372 symbols completed. MT took 40.7s. Estimated remaining: 2h 7m 9s. Rate: 7.5 symbols/min [2025-09-22T20:08:03.606265] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:08:03.689292] [DEBUG] [LOCAL ] MTDR: Loaded 52334 existing records from primary storage. [2025-09-22T20:08:03.689571] [INFO ] [MAIN ] MTDR: Loaded 52334 existing records. [2025-09-22T20:08:03.727269] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-22T20:08:03.951173] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:08:03.951548] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-22T20:08:03.951602] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-22T20:08:03.953004] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-22T20:08:03.953070] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-22T20:08:04.363724] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:08:04.386913] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T20:08:04.392995] [INFO ] [REMOTE ] MTAL: Full fetch complete (46624 records). [2025-09-22T20:08:04.393088] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-22T20:08:04.535205] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-22T20:08:04.786913] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-22T20:08:04.786996] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-22T20:08:04.787782] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-22T20:08:04.787845] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-22T20:08:04.789029] [DEBUG] [LOCAL ] MTAL: Trimmed 46624 records to 36305 (keeping 200 days of data) [2025-09-22T20:08:05.012917] [DEBUG] [LOCAL ] MTAL: Primary data saved (36305 records). [2025-09-22T20:08:05.013070] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-22T20:08:05.013191] [INFO ] [MAIN ] Update Progress: 1416/2372 symbols completed. MTAL took 32.1s. Estimated remaining: 2h 6m 56s. Rate: 7.5 symbols/min [2025-09-22T20:08:05.187622] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:08:05.242347] [DEBUG] [LOCAL ] MTG: Loaded 52129 existing records from primary storage. [2025-09-22T20:08:05.242493] [INFO ] [MAIN ] MTG: Loaded 52129 existing records. [2025-09-22T20:08:05.323368] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-22T20:08:05.427870] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:08:05.428216] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-22T20:08:05.428356] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-22T20:08:05.437844] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-22T20:08:05.443302] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-22T20:08:05.521168] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T20:08:05.839613] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:08:05.853862] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T20:08:06.122056] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-22T20:08:06.922036] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-22T20:08:07.002412] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T20:08:07.722063] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-22T20:08:07.887737] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T20:08:08.522039] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-22T20:08:08.683110] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T20:08:08.692013] [INFO ] [REMOTE ] MTB: Full fetch complete (68457 records). [2025-09-22T20:08:08.692176] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-22T20:08:09.084057] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T20:08:09.124627] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-22T20:08:09.125048] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-22T20:08:09.126361] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-22T20:08:09.126428] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-22T20:08:09.127707] [DEBUG] [LOCAL ] MTB: Trimmed 68457 records to 47175 (keeping 200 days of data) [2025-09-22T20:08:09.329822] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-22T20:08:09.446912] [DEBUG] [LOCAL ] MTB: Primary data saved (47175 records). [2025-09-22T20:08:09.447056] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-22T20:08:09.447163] [INFO ] [MAIN ] Update Progress: 1417/2372 symbols completed. MTB took 29.2s. Estimated remaining: 2h 6m 46s. Rate: 7.5 symbols/min [2025-09-22T20:08:09.625059] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:08:09.668796] [DEBUG] [LOCAL ] MTH: Loaded 44670 existing records from primary storage. [2025-09-22T20:08:09.668944] [INFO ] [MAIN ] MTH: Loaded 44670 existing records. [2025-09-22T20:08:09.854935] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:08:09.855240] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-22T20:08:09.855308] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-22T20:08:09.856495] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-22T20:08:09.856586] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-22T20:08:10.131017] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-22T20:08:10.240051] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:08:10.251028] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T20:08:10.340739] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T20:08:10.922074] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-22T20:08:11.722059] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-22T20:08:11.784593] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T20:08:12.004577] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T20:08:12.522068] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-22T20:08:13.281710] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T20:08:13.322069] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-22T20:08:13.512781] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T20:08:14.122070] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-22T20:08:14.922033] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-22T20:08:15.047671] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T20:08:15.722100] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-22T20:08:15.864223] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-22T20:08:15.954900] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-22T20:08:16.522104] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-22T20:08:17.046224] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T20:08:17.322064] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-22T20:08:17.650724] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T20:08:17.652735] [INFO ] [REMOTE ] MTD: Full fetch complete (21011 records). [2025-09-22T20:08:17.652812] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-22T20:08:18.032344] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-22T20:08:18.032429] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-22T20:08:18.032936] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-22T20:08:18.033000] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-22T20:08:18.033614] [DEBUG] [LOCAL ] MTD: Trimmed 21011 records to 15215 (keeping 200 days of data) [2025-09-22T20:08:18.130371] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-22T20:08:18.137407] [DEBUG] [LOCAL ] MTD: Primary data saved (15215 records). [2025-09-22T20:08:18.137563] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-22T20:08:18.137672] [INFO ] [MAIN ] Update Progress: 1418/2372 symbols completed. MTD took 30.5s. Estimated remaining: 2h 6m 39s. Rate: 7.5 symbols/min [2025-09-22T20:08:18.309688] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:08:18.356169] [DEBUG] [LOCAL ] MTN: Loaded 39558 existing records from primary storage. [2025-09-22T20:08:18.356322] [INFO ] [MAIN ] MTN: Loaded 39558 existing records. [2025-09-22T20:08:18.535602] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:08:18.535916] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-22T20:08:18.535966] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-22T20:08:18.537019] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-22T20:08:18.537080] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-22T20:08:18.890050] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:08:18.922017] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-22T20:08:19.126670] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T20:08:19.664472] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T20:08:19.722040] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-22T20:08:20.210351] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T20:08:20.522150] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-22T20:08:21.322070] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-22T20:08:21.469013] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T20:08:22.123546] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-22T20:08:22.129695] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T20:08:22.922045] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-22T20:08:23.028699] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T20:08:23.703927] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T20:08:23.722009] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-22T20:08:24.266439] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T20:08:24.522062] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-22T20:08:25.147809] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T20:08:25.322063] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-22T20:08:26.122113] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-22T20:08:26.265301] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T20:08:26.808360] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T20:08:26.922013] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-22T20:08:27.722027] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-22T20:08:27.765034] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T20:08:28.381793] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T20:08:28.522032] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-22T20:08:29.184382] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T20:08:29.322033] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-22T20:08:30.122078] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-22T20:08:30.288767] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T20:08:30.927320] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-22T20:08:30.943525] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T20:08:31.715190] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T20:08:31.726045] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-22T20:08:32.522105] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-22T20:08:32.560278] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T20:08:33.059208] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T20:08:33.322030] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-22T20:08:33.980298] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T20:08:34.122063] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-22T20:08:34.922085] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-22T20:08:34.965903] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T20:08:35.422770] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-22T20:08:35.432958] [INFO ] [REMOTE ] MTH: Full fetch complete (62541 records). [2025-09-22T20:08:35.433147] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-22T20:08:35.727369] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-22T20:08:35.821329] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-22T20:08:35.821407] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-22T20:08:35.822303] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-22T20:08:35.822369] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-22T20:08:35.823617] [DEBUG] [LOCAL ] MTH: Trimmed 62541 records to 43969 (keeping 200 days of data) [2025-09-22T20:08:36.100040] [DEBUG] [LOCAL ] MTH: Primary data saved (43969 records). [2025-09-22T20:08:36.100171] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-22T20:08:36.100254] [INFO ] [MAIN ] Update Progress: 1419/2372 symbols completed. MTH took 26.7s. Estimated remaining: 2h 6m 37s. Rate: 7.5 symbols/min [2025-09-22T20:08:36.285758] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:08:36.285969] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-22T20:08:36.286020] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-22T20:08:36.286175] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-22T20:08:36.286217] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-22T20:08:36.286259] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-22T20:08:36.286291] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-22T20:08:36.525813] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-22T20:08:36.663554] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:08:36.785192] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T20:08:36.793183] [INFO ] [REMOTE ] MTG: Full fetch complete (73959 records). [2025-09-22T20:08:36.793307] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-22T20:08:37.187928] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-22T20:08:37.188008] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-22T20:08:37.189023] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-22T20:08:37.189096] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-22T20:08:37.193741] [DEBUG] [LOCAL ] MTG: Trimmed 73959 records to 51374 (keeping 200 days of data) [2025-09-22T20:08:37.372095] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-22T20:08:37.519634] [DEBUG] [LOCAL ] MTG: Primary data saved (51374 records). [2025-09-22T20:08:37.519793] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-22T20:08:37.519881] [INFO ] [MAIN ] Update Progress: 1420/2372 symbols completed. MTG took 32.5s. Estimated remaining: 2h 6m 25s. Rate: 7.5 symbols/min [2025-09-22T20:08:37.699553] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:08:37.733136] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-22T20:08:37.757740] [DEBUG] [LOCAL ] MTRN: Loaded 18229 existing records from primary storage. [2025-09-22T20:08:37.757904] [INFO ] [MAIN ] MTRN: Loaded 18229 existing records. [2025-09-22T20:08:37.944199] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T20:08:37.950160] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:08:37.951755] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-22T20:08:37.951896] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-22T20:08:37.952549] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-22T20:08:37.952618] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-22T20:08:38.123729] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-22T20:08:38.161294] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T20:08:38.358387] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:08:38.673561] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-22T20:08:38.922121] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-22T20:08:39.722117] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-22T20:08:40.036585] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-22T20:08:40.522058] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-22T20:08:40.872124] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T20:08:41.322058] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-22T20:08:41.754629] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-09-22T20:08:42.122032] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-22T20:08:42.209095] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T20:08:42.922052] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-22T20:08:43.630954] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T20:08:43.722016] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-22T20:08:43.791389] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T20:08:44.522092] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-22T20:08:45.065675] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T20:08:45.322056] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-22T20:08:45.402323] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T20:08:45.689046] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-22T20:08:46.122115] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-22T20:08:46.922048] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-22T20:08:47.722115] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-22T20:08:47.883352] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T20:08:47.950812] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T20:08:48.142287] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T20:08:48.522059] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-22T20:08:49.322083] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-22T20:08:49.542907] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T20:08:50.122083] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-22T20:08:50.306823] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T20:08:50.922029] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-22T20:08:51.216809] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T20:08:51.229928] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-22T20:08:51.722063] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-22T20:08:52.522069] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-22T20:08:53.271033] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T20:08:53.277598] [INFO ] [REMOTE ] MTN: Full fetch complete (56155 records). [2025-09-22T20:08:53.277750] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-22T20:08:53.327144] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-22T20:08:53.641031] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T20:08:53.741742] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-22T20:08:53.741844] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-22T20:08:53.742843] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-22T20:08:53.742910] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-22T20:08:53.744240] [DEBUG] [LOCAL ] MTN: Trimmed 56155 records to 38983 (keeping 200 days of data) [2025-09-22T20:08:53.996227] [DEBUG] [LOCAL ] MTN: Primary data saved (38983 records). [2025-09-22T20:08:53.996385] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-22T20:08:53.999416] [INFO ] [MAIN ] Update Progress: 1421/2372 symbols completed. MTN took 35.9s. Estimated remaining: 2h 6m 23s. Rate: 7.5 symbols/min [2025-09-22T20:08:54.127188] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-22T20:08:54.192102] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:08:54.225918] [DEBUG] [LOCAL ] MTUS: Loaded 29399 existing records from primary storage. [2025-09-22T20:08:54.226071] [INFO ] [MAIN ] MTUS: Loaded 29399 existing records. [2025-09-22T20:08:54.423851] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:08:54.424152] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-22T20:08:54.424209] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-22T20:08:54.424966] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-22T20:08:54.425026] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-22T20:08:54.793418] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:08:54.922032] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-22T20:08:55.098421] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T20:08:55.106412] [INFO ] [REMOTE ] MTDR: Full fetch complete (73349 records). [2025-09-22T20:08:55.106553] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-22T20:08:55.512561] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-22T20:08:55.512715] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-22T20:08:55.513768] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-22T20:08:55.514018] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-22T20:08:55.515783] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T20:08:55.522205] [DEBUG] [LOCAL ] MTDR: Trimmed 73349 records to 51549 (keeping 200 days of data) [2025-09-22T20:08:55.737720] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-22T20:08:55.847789] [DEBUG] [LOCAL ] MTDR: Primary data saved (51549 records). [2025-09-22T20:08:55.847942] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-22T20:08:55.848068] [INFO ] [MAIN ] Update Progress: 1422/2372 symbols completed. MTDR took 52.5s. Estimated remaining: 2h 6m 11s. Rate: 7.5 symbols/min [2025-09-22T20:08:56.018793] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:08:56.046897] [DEBUG] [LOCAL ] MTW: Loaded 27033 existing records from primary storage. [2025-09-22T20:08:56.047052] [INFO ] [MAIN ] MTW: Loaded 27033 existing records. [2025-09-22T20:08:56.240685] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:08:56.240972] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-22T20:08:56.241021] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-22T20:08:56.241806] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-22T20:08:56.241867] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-22T20:08:56.523935] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-22T20:08:56.677769] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T20:08:56.866492] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:08:56.888933] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T20:08:56.902359] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-22T20:08:57.322089] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-22T20:08:58.122016] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-22T20:08:58.591777] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T20:08:58.911752] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T20:08:58.915306] [INFO ] [REMOTE ] MTRN: Full fetch complete (23210 records). [2025-09-22T20:08:58.915422] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-22T20:08:58.927760] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-22T20:08:59.317893] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-22T20:08:59.318007] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-22T20:08:59.318922] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-22T20:08:59.319007] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-22T20:08:59.320115] [DEBUG] [LOCAL ] MTRN: Trimmed 23210 records to 18011 (keeping 200 days of data) [2025-09-22T20:08:59.448794] [DEBUG] [LOCAL ] MTRN: Primary data saved (18011 records). [2025-09-22T20:08:59.449019] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-22T20:08:59.449136] [INFO ] [MAIN ] Update Progress: 1423/2372 symbols completed. MTRN took 21.9s. Estimated remaining: 2h 5m 60s. Rate: 7.5 symbols/min [2025-09-22T20:08:59.648198] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:08:59.673057] [DEBUG] [LOCAL ] MTX: Loaded 23151 existing records from primary storage. [2025-09-22T20:08:59.673284] [INFO ] [MAIN ] MTX: Loaded 23151 existing records. [2025-09-22T20:08:59.727273] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-22T20:08:59.872853] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:08:59.873207] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-22T20:08:59.873260] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-22T20:08:59.874141] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-22T20:08:59.874204] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-22T20:09:00.260132] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:09:00.280111] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T20:09:00.522079] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-22T20:09:00.920580] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T20:09:01.322102] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-22T20:09:01.360011] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T20:09:02.122071] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-22T20:09:02.922097] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-22T20:09:03.295912] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-22T20:09:03.722086] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-22T20:09:03.999522] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T20:09:04.000621] [INFO ] [REMOTE ] MTR: Full fetch complete (2588 records). [2025-09-22T20:09:04.000740] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-22T20:09:04.216001] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T20:09:04.216365] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:09:04.216426] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:09:04.216509] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-22T20:09:04.216677] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-22T20:09:04.216736] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-22T20:09:04.216784] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-22T20:09:04.216847] [INFO ] [MAIN ] Update Progress: 1424/2372 symbols completed. MTR took 28.1s. Estimated remaining: 2h 5m 50s. Rate: 7.5 symbols/min [2025-09-22T20:09:04.403045] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:09:04.455320] [DEBUG] [LOCAL ] MTZ: Loaded 44264 existing records from primary storage. [2025-09-22T20:09:04.455526] [INFO ] [MAIN ] MTZ: Loaded 44264 existing records. [2025-09-22T20:09:04.531150] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-22T20:09:04.653961] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:09:04.654272] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-22T20:09:04.654322] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-22T20:09:04.655732] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-22T20:09:04.655794] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-22T20:09:05.036730] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:09:05.165073] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T20:09:05.306025] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-22T20:09:05.321999] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-22T20:09:06.051891] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T20:09:06.122010] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-22T20:09:06.221359] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T20:09:06.922083] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-22T20:09:07.273633] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-22T20:09:07.722083] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-22T20:09:08.118845] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T20:09:08.522068] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-22T20:09:08.781985] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T20:09:09.322070] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-22T20:09:10.121188] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T20:09:10.124365] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-22T20:09:10.626976] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T20:09:10.922051] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-22T20:09:11.233582] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T20:09:11.722066] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-22T20:09:12.524034] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-22T20:09:12.541267] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T20:09:12.580002] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T20:09:13.322066] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-22T20:09:13.965750] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T20:09:14.122069] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-22T20:09:14.525756] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T20:09:14.922057] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-22T20:09:15.722102] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-22T20:09:16.198814] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-22T20:09:16.522056] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-22T20:09:16.728191] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T20:09:16.973807] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T20:09:17.322081] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-22T20:09:18.122099] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-22T20:09:18.276867] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T20:09:18.522432] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T20:09:18.922092] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-22T20:09:19.010438] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T20:09:19.722013] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-22T20:09:20.185907] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T20:09:20.522071] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-22T20:09:21.041082] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T20:09:21.322083] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-22T20:09:22.122058] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-22T20:09:22.153949] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T20:09:22.388425] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T20:09:22.922039] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-22T20:09:23.367497] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T20:09:23.722036] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-22T20:09:24.041966] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T20:09:24.522055] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-22T20:09:25.322026] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-22T20:09:25.427194] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T20:09:25.683587] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T20:09:25.688056] [INFO ] [REMOTE ] MTUS: Full fetch complete (42871 records). [2025-09-22T20:09:25.688147] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-22T20:09:26.073232] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-22T20:09:26.073324] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-22T20:09:26.074161] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-22T20:09:26.074225] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-22T20:09:26.075347] [DEBUG] [LOCAL ] MTUS: Trimmed 42871 records to 28785 (keeping 200 days of data) [2025-09-22T20:09:26.125331] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-22T20:09:26.255038] [DEBUG] [LOCAL ] MTUS: Primary data saved (28785 records). [2025-09-22T20:09:26.255276] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-22T20:09:26.255498] [INFO ] [MAIN ] Update Progress: 1425/2372 symbols completed. MTUS took 32.3s. Estimated remaining: 2h 5m 51s. Rate: 7.5 symbols/min [2025-09-22T20:09:26.429346] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:09:26.445305] [DEBUG] [LOCAL ] MUA: Loaded 12547 existing records from primary storage. [2025-09-22T20:09:26.445451] [INFO ] [MAIN ] MUA: Loaded 12547 existing records. [2025-09-22T20:09:26.623084] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:09:26.623371] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-22T20:09:26.623419] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-22T20:09:26.623945] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-22T20:09:26.624006] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-22T20:09:26.919387] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T20:09:26.925483] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-22T20:09:26.947077] [INFO ] [REMOTE ] MTW: Full fetch complete (38414 records). [2025-09-22T20:09:26.967205] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-22T20:09:27.035584] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:09:27.398823] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-22T20:09:27.398903] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-22T20:09:27.399633] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-22T20:09:27.399717] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-22T20:09:27.400513] [DEBUG] [LOCAL ] MTW: Trimmed 38414 records to 26506 (keeping 200 days of data) [2025-09-22T20:09:27.574713] [DEBUG] [LOCAL ] MTW: Primary data saved (26506 records). [2025-09-22T20:09:27.574947] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-22T20:09:27.575348] [INFO ] [MAIN ] Update Progress: 1426/2372 symbols completed. MTW took 31.7s. Estimated remaining: 2h 5m 39s. Rate: 7.5 symbols/min [2025-09-22T20:09:27.744891] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-22T20:09:27.777591] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:09:27.796284] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T20:09:27.830236] [DEBUG] [LOCAL ] MUC: Loaded 20455 existing records from primary storage. [2025-09-22T20:09:27.830391] [INFO ] [MAIN ] MUC: Loaded 20455 existing records. [2025-09-22T20:09:28.062809] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:09:28.063216] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-22T20:09:28.063354] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-22T20:09:28.064089] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-22T20:09:28.064149] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-22T20:09:28.176674] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T20:09:28.202019] [INFO ] [REMOTE ] MTX: Full fetch complete (31007 records). [2025-09-22T20:09:28.221237] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-22T20:09:28.538759] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-22T20:09:28.704719] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:09:28.705842] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T20:09:28.887242] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-22T20:09:28.887320] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-22T20:09:28.887948] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-22T20:09:28.888013] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-22T20:09:28.888894] [DEBUG] [LOCAL ] MTX: Trimmed 31007 records to 22850 (keeping 200 days of data) [2025-09-22T20:09:29.035404] [DEBUG] [LOCAL ] MTX: Primary data saved (22850 records). [2025-09-22T20:09:29.035540] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-22T20:09:29.035628] [INFO ] [MAIN ] Update Progress: 1427/2372 symbols completed. MTX took 29.6s. Estimated remaining: 2h 5m 26s. Rate: 7.5 symbols/min [2025-09-22T20:09:29.208680] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:09:29.221465] [DEBUG] [LOCAL ] MUE: Loaded 12087 existing records from primary storage. [2025-09-22T20:09:29.221577] [INFO ] [MAIN ] MUE: Loaded 12087 existing records. [2025-09-22T20:09:29.324186] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-22T20:09:29.423286] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:09:29.423809] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-22T20:09:29.423900] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-22T20:09:29.424348] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-22T20:09:29.424420] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-22T20:09:29.789913] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:09:30.122075] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-22T20:09:30.318254] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T20:09:30.480920] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T20:09:30.922111] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-22T20:09:31.399672] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-22T20:09:31.722112] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-22T20:09:32.181435] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T20:09:32.522038] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-22T20:09:32.563445] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T20:09:33.262213] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T20:09:33.322013] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-22T20:09:34.016384] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T20:09:34.122111] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-22T20:09:34.922063] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-22T20:09:35.722039] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-22T20:09:35.773321] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T20:09:35.879385] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T20:09:36.522135] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-22T20:09:36.737193] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T20:09:37.322070] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-22T20:09:38.065290] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T20:09:38.072132] [INFO ] [REMOTE ] MTZ: Full fetch complete (63439 records). [2025-09-22T20:09:38.072265] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-22T20:09:38.122227] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-22T20:09:38.312432] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T20:09:38.512166] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-22T20:09:38.512256] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-22T20:09:38.513252] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-22T20:09:38.513317] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-22T20:09:38.518360] [DEBUG] [LOCAL ] MTZ: Trimmed 63439 records to 43479 (keeping 200 days of data) [2025-09-22T20:09:38.796592] [DEBUG] [LOCAL ] MTZ: Primary data saved (43479 records). [2025-09-22T20:09:38.796753] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-22T20:09:38.796870] [INFO ] [MAIN ] Update Progress: 1428/2372 symbols completed. MTZ took 34.6s. Estimated remaining: 2h 5m 20s. Rate: 7.5 symbols/min [2025-09-22T20:09:38.927181] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-22T20:09:38.975251] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:09:39.037523] [DEBUG] [LOCAL ] MUFG: Loaded 53408 existing records from primary storage. [2025-09-22T20:09:39.037699] [INFO ] [MAIN ] MUFG: Loaded 53408 existing records. [2025-09-22T20:09:39.232497] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T20:09:39.250307] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:09:39.251011] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-22T20:09:39.251068] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-22T20:09:39.252359] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-22T20:09:39.252445] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-22T20:09:39.628701] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:09:39.722108] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-22T20:09:40.022225] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T20:09:40.522082] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-22T20:09:41.269792] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T20:09:41.322036] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-22T20:09:41.475742] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T20:09:42.122020] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-22T20:09:42.279581] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T20:09:42.922115] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-22T20:09:43.688689] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T20:09:43.727185] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-22T20:09:43.744807] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T20:09:44.522042] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-22T20:09:44.756844] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T20:09:45.322032] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-22T20:09:45.369017] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T20:09:46.122069] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-22T20:09:46.321540] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T20:09:46.924801] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-22T20:09:46.927624] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T20:09:47.722060] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-22T20:09:48.522056] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-22T20:09:48.580595] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T20:09:48.620986] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T20:09:49.313276] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T20:09:49.321994] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-22T20:09:50.122084] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-22T20:09:50.309283] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T20:09:50.922048] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-22T20:09:51.707313] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T20:09:51.722006] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-22T20:09:52.045785] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T20:09:52.522057] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-22T20:09:52.647972] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T20:09:53.322032] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-22T20:09:53.577382] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T20:09:54.122107] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-22T20:09:54.922056] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-22T20:09:55.208528] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T20:09:55.246255] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T20:09:55.722090] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-22T20:09:55.805903] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T20:09:55.808101] [INFO ] [REMOTE ] MUA: Full fetch complete (18670 records). [2025-09-22T20:09:55.808199] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-22T20:09:56.194541] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-22T20:09:56.194682] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-22T20:09:56.195114] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-22T20:09:56.195190] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-22T20:09:56.195872] [DEBUG] [LOCAL ] MUA: Trimmed 18670 records to 12232 (keeping 200 days of data) [2025-09-22T20:09:56.282564] [DEBUG] [LOCAL ] MUA: Primary data saved (12232 records). [2025-09-22T20:09:56.282853] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-22T20:09:56.282978] [INFO ] [MAIN ] Update Progress: 1429/2372 symbols completed. MUA took 30.0s. Estimated remaining: 2h 5m 18s. Rate: 7.5 symbols/min [2025-09-22T20:09:56.416314] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T20:09:56.475380] [INFO ] [REMOTE ] MUE: Full fetch complete (16216 records). [2025-09-22T20:09:56.478036] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:09:56.478354] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-22T20:09:56.526213] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-22T20:09:56.639638] [DEBUG] [LOCAL ] MUJ: Loaded 13376 existing records from primary storage. [2025-09-22T20:09:56.658192] [INFO ] [MAIN ] MUJ: Loaded 13376 existing records. [2025-09-22T20:09:57.068824] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:09:57.103936] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-22T20:09:57.104028] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-22T20:09:57.104964] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-22T20:09:57.105070] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-22T20:09:57.105623] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-22T20:09:57.105725] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-22T20:09:57.105829] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-22T20:09:57.105925] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-22T20:09:57.207405] [DEBUG] [LOCAL ] MUE: Trimmed 16216 records to 11972 (keeping 200 days of data) [2025-09-22T20:09:57.330679] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-22T20:09:57.379900] [DEBUG] [LOCAL ] MUE: Primary data saved (11972 records). [2025-09-22T20:09:57.408002] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-22T20:09:57.414245] [INFO ] [MAIN ] Update Progress: 1430/2372 symbols completed. MUE took 28.4s. Estimated remaining: 2h 5m 5s. Rate: 7.5 symbols/min [2025-09-22T20:09:57.696990] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:09:57.754855] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:09:57.817514] [DEBUG] [LOCAL ] MUR: Loaded 53713 existing records from primary storage. [2025-09-22T20:09:57.817726] [INFO ] [MAIN ] MUR: Loaded 53713 existing records. [2025-09-22T20:09:58.011743] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:09:58.012102] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-22T20:09:58.012162] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-22T20:09:58.013372] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-22T20:09:58.013432] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-22T20:09:58.127223] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-22T20:09:58.396482] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:09:58.438968] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T20:09:58.553001] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T20:09:58.922014] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-22T20:09:59.315386] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T20:09:59.722087] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-22T20:09:59.838574] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T20:09:59.842439] [INFO ] [REMOTE ] MUC: Full fetch complete (30034 records). [2025-09-22T20:09:59.842531] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-22T20:10:00.222616] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-22T20:10:00.222967] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-22T20:10:00.223581] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-22T20:10:00.223622] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-22T20:10:00.224355] [DEBUG] [LOCAL ] MUC: Trimmed 30034 records to 20075 (keeping 200 days of data) [2025-09-22T20:10:00.351088] [DEBUG] [LOCAL ] MUC: Primary data saved (20075 records). [2025-09-22T20:10:00.351215] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-22T20:10:00.351340] [INFO ] [MAIN ] Update Progress: 1431/2372 symbols completed. MUC took 32.8s. Estimated remaining: 2h 4m 54s. Rate: 7.5 symbols/min [2025-09-22T20:10:00.523140] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:10:00.523209] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-22T20:10:00.552793] [DEBUG] [LOCAL ] MUSA: Loaded 25473 existing records from primary storage. [2025-09-22T20:10:00.552936] [INFO ] [MAIN ] MUSA: Loaded 25473 existing records. [2025-09-22T20:10:00.736789] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:10:00.737119] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-22T20:10:00.737208] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-22T20:10:00.738103] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-22T20:10:00.738165] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-22T20:10:01.103564] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:10:01.322067] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-22T20:10:01.392419] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T20:10:01.416622] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T20:10:02.122100] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-22T20:10:02.357721] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T20:10:02.922070] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-22T20:10:03.722069] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-22T20:10:03.798604] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T20:10:04.491756] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T20:10:04.522049] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-22T20:10:04.767092] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-22T20:10:05.291511] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T20:10:05.322049] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-22T20:10:06.122120] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-22T20:10:06.135492] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T20:10:06.922056] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-22T20:10:07.713493] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T20:10:07.722008] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-22T20:10:07.935520] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T20:10:08.522106] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-22T20:10:08.651700] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T20:10:09.322099] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-22T20:10:10.122099] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-22T20:10:10.396829] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-22T20:10:10.922076] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-22T20:10:11.001916] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T20:10:11.038309] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T20:10:11.632931] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T20:10:11.722053] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-22T20:10:12.522062] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-22T20:10:13.322029] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-22T20:10:13.370776] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T20:10:13.511265] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T20:10:14.122063] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-22T20:10:14.922038] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-22T20:10:15.172709] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T20:10:15.187060] [INFO ] [REMOTE ] MUFG: Full fetch complete (75413 records). [2025-09-22T20:10:15.187211] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-22T20:10:15.598088] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-22T20:10:15.598183] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-22T20:10:15.599338] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-22T20:10:15.599409] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-22T20:10:15.601373] [DEBUG] [LOCAL ] MUFG: Trimmed 75413 records to 52636 (keeping 200 days of data) [2025-09-22T20:10:15.722704] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-22T20:10:15.965509] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T20:10:15.968624] [DEBUG] [LOCAL ] MUFG: Primary data saved (52636 records). [2025-09-22T20:10:15.974184] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-22T20:10:15.994090] [INFO ] [MAIN ] Update Progress: 1432/2372 symbols completed. MUFG took 37.2s. Estimated remaining: 2h 4m 51s. Rate: 7.5 symbols/min [2025-09-22T20:10:15.995988] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T20:10:16.173892] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:10:16.174142] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-22T20:10:16.174198] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-22T20:10:16.174344] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-22T20:10:16.174398] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-22T20:10:16.174487] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-22T20:10:16.174522] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-22T20:10:16.536736] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-22T20:10:16.561380] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:10:16.715210] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-22T20:10:16.718352] [INFO ] [REMOTE ] MUJ: Full fetch complete (20463 records). [2025-09-22T20:10:16.718426] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-22T20:10:17.080067] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-22T20:10:17.080143] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-22T20:10:17.080582] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-22T20:10:17.080659] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-22T20:10:17.081265] [DEBUG] [LOCAL ] MUJ: Trimmed 20463 records to 13226 (keeping 200 days of data) [2025-09-22T20:10:17.161956] [DEBUG] [LOCAL ] MUJ: Primary data saved (13226 records). [2025-09-22T20:10:17.162110] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-22T20:10:17.162199] [INFO ] [MAIN ] Update Progress: 1433/2372 symbols completed. MUJ took 20.9s. Estimated remaining: 2h 4m 39s. Rate: 7.5 symbols/min [2025-09-22T20:10:17.330162] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-22T20:10:17.334400] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:10:17.388330] [DEBUG] [LOCAL ] MUX: Loaded 42940 existing records from primary storage. [2025-09-22T20:10:17.388554] [INFO ] [MAIN ] MUX: Loaded 42940 existing records. [2025-09-22T20:10:17.566065] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:10:17.566328] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-22T20:10:17.566384] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-22T20:10:17.567335] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-22T20:10:17.567395] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-22T20:10:17.924215] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:10:18.122046] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-22T20:10:18.321386] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T20:10:18.534292] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T20:10:18.922048] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-22T20:10:19.289945] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-22T20:10:19.419148] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T20:10:19.722073] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-22T20:10:20.522062] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-22T20:10:21.040797] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T20:10:21.322059] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-22T20:10:21.732118] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T20:10:22.122055] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-22T20:10:22.647565] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T20:10:22.922083] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-22T20:10:23.586169] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T20:10:23.722061] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-22T20:10:24.207286] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T20:10:24.522057] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-22T20:10:25.322072] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-22T20:10:25.368289] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T20:10:25.441529] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T20:10:26.122089] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-22T20:10:26.922036] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-22T20:10:27.040739] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T20:10:27.662923] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T20:10:27.722021] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-22T20:10:28.200723] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T20:10:28.522092] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-22T20:10:28.905404] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T20:10:29.322083] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-22T20:10:30.122035] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-22T20:10:30.361329] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T20:10:30.426187] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T20:10:30.922061] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-22T20:10:31.134502] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:10:31.134913] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-22T20:10:31.335773] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T20:10:31.340059] [INFO ] [REMOTE ] MUSA: Full fetch complete (34960 records). [2025-09-22T20:10:31.340147] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-22T20:10:31.727161] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-22T20:10:31.740769] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-22T20:10:31.740866] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-22T20:10:31.741668] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-22T20:10:31.741848] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-22T20:10:31.742716] [DEBUG] [LOCAL ] MUSA: Trimmed 34960 records to 25049 (keeping 200 days of data) [2025-09-22T20:10:31.902726] [DEBUG] [LOCAL ] MUSA: Primary data saved (25049 records). [2025-09-22T20:10:31.902869] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-22T20:10:31.902957] [INFO ] [MAIN ] Update Progress: 1434/2372 symbols completed. MUSA took 31.6s. Estimated remaining: 2h 4m 35s. Rate: 7.5 symbols/min [2025-09-22T20:10:32.079859] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:10:32.093503] [DEBUG] [LOCAL ] MVF: Loaded 13078 existing records from primary storage. [2025-09-22T20:10:32.093615] [INFO ] [MAIN ] MVF: Loaded 13078 existing records. [2025-09-22T20:10:32.273186] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:10:32.273445] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-22T20:10:32.273493] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-22T20:10:32.273975] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-22T20:10:32.274034] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-22T20:10:32.528003] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-22T20:10:32.638128] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:10:32.795908] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:10:32.796244] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-22T20:10:33.322023] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-22T20:10:33.427471] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T20:10:34.122039] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-22T20:10:34.283347] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T20:10:34.922063] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-22T20:10:35.143189] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-22T20:10:35.722033] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-22T20:10:35.823931] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T20:10:36.522095] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-22T20:10:37.274337] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T20:10:37.322053] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-22T20:10:37.366171] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T20:10:37.949004] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T20:10:38.122062] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-22T20:10:38.922119] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-22T20:10:39.722034] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-22T20:10:39.920957] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T20:10:39.928778] [INFO ] [REMOTE ] MUX: Full fetch complete (58649 records). [2025-09-22T20:10:39.928901] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-22T20:10:40.010729] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-22T20:10:40.326025] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-22T20:10:40.326146] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-22T20:10:40.327061] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-22T20:10:40.327124] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-22T20:10:40.328400] [DEBUG] [LOCAL ] MUX: Trimmed 58649 records to 42394 (keeping 200 days of data) [2025-09-22T20:10:40.528564] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-22T20:10:40.578936] [DEBUG] [LOCAL ] MUX: Primary data saved (42394 records). [2025-09-22T20:10:40.579070] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-22T20:10:40.579151] [INFO ] [MAIN ] Update Progress: 1435/2372 symbols completed. MUX took 23.4s. Estimated remaining: 2h 4m 28s. Rate: 7.5 symbols/min [2025-09-22T20:10:40.755552] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:10:40.755780] [DEBUG] [LOCAL ] MVO: No existing data file found in primary storage. [2025-09-22T20:10:40.755872] [WARN ] [MAIN ] MVO: No existing data found, performing full refresh instead. [2025-09-22T20:10:40.756253] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-22T20:10:40.756401] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-22T20:10:40.756485] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-09-22T20:10:40.756528] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-22T20:10:41.049407] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-22T20:10:41.091397] [INFO ] [REMOTE ] MUR: Full fetch complete (76339 records). [2025-09-22T20:10:41.101834] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-22T20:10:41.220665] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:10:41.329511] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-22T20:10:41.512079] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T20:10:41.597515] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-22T20:10:41.597613] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-22T20:10:41.598718] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-22T20:10:41.598794] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-22T20:10:41.600409] [DEBUG] [LOCAL ] MUR: Trimmed 76339 records to 52929 (keeping 200 days of data) [2025-09-22T20:10:41.943958] [DEBUG] [LOCAL ] MUR: Primary data saved (52929 records). [2025-09-22T20:10:41.944115] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-22T20:10:41.944206] [INFO ] [MAIN ] Update Progress: 1436/2372 symbols completed. MUR took 44.5s. Estimated remaining: 2h 4m 15s. Rate: 7.5 symbols/min [2025-09-22T20:10:42.101743] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T20:10:42.140302] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:10:42.139253] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-22T20:10:42.153170] [DEBUG] [LOCAL ] MVT: Loaded 10194 existing records from primary storage. [2025-09-22T20:10:42.153298] [INFO ] [MAIN ] MVT: Loaded 10194 existing records. [2025-09-22T20:10:42.340835] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:10:42.341180] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-22T20:10:42.341238] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-22T20:10:42.341587] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-22T20:10:42.341681] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-22T20:10:42.716117] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:10:42.922055] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-22T20:10:42.946016] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T20:10:43.722076] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-22T20:10:43.893455] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T20:10:44.399325] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-22T20:10:44.522098] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-22T20:10:44.747514] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-22T20:10:45.322063] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-22T20:10:45.575266] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-22T20:10:46.122079] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-22T20:10:46.922042] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-22T20:10:46.995063] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T20:10:47.139219] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-22T20:10:47.722079] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-22T20:10:48.510347] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T20:10:48.521991] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-22T20:10:49.322070] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-22T20:10:49.334199] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T20:10:50.009200] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-22T20:10:50.122069] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-22T20:10:50.922087] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-22T20:10:50.994133] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-22T20:10:51.643752] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T20:10:51.722061] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-22T20:10:52.011374] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-22T20:10:52.522103] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-22T20:10:53.308993] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T20:10:53.322011] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-22T20:10:54.023024] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T20:10:54.122096] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-22T20:10:54.922100] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-22T20:10:54.928544] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T20:10:55.358410] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:10:55.358773] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-22T20:10:55.358878] [INFO ] [REMOTE ] MUSE: Full fetch complete (104 records). [2025-09-22T20:10:55.358950] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-22T20:10:55.359541] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:10:55.359618] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:10:55.359729] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:10:55.359808] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-22T20:10:55.359874] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-22T20:10:55.359911] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-22T20:10:55.359972] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-22T20:10:55.360055] [INFO ] [MAIN ] Update Progress: 1437/2372 symbols completed. MUSE took 39.4s. Estimated remaining: 2h 4m 11s. Rate: 7.5 symbols/min [2025-09-22T20:10:55.722068] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-22T20:10:56.520517] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-22T20:10:56.523494] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-22T20:10:57.322080] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-22T20:10:57.416827] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T20:10:58.012725] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T20:10:58.122048] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-22T20:10:58.844431] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-22T20:10:58.846311] [INFO ] [REMOTE ] MVO: Full fetch complete (14590 records). [2025-09-22T20:10:58.846381] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-22T20:10:58.927138] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-22T20:10:59.217862] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-22T20:10:59.217938] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-22T20:10:59.218250] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-22T20:10:59.218287] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-22T20:10:59.218794] [DEBUG] [LOCAL ] MVO: Trimmed 14590 records to 9049 (keeping 200 days of data) [2025-09-22T20:10:59.270944] [DEBUG] [LOCAL ] MVO: Primary data saved (9049 records). [2025-09-22T20:10:59.271080] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-22T20:10:59.271156] [INFO ] [MAIN ] Update Progress: 1438/2372 symbols completed. MVO took 18.7s. Estimated remaining: 2h 4m 0s. Rate: 7.5 symbols/min [2025-09-22T20:10:59.722054] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-22T20:10:59.874911] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T20:10:59.877856] [INFO ] [REMOTE ] MVF: Full fetch complete (19187 records). [2025-09-22T20:10:59.877934] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-22T20:11:00.268913] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-22T20:11:00.269054] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-22T20:11:00.269475] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-22T20:11:00.269517] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-22T20:11:00.270122] [DEBUG] [LOCAL ] MVF: Trimmed 19187 records to 12801 (keeping 200 days of data) [2025-09-22T20:11:00.345887] [DEBUG] [LOCAL ] MVF: Primary data saved (12801 records). [2025-09-22T20:11:00.346030] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-22T20:11:00.346116] [INFO ] [MAIN ] Update Progress: 1439/2372 symbols completed. MVF took 28.4s. Estimated remaining: 2h 3m 48s. Rate: 7.5 symbols/min [2025-09-22T20:11:00.356080] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T20:11:00.522051] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-22T20:11:01.395818] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-22T20:11:01.398512] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-22T20:11:02.247848] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-22T20:11:02.252141] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-22T20:11:03.086236] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T20:11:03.090092] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-22T20:11:03.983965] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T20:11:03.987628] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-22T20:11:04.753106] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T20:11:04.755735] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-22T20:11:05.578362] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T20:11:05.581123] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-22T20:11:06.446587] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T20:11:06.448831] [INFO ] [REMOTE ] MVT: Full fetch complete (14566 records). [2025-09-22T20:11:06.448905] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-22T20:11:06.810418] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-22T20:11:06.810501] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-22T20:11:06.810847] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-22T20:11:06.810911] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-22T20:11:06.811433] [DEBUG] [LOCAL ] MVT: Trimmed 14566 records to 10049 (keeping 200 days of data) [2025-09-22T20:11:06.877494] [DEBUG] [LOCAL ] MVT: Primary data saved (10049 records). [2025-09-22T20:11:06.877617] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-22T20:11:06.877727] [INFO ] [MAIN ] Update Progress: 1440/2372 symbols completed. MVT took 24.9s. Estimated remaining: 2h 3m 39s. Rate: 7.5 symbols/min [2025-09-22T20:11:07.405493] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:11:07.511448] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:11:07.543539] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:11:07.588531] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:11:07.588886] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-22T20:11:07.591863] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-22T20:11:07.592079] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-22T20:11:07.593793] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-22T20:11:07.593953] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-22T20:11:07.594028] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-22T20:11:07.670607] [DEBUG] [LOCAL ] MXF: Loaded 6145 existing records from primary storage. [2025-09-22T20:11:07.698837] [INFO ] [MAIN ] MXF: Loaded 6145 existing records. [2025-09-22T20:11:07.806296] [DEBUG] [LOCAL ] MX: Loaded 23271 existing records from primary storage. [2025-09-22T20:11:07.837792] [INFO ] [MAIN ] MX: Loaded 23271 existing records. [2025-09-22T20:11:08.098791] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:11:08.135798] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-22T20:11:08.135588] [DEBUG] [LOCAL ] MWA: Loaded 47924 existing records from primary storage. [2025-09-22T20:11:08.155046] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-22T20:11:08.209296] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-22T20:11:08.219698] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-22T20:11:08.191577] [INFO ] [MAIN ] MWA: Loaded 47924 existing records. [2025-09-22T20:11:08.400408] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:11:08.567844] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-22T20:11:08.596388] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-22T20:11:08.612980] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:11:08.623434] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-22T20:11:08.623820] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-22T20:11:08.648100] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-22T20:11:08.887486] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:11:08.953097] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-22T20:11:08.966670] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-22T20:11:09.053528] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-22T20:11:09.076137] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-22T20:11:09.182110] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:11:09.182240] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-22T20:11:09.216706] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-22T20:11:09.236064] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-22T20:11:09.530341] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:11:09.563254] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-22T20:11:09.681019] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:11:09.681313] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-22T20:11:09.778900] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-22T20:11:09.936608] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-22T20:11:10.122095] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-22T20:11:10.421131] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T20:11:10.922041] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-22T20:11:10.947190] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T20:11:11.190615] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T20:11:11.289469] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-22T20:11:11.722052] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-22T20:11:12.522097] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-22T20:11:12.945431] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-22T20:11:13.322066] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-22T20:11:13.364707] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T20:11:14.110513] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T20:11:14.122008] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-22T20:11:14.922028] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-22T20:11:15.010522] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T20:11:15.460273] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-22T20:11:15.722053] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-22T20:11:16.522065] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-22T20:11:16.779294] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T20:11:17.322053] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-22T20:11:18.123632] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-22T20:11:18.126089] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T20:11:18.324171] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T20:11:18.509975] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-22T20:11:18.922083] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-22T20:11:19.722081] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-22T20:11:20.522082] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-22T20:11:20.624609] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T20:11:20.643690] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T20:11:21.032294] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T20:11:21.322056] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-22T20:11:22.090065] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T20:11:22.122010] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-22T20:11:22.730273] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-22T20:11:22.922053] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-22T20:11:23.461582] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-22T20:11:23.722114] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-22T20:11:24.391063] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-22T20:11:24.522016] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-22T20:11:25.059823] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-22T20:11:25.322062] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-22T20:11:25.938552] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T20:11:25.939575] [INFO ] [REMOTE ] MXF: Full fetch complete (10526 records). [2025-09-22T20:11:25.939678] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-22T20:11:26.134979] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-22T20:11:26.349269] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-22T20:11:26.349373] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-22T20:11:26.349697] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-22T20:11:26.349763] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-22T20:11:26.350352] [DEBUG] [LOCAL ] MXF: Trimmed 10526 records to 6012 (keeping 200 days of data) [2025-09-22T20:11:26.390539] [DEBUG] [LOCAL ] MXF: Primary data saved (6012 records). [2025-09-22T20:11:26.390722] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-22T20:11:26.390827] [INFO ] [MAIN ] Update Progress: 1441/2372 symbols completed. MXF took 19.5s. Estimated remaining: 2h 3m 39s. Rate: 7.5 symbols/min [2025-09-22T20:11:26.568890] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:11:26.583459] [DEBUG] [LOCAL ] MYD: Loaded 13981 existing records from primary storage. [2025-09-22T20:11:26.583572] [INFO ] [MAIN ] MYD: Loaded 13981 existing records. [2025-09-22T20:11:26.775268] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:11:26.775589] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-22T20:11:26.775684] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-22T20:11:26.776746] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-22T20:11:26.776810] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-22T20:11:26.928445] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-22T20:11:27.167482] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:11:27.722040] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-22T20:11:27.967849] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T20:11:28.215937] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T20:11:28.522039] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-22T20:11:28.680373] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T20:11:29.322025] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-22T20:11:29.687587] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T20:11:30.122086] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-22T20:11:30.136037] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T20:11:30.922081] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-22T20:11:31.722023] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-22T20:11:31.754346] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T20:11:32.106763] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T20:11:32.522022] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-22T20:11:32.577466] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T20:11:33.322071] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-22T20:11:33.618773] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-22T20:11:33.618622] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T20:11:34.122069] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-22T20:11:34.695726] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T20:11:34.696745] [INFO ] [REMOTE ] MXE: Full fetch complete (2686 records). [2025-09-22T20:11:34.696814] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-22T20:11:34.921450] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T20:11:34.921684] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:11:34.921757] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:11:34.921830] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-22T20:11:34.921895] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-22T20:11:34.921932] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-22T20:11:34.921974] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-22T20:11:34.922034] [INFO ] [MAIN ] Update Progress: 1442/2372 symbols completed. MXE took 28.0s. Estimated remaining: 2h 3m 31s. Rate: 7.5 symbols/min [2025-09-22T20:11:34.922143] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-22T20:11:35.099172] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:11:35.128261] [DEBUG] [LOCAL ] MYE: Loaded 25917 existing records from primary storage. [2025-09-22T20:11:35.128401] [INFO ] [MAIN ] MYE: Loaded 25917 existing records. [2025-09-22T20:11:35.312678] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:11:35.312973] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-22T20:11:35.313045] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-22T20:11:35.314168] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-22T20:11:35.314231] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-22T20:11:35.697985] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:11:35.722015] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-22T20:11:36.018106] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T20:11:36.522122] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-22T20:11:36.704315] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T20:11:37.322057] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-22T20:11:38.051704] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T20:11:38.122040] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-22T20:11:38.425184] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T20:11:38.922033] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-22T20:11:39.148815] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T20:11:39.722062] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-22T20:11:40.248282] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T20:11:40.522067] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-22T20:11:40.730452] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T20:11:41.322105] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-22T20:11:41.748983] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T20:11:42.122039] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-22T20:11:42.201487] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T20:11:42.922069] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-22T20:11:43.307096] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T20:11:43.722024] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-22T20:11:43.797418] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T20:11:44.522068] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-22T20:11:45.272355] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T20:11:45.304820] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T20:11:45.321994] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-22T20:11:46.094381] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T20:11:46.122098] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-22T20:11:46.922068] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-22T20:11:47.671168] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T20:11:47.678123] [INFO ] [REMOTE ] MWA: Full fetch complete (67808 records). [2025-09-22T20:11:47.678260] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-22T20:11:47.733416] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-22T20:11:48.093164] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-22T20:11:48.093301] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-22T20:11:48.094546] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-22T20:11:48.094670] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-22T20:11:48.097410] [DEBUG] [LOCAL ] MWA: Trimmed 67808 records to 47143 (keeping 200 days of data) [2025-09-22T20:11:48.215546] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T20:11:48.224624] [INFO ] [REMOTE ] MX: Full fetch complete (31802 records). [2025-09-22T20:11:48.225608] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-22T20:11:48.525941] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-22T20:11:48.660444] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-22T20:11:48.662108] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-22T20:11:48.662969] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-22T20:11:48.667579] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-22T20:11:48.719833] [DEBUG] [LOCAL ] MX: Trimmed 31802 records to 22982 (keeping 200 days of data) [2025-09-22T20:11:48.927229] [DEBUG] [LOCAL ] MWA: Primary data saved (47143 records). [2025-09-22T20:11:48.929546] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-22T20:11:48.933589] [INFO ] [MAIN ] Update Progress: 1443/2372 symbols completed. MWA took 42.1s. Estimated remaining: 2h 3m 27s. Rate: 7.5 symbols/min [2025-09-22T20:11:49.136324] [DEBUG] [LOCAL ] MX: Primary data saved (22982 records). [2025-09-22T20:11:49.144867] [INFO ] [MAIN ] MX: Full history saved. [2025-09-22T20:11:49.170673] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T20:11:49.166850] [INFO ] [MAIN ] Update Progress: 1444/2372 symbols completed. MX took 42.3s. Estimated remaining: 2h 3m 14s. Rate: 7.5 symbols/min [2025-09-22T20:11:49.172112] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:11:49.331854] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-22T20:11:49.371436] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:11:49.373057] [DEBUG] [LOCAL ] MYI: Loaded 19663 existing records from primary storage. [2025-09-22T20:11:49.373128] [INFO ] [MAIN ] MYI: Loaded 19663 existing records. [2025-09-22T20:11:49.545283] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-22T20:11:49.523870] [DEBUG] [LOCAL ] MYN: Loaded 10530 existing records from primary storage. [2025-09-22T20:11:49.568706] [INFO ] [MAIN ] MYN: Loaded 10530 existing records. [2025-09-22T20:11:49.603963] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:11:49.651763] [INFO ] [REMOTE ] MYD: Full fetch complete (20842 records). [2025-09-22T20:11:49.672507] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-22T20:11:49.689370] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-22T20:11:49.737536] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-22T20:11:49.762991] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-22T20:11:49.805284] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-22T20:11:49.926827] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:11:49.984812] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-22T20:11:50.006171] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-22T20:11:50.085065] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-22T20:11:50.165842] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-22T20:11:50.621401] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-22T20:11:50.681737] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-22T20:11:50.763394] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-22T20:11:50.779675] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:11:50.790204] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-22T20:11:50.810954] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-22T20:11:50.865009] [DEBUG] [LOCAL ] MYD: Trimmed 20842 records to 13748 (keeping 200 days of data) [2025-09-22T20:11:51.007053] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:11:51.015794] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-22T20:11:51.035047] [DEBUG] [LOCAL ] MYD: Primary data saved (13748 records). [2025-09-22T20:11:51.035264] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-22T20:11:51.035455] [INFO ] [MAIN ] Update Progress: 1445/2372 symbols completed. MYD took 24.6s. Estimated remaining: 2h 3m 2s. Rate: 7.5 symbols/min [2025-09-22T20:11:51.107634] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T20:11:51.247614] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:11:51.293317] [DEBUG] [LOCAL ] NABL: Loaded 40942 existing records from primary storage. [2025-09-22T20:11:51.293496] [INFO ] [MAIN ] NABL: Loaded 40942 existing records. [2025-09-22T20:11:51.472538] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:11:51.472943] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-22T20:11:51.473012] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-22T20:11:51.473992] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-22T20:11:51.474068] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-22T20:11:51.731332] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-22T20:11:51.851068] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:11:52.007351] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T20:11:52.032333] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T20:11:52.522072] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-22T20:11:52.871233] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T20:11:53.322056] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-22T20:11:53.850409] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T20:11:54.122061] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-22T20:11:54.233729] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T20:11:54.922053] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-22T20:11:55.230331] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T20:11:55.722088] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-22T20:11:55.862211] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T20:11:56.196387] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-22T20:11:56.522144] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-22T20:11:57.322099] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-22T20:11:57.375267] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T20:11:58.122027] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-22T20:11:58.405686] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T20:11:58.922070] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-22T20:11:59.124438] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T20:11:59.725170] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-22T20:11:59.731291] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T20:12:00.522058] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-22T20:12:01.132114] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T20:12:01.322059] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-22T20:12:02.122059] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-22T20:12:02.367592] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T20:12:02.752454] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T20:12:02.756821] [INFO ] [REMOTE ] MYE: Full fetch complete (36965 records). [2025-09-22T20:12:02.757090] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-22T20:12:02.927181] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-22T20:12:03.180325] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-22T20:12:03.180420] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-22T20:12:03.181160] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-22T20:12:03.181249] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-22T20:12:03.182248] [DEBUG] [LOCAL ] MYE: Trimmed 36965 records to 25322 (keeping 200 days of data) [2025-09-22T20:12:03.353289] [DEBUG] [LOCAL ] MYE: Primary data saved (25322 records). [2025-09-22T20:12:03.353428] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-22T20:12:03.353542] [INFO ] [MAIN ] Update Progress: 1446/2372 symbols completed. MYE took 28.4s. Estimated remaining: 2h 2m 57s. Rate: 7.5 symbols/min [2025-09-22T20:12:03.524049] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:12:03.551696] [DEBUG] [LOCAL ] NAC: Loaded 25128 existing records from primary storage. [2025-09-22T20:12:03.551842] [INFO ] [MAIN ] NAC: Loaded 25128 existing records. [2025-09-22T20:12:03.735005] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-22T20:12:03.742265] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:12:03.742552] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-22T20:12:03.742621] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-22T20:12:03.743436] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-22T20:12:03.743532] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-22T20:12:04.116977] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:12:04.208135] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-22T20:12:04.522055] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-22T20:12:04.941666] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-22T20:12:05.322060] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-22T20:12:06.122113] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-22T20:12:06.703300] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-22T20:12:06.922024] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-22T20:12:07.049458] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (3.31 seconds). [2025-09-22T20:12:07.147429] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T20:12:07.466827] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-22T20:12:07.722033] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-22T20:12:07.740758] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-22T20:12:08.456542] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T20:12:08.522007] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-22T20:12:09.320558] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T20:12:09.323350] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-22T20:12:10.074424] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T20:12:10.121999] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-22T20:12:10.922025] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-22T20:12:11.148410] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T20:12:11.722072] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-22T20:12:12.428134] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T20:12:12.522108] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-22T20:12:12.720286] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T20:12:13.322054] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-22T20:12:13.667454] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T20:12:14.054503] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-22T20:12:14.122057] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-22T20:12:14.922064] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-22T20:12:15.339241] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T20:12:15.722065] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-22T20:12:16.522067] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-22T20:12:16.559789] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T20:12:16.850886] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-22T20:12:17.322071] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-22T20:12:17.672630] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T20:12:18.105976] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T20:12:18.122003] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-22T20:12:18.870608] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T20:12:18.922042] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-22T20:12:19.722083] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-22T20:12:19.772326] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T20:12:19.780254] [INFO ] [REMOTE ] MYN: Full fetch complete (15607 records). [2025-09-22T20:12:19.780817] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-22T20:12:20.145362] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-22T20:12:20.145453] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-22T20:12:20.145809] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-22T20:12:20.145871] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-22T20:12:20.146514] [DEBUG] [LOCAL ] MYN: Trimmed 15607 records to 10334 (keeping 200 days of data) [2025-09-22T20:12:20.215892] [DEBUG] [LOCAL ] MYN: Primary data saved (10334 records). [2025-09-22T20:12:20.216044] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-22T20:12:20.216147] [INFO ] [MAIN ] Update Progress: 1447/2372 symbols completed. MYN took 31.0s. Estimated remaining: 2h 2m 55s. Rate: 7.5 symbols/min [2025-09-22T20:12:20.389981] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:12:20.439093] [DEBUG] [LOCAL ] NAD: Loaded 34609 existing records from primary storage. [2025-09-22T20:12:20.439231] [INFO ] [MAIN ] NAD: Loaded 34609 existing records. [2025-09-22T20:12:20.532277] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-22T20:12:20.625692] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:12:20.626024] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-22T20:12:20.626079] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-22T20:12:20.627237] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-22T20:12:20.627302] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-22T20:12:20.983411] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T20:12:21.030255] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:12:21.322043] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-22T20:12:21.954496] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T20:12:22.122069] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-22T20:12:22.814129] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T20:12:22.922037] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-22T20:12:23.159777] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T20:12:23.722079] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-22T20:12:24.453166] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T20:12:24.460410] [INFO ] [REMOTE ] NABL: Full fetch complete (56713 records). [2025-09-22T20:12:24.460599] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-22T20:12:24.526324] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-22T20:12:24.900112] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-22T20:12:24.900470] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-22T20:12:24.902307] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-22T20:12:24.902377] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-22T20:12:24.904114] [DEBUG] [LOCAL ] NABL: Trimmed 56713 records to 40033 (keeping 200 days of data) [2025-09-22T20:12:25.057418] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T20:12:25.223282] [DEBUG] [LOCAL ] NABL: Primary data saved (40033 records). [2025-09-22T20:12:25.223478] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-22T20:12:25.223615] [INFO ] [MAIN ] Update Progress: 1448/2372 symbols completed. NABL took 34.2s. Estimated remaining: 2h 2m 45s. Rate: 7.5 symbols/min [2025-09-22T20:12:25.326699] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-22T20:12:25.402930] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:12:25.417639] [DEBUG] [LOCAL ] NAN: Loaded 9197 existing records from primary storage. [2025-09-22T20:12:25.417924] [INFO ] [MAIN ] NAN: Loaded 9197 existing records. [2025-09-22T20:12:25.611417] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:12:25.611930] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-22T20:12:25.611985] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-22T20:12:25.612597] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-22T20:12:25.612708] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-22T20:12:25.926853] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T20:12:26.020496] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:12:26.122008] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-22T20:12:26.204848] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T20:12:26.209074] [INFO ] [REMOTE ] MYI: Full fetch complete (29533 records). [2025-09-22T20:12:26.209183] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-22T20:12:26.659850] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-22T20:12:26.659937] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-22T20:12:26.660588] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-22T20:12:26.660628] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-22T20:12:26.662595] [DEBUG] [LOCAL ] MYI: Trimmed 29533 records to 19310 (keeping 200 days of data) [2025-09-22T20:12:26.802295] [DEBUG] [LOCAL ] MYI: Primary data saved (19310 records). [2025-09-22T20:12:26.802448] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-22T20:12:26.802607] [INFO ] [MAIN ] Update Progress: 1449/2372 symbols completed. MYI took 37.9s. Estimated remaining: 2h 2m 33s. Rate: 7.5 symbols/min [2025-09-22T20:12:26.927226] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-22T20:12:26.986415] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:12:27.053021] [DEBUG] [LOCAL ] NAT: Loaded 49893 existing records from primary storage. [2025-09-22T20:12:27.053171] [INFO ] [MAIN ] NAT: Loaded 49893 existing records. [2025-09-22T20:12:27.246999] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:12:27.247406] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-22T20:12:27.247555] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-22T20:12:27.249202] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-22T20:12:27.249268] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-22T20:12:27.386722] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T20:12:27.665215] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:12:27.722026] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-22T20:12:27.920375] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T20:12:28.522072] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-22T20:12:29.322062] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-22T20:12:29.850115] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-22T20:12:29.851505] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T20:12:29.882235] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-22T20:12:30.122074] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-22T20:12:30.922041] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-22T20:12:31.481449] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T20:12:31.722078] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-22T20:12:32.460282] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T20:12:32.492382] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T20:12:32.522017] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-22T20:12:33.322055] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-22T20:12:33.335054] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T20:12:34.122047] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-22T20:12:34.193668] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T20:12:34.922119] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-22T20:12:35.446897] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-22T20:12:35.555191] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T20:12:35.722096] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-22T20:12:36.522098] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-22T20:12:37.322042] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-22T20:12:37.426296] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T20:12:38.122035] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-22T20:12:38.544108] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (2.82 seconds). [2025-09-22T20:12:38.922025] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-22T20:12:39.154930] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-22T20:12:39.299293] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-22T20:12:39.304270] [INFO ] [REMOTE ] NAC: Full fetch complete (36320 records). [2025-09-22T20:12:39.304378] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-22T20:12:39.722093] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-22T20:12:39.722388] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-22T20:12:39.723285] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-22T20:12:39.724145] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-22T20:12:39.724301] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-22T20:12:39.725344] [DEBUG] [LOCAL ] NAC: Trimmed 36320 records to 24636 (keeping 200 days of data) [2025-09-22T20:12:39.906525] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T20:12:39.919973] [DEBUG] [LOCAL ] NAC: Primary data saved (24636 records). [2025-09-22T20:12:39.920094] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-22T20:12:39.920192] [INFO ] [MAIN ] Update Progress: 1450/2372 symbols completed. NAC took 36.6s. Estimated remaining: 2h 2m 28s. Rate: 7.5 symbols/min [2025-09-22T20:12:40.103439] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:12:40.142006] [DEBUG] [LOCAL ] NATL: Loaded 33354 existing records from primary storage. [2025-09-22T20:12:40.142190] [INFO ] [MAIN ] NATL: Loaded 33354 existing records. [2025-09-22T20:12:40.319374] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T20:12:40.347587] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:12:40.347895] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-22T20:12:40.347967] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-22T20:12:40.348804] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-22T20:12:40.348867] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-22T20:12:40.525328] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-22T20:12:40.725439] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:12:41.288592] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T20:12:41.322008] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-22T20:12:42.122051] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-22T20:12:42.495594] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T20:12:42.922044] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-22T20:12:43.722044] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-22T20:12:43.818368] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T20:12:44.378149] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T20:12:44.444234] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-22T20:12:44.447541] [INFO ] [REMOTE ] NAN: Full fetch complete (14167 records). [2025-09-22T20:12:44.447691] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-22T20:12:44.527157] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-22T20:12:44.852139] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-22T20:12:44.852226] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-22T20:12:44.852543] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-22T20:12:44.852583] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-22T20:12:44.853113] [DEBUG] [LOCAL ] NAN: Trimmed 14167 records to 9054 (keeping 200 days of data) [2025-09-22T20:12:44.908203] [DEBUG] [LOCAL ] NAN: Primary data saved (9054 records). [2025-09-22T20:12:44.908344] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-22T20:12:44.908443] [INFO ] [MAIN ] Update Progress: 1451/2372 symbols completed. NAN took 19.7s. Estimated remaining: 2h 2m 18s. Rate: 7.5 symbols/min [2025-09-22T20:12:45.079360] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:12:45.084177] [DEBUG] [LOCAL ] NAZ: Loaded 2766 existing records from primary storage. [2025-09-22T20:12:45.084273] [INFO ] [MAIN ] NAZ: Loaded 2766 existing records. [2025-09-22T20:12:45.267673] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:12:45.267979] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-22T20:12:45.268051] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-22T20:12:45.268402] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-22T20:12:45.268463] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-22T20:12:45.333368] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-22T20:12:45.671842] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:12:45.921159] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T20:12:46.122064] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-22T20:12:46.927218] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-22T20:12:46.941544] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T20:12:46.950476] [INFO ] [REMOTE ] NAD: Full fetch complete (50275 records). [2025-09-22T20:12:46.950749] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-22T20:12:47.363689] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-22T20:12:47.369564] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-22T20:12:47.379743] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-22T20:12:47.379840] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-22T20:12:47.381458] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T20:12:47.388459] [DEBUG] [LOCAL ] NAD: Trimmed 50275 records to 34029 (keeping 200 days of data) [2025-09-22T20:12:47.595212] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T20:12:47.625598] [DEBUG] [LOCAL ] NAD: Primary data saved (34029 records). [2025-09-22T20:12:47.625822] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-22T20:12:47.625927] [INFO ] [MAIN ] Update Progress: 1452/2372 symbols completed. NAD took 27.4s. Estimated remaining: 2h 2m 7s. Rate: 7.5 symbols/min [2025-09-22T20:12:47.731150] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-22T20:12:47.811069] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:12:47.822979] [DEBUG] [LOCAL ] NBB: Loaded 9027 existing records from primary storage. [2025-09-22T20:12:47.823113] [INFO ] [MAIN ] NBB: Loaded 9027 existing records. [2025-09-22T20:12:48.017121] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:12:48.017443] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-22T20:12:48.017499] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-22T20:12:48.017969] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-22T20:12:48.018031] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-22T20:12:48.349334] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T20:12:48.410448] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:12:48.522045] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-22T20:12:49.322130] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-22T20:12:49.492391] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T20:12:50.122090] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-22T20:12:50.661048] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-22T20:12:50.928216] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-22T20:12:50.934762] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T20:12:51.722015] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-22T20:12:52.111177] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T20:12:52.301182] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-22T20:12:52.522052] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-22T20:12:53.322056] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-22T20:12:53.817703] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T20:12:54.122083] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-22T20:12:54.322688] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T20:12:54.489870] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-22T20:12:54.922063] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-22T20:12:55.722045] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-22T20:12:55.792158] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T20:12:56.161463] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-22T20:12:56.522064] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-22T20:12:57.276919] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-22T20:12:57.322032] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-22T20:12:58.122084] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-22T20:12:58.616370] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T20:12:58.922054] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-22T20:12:59.621509] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T20:12:59.700730] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T20:12:59.722009] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-22T20:13:00.522064] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-22T20:13:01.201045] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T20:13:01.322088] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-22T20:13:01.882334] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T20:13:02.122064] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-22T20:13:02.307167] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T20:13:02.839159] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T20:13:02.922049] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-22T20:13:03.600003] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T20:13:03.601315] [INFO ] [REMOTE ] NAZ: Full fetch complete (4405 records). [2025-09-22T20:13:03.601386] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-22T20:13:03.727139] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-22T20:13:03.980242] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-22T20:13:03.980320] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-22T20:13:03.980453] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-22T20:13:03.980491] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-22T20:13:03.980969] [DEBUG] [LOCAL ] NAZ: Trimmed 4405 records to 2636 (keeping 200 days of data) [2025-09-22T20:13:03.998765] [DEBUG] [LOCAL ] NAZ: Primary data saved (2636 records). [2025-09-22T20:13:03.998828] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-22T20:13:03.998899] [INFO ] [MAIN ] Update Progress: 1453/2372 symbols completed. NAZ took 19.1s. Estimated remaining: 2h 2m 4s. Rate: 7.5 symbols/min [2025-09-22T20:13:04.169102] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:13:04.191542] [DEBUG] [LOCAL ] NBHC: Loaded 23438 existing records from primary storage. [2025-09-22T20:13:04.191704] [INFO ] [MAIN ] NBHC: Loaded 23438 existing records. [2025-09-22T20:13:04.369820] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:13:04.370084] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-22T20:13:04.370132] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-22T20:13:04.370798] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-22T20:13:04.370859] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-22T20:13:04.527145] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-22T20:13:04.694297] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T20:13:04.759854] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:13:05.322055] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-22T20:13:06.122064] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-22T20:13:06.299219] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T20:13:06.369454] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T20:13:06.854299] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T20:13:06.922047] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-22T20:13:07.475213] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-22T20:13:07.722054] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-22T20:13:08.448877] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T20:13:08.522044] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-22T20:13:09.322051] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-22T20:13:10.106482] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T20:13:10.122041] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-22T20:13:10.310634] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T20:13:10.318909] [INFO ] [REMOTE ] NAT: Full fetch complete (72186 records). [2025-09-22T20:13:10.319069] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-22T20:13:10.735394] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-22T20:13:10.735481] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-22T20:13:10.736478] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-22T20:13:10.736545] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-22T20:13:10.738079] [DEBUG] [LOCAL ] NAT: Trimmed 72186 records to 49108 (keeping 200 days of data) [2025-09-22T20:13:10.947094] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-22T20:13:10.956335] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T20:13:10.960150] [INFO ] [REMOTE ] NBB: Full fetch complete (13918 records). [2025-09-22T20:13:10.961033] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-22T20:13:11.392626] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-22T20:13:11.393593] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-22T20:13:11.394220] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-22T20:13:11.394610] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-22T20:13:11.397013] [DEBUG] [LOCAL ] NBB: Trimmed 13918 records to 8877 (keeping 200 days of data) [2025-09-22T20:13:11.456855] [DEBUG] [LOCAL ] NBB: Primary data saved (8877 records). [2025-09-22T20:13:11.457805] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-22T20:13:11.458234] [INFO ] [MAIN ] Update Progress: 1454/2372 symbols completed. NBB took 23.8s. Estimated remaining: 2h 1m 56s. Rate: 7.5 symbols/min [2025-09-22T20:13:11.681142] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:13:11.701750] [DEBUG] [LOCAL ] NAT: Primary data saved (49108 records). [2025-09-22T20:13:11.701986] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-22T20:13:11.702148] [INFO ] [MAIN ] Update Progress: 1455/2372 symbols completed. NAT took 44.9s. Estimated remaining: 2h 1m 43s. Rate: 7.5 symbols/min [2025-09-22T20:13:11.734289] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-22T20:13:11.911167] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:13:11.912556] [DEBUG] [LOCAL ] NBR: Loaded 35512 existing records from primary storage. [2025-09-22T20:13:11.912759] [INFO ] [MAIN ] NBR: Loaded 35512 existing records. [2025-09-22T20:13:12.109122] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:13:12.110377] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-22T20:13:12.110550] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-22T20:13:12.111018] [DEBUG] [LOCAL ] NBXG: Loaded 23153 existing records from primary storage. [2025-09-22T20:13:12.111199] [INFO ] [MAIN ] NBXG: Loaded 23153 existing records. [2025-09-22T20:13:12.122409] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-22T20:13:12.154079] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-22T20:13:12.422725] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:13:12.451701] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-22T20:13:12.488540] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-22T20:13:12.540379] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-22T20:13:12.561945] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-22T20:13:12.595156] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T20:13:12.706821] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-22T20:13:12.825582] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:13:13.052109] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T20:13:13.114100] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:13:13.322064] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-22T20:13:14.122061] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-22T20:13:14.244155] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T20:13:14.656226] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T20:13:14.922040] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-22T20:13:15.223193] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T20:13:15.722054] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-22T20:13:16.305101] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T20:13:16.522037] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-22T20:13:16.759981] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T20:13:17.322082] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-22T20:13:17.616639] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T20:13:18.122065] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-22T20:13:18.605918] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T20:13:18.923157] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-22T20:13:18.925259] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T20:13:19.722099] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-22T20:13:20.222994] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T20:13:20.522096] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-22T20:13:20.782936] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T20:13:21.322059] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-22T20:13:21.741409] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T20:13:22.122085] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-22T20:13:22.732450] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T20:13:22.922023] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-22T20:13:23.237626] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T20:13:23.722071] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-22T20:13:24.272400] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T20:13:24.522067] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-22T20:13:25.021579] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T20:13:25.322083] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-22T20:13:26.058491] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T20:13:26.122025] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-22T20:13:26.574938] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T20:13:26.580728] [INFO ] [REMOTE ] NATL: Full fetch complete (45554 records). [2025-09-22T20:13:26.580834] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-22T20:13:26.931503] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-22T20:13:26.974527] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-22T20:13:26.974629] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-22T20:13:26.975519] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-22T20:13:26.975585] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-22T20:13:26.976809] [DEBUG] [LOCAL ] NATL: Trimmed 45554 records to 32779 (keeping 200 days of data) [2025-09-22T20:13:27.182332] [DEBUG] [LOCAL ] NATL: Primary data saved (32779 records). [2025-09-22T20:13:27.182492] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-22T20:13:27.182581] [INFO ] [MAIN ] Update Progress: 1456/2372 symbols completed. NATL took 47.3s. Estimated remaining: 2h 1m 40s. Rate: 7.5 symbols/min [2025-09-22T20:13:27.359092] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:13:27.363414] [DEBUG] [LOCAL ] NC: Loaded 1945 existing records from primary storage. [2025-09-22T20:13:27.363637] [INFO ] [MAIN ] NC: Loaded 1945 existing records. [2025-09-22T20:13:27.554309] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:13:27.554739] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-22T20:13:27.554888] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-22T20:13:27.555227] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-22T20:13:27.555289] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-22T20:13:27.667421] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T20:13:27.733505] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-22T20:13:27.951538] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:13:28.051023] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T20:13:28.522112] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-22T20:13:29.071387] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-22T20:13:29.254907] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T20:13:29.322099] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-22T20:13:30.129835] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-22T20:13:30.139771] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T20:13:30.922044] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-22T20:13:31.439716] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-22T20:13:31.461619] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T20:13:31.722055] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-22T20:13:32.522054] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-22T20:13:32.879455] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T20:13:33.322077] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-22T20:13:33.838855] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T20:13:34.122062] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-22T20:13:34.309191] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T20:13:34.581425] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-22T20:13:34.922040] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-22T20:13:35.722032] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-22T20:13:36.105626] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T20:13:36.195189] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-22T20:13:36.522122] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-22T20:13:37.322052] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-22T20:13:37.628622] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T20:13:38.122083] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-22T20:13:38.516007] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T20:13:38.522757] [INFO ] [REMOTE ] NBR: Full fetch complete (49336 records). [2025-09-22T20:13:38.522916] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-22T20:13:38.907291] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-22T20:13:38.907383] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-22T20:13:38.908262] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-22T20:13:38.908328] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-22T20:13:38.909606] [DEBUG] [LOCAL ] NBR: Trimmed 49336 records to 34821 (keeping 200 days of data) [2025-09-22T20:13:38.957422] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-22T20:13:39.018389] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T20:13:39.023083] [INFO ] [REMOTE ] NBXG: Full fetch complete (33131 records). [2025-09-22T20:13:39.023731] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-22T20:13:39.433970] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-22T20:13:39.434358] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-22T20:13:39.435627] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-22T20:13:39.436045] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-22T20:13:39.438962] [DEBUG] [LOCAL ] NBXG: Trimmed 33131 records to 22674 (keeping 200 days of data) [2025-09-22T20:13:39.658299] [DEBUG] [LOCAL ] NBR: Primary data saved (34821 records). [2025-09-22T20:13:39.659091] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-22T20:13:39.659250] [INFO ] [MAIN ] Update Progress: 1457/2372 symbols completed. NBR took 28.2s. Estimated remaining: 2h 1m 35s. Rate: 7.5 symbols/min [2025-09-22T20:13:39.736165] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-22T20:13:39.868327] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:13:39.872303] [DEBUG] [LOCAL ] NBXG: Primary data saved (22674 records). [2025-09-22T20:13:39.872419] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-22T20:13:39.872525] [INFO ] [MAIN ] Update Progress: 1458/2372 symbols completed. NBXG took 28.2s. Estimated remaining: 2h 1m 22s. Rate: 7.5 symbols/min [2025-09-22T20:13:40.008775] [DEBUG] [LOCAL ] NCA: Loaded 10214 existing records from primary storage. [2025-09-22T20:13:40.028097] [INFO ] [MAIN ] NCA: Loaded 10214 existing records. [2025-09-22T20:13:40.062355] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:13:40.262046] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:13:40.270713] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-22T20:13:40.278769] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-22T20:13:40.285290] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-22T20:13:40.293736] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-22T20:13:40.293620] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T20:13:40.343100] [DEBUG] [LOCAL ] NCDL: Loaded 22141 existing records from primary storage. [2025-09-22T20:13:40.355720] [INFO ] [MAIN ] NCDL: Loaded 22141 existing records. [2025-09-22T20:13:40.523080] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-22T20:13:40.560053] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T20:13:40.706842] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:13:40.782582] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-22T20:13:40.782717] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-22T20:13:40.809509] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-22T20:13:40.814768] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-22T20:13:40.985435] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:13:41.279345] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:13:41.322009] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-22T20:13:41.736251] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T20:13:42.122077] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-22T20:13:42.265686] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T20:13:42.468320] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-22T20:13:42.922048] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-22T20:13:43.373151] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T20:13:43.722102] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-22T20:13:44.170325] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-22T20:13:44.522069] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-22T20:13:45.322065] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-22T20:13:45.528242] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T20:13:46.122110] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-22T20:13:46.575352] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T20:13:46.580197] [INFO ] [REMOTE ] NBHC: Full fetch complete (31757 records). [2025-09-22T20:13:46.580296] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-22T20:13:46.931247] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-22T20:13:46.968891] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T20:13:46.987085] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-22T20:13:46.987178] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-22T20:13:46.988564] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-22T20:13:46.988697] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-22T20:13:46.990005] [DEBUG] [LOCAL ] NBHC: Trimmed 31757 records to 23082 (keeping 200 days of data) [2025-09-22T20:13:47.140895] [DEBUG] [LOCAL ] NBHC: Primary data saved (23082 records). [2025-09-22T20:13:47.141037] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-22T20:13:47.141139] [INFO ] [MAIN ] Update Progress: 1459/2372 symbols completed. NBHC took 43.1s. Estimated remaining: 2h 1m 14s. Rate: 7.5 symbols/min [2025-09-22T20:13:47.321782] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:13:47.358528] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T20:13:47.380009] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-22T20:13:47.380157] [INFO ] [MAIN ] NCLH: Loaded 54533 existing records. [2025-09-22T20:13:47.560176] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:13:47.560476] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-22T20:13:47.560527] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-22T20:13:47.561758] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-22T20:13:47.561820] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-22T20:13:47.725832] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-22T20:13:47.958281] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:13:48.292819] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T20:13:48.293752] [INFO ] [REMOTE ] NC: Full fetch complete (2705 records). [2025-09-22T20:13:48.293824] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-22T20:13:48.527264] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-22T20:13:48.656061] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-22T20:13:48.656139] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-22T20:13:48.656249] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-22T20:13:48.656289] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-22T20:13:48.656636] [DEBUG] [LOCAL ] NC: Trimmed 2705 records to 1907 (keeping 200 days of data) [2025-09-22T20:13:48.670168] [DEBUG] [LOCAL ] NC: Primary data saved (1907 records). [2025-09-22T20:13:48.670231] [INFO ] [MAIN ] NC: Full history saved. [2025-09-22T20:13:48.670300] [INFO ] [MAIN ] Update Progress: 1460/2372 symbols completed. NC took 21.5s. Estimated remaining: 2h 1m 2s. Rate: 7.5 symbols/min [2025-09-22T20:13:48.837832] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:13:48.852699] [DEBUG] [LOCAL ] NCV: Loaded 13619 existing records from primary storage. [2025-09-22T20:13:48.852809] [INFO ] [MAIN ] NCV: Loaded 13619 existing records. [2025-09-22T20:13:49.035426] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:13:49.035738] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-22T20:13:49.035797] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-22T20:13:49.036382] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-22T20:13:49.036458] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-22T20:13:49.322860] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-22T20:13:49.358566] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T20:13:49.415988] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:13:50.122069] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-22T20:13:50.459144] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T20:13:50.628260] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-22T20:13:50.922071] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-22T20:13:51.722118] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-22T20:13:51.760488] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-22T20:13:52.522059] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-22T20:13:53.322048] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-22T20:13:53.599705] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T20:13:53.636392] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T20:13:54.108639] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T20:13:54.122006] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-22T20:13:54.922076] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-22T20:13:55.722045] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-22T20:13:55.996899] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T20:13:56.083875] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-22T20:13:56.164349] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T20:13:56.522052] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-22T20:13:57.322092] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-22T20:13:57.345381] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T20:13:58.122073] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-22T20:13:58.906233] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T20:13:58.921993] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-22T20:13:59.224016] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T20:13:59.632725] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T20:13:59.722056] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-22T20:14:00.522057] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-22T20:14:01.322055] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-22T20:14:01.436200] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T20:14:01.438333] [INFO ] [REMOTE ] NCA: Full fetch complete (15782 records). [2025-09-22T20:14:01.438405] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-22T20:14:01.816147] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-22T20:14:01.816227] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-22T20:14:01.816580] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-22T20:14:01.816621] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-22T20:14:01.817476] [DEBUG] [LOCAL ] NCA: Trimmed 15782 records to 10054 (keeping 200 days of data) [2025-09-22T20:14:01.876370] [DEBUG] [LOCAL ] NCA: Primary data saved (10054 records). [2025-09-22T20:14:01.876478] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-22T20:14:01.876558] [INFO ] [MAIN ] Update Progress: 1461/2372 symbols completed. NCA took 22.2s. Estimated remaining: 2h 0m 57s. Rate: 7.5 symbols/min [2025-09-22T20:14:02.048321] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:14:02.063438] [DEBUG] [LOCAL ] NCZ: Loaded 11979 existing records from primary storage. [2025-09-22T20:14:02.063558] [INFO ] [MAIN ] NCZ: Loaded 11979 existing records. [2025-09-22T20:14:02.127418] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-22T20:14:02.258600] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:14:02.266971] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-22T20:14:02.267088] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-22T20:14:02.266903] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T20:14:02.270849] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-22T20:14:02.271613] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-22T20:14:02.645319] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:14:02.677377] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-09-22T20:14:02.922121] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-22T20:14:03.330106] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T20:14:03.722094] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-22T20:14:04.522145] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-22T20:14:04.901164] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T20:14:05.056912] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-22T20:14:05.322057] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-22T20:14:05.531431] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T20:14:06.122077] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-22T20:14:06.922054] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-22T20:14:07.085856] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T20:14:07.485507] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-22T20:14:07.709900] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T20:14:07.721998] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-22T20:14:08.522054] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-22T20:14:08.895344] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-22T20:14:09.322053] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-22T20:14:10.122025] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-22T20:14:10.135041] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T20:14:10.516541] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-22T20:14:10.821758] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T20:14:10.922041] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-22T20:14:11.722114] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-22T20:14:12.522048] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-22T20:14:12.645887] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T20:14:13.125814] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-22T20:14:13.322081] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-22T20:14:13.526765] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T20:14:14.122099] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-22T20:14:14.251263] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T20:14:14.922091] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-22T20:14:15.213634] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T20:14:15.613488] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T20:14:15.722187] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-22T20:14:16.522177] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-22T20:14:17.322091] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-22T20:14:17.653252] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T20:14:17.656505] [INFO ] [REMOTE ] NCV: Full fetch complete (23155 records). [2025-09-22T20:14:17.656619] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-22T20:14:18.073842] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-22T20:14:18.073997] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-22T20:14:18.074555] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-22T20:14:18.074667] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-22T20:14:18.075880] [DEBUG] [LOCAL ] NCV: Trimmed 23155 records to 13376 (keeping 200 days of data) [2025-09-22T20:14:18.128017] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-22T20:14:18.186502] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-22T20:14:18.214837] [DEBUG] [LOCAL ] NCV: Primary data saved (13376 records). [2025-09-22T20:14:18.214960] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-22T20:14:18.215081] [INFO ] [MAIN ] Update Progress: 1462/2372 symbols completed. NCV took 29.5s. Estimated remaining: 2h 0m 54s. Rate: 7.5 symbols/min [2025-09-22T20:14:18.394609] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:14:18.412391] [DEBUG] [LOCAL ] NDMO: Loaded 16709 existing records from primary storage. [2025-09-22T20:14:18.412553] [INFO ] [MAIN ] NDMO: Loaded 16709 existing records. [2025-09-22T20:14:18.629873] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T20:14:18.644362] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:14:18.653277] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-22T20:14:18.653404] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-22T20:14:18.654527] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-22T20:14:18.654605] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-22T20:14:18.927319] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-22T20:14:19.049326] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:14:19.104832] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-22T20:14:19.110408] [INFO ] [REMOTE ] NCDL: Full fetch complete (33434 records). [2025-09-22T20:14:19.110888] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-22T20:14:19.535692] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-22T20:14:19.535825] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-22T20:14:19.537092] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-22T20:14:19.537162] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-22T20:14:19.538430] [DEBUG] [LOCAL ] NCDL: Trimmed 33434 records to 21696 (keeping 200 days of data) [2025-09-22T20:14:19.710096] [DEBUG] [LOCAL ] NCDL: Primary data saved (21696 records). [2025-09-22T20:14:19.710385] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-22T20:14:19.710741] [INFO ] [MAIN ] Update Progress: 1463/2372 symbols completed. NCDL took 39.8s. Estimated remaining: 2h 0m 42s. Rate: 7.5 symbols/min [2025-09-22T20:14:19.727201] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-22T20:14:19.905750] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:14:19.981304] [DEBUG] [LOCAL ] NE: Loaded 53173 existing records from primary storage. [2025-09-22T20:14:19.981660] [INFO ] [MAIN ] NE: Loaded 53173 existing records. [2025-09-22T20:14:20.179235] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:14:20.179760] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-22T20:14:20.179820] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-22T20:14:20.181667] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-22T20:14:20.181733] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-22T20:14:20.535839] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-22T20:14:20.588801] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:14:20.739734] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T20:14:21.138881] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-22T20:14:21.156931] [INFO ] [REMOTE ] NCLH: Full fetch complete (77808 records). [2025-09-22T20:14:21.157104] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-22T20:14:21.331769] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-22T20:14:21.592791] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-22T20:14:21.592886] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-22T20:14:21.593983] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-22T20:14:21.594074] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-22T20:14:21.598621] [DEBUG] [LOCAL ] NCLH: Trimmed 77808 records to 53753 (keeping 200 days of data) [2025-09-22T20:14:21.872522] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T20:14:21.973060] [DEBUG] [LOCAL ] NCLH: Primary data saved (53753 records). [2025-09-22T20:14:21.973213] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-22T20:14:21.973343] [INFO ] [MAIN ] Update Progress: 1464/2372 symbols completed. NCLH took 34.8s. Estimated remaining: 2h 0m 31s. Rate: 7.5 symbols/min [2025-09-22T20:14:22.130955] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-22T20:14:22.153674] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:14:22.196054] [DEBUG] [LOCAL ] NEA: Loaded 35876 existing records from primary storage. [2025-09-22T20:14:22.196201] [INFO ] [MAIN ] NEA: Loaded 35876 existing records. [2025-09-22T20:14:22.377570] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:14:22.377896] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-22T20:14:22.377944] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-22T20:14:22.379226] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-22T20:14:22.379300] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-22T20:14:22.741741] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:14:22.869252] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T20:14:22.910001] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T20:14:22.921997] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-22T20:14:23.722072] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-22T20:14:24.522092] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-22T20:14:24.674268] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T20:14:25.224394] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T20:14:25.322034] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-22T20:14:25.358273] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T20:14:26.122076] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-22T20:14:26.716147] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T20:14:26.922069] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-22T20:14:27.722035] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-22T20:14:27.769828] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T20:14:27.843438] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T20:14:28.522075] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-22T20:14:28.558470] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T20:14:29.322018] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-22T20:14:29.791077] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T20:14:29.845885] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T20:14:30.122071] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-22T20:14:30.922103] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-22T20:14:31.722034] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-22T20:14:31.943086] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T20:14:31.983296] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T20:14:32.522053] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-22T20:14:32.733183] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T20:14:33.300014] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-22T20:14:33.321999] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-22T20:14:34.122084] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-22T20:14:34.340245] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T20:14:34.922105] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-22T20:14:35.636107] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T20:14:35.722024] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-22T20:14:35.961875] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T20:14:36.522057] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-22T20:14:37.191867] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T20:14:37.322068] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-22T20:14:38.023074] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T20:14:38.096352] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T20:14:38.122014] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-22T20:14:38.922112] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-22T20:14:39.722123] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-22T20:14:39.863283] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-22T20:14:39.899757] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T20:14:40.287452] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T20:14:40.522094] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-22T20:14:41.322064] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-22T20:14:41.491570] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T20:14:41.936245] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T20:14:41.938942] [INFO ] [REMOTE ] NCZ: Full fetch complete (21560 records). [2025-09-22T20:14:41.939017] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-22T20:14:42.127221] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-22T20:14:42.311986] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-22T20:14:42.312076] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-22T20:14:42.312583] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-22T20:14:42.312622] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-22T20:14:42.313378] [DEBUG] [LOCAL ] NCZ: Trimmed 21560 records to 11740 (keeping 200 days of data) [2025-09-22T20:14:42.393533] [DEBUG] [LOCAL ] NCZ: Primary data saved (11740 records). [2025-09-22T20:14:42.393696] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-22T20:14:42.393819] [INFO ] [MAIN ] Update Progress: 1465/2372 symbols completed. NCZ took 40.5s. Estimated remaining: 2h 0m 30s. Rate: 7.5 symbols/min [2025-09-22T20:14:42.569429] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:14:42.637421] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-09-22T20:14:42.637574] [INFO ] [MAIN ] NEE: Loaded 54487 existing records. [2025-09-22T20:14:42.813827] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:14:42.814184] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-22T20:14:42.814240] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-22T20:14:42.816197] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-22T20:14:42.816259] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-22T20:14:42.927265] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-22T20:14:43.177194] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:14:43.253086] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-22T20:14:43.722065] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-22T20:14:44.024482] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T20:14:44.522015] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-22T20:14:44.787384] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T20:14:44.790836] [INFO ] [REMOTE ] NDMO: Full fetch complete (25046 records). [2025-09-22T20:14:44.790912] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-22T20:14:45.220504] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-22T20:14:45.220603] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-22T20:14:45.221131] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-22T20:14:45.221193] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-22T20:14:45.221872] [DEBUG] [LOCAL ] NDMO: Trimmed 25046 records to 16551 (keeping 200 days of data) [2025-09-22T20:14:45.323439] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-22T20:14:45.330394] [DEBUG] [LOCAL ] NDMO: Primary data saved (16551 records). [2025-09-22T20:14:45.330536] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-22T20:14:45.330677] [INFO ] [MAIN ] Update Progress: 1466/2372 symbols completed. NDMO took 27.1s. Estimated remaining: 2h 0m 19s. Rate: 7.5 symbols/min [2025-09-22T20:14:45.522557] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:14:45.581829] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-09-22T20:14:45.581985] [INFO ] [MAIN ] NEM: Loaded 54488 existing records. [2025-09-22T20:14:45.821025] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:14:45.821454] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-22T20:14:45.821566] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-22T20:14:45.823302] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-22T20:14:45.823367] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-22T20:14:46.022903] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T20:14:46.127116] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-22T20:14:46.232920] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:14:46.800172] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T20:14:46.922047] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-22T20:14:47.722028] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-22T20:14:48.219079] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-22T20:14:48.522097] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-22T20:14:48.837722] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T20:14:49.085952] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T20:14:49.322052] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-22T20:14:50.122100] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-22T20:14:50.653947] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-22T20:14:50.922049] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-22T20:14:51.125303] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T20:14:51.192158] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T20:14:51.198108] [INFO ] [REMOTE ] NEA: Full fetch complete (52360 records). [2025-09-22T20:14:51.198225] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-22T20:14:51.589269] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-22T20:14:51.589352] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-22T20:14:51.590204] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-22T20:14:51.590267] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-22T20:14:51.591410] [DEBUG] [LOCAL ] NEA: Trimmed 52360 records to 35290 (keeping 200 days of data) [2025-09-22T20:14:51.722685] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-22T20:14:51.835911] [DEBUG] [LOCAL ] NEA: Primary data saved (35290 records). [2025-09-22T20:14:51.836065] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-22T20:14:51.836159] [INFO ] [MAIN ] Update Progress: 1467/2372 symbols completed. NEA took 29.9s. Estimated remaining: 2h 0m 10s. Rate: 7.5 symbols/min [2025-09-22T20:14:52.011487] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:14:52.065338] [DEBUG] [LOCAL ] NET: Loaded 53854 existing records from primary storage. [2025-09-22T20:14:52.065486] [INFO ] [MAIN ] NET: Loaded 53854 existing records. [2025-09-22T20:14:52.247013] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:14:52.247298] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-22T20:14:52.247386] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-22T20:14:52.248500] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-22T20:14:52.248562] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-22T20:14:52.530257] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-22T20:14:52.614213] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:14:52.847941] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-22T20:14:53.322143] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-22T20:14:53.566679] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T20:14:53.578819] [INFO ] [REMOTE ] NE: Full fetch complete (75360 records). [2025-09-22T20:14:53.578997] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-22T20:14:53.979445] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-22T20:14:53.979560] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-22T20:14:53.980619] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-22T20:14:53.980721] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-22T20:14:53.982328] [DEBUG] [LOCAL ] NE: Trimmed 75360 records to 52391 (keeping 200 days of data) [2025-09-22T20:14:54.165580] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-22T20:14:54.328899] [DEBUG] [LOCAL ] NE: Primary data saved (52391 records). [2025-09-22T20:14:54.329050] [INFO ] [MAIN ] NE: Full history saved. [2025-09-22T20:14:54.329139] [INFO ] [MAIN ] Update Progress: 1468/2372 symbols completed. NE took 34.6s. Estimated remaining: 1h 59m 59s. Rate: 7.5 symbols/min [2025-09-22T20:14:54.509474] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:14:54.542952] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-22T20:14:54.557498] [DEBUG] [LOCAL ] NEU: Loaded 8234 existing records from primary storage. [2025-09-22T20:14:54.557600] [INFO ] [MAIN ] NEU: Loaded 8234 existing records. [2025-09-22T20:14:54.738160] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:14:54.738460] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-22T20:14:54.738516] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-22T20:14:54.738919] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-22T20:14:54.738978] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-22T20:14:54.929194] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-22T20:14:55.102659] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:14:55.160476] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T20:14:55.722051] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-22T20:14:56.348939] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-22T20:14:56.403210] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-22T20:14:56.522027] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-22T20:14:56.933570] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-22T20:14:57.322074] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-22T20:14:58.037116] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T20:14:58.122125] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-22T20:14:58.666700] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-22T20:14:58.860919] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T20:14:58.922019] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-22T20:14:59.577606] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-22T20:14:59.722066] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-22T20:15:00.522080] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-22T20:15:01.322059] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-22T20:15:01.380183] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T20:15:01.855071] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-22T20:15:02.122051] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-22T20:15:02.922045] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-22T20:15:03.722059] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-22T20:15:05.437154] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (4.12 seconds). [2025-09-22T20:15:05.449576] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-22T20:15:05.484789] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T20:15:05.490895] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-22T20:15:05.495964] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (3.37 seconds). [2025-09-22T20:15:06.122024] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-22T20:15:06.229433] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-09-22T20:15:06.408908] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T20:15:06.922042] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-22T20:15:07.721606] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-22T20:15:07.732698] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-22T20:15:08.258539] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-22T20:15:08.522016] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-22T20:15:08.536783] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-22T20:15:09.009708] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-22T20:15:09.322066] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-22T20:15:10.122090] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-22T20:15:10.143519] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T20:15:10.861108] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-22T20:15:10.922026] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-22T20:15:11.722175] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-22T20:15:12.154572] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-22T20:15:12.522087] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-22T20:15:12.529027] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T20:15:12.531293] [INFO ] [REMOTE ] NEU: Full fetch complete (10169 records). [2025-09-22T20:15:12.531369] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-22T20:15:12.916970] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-22T20:15:12.917184] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-22T20:15:12.917529] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-22T20:15:12.917715] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-22T20:15:12.918395] [DEBUG] [LOCAL ] NEU: Trimmed 10169 records to 8155 (keeping 200 days of data) [2025-09-22T20:15:12.974983] [DEBUG] [LOCAL ] NEU: Primary data saved (8155 records). [2025-09-22T20:15:12.975399] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-22T20:15:12.975557] [INFO ] [MAIN ] Update Progress: 1469/2372 symbols completed. NEU took 18.6s. Estimated remaining: 1h 59m 58s. Rate: 7.5 symbols/min [2025-09-22T20:15:13.118362] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-22T20:15:13.204730] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:15:13.209042] [DEBUG] [LOCAL ] NEUE: Loaded 2278 existing records from primary storage. [2025-09-22T20:15:13.209134] [INFO ] [MAIN ] NEUE: Loaded 2278 existing records. [2025-09-22T20:15:13.327195] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-22T20:15:13.388190] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:15:13.388435] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-22T20:15:13.388483] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-22T20:15:13.388747] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-22T20:15:13.388809] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-22T20:15:13.763489] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:15:14.122118] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-22T20:15:14.922045] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-22T20:15:15.219083] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T20:15:15.727683] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-22T20:15:15.740899] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-22T20:15:15.824855] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-09-22T20:15:16.494572] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-22T20:15:16.522068] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-22T20:15:17.322060] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-22T20:15:17.466325] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-22T20:15:18.122056] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-22T20:15:18.537490] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T20:15:18.664248] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-22T20:15:18.922051] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-22T20:15:19.206243] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T20:15:19.722094] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-22T20:15:20.201677] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-22T20:15:20.522120] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-22T20:15:20.950306] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T20:15:20.953521] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T20:15:21.322084] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-22T20:15:22.122083] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-22T20:15:22.922041] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-22T20:15:23.382116] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-22T20:15:23.722030] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-22T20:15:23.823334] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-22T20:15:24.522102] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-22T20:15:24.777058] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-22T20:15:24.785314] [INFO ] [REMOTE ] NET: Full fetch complete (76885 records). [2025-09-22T20:15:24.785440] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-22T20:15:25.161241] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T20:15:25.188673] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-22T20:15:25.188770] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-22T20:15:25.189931] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-22T20:15:25.190022] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-22T20:15:25.191560] [DEBUG] [LOCAL ] NET: Trimmed 76885 records to 53072 (keeping 200 days of data) [2025-09-22T20:15:25.361447] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-22T20:15:25.510416] [DEBUG] [LOCAL ] NET: Primary data saved (53072 records). [2025-09-22T20:15:25.510551] [INFO ] [MAIN ] NET: Full history saved. [2025-09-22T20:15:25.510637] [INFO ] [MAIN ] Update Progress: 1470/2372 symbols completed. NET took 33.7s. Estimated remaining: 1h 59m 52s. Rate: 7.5 symbols/min [2025-09-22T20:15:25.680408] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:15:25.686169] [DEBUG] [LOCAL ] NEXA: Loaded 4087 existing records from primary storage. [2025-09-22T20:15:25.686312] [INFO ] [MAIN ] NEXA: Loaded 4087 existing records. [2025-09-22T20:15:25.871760] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:15:25.872108] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-22T20:15:25.872177] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-22T20:15:25.872669] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-22T20:15:25.872749] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-22T20:15:26.051618] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-22T20:15:26.127121] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-22T20:15:26.147428] [INFO ] [REMOTE ] NEM: Full fetch complete (77749 records). [2025-09-22T20:15:26.147663] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-22T20:15:26.447421] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:15:26.662620] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-22T20:15:26.688014] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-22T20:15:26.688088] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-22T20:15:26.689127] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-22T20:15:26.689192] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-22T20:15:26.690687] [DEBUG] [LOCAL ] NEM: Trimmed 77749 records to 53708 (keeping 200 days of data) [2025-09-22T20:15:26.922756] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-22T20:15:27.019764] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-09-22T20:15:27.019909] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-22T20:15:27.019995] [INFO ] [MAIN ] Update Progress: 1471/2372 symbols completed. NEM took 41.7s. Estimated remaining: 1h 59m 41s. Rate: 7.5 symbols/min [2025-09-22T20:15:27.192906] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:15:27.229992] [DEBUG] [LOCAL ] NFG: Loaded 39313 existing records from primary storage. [2025-09-22T20:15:27.230174] [INFO ] [MAIN ] NFG: Loaded 39313 existing records. [2025-09-22T20:15:27.312426] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-22T20:15:27.410920] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:15:27.411215] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-22T20:15:27.411272] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-22T20:15:27.412627] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-22T20:15:27.412710] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-22T20:15:27.730531] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-22T20:15:27.773074] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:15:27.806368] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-22T20:15:28.404911] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T20:15:28.522086] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-22T20:15:29.290393] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-22T20:15:29.322040] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-22T20:15:29.706250] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-22T20:15:30.122102] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-22T20:15:30.922048] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-22T20:15:31.429439] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-22T20:15:31.430604] [INFO ] [REMOTE ] NEUE: Full fetch complete (4005 records). [2025-09-22T20:15:31.430729] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-22T20:15:31.620151] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T20:15:31.730554] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-22T20:15:31.927340] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-22T20:15:31.927425] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-22T20:15:31.927573] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-22T20:15:31.927615] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-22T20:15:31.928053] [DEBUG] [LOCAL ] NEUE: Trimmed 4005 records to 2247 (keeping 200 days of data) [2025-09-22T20:15:31.941888] [DEBUG] [LOCAL ] NEUE: Primary data saved (2247 records). [2025-09-22T20:15:31.941956] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-22T20:15:31.942032] [INFO ] [MAIN ] Update Progress: 1472/2372 symbols completed. NEUE took 19.0s. Estimated remaining: 1h 59m 31s. Rate: 7.5 symbols/min [2025-09-22T20:15:32.125102] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:15:32.151984] [DEBUG] [LOCAL ] NFJ: Loaded 20729 existing records from primary storage. [2025-09-22T20:15:32.152164] [INFO ] [MAIN ] NFJ: Loaded 20729 existing records. [2025-09-22T20:15:32.346384] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:15:32.346688] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-22T20:15:32.346749] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-22T20:15:32.347506] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-22T20:15:32.347568] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-22T20:15:32.409455] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-22T20:15:32.523207] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-22T20:15:32.744239] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:15:33.235785] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-22T20:15:33.322023] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-22T20:15:34.122046] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-22T20:15:34.553812] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T20:15:34.684322] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T20:15:34.922077] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-22T20:15:35.722032] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-22T20:15:36.017479] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T20:15:36.522053] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-22T20:15:37.270335] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T20:15:37.322014] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-22T20:15:37.531926] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T20:15:38.122083] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-22T20:15:38.922041] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-22T20:15:39.169109] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T20:15:39.488346] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-22T20:15:39.722067] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-22T20:15:40.286356] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-22T20:15:40.376403] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T20:15:40.522062] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-22T20:15:41.322057] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-22T20:15:41.982785] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T20:15:42.122084] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-22T20:15:42.734495] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-22T20:15:42.922060] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-22T20:15:43.446688] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-22T20:15:43.455040] [INFO ] [REMOTE ] NEE: Full fetch complete (77758 records). [2025-09-22T20:15:43.455194] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-22T20:15:43.727176] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-22T20:15:43.846665] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-22T20:15:43.846757] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-22T20:15:43.847802] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-22T20:15:43.847865] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-22T20:15:43.849366] [DEBUG] [LOCAL ] NEE: Trimmed 77758 records to 53707 (keeping 200 days of data) [2025-09-22T20:15:44.199532] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-09-22T20:15:44.199701] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-22T20:15:44.199810] [INFO ] [MAIN ] Update Progress: 1473/2372 symbols completed. NEE took 1m 2s. Estimated remaining: 1h 59m 25s. Rate: 7.5 symbols/min [2025-09-22T20:15:44.375745] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:15:44.420748] [DEBUG] [LOCAL ] NGG: Loaded 46764 existing records from primary storage. [2025-09-22T20:15:44.420909] [INFO ] [MAIN ] NGG: Loaded 46764 existing records. [2025-09-22T20:15:44.523928] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-22T20:15:44.625446] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:15:44.635348] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-22T20:15:44.635427] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-22T20:15:44.637333] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T20:15:44.637390] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-22T20:15:44.646882] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-22T20:15:44.986843] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-22T20:15:45.060580] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:15:45.073008] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T20:15:45.322056] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-22T20:15:46.122096] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-22T20:15:46.259925] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T20:15:46.922039] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-22T20:15:47.723251] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T20:15:47.722141] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-22T20:15:47.932469] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-22T20:15:48.522070] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-22T20:15:49.090840] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T20:15:49.258787] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T20:15:49.260528] [INFO ] [REMOTE ] NEXA: Full fetch complete (7557 records). [2025-09-22T20:15:49.260617] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-22T20:15:49.328235] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-22T20:15:49.651141] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-22T20:15:49.651228] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-22T20:15:49.651469] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-22T20:15:49.651508] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-22T20:15:49.651994] [DEBUG] [LOCAL ] NEXA: Trimmed 7557 records to 4047 (keeping 200 days of data) [2025-09-22T20:15:49.678581] [DEBUG] [LOCAL ] NEXA: Primary data saved (4047 records). [2025-09-22T20:15:49.678947] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-22T20:15:49.679055] [INFO ] [MAIN ] Update Progress: 1474/2372 symbols completed. NEXA took 24.2s. Estimated remaining: 1h 59m 16s. Rate: 7.5 symbols/min [2025-09-22T20:15:49.853039] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:15:49.886965] [DEBUG] [LOCAL ] NGL: Loaded 30987 existing records from primary storage. [2025-09-22T20:15:49.887112] [INFO ] [MAIN ] NGL: Loaded 30987 existing records. [2025-09-22T20:15:50.083798] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:15:50.084057] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-22T20:15:50.084113] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-22T20:15:50.084915] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-22T20:15:50.085006] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-22T20:15:50.128944] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-22T20:15:50.478451] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:15:50.497352] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T20:15:50.922082] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-22T20:15:51.595322] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T20:15:51.722132] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-22T20:15:52.337044] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T20:15:52.522057] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-22T20:15:52.689231] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T20:15:53.322094] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-22T20:15:53.611858] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T20:15:54.122255] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-22T20:15:54.851158] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T20:15:54.855358] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T20:15:54.868892] [INFO ] [REMOTE ] NFJ: Full fetch complete (30518 records). [2025-09-22T20:15:54.869717] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-22T20:15:54.927289] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-22T20:15:55.265232] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-22T20:15:55.265326] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-22T20:15:55.265978] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-22T20:15:55.266044] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-22T20:15:55.266969] [DEBUG] [LOCAL ] NFJ: Trimmed 30518 records to 20357 (keeping 200 days of data) [2025-09-22T20:15:55.402540] [DEBUG] [LOCAL ] NFJ: Primary data saved (20357 records). [2025-09-22T20:15:55.402700] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-22T20:15:55.402798] [INFO ] [MAIN ] Update Progress: 1475/2372 symbols completed. NFJ took 23.5s. Estimated remaining: 1h 59m 7s. Rate: 7.5 symbols/min [2025-09-22T20:15:55.580466] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:15:55.594131] [DEBUG] [LOCAL ] NGS: Loaded 11953 existing records from primary storage. [2025-09-22T20:15:55.594267] [INFO ] [MAIN ] NGS: Loaded 11953 existing records. [2025-09-22T20:15:55.727311] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-22T20:15:55.797053] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:15:55.797363] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-22T20:15:55.797432] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-22T20:15:55.798031] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-22T20:15:55.798094] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-22T20:15:56.187627] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:15:56.202941] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T20:15:56.522063] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-22T20:15:57.321389] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T20:15:57.329988] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-22T20:15:57.793333] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T20:15:57.980757] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-22T20:15:58.122049] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-22T20:15:58.922070] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-22T20:15:59.656259] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T20:15:59.712801] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T20:15:59.722003] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-22T20:16:00.522071] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-22T20:16:00.555469] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T20:16:01.322051] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-22T20:16:02.122067] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-22T20:16:02.161815] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T20:16:02.706861] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T20:16:02.713001] [INFO ] [REMOTE ] NFG: Full fetch complete (56446 records). [2025-09-22T20:16:02.713153] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-22T20:16:02.927206] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-22T20:16:03.112207] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-22T20:16:03.112332] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-22T20:16:03.113223] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-22T20:16:03.113287] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-22T20:16:03.114482] [DEBUG] [LOCAL ] NFG: Trimmed 56446 records to 38524 (keeping 200 days of data) [2025-09-22T20:16:03.239332] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T20:16:03.377561] [DEBUG] [LOCAL ] NFG: Primary data saved (38524 records). [2025-09-22T20:16:03.377741] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-22T20:16:03.377853] [INFO ] [MAIN ] Update Progress: 1476/2372 symbols completed. NFG took 36.4s. Estimated remaining: 1h 58m 59s. Rate: 7.5 symbols/min [2025-09-22T20:16:03.551222] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:16:03.573877] [DEBUG] [LOCAL ] NGVC: Loaded 22756 existing records from primary storage. [2025-09-22T20:16:03.574075] [INFO ] [MAIN ] NGVC: Loaded 22756 existing records. [2025-09-22T20:16:03.725028] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-22T20:16:03.757019] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:16:03.757209] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-22T20:16:03.757257] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-22T20:16:03.757980] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-22T20:16:03.758041] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-22T20:16:04.113796] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T20:16:04.134472] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:16:04.522076] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-22T20:16:05.322049] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-22T20:16:05.552246] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T20:16:05.899010] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-22T20:16:06.122106] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-22T20:16:06.440764] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T20:16:06.922081] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-22T20:16:07.501956] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T20:16:07.722070] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-22T20:16:08.522067] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-22T20:16:08.776796] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T20:16:08.966878] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T20:16:09.322060] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-22T20:16:09.426708] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T20:16:10.122102] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-22T20:16:10.591459] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T20:16:10.922056] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-22T20:16:11.716248] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T20:16:11.721992] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-22T20:16:11.801188] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T20:16:12.522088] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-22T20:16:12.612937] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-22T20:16:13.322030] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-22T20:16:13.431291] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T20:16:14.122070] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-22T20:16:14.218438] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T20:16:14.922029] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-22T20:16:15.078004] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T20:16:15.722104] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-22T20:16:15.767871] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T20:16:15.769972] [INFO ] [REMOTE ] NGS: Full fetch complete (17150 records). [2025-09-22T20:16:15.770062] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-22T20:16:16.145471] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-22T20:16:16.145556] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-22T20:16:16.145989] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-22T20:16:16.146050] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-22T20:16:16.146682] [DEBUG] [LOCAL ] NGS: Trimmed 17150 records to 11503 (keeping 200 days of data) [2025-09-22T20:16:16.219074] [DEBUG] [LOCAL ] NGS: Primary data saved (11503 records). [2025-09-22T20:16:16.219237] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-22T20:16:16.219329] [INFO ] [MAIN ] Update Progress: 1477/2372 symbols completed. NGS took 20.8s. Estimated remaining: 1h 58m 54s. Rate: 7.5 symbols/min [2025-09-22T20:16:16.522119] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-22T20:16:17.322110] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-22T20:16:17.615218] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T20:16:17.664298] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T20:16:18.122136] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-22T20:16:18.839994] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T20:16:18.922024] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-22T20:16:19.722032] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-22T20:16:19.797220] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T20:16:20.399315] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T20:16:20.522046] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-22T20:16:20.612056] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T20:16:21.322142] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-22T20:16:22.054831] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T20:16:22.063018] [INFO ] [REMOTE ] NGG: Full fetch complete (66255 records). [2025-09-22T20:16:22.063235] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-22T20:16:22.133602] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-22T20:16:22.482844] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-22T20:16:22.482928] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-22T20:16:22.483886] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-22T20:16:22.483950] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-22T20:16:22.485367] [DEBUG] [LOCAL ] NGG: Trimmed 66255 records to 46155 (keeping 200 days of data) [2025-09-22T20:16:22.614029] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T20:16:22.622990] [INFO ] [REMOTE ] NGL: Full fetch complete (40692 records). [2025-09-22T20:16:22.623992] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-22T20:16:23.138228] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-22T20:16:23.138593] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-22T20:16:23.139593] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-22T20:16:23.140051] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-22T20:16:23.143525] [DEBUG] [LOCAL ] NGL: Trimmed 40692 records to 30374 (keeping 200 days of data) [2025-09-22T20:16:23.383261] [DEBUG] [LOCAL ] NGG: Primary data saved (46155 records). [2025-09-22T20:16:23.384233] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-22T20:16:23.385442] [INFO ] [MAIN ] Update Progress: 1478/2372 symbols completed. NGG took 39.2s. Estimated remaining: 1h 58m 45s. Rate: 7.5 symbols/min [2025-09-22T20:16:23.404288] [DEBUG] [LOCAL ] NGL: Primary data saved (30374 records). [2025-09-22T20:16:23.404484] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-22T20:16:23.404635] [INFO ] [MAIN ] Update Progress: 1479/2372 symbols completed. NGL took 33.7s. Estimated remaining: 1h 58m 32s. Rate: 7.5 symbols/min [2025-09-22T20:16:23.437215] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T20:16:23.442559] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-22T20:16:24.646673] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T20:16:24.653153] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-22T20:16:25.882344] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T20:16:25.888027] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-22T20:16:27.076494] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T20:16:27.082531] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-22T20:16:28.134451] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T20:16:28.140127] [INFO ] [REMOTE ] NGVC: Full fetch complete (30256 records). [2025-09-22T20:16:28.140310] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-22T20:16:28.520778] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-22T20:16:28.520859] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-22T20:16:28.521454] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-22T20:16:28.521536] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-22T20:16:28.522430] [DEBUG] [LOCAL ] NGVC: Trimmed 30256 records to 22375 (keeping 200 days of data) [2025-09-22T20:16:28.677319] [DEBUG] [LOCAL ] NGVC: Primary data saved (22375 records). [2025-09-22T20:16:28.677639] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-22T20:16:28.677958] [INFO ] [MAIN ] Update Progress: 1480/2372 symbols completed. NGVC took 25.3s. Estimated remaining: 1h 58m 23s. Rate: 7.5 symbols/min [2025-09-22T20:16:29.261765] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:16:29.334231] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-09-22T20:16:29.376480] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:16:29.376548] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-09-22T20:16:29.412562] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:16:29.418195] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:16:29.414407] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-22T20:16:29.419788] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-22T20:16:29.419864] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-22T20:16:29.419927] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-22T20:16:29.552774] [DEBUG] [LOCAL ] NIC: Loaded 9062 existing records from primary storage. [2025-09-22T20:16:29.559121] [INFO ] [MAIN ] NIC: Loaded 9062 existing records. [2025-09-22T20:16:29.707709] [DEBUG] [LOCAL ] NGVT: Loaded 24863 existing records from primary storage. [2025-09-22T20:16:29.774453] [DEBUG] [LOCAL ] NHI: Loaded 22458 existing records from primary storage. [2025-09-22T20:16:29.768750] [INFO ] [MAIN ] NGVT: Loaded 24863 existing records. [2025-09-22T20:16:29.795498] [INFO ] [MAIN ] NHI: Loaded 22458 existing records. [2025-09-22T20:16:30.277465] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:16:30.366324] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-22T20:16:30.415691] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-22T20:16:30.443313] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:16:30.431960] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:16:30.451406] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-22T20:16:30.474090] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-22T20:16:30.480881] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-22T20:16:30.481349] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-22T20:16:30.481869] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-22T20:16:30.481078] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:16:30.487196] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-22T20:16:30.495205] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-22T20:16:30.554302] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-22T20:16:30.576399] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-22T20:16:30.642212] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-22T20:16:30.654233] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-22T20:16:31.658143] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:16:31.664601] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-22T20:16:31.649463] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:16:31.678373] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-22T20:16:31.744970] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:16:31.746206] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-22T20:16:32.408684] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-22T20:16:32.419768] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-22T20:16:32.663545] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T20:16:32.665912] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-22T20:16:32.740011] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T20:16:32.746349] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-22T20:16:33.032799] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T20:16:33.038113] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-22T20:16:33.413548] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T20:16:33.423362] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-22T20:16:33.912424] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T20:16:33.917496] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-22T20:16:34.258551] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T20:16:34.257087] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T20:16:34.271953] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-22T20:16:34.303232] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T20:16:34.921971] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-22T20:16:35.157026] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T20:16:35.221352] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T20:16:35.722057] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-22T20:16:36.522022] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-22T20:16:36.671815] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T20:16:36.820710] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T20:16:37.322071] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-22T20:16:37.660352] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-22T20:16:38.122063] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-22T20:16:38.922034] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-22T20:16:39.048523] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T20:16:39.284589] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T20:16:39.722073] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-22T20:16:40.221088] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T20:16:40.522036] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-22T20:16:40.580003] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T20:16:41.322073] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-22T20:16:41.524962] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T20:16:42.122065] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-22T20:16:42.771981] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T20:16:42.922077] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-22T20:16:43.224853] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T20:16:43.722102] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-22T20:16:43.998141] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-22T20:16:44.522140] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-22T20:16:44.582196] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T20:16:45.322067] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-22T20:16:45.781082] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T20:16:46.122106] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-22T20:16:46.233441] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-22T20:16:46.922096] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-22T20:16:47.394399] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T20:16:47.722088] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-22T20:16:47.816570] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T20:16:48.522068] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-22T20:16:48.729549] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-22T20:16:48.738747] [INFO ] [REMOTE ] NGVT: Full fetch complete (34515 records). [2025-09-22T20:16:48.739034] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-22T20:16:49.163713] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-22T20:16:49.163807] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-22T20:16:49.164530] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-22T20:16:49.164620] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-22T20:16:49.165720] [DEBUG] [LOCAL ] NGVT: Trimmed 34515 records to 24402 (keeping 200 days of data) [2025-09-22T20:16:49.271067] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T20:16:49.275078] [INFO ] [REMOTE ] NIC: Full fetch complete (12079 records). [2025-09-22T20:16:49.277278] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-22T20:16:49.330477] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-22T20:16:49.532136] [DEBUG] [LOCAL ] NGVT: Primary data saved (24402 records). [2025-09-22T20:16:49.541587] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-22T20:16:49.541744] [INFO ] [MAIN ] Update Progress: 1481/2372 symbols completed. NGVT took 20.9s. Estimated remaining: 1h 58m 23s. Rate: 7.5 symbols/min [2025-09-22T20:16:49.878039] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:16:49.905559] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-22T20:16:49.905634] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-22T20:16:49.906108] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-22T20:16:49.906176] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-22T20:16:49.906725] [DEBUG] [LOCAL ] NIC: Trimmed 12079 records to 8853 (keeping 200 days of data) [2025-09-22T20:16:49.970286] [DEBUG] [LOCAL ] NIC: Primary data saved (8853 records). [2025-09-22T20:16:49.970524] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-22T20:16:49.970691] [INFO ] [MAIN ] Update Progress: 1482/2372 symbols completed. NIC took 21.3s. Estimated remaining: 1h 58m 10s. Rate: 7.5 symbols/min [2025-09-22T20:16:50.051632] [DEBUG] [LOCAL ] NIE: Loaded 11831 existing records from primary storage. [2025-09-22T20:16:50.069390] [INFO ] [MAIN ] NIE: Loaded 11831 existing records. [2025-09-22T20:16:50.130128] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-22T20:16:50.299208] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:16:50.390421] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:16:50.393836] [DEBUG] [LOCAL ] NIM: Loaded 4178 existing records from primary storage. [2025-09-22T20:16:50.394031] [INFO ] [MAIN ] NIM: Loaded 4178 existing records. [2025-09-22T20:16:50.428751] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-22T20:16:50.449387] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-22T20:16:50.487368] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-22T20:16:50.492557] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-22T20:16:50.714462] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:16:50.764902] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-22T20:16:50.807213] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-22T20:16:50.864890] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-22T20:16:50.871962] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-22T20:16:51.086580] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:16:51.050541] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T20:16:51.099967] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-22T20:16:51.426979] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:16:51.722087] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-22T20:16:52.086807] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T20:16:52.300550] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-22T20:16:52.484260] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T20:16:52.522002] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-22T20:16:53.201061] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T20:16:53.322045] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-22T20:16:54.122056] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-22T20:16:54.792730] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T20:16:54.922052] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-22T20:16:55.068702] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T20:16:55.722066] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-22T20:16:56.139686] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T20:16:56.522113] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-22T20:16:57.322026] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-22T20:16:57.482315] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T20:16:57.723687] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-22T20:16:58.109513] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T20:16:58.122012] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-22T20:16:58.774249] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T20:16:58.922061] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-22T20:16:59.722045] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-22T20:16:59.860954] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-22T20:17:00.377163] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-22T20:17:00.522039] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-22T20:17:01.322048] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-22T20:17:01.625582] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T20:17:02.122060] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-22T20:17:02.839469] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T20:17:02.922052] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-22T20:17:03.145210] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T20:17:03.722095] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-22T20:17:03.907221] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T20:17:04.430335] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T20:17:04.441268] [INFO ] [REMOTE ] NI: Full fetch complete (76873 records). [2025-09-22T20:17:04.441566] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-22T20:17:04.443068] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:17:04.443196] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:17:04.443241] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:17:04.443310] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-22T20:17:04.443386] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-22T20:17:04.443427] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-09-22T20:17:04.443486] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-09-22T20:17:04.443587] [INFO ] [MAIN ] Update Progress: 1483/2372 symbols completed. NI took 35.8s. Estimated remaining: 1h 58m 6s. Rate: 7.5 symbols/min [2025-09-22T20:17:04.527239] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-22T20:17:04.638381] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:17:04.670865] [DEBUG] [LOCAL ] NINE: Loaded 29387 existing records from primary storage. [2025-09-22T20:17:04.671017] [INFO ] [MAIN ] NINE: Loaded 29387 existing records. [2025-09-22T20:17:04.846723] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:17:04.847003] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-22T20:17:04.847052] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-22T20:17:04.848127] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-22T20:17:04.848204] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-22T20:17:05.201664] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:17:05.224763] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T20:17:05.322056] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-22T20:17:06.122083] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-22T20:17:06.685967] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T20:17:06.879125] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T20:17:06.922056] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-22T20:17:07.722056] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-22T20:17:07.777252] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T20:17:08.318076] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T20:17:08.522090] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-22T20:17:09.208602] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T20:17:09.322051] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-22T20:17:09.931528] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T20:17:10.122075] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-22T20:17:10.922104] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-22T20:17:11.334450] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T20:17:11.383947] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-22T20:17:11.384975] [INFO ] [REMOTE ] NIM: Full fetch complete (6843 records). [2025-09-22T20:17:11.385046] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-22T20:17:11.758558] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-22T20:17:11.725685] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-22T20:17:11.759498] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-22T20:17:11.759761] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-22T20:17:11.759825] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-22T20:17:11.760321] [DEBUG] [LOCAL ] NIM: Trimmed 6843 records to 4079 (keeping 200 days of data) [2025-09-22T20:17:11.787639] [DEBUG] [LOCAL ] NIM: Primary data saved (4079 records). [2025-09-22T20:17:11.787811] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-22T20:17:11.787934] [INFO ] [MAIN ] Update Progress: 1484/2372 symbols completed. NIM took 21.8s. Estimated remaining: 1h 57m 58s. Rate: 7.5 symbols/min [2025-09-22T20:17:11.978186] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:17:12.045719] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-22T20:17:12.045902] [INFO ] [MAIN ] NIO: Loaded 54582 existing records. [2025-09-22T20:17:12.239292] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:17:12.239610] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-22T20:17:12.239691] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-22T20:17:12.242017] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-22T20:17:12.242085] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-22T20:17:12.527265] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-22T20:17:12.622785] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:17:12.629427] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T20:17:12.631784] [INFO ] [REMOTE ] NIE: Full fetch complete (16351 records). [2025-09-22T20:17:12.631916] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-22T20:17:13.009192] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-22T20:17:13.009339] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-22T20:17:13.009832] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-22T20:17:13.009896] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-22T20:17:13.010442] [DEBUG] [LOCAL ] NIE: Trimmed 16351 records to 11610 (keeping 200 days of data) [2025-09-22T20:17:13.089592] [DEBUG] [LOCAL ] NIE: Primary data saved (11610 records). [2025-09-22T20:17:13.089761] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-22T20:17:13.089868] [INFO ] [MAIN ] Update Progress: 1485/2372 symbols completed. NIE took 23.5s. Estimated remaining: 1h 57m 46s. Rate: 7.5 symbols/min [2025-09-22T20:17:13.266694] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:17:13.266924] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-22T20:17:13.266974] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-22T20:17:13.267134] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-22T20:17:13.267197] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-22T20:17:13.267264] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-22T20:17:13.267299] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-22T20:17:13.331014] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-22T20:17:13.627062] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:17:14.054329] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T20:17:14.122030] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-22T20:17:14.922022] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-22T20:17:15.285044] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T20:17:15.722096] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-22T20:17:16.008260] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:17:16.008682] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-22T20:17:16.122818] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-09-22T20:17:16.340265] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T20:17:16.522083] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-09-22T20:17:16.804467] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:17:16.804835] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-09-22T20:17:17.322085] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-22T20:17:18.122029] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-22T20:17:18.172586] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T20:17:18.176137] [INFO ] [REMOTE ] NHI: Full fetch complete (31593 records). [2025-09-22T20:17:18.176223] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-22T20:17:18.573973] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-22T20:17:18.574057] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-22T20:17:18.574870] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-22T20:17:18.574934] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-22T20:17:18.576334] [DEBUG] [LOCAL ] NHI: Trimmed 31593 records to 22012 (keeping 200 days of data) [2025-09-22T20:17:18.730215] [DEBUG] [LOCAL ] NHI: Primary data saved (22012 records). [2025-09-22T20:17:18.730347] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-22T20:17:18.730432] [INFO ] [MAIN ] Update Progress: 1486/2372 symbols completed. NHI took 50.1s. Estimated remaining: 1h 57m 36s. Rate: 7.5 symbols/min [2025-09-22T20:17:18.911096] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:17:18.922061] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-22T20:17:18.954370] [DEBUG] [LOCAL ] NJR: Loaded 38528 existing records from primary storage. [2025-09-22T20:17:18.954549] [INFO ] [MAIN ] NJR: Loaded 38528 existing records. [2025-09-22T20:17:19.142547] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:17:19.142848] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-22T20:17:19.142906] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-22T20:17:19.143749] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-22T20:17:19.143810] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-22T20:17:19.517902] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:17:19.537547] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T20:17:19.722082] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-22T20:17:20.522123] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-22T20:17:20.767075] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:17:20.767469] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-22T20:17:21.209102] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T20:17:21.322041] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-22T20:17:21.425271] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-22T20:17:22.122130] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-22T20:17:22.411190] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:17:22.411721] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-22T20:17:22.744544] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T20:17:22.922064] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-22T20:17:23.722061] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-22T20:17:24.522116] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-22T20:17:25.322097] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-22T20:17:25.419046] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-22T20:17:25.489461] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T20:17:25.596081] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:17:25.596421] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-22T20:17:25.947616] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T20:17:26.122119] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-22T20:17:26.922063] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-22T20:17:27.727134] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-22T20:17:27.740489] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T20:17:28.522057] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-22T20:17:29.192693] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T20:17:29.322008] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-22T20:17:29.567146] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-22T20:17:29.712628] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T20:17:30.122054] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-22T20:17:30.764776] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T20:17:30.922006] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-22T20:17:31.381932] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T20:17:31.722081] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-22T20:17:32.522073] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-22T20:17:32.852620] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-22T20:17:33.322070] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-22T20:17:33.568796] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:17:33.569159] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-22T20:17:34.108137] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-22T20:17:34.122017] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-22T20:17:34.183205] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T20:17:34.922103] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-22T20:17:35.722115] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-22T20:17:36.423355] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T20:17:36.522071] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-22T20:17:36.711850] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-22T20:17:37.322088] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-22T20:17:37.538415] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T20:17:37.812465] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T20:17:38.122128] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-22T20:17:38.922050] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-22T20:17:39.184747] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:17:39.185152] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-22T20:17:39.681286] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T20:17:39.722057] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-22T20:17:39.799600] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-22T20:17:40.522101] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-22T20:17:41.224151] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T20:17:41.230312] [INFO ] [REMOTE ] NJR: Full fetch complete (54221 records). [2025-09-22T20:17:41.230416] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-22T20:17:41.328964] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-22T20:17:41.631166] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-22T20:17:41.631250] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-22T20:17:41.632104] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-22T20:17:41.632179] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-22T20:17:41.633404] [DEBUG] [LOCAL ] NJR: Trimmed 54221 records to 38056 (keeping 200 days of data) [2025-09-22T20:17:41.869374] [DEBUG] [LOCAL ] NJR: Primary data saved (38056 records). [2025-09-22T20:17:41.869519] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-22T20:17:41.869601] [INFO ] [MAIN ] Update Progress: 1487/2372 symbols completed. NJR took 23.1s. Estimated remaining: 1h 57m 37s. Rate: 7.5 symbols/min [2025-09-22T20:17:42.038856] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:17:42.039015] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-22T20:17:42.039051] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-22T20:17:42.039190] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-22T20:17:42.039232] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-22T20:17:42.039272] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-22T20:17:42.039303] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-22T20:17:42.130091] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-22T20:17:42.398722] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:17:42.464509] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T20:17:42.922110] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-22T20:17:43.075871] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T20:17:43.080566] [INFO ] [REMOTE ] NINE: Full fetch complete (44418 records). [2025-09-22T20:17:43.080842] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-22T20:17:43.416326] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-22T20:17:43.594094] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-22T20:17:43.594194] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-22T20:17:43.595158] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-22T20:17:43.595229] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-22T20:17:43.596728] [DEBUG] [LOCAL ] NINE: Trimmed 44418 records to 28634 (keeping 200 days of data) [2025-09-22T20:17:43.722148] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-22T20:17:43.779701] [DEBUG] [LOCAL ] NINE: Primary data saved (28634 records). [2025-09-22T20:17:43.779875] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-22T20:17:43.779972] [INFO ] [MAIN ] Update Progress: 1488/2372 symbols completed. NINE took 39.3s. Estimated remaining: 1h 57m 26s. Rate: 7.5 symbols/min [2025-09-22T20:17:43.957891] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:17:43.958065] [DEBUG] [LOCAL ] NKX: No existing data file found in primary storage. [2025-09-22T20:17:43.958104] [WARN ] [MAIN ] NKX: No existing data found, performing full refresh instead. [2025-09-22T20:17:43.958253] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-22T20:17:43.958297] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-22T20:17:43.958398] [DEBUG] [LOCAL ] NKX: No primary data file found to delete. [2025-09-22T20:17:43.958448] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-22T20:17:44.363665] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:17:44.524966] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-22T20:17:44.530596] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T20:17:45.313945] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-22T20:17:45.322005] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-22T20:17:46.122078] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-22T20:17:46.380227] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-22T20:17:46.398526] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T20:17:46.922101] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-22T20:17:47.722084] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-22T20:17:48.522018] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-22T20:17:48.594127] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T20:17:48.731444] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-22T20:17:49.008234] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-22T20:17:49.016473] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-09-22T20:17:49.016627] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-22T20:17:49.327132] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-22T20:17:49.411509] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-22T20:17:49.411596] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-22T20:17:49.412689] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-22T20:17:49.412756] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-22T20:17:49.414282] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 53802 (keeping 200 days of data) [2025-09-22T20:17:49.736174] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-09-22T20:17:49.736321] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-22T20:17:49.736404] [INFO ] [MAIN ] Update Progress: 1489/2372 symbols completed. NIO took 37.9s. Estimated remaining: 1h 57m 17s. Rate: 7.5 symbols/min [2025-09-22T20:17:49.912864] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:17:49.913108] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-22T20:17:49.913213] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-22T20:17:49.913418] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-22T20:17:49.913531] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-22T20:17:49.913589] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-22T20:17:49.913623] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-22T20:17:50.123533] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-22T20:17:50.117023] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T20:17:50.211530] [INFO ] [REMOTE ] NIQ: Full fetch complete (14683 records). [2025-09-22T20:17:50.256750] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-22T20:17:50.466818] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:17:50.521310] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 43 unique days, need 200 days [2025-09-22T20:17:50.521627] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:17:50.521717] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:17:50.521766] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-22T20:17:50.521822] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-22T20:17:50.521857] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-22T20:17:50.521914] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-22T20:17:50.521992] [INFO ] [MAIN ] Update Progress: 1490/2372 symbols completed. NIQ took 37.4s. Estimated remaining: 1h 57m 4s. Rate: 7.5 symbols/min [2025-09-22T20:17:50.706703] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:17:50.722268] [DEBUG] [LOCAL ] NLOP: Loaded 12008 existing records from primary storage. [2025-09-22T20:17:50.722405] [INFO ] [MAIN ] NLOP: Loaded 12008 existing records. [2025-09-22T20:17:50.916516] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:17:50.916866] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-22T20:17:50.916927] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-22T20:17:50.917511] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-22T20:17:50.917577] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-22T20:17:50.950619] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-22T20:17:51.212884] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T20:17:51.330242] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:17:51.479864] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-22T20:17:51.722049] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-22T20:17:52.062577] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-22T20:17:52.305066] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-22T20:17:52.522055] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-22T20:17:53.322044] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-22T20:17:53.576092] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T20:17:53.990782] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T20:17:54.122059] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-22T20:17:54.922052] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-22T20:17:55.033259] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T20:17:55.722046] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-22T20:17:55.833942] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-22T20:17:56.522118] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-22T20:17:56.642763] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-22T20:17:57.322037] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-22T20:17:57.701359] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T20:17:58.122103] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-22T20:17:58.327404] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T20:17:58.853633] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T20:17:58.922076] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-22T20:17:59.536748] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T20:17:59.722059] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-22T20:18:00.522073] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-22T20:18:00.813108] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T20:18:01.322027] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-22T20:18:01.475576] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T20:18:02.122048] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-22T20:18:02.786008] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T20:18:02.922142] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-22T20:18:03.722072] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-22T20:18:04.522038] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-22T20:18:04.588579] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-22T20:18:04.600936] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T20:18:05.322093] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-22T20:18:05.446931] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T20:18:05.450276] [INFO ] [REMOTE ] NKX: Full fetch complete (19463 records). [2025-09-22T20:18:05.450400] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-22T20:18:05.857763] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-22T20:18:05.857853] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-22T20:18:05.858309] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-22T20:18:05.858349] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-22T20:18:05.859109] [DEBUG] [LOCAL ] NKX: Trimmed 19463 records to 13576 (keeping 200 days of data) [2025-09-22T20:18:05.947316] [DEBUG] [LOCAL ] NKX: Primary data saved (13576 records). [2025-09-22T20:18:05.947505] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-22T20:18:05.947598] [INFO ] [MAIN ] Update Progress: 1491/2372 symbols completed. NKX took 22.2s. Estimated remaining: 1h 57m 1s. Rate: 7.5 symbols/min [2025-09-22T20:18:06.131346] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:18:06.131423] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-22T20:18:06.152972] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T20:18:06.222214] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-22T20:18:06.251580] [DEBUG] [LOCAL ] NLY: Loaded 54361 existing records from primary storage. [2025-09-22T20:18:06.251760] [INFO ] [MAIN ] NLY: Loaded 54361 existing records. [2025-09-22T20:18:06.439577] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:18:06.439900] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-22T20:18:06.439965] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-22T20:18:06.441460] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-22T20:18:06.441525] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-22T20:18:06.816228] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:18:06.820867] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T20:18:06.922079] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-22T20:18:07.432250] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-22T20:18:07.722077] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-22T20:18:08.477812] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-22T20:18:08.522066] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-22T20:18:09.322085] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-22T20:18:10.122059] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-22T20:18:10.552588] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-22T20:18:10.922139] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-22T20:18:11.117620] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T20:18:11.722030] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-22T20:18:11.951088] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-22T20:18:12.522077] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-22T20:18:12.615588] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T20:18:12.618786] [INFO ] [REMOTE ] NLOP: Full fetch complete (17611 records). [2025-09-22T20:18:12.619281] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-22T20:18:13.021205] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-22T20:18:13.037454] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-22T20:18:13.051304] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-22T20:18:13.051402] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-22T20:18:13.054129] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-22T20:18:13.066425] [DEBUG] [LOCAL ] NLOP: Trimmed 17611 records to 11818 (keeping 200 days of data) [2025-09-22T20:18:13.146396] [DEBUG] [LOCAL ] NLOP: Primary data saved (11818 records). [2025-09-22T20:18:13.146595] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-22T20:18:13.146732] [INFO ] [MAIN ] Update Progress: 1492/2372 symbols completed. NLOP took 22.6s. Estimated remaining: 1h 56m 52s. Rate: 7.5 symbols/min [2025-09-22T20:18:13.278756] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T20:18:13.335212] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-22T20:18:13.341594] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:18:13.361472] [DEBUG] [LOCAL ] NMAI: Loaded 13451 existing records from primary storage. [2025-09-22T20:18:13.361717] [INFO ] [MAIN ] NMAI: Loaded 13451 existing records. [2025-09-22T20:18:13.548409] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:18:13.548729] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-22T20:18:13.548800] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-22T20:18:13.549396] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-22T20:18:13.549459] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-22T20:18:13.929469] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:18:14.122094] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-22T20:18:14.138249] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T20:18:14.922074] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-22T20:18:15.722096] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-22T20:18:15.999744] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T20:18:16.001058] [INFO ] [REMOTE ] NL: Full fetch complete (6908 records). [2025-09-22T20:18:16.001127] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-22T20:18:16.190028] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T20:18:16.190323] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:18:16.190410] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:18:16.190591] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-22T20:18:16.190748] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-22T20:18:16.190804] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-22T20:18:16.190849] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-22T20:18:16.190915] [INFO ] [MAIN ] Update Progress: 1493/2372 symbols completed. NL took 26.5s. Estimated remaining: 1h 56m 42s. Rate: 7.5 symbols/min [2025-09-22T20:18:16.379193] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:18:16.379469] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-22T20:18:16.379594] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-22T20:18:16.380092] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-22T20:18:16.380154] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-22T20:18:16.380241] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-22T20:18:16.380289] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-22T20:18:16.530977] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-22T20:18:16.638246] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-22T20:18:16.835722] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:18:17.322069] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-22T20:18:17.656026] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T20:18:18.122052] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-22T20:18:18.501127] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-22T20:18:18.922022] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-22T20:18:19.003798] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T20:18:19.196904] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T20:18:19.722189] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-22T20:18:20.522137] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-22T20:18:20.696312] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T20:18:21.322049] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-22T20:18:21.461639] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-22T20:18:22.122042] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-22T20:18:22.350824] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T20:18:22.442026] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T20:18:22.922106] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-22T20:18:23.582746] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-22T20:18:23.722113] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-22T20:18:24.522119] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-22T20:18:24.673374] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-22T20:18:25.322074] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-22T20:18:25.393756] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T20:18:25.584037] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:18:25.584784] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-22T20:18:25.846494] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-22T20:18:26.122056] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-22T20:18:26.922038] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-09-22T20:18:27.086713] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T20:18:27.223521] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:18:27.223916] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-09-22T20:18:27.722072] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-22T20:18:28.522032] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-22T20:18:28.768873] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T20:18:29.322057] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-22T20:18:30.122064] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-22T20:18:30.922037] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-22T20:18:31.101951] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T20:18:31.199607] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:18:31.200013] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-22T20:18:31.298698] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-22T20:18:31.344278] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-22T20:18:31.722135] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-22T20:18:32.218375] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-22T20:18:32.522135] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-22T20:18:32.628669] [DEBUG] [REMOTE ] NKE: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-22T20:18:32.629078] [WARN ] [REMOTE ] NKE: No data returned for month 2025-08 [2025-09-22T20:18:33.322072] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-22T20:18:34.122057] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-22T20:18:34.922105] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-22T20:18:35.722058] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-22T20:18:35.807587] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-22T20:18:35.825224] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T20:18:35.828562] [INFO ] [REMOTE ] NMAI: Full fetch complete (20016 records). [2025-09-22T20:18:35.828669] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-22T20:18:36.205505] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-22T20:18:36.205683] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-22T20:18:36.206229] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-22T20:18:36.206301] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-22T20:18:36.206995] [DEBUG] [LOCAL ] NMAI: Trimmed 20016 records to 13187 (keeping 200 days of data) [2025-09-22T20:18:36.292195] [DEBUG] [LOCAL ] NMAI: Primary data saved (13187 records). [2025-09-22T20:18:36.292368] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-22T20:18:36.292497] [INFO ] [MAIN ] Update Progress: 1494/2372 symbols completed. NMAI took 23.1s. Estimated remaining: 1h 56m 41s. Rate: 7.5 symbols/min [2025-09-22T20:18:36.472304] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:18:36.508534] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-22T20:18:36.525618] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-22T20:18:36.534735] [DEBUG] [LOCAL ] NMCO: Loaded 16688 existing records from primary storage. [2025-09-22T20:18:36.534867] [INFO ] [MAIN ] NMCO: Loaded 16688 existing records. [2025-09-22T20:18:36.718906] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:18:36.719201] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-22T20:18:36.719270] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-22T20:18:36.719929] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-22T20:18:36.719991] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-22T20:18:37.099146] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:18:37.322075] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-22T20:18:37.686587] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-22T20:18:37.694979] [INFO ] [REMOTE ] NKE: Full fetch complete (69397 records). [2025-09-22T20:18:37.695193] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-22T20:18:37.895163] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-22T20:18:37.895937] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:18:37.896013] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:18:37.896096] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-22T20:18:37.896187] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-22T20:18:37.896232] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-22T20:18:37.896291] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-22T20:18:37.896378] [INFO ] [MAIN ] Update Progress: 1495/2372 symbols completed. NKE took 56.0s. Estimated remaining: 1h 56m 29s. Rate: 7.5 symbols/min [2025-09-22T20:18:38.073753] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:18:38.083377] [DEBUG] [LOCAL ] NMG: Loaded 7572 existing records from primary storage. [2025-09-22T20:18:38.083498] [INFO ] [MAIN ] NMG: Loaded 7572 existing records. [2025-09-22T20:18:38.131056] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-22T20:18:38.287753] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:18:38.288034] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-22T20:18:38.288088] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-22T20:18:38.288549] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-22T20:18:38.288611] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-22T20:18:38.665492] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:18:38.694540] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-22T20:18:38.922029] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-22T20:18:39.276957] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T20:18:39.323154] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T20:18:39.722082] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-22T20:18:40.522064] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-22T20:18:40.781281] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T20:18:40.838166] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T20:18:41.190791] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T20:18:41.322058] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-22T20:18:42.122053] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-22T20:18:42.323831] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T20:18:42.922068] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-22T20:18:43.722070] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-22T20:18:44.111258] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T20:18:44.451171] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-22T20:18:44.460002] [INFO ] [REMOTE ] NLY: Full fetch complete (77555 records). [2025-09-22T20:18:44.460178] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-22T20:18:44.529959] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-22T20:18:44.868229] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-22T20:18:44.868316] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-22T20:18:44.869367] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-22T20:18:44.869432] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-22T20:18:44.870917] [DEBUG] [LOCAL ] NLY: Trimmed 77555 records to 53581 (keeping 200 days of data) [2025-09-22T20:18:45.202670] [DEBUG] [LOCAL ] NLY: Primary data saved (53581 records). [2025-09-22T20:18:45.202816] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-22T20:18:45.202908] [INFO ] [MAIN ] Update Progress: 1496/2372 symbols completed. NLY took 39.3s. Estimated remaining: 1h 56m 21s. Rate: 7.5 symbols/min [2025-09-22T20:18:45.327256] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-22T20:18:45.375111] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:18:45.381004] [DEBUG] [LOCAL ] NMI: Loaded 4156 existing records from primary storage. [2025-09-22T20:18:45.381281] [INFO ] [MAIN ] NMI: Loaded 4156 existing records. [2025-09-22T20:18:45.560389] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:18:45.561094] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-22T20:18:45.561144] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-22T20:18:45.561466] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-22T20:18:45.561526] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-22T20:18:45.859370] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T20:18:45.983681] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:18:46.044207] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-22T20:18:46.122014] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-22T20:18:46.167417] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T20:18:46.813090] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-22T20:18:46.922018] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-22T20:18:47.722055] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-22T20:18:48.321289] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T20:18:48.522099] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-22T20:18:48.635182] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T20:18:49.194959] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T20:18:49.322070] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-22T20:18:49.959418] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-22T20:18:50.122061] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-22T20:18:50.922083] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-22T20:18:51.725741] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-22T20:18:51.732571] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T20:18:51.741232] [INFO ] [REMOTE ] NMAX: Full fetch complete (39672 records). [2025-09-22T20:18:51.741455] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-22T20:18:52.051491] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 121 unique days, need 200 days [2025-09-22T20:18:52.052350] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:18:52.052440] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:18:52.052522] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-22T20:18:52.052615] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-22T20:18:52.052699] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-22T20:18:52.052773] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-22T20:18:52.053123] [INFO ] [MAIN ] Update Progress: 1497/2372 symbols completed. NMAX took 35.9s. Estimated remaining: 1h 56m 12s. Rate: 7.5 symbols/min [2025-09-22T20:18:52.352665] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:18:52.367898] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T20:18:52.395787] [DEBUG] [LOCAL ] NMM: Loaded 14541 existing records from primary storage. [2025-09-22T20:18:52.395983] [INFO ] [MAIN ] NMM: Loaded 14541 existing records. [2025-09-22T20:18:52.523679] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-22T20:18:52.528059] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-22T20:18:52.637950] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:18:52.638220] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-22T20:18:52.638271] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-22T20:18:52.638798] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-22T20:18:52.638861] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-22T20:18:53.042879] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:18:53.322028] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-22T20:18:53.638062] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T20:18:53.952629] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T20:18:54.122054] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-22T20:18:54.922036] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-22T20:18:55.119781] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T20:18:55.722020] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-22T20:18:56.067612] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T20:18:56.522062] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-22T20:18:56.820362] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T20:18:57.322062] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-22T20:18:57.371819] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T20:18:57.912888] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-22T20:18:58.122063] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-22T20:18:58.783748] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T20:18:58.922050] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-22T20:18:59.722061] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-22T20:18:59.985366] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T20:19:00.522100] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-22T20:19:00.929715] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T20:19:01.202492] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T20:19:01.322070] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-22T20:19:02.122094] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-22T20:19:02.392884] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T20:19:02.922108] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-22T20:19:03.106826] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-22T20:19:03.110062] [INFO ] [REMOTE ] NMCO: Full fetch complete (24514 records). [2025-09-22T20:19:03.110162] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-22T20:19:03.519245] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-22T20:19:03.519363] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-22T20:19:03.520298] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-22T20:19:03.520374] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-22T20:19:03.522292] [DEBUG] [LOCAL ] NMCO: Trimmed 24514 records to 16527 (keeping 200 days of data) [2025-09-22T20:19:03.639922] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-22T20:19:03.642760] [INFO ] [REMOTE ] NMI: Full fetch complete (6280 records). [2025-09-22T20:19:03.642912] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-22T20:19:03.718684] [DEBUG] [LOCAL ] NMCO: Primary data saved (16527 records). [2025-09-22T20:19:03.730512] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-22T20:19:03.725081] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-22T20:19:03.755755] [INFO ] [MAIN ] Update Progress: 1498/2372 symbols completed. NMCO took 27.5s. Estimated remaining: 1h 56m 6s. Rate: 7.5 symbols/min [2025-09-22T20:19:04.169436] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:19:04.256180] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-22T20:19:04.256271] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-22T20:19:04.256546] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-22T20:19:04.256607] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-22T20:19:04.257210] [DEBUG] [LOCAL ] NMI: Trimmed 6280 records to 4059 (keeping 200 days of data) [2025-09-22T20:19:04.297857] [DEBUG] [LOCAL ] NMI: Primary data saved (4059 records). [2025-09-22T20:19:04.298024] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-22T20:19:04.298142] [INFO ] [MAIN ] Update Progress: 1499/2372 symbols completed. NMI took 19.1s. Estimated remaining: 1h 55m 54s. Rate: 7.5 symbols/min [2025-09-22T20:19:04.427572] [DEBUG] [LOCAL ] NMR: Loaded 35725 existing records from primary storage. [2025-09-22T20:19:04.428229] [INFO ] [MAIN ] NMR: Loaded 35725 existing records. [2025-09-22T20:19:04.523333] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-22T20:19:04.621343] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:19:04.694373] [DEBUG] [LOCAL ] NMS: Loaded 2899 existing records from primary storage. [2025-09-22T20:19:04.723431] [INFO ] [MAIN ] NMS: Loaded 2899 existing records. [2025-09-22T20:19:04.730172] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:19:04.782205] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-22T20:19:04.810762] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-22T20:19:04.842752] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-22T20:19:04.845776] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-22T20:19:05.046781] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:19:05.086392] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-22T20:19:05.106625] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-22T20:19:05.192727] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-22T20:19:05.223280] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-22T20:19:05.224258] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T20:19:05.340296] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-22T20:19:05.480705] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:19:05.492719] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T20:19:05.769775] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:19:06.122038] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-22T20:19:06.235255] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T20:19:06.916254] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T20:19:06.922004] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-22T20:19:07.722074] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-22T20:19:07.895993] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T20:19:08.522072] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-22T20:19:09.055373] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T20:19:09.322065] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-22T20:19:09.354148] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T20:19:10.122084] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-22T20:19:10.752836] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T20:19:10.922024] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-22T20:19:10.997790] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T20:19:10.999565] [INFO ] [REMOTE ] NMG: Full fetch complete (12994 records). [2025-09-22T20:19:10.999635] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-22T20:19:11.361319] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-22T20:19:11.361400] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-22T20:19:11.361714] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-22T20:19:11.361791] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-22T20:19:11.362308] [DEBUG] [LOCAL ] NMG: Trimmed 12994 records to 7500 (keeping 200 days of data) [2025-09-22T20:19:11.405373] [DEBUG] [LOCAL ] NMG: Primary data saved (7500 records). [2025-09-22T20:19:11.405466] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-22T20:19:11.405563] [INFO ] [MAIN ] Update Progress: 1500/2372 symbols completed. NMG took 33.5s. Estimated remaining: 1h 55m 46s. Rate: 7.5 symbols/min [2025-09-22T20:19:11.583858] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:19:11.593845] [DEBUG] [LOCAL ] NMT: Loaded 2857 existing records from primary storage. [2025-09-22T20:19:11.593951] [INFO ] [MAIN ] NMT: Loaded 2857 existing records. [2025-09-22T20:19:11.732203] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-22T20:19:11.778090] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:19:11.778408] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-22T20:19:11.778478] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-22T20:19:11.778821] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-22T20:19:11.778896] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-22T20:19:12.148730] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:19:12.414871] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T20:19:12.522048] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-22T20:19:13.052724] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T20:19:13.322094] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-22T20:19:13.815699] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-22T20:19:13.962785] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T20:19:14.122058] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-22T20:19:14.922073] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-22T20:19:15.534918] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-22T20:19:15.709742] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T20:19:15.721994] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-22T20:19:16.522110] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-22T20:19:16.970544] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T20:19:16.970688] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T20:19:17.322052] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-22T20:19:17.941171] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T20:19:18.122067] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-22T20:19:18.713900] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T20:19:18.922072] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-22T20:19:19.441787] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-22T20:19:19.722109] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-22T20:19:20.282553] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T20:19:20.522101] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-22T20:19:21.121126] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T20:19:21.322071] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-22T20:19:22.122059] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-22T20:19:22.615932] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-22T20:19:22.773411] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T20:19:22.922068] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-22T20:19:23.435989] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T20:19:23.722093] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-22T20:19:24.362374] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T20:19:24.522067] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-22T20:19:25.199298] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T20:19:25.322035] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-22T20:19:25.877791] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T20:19:26.122061] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-22T20:19:26.922075] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-22T20:19:27.437979] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-22T20:19:27.439375] [INFO ] [REMOTE ] NMS: Full fetch complete (4035 records). [2025-09-22T20:19:27.439469] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-22T20:19:27.727182] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-22T20:19:27.820709] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-22T20:19:27.820917] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-22T20:19:27.821144] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-22T20:19:27.821271] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-22T20:19:27.821939] [DEBUG] [LOCAL ] NMS: Trimmed 4035 records to 2888 (keeping 200 days of data) [2025-09-22T20:19:27.864229] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T20:19:27.873276] [DEBUG] [LOCAL ] NMS: Primary data saved (2888 records). [2025-09-22T20:19:27.873517] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-22T20:19:27.873736] [INFO ] [MAIN ] Update Progress: 1501/2372 symbols completed. NMS took 23.6s. Estimated remaining: 1h 55m 43s. Rate: 7.5 symbols/min [2025-09-22T20:19:28.045621] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:19:28.076143] [DEBUG] [LOCAL ] NMZ: Loaded 21695 existing records from primary storage. [2025-09-22T20:19:28.076274] [INFO ] [MAIN ] NMZ: Loaded 21695 existing records. [2025-09-22T20:19:28.263929] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:19:28.264253] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-22T20:19:28.264329] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-22T20:19:28.265095] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-22T20:19:28.265212] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-22T20:19:28.522202] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-22T20:19:28.538857] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T20:19:28.641029] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:19:29.322077] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-22T20:19:29.949735] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T20:19:30.122089] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-22T20:19:30.266158] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T20:19:30.922088] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-22T20:19:31.380131] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T20:19:31.722091] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-22T20:19:32.010025] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T20:19:32.354093] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T20:19:32.522067] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-22T20:19:33.147472] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-22T20:19:33.322062] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-22T20:19:34.122057] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-22T20:19:34.686782] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T20:19:34.692212] [INFO ] [REMOTE ] NMR: Full fetch complete (50151 records). [2025-09-22T20:19:34.692325] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-22T20:19:34.932086] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-22T20:19:35.137425] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-22T20:19:35.139446] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-22T20:19:35.140462] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-22T20:19:35.140620] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-22T20:19:35.142021] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T20:19:35.149013] [DEBUG] [LOCAL ] NMR: Trimmed 50151 records to 35091 (keeping 200 days of data) [2025-09-22T20:19:35.367905] [DEBUG] [LOCAL ] NMR: Primary data saved (35091 records). [2025-09-22T20:19:35.368182] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-22T20:19:35.368303] [INFO ] [MAIN ] Update Progress: 1502/2372 symbols completed. NMR took 31.6s. Estimated remaining: 1h 55m 34s. Rate: 7.5 symbols/min [2025-09-22T20:19:35.541514] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:19:35.548243] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T20:19:35.560429] [DEBUG] [LOCAL ] NNI: Loaded 9997 existing records from primary storage. [2025-09-22T20:19:35.560576] [INFO ] [MAIN ] NNI: Loaded 9997 existing records. [2025-09-22T20:19:35.734888] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-22T20:19:35.741007] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:19:35.742601] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-22T20:19:35.742702] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-22T20:19:35.743709] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-22T20:19:35.743786] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-22T20:19:36.139339] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:19:36.522078] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-22T20:19:36.916182] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T20:19:37.150731] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-22T20:19:37.322058] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-22T20:19:37.892635] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T20:19:37.893892] [INFO ] [REMOTE ] NMT: Full fetch complete (4296 records). [2025-09-22T20:19:37.893966] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-22T20:19:38.129147] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-22T20:19:38.294126] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-22T20:19:38.294215] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-22T20:19:38.294354] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-22T20:19:38.294392] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-22T20:19:38.294817] [DEBUG] [LOCAL ] NMT: Trimmed 4296 records to 2845 (keeping 200 days of data) [2025-09-22T20:19:38.315332] [DEBUG] [LOCAL ] NMT: Primary data saved (2845 records). [2025-09-22T20:19:38.315420] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-22T20:19:38.315498] [INFO ] [MAIN ] Update Progress: 1503/2372 symbols completed. NMT took 26.9s. Estimated remaining: 1h 55m 23s. Rate: 7.5 symbols/min [2025-09-22T20:19:38.505203] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:19:38.577307] [DEBUG] [LOCAL ] NNN: Loaded 49131 existing records from primary storage. [2025-09-22T20:19:38.577486] [INFO ] [MAIN ] NNN: Loaded 49131 existing records. [2025-09-22T20:19:38.778955] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:19:38.779215] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-22T20:19:38.779265] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-22T20:19:38.780840] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-22T20:19:38.780904] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-22T20:19:38.927244] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-22T20:19:39.156757] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T20:19:39.186869] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:19:39.722031] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-22T20:19:39.949337] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T20:19:40.522064] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-22T20:19:41.322057] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-22T20:19:41.544857] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T20:19:41.635534] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T20:19:42.052301] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T20:19:42.122035] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-22T20:19:42.680293] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T20:19:42.922059] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-22T20:19:43.722069] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-22T20:19:43.967403] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T20:19:44.522095] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-22T20:19:44.530249] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T20:19:45.322075] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-22T20:19:46.122105] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-22T20:19:46.177540] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T20:19:46.354934] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T20:19:46.872375] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T20:19:46.922138] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-22T20:19:47.722090] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-22T20:19:47.872143] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T20:19:48.522042] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-22T20:19:48.723461] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T20:19:49.322028] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-22T20:19:49.372417] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T20:19:50.122056] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-22T20:19:50.445930] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T20:19:50.922107] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-22T20:19:50.941312] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T20:19:50.944399] [INFO ] [REMOTE ] NMM: Full fetch complete (22426 records). [2025-09-22T20:19:50.944559] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-22T20:19:51.341353] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-22T20:19:51.341439] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-22T20:19:51.341994] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-22T20:19:51.342057] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-22T20:19:51.342772] [DEBUG] [LOCAL ] NMM: Trimmed 22426 records to 14314 (keeping 200 days of data) [2025-09-22T20:19:51.448519] [DEBUG] [LOCAL ] NMM: Primary data saved (14314 records). [2025-09-22T20:19:51.448722] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-22T20:19:51.448851] [INFO ] [MAIN ] Update Progress: 1504/2372 symbols completed. NMM took 59.4s. Estimated remaining: 1h 55m 18s. Rate: 7.5 symbols/min [2025-09-22T20:19:51.616819] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:19:51.624182] [DEBUG] [LOCAL ] NNY: Loaded 5772 existing records from primary storage. [2025-09-22T20:19:51.624270] [INFO ] [MAIN ] NNY: Loaded 5772 existing records. [2025-09-22T20:19:51.723424] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-22T20:19:51.811743] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:19:51.812041] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-22T20:19:51.812092] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-22T20:19:51.812471] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-22T20:19:51.812531] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-22T20:19:52.169626] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:19:52.182760] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T20:19:52.522057] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-22T20:19:53.322034] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-22T20:19:53.394756] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T20:19:53.624633] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-22T20:19:53.629634] [INFO ] [REMOTE ] NMZ: Full fetch complete (31883 records). [2025-09-22T20:19:53.629785] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-22T20:19:54.052970] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-22T20:19:54.053086] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-22T20:19:54.053934] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-22T20:19:54.053998] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-22T20:19:54.054986] [DEBUG] [LOCAL ] NMZ: Trimmed 31883 records to 21499 (keeping 200 days of data) [2025-09-22T20:19:54.123067] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-22T20:19:54.219419] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T20:19:54.223674] [DEBUG] [LOCAL ] NMZ: Primary data saved (21499 records). [2025-09-22T20:19:54.223826] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-22T20:19:54.223939] [INFO ] [MAIN ] Update Progress: 1505/2372 symbols completed. NMZ took 26.3s. Estimated remaining: 1h 55m 7s. Rate: 7.5 symbols/min [2025-09-22T20:19:54.441624] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:19:54.459713] [DEBUG] [LOCAL ] NOA: Loaded 16673 existing records from primary storage. [2025-09-22T20:19:54.459852] [INFO ] [MAIN ] NOA: Loaded 16673 existing records. [2025-09-22T20:19:54.705562] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:19:54.705858] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-22T20:19:54.705906] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-22T20:19:54.706597] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-22T20:19:54.706698] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-22T20:19:54.923995] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-22T20:19:55.012898] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T20:19:55.089796] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:19:55.722050] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-22T20:19:56.522090] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-22T20:19:56.704536] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-22T20:19:56.892638] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-22T20:19:57.322033] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-22T20:19:57.453446] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-22T20:19:58.099275] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T20:19:58.122050] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-22T20:19:58.922076] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-22T20:19:58.992332] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T20:19:58.994914] [INFO ] [REMOTE ] NNI: Full fetch complete (12543 records). [2025-09-22T20:19:58.994997] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-22T20:19:59.393546] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-22T20:19:59.393716] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-22T20:19:59.394127] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-22T20:19:59.394238] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-22T20:19:59.395303] [DEBUG] [LOCAL ] NNI: Trimmed 12543 records to 9907 (keeping 200 days of data) [2025-09-22T20:19:59.465681] [DEBUG] [LOCAL ] NNI: Primary data saved (9907 records). [2025-09-22T20:19:59.465840] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-22T20:19:59.465933] [INFO ] [MAIN ] Update Progress: 1506/2372 symbols completed. NNI took 24.1s. Estimated remaining: 1h 54m 58s. Rate: 7.5 symbols/min [2025-09-22T20:19:59.640600] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:19:59.663960] [DEBUG] [LOCAL ] NOAH: Loaded 20306 existing records from primary storage. [2025-09-22T20:19:59.664104] [INFO ] [MAIN ] NOAH: Loaded 20306 existing records. [2025-09-22T20:19:59.727592] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-22T20:19:59.849756] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:19:59.857228] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-22T20:19:59.857368] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-22T20:19:59.858241] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T20:19:59.860754] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-22T20:19:59.861411] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-22T20:20:00.238003] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:20:00.522084] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-22T20:20:01.322036] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-22T20:20:01.399941] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T20:20:01.590998] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T20:20:02.122146] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-22T20:20:02.285310] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T20:20:02.922112] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-22T20:20:03.610823] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T20:20:03.722025] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-22T20:20:03.816702] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T20:20:04.397158] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-22T20:20:04.522040] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-22T20:20:05.322038] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-22T20:20:05.349218] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-22T20:20:06.122080] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-22T20:20:06.353575] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-22T20:20:06.535083] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-22T20:20:06.922069] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-22T20:20:07.722062] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-22T20:20:07.847616] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-22T20:20:08.463882] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-22T20:20:08.522083] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-22T20:20:09.322064] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-22T20:20:09.970997] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-22T20:20:10.122025] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-22T20:20:10.158898] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T20:20:10.895459] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T20:20:10.922020] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-22T20:20:11.664973] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T20:20:11.667721] [INFO ] [REMOTE ] NNY: Full fetch complete (8998 records). [2025-09-22T20:20:11.667892] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-22T20:20:11.727232] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-22T20:20:12.050662] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-22T20:20:12.050771] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-22T20:20:12.051010] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-22T20:20:12.051051] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-22T20:20:12.051539] [DEBUG] [LOCAL ] NNY: Trimmed 8998 records to 5719 (keeping 200 days of data) [2025-09-22T20:20:12.085894] [DEBUG] [LOCAL ] NNY: Primary data saved (5719 records). [2025-09-22T20:20:12.086042] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-22T20:20:12.086145] [INFO ] [MAIN ] Update Progress: 1507/2372 symbols completed. NNY took 20.6s. Estimated remaining: 1h 54m 53s. Rate: 7.5 symbols/min [2025-09-22T20:20:12.264266] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:20:12.314175] [DEBUG] [LOCAL ] NOC: Loaded 43509 existing records from primary storage. [2025-09-22T20:20:12.314342] [INFO ] [MAIN ] NOC: Loaded 43509 existing records. [2025-09-22T20:20:12.499276] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:20:12.499546] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-22T20:20:12.499605] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-22T20:20:12.500629] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-22T20:20:12.500748] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-22T20:20:12.532037] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-22T20:20:12.870899] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:20:13.327479] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-22T20:20:13.328525] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T20:20:13.614512] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T20:20:14.122124] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-22T20:20:14.546897] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T20:20:14.922055] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-22T20:20:15.644874] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T20:20:15.722105] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-22T20:20:16.248789] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T20:20:16.522075] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-22T20:20:17.322031] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-22T20:20:17.449011] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T20:20:17.456931] [INFO ] [REMOTE ] NNN: Full fetch complete (70134 records). [2025-09-22T20:20:17.457107] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-22T20:20:17.760207] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T20:20:17.874032] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-22T20:20:17.874128] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-22T20:20:17.875165] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-22T20:20:17.875234] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-22T20:20:17.876811] [DEBUG] [LOCAL ] NNN: Trimmed 70134 records to 48446 (keeping 200 days of data) [2025-09-22T20:20:18.122211] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-22T20:20:18.205951] [DEBUG] [LOCAL ] NNN: Primary data saved (48446 records). [2025-09-22T20:20:18.206096] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-22T20:20:18.206180] [INFO ] [MAIN ] Update Progress: 1508/2372 symbols completed. NNN took 39.9s. Estimated remaining: 1h 54m 44s. Rate: 7.5 symbols/min [2025-09-22T20:20:18.376065] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:20:18.427095] [DEBUG] [LOCAL ] NOG: Loaded 51936 existing records from primary storage. [2025-09-22T20:20:18.427243] [INFO ] [MAIN ] NOG: Loaded 51936 existing records. [2025-09-22T20:20:18.609074] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:20:18.609547] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-22T20:20:18.609664] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-22T20:20:18.611190] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-22T20:20:18.611252] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-22T20:20:18.925113] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-22T20:20:18.977251] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T20:20:19.015821] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:20:19.030916] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-22T20:20:19.722873] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-22T20:20:19.726202] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T20:20:20.522055] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-22T20:20:21.322041] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-22T20:20:21.440087] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T20:20:21.907097] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T20:20:22.122051] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-22T20:20:22.922023] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-22T20:20:23.200130] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T20:20:23.722055] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-22T20:20:23.838429] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T20:20:23.980151] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T20:20:24.522080] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-22T20:20:25.248781] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T20:20:25.322019] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-22T20:20:25.714431] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T20:20:26.122054] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-22T20:20:26.907441] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T20:20:26.911890] [INFO ] [REMOTE ] NOA: Full fetch complete (21757 records). [2025-09-22T20:20:26.912024] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-22T20:20:26.928240] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-22T20:20:27.270705] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-22T20:20:27.364194] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-22T20:20:27.364269] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-22T20:20:27.364732] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-22T20:20:27.364793] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-22T20:20:27.365429] [DEBUG] [LOCAL ] NOA: Trimmed 21757 records to 16312 (keeping 200 days of data) [2025-09-22T20:20:27.463873] [DEBUG] [LOCAL ] NOA: Primary data saved (16312 records). [2025-09-22T20:20:27.464013] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-22T20:20:27.464105] [INFO ] [MAIN ] Update Progress: 1509/2372 symbols completed. NOA took 33.2s. Estimated remaining: 1h 54m 36s. Rate: 7.5 symbols/min [2025-09-22T20:20:27.638729] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:20:27.699310] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-22T20:20:27.699452] [INFO ] [MAIN ] NOK: Loaded 54401 existing records. [2025-09-22T20:20:27.730224] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-22T20:20:27.883985] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:20:27.884270] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-22T20:20:27.884336] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-22T20:20:27.885505] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-22T20:20:27.885568] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-22T20:20:28.239759] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:20:28.522042] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-22T20:20:28.657735] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T20:20:28.808794] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T20:20:29.322084] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-22T20:20:30.122074] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-22T20:20:30.515900] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-22T20:20:30.523521] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-22T20:20:30.922059] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-22T20:20:31.722019] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-22T20:20:31.960001] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T20:20:32.059114] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T20:20:32.522078] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-22T20:20:33.322074] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-22T20:20:33.961018] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-22T20:20:34.122036] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-22T20:20:34.518408] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-22T20:20:34.922074] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-22T20:20:35.234681] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-22T20:20:35.722040] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-22T20:20:35.998499] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T20:20:36.010749] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T20:20:36.522136] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-22T20:20:37.322032] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-22T20:20:37.517924] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T20:20:37.635771] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T20:20:37.640145] [INFO ] [REMOTE ] NOAH: Full fetch complete (28859 records). [2025-09-22T20:20:37.640233] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-22T20:20:38.040076] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-22T20:20:38.040166] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-22T20:20:38.040867] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-22T20:20:38.040935] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-22T20:20:38.041885] [DEBUG] [LOCAL ] NOAH: Trimmed 28859 records to 20036 (keeping 200 days of data) [2025-09-22T20:20:38.130471] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-22T20:20:38.171781] [DEBUG] [LOCAL ] NOAH: Primary data saved (20036 records). [2025-09-22T20:20:38.171932] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-22T20:20:38.172021] [INFO ] [MAIN ] Update Progress: 1510/2372 symbols completed. NOAH took 38.7s. Estimated remaining: 1h 54m 30s. Rate: 7.5 symbols/min [2025-09-22T20:20:38.352862] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:20:38.353079] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-22T20:20:38.353118] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-22T20:20:38.353275] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-22T20:20:38.353321] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-22T20:20:38.353362] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-22T20:20:38.353395] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-22T20:20:38.722244] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:20:38.922037] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-22T20:20:39.201882] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T20:20:39.271712] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-22T20:20:39.722135] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-22T20:20:40.127458] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-22T20:20:40.130976] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-22T20:20:40.522181] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-22T20:20:41.322072] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-22T20:20:42.122061] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-22T20:20:42.345441] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T20:20:42.922097] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-22T20:20:43.170688] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T20:20:43.255860] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-22T20:20:43.722143] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-22T20:20:43.966351] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T20:20:44.522152] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-22T20:20:44.953837] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T20:20:45.322044] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-22T20:20:45.543085] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T20:20:46.122079] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-22T20:20:46.573030] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-22T20:20:46.922104] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-22T20:20:47.329911] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-22T20:20:47.445763] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-22T20:20:47.722068] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-22T20:20:48.522075] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-22T20:20:49.322067] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-22T20:20:49.627695] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T20:20:49.745553] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-22T20:20:50.122066] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-22T20:20:50.159603] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T20:20:50.922097] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-22T20:20:51.722035] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-22T20:20:51.862503] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T20:20:51.870728] [INFO ] [REMOTE ] NOG: Full fetch complete (73549 records). [2025-09-22T20:20:51.870869] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-22T20:20:52.282911] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T20:20:52.310089] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-22T20:20:52.310207] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-22T20:20:52.311556] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-22T20:20:52.311674] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-22T20:20:52.313610] [DEBUG] [LOCAL ] NOG: Trimmed 73549 records to 51153 (keeping 200 days of data) [2025-09-22T20:20:52.528541] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-22T20:20:52.576169] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T20:20:52.586184] [INFO ] [REMOTE ] NOC: Full fetch complete (62213 records). [2025-09-22T20:20:52.588409] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-22T20:20:53.077352] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-22T20:20:53.077265] [DEBUG] [LOCAL ] NOG: Primary data saved (51153 records). [2025-09-22T20:20:53.077522] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-22T20:20:53.077669] [INFO ] [MAIN ] Update Progress: 1511/2372 symbols completed. NOG took 34.9s. Estimated remaining: 1h 54m 26s. Rate: 7.5 symbols/min [2025-09-22T20:20:53.077471] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-22T20:20:53.078721] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-22T20:20:53.078925] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-22T20:20:53.185631] [DEBUG] [LOCAL ] NOC: Trimmed 62213 records to 42698 (keeping 200 days of data) [2025-09-22T20:20:53.313855] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:20:53.322537] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-22T20:20:53.520440] [DEBUG] [LOCAL ] NOMD: Loaded 42179 existing records from primary storage. [2025-09-22T20:20:53.521221] [INFO ] [MAIN ] NOMD: Loaded 42179 existing records. [2025-09-22T20:20:53.740357] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:20:53.743139] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-22T20:20:53.747277] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-22T20:20:53.753182] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-22T20:20:53.753282] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-22T20:20:53.855832] [DEBUG] [LOCAL ] NOC: Primary data saved (42698 records). [2025-09-22T20:20:53.866251] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-22T20:20:53.879941] [INFO ] [MAIN ] Update Progress: 1512/2372 symbols completed. NOC took 41.8s. Estimated remaining: 1h 54m 14s. Rate: 7.5 symbols/min [2025-09-22T20:20:53.957817] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T20:20:54.127190] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-22T20:20:54.231036] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:20:54.382537] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:20:54.411529] [DEBUG] [LOCAL ] NOTE: Loaded 43867 existing records from primary storage. [2025-09-22T20:20:54.411709] [INFO ] [MAIN ] NOTE: Loaded 43867 existing records. [2025-09-22T20:20:54.626453] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-22T20:20:54.634540] [INFO ] [REMOTE ] NOM: Full fetch complete (1708 records). [2025-09-22T20:20:54.639546] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:20:54.639816] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-22T20:20:54.659998] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-22T20:20:54.660233] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-22T20:20:54.671193] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-22T20:20:54.676595] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-22T20:20:54.926163] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-22T20:20:55.093997] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-22T20:20:55.108430] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:20:55.119897] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:20:55.131497] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-22T20:20:55.160732] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-22T20:20:55.198524] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-22T20:20:55.210993] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-22T20:20:55.268131] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-22T20:20:55.271032] [INFO ] [MAIN ] Update Progress: 1513/2372 symbols completed. NOM took 17.1s. Estimated remaining: 1h 54m 2s. Rate: 7.5 symbols/min [2025-09-22T20:20:55.438068] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:20:55.537261] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:20:55.602975] [DEBUG] [LOCAL ] NOV: Loaded 53967 existing records from primary storage. [2025-09-22T20:20:55.603213] [INFO ] [MAIN ] NOV: Loaded 53967 existing records. [2025-09-22T20:20:55.727233] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-22T20:20:55.796619] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:20:55.796922] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-22T20:20:55.796972] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-22T20:20:55.798203] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-22T20:20:55.798267] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-22T20:20:56.167544] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:20:56.522059] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-22T20:20:56.618352] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T20:20:57.322116] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-22T20:20:57.702894] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-22T20:20:58.122060] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-22T20:20:58.223362] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T20:20:58.827076] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T20:20:58.922063] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-22T20:20:59.722081] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-22T20:20:59.994301] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T20:21:00.522102] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-22T20:21:01.095278] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T20:21:01.322053] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-22T20:21:01.508550] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-22T20:21:02.122275] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-22T20:21:02.922175] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-22T20:21:03.090995] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-22T20:21:03.722112] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-22T20:21:04.375340] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (3.05 seconds). [2025-09-22T20:21:04.522161] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-22T20:21:05.023705] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-22T20:21:05.061034] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-22T20:21:05.322026] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-22T20:21:05.417540] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T20:21:06.122043] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-22T20:21:06.416335] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-22T20:21:06.922039] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-22T20:21:07.315970] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-22T20:21:07.324851] [INFO ] [REMOTE ] NOK: Full fetch complete (77632 records). [2025-09-22T20:21:07.324979] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-22T20:21:07.730564] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-22T20:21:07.773996] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-22T20:21:07.775011] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-22T20:21:07.776484] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-22T20:21:07.776711] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-22T20:21:07.803945] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T20:21:07.814069] [DEBUG] [LOCAL ] NOK: Trimmed 77632 records to 53621 (keeping 200 days of data) [2025-09-22T20:21:08.163283] [DEBUG] [LOCAL ] NOK: Primary data saved (53621 records). [2025-09-22T20:21:08.163442] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-22T20:21:08.163560] [INFO ] [MAIN ] Update Progress: 1514/2372 symbols completed. NOK took 40.7s. Estimated remaining: 1h 53m 57s. Rate: 7.5 symbols/min [2025-09-22T20:21:08.353717] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:21:08.354063] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-09-22T20:21:08.354122] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-09-22T20:21:08.354284] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-22T20:21:08.354339] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-22T20:21:08.354408] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-22T20:21:08.354444] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-22T20:21:08.545543] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-22T20:21:08.760123] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:21:08.787712] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-22T20:21:09.099359] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T20:21:09.322078] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-22T20:21:10.122079] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-22T20:21:10.354982] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T20:21:10.922115] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-22T20:21:11.448951] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T20:21:11.498038] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-22T20:21:11.722073] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-22T20:21:12.522026] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-22T20:21:12.793408] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T20:21:13.322034] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-22T20:21:13.870486] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-22T20:21:14.122093] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-22T20:21:14.516539] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-22T20:21:14.922099] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-22T20:21:15.555019] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-22T20:21:15.722021] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-22T20:21:16.522031] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-22T20:21:16.753787] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-22T20:21:17.322030] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-22T20:21:17.690923] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-09-22T20:21:18.037761] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-22T20:21:18.099799] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T20:21:18.122071] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-22T20:21:18.712767] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T20:21:18.922076] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-22T20:21:19.715925] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T20:21:19.724601] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-22T20:21:19.947019] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-22T20:21:19.953101] [INFO ] [REMOTE ] NOTE: Full fetch complete (64768 records). [2025-09-22T20:21:19.953280] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-22T20:21:20.375730] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-22T20:21:20.375835] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-22T20:21:20.376947] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-22T20:21:20.377020] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-22T20:21:20.378468] [DEBUG] [LOCAL ] NOTE: Trimmed 64768 records to 43132 (keeping 200 days of data) [2025-09-22T20:21:20.549244] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-22T20:21:20.641556] [DEBUG] [LOCAL ] NOTE: Primary data saved (43132 records). [2025-09-22T20:21:20.641728] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-22T20:21:20.641839] [INFO ] [MAIN ] Update Progress: 1515/2372 symbols completed. NOTE took 26.8s. Estimated remaining: 1h 53m 52s. Rate: 7.5 symbols/min [2025-09-22T20:21:20.814590] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:21:20.814829] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-22T20:21:20.814872] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-22T20:21:20.815083] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-22T20:21:20.815156] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-22T20:21:20.815221] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-22T20:21:20.815256] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-22T20:21:21.173896] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:21:21.322073] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-22T20:21:21.585812] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T20:21:22.122148] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-22T20:21:22.376007] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T20:21:22.856239] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T20:21:22.922075] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-22T20:21:23.722105] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-22T20:21:24.480025] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-22T20:21:24.510599] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T20:21:24.521231] [INFO ] [REMOTE ] NOMD: Full fetch complete (58806 records). [2025-09-22T20:21:24.521398] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-22T20:21:24.527238] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-22T20:21:24.937376] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-22T20:21:24.937470] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-22T20:21:24.938432] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-22T20:21:24.938550] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-22T20:21:24.940063] [DEBUG] [LOCAL ] NOMD: Trimmed 58806 records to 41390 (keeping 200 days of data) [2025-09-22T20:21:25.198460] [DEBUG] [LOCAL ] NOMD: Primary data saved (41390 records). [2025-09-22T20:21:25.198591] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-22T20:21:25.198692] [INFO ] [MAIN ] Update Progress: 1516/2372 symbols completed. NOMD took 32.1s. Estimated remaining: 1h 53m 42s. Rate: 7.5 symbols/min [2025-09-22T20:21:25.340066] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-22T20:21:25.379366] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:21:25.401003] [DEBUG] [LOCAL ] NPCT: Loaded 17187 existing records from primary storage. [2025-09-22T20:21:25.401252] [INFO ] [MAIN ] NPCT: Loaded 17187 existing records. [2025-09-22T20:21:25.585323] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:21:25.586029] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-22T20:21:25.586115] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-22T20:21:25.586892] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-22T20:21:25.586999] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-22T20:21:25.836913] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:21:25.860856] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-22T20:21:25.926079] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-22T20:21:26.017211] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:21:26.122121] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-22T20:21:26.593468] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-22T20:21:26.922094] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-09-22T20:21:27.202453] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:21:27.202866] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-09-22T20:21:27.722077] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-22T20:21:28.027109] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T20:21:28.522039] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-22T20:21:28.571116] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T20:21:29.322064] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-22T20:21:29.389479] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-22T20:21:30.122062] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-22T20:21:30.922035] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-22T20:21:31.087626] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T20:21:31.722063] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-22T20:21:31.826493] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T20:21:31.837466] [INFO ] [REMOTE ] NOV: Full fetch complete (76976 records). [2025-09-22T20:21:31.837708] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-22T20:21:32.016148] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T20:21:32.289388] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-22T20:21:32.289522] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-22T20:21:32.290875] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-22T20:21:32.290946] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-22T20:21:32.292689] [DEBUG] [LOCAL ] NOV: Trimmed 76976 records to 53184 (keeping 200 days of data) [2025-09-22T20:21:32.545970] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-22T20:21:32.676867] [DEBUG] [LOCAL ] NOV: Primary data saved (53184 records). [2025-09-22T20:21:32.677082] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-22T20:21:32.677319] [INFO ] [MAIN ] Update Progress: 1517/2372 symbols completed. NOV took 37.4s. Estimated remaining: 1h 53m 33s. Rate: 7.5 symbols/min [2025-09-22T20:21:33.322050] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-22T20:21:33.487371] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T20:21:34.031584] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-22T20:21:34.122041] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-22T20:21:34.454673] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-22T20:21:34.922089] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-22T20:21:35.722116] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-22T20:21:35.813928] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T20:21:36.334570] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-22T20:21:36.522091] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-22T20:21:36.586797] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T20:21:37.322036] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-22T20:21:37.353092] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T20:21:37.360264] [INFO ] [REMOTE ] NOW: Full fetch complete (70481 records). [2025-09-22T20:21:37.360398] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-22T20:21:37.361718] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:21:37.361808] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:21:37.361876] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:21:37.361965] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-22T20:21:37.362075] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-22T20:21:37.362141] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-09-22T20:21:37.362217] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-09-22T20:21:37.362361] [INFO ] [MAIN ] Update Progress: 1518/2372 symbols completed. NOW took 29.2s. Estimated remaining: 1h 53m 24s. Rate: 7.5 symbols/min [2025-09-22T20:21:38.122023] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-22T20:21:38.148151] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T20:21:38.922083] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-22T20:21:39.218232] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T20:21:39.722077] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-22T20:21:39.919677] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T20:21:40.522054] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-22T20:21:40.831089] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T20:21:41.322031] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-22T20:21:41.534275] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T20:21:42.122038] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-22T20:21:42.437165] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T20:21:42.922071] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-22T20:21:43.093244] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T20:21:43.096610] [INFO ] [REMOTE ] NPB: Full fetch complete (15958 records). [2025-09-22T20:21:43.096792] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-22T20:21:43.302074] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 151 unique days, need 200 days [2025-09-22T20:21:43.302467] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:21:43.302979] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:21:43.303083] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-22T20:21:43.303181] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-22T20:21:43.303249] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-22T20:21:43.303320] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-22T20:21:43.303429] [INFO ] [MAIN ] Update Progress: 1519/2372 symbols completed. NPB took 22.7s. Estimated remaining: 1h 53m 15s. Rate: 7.5 symbols/min [2025-09-22T20:21:43.961457] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T20:21:43.966934] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-22T20:21:44.924808] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T20:21:44.931184] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-22T20:21:45.798797] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T20:21:45.802848] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-22T20:21:46.719771] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T20:21:46.723776] [INFO ] [REMOTE ] NPCT: Full fetch complete (25133 records). [2025-09-22T20:21:46.723971] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-22T20:21:47.120890] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-22T20:21:47.120997] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-22T20:21:47.121598] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-22T20:21:47.121700] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-22T20:21:47.122424] [DEBUG] [LOCAL ] NPCT: Trimmed 25133 records to 16799 (keeping 200 days of data) [2025-09-22T20:21:47.234311] [DEBUG] [LOCAL ] NPCT: Primary data saved (16799 records). [2025-09-22T20:21:47.234459] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-22T20:21:47.234659] [INFO ] [MAIN ] Update Progress: 1520/2372 symbols completed. NPCT took 22.0s. Estimated remaining: 1h 53m 4s. Rate: 7.5 symbols/min [2025-09-22T20:21:47.848695] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:21:47.897055] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:21:47.964952] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-22T20:21:47.969173] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-22T20:21:47.994079] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-22T20:21:47.993972] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:21:47.997157] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-22T20:21:48.016558] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:21:48.017101] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-22T20:21:48.017381] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-22T20:21:48.123787] [DEBUG] [LOCAL ] NPFD: Loaded 9943 existing records from primary storage. [2025-09-22T20:21:48.130694] [INFO ] [MAIN ] NPFD: Loaded 9943 existing records. [2025-09-22T20:21:48.152573] [DEBUG] [LOCAL ] NPK: Loaded 8278 existing records from primary storage. [2025-09-22T20:21:48.168789] [INFO ] [MAIN ] NPK: Loaded 8278 existing records. [2025-09-22T20:21:48.218983] [DEBUG] [LOCAL ] NPO: Loaded 13074 existing records from primary storage. [2025-09-22T20:21:48.362954] [INFO ] [MAIN ] NPO: Loaded 13074 existing records. [2025-09-22T20:21:48.778087] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:21:48.846919] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-22T20:21:48.847229] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-22T20:21:48.847120] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:21:48.861378] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-22T20:21:48.867398] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-22T20:21:48.873037] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-22T20:21:48.935873] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-22T20:21:49.033258] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-22T20:21:49.033455] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-22T20:21:49.020016] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:21:49.136285] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:21:49.182276] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-22T20:21:49.182208] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-22T20:21:49.229714] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-22T20:21:49.298436] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-22T20:21:49.379262] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-22T20:21:49.834938] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:21:49.930758] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-22T20:21:49.986563] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:21:50.017461] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-22T20:21:50.111801] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T20:21:50.131073] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-22T20:21:50.198486] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:21:50.198844] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-22T20:21:50.953724] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T20:21:50.958107] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-22T20:21:51.038921] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T20:21:51.042738] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-22T20:21:51.116638] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T20:21:51.198971] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T20:21:51.670467] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-22T20:21:51.697585] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T20:21:51.722059] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-22T20:21:52.522052] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-22T20:21:52.579801] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T20:21:53.322172] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-22T20:21:53.334547] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T20:21:54.081092] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T20:21:54.122095] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-22T20:21:54.922175] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-22T20:21:55.010334] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T20:21:55.701022] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T20:21:55.722065] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-22T20:21:56.522107] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-22T20:21:56.587460] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T20:21:57.322096] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-22T20:21:57.375382] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-22T20:21:58.122072] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-22T20:21:58.301842] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-22T20:21:58.911993] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T20:21:58.922019] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-22T20:21:59.722066] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-22T20:21:59.817530] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T20:22:00.522114] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-22T20:22:00.700231] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T20:22:01.322079] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-22T20:22:01.397832] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T20:22:02.122116] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-22T20:22:02.543185] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T20:22:02.915479] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T20:22:02.922003] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-22T20:22:03.722064] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-22T20:22:03.825130] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-22T20:22:04.522055] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-22T20:22:04.720979] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T20:22:05.322076] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-22T20:22:05.369224] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T20:22:06.122105] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-22T20:22:06.131725] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-22T20:22:06.922112] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-22T20:22:07.226573] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T20:22:07.591737] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-22T20:22:07.593256] [INFO ] [REMOTE ] NPK: Full fetch complete (10953 records). [2025-09-22T20:22:07.593345] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-22T20:22:07.734175] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-22T20:22:07.962336] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-22T20:22:07.962411] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-22T20:22:07.962687] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-22T20:22:07.962759] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-22T20:22:07.963221] [DEBUG] [LOCAL ] NPK: Trimmed 10953 records to 8089 (keeping 200 days of data) [2025-09-22T20:22:08.012893] [DEBUG] [LOCAL ] NPK: Primary data saved (8089 records). [2025-09-22T20:22:08.012997] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-22T20:22:08.013076] [INFO ] [MAIN ] Update Progress: 1521/2372 symbols completed. NPK took 20.8s. Estimated remaining: 1h 53m 3s. Rate: 7.5 symbols/min [2025-09-22T20:22:08.185676] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:22:08.198168] [DEBUG] [LOCAL ] NPV: Loaded 5021 existing records from primary storage. [2025-09-22T20:22:08.198270] [INFO ] [MAIN ] NPV: Loaded 5021 existing records. [2025-09-22T20:22:08.375549] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:22:08.375869] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-22T20:22:08.375925] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-22T20:22:08.376343] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-22T20:22:08.376402] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-22T20:22:08.527171] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-22T20:22:08.742330] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:22:09.150048] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T20:22:09.322047] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-22T20:22:09.526129] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T20:22:10.119413] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-22T20:22:10.121936] [INFO ] [REMOTE ] NPFD: Full fetch complete (14807 records). [2025-09-22T20:22:10.122163] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-22T20:22:10.122025] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-22T20:22:10.528824] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-22T20:22:10.528995] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-22T20:22:10.529408] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-22T20:22:10.529451] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-22T20:22:10.530123] [DEBUG] [LOCAL ] NPFD: Trimmed 14807 records to 9764 (keeping 200 days of data) [2025-09-22T20:22:10.595714] [DEBUG] [LOCAL ] NPFD: Primary data saved (9764 records). [2025-09-22T20:22:10.595873] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-22T20:22:10.596032] [INFO ] [MAIN ] Update Progress: 1522/2372 symbols completed. NPFD took 23.4s. Estimated remaining: 1h 52m 53s. Rate: 7.5 symbols/min [2025-09-22T20:22:10.768478] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:22:10.825344] [DEBUG] [LOCAL ] NPWR: Loaded 43617 existing records from primary storage. [2025-09-22T20:22:10.825500] [INFO ] [MAIN ] NPWR: Loaded 43617 existing records. [2025-09-22T20:22:10.925936] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-22T20:22:11.024843] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T20:22:11.047188] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:22:11.047895] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-22T20:22:11.047989] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-22T20:22:11.049747] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-22T20:22:11.049844] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-22T20:22:11.527441] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:22:11.722059] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-22T20:22:11.918469] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T20:22:12.445078] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T20:22:12.522097] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-22T20:22:13.198612] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-22T20:22:13.322056] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-22T20:22:14.122063] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-22T20:22:14.773761] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T20:22:14.922028] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-22T20:22:15.089213] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-22T20:22:15.722058] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-22T20:22:16.421331] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T20:22:16.522065] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-22T20:22:16.620501] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T20:22:16.622792] [INFO ] [REMOTE ] NPO: Full fetch complete (18131 records). [2025-09-22T20:22:16.622880] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-22T20:22:16.993536] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-22T20:22:16.993887] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-22T20:22:16.994549] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-22T20:22:16.994600] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-22T20:22:16.995279] [DEBUG] [LOCAL ] NPO: Trimmed 18131 records to 12809 (keeping 200 days of data) [2025-09-22T20:22:17.089209] [DEBUG] [LOCAL ] NPO: Primary data saved (12809 records). [2025-09-22T20:22:17.089369] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-22T20:22:17.089462] [INFO ] [MAIN ] Update Progress: 1523/2372 symbols completed. NPO took 29.8s. Estimated remaining: 1h 52m 44s. Rate: 7.5 symbols/min [2025-09-22T20:22:17.265620] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:22:17.277408] [DEBUG] [LOCAL ] NQP: Loaded 9289 existing records from primary storage. [2025-09-22T20:22:17.277526] [INFO ] [MAIN ] NQP: Loaded 9289 existing records. [2025-09-22T20:22:17.332344] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-22T20:22:17.461841] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:22:17.462123] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-22T20:22:17.462171] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-22T20:22:17.462853] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-22T20:22:17.462915] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-22T20:22:17.823494] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:22:18.107134] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T20:22:18.122073] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-22T20:22:18.907439] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T20:22:18.922107] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-22T20:22:19.693184] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T20:22:19.722018] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-22T20:22:19.853683] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T20:22:20.522320] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-22T20:22:21.295690] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-22T20:22:21.324902] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-22T20:22:21.330208] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T20:22:21.967298] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-22T20:22:22.122065] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-22T20:22:22.922081] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-22T20:22:23.716835] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T20:22:23.727099] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-22T20:22:23.759182] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T20:22:24.457188] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T20:22:24.522076] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-22T20:22:25.322032] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-22T20:22:25.370341] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-22T20:22:25.975913] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T20:22:26.122047] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-22T20:22:26.858279] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-22T20:22:26.922057] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-22T20:22:27.722065] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-22T20:22:28.306098] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-22T20:22:28.466285] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T20:22:28.522024] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-22T20:22:29.322048] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-22T20:22:29.914467] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T20:22:30.072773] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T20:22:30.122068] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-22T20:22:30.922087] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-22T20:22:31.722044] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-22T20:22:31.833386] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T20:22:32.316560] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T20:22:32.322570] [INFO ] [REMOTE ] NPKI: Full fetch complete (52562 records). [2025-09-22T20:22:32.322741] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-22T20:22:32.501301] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-22T20:22:32.522284] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-22T20:22:32.523880] [INFO ] [REMOTE ] NPV: Full fetch complete (6751 records). [2025-09-22T20:22:32.542916] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-22T20:22:32.543941] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:22:32.544085] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:22:32.544216] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-22T20:22:32.544303] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-22T20:22:32.544414] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-22T20:22:32.581006] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-22T20:22:32.645337] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-22T20:22:32.656935] [INFO ] [MAIN ] Update Progress: 1524/2372 symbols completed. NPKI took 45.4s. Estimated remaining: 1h 52m 40s. Rate: 7.5 symbols/min [2025-09-22T20:22:33.090588] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:22:33.134890] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-22T20:22:33.134971] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-22T20:22:33.135190] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-22T20:22:33.135248] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-22T20:22:33.135702] [DEBUG] [LOCAL ] NPV: Trimmed 6751 records to 4937 (keeping 200 days of data) [2025-09-22T20:22:33.167608] [DEBUG] [LOCAL ] NPV: Primary data saved (4937 records). [2025-09-22T20:22:33.167801] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-22T20:22:33.167922] [INFO ] [MAIN ] Update Progress: 1525/2372 symbols completed. NPV took 25.2s. Estimated remaining: 1h 52m 28s. Rate: 7.5 symbols/min [2025-09-22T20:22:33.341087] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-22T20:22:33.378074] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:22:33.380130] [DEBUG] [LOCAL ] NRDY: Loaded 33746 existing records from primary storage. [2025-09-22T20:22:33.382781] [INFO ] [MAIN ] NRDY: Loaded 33746 existing records. [2025-09-22T20:22:33.502277] [DEBUG] [LOCAL ] NREF: Loaded 7913 existing records from primary storage. [2025-09-22T20:22:33.513141] [INFO ] [MAIN ] NREF: Loaded 7913 existing records. [2025-09-22T20:22:33.658212] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:22:33.701125] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T20:22:33.717838] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-22T20:22:33.723553] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-22T20:22:33.725866] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-22T20:22:33.725935] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-22T20:22:33.943333] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:22:33.989388] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-22T20:22:33.991246] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-22T20:22:34.009143] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-22T20:22:34.009277] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-22T20:22:34.152084] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-22T20:22:34.373153] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:22:34.583433] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:22:34.924497] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-22T20:22:34.927559] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T20:22:35.073829] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-22T20:22:35.594998] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T20:22:35.722046] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-22T20:22:36.522059] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-22T20:22:37.208242] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T20:22:37.322044] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-22T20:22:38.122079] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-22T20:22:38.406985] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-22T20:22:38.870176] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T20:22:38.922042] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-22T20:22:39.019639] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T20:22:39.722080] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-22T20:22:40.318774] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T20:22:40.522068] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-22T20:22:41.097596] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-22T20:22:41.219475] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T20:22:41.322035] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-22T20:22:42.122049] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-22T20:22:42.209679] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T20:22:42.922063] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-22T20:22:43.618000] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T20:22:43.722078] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-22T20:22:44.473196] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T20:22:44.522079] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-22T20:22:45.125788] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T20:22:45.132240] [INFO ] [REMOTE ] NPWR: Full fetch complete (58892 records). [2025-09-22T20:22:45.132381] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-22T20:22:45.325300] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-22T20:22:45.590515] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-22T20:22:45.590616] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-22T20:22:45.591764] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-22T20:22:45.591852] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-22T20:22:45.593687] [DEBUG] [LOCAL ] NPWR: Trimmed 58892 records to 43055 (keeping 200 days of data) [2025-09-22T20:22:45.874269] [DEBUG] [LOCAL ] NPWR: Primary data saved (43055 records). [2025-09-22T20:22:45.874430] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-22T20:22:45.874529] [INFO ] [MAIN ] Update Progress: 1526/2372 symbols completed. NPWR took 35.3s. Estimated remaining: 1h 52m 23s. Rate: 7.5 symbols/min [2025-09-22T20:22:46.065473] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:22:46.065787] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-09-22T20:22:46.065859] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-09-22T20:22:46.066237] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-22T20:22:46.066331] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-22T20:22:46.066474] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-22T20:22:46.066585] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-22T20:22:46.129796] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-22T20:22:46.285754] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T20:22:46.406016] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T20:22:46.492962] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:22:46.922077] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-22T20:22:47.057352] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T20:22:47.722085] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-22T20:22:48.522063] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-22T20:22:48.808488] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T20:22:49.152955] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T20:22:49.175612] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-22T20:22:49.322066] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-22T20:22:50.114409] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T20:22:50.122006] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-22T20:22:50.826414] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T20:22:50.922078] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-22T20:22:51.722176] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-22T20:22:52.522118] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-22T20:22:52.566030] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T20:22:53.322076] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-22T20:22:53.789231] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T20:22:54.122106] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-22T20:22:54.922123] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-22T20:23:05.900480] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (12.58 seconds). [2025-09-22T20:23:05.902551] [INFO ] [REMOTE ] NQP: Full fetch complete (13476 records). [2025-09-22T20:23:05.902620] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-22T20:23:06.280462] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-22T20:23:06.280748] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-22T20:23:06.281287] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-22T20:23:06.288573] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-22T20:23:06.303395] [DEBUG] [LOCAL ] NQP: Trimmed 13476 records to 9278 (keeping 200 days of data) [2025-09-22T20:23:06.304926] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (12.18 seconds). [2025-09-22T20:23:06.337905] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-22T20:23:06.377139] [DEBUG] [LOCAL ] NQP: Primary data saved (9278 records). [2025-09-22T20:23:06.377298] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-22T20:23:06.377408] [INFO ] [MAIN ] Update Progress: 1527/2372 symbols completed. NQP took 49.3s. Estimated remaining: 1h 52m 21s. Rate: 7.5 symbols/min [2025-09-22T20:23:06.570205] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:23:06.623736] [DEBUG] [LOCAL ] NRGV: Loaded 43456 existing records from primary storage. [2025-09-22T20:23:06.623883] [INFO ] [MAIN ] NRGV: Loaded 43456 existing records. [2025-09-22T20:23:06.844524] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:23:06.845018] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-22T20:23:06.845266] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-22T20:23:06.856789] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-22T20:23:06.878402] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-22T20:23:06.953566] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (16.03 seconds). [2025-09-22T20:23:07.003617] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-22T20:23:07.276803] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:23:07.277313] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-22T20:23:07.426474] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (12.50 seconds). [2025-09-22T20:23:07.429046] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-22T20:23:07.985123] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-22T20:23:07.987405] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-22T20:23:08.610736] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T20:23:08.624474] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-22T20:23:08.983354] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T20:23:08.993371] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-22T20:23:09.097552] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T20:23:09.100024] [INFO ] [REMOTE ] NREF: Full fetch complete (10845 records). [2025-09-22T20:23:09.100126] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-22T20:23:09.475254] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-22T20:23:09.475351] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-22T20:23:09.475719] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-22T20:23:09.475781] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-22T20:23:09.476273] [DEBUG] [LOCAL ] NREF: Trimmed 10845 records to 7823 (keeping 200 days of data) [2025-09-22T20:23:09.526474] [DEBUG] [LOCAL ] NREF: Primary data saved (7823 records). [2025-09-22T20:23:09.526619] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-22T20:23:09.526742] [INFO ] [MAIN ] Update Progress: 1528/2372 symbols completed. NREF took 36.4s. Estimated remaining: 1h 52m 11s. Rate: 7.5 symbols/min [2025-09-22T20:23:09.705352] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:23:09.728088] [DEBUG] [LOCAL ] NRK: Loaded 19774 existing records from primary storage. [2025-09-22T20:23:09.728332] [INFO ] [MAIN ] NRK: Loaded 19774 existing records. [2025-09-22T20:23:09.883131] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (3.55 seconds). [2025-09-22T20:23:09.952555] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-22T20:23:09.952096] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:23:09.954237] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-22T20:23:09.954360] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-22T20:23:09.954984] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-22T20:23:09.955384] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-22T20:23:10.325627] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:23:10.326479] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-22T20:23:10.354735] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T20:23:10.364111] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-22T20:23:10.650093] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-22T20:23:10.661390] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-22T20:23:11.104171] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T20:23:11.111577] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-22T20:23:11.672530] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T20:23:11.677487] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-22T20:23:11.900445] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T20:23:11.908242] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-22T20:23:12.105164] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-22T20:23:12.113896] [INFO ] [REMOTE ] NRDY: Full fetch complete (52524 records). [2025-09-22T20:23:12.114174] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-22T20:23:12.535361] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-22T20:23:12.536856] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-22T20:23:12.537815] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-22T20:23:12.537965] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-22T20:23:12.539631] [DEBUG] [LOCAL ] NRDY: Trimmed 52524 records to 33052 (keeping 200 days of data) [2025-09-22T20:23:12.572660] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T20:23:12.664473] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-22T20:23:12.704365] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-22T20:23:12.710783] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-22T20:23:12.798399] [DEBUG] [LOCAL ] NRDY: Primary data saved (33052 records). [2025-09-22T20:23:12.798574] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-22T20:23:12.798700] [INFO ] [MAIN ] Update Progress: 1529/2372 symbols completed. NRDY took 40.1s. Estimated remaining: 1h 52m 0s. Rate: 7.5 symbols/min [2025-09-22T20:23:12.994507] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:23:13.000252] [DEBUG] [LOCAL ] NRP: Loaded 4219 existing records from primary storage. [2025-09-22T20:23:13.000340] [INFO ] [MAIN ] NRP: Loaded 4219 existing records. [2025-09-22T20:23:13.198925] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:23:13.199201] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-22T20:23:13.199251] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-22T20:23:13.199576] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-22T20:23:13.199638] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-22T20:23:13.535911] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T20:23:13.597514] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:23:13.591233] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-22T20:23:13.598011] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-22T20:23:13.631615] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T20:23:13.642401] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-22T20:23:14.363438] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T20:23:14.365449] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-22T20:23:14.490507] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T20:23:14.502251] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-22T20:23:14.698203] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T20:23:14.701966] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-22T20:23:14.843401] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T20:23:14.845124] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-22T20:23:15.053223] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T20:23:15.063040] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-22T20:23:15.550449] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T20:23:15.552097] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-22T20:23:15.778335] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T20:23:15.782904] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-22T20:23:16.248779] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-22T20:23:16.348917] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-22T20:23:16.522018] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-22T20:23:16.661512] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T20:23:16.751006] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T20:23:17.322064] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-22T20:23:18.122066] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-22T20:23:18.143958] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T20:23:18.359903] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T20:23:18.922061] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-22T20:23:19.465294] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T20:23:19.722114] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-22T20:23:20.065018] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T20:23:20.414759] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T20:23:20.522129] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-22T20:23:21.322099] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-22T20:23:22.122105] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-22T20:23:22.203920] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T20:23:22.437607] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T20:23:22.922109] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-22T20:23:23.677366] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T20:23:23.722042] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-22T20:23:24.089841] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-22T20:23:24.383520] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T20:23:24.522061] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-22T20:23:25.160171] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T20:23:25.322077] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-22T20:23:26.122102] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-22T20:23:26.700601] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T20:23:26.922032] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-22T20:23:27.029016] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T20:23:27.722050] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-22T20:23:27.823742] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T20:23:27.831525] [INFO ] [REMOTE ] NRG: Full fetch complete (76162 records). [2025-09-22T20:23:27.831698] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-22T20:23:27.833127] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:23:27.833226] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:23:27.833270] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:23:27.833309] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-22T20:23:27.833373] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-22T20:23:27.833450] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-22T20:23:27.833513] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-09-22T20:23:27.833596] [INFO ] [MAIN ] Update Progress: 1530/2372 symbols completed. NRG took 42.0s. Estimated remaining: 1h 51m 56s. Rate: 7.5 symbols/min [2025-09-22T20:23:28.006620] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:23:28.013682] [DEBUG] [LOCAL ] NRT: Loaded 4976 existing records from primary storage. [2025-09-22T20:23:28.013797] [INFO ] [MAIN ] NRT: Loaded 4976 existing records. [2025-09-22T20:23:28.190801] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:23:28.191069] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-22T20:23:28.191119] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-22T20:23:28.191452] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-22T20:23:28.191511] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-22T20:23:28.531240] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-22T20:23:28.607506] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:23:29.322069] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-22T20:23:29.401630] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T20:23:29.409781] [INFO ] [REMOTE ] NRGV: Full fetch complete (61724 records). [2025-09-22T20:23:29.409977] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-22T20:23:29.792534] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-22T20:23:29.792620] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-22T20:23:29.793696] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-22T20:23:29.793762] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-22T20:23:29.795185] [DEBUG] [LOCAL ] NRGV: Trimmed 61724 records to 42806 (keeping 200 days of data) [2025-09-22T20:23:30.011163] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-22T20:23:30.029250] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T20:23:30.036464] [INFO ] [REMOTE ] NRK: Full fetch complete (27760 records). [2025-09-22T20:23:30.037145] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-22T20:23:30.127165] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-22T20:23:30.434677] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-22T20:23:30.435009] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-22T20:23:30.437322] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-22T20:23:30.437735] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-22T20:23:30.450218] [DEBUG] [LOCAL ] NRK: Trimmed 27760 records to 19581 (keeping 200 days of data) [2025-09-22T20:23:30.461202] [DEBUG] [LOCAL ] NRGV: Primary data saved (42806 records). [2025-09-22T20:23:30.461308] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-22T20:23:30.461401] [INFO ] [MAIN ] Update Progress: 1531/2372 symbols completed. NRGV took 24.1s. Estimated remaining: 1h 51m 45s. Rate: 7.5 symbols/min [2025-09-22T20:23:30.732832] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:23:30.743683] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T20:23:30.746180] [INFO ] [REMOTE ] NRP: Full fetch complete (6538 records). [2025-09-22T20:23:30.747008] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-22T20:23:30.772028] [DEBUG] [LOCAL ] NRUC: Loaded 3191 existing records from primary storage. [2025-09-22T20:23:30.787587] [INFO ] [MAIN ] NRUC: Loaded 3191 existing records. [2025-09-22T20:23:30.928458] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-22T20:23:31.147490] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:23:31.159275] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-22T20:23:31.159738] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-22T20:23:31.181131] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-22T20:23:31.181484] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-22T20:23:31.516846] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-22T20:23:31.531011] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-22T20:23:31.540822] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-22T20:23:31.541512] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-22T20:23:31.588120] [DEBUG] [LOCAL ] NRP: Trimmed 6538 records to 4088 (keeping 200 days of data) [2025-09-22T20:23:31.734367] [DEBUG] [LOCAL ] NRK: Primary data saved (19581 records). [2025-09-22T20:23:31.745026] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-22T20:23:31.745512] [INFO ] [MAIN ] Update Progress: 1532/2372 symbols completed. NRK took 22.2s. Estimated remaining: 1h 51m 34s. Rate: 7.5 symbols/min [2025-09-22T20:23:31.830899] [DEBUG] [LOCAL ] NRP: Primary data saved (4088 records). [2025-09-22T20:23:31.878936] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:23:31.889578] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-22T20:23:31.918813] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-22T20:23:31.910886] [INFO ] [MAIN ] Update Progress: 1533/2372 symbols completed. NRP took 19.1s. Estimated remaining: 1h 51m 21s. Rate: 7.5 symbols/min [2025-09-22T20:23:31.936276] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T20:23:32.124083] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:23:32.202510] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:23:32.202749] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-09-22T20:23:32.202805] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-22T20:23:32.202952] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-22T20:23:32.202996] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-22T20:23:32.203039] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-22T20:23:32.203896] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-22T20:23:32.509105] [DEBUG] [LOCAL ] NSA: Loaded 45492 existing records from primary storage. [2025-09-22T20:23:32.527159] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-22T20:23:32.520728] [INFO ] [MAIN ] NSA: Loaded 45492 existing records. [2025-09-22T20:23:32.780509] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:23:32.844528] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:23:32.850227] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T20:23:32.850335] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-22T20:23:32.850490] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-22T20:23:32.853767] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-22T20:23:32.853832] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-22T20:23:33.226847] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:23:33.315442] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T20:23:33.321999] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-22T20:23:34.122094] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-22T20:23:34.826164] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T20:23:34.922042] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-22T20:23:35.099011] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T20:23:35.566939] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T20:23:35.722055] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-22T20:23:36.331677] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T20:23:36.522077] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-22T20:23:37.204130] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-22T20:23:37.322058] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-22T20:23:38.024149] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T20:23:38.122048] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-22T20:23:38.922052] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-22T20:23:39.563817] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T20:23:39.722108] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-22T20:23:39.783036] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T20:23:40.242245] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-22T20:23:40.522088] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-22T20:23:41.322064] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-22T20:23:41.953668] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T20:23:42.034963] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T20:23:42.122060] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-22T20:23:42.922055] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-22T20:23:43.490348] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T20:23:43.722040] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-22T20:23:43.802252] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T20:23:44.522101] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-22T20:23:44.559035] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T20:23:45.322113] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-22T20:23:45.922464] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T20:23:45.999224] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T20:23:46.122089] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-22T20:23:46.922054] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-22T20:23:46.930736] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-22T20:23:47.722090] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-22T20:23:48.404120] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T20:23:48.522062] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-22T20:23:48.716004] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T20:23:49.322079] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-22T20:23:50.122062] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-22T20:23:50.204709] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T20:23:50.571452] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T20:23:50.572557] [INFO ] [REMOTE ] NRUC: Full fetch complete (5557 records). [2025-09-22T20:23:50.572628] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-22T20:23:50.924472] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-22T20:23:50.972377] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-22T20:23:50.972511] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-22T20:23:50.972753] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-22T20:23:50.972865] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-22T20:23:50.973704] [DEBUG] [LOCAL ] NRUC: Trimmed 5557 records to 3101 (keeping 200 days of data) [2025-09-22T20:23:50.994738] [DEBUG] [LOCAL ] NRUC: Primary data saved (3101 records). [2025-09-22T20:23:50.994877] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-22T20:23:50.995083] [INFO ] [MAIN ] Update Progress: 1534/2372 symbols completed. NRUC took 20.5s. Estimated remaining: 1h 51m 20s. Rate: 7.5 symbols/min [2025-09-22T20:23:51.171369] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T20:23:51.217990] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:23:51.254302] [DEBUG] [LOCAL ] NSP: Loaded 35435 existing records from primary storage. [2025-09-22T20:23:51.254465] [INFO ] [MAIN ] NSP: Loaded 35435 existing records. [2025-09-22T20:23:51.434583] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:23:51.434841] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-22T20:23:51.434890] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-22T20:23:51.436156] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-22T20:23:51.436219] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-22T20:23:51.727173] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-22T20:23:51.802187] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:23:51.855872] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T20:23:52.522085] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-22T20:23:53.322084] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-22T20:23:53.778497] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-22T20:23:53.843191] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T20:23:54.122151] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-22T20:23:54.691766] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T20:23:54.693795] [INFO ] [REMOTE ] NRT: Full fetch complete (8068 records). [2025-09-22T20:23:54.693919] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-22T20:23:54.926092] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-22T20:23:55.170284] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-22T20:23:55.170397] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-22T20:23:55.170845] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-22T20:23:55.171334] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-22T20:23:55.172450] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T20:23:55.182115] [DEBUG] [LOCAL ] NRT: Trimmed 8068 records to 4853 (keeping 200 days of data) [2025-09-22T20:23:55.210892] [DEBUG] [LOCAL ] NRT: Primary data saved (4853 records). [2025-09-22T20:23:55.211007] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-22T20:23:55.211113] [INFO ] [MAIN ] Update Progress: 1535/2372 symbols completed. NRT took 27.4s. Estimated remaining: 1h 51m 9s. Rate: 7.5 symbols/min [2025-09-22T20:23:55.399132] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:23:55.426609] [DEBUG] [LOCAL ] NTB: Loaded 21194 existing records from primary storage. [2025-09-22T20:23:55.426860] [INFO ] [MAIN ] NTB: Loaded 21194 existing records. [2025-09-22T20:23:55.611752] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:23:55.612008] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-22T20:23:55.612056] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-22T20:23:55.612760] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-22T20:23:55.612820] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-22T20:23:55.727159] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-22T20:23:55.995259] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:23:56.378443] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T20:23:56.522030] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-22T20:23:57.322048] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-22T20:23:57.411665] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T20:23:57.953267] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T20:23:58.122071] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-22T20:23:58.184777] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T20:23:58.922076] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-22T20:23:59.722080] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-22T20:24:00.229235] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-22T20:24:00.443405] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T20:24:00.522129] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-22T20:24:01.322065] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-22T20:24:02.122075] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-22T20:24:02.179137] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-22T20:24:02.324449] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T20:24:02.922060] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-22T20:24:03.722079] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-22T20:24:04.982944] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-22T20:24:04.993786] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-22T20:24:05.039394] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (3.72 seconds). [2025-09-22T20:24:05.041209] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-22T20:24:05.322080] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-22T20:24:06.122102] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-22T20:24:06.420947] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-22T20:24:06.919357] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T20:24:06.928583] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-22T20:24:07.380350] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T20:24:07.674984] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-22T20:24:07.722077] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-22T20:24:08.452576] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T20:24:08.522060] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-22T20:24:09.303251] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T20:24:09.310720] [INFO ] [REMOTE ] NSA: Full fetch complete (61656 records). [2025-09-22T20:24:09.310830] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-22T20:24:09.332499] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-22T20:24:09.698749] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-22T20:24:09.698834] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-22T20:24:09.699748] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-22T20:24:09.699871] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-22T20:24:09.701132] [DEBUG] [LOCAL ] NSA: Trimmed 61656 records to 44842 (keeping 200 days of data) [2025-09-22T20:24:09.983700] [DEBUG] [LOCAL ] NSA: Primary data saved (44842 records). [2025-09-22T20:24:09.983831] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-22T20:24:09.983917] [INFO ] [MAIN ] Update Progress: 1536/2372 symbols completed. NSA took 38.2s. Estimated remaining: 1h 51m 5s. Rate: 7.5 symbols/min [2025-09-22T20:24:10.134285] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-22T20:24:10.161944] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:24:10.162238] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-22T20:24:10.177889] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-22T20:24:10.190616] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-22T20:24:10.192240] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T20:24:10.191293] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-22T20:24:10.203554] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-22T20:24:10.204453] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-22T20:24:10.561351] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:24:10.603598] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T20:24:10.922021] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-22T20:24:11.354860] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T20:24:11.722094] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-22T20:24:12.034671] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T20:24:12.261624] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-22T20:24:12.522081] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-22T20:24:13.322092] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-22T20:24:14.122034] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-22T20:24:14.476699] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T20:24:14.878116] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T20:24:14.922031] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-22T20:24:15.236397] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T20:24:15.661403] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T20:24:15.722092] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-22T20:24:16.522041] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-22T20:24:16.850199] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T20:24:17.294822] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T20:24:17.304225] [INFO ] [REMOTE ] NSC: Full fetch complete (70525 records). [2025-09-22T20:24:17.304389] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-22T20:24:17.305298] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:24:17.305394] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:24:17.305440] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:24:17.305515] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-22T20:24:17.305669] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-22T20:24:17.305728] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-22T20:24:17.305797] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-09-22T20:24:17.305882] [INFO ] [MAIN ] Update Progress: 1537/2372 symbols completed. NSC took 45.4s. Estimated remaining: 1h 50m 57s. Rate: 7.5 symbols/min [2025-09-22T20:24:17.327142] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-22T20:24:17.493131] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:24:17.553190] [DEBUG] [LOCAL ] NTR: Loaded 53385 existing records from primary storage. [2025-09-22T20:24:17.553378] [INFO ] [MAIN ] NTR: Loaded 53385 existing records. [2025-09-22T20:24:17.750730] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:24:17.751026] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-22T20:24:17.751076] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-22T20:24:17.752591] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-22T20:24:17.752679] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-22T20:24:18.066118] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T20:24:18.123427] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-22T20:24:18.162543] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:24:18.922098] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-22T20:24:19.184198] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T20:24:19.190763] [INFO ] [REMOTE ] NSP: Full fetch complete (49358 records). [2025-09-22T20:24:19.190868] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-22T20:24:19.458587] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-22T20:24:19.573085] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-22T20:24:19.573165] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-22T20:24:19.574024] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-22T20:24:19.574086] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-22T20:24:19.575330] [DEBUG] [LOCAL ] NSP: Trimmed 49358 records to 34883 (keeping 200 days of data) [2025-09-22T20:24:19.750958] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-22T20:24:19.810312] [DEBUG] [LOCAL ] NSP: Primary data saved (34883 records). [2025-09-22T20:24:19.810474] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-22T20:24:19.810566] [INFO ] [MAIN ] Update Progress: 1538/2372 symbols completed. NSP took 28.8s. Estimated remaining: 1h 50m 46s. Rate: 7.5 symbols/min [2025-09-22T20:24:20.012900] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:24:20.061308] [DEBUG] [LOCAL ] NTST: Loaded 44080 existing records from primary storage. [2025-09-22T20:24:20.061487] [INFO ] [MAIN ] NTST: Loaded 44080 existing records. [2025-09-22T20:24:20.238820] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:24:20.239113] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-22T20:24:20.239178] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-22T20:24:20.240678] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-22T20:24:20.240742] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-22T20:24:20.322738] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-22T20:24:20.527296] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-22T20:24:20.619911] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:24:21.322064] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-22T20:24:21.658177] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-22T20:24:22.122141] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-22T20:24:22.792603] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T20:24:22.922007] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-22T20:24:23.080627] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T20:24:23.722105] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-22T20:24:24.466562] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T20:24:24.522004] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-22T20:24:24.750853] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-22T20:24:24.754448] [INFO ] [REMOTE ] NTB: Full fetch complete (30886 records). [2025-09-22T20:24:24.754576] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-22T20:24:25.218793] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-22T20:24:25.218872] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-22T20:24:25.219505] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-22T20:24:25.219545] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-22T20:24:25.220338] [DEBUG] [LOCAL ] NTB: Trimmed 30886 records to 20720 (keeping 200 days of data) [2025-09-22T20:24:25.322144] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-22T20:24:25.368027] [DEBUG] [LOCAL ] NTB: Primary data saved (20720 records). [2025-09-22T20:24:25.368160] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-22T20:24:25.368285] [INFO ] [MAIN ] Update Progress: 1539/2372 symbols completed. NTB took 30.2s. Estimated remaining: 1h 50m 37s. Rate: 7.5 symbols/min [2025-09-22T20:24:25.548626] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:24:25.622036] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-22T20:24:25.622347] [INFO ] [MAIN ] NU: Loaded 54526 existing records. [2025-09-22T20:24:25.828622] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:24:25.838972] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-22T20:24:25.852775] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-22T20:24:25.858147] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T20:24:25.858224] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-22T20:24:25.866416] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-22T20:24:25.961253] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T20:24:26.127250] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-22T20:24:26.274794] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:24:26.922058] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-22T20:24:27.585071] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T20:24:27.703748] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T20:24:27.722104] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-22T20:24:28.522083] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-22T20:24:29.322057] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-22T20:24:29.828558] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T20:24:30.122052] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-22T20:24:30.922034] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-22T20:24:31.403999] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (3.68 seconds). [2025-09-22T20:24:31.660797] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T20:24:31.661600] [INFO ] [REMOTE ] NTEST: Full fetch complete (1987 records). [2025-09-22T20:24:31.661728] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-22T20:24:31.731167] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-22T20:24:31.876627] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-22T20:24:31.876856] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:24:31.876927] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:24:31.877001] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-22T20:24:31.877082] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-22T20:24:31.877151] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-22T20:24:31.877219] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-22T20:24:31.877315] [INFO ] [MAIN ] Update Progress: 1540/2372 symbols completed. NTEST took 21.9s. Estimated remaining: 1h 50m 28s. Rate: 7.5 symbols/min [2025-09-22T20:24:32.046777] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:24:32.046964] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-22T20:24:32.047001] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-22T20:24:32.047142] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-22T20:24:32.047184] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-22T20:24:32.047224] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-22T20:24:32.047256] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-22T20:24:32.414834] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:24:32.442363] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (3.12 seconds). [2025-09-22T20:24:32.522017] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-22T20:24:32.678154] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-22T20:24:33.322103] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-22T20:24:34.020903] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T20:24:34.122056] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-22T20:24:34.188300] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-22T20:24:34.922065] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-22T20:24:35.193179] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T20:24:35.540560] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T20:24:35.722067] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-22T20:24:36.522062] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-22T20:24:37.005479] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-22T20:24:37.322053] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-22T20:24:37.369961] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T20:24:38.122120] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-22T20:24:38.613668] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-22T20:24:38.932572] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-22T20:24:38.943471] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T20:24:39.722173] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-22T20:24:39.755399] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T20:24:40.522083] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-22T20:24:40.917582] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-22T20:24:41.322088] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-22T20:24:41.459431] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T20:24:41.973871] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T20:24:41.982611] [INFO ] [REMOTE ] NTST: Full fetch complete (60663 records). [2025-09-22T20:24:41.982848] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-22T20:24:42.127152] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-22T20:24:42.437041] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-22T20:24:42.437198] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-22T20:24:42.439006] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-22T20:24:42.439102] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-22T20:24:42.442852] [DEBUG] [LOCAL ] NTST: Trimmed 60663 records to 43435 (keeping 200 days of data) [2025-09-22T20:24:42.757248] [DEBUG] [LOCAL ] NTST: Primary data saved (43435 records). [2025-09-22T20:24:42.757494] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-22T20:24:42.757631] [INFO ] [MAIN ] Update Progress: 1541/2372 symbols completed. NTST took 22.9s. Estimated remaining: 1h 50m 22s. Rate: 7.5 symbols/min [2025-09-22T20:24:42.927179] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-22T20:24:42.966829] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:24:43.016336] [DEBUG] [LOCAL ] NUS: Loaded 36901 existing records from primary storage. [2025-09-22T20:24:43.016592] [INFO ] [MAIN ] NUS: Loaded 36901 existing records. [2025-09-22T20:24:43.216390] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T20:24:43.264666] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:24:43.265053] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-22T20:24:43.265140] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-22T20:24:43.266611] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-22T20:24:43.266717] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-22T20:24:43.677104] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:24:43.722027] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-22T20:24:44.130236] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T20:24:44.522203] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-22T20:24:45.322131] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-22T20:24:45.461241] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-22T20:24:45.749719] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-22T20:24:46.122057] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-22T20:24:46.341779] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T20:24:46.927195] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-22T20:24:46.941004] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T20:24:47.722136] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-22T20:24:48.526690] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-22T20:24:48.533697] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-22T20:24:49.091166] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-22T20:24:49.322053] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-22T20:24:49.510243] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T20:24:50.127153] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-22T20:24:50.140893] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T20:24:50.922122] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-22T20:24:51.275102] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T20:24:51.722139] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-22T20:24:52.467878] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T20:24:52.523373] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-22T20:24:52.523248] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-22T20:24:53.322122] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-22T20:24:53.581100] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T20:24:54.058465] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T20:24:54.122147] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-22T20:24:54.922127] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-22T20:24:55.516468] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-22T20:24:55.722113] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-22T20:24:55.870041] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T20:24:56.464176] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T20:24:56.522121] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-22T20:24:57.322117] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-22T20:24:58.122196] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-22T20:24:58.202550] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-22T20:24:58.239316] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T20:24:58.247817] [INFO ] [REMOTE ] NTR: Full fetch complete (76283 records). [2025-09-22T20:24:58.247955] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-22T20:24:58.658939] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-22T20:24:58.659299] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-22T20:24:58.660563] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-22T20:24:58.660665] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-22T20:24:58.662516] [DEBUG] [LOCAL ] NTR: Trimmed 76283 records to 52586 (keeping 200 days of data) [2025-09-22T20:24:58.928058] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-22T20:24:59.013069] [DEBUG] [LOCAL ] NTR: Primary data saved (52586 records). [2025-09-22T20:24:59.013421] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-22T20:24:59.013561] [INFO ] [MAIN ] Update Progress: 1542/2372 symbols completed. NTR took 41.7s. Estimated remaining: 1h 50m 18s. Rate: 7.5 symbols/min [2025-09-22T20:24:59.196374] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:24:59.219224] [DEBUG] [LOCAL ] NUV: Loaded 23361 existing records from primary storage. [2025-09-22T20:24:59.219352] [INFO ] [MAIN ] NUV: Loaded 23361 existing records. [2025-09-22T20:24:59.442719] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:24:59.443543] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-22T20:24:59.444241] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-22T20:24:59.445914] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-22T20:24:59.445821] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-22T20:24:59.446048] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-22T20:24:59.731297] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-22T20:24:59.877223] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T20:24:59.875479] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:25:00.522103] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-22T20:25:01.322081] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-22T20:25:01.459531] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-22T20:25:01.625240] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T20:25:01.722336] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T20:25:02.122047] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-22T20:25:02.740416] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T20:25:02.922146] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-22T20:25:03.722059] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-22T20:25:04.107095] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T20:25:04.326533] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-22T20:25:04.335922] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-22T20:25:04.336096] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-22T20:25:04.529296] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-22T20:25:04.754171] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-22T20:25:04.754264] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-22T20:25:04.755361] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-22T20:25:04.755430] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-22T20:25:04.760034] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 53746 (keeping 200 days of data) [2025-09-22T20:25:05.109960] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-09-22T20:25:05.110169] [INFO ] [MAIN ] NU: Full history saved. [2025-09-22T20:25:05.110297] [INFO ] [MAIN ] Update Progress: 1543/2372 symbols completed. NU took 39.7s. Estimated remaining: 1h 50m 9s. Rate: 7.5 symbols/min [2025-09-22T20:25:05.291586] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:25:05.326109] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-22T20:25:05.349895] [DEBUG] [LOCAL ] NUVB: Loaded 51955 existing records from primary storage. [2025-09-22T20:25:05.350067] [INFO ] [MAIN ] NUVB: Loaded 51955 existing records. [2025-09-22T20:25:05.532975] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:25:05.533341] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-22T20:25:05.533405] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-22T20:25:05.534823] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-22T20:25:05.534885] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-22T20:25:05.833279] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T20:25:05.954900] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:25:05.956976] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-22T20:25:06.122024] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-22T20:25:06.494424] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T20:25:06.922093] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-22T20:25:07.365219] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T20:25:07.722103] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-22T20:25:08.358812] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T20:25:08.365962] [INFO ] [REMOTE ] NUE: Full fetch complete (74564 records). [2025-09-22T20:25:08.366103] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-22T20:25:08.371194] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:25:08.371351] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:25:08.371442] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:25:08.371540] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-22T20:25:08.371627] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-22T20:25:08.371707] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-22T20:25:08.371764] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-22T20:25:08.371832] [INFO ] [MAIN ] Update Progress: 1544/2372 symbols completed. NUE took 36.5s. Estimated remaining: 1h 49m 59s. Rate: 7.5 symbols/min [2025-09-22T20:25:08.528186] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-22T20:25:08.553222] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:25:08.566094] [DEBUG] [LOCAL ] NUW: Loaded 7591 existing records from primary storage. [2025-09-22T20:25:08.566227] [INFO ] [MAIN ] NUW: Loaded 7591 existing records. [2025-09-22T20:25:08.782748] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:25:08.786867] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-22T20:25:08.786948] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-22T20:25:08.787556] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-22T20:25:08.787622] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-22T20:25:08.788927] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T20:25:09.161922] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:25:09.322062] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-22T20:25:10.122016] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-22T20:25:10.223908] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T20:25:10.922104] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-22T20:25:11.143966] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T20:25:11.486517] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T20:25:11.722118] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-22T20:25:12.256122] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T20:25:12.261957] [INFO ] [REMOTE ] NUS: Full fetch complete (53849 records). [2025-09-22T20:25:12.262073] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-22T20:25:12.527390] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-22T20:25:12.657937] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-22T20:25:12.658020] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-22T20:25:12.658942] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-22T20:25:12.659028] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-22T20:25:12.660283] [DEBUG] [LOCAL ] NUS: Trimmed 53849 records to 36414 (keeping 200 days of data) [2025-09-22T20:25:12.882988] [DEBUG] [LOCAL ] NUS: Primary data saved (36414 records). [2025-09-22T20:25:12.883168] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-22T20:25:12.883272] [INFO ] [MAIN ] Update Progress: 1545/2372 symbols completed. NUS took 30.1s. Estimated remaining: 1h 49m 49s. Rate: 7.5 symbols/min [2025-09-22T20:25:13.077708] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:25:13.109339] [DEBUG] [LOCAL ] NVG: Loaded 27624 existing records from primary storage. [2025-09-22T20:25:13.109500] [INFO ] [MAIN ] NVG: Loaded 27624 existing records. [2025-09-22T20:25:13.305979] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:25:13.317316] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-22T20:25:13.323489] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-22T20:25:13.338387] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-22T20:25:13.342576] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T20:25:13.342684] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-22T20:25:13.351830] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-22T20:25:13.689066] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T20:25:13.770257] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:25:14.122091] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-22T20:25:14.568345] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T20:25:14.922095] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-22T20:25:15.722172] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-22T20:25:15.771980] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T20:25:16.056467] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T20:25:16.522106] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-22T20:25:16.847144] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T20:25:17.322075] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-22T20:25:17.334308] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T20:25:18.122117] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-22T20:25:18.922262] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-22T20:25:19.023437] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T20:25:19.030583] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T20:25:19.722071] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-22T20:25:20.235437] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T20:25:20.522055] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-22T20:25:21.309360] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T20:25:21.322017] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-22T20:25:21.436415] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-22T20:25:22.122062] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-22T20:25:22.922036] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-22T20:25:22.947527] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T20:25:23.279701] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T20:25:23.722038] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-22T20:25:24.103133] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T20:25:24.522062] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-22T20:25:25.322066] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-22T20:25:25.581860] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T20:25:25.623304] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T20:25:26.122052] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-22T20:25:26.149097] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T20:25:26.922030] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-22T20:25:27.299894] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T20:25:27.671161] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T20:25:27.722030] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-22T20:25:28.522050] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-22T20:25:28.821723] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-22T20:25:28.825544] [INFO ] [REMOTE ] NUV: Full fetch complete (34331 records). [2025-09-22T20:25:28.825624] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-22T20:25:29.265315] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-22T20:25:29.265453] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-22T20:25:29.266226] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-22T20:25:29.266289] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-22T20:25:29.267137] [DEBUG] [LOCAL ] NUV: Trimmed 34331 records to 23066 (keeping 200 days of data) [2025-09-22T20:25:29.322896] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-22T20:25:29.371466] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T20:25:29.425441] [DEBUG] [LOCAL ] NUV: Primary data saved (23066 records). [2025-09-22T20:25:29.425590] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-22T20:25:29.425702] [INFO ] [MAIN ] Update Progress: 1546/2372 symbols completed. NUV took 30.4s. Estimated remaining: 1h 49m 45s. Rate: 7.5 symbols/min [2025-09-22T20:25:29.594090] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:25:29.626399] [DEBUG] [LOCAL ] NVGS: Loaded 31645 existing records from primary storage. [2025-09-22T20:25:29.626562] [INFO ] [MAIN ] NVGS: Loaded 31645 existing records. [2025-09-22T20:25:29.805501] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:25:29.805813] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-22T20:25:29.805864] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-22T20:25:29.806777] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-22T20:25:29.806844] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-22T20:25:30.127285] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-22T20:25:30.168320] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:25:30.531905] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T20:25:30.922075] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-22T20:25:31.010384] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T20:25:31.012129] [INFO ] [REMOTE ] NUW: Full fetch complete (11801 records). [2025-09-22T20:25:31.012211] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-22T20:25:31.405225] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-22T20:25:31.405315] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-22T20:25:31.405619] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-22T20:25:31.405692] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-22T20:25:31.406330] [DEBUG] [LOCAL ] NUW: Trimmed 11801 records to 7413 (keeping 200 days of data) [2025-09-22T20:25:31.451889] [DEBUG] [LOCAL ] NUW: Primary data saved (7413 records). [2025-09-22T20:25:31.452041] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-22T20:25:31.452131] [INFO ] [MAIN ] Update Progress: 1547/2372 symbols completed. NUW took 23.1s. Estimated remaining: 1h 49m 34s. Rate: 7.5 symbols/min [2025-09-22T20:25:31.632084] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:25:31.703377] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-22T20:25:31.703548] [INFO ] [MAIN ] NVO: Loaded 54564 existing records. [2025-09-22T20:25:31.727209] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-22T20:25:31.893223] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:25:31.893530] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-22T20:25:31.893591] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-22T20:25:31.895435] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-22T20:25:31.895497] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-22T20:25:32.259717] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:25:32.522018] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-22T20:25:32.946919] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T20:25:33.001262] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T20:25:33.322059] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-22T20:25:34.122059] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-22T20:25:34.607542] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-22T20:25:34.922104] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-22T20:25:35.190472] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-22T20:25:35.722031] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-22T20:25:35.953774] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T20:25:36.105210] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-22T20:25:36.113935] [INFO ] [REMOTE ] NUVB: Full fetch complete (72451 records). [2025-09-22T20:25:36.114096] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-22T20:25:36.524349] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-22T20:25:36.524813] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-22T20:25:36.525822] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-22T20:25:36.527029] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-22T20:25:36.527208] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-22T20:25:36.528877] [DEBUG] [LOCAL ] NUVB: Trimmed 72451 records to 51209 (keeping 200 days of data) [2025-09-22T20:25:36.843387] [DEBUG] [LOCAL ] NUVB: Primary data saved (51209 records). [2025-09-22T20:25:36.843592] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-22T20:25:36.843740] [INFO ] [MAIN ] Update Progress: 1548/2372 symbols completed. NUVB took 31.7s. Estimated remaining: 1h 49m 25s. Rate: 7.5 symbols/min [2025-09-22T20:25:37.021511] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:25:37.042943] [DEBUG] [LOCAL ] NVR: Loaded 19838 existing records from primary storage. [2025-09-22T20:25:37.043091] [INFO ] [MAIN ] NVR: Loaded 19838 existing records. [2025-09-22T20:25:37.228400] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:25:37.228719] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-22T20:25:37.228777] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-22T20:25:37.229386] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-22T20:25:37.229446] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-22T20:25:37.327176] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-22T20:25:37.656373] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:25:37.878946] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T20:25:38.127246] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-22T20:25:38.150545] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-22T20:25:38.177937] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T20:25:38.922061] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-22T20:25:39.373360] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-22T20:25:39.722060] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-22T20:25:40.522052] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-22T20:25:40.926284] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T20:25:41.322040] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-22T20:25:41.379336] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-22T20:25:41.478920] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T20:25:42.122060] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-22T20:25:42.405582] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T20:25:42.922055] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-22T20:25:43.722059] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-22T20:25:44.096757] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T20:25:44.522107] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-22T20:25:44.728612] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T20:25:44.862536] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-22T20:25:45.322091] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-22T20:25:45.743839] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T20:25:46.122059] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-22T20:25:46.922065] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-22T20:25:47.461077] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T20:25:47.722028] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-22T20:25:47.971171] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T20:25:47.976785] [INFO ] [REMOTE ] NVG: Full fetch complete (40694 records). [2025-09-22T20:25:47.976907] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-22T20:25:48.404690] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (3.08 seconds). [2025-09-22T20:25:48.430561] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-22T20:25:48.431105] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-22T20:25:48.432341] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-22T20:25:48.432407] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-22T20:25:48.433375] [DEBUG] [LOCAL ] NVG: Trimmed 40694 records to 27227 (keeping 200 days of data) [2025-09-22T20:25:48.524478] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-22T20:25:48.600108] [DEBUG] [LOCAL ] NVG: Primary data saved (27227 records). [2025-09-22T20:25:48.600246] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-22T20:25:48.600351] [INFO ] [MAIN ] Update Progress: 1549/2372 symbols completed. NVG took 35.7s. Estimated remaining: 1h 49m 19s. Rate: 7.5 symbols/min [2025-09-22T20:25:48.777238] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:25:48.796161] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T20:25:48.836040] [DEBUG] [LOCAL ] NVRI: Loaded 39584 existing records from primary storage. [2025-09-22T20:25:48.836175] [INFO ] [MAIN ] NVRI: Loaded 39584 existing records. [2025-09-22T20:25:49.012108] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:25:49.012405] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-22T20:25:49.012461] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-22T20:25:49.013296] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-22T20:25:49.013357] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-22T20:25:49.329481] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-22T20:25:49.410755] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:25:50.122061] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-22T20:25:50.760316] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T20:25:50.922060] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-22T20:25:51.287034] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-22T20:25:51.722047] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-22T20:25:51.809212] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T20:25:52.346368] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T20:25:52.522139] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-22T20:25:52.926417] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T20:25:53.322104] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-22T20:25:53.754446] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T20:25:54.122046] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-22T20:25:54.827967] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T20:25:54.922055] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-22T20:25:55.538738] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T20:25:55.722097] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-22T20:25:56.072748] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T20:25:56.522084] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-22T20:25:57.322082] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-22T20:25:57.746627] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T20:25:57.928271] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-22T20:25:58.122062] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-22T20:25:58.635302] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T20:25:58.922086] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-22T20:25:59.722088] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-22T20:26:00.203893] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-22T20:26:00.522069] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-22T20:26:00.854723] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T20:26:01.130724] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-22T20:26:01.322084] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-22T20:26:02.122108] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-22T20:26:02.248453] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T20:26:02.922087] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-22T20:26:03.336952] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-22T20:26:03.722097] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-22T20:26:04.203256] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-22T20:26:04.247667] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T20:26:04.522128] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-22T20:26:04.827923] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T20:26:04.831919] [INFO ] [REMOTE ] NVGS: Full fetch complete (41485 records). [2025-09-22T20:26:04.832035] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-22T20:26:05.236413] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-22T20:26:05.236497] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-22T20:26:05.237384] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-22T20:26:05.237453] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-22T20:26:05.238490] [DEBUG] [LOCAL ] NVGS: Trimmed 41485 records to 31141 (keeping 200 days of data) [2025-09-22T20:26:05.332356] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-22T20:26:05.444791] [DEBUG] [LOCAL ] NVGS: Primary data saved (31141 records). [2025-09-22T20:26:05.444946] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-22T20:26:05.445035] [INFO ] [MAIN ] Update Progress: 1550/2372 symbols completed. NVGS took 36.0s. Estimated remaining: 1h 49m 16s. Rate: 7.5 symbols/min [2025-09-22T20:26:05.659559] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:26:05.718710] [DEBUG] [LOCAL ] NVS: Loaded 52474 existing records from primary storage. [2025-09-22T20:26:05.726245] [INFO ] [MAIN ] NVS: Loaded 52474 existing records. [2025-09-22T20:26:05.816826] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T20:26:05.932599] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:26:05.932915] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-22T20:26:05.932976] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-22T20:26:05.934212] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-22T20:26:05.934301] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-22T20:26:06.127311] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-22T20:26:06.299608] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:26:06.922083] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-22T20:26:07.710179] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T20:26:07.722020] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-22T20:26:08.085262] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-22T20:26:08.098201] [INFO ] [REMOTE ] NVO: Full fetch complete (77955 records). [2025-09-22T20:26:08.098356] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-22T20:26:08.529885] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-22T20:26:08.533701] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-22T20:26:08.534033] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-22T20:26:08.535738] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-22T20:26:08.536699] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-22T20:26:08.554051] [DEBUG] [LOCAL ] NVO: Trimmed 77955 records to 53784 (keeping 200 days of data) [2025-09-22T20:26:08.571408] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T20:26:08.943685] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-09-22T20:26:08.943850] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-22T20:26:08.944235] [INFO ] [MAIN ] Update Progress: 1551/2372 symbols completed. NVO took 37.5s. Estimated remaining: 1h 49m 5s. Rate: 7.5 symbols/min [2025-09-22T20:26:09.137399] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:26:09.192789] [DEBUG] [LOCAL ] NVST: Loaded 52463 existing records from primary storage. [2025-09-22T20:26:09.192946] [INFO ] [MAIN ] NVST: Loaded 52463 existing records. [2025-09-22T20:26:09.325547] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-22T20:26:09.415692] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:26:09.418785] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T20:26:09.427514] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-22T20:26:09.428024] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-22T20:26:09.429150] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-22T20:26:09.429217] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-22T20:26:09.615995] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T20:26:09.823752] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:26:10.122085] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-22T20:26:10.922082] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-22T20:26:11.294619] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-22T20:26:11.722091] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-22T20:26:11.871018] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T20:26:12.155305] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T20:26:12.162195] [INFO ] [REMOTE ] NVRI: Full fetch complete (55809 records). [2025-09-22T20:26:12.162373] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-22T20:26:12.527753] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-22T20:26:12.548499] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-22T20:26:12.548596] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-22T20:26:12.549606] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-22T20:26:12.549818] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-22T20:26:12.551352] [DEBUG] [LOCAL ] NVRI: Trimmed 55809 records to 38810 (keeping 200 days of data) [2025-09-22T20:26:12.760239] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T20:26:12.766236] [INFO ] [REMOTE ] NVR: Full fetch complete (29852 records). [2025-09-22T20:26:12.766631] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-22T20:26:13.163698] [DEBUG] [LOCAL ] NVRI: Primary data saved (38810 records). [2025-09-22T20:26:13.181169] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-22T20:26:13.184877] [INFO ] [MAIN ] Update Progress: 1552/2372 symbols completed. NVRI took 24.6s. Estimated remaining: 1h 48m 55s. Rate: 7.5 symbols/min [2025-09-22T20:26:13.192533] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-22T20:26:13.198122] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-22T20:26:13.259741] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-22T20:26:13.276524] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-22T20:26:13.326545] [DEBUG] [LOCAL ] NVR: Trimmed 29852 records to 19257 (keeping 200 days of data) [2025-09-22T20:26:13.326689] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-22T20:26:13.435706] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:26:13.539017] [DEBUG] [LOCAL ] NVT: Loaded 52384 existing records from primary storage. [2025-09-22T20:26:13.539822] [INFO ] [MAIN ] NVT: Loaded 52384 existing records. [2025-09-22T20:26:13.668121] [DEBUG] [LOCAL ] NVR: Primary data saved (19257 records). [2025-09-22T20:26:13.678582] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-22T20:26:13.683833] [INFO ] [MAIN ] Update Progress: 1553/2372 symbols completed. NVR took 36.8s. Estimated remaining: 1h 48m 43s. Rate: 7.5 symbols/min [2025-09-22T20:26:13.856823] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:26:13.866536] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-22T20:26:13.882140] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-22T20:26:13.916821] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-22T20:26:13.938965] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:26:13.939074] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-22T20:26:14.340702] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:26:14.356050] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-22T20:26:14.358322] [DEBUG] [LOCAL ] NWG: Loaded 52434 existing records from primary storage. [2025-09-22T20:26:14.358937] [INFO ] [MAIN ] NWG: Loaded 52434 existing records. [2025-09-22T20:26:14.548210] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:26:14.564155] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-22T20:26:14.574166] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-22T20:26:14.575546] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-22T20:26:14.579135] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-22T20:26:14.585536] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-22T20:26:14.950087] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:26:14.947690] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-22T20:26:14.982314] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T20:26:15.722044] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-22T20:26:16.124484] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T20:26:16.522063] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-22T20:26:17.041334] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-22T20:26:17.322015] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-22T20:26:17.461418] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T20:26:17.822571] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T20:26:18.122079] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-22T20:26:18.922032] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-22T20:26:19.287601] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-22T20:26:19.538611] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T20:26:19.722088] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-22T20:26:20.522109] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-22T20:26:20.761846] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T20:26:21.322063] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-22T20:26:21.706513] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T20:26:22.122064] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-22T20:26:22.341754] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T20:26:22.873783] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T20:26:22.922063] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-22T20:26:23.646700] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T20:26:23.722050] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-22T20:26:24.522029] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-22T20:26:24.576364] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T20:26:25.322024] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-22T20:26:25.403248] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T20:26:26.049546] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T20:26:26.122025] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-22T20:26:26.922027] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-22T20:26:27.065432] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T20:26:27.604575] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T20:26:27.722063] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-22T20:26:28.522104] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-22T20:26:28.735300] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T20:26:29.322073] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-22T20:26:29.611019] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T20:26:30.122072] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-22T20:26:30.290242] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T20:26:30.922034] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-22T20:26:31.108575] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T20:26:31.722051] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-22T20:26:31.768544] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T20:26:32.522066] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-22T20:26:32.705525] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T20:26:32.716877] [INFO ] [REMOTE ] NVS: Full fetch complete (74828 records). [2025-09-22T20:26:32.717064] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-22T20:26:33.132120] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-22T20:26:33.132321] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-22T20:26:33.133513] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-22T20:26:33.133599] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-22T20:26:33.135250] [DEBUG] [LOCAL ] NVS: Trimmed 74828 records to 51691 (keeping 200 days of data) [2025-09-22T20:26:33.328099] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-22T20:26:33.485741] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T20:26:33.510807] [DEBUG] [LOCAL ] NVS: Primary data saved (51691 records). [2025-09-22T20:26:33.510922] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-22T20:26:33.511060] [INFO ] [MAIN ] Update Progress: 1554/2372 symbols completed. NVS took 28.1s. Estimated remaining: 1h 48m 42s. Rate: 7.5 symbols/min [2025-09-22T20:26:33.701905] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:26:33.702277] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-09-22T20:26:33.702342] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-09-22T20:26:33.702681] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-22T20:26:33.702777] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-22T20:26:33.702869] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-09-22T20:26:33.702931] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-22T20:26:34.082124] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:26:34.122048] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-22T20:26:34.554762] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-22T20:26:34.757422] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T20:26:34.766572] [INFO ] [REMOTE ] NVST: Full fetch complete (74085 records). [2025-09-22T20:26:34.766775] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-22T20:26:34.930746] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-22T20:26:35.190868] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-22T20:26:35.190957] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-22T20:26:35.192104] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-22T20:26:35.192172] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-22T20:26:35.193618] [DEBUG] [LOCAL ] NVST: Trimmed 74085 records to 51671 (keeping 200 days of data) [2025-09-22T20:26:35.511126] [DEBUG] [LOCAL ] NVST: Primary data saved (51671 records). [2025-09-22T20:26:35.511334] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-22T20:26:35.511601] [INFO ] [MAIN ] Update Progress: 1555/2372 symbols completed. NVST took 26.6s. Estimated remaining: 1h 48m 31s. Rate: 7.5 symbols/min [2025-09-22T20:26:35.688914] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:26:35.725861] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-22T20:26:35.727996] [DEBUG] [LOCAL ] NX: Loaded 33956 existing records from primary storage. [2025-09-22T20:26:35.729426] [INFO ] [MAIN ] NX: Loaded 33956 existing records. [2025-09-22T20:26:35.923626] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:26:35.924693] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-22T20:26:35.925398] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-22T20:26:35.926497] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-22T20:26:35.926566] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-22T20:26:36.329302] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T20:26:36.327330] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-22T20:26:36.378507] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:26:36.522068] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-22T20:26:37.328140] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-22T20:26:37.334081] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T20:26:38.078302] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T20:26:38.122012] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-22T20:26:38.233338] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T20:26:38.922091] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-22T20:26:39.722037] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-22T20:26:39.791041] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T20:26:40.020853] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T20:26:40.522052] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-22T20:26:41.322019] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-22T20:26:41.728956] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-22T20:26:42.122030] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-22T20:26:42.314487] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T20:26:42.807410] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T20:26:42.922009] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-22T20:26:43.722038] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-22T20:26:44.017808] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T20:26:44.310852] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T20:26:44.522114] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-22T20:26:44.845078] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T20:26:45.322068] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-22T20:26:45.885846] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T20:26:46.122132] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-22T20:26:46.662761] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T20:26:46.675870] [INFO ] [REMOTE ] NVT: Full fetch complete (74473 records). [2025-09-22T20:26:46.676105] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-22T20:26:46.929844] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-22T20:26:47.280350] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-22T20:26:47.280447] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-22T20:26:47.281882] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-22T20:26:47.281954] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-22T20:26:47.286752] [DEBUG] [LOCAL ] NVT: Trimmed 74473 records to 51608 (keeping 200 days of data) [2025-09-22T20:26:47.627268] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T20:26:47.651185] [DEBUG] [LOCAL ] NVT: Primary data saved (51608 records). [2025-09-22T20:26:47.651350] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-22T20:26:47.651481] [INFO ] [MAIN ] Update Progress: 1556/2372 symbols completed. NVT took 34.5s. Estimated remaining: 1h 48m 25s. Rate: 7.5 symbols/min [2025-09-22T20:26:47.727261] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-22T20:26:47.824080] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:26:47.829870] [DEBUG] [LOCAL ] NXC: Loaded 4230 existing records from primary storage. [2025-09-22T20:26:47.829951] [INFO ] [MAIN ] NXC: Loaded 4230 existing records. [2025-09-22T20:26:48.005047] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:26:48.005293] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-22T20:26:48.005344] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-22T20:26:48.005586] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-22T20:26:48.005668] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-22T20:26:48.355780] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:26:48.521998] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-22T20:26:49.085153] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-22T20:26:49.178417] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T20:26:49.322012] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-22T20:26:49.366534] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T20:26:50.122069] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-22T20:26:50.709635] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T20:26:50.922095] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-22T20:26:51.670957] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T20:26:51.680446] [INFO ] [REMOTE ] NWG: Full fetch complete (73041 records). [2025-09-22T20:26:51.680605] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-22T20:26:51.728509] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-22T20:26:52.106937] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-22T20:26:52.107029] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-22T20:26:52.108106] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-22T20:26:52.108187] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-22T20:26:52.109693] [DEBUG] [LOCAL ] NWG: Trimmed 73041 records to 51636 (keeping 200 days of data) [2025-09-22T20:26:52.353739] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T20:26:52.493583] [DEBUG] [LOCAL ] NWG: Primary data saved (51636 records). [2025-09-22T20:26:52.493873] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-22T20:26:52.494189] [INFO ] [MAIN ] Update Progress: 1557/2372 symbols completed. NWG took 38.8s. Estimated remaining: 1h 48m 15s. Rate: 7.5 symbols/min [2025-09-22T20:26:52.522095] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-22T20:26:53.078715] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T20:26:53.322056] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-22T20:26:53.346223] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-22T20:26:54.122049] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-22T20:26:54.857362] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T20:26:54.922067] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-22T20:26:55.410124] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T20:26:55.722112] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-22T20:26:56.012932] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T20:26:56.369981] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T20:26:56.522080] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-22T20:26:57.322076] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-22T20:26:57.946820] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T20:26:57.983402] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-22T20:26:58.122018] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-22T20:26:58.922115] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-22T20:26:59.535040] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T20:26:59.599523] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-22T20:26:59.722090] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-22T20:27:00.392062] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-22T20:27:00.522076] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-22T20:27:01.322140] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-22T20:27:02.122080] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-22T20:27:02.306764] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T20:27:02.316941] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T20:27:02.922114] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-22T20:27:03.722085] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-22T20:27:05.049467] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T20:27:05.051144] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-22T20:27:05.153707] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (3.03 seconds). [2025-09-22T20:27:05.157749] [INFO ] [REMOTE ] NWN: Full fetch complete (36935 records). [2025-09-22T20:27:05.157848] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-22T20:27:05.562121] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-22T20:27:05.566712] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-22T20:27:05.566854] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-22T20:27:05.567908] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-22T20:27:05.568901] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-22T20:27:05.568967] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-22T20:27:05.569935] [DEBUG] [LOCAL ] NWN: Trimmed 36935 records to 26838 (keeping 200 days of data) [2025-09-22T20:27:05.748060] [DEBUG] [LOCAL ] NWN: Primary data saved (26838 records). [2025-09-22T20:27:05.748372] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-22T20:27:05.748488] [INFO ] [MAIN ] Update Progress: 1558/2372 symbols completed. NWN took 32.2s. Estimated remaining: 1h 48m 10s. Rate: 7.5 symbols/min [2025-09-22T20:27:05.799507] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-09-22T20:27:05.807615] [INFO ] [REMOTE ] NX: Full fetch complete (48175 records). [2025-09-22T20:27:05.807762] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-22T20:27:06.198577] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-22T20:27:06.198687] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-22T20:27:06.199629] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-22T20:27:06.199916] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-22T20:27:06.205584] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T20:27:06.208337] [DEBUG] [LOCAL ] NX: Trimmed 48175 records to 33418 (keeping 200 days of data) [2025-09-22T20:27:06.208213] [INFO ] [REMOTE ] NXC: Full fetch complete (6014 records). [2025-09-22T20:27:06.208610] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-22T20:27:06.724543] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-22T20:27:06.725283] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-22T20:27:06.725885] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-22T20:27:06.726286] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-22T20:27:06.729046] [DEBUG] [LOCAL ] NXC: Trimmed 6014 records to 4193 (keeping 200 days of data) [2025-09-22T20:27:06.766019] [DEBUG] [LOCAL ] NXC: Primary data saved (4193 records). [2025-09-22T20:27:06.767268] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-22T20:27:06.767428] [INFO ] [MAIN ] Update Progress: 1559/2372 symbols completed. NXC took 19.1s. Estimated remaining: 1h 47m 58s. Rate: 7.5 symbols/min [2025-09-22T20:27:06.871595] [DEBUG] [LOCAL ] NX: Primary data saved (33418 records). [2025-09-22T20:27:06.871856] [INFO ] [MAIN ] NX: Full history saved. [2025-09-22T20:27:06.871989] [INFO ] [MAIN ] Update Progress: 1560/2372 symbols completed. NX took 31.4s. Estimated remaining: 1h 47m 46s. Rate: 7.5 symbols/min [2025-09-22T20:27:07.576941] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:27:07.571517] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:27:07.638080] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:27:07.661782] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:27:07.662204] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-22T20:27:07.662871] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-22T20:27:07.669446] [DEBUG] [LOCAL ] NXG: Loaded 10734 existing records from primary storage. [2025-09-22T20:27:07.669730] [INFO ] [MAIN ] NXG: Loaded 10734 existing records. [2025-09-22T20:27:07.669141] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-22T20:27:07.682485] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-22T20:27:07.707745] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-22T20:27:07.719810] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-22T20:27:07.832823] [DEBUG] [LOCAL ] NXDT: Loaded 16764 existing records from primary storage. [2025-09-22T20:27:07.868159] [INFO ] [MAIN ] NXDT: Loaded 16764 existing records. [2025-09-22T20:27:08.133131] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:27:08.167324] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-22T20:27:08.173908] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-22T20:27:08.206187] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-22T20:27:08.247995] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-22T20:27:08.387279] [DEBUG] [LOCAL ] NXE: Loaded 53760 existing records from primary storage. [2025-09-22T20:27:08.451845] [INFO ] [MAIN ] NXE: Loaded 53760 existing records. [2025-09-22T20:27:08.565693] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:27:08.649170] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:27:08.674324] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-22T20:27:08.685947] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-22T20:27:08.680684] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-22T20:27:08.732842] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-22T20:27:08.732988] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-22T20:27:09.133950] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:27:09.161509] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:27:09.168951] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-22T20:27:09.217428] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-09-22T20:27:09.194985] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-22T20:27:09.290317] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-22T20:27:09.352589] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-22T20:27:09.375096] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-22T20:27:09.378175] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:27:09.378504] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-22T20:27:09.564823] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:27:09.565204] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-22T20:27:09.558994] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:27:09.566676] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-09-22T20:27:09.583023] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-22T20:27:09.834404] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:27:09.921024] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:27:09.921286] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-22T20:27:10.122092] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-22T20:27:10.370983] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T20:27:10.769243] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T20:27:10.922062] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-22T20:27:11.722068] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-22T20:27:12.008920] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:27:12.009244] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-22T20:27:12.097699] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-22T20:27:12.245713] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T20:27:12.522125] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-22T20:27:12.803597] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:27:12.803967] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-22T20:27:13.322075] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-22T20:27:14.122104] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-22T20:27:14.429841] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T20:27:14.922109] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-22T20:27:15.722114] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-22T20:27:16.250029] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T20:27:16.350084] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:27:16.350435] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-22T20:27:16.522032] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-22T20:27:16.710967] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-22T20:27:17.322019] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-22T20:27:17.705275] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-22T20:27:18.122032] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-22T20:27:18.180935] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T20:27:18.392600] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:27:18.393050] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-22T20:27:18.922058] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-22T20:27:19.722081] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-22T20:27:19.813772] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T20:27:20.522085] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-22T20:27:21.322027] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-22T20:27:21.575070] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T20:27:21.720358] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T20:27:22.122039] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-22T20:27:22.173740] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-22T20:27:22.922095] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-22T20:27:23.722104] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-22T20:27:24.066058] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T20:27:24.090168] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T20:27:24.522043] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-22T20:27:24.550723] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T20:27:25.322053] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-22T20:27:26.122044] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-22T20:27:26.137620] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T20:27:26.355012] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T20:27:26.922057] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-22T20:27:27.722030] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-22T20:27:27.740873] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T20:27:28.522067] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-22T20:27:28.877269] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T20:27:29.322042] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-22T20:27:29.398975] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T20:27:29.807810] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-22T20:27:30.128503] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-22T20:27:30.129475] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T20:27:30.922064] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-22T20:27:31.053612] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T20:27:31.722066] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-22T20:27:32.522036] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-22T20:27:32.676598] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T20:27:32.806806] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T20:27:33.322076] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-22T20:27:34.122115] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-22T20:27:34.265999] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T20:27:34.274315] [INFO ] [REMOTE ] NXDR: Full fetch complete (16253 records). [2025-09-22T20:27:34.274396] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-22T20:27:34.454992] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 45 unique days, need 200 days [2025-09-22T20:27:34.455358] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:27:34.455436] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:27:34.455490] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-22T20:27:34.455547] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-22T20:27:34.455580] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-22T20:27:34.455634] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-22T20:27:34.455739] [INFO ] [MAIN ] Update Progress: 1561/2372 symbols completed. NXDR took 27.6s. Estimated remaining: 1h 47m 49s. Rate: 7.5 symbols/min [2025-09-22T20:27:34.622536] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:27:34.640586] [DEBUG] [LOCAL ] NXJ: Loaded 15097 existing records from primary storage. [2025-09-22T20:27:34.640760] [INFO ] [MAIN ] NXJ: Loaded 15097 existing records. [2025-09-22T20:27:34.837733] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:27:34.838196] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-22T20:27:34.838385] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-22T20:27:34.839006] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-22T20:27:34.839067] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-22T20:27:34.942532] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-22T20:27:35.219279] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:27:35.262092] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-22T20:27:35.273506] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T20:27:35.722084] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-22T20:27:35.973299] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-22T20:27:35.975838] [INFO ] [REMOTE ] NXG: Full fetch complete (14455 records). [2025-09-22T20:27:35.975929] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-22T20:27:36.341500] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-22T20:27:36.341604] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-22T20:27:36.342000] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-22T20:27:36.342069] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-22T20:27:36.342625] [DEBUG] [LOCAL ] NXG: Trimmed 14455 records to 10497 (keeping 200 days of data) [2025-09-22T20:27:36.407533] [DEBUG] [LOCAL ] NXG: Primary data saved (10497 records). [2025-09-22T20:27:36.407693] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-22T20:27:36.407795] [INFO ] [MAIN ] Update Progress: 1562/2372 symbols completed. NXG took 29.5s. Estimated remaining: 1h 47m 37s. Rate: 7.5 symbols/min [2025-09-22T20:27:36.527233] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-22T20:27:36.585249] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:27:36.589584] [DEBUG] [LOCAL ] NXN: Loaded 2363 existing records from primary storage. [2025-09-22T20:27:36.589698] [INFO ] [MAIN ] NXN: Loaded 2363 existing records. [2025-09-22T20:27:36.699343] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-22T20:27:36.751732] [INFO ] [REMOTE ] NXDT: Full fetch complete (25784 records). [2025-09-22T20:27:36.776754] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-22T20:27:36.782224] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:27:36.846382] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-22T20:27:36.846481] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-22T20:27:36.863173] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-22T20:27:36.884811] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-22T20:27:37.334538] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-22T20:27:37.456501] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-22T20:27:37.467319] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-22T20:27:37.479056] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-22T20:27:37.510886] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-22T20:27:37.542668] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:27:37.543430] [DEBUG] [LOCAL ] NXDT: Trimmed 25784 records to 16470 (keeping 200 days of data) [2025-09-22T20:27:37.639752] [DEBUG] [LOCAL ] NXDT: Primary data saved (16470 records). [2025-09-22T20:27:37.639907] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-22T20:27:37.639999] [INFO ] [MAIN ] Update Progress: 1563/2372 symbols completed. NXDT took 30.8s. Estimated remaining: 1h 47m 26s. Rate: 7.5 symbols/min [2025-09-22T20:27:37.807988] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:27:37.820881] [DEBUG] [LOCAL ] NXP: Loaded 12392 existing records from primary storage. [2025-09-22T20:27:37.820985] [INFO ] [MAIN ] NXP: Loaded 12392 existing records. [2025-09-22T20:27:37.997793] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:27:37.998083] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-22T20:27:37.998152] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-22T20:27:37.998759] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-22T20:27:37.998825] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-22T20:27:38.127153] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-22T20:27:38.370599] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:27:38.488225] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T20:27:38.510214] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T20:27:38.829578] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-22T20:27:38.922044] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-22T20:27:39.407719] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-22T20:27:39.722098] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-22T20:27:40.522134] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-22T20:27:40.657704] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T20:27:41.322068] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-22T20:27:41.412302] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T20:27:42.122051] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-22T20:27:42.695567] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T20:27:42.922074] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-22T20:27:43.096770] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-22T20:27:43.106026] [INFO ] [REMOTE ] NXE: Full fetch complete (76629 records). [2025-09-22T20:27:43.106178] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-22T20:27:43.610197] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-22T20:27:43.610364] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-22T20:27:43.611819] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-22T20:27:43.611891] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-22T20:27:43.613572] [DEBUG] [LOCAL ] NXE: Trimmed 76629 records to 52981 (keeping 200 days of data) [2025-09-22T20:27:43.722148] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-22T20:27:43.828150] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T20:27:43.942490] [DEBUG] [LOCAL ] NXE: Primary data saved (52981 records). [2025-09-22T20:27:43.942681] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-22T20:27:43.944627] [INFO ] [MAIN ] Update Progress: 1564/2372 symbols completed. NXE took 37.1s. Estimated remaining: 1h 47m 17s. Rate: 7.5 symbols/min [2025-09-22T20:27:44.113925] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:27:44.136442] [DEBUG] [LOCAL ] NXRT: Loaded 19184 existing records from primary storage. [2025-09-22T20:27:44.136581] [INFO ] [MAIN ] NXRT: Loaded 19184 existing records. [2025-09-22T20:27:44.316452] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:27:44.316776] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-22T20:27:44.316830] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-22T20:27:44.317625] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-22T20:27:44.317720] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-22T20:27:44.526725] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-22T20:27:44.637825] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-22T20:27:44.723176] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:27:45.322040] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-22T20:27:45.421790] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T20:27:46.080571] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T20:27:46.122067] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-22T20:27:46.645243] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T20:27:46.922074] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-22T20:27:47.722086] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-22T20:27:47.834880] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T20:27:48.158579] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-22T20:27:48.522101] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-22T20:27:49.026593] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-22T20:27:49.322113] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-22T20:27:50.122039] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-22T20:27:50.348545] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T20:27:50.526100] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-22T20:27:50.922097] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-22T20:27:51.482837] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T20:27:51.722095] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-22T20:27:52.522071] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-22T20:27:52.584862] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-22T20:27:53.279634] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T20:27:53.322006] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-22T20:27:53.888275] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T20:27:54.122039] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-22T20:27:54.829118] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T20:27:54.922033] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-22T20:27:55.424812] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-22T20:27:55.425921] [INFO ] [REMOTE ] NXN: Full fetch complete (3668 records). [2025-09-22T20:27:55.425992] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-22T20:27:55.729992] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-22T20:27:55.813883] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-22T20:27:55.813958] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-22T20:27:55.814078] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-22T20:27:55.814114] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-22T20:27:55.814488] [DEBUG] [LOCAL ] NXN: Trimmed 3668 records to 2312 (keeping 200 days of data) [2025-09-22T20:27:55.828676] [DEBUG] [LOCAL ] NXN: Primary data saved (2312 records). [2025-09-22T20:27:55.828746] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-22T20:27:55.828817] [INFO ] [MAIN ] Update Progress: 1565/2372 symbols completed. NXN took 19.4s. Estimated remaining: 1h 47m 11s. Rate: 7.5 symbols/min [2025-09-22T20:27:55.995869] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:27:55.996059] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-22T20:27:55.996094] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-22T20:27:55.996236] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-22T20:27:55.996279] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-22T20:27:55.996319] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-22T20:27:55.996351] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-22T20:27:56.345980] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:27:56.522026] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-22T20:27:56.758569] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T20:27:57.322038] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-22T20:27:57.536458] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T20:27:58.122030] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-22T20:27:58.213111] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T20:27:58.766824] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-22T20:27:58.922017] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-22T20:27:59.722072] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-22T20:27:59.822369] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T20:28:00.522057] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-22T20:28:00.714173] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T20:28:01.322096] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-22T20:28:01.738545] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T20:28:02.020812] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-22T20:28:02.122064] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-22T20:28:02.922034] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-22T20:28:03.144945] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T20:28:03.628863] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T20:28:03.631699] [INFO ] [REMOTE ] NXP: Full fetch complete (16756 records). [2025-09-22T20:28:03.631781] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-22T20:28:03.729482] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-22T20:28:04.004485] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-22T20:28:04.004590] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-22T20:28:04.005034] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-22T20:28:04.005096] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-22T20:28:04.005694] [DEBUG] [LOCAL ] NXP: Trimmed 16756 records to 12323 (keeping 200 days of data) [2025-09-22T20:28:04.084779] [DEBUG] [LOCAL ] NXP: Primary data saved (12323 records). [2025-09-22T20:28:04.084920] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-22T20:28:04.085006] [INFO ] [MAIN ] Update Progress: 1566/2372 symbols completed. NXP took 26.4s. Estimated remaining: 1h 47m 3s. Rate: 7.5 symbols/min [2025-09-22T20:28:04.262279] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:28:04.316188] [DEBUG] [LOCAL ] NYT: Loaded 50763 existing records from primary storage. [2025-09-22T20:28:04.316362] [INFO ] [MAIN ] NYT: Loaded 50763 existing records. [2025-09-22T20:28:04.501447] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:28:04.501738] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-22T20:28:04.501795] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-22T20:28:04.503345] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-22T20:28:04.503407] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-22T20:28:04.527150] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-22T20:28:04.768861] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T20:28:04.824973] [INFO ] [REMOTE ] NXJ: Full fetch complete (21306 records). [2025-09-22T20:28:04.836520] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-22T20:28:05.032068] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:28:05.286247] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-22T20:28:05.286325] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-22T20:28:05.286771] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-22T20:28:05.286837] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-22T20:28:05.287450] [DEBUG] [LOCAL ] NXJ: Trimmed 21306 records to 14967 (keeping 200 days of data) [2025-09-22T20:28:05.327733] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-22T20:28:05.381719] [DEBUG] [LOCAL ] NXJ: Primary data saved (14967 records). [2025-09-22T20:28:05.381838] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-22T20:28:05.381941] [INFO ] [MAIN ] Update Progress: 1567/2372 symbols completed. NXJ took 30.9s. Estimated remaining: 1h 46m 52s. Rate: 7.5 symbols/min [2025-09-22T20:28:05.555139] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:28:05.567855] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T20:28:05.605432] [DEBUG] [LOCAL ] NZF: Loaded 29676 existing records from primary storage. [2025-09-22T20:28:05.605568] [INFO ] [MAIN ] NZF: Loaded 29676 existing records. [2025-09-22T20:28:05.781993] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:28:05.782242] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-22T20:28:05.782291] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-22T20:28:05.783232] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-22T20:28:05.783292] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-22T20:28:06.128615] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-22T20:28:06.152879] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:28:06.922069] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-22T20:28:07.136584] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T20:28:07.393846] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T20:28:07.409187] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-22T20:28:07.722077] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-22T20:28:08.522029] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-22T20:28:08.798534] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T20:28:09.322074] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-22T20:28:09.851098] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-22T20:28:10.056569] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T20:28:10.122061] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-22T20:28:10.922098] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-22T20:28:11.449520] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-22T20:28:11.722042] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-22T20:28:11.835082] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T20:28:12.071157] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-22T20:28:12.522104] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-22T20:28:13.322053] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-22T20:28:13.574279] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T20:28:14.122106] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-22T20:28:14.701951] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T20:28:14.922019] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-22T20:28:15.230114] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T20:28:15.722055] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-22T20:28:15.983251] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T20:28:16.277537] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T20:28:16.522074] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-22T20:28:17.322018] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-22T20:28:17.686715] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T20:28:18.122054] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-22T20:28:18.607878] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T20:28:18.922021] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-22T20:28:19.227489] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T20:28:19.230934] [INFO ] [REMOTE ] NXRT: Full fetch complete (25029 records). [2025-09-22T20:28:19.231011] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-22T20:28:19.607873] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-22T20:28:19.607948] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-22T20:28:19.608459] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-22T20:28:19.608497] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-22T20:28:19.609149] [DEBUG] [LOCAL ] NXRT: Trimmed 25029 records to 18963 (keeping 200 days of data) [2025-09-22T20:28:19.724038] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-22T20:28:19.730386] [DEBUG] [LOCAL ] NXRT: Primary data saved (18963 records). [2025-09-22T20:28:19.730537] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-22T20:28:19.730635] [INFO ] [MAIN ] Update Progress: 1568/2372 symbols completed. NXRT took 35.8s. Estimated remaining: 1h 46m 47s. Rate: 7.5 symbols/min [2025-09-22T20:28:19.907688] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:28:19.907963] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-22T20:28:19.908018] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-22T20:28:19.908159] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-22T20:28:19.908203] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-22T20:28:19.908245] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-22T20:28:19.908277] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-22T20:28:20.204514] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-22T20:28:20.293505] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T20:28:20.312755] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:28:20.522058] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-22T20:28:21.322071] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-22T20:28:22.122082] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-22T20:28:22.775515] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-22T20:28:22.797814] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T20:28:22.922013] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-22T20:28:23.232214] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-22T20:28:23.345518] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T20:28:23.722067] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-22T20:28:24.108201] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-22T20:28:24.522054] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-22T20:28:25.322053] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-22T20:28:26.122043] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-22T20:28:26.816589] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-22T20:28:26.922111] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-22T20:28:27.019964] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T20:28:27.259855] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T20:28:27.361765] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-22T20:28:27.362754] [INFO ] [REMOTE ] NYC: Full fetch complete (1916 records). [2025-09-22T20:28:27.362825] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-22T20:28:27.556396] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-22T20:28:27.556609] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:28:27.556700] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:28:27.556774] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-22T20:28:27.556855] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-22T20:28:27.556912] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-22T20:28:27.556956] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-22T20:28:27.557016] [INFO ] [MAIN ] Update Progress: 1569/2372 symbols completed. NYC took 31.7s. Estimated remaining: 1h 46m 39s. Rate: 7.5 symbols/min [2025-09-22T20:28:27.724264] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-22T20:28:27.746503] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:28:27.810779] [DEBUG] [LOCAL ] OBDC: Loaded 52406 existing records from primary storage. [2025-09-22T20:28:27.810989] [INFO ] [MAIN ] OBDC: Loaded 52406 existing records. [2025-09-22T20:28:27.996266] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:28:27.996668] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-22T20:28:27.996731] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-22T20:28:27.998357] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-22T20:28:27.998422] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-22T20:28:28.369177] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:28:28.522064] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-22T20:28:29.322072] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-22T20:28:29.597735] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T20:28:29.925607] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T20:28:30.122098] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-22T20:28:30.650498] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T20:28:30.922067] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-22T20:28:31.722115] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-22T20:28:32.335963] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T20:28:32.369906] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-22T20:28:32.522046] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-22T20:28:33.322065] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-22T20:28:33.796170] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-22T20:28:34.018836] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T20:28:34.122092] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-22T20:28:34.922075] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-22T20:28:35.722058] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-22T20:28:36.551882] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-22T20:28:36.556879] [INFO ] [REMOTE ] NZF: Full fetch complete (43736 records). [2025-09-22T20:28:36.556972] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-22T20:28:36.937501] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-22T20:28:36.937748] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-22T20:28:36.938560] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-22T20:28:36.938603] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-22T20:28:36.939584] [DEBUG] [LOCAL ] NZF: Trimmed 43736 records to 29077 (keeping 200 days of data) [2025-09-22T20:28:37.127670] [DEBUG] [LOCAL ] NZF: Primary data saved (29077 records). [2025-09-22T20:28:37.127822] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-22T20:28:37.127913] [INFO ] [MAIN ] Update Progress: 1570/2372 symbols completed. NZF took 31.7s. Estimated remaining: 1h 46m 32s. Rate: 7.5 symbols/min [2025-09-22T20:28:37.319023] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:28:37.357544] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (4.04 seconds). [2025-09-22T20:28:37.369274] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-22T20:28:37.375917] [DEBUG] [LOCAL ] OBK: Loaded 16504 existing records from primary storage. [2025-09-22T20:28:37.376005] [INFO ] [MAIN ] OBK: Loaded 16504 existing records. [2025-09-22T20:28:37.601109] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:28:37.601550] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-22T20:28:37.601634] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-22T20:28:37.602768] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-22T20:28:37.602832] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-22T20:28:37.783336] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-22T20:28:37.910394] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-22T20:28:38.030734] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:28:38.122023] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-22T20:28:38.588456] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (2.87 seconds). [2025-09-22T20:28:38.922010] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-22T20:28:39.227816] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T20:28:39.625803] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T20:28:39.678870] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-22T20:28:39.722004] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-22T20:28:40.522032] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-22T20:28:40.815964] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T20:28:41.122289] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T20:28:41.322059] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-22T20:28:41.609818] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T20:28:42.122104] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-22T20:28:42.922009] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-22T20:28:43.161155] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-22T20:28:43.237245] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T20:28:43.722113] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-22T20:28:44.522064] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-22T20:28:44.837310] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T20:28:45.239119] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T20:28:45.247723] [INFO ] [REMOTE ] NYT: Full fetch complete (72142 records). [2025-09-22T20:28:45.247945] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-22T20:28:45.328826] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-22T20:28:45.670713] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-22T20:28:45.670814] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-22T20:28:45.672096] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-22T20:28:45.672163] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-22T20:28:45.673705] [DEBUG] [LOCAL ] NYT: Trimmed 72142 records to 49995 (keeping 200 days of data) [2025-09-22T20:28:45.985030] [DEBUG] [LOCAL ] NYT: Primary data saved (49995 records). [2025-09-22T20:28:45.985388] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-22T20:28:45.985742] [INFO ] [MAIN ] Update Progress: 1571/2372 symbols completed. NYT took 41.9s. Estimated remaining: 1h 46m 25s. Rate: 7.5 symbols/min [2025-09-22T20:28:46.136396] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-22T20:28:46.172876] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:28:46.222490] [DEBUG] [LOCAL ] OC: Loaded 45549 existing records from primary storage. [2025-09-22T20:28:46.222701] [INFO ] [MAIN ] OC: Loaded 45549 existing records. [2025-09-22T20:28:46.427011] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:28:46.428091] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T20:28:46.432453] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-22T20:28:46.432531] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-22T20:28:46.434229] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-22T20:28:46.434308] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-22T20:28:46.831452] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:28:46.922061] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-22T20:28:47.115260] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-22T20:28:47.722107] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-22T20:28:48.075833] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T20:28:48.522088] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-22T20:28:49.122614] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T20:28:49.322063] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-22T20:28:49.528986] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-22T20:28:50.122060] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-22T20:28:50.801702] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T20:28:50.922099] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-22T20:28:51.722041] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-22T20:28:51.818905] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T20:28:51.859688] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (3.34 seconds). [2025-09-22T20:28:52.038189] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T20:28:52.522069] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-22T20:28:53.062532] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T20:28:53.322063] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-22T20:28:54.122076] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-22T20:28:54.333060] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T20:28:54.922049] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-22T20:28:55.039834] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-22T20:28:55.458029] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T20:28:55.722143] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-22T20:28:55.824126] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T20:28:56.522081] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-22T20:28:57.270152] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T20:28:57.322019] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-22T20:28:57.537036] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-22T20:28:57.540433] [INFO ] [REMOTE ] OBK: Full fetch complete (24116 records). [2025-09-22T20:28:57.540506] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-22T20:28:57.908532] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-22T20:28:57.908617] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-22T20:28:57.909130] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-22T20:28:57.909185] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-22T20:28:57.909820] [DEBUG] [LOCAL ] OBK: Trimmed 24116 records to 16315 (keeping 200 days of data) [2025-09-22T20:28:58.011321] [DEBUG] [LOCAL ] OBK: Primary data saved (16315 records). [2025-09-22T20:28:58.011470] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-22T20:28:58.011559] [INFO ] [MAIN ] Update Progress: 1572/2372 symbols completed. OBK took 20.9s. Estimated remaining: 1h 46m 19s. Rate: 7.5 symbols/min [2025-09-22T20:28:58.127154] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-22T20:28:58.184174] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:28:58.195003] [DEBUG] [LOCAL ] OCFT: Loaded 9497 existing records from primary storage. [2025-09-22T20:28:58.195120] [INFO ] [MAIN ] OCFT: Loaded 9497 existing records. [2025-09-22T20:28:58.369773] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:28:58.370055] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-22T20:28:58.370118] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-22T20:28:58.370744] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-22T20:28:58.370804] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-22T20:28:58.737224] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:28:58.922093] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-22T20:28:59.072241] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T20:28:59.569858] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-22T20:28:59.722059] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-22T20:29:00.522064] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-22T20:29:00.840995] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-22T20:29:01.190753] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-22T20:29:01.322102] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-22T20:29:01.451784] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T20:29:01.459906] [INFO ] [REMOTE ] OBDC: Full fetch complete (74833 records). [2025-09-22T20:29:01.460036] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-22T20:29:01.874929] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-22T20:29:01.875010] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-22T20:29:01.876096] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-22T20:29:01.876161] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-22T20:29:01.877592] [DEBUG] [LOCAL ] OBDC: Trimmed 74833 records to 51650 (keeping 200 days of data) [2025-09-22T20:29:02.122080] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-22T20:29:02.204464] [DEBUG] [LOCAL ] OBDC: Primary data saved (51650 records). [2025-09-22T20:29:02.204608] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-22T20:29:02.204722] [INFO ] [MAIN ] Update Progress: 1573/2372 symbols completed. OBDC took 34.6s. Estimated remaining: 1h 46m 9s. Rate: 7.5 symbols/min [2025-09-22T20:29:02.311778] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T20:29:02.385255] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:29:02.395553] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-22T20:29:02.395704] [INFO ] [MAIN ] ODC: Loaded 8633 existing records. [2025-09-22T20:29:02.572523] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:29:02.572834] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-22T20:29:02.572886] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-22T20:29:02.573504] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-22T20:29:02.573562] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-22T20:29:02.933077] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-22T20:29:02.939130] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:29:03.722059] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-22T20:29:04.424317] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-22T20:29:04.432418] [INFO ] [REMOTE ] O: Full fetch complete (77557 records). [2025-09-22T20:29:04.432564] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-22T20:29:04.532518] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-22T20:29:04.562785] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T20:29:04.657101] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T20:29:04.657966] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:29:04.658057] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:29:04.658510] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-22T20:29:04.658635] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-22T20:29:04.658760] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-22T20:29:04.658909] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-22T20:29:04.659034] [INFO ] [MAIN ] Update Progress: 1574/2372 symbols completed. O took 44.9s. Estimated remaining: 1h 45m 58s. Rate: 7.5 symbols/min [2025-09-22T20:29:04.833578] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:29:04.861781] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T20:29:04.892416] [DEBUG] [LOCAL ] ODV: Loaded 25338 existing records from primary storage. [2025-09-22T20:29:04.892552] [INFO ] [MAIN ] ODV: Loaded 25338 existing records. [2025-09-22T20:29:05.074868] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:29:05.075137] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-22T20:29:05.075240] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-22T20:29:05.076143] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-22T20:29:05.076212] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-22T20:29:05.327176] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-22T20:29:05.446911] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:29:05.770450] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T20:29:06.122097] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-22T20:29:06.924312] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-22T20:29:06.927362] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T20:29:06.965978] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T20:29:07.722069] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-22T20:29:07.953221] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T20:29:08.442186] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T20:29:08.522054] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-22T20:29:09.195861] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T20:29:09.322062] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-22T20:29:09.948852] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T20:29:10.122081] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-22T20:29:10.922052] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-22T20:29:11.722092] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-22T20:29:11.729162] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T20:29:11.889575] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T20:29:12.522081] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-22T20:29:12.605951] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T20:29:13.322084] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-22T20:29:13.420305] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-22T20:29:14.122144] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-22T20:29:14.153847] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-22T20:29:14.922068] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-22T20:29:15.653492] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T20:29:15.654140] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T20:29:15.722015] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-22T20:29:16.522092] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-22T20:29:16.652412] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T20:29:17.322066] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-22T20:29:18.122022] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-22T20:29:18.193638] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T20:29:18.210826] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-22T20:29:18.738606] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T20:29:18.922069] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-22T20:29:19.722081] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-22T20:29:19.764053] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T20:29:20.522068] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-22T20:29:21.322037] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-22T20:29:21.448729] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-22T20:29:21.468111] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T20:29:22.122024] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-22T20:29:22.130839] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-22T20:29:22.922035] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-22T20:29:23.286504] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T20:29:23.674918] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T20:29:23.722078] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-22T20:29:24.522079] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-22T20:29:24.991004] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T20:29:25.139766] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T20:29:25.141102] [INFO ] [REMOTE ] OCFT: Full fetch complete (11764 records). [2025-09-22T20:29:25.141173] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-22T20:29:25.322079] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-22T20:29:25.510204] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-22T20:29:25.510281] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-22T20:29:25.510537] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-22T20:29:25.510576] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-22T20:29:25.511059] [DEBUG] [LOCAL ] OCFT: Trimmed 11764 records to 8957 (keeping 200 days of data) [2025-09-22T20:29:25.563084] [DEBUG] [LOCAL ] OCFT: Primary data saved (8957 records). [2025-09-22T20:29:25.563323] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-22T20:29:25.563637] [INFO ] [MAIN ] Update Progress: 1575/2372 symbols completed. OCFT took 27.6s. Estimated remaining: 1h 45m 57s. Rate: 7.5 symbols/min [2025-09-22T20:29:25.734929] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:29:25.780856] [DEBUG] [LOCAL ] OEC: Loaded 37971 existing records from primary storage. [2025-09-22T20:29:25.781002] [INFO ] [MAIN ] OEC: Loaded 37971 existing records. [2025-09-22T20:29:25.960889] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:29:25.961142] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-22T20:29:25.961190] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-22T20:29:25.962344] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-22T20:29:25.962419] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-22T20:29:26.136509] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-22T20:29:26.340243] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:29:26.534918] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T20:29:26.922059] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-22T20:29:27.722071] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-22T20:29:27.767684] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T20:29:27.775240] [INFO ] [REMOTE ] OC: Full fetch complete (64057 records). [2025-09-22T20:29:27.775393] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-22T20:29:28.189886] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-22T20:29:28.190071] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-22T20:29:28.191686] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-22T20:29:28.192225] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-22T20:29:28.193723] [DEBUG] [LOCAL ] OC: Trimmed 64057 records to 44772 (keeping 200 days of data) [2025-09-22T20:29:28.352434] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T20:29:28.524540] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-22T20:29:28.528604] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T20:29:28.531941] [INFO ] [REMOTE ] ODC: Full fetch complete (10905 records). [2025-09-22T20:29:28.532272] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-22T20:29:28.618744] [DEBUG] [LOCAL ] OC: Primary data saved (44772 records). [2025-09-22T20:29:28.637053] [INFO ] [MAIN ] OC: Full history saved. [2025-09-22T20:29:28.639484] [INFO ] [MAIN ] Update Progress: 1576/2372 symbols completed. OC took 42.7s. Estimated remaining: 1h 45m 46s. Rate: 7.5 symbols/min [2025-09-22T20:29:29.001663] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:29:29.090805] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-22T20:29:29.090889] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-22T20:29:29.091303] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-22T20:29:29.091376] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-22T20:29:29.092058] [DEBUG] [LOCAL ] ODC: Trimmed 10905 records to 8551 (keeping 200 days of data) [2025-09-22T20:29:29.126799] [DEBUG] [LOCAL ] OFG: Loaded 22682 existing records from primary storage. [2025-09-22T20:29:29.138007] [INFO ] [MAIN ] OFG: Loaded 22682 existing records. [2025-09-22T20:29:29.272283] [DEBUG] [LOCAL ] ODC: Primary data saved (8551 records). [2025-09-22T20:29:29.282749] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-22T20:29:29.283059] [INFO ] [MAIN ] Update Progress: 1577/2372 symbols completed. ODC took 27.1s. Estimated remaining: 1h 45m 35s. Rate: 7.5 symbols/min [2025-09-22T20:29:29.333074] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-22T20:29:29.381353] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:29:29.410038] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-22T20:29:29.423020] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-22T20:29:29.455358] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-22T20:29:29.465700] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-22T20:29:29.623536] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:29:29.897660] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:29:29.911207] [DEBUG] [LOCAL ] OGE: Loaded 47295 existing records from primary storage. [2025-09-22T20:29:29.911316] [INFO ] [MAIN ] OGE: Loaded 47295 existing records. [2025-09-22T20:29:30.086509] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:29:30.086762] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-22T20:29:30.086814] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-22T20:29:30.088703] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-22T20:29:30.088763] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-22T20:29:30.130683] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-22T20:29:30.441423] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:29:30.910031] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T20:29:30.922003] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-22T20:29:31.430045] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T20:29:31.722046] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-22T20:29:32.008443] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (3.48 seconds). [2025-09-22T20:29:32.350565] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T20:29:32.357366] [INFO ] [REMOTE ] ODV: Full fetch complete (31514 records). [2025-09-22T20:29:32.357544] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-22T20:29:32.527339] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-22T20:29:32.792351] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-22T20:29:32.792453] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-22T20:29:32.793311] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-22T20:29:32.793395] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-22T20:29:32.795567] [DEBUG] [LOCAL ] ODV: Trimmed 31514 records to 25269 (keeping 200 days of data) [2025-09-22T20:29:32.966351] [DEBUG] [LOCAL ] ODV: Primary data saved (25269 records). [2025-09-22T20:29:32.966514] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-22T20:29:32.966697] [INFO ] [MAIN ] Update Progress: 1578/2372 symbols completed. ODV took 28.3s. Estimated remaining: 1h 45m 24s. Rate: 7.5 symbols/min [2025-09-22T20:29:33.143585] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:29:33.205002] [DEBUG] [LOCAL ] OGN: Loaded 53908 existing records from primary storage. [2025-09-22T20:29:33.205224] [INFO ] [MAIN ] OGN: Loaded 53908 existing records. [2025-09-22T20:29:33.324818] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-22T20:29:33.399636] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:29:33.400183] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-22T20:29:33.400272] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-22T20:29:33.401820] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-22T20:29:33.401946] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-22T20:29:33.514975] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T20:29:33.816541] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:29:34.117766] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T20:29:34.124877] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-22T20:29:34.666034] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T20:29:34.922087] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-22T20:29:35.722103] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-22T20:29:36.239547] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-22T20:29:36.251999] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T20:29:36.522059] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-22T20:29:37.140527] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T20:29:37.322054] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-22T20:29:38.122027] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-22T20:29:38.311696] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T20:29:38.736278] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T20:29:38.922048] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-22T20:29:39.221149] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T20:29:39.722122] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-22T20:29:40.504756] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T20:29:40.522004] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-22T20:29:40.942931] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T20:29:41.322053] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-22T20:29:42.122069] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-22T20:29:42.164967] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T20:29:42.922036] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-22T20:29:43.101529] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-22T20:29:43.722022] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-22T20:29:43.758608] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T20:29:44.039244] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T20:29:44.522097] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-22T20:29:45.322143] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-22T20:29:45.553981] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T20:29:46.122103] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-22T20:29:46.266577] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T20:29:46.909457] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T20:29:46.922457] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-22T20:29:47.722033] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-22T20:29:48.038046] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T20:29:48.143433] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T20:29:48.522112] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-22T20:29:49.071388] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T20:29:49.322050] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-22T20:29:50.122143] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-22T20:29:50.279719] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T20:29:50.922045] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-22T20:29:51.166945] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T20:29:51.538820] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T20:29:51.722076] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-22T20:29:52.079244] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T20:29:52.522068] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-22T20:29:53.322033] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-22T20:29:53.415787] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T20:29:53.469226] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T20:29:54.122075] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-22T20:29:54.922077] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-22T20:29:55.243341] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T20:29:55.603757] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T20:29:55.722124] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-22T20:29:55.965777] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T20:29:56.522075] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-22T20:29:57.322070] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-22T20:29:57.625746] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T20:29:58.122101] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-22T20:29:58.421771] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T20:29:58.665943] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T20:29:58.671487] [INFO ] [REMOTE ] OEC: Full fetch complete (52596 records). [2025-09-22T20:29:58.671583] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-22T20:29:58.928963] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-22T20:29:59.068409] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-22T20:29:59.068502] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-22T20:29:59.069384] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-22T20:29:59.069446] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-22T20:29:59.070546] [DEBUG] [LOCAL ] OEC: Trimmed 52596 records to 37238 (keeping 200 days of data) [2025-09-22T20:29:59.296086] [DEBUG] [LOCAL ] OEC: Primary data saved (37238 records). [2025-09-22T20:29:59.296227] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-22T20:29:59.296364] [INFO ] [MAIN ] Update Progress: 1579/2372 symbols completed. OEC took 33.7s. Estimated remaining: 1h 45m 26s. Rate: 7.5 symbols/min [2025-09-22T20:29:59.471185] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:29:59.514244] [DEBUG] [LOCAL ] OGS: Loaded 34357 existing records from primary storage. [2025-09-22T20:29:59.514399] [INFO ] [MAIN ] OGS: Loaded 34357 existing records. [2025-09-22T20:29:59.690809] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:29:59.691024] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-22T20:29:59.691070] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-22T20:29:59.692102] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-22T20:29:59.692162] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-22T20:29:59.734898] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-22T20:30:00.053608] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:30:00.078516] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T20:30:00.522120] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-22T20:30:00.852750] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T20:30:00.924763] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T20:30:00.928217] [INFO ] [REMOTE ] OFG: Full fetch complete (34529 records). [2025-09-22T20:30:00.928296] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-22T20:30:01.306394] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-22T20:30:01.306729] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-22T20:30:01.307420] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-22T20:30:01.307462] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-22T20:30:01.308224] [DEBUG] [LOCAL ] OFG: Trimmed 34529 records to 22253 (keeping 200 days of data) [2025-09-22T20:30:01.365453] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-22T20:30:01.448105] [DEBUG] [LOCAL ] OFG: Primary data saved (22253 records). [2025-09-22T20:30:01.448237] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-22T20:30:01.448341] [INFO ] [MAIN ] Update Progress: 1580/2372 symbols completed. OFG took 32.8s. Estimated remaining: 1h 45m 15s. Rate: 7.5 symbols/min [2025-09-22T20:30:01.622167] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:30:01.679363] [DEBUG] [LOCAL ] OHI: Loaded 52885 existing records from primary storage. [2025-09-22T20:30:01.679520] [INFO ] [MAIN ] OHI: Loaded 52885 existing records. [2025-09-22T20:30:01.869881] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:30:01.870235] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-22T20:30:01.870400] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-22T20:30:01.877695] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-22T20:30:01.888738] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-22T20:30:01.889322] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T20:30:02.128548] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-22T20:30:02.287499] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:30:02.922030] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-22T20:30:03.234072] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T20:30:03.243877] [INFO ] [REMOTE ] OGE: Full fetch complete (66736 records). [2025-09-22T20:30:03.244037] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-22T20:30:03.648535] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-22T20:30:03.648719] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-22T20:30:03.650037] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-22T20:30:03.650108] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-22T20:30:03.651553] [DEBUG] [LOCAL ] OGE: Trimmed 66736 records to 46509 (keeping 200 days of data) [2025-09-22T20:30:03.728857] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-22T20:30:03.951291] [DEBUG] [LOCAL ] OGE: Primary data saved (46509 records). [2025-09-22T20:30:03.951431] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-22T20:30:03.951558] [INFO ] [MAIN ] Update Progress: 1581/2372 symbols completed. OGE took 34.7s. Estimated remaining: 1h 45m 4s. Rate: 7.5 symbols/min [2025-09-22T20:30:04.122287] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:30:04.171496] [DEBUG] [LOCAL ] OI: Loaded 48123 existing records from primary storage. [2025-09-22T20:30:04.171633] [INFO ] [MAIN ] OI: Loaded 48123 existing records. [2025-09-22T20:30:04.356370] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:30:04.356703] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-22T20:30:04.356772] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-22T20:30:04.357842] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-22T20:30:04.357905] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-22T20:30:04.782725] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:30:04.783162] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-22T20:30:04.801277] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-22T20:30:05.322068] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-22T20:30:06.637140] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-22T20:30:06.647530] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-22T20:30:06.972228] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T20:30:06.982564] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-22T20:30:07.040783] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (4.12 seconds). [2025-09-22T20:30:07.049763] [INFO ] [REMOTE ] OGN: Full fetch complete (76801 records). [2025-09-22T20:30:07.049952] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-22T20:30:07.457274] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-22T20:30:07.457406] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-22T20:30:07.458690] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-22T20:30:07.458784] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-22T20:30:07.470559] [DEBUG] [LOCAL ] OGN: Trimmed 76801 records to 53122 (keeping 200 days of data) [2025-09-22T20:30:07.490269] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-22T20:30:07.722760] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-22T20:30:07.835032] [DEBUG] [LOCAL ] OGN: Primary data saved (53122 records). [2025-09-22T20:30:07.835222] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-22T20:30:07.835331] [INFO ] [MAIN ] Update Progress: 1582/2372 symbols completed. OGN took 34.9s. Estimated remaining: 1h 44m 54s. Rate: 7.5 symbols/min [2025-09-22T20:30:08.037596] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:30:08.059998] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T20:30:08.083465] [DEBUG] [LOCAL ] OIA: Loaded 13944 existing records from primary storage. [2025-09-22T20:30:08.083625] [INFO ] [MAIN ] OIA: Loaded 13944 existing records. [2025-09-22T20:30:08.278278] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:30:08.278823] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-22T20:30:08.278939] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-22T20:30:08.279388] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-22T20:30:08.279453] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-22T20:30:08.430336] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T20:30:08.528308] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-22T20:30:08.708973] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:30:09.322051] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-22T20:30:09.415317] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T20:30:10.123225] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-22T20:30:10.127288] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T20:30:10.146810] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-22T20:30:10.922063] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-22T20:30:11.707491] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T20:30:11.722004] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-22T20:30:11.859435] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T20:30:12.522055] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-22T20:30:13.322043] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-22T20:30:13.379379] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T20:30:13.502154] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T20:30:14.122118] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-22T20:30:14.922090] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-22T20:30:15.147070] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-22T20:30:15.722037] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-22T20:30:16.088733] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-22T20:30:16.233032] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-22T20:30:16.522058] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-22T20:30:17.322063] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-22T20:30:18.052154] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-22T20:30:18.122008] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-22T20:30:18.450058] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T20:30:18.922062] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-22T20:30:19.463615] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-09-22T20:30:19.501599] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T20:30:19.598522] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T20:30:19.722067] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-22T20:30:20.522092] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-22T20:30:20.706851] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T20:30:21.322063] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-22T20:30:22.122139] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-22T20:30:22.197533] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T20:30:22.240926] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T20:30:22.922067] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-22T20:30:23.609560] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T20:30:23.722025] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-22T20:30:24.073475] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T20:30:24.522123] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-22T20:30:25.146944] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T20:30:25.322064] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-22T20:30:26.122096] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-22T20:30:26.400492] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T20:30:26.834857] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T20:30:26.922015] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-22T20:30:27.035615] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T20:30:27.041280] [INFO ] [REMOTE ] OGS: Full fetch complete (47810 records). [2025-09-22T20:30:27.041440] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-22T20:30:27.441668] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-22T20:30:27.441773] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-22T20:30:27.442867] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-22T20:30:27.442936] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-22T20:30:27.444272] [DEBUG] [LOCAL ] OGS: Trimmed 47810 records to 33911 (keeping 200 days of data) [2025-09-22T20:30:27.665230] [DEBUG] [LOCAL ] OGS: Primary data saved (33911 records). [2025-09-22T20:30:27.665406] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-22T20:30:27.665501] [INFO ] [MAIN ] Update Progress: 1583/2372 symbols completed. OGS took 28.4s. Estimated remaining: 1h 44m 52s. Rate: 7.5 symbols/min [2025-09-22T20:30:27.731360] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-22T20:30:27.843217] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:30:27.886280] [DEBUG] [LOCAL ] OII: Loaded 43796 existing records from primary storage. [2025-09-22T20:30:27.886438] [INFO ] [MAIN ] OII: Loaded 43796 existing records. [2025-09-22T20:30:28.066178] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:30:28.066478] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-22T20:30:28.066527] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-22T20:30:28.067428] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-22T20:30:28.067491] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-22T20:30:28.435305] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:30:28.522005] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-22T20:30:28.915021] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-22T20:30:28.961565] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T20:30:28.964500] [INFO ] [REMOTE ] OIA: Full fetch complete (20998 records). [2025-09-22T20:30:28.964602] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-22T20:30:29.330693] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-22T20:30:29.343355] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-22T20:30:29.343432] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-22T20:30:29.343889] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-22T20:30:29.344043] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-22T20:30:29.344764] [DEBUG] [LOCAL ] OIA: Trimmed 20998 records to 13892 (keeping 200 days of data) [2025-09-22T20:30:29.428476] [DEBUG] [LOCAL ] OIA: Primary data saved (13892 records). [2025-09-22T20:30:29.428690] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-22T20:30:29.428797] [INFO ] [MAIN ] Update Progress: 1584/2372 symbols completed. OIA took 21.6s. Estimated remaining: 1h 44m 41s. Rate: 7.5 symbols/min [2025-09-22T20:30:29.596584] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:30:29.634811] [DEBUG] [LOCAL ] OIS: Loaded 41515 existing records from primary storage. [2025-09-22T20:30:29.634947] [INFO ] [MAIN ] OIS: Loaded 41515 existing records. [2025-09-22T20:30:29.814425] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:30:29.814709] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-22T20:30:29.814769] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-22T20:30:29.815613] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-22T20:30:29.815705] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-22T20:30:30.126423] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-22T20:30:30.187220] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:30:30.214059] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T20:30:30.754102] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T20:30:30.922131] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-22T20:30:31.722056] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-22T20:30:31.965106] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T20:30:32.115446] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T20:30:32.522060] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-22T20:30:33.322124] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-22T20:30:33.520619] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T20:30:34.122065] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-22T20:30:34.485497] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T20:30:34.898325] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T20:30:34.922032] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-22T20:30:35.726792] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-22T20:30:35.728955] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T20:30:35.736445] [INFO ] [REMOTE ] OI: Full fetch complete (68268 records). [2025-09-22T20:30:35.736547] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-22T20:30:36.125890] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-22T20:30:36.125972] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-22T20:30:36.127000] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-22T20:30:36.127065] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-22T20:30:36.128525] [DEBUG] [LOCAL ] OI: Trimmed 68268 records to 47398 (keeping 200 days of data) [2025-09-22T20:30:36.417461] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T20:30:36.438108] [DEBUG] [LOCAL ] OI: Primary data saved (47398 records). [2025-09-22T20:30:36.438203] [INFO ] [MAIN ] OI: Full history saved. [2025-09-22T20:30:36.438277] [INFO ] [MAIN ] Update Progress: 1585/2372 symbols completed. OI took 32.5s. Estimated remaining: 1h 44m 32s. Rate: 7.5 symbols/min [2025-09-22T20:30:36.528421] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-22T20:30:36.609888] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:30:36.661280] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-22T20:30:36.661449] [INFO ] [MAIN ] OKE: Loaded 54316 existing records. [2025-09-22T20:30:36.839351] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:30:36.839600] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-22T20:30:36.839667] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-22T20:30:36.840882] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-22T20:30:36.840944] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-22T20:30:37.197695] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:30:37.327613] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-22T20:30:37.332348] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T20:30:38.122012] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-22T20:30:38.468979] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T20:30:38.922056] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-22T20:30:39.309988] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-22T20:30:39.647941] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T20:30:39.722050] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-22T20:30:40.329288] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T20:30:40.522059] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-22T20:30:41.322028] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-22T20:30:41.455369] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T20:30:42.105044] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T20:30:42.117707] [INFO ] [REMOTE ] OHI: Full fetch complete (75098 records). [2025-09-22T20:30:42.117925] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-22T20:30:42.131338] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-22T20:30:42.760091] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-22T20:30:42.760410] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-22T20:30:42.761941] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-22T20:30:42.762094] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-22T20:30:42.764086] [DEBUG] [LOCAL ] OHI: Trimmed 75098 records to 52117 (keeping 200 days of data) [2025-09-22T20:30:42.913718] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T20:30:42.922343] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-22T20:30:43.176054] [DEBUG] [LOCAL ] OHI: Primary data saved (52117 records). [2025-09-22T20:30:43.176193] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-22T20:30:43.176276] [INFO ] [MAIN ] Update Progress: 1586/2372 symbols completed. OHI took 41.7s. Estimated remaining: 1h 44m 24s. Rate: 7.5 symbols/min [2025-09-22T20:30:43.353366] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:30:43.353515] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-09-22T20:30:43.353551] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-09-22T20:30:43.353727] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-22T20:30:43.353779] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-22T20:30:43.353823] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-22T20:30:43.353873] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-22T20:30:43.711865] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:30:43.722007] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-22T20:30:43.799588] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T20:30:44.522144] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-22T20:30:44.835876] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-22T20:30:45.322057] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-22T20:30:46.071720] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T20:30:46.122021] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-22T20:30:46.460336] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-22T20:30:46.922075] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-22T20:30:47.367009] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-22T20:30:47.722056] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-22T20:30:47.852313] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T20:30:48.522064] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-22T20:30:49.322024] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-22T20:30:49.618965] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-22T20:30:49.787273] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-22T20:30:50.076493] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T20:30:50.122024] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-22T20:30:50.646243] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T20:30:50.922121] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-22T20:30:51.626742] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T20:30:51.633046] [INFO ] [REMOTE ] OII: Full fetch complete (62183 records). [2025-09-22T20:30:51.633158] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-22T20:30:51.727935] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-22T20:30:52.025608] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-22T20:30:52.025717] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-22T20:30:52.026677] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-22T20:30:52.026739] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-22T20:30:52.027945] [DEBUG] [LOCAL ] OII: Trimmed 62183 records to 43007 (keeping 200 days of data) [2025-09-22T20:30:52.286546] [DEBUG] [LOCAL ] OII: Primary data saved (43007 records). [2025-09-22T20:30:52.286705] [INFO ] [MAIN ] OII: Full history saved. [2025-09-22T20:30:52.286806] [INFO ] [MAIN ] Update Progress: 1587/2372 symbols completed. OII took 24.6s. Estimated remaining: 1h 44m 16s. Rate: 7.5 symbols/min [2025-09-22T20:30:52.460101] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:30:52.512191] [DEBUG] [LOCAL ] OLN: Loaded 52484 existing records from primary storage. [2025-09-22T20:30:52.512331] [INFO ] [MAIN ] OLN: Loaded 52484 existing records. [2025-09-22T20:30:52.544100] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-22T20:30:52.710759] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:30:52.710997] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-22T20:30:52.711077] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-22T20:30:52.712183] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-22T20:30:52.712244] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-22T20:30:53.079771] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:30:53.109109] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-22T20:30:53.322010] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-22T20:30:53.657876] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T20:30:54.122102] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-22T20:30:54.922030] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-22T20:30:55.207771] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T20:30:55.357681] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-09-22T20:30:55.635573] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T20:30:55.722007] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-22T20:30:56.477203] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T20:30:56.522077] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-22T20:30:57.322041] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-22T20:30:57.445100] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T20:30:58.122026] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-22T20:30:58.175466] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T20:30:58.922034] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-22T20:30:59.132883] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T20:30:59.722050] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-22T20:31:00.378071] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T20:31:00.522015] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-22T20:31:01.094759] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-09-22T20:31:01.322050] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-22T20:31:01.640610] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T20:31:01.802151] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T20:31:01.807904] [INFO ] [REMOTE ] OIS: Full fetch complete (56916 records). [2025-09-22T20:31:01.808080] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-22T20:31:02.123072] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-22T20:31:02.221178] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-22T20:31:02.221281] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-22T20:31:02.222333] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-22T20:31:02.222403] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-22T20:31:02.223873] [DEBUG] [LOCAL ] OIS: Trimmed 56916 records to 40688 (keeping 200 days of data) [2025-09-22T20:31:02.455259] [DEBUG] [LOCAL ] OIS: Primary data saved (40688 records). [2025-09-22T20:31:02.455507] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-22T20:31:02.455599] [INFO ] [MAIN ] Update Progress: 1588/2372 symbols completed. OIS took 33.0s. Estimated remaining: 1h 44m 10s. Rate: 7.5 symbols/min [2025-09-22T20:31:02.626774] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:31:02.637862] [DEBUG] [LOCAL ] OLP: Loaded 9774 existing records from primary storage. [2025-09-22T20:31:02.638018] [INFO ] [MAIN ] OLP: Loaded 9774 existing records. [2025-09-22T20:31:02.818613] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:31:02.818926] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-22T20:31:02.819008] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-22T20:31:02.819420] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-22T20:31:02.819547] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-22T20:31:02.922121] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-22T20:31:03.049595] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T20:31:03.238473] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:31:03.722093] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-22T20:31:04.173151] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T20:31:04.522084] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-22T20:31:04.736676] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T20:31:05.322015] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-22T20:31:05.627204] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-22T20:31:06.027404] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T20:31:06.122042] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-22T20:31:06.922056] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-22T20:31:07.265325] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-22T20:31:07.273744] [INFO ] [REMOTE ] OKE: Full fetch complete (77481 records). [2025-09-22T20:31:07.273865] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-22T20:31:07.705272] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-22T20:31:07.705432] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-22T20:31:07.706768] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-22T20:31:07.706836] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-22T20:31:07.709068] [DEBUG] [LOCAL ] OKE: Trimmed 77481 records to 53536 (keeping 200 days of data) [2025-09-22T20:31:07.773547] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-22T20:31:07.818952] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-22T20:31:08.066709] [DEBUG] [LOCAL ] OKE: Primary data saved (53536 records). [2025-09-22T20:31:08.066856] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-22T20:31:08.066944] [INFO ] [MAIN ] Update Progress: 1589/2372 symbols completed. OKE took 31.6s. Estimated remaining: 1h 44m 0s. Rate: 7.5 symbols/min [2025-09-22T20:31:08.236306] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:31:08.291026] [DEBUG] [LOCAL ] OMC: Loaded 54071 existing records from primary storage. [2025-09-22T20:31:08.291241] [INFO ] [MAIN ] OMC: Loaded 54071 existing records. [2025-09-22T20:31:08.484149] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:31:08.484483] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-22T20:31:08.484539] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-22T20:31:08.486122] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-22T20:31:08.486189] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-22T20:31:08.527167] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-22T20:31:08.949322] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:31:09.130826] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-09-22T20:31:09.200479] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T20:31:09.322038] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-22T20:31:09.490482] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T20:31:10.122050] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-22T20:31:10.922113] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-22T20:31:11.722034] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-22T20:31:11.877907] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T20:31:11.977480] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T20:31:12.019300] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-22T20:31:12.522050] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-22T20:31:13.322097] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-22T20:31:13.621948] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-22T20:31:13.654811] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T20:31:14.122049] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-22T20:31:14.922102] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-22T20:31:15.138313] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T20:31:15.722072] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-22T20:31:16.522100] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-22T20:31:16.566208] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T20:31:16.817582] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-22T20:31:17.119922] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-09-22T20:31:17.322052] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-22T20:31:18.122023] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-22T20:31:18.289232] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T20:31:18.922063] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-22T20:31:19.722034] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-22T20:31:19.803560] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T20:31:19.866016] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T20:31:20.003273] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-22T20:31:20.522058] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-22T20:31:21.322057] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-22T20:31:21.572669] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T20:31:22.122045] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-22T20:31:22.922079] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-22T20:31:23.027432] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-22T20:31:23.216715] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T20:31:23.262619] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-22T20:31:23.274262] [INFO ] [REMOTE ] OKLO: Full fetch complete (77993 records). [2025-09-22T20:31:23.274456] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-22T20:31:23.705112] [DEBUG] [VALIDATOR ] OKLO: All expected trading days are present. [2025-09-22T20:31:23.705246] [DEBUG] [VALIDATOR ] OKLO: Primary data validation passed. [2025-09-22T20:31:23.706722] [INFO ] [MAIN ] OKLO: Fetched primary data is valid. [2025-09-22T20:31:23.706804] [DEBUG] [LOCAL ] OKLO: Saving primary data. [2025-09-22T20:31:23.708477] [DEBUG] [LOCAL ] OKLO: Trimmed 77993 records to 53819 (keeping 200 days of data) [2025-09-22T20:31:23.768768] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-22T20:31:24.051750] [DEBUG] [LOCAL ] OKLO: Primary data saved (53819 records). [2025-09-22T20:31:24.051900] [INFO ] [MAIN ] OKLO: Full history saved. [2025-09-22T20:31:24.052018] [INFO ] [MAIN ] Update Progress: 1590/2372 symbols completed. OKLO took 40.9s. Estimated remaining: 1h 43m 56s. Rate: 7.5 symbols/min [2025-09-22T20:31:24.227172] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:31:24.271160] [DEBUG] [LOCAL ] OMF: Loaded 46967 existing records from primary storage. [2025-09-22T20:31:24.271338] [INFO ] [MAIN ] OMF: Loaded 46967 existing records. [2025-09-22T20:31:24.512769] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:31:24.513090] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-22T20:31:24.513169] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-22T20:31:24.514237] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-22T20:31:24.514349] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-22T20:31:24.547774] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-22T20:31:24.804447] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T20:31:24.917296] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:31:25.022211] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-22T20:31:25.322064] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-22T20:31:26.122327] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-22T20:31:26.127529] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T20:31:26.139451] [INFO ] [REMOTE ] OLN: Full fetch complete (74453 records). [2025-09-22T20:31:26.139598] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-22T20:31:26.632991] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-22T20:31:26.633150] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-22T20:31:26.635305] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-22T20:31:26.635411] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-22T20:31:26.637785] [DEBUG] [LOCAL ] OLN: Trimmed 74453 records to 51738 (keeping 200 days of data) [2025-09-22T20:31:26.939461] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-22T20:31:26.988698] [DEBUG] [LOCAL ] OLN: Primary data saved (51738 records). [2025-09-22T20:31:26.988890] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-22T20:31:26.989194] [INFO ] [MAIN ] Update Progress: 1591/2372 symbols completed. OLN took 34.7s. Estimated remaining: 1h 43m 46s. Rate: 7.5 symbols/min [2025-09-22T20:31:27.075912] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T20:31:27.112442] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T20:31:27.147263] [INFO ] [REMOTE ] OLP: Full fetch complete (13868 records). [2025-09-22T20:31:27.148852] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-22T20:31:27.325405] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:31:27.642663] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-22T20:31:27.642781] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-22T20:31:27.643452] [DEBUG] [LOCAL ] OMI: Loaded 46620 existing records from primary storage. [2025-09-22T20:31:27.643949] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-22T20:31:27.644206] [INFO ] [MAIN ] OMI: Loaded 46620 existing records. [2025-09-22T20:31:27.644135] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-22T20:31:27.726962] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-22T20:31:27.721698] [DEBUG] [LOCAL ] OLP: Trimmed 13868 records to 9647 (keeping 200 days of data) [2025-09-22T20:31:27.902572] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:31:27.904760] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-22T20:31:27.905449] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-22T20:31:27.907070] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-22T20:31:27.907161] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-22T20:31:28.212467] [DEBUG] [LOCAL ] OLP: Primary data saved (9647 records). [2025-09-22T20:31:28.218399] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-22T20:31:28.271057] [INFO ] [MAIN ] Update Progress: 1592/2372 symbols completed. OLP took 25.8s. Estimated remaining: 1h 43m 35s. Rate: 7.5 symbols/min [2025-09-22T20:31:28.298855] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:31:28.491814] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:31:28.503153] [DEBUG] [LOCAL ] ONIT: Loaded 7906 existing records from primary storage. [2025-09-22T20:31:28.503276] [INFO ] [MAIN ] ONIT: Loaded 7906 existing records. [2025-09-22T20:31:28.533815] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-22T20:31:28.679671] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T20:31:28.727441] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:31:28.727735] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-22T20:31:28.727794] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-22T20:31:28.728951] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-22T20:31:28.729065] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-22T20:31:29.100099] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:31:29.322055] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-22T20:31:29.715352] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-22T20:31:30.080260] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T20:31:30.122081] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-22T20:31:30.922033] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-22T20:31:31.119066] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-22T20:31:31.722055] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-22T20:31:32.168512] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T20:31:32.299485] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T20:31:32.522050] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-22T20:31:33.272731] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T20:31:33.322017] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-22T20:31:34.122088] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-22T20:31:34.187035] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-22T20:31:34.565691] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-22T20:31:34.922073] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-22T20:31:35.722091] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-22T20:31:36.033150] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T20:31:36.348396] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T20:31:36.522186] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-22T20:31:36.665011] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T20:31:37.322060] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-22T20:31:38.122039] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-22T20:31:38.155111] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T20:31:38.327548] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T20:31:38.922121] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-22T20:31:39.722134] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-22T20:31:39.798842] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T20:31:39.809100] [INFO ] [REMOTE ] OMC: Full fetch complete (76782 records). [2025-09-22T20:31:39.809227] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-22T20:31:40.223751] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-22T20:31:40.223833] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-22T20:31:40.224910] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-22T20:31:40.224997] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-22T20:31:40.229233] [DEBUG] [LOCAL ] OMC: Trimmed 76782 records to 53293 (keeping 200 days of data) [2025-09-22T20:31:40.533056] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-22T20:31:40.586174] [DEBUG] [LOCAL ] OMC: Primary data saved (53293 records). [2025-09-22T20:31:40.586312] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-22T20:31:40.586428] [INFO ] [MAIN ] Update Progress: 1593/2372 symbols completed. OMC took 32.5s. Estimated remaining: 1h 43m 29s. Rate: 7.5 symbols/min [2025-09-22T20:31:40.803405] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:31:40.806228] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T20:31:40.849399] [DEBUG] [LOCAL ] ONL: Loaded 32574 existing records from primary storage. [2025-09-22T20:31:40.849542] [INFO ] [MAIN ] ONL: Loaded 32574 existing records. [2025-09-22T20:31:41.044735] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:31:41.045018] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-22T20:31:41.045066] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-22T20:31:41.046154] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-22T20:31:41.046226] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-22T20:31:41.324422] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-22T20:31:41.435012] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:31:41.437245] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T20:31:41.493934] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T20:31:42.122094] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-22T20:31:42.672601] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-22T20:31:42.922039] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-22T20:31:43.102194] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T20:31:43.722051] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-22T20:31:43.863924] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T20:31:44.522076] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-22T20:31:45.039985] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T20:31:45.240107] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T20:31:45.322077] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-22T20:31:46.122113] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-22T20:31:46.698602] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T20:31:46.724588] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T20:31:46.922132] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-22T20:31:47.722083] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-22T20:31:48.522072] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-22T20:31:48.778581] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T20:31:48.827438] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T20:31:49.322094] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-22T20:31:49.404881] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T20:31:50.122056] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-22T20:31:50.925828] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-22T20:31:50.931084] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T20:31:50.950110] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T20:31:50.952286] [INFO ] [REMOTE ] ONIT: Full fetch complete (11259 records). [2025-09-22T20:31:50.952404] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-22T20:31:51.355611] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-22T20:31:51.355719] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-22T20:31:51.355994] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-22T20:31:51.356033] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-22T20:31:51.356490] [DEBUG] [LOCAL ] ONIT: Trimmed 11259 records to 7805 (keeping 200 days of data) [2025-09-22T20:31:51.417098] [DEBUG] [LOCAL ] ONIT: Primary data saved (7805 records). [2025-09-22T20:31:51.417274] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-22T20:31:51.417435] [INFO ] [MAIN ] Update Progress: 1594/2372 symbols completed. ONIT took 23.1s. Estimated remaining: 1h 43m 22s. Rate: 7.5 symbols/min [2025-09-22T20:31:51.605748] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:31:51.670473] [DEBUG] [LOCAL ] ONON: Loaded 54393 existing records from primary storage. [2025-09-22T20:31:51.670694] [INFO ] [MAIN ] ONON: Loaded 54393 existing records. [2025-09-22T20:31:51.735038] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-22T20:31:51.858775] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:31:51.859058] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-22T20:31:51.859106] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-22T20:31:51.860229] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-22T20:31:51.860290] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-22T20:31:52.244121] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:31:52.432728] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T20:31:52.522087] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-22T20:31:53.322108] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-22T20:31:53.375735] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T20:31:54.122043] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-22T20:31:54.922029] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-22T20:31:55.426492] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-22T20:31:55.722067] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-22T20:31:55.909160] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-22T20:31:56.522077] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-22T20:31:56.671983] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-22T20:31:57.322061] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-22T20:31:57.496859] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-22T20:31:57.615287] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-22T20:31:58.124307] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-22T20:31:58.129212] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T20:31:58.922064] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-22T20:31:58.984969] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T20:31:59.702750] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T20:31:59.711370] [INFO ] [REMOTE ] OMI: Full fetch complete (63654 records). [2025-09-22T20:31:59.711499] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-22T20:31:59.727147] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-22T20:32:00.124337] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-22T20:32:00.124498] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-22T20:32:00.125832] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-22T20:32:00.125949] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-22T20:32:00.127826] [DEBUG] [LOCAL ] OMI: Trimmed 63654 records to 45856 (keeping 200 days of data) [2025-09-22T20:32:00.149210] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T20:32:00.413291] [DEBUG] [LOCAL ] OMI: Primary data saved (45856 records). [2025-09-22T20:32:00.413426] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-22T20:32:00.413539] [INFO ] [MAIN ] Update Progress: 1595/2372 symbols completed. OMI took 33.4s. Estimated remaining: 1h 43m 15s. Rate: 7.5 symbols/min [2025-09-22T20:32:00.527158] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-22T20:32:00.590993] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:32:00.615836] [DEBUG] [LOCAL ] ONTF: Loaded 23403 existing records from primary storage. [2025-09-22T20:32:00.615990] [INFO ] [MAIN ] ONTF: Loaded 23403 existing records. [2025-09-22T20:32:00.800742] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:32:00.801033] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-22T20:32:00.801083] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-22T20:32:00.801923] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-22T20:32:00.801985] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-22T20:32:01.166459] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:32:01.322097] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-22T20:32:01.717550] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-22T20:32:02.122044] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-22T20:32:02.212375] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T20:32:02.272193] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-22T20:32:02.922090] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-22T20:32:03.722048] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-22T20:32:04.063916] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T20:32:04.336259] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-22T20:32:04.522068] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-22T20:32:04.999533] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-22T20:32:05.322075] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-22T20:32:06.122048] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-22T20:32:06.572870] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-22T20:32:06.875918] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T20:32:06.884910] [INFO ] [REMOTE ] OMF: Full fetch complete (66560 records). [2025-09-22T20:32:06.885148] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-22T20:32:06.930132] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-22T20:32:07.339530] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T20:32:07.433029] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-22T20:32:07.433148] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-22T20:32:07.434989] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-22T20:32:07.435084] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-22T20:32:07.437172] [DEBUG] [LOCAL ] OMF: Trimmed 66560 records to 46269 (keeping 200 days of data) [2025-09-22T20:32:07.722447] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-22T20:32:07.779616] [DEBUG] [LOCAL ] OMF: Primary data saved (46269 records). [2025-09-22T20:32:07.779849] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-22T20:32:07.779992] [INFO ] [MAIN ] Update Progress: 1596/2372 symbols completed. OMF took 43.7s. Estimated remaining: 1h 43m 7s. Rate: 7.5 symbols/min [2025-09-22T20:32:07.962013] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:32:08.015720] [DEBUG] [LOCAL ] ONTO: Loaded 47235 existing records from primary storage. [2025-09-22T20:32:08.015969] [INFO ] [MAIN ] ONTO: Loaded 47235 existing records. [2025-09-22T20:32:08.205369] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:32:08.205748] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-22T20:32:08.205821] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-22T20:32:08.207143] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-22T20:32:08.207206] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-22T20:32:08.388701] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T20:32:08.527225] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-22T20:32:08.626793] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:32:09.322085] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-22T20:32:09.839859] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T20:32:10.027067] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-22T20:32:10.122006] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-22T20:32:10.425291] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-22T20:32:10.431278] [INFO ] [REMOTE ] ONL: Full fetch complete (43708 records). [2025-09-22T20:32:10.431429] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-22T20:32:10.822794] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-22T20:32:10.822898] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-22T20:32:10.824679] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-22T20:32:10.824753] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-22T20:32:10.825843] [DEBUG] [LOCAL ] ONL: Trimmed 43708 records to 32082 (keeping 200 days of data) [2025-09-22T20:32:10.922971] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-22T20:32:11.025371] [DEBUG] [LOCAL ] ONL: Primary data saved (32082 records). [2025-09-22T20:32:11.025537] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-22T20:32:11.025636] [INFO ] [MAIN ] Update Progress: 1597/2372 symbols completed. ONL took 30.4s. Estimated remaining: 1h 42m 56s. Rate: 7.5 symbols/min [2025-09-22T20:32:11.722081] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-22T20:32:11.931762] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T20:32:12.224491] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-22T20:32:12.522084] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-22T20:32:13.011980] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T20:32:13.322089] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-22T20:32:14.122035] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-22T20:32:14.456620] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T20:32:14.511735] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-22T20:32:14.922111] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-22T20:32:15.722074] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-22T20:32:15.933421] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T20:32:16.522116] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-22T20:32:16.985299] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T20:32:17.169545] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-22T20:32:17.322009] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-22T20:32:18.122015] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-22T20:32:18.280026] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T20:32:18.922016] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-22T20:32:18.956830] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T20:32:18.965101] [INFO ] [REMOTE ] ONON: Full fetch complete (77559 records). [2025-09-22T20:32:18.965242] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-22T20:32:19.378431] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-22T20:32:19.379482] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T20:32:19.379567] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-22T20:32:19.386001] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-22T20:32:19.386371] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-22T20:32:19.387803] [DEBUG] [LOCAL ] ONON: Trimmed 77559 records to 53613 (keeping 200 days of data) [2025-09-22T20:32:19.716284] [DEBUG] [LOCAL ] ONON: Primary data saved (53613 records). [2025-09-22T20:32:19.716457] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-22T20:32:19.716580] [INFO ] [MAIN ] Update Progress: 1598/2372 symbols completed. ONON took 28.3s. Estimated remaining: 1h 42m 49s. Rate: 7.5 symbols/min [2025-09-22T20:32:19.722058] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-22T20:32:20.701031] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T20:32:20.710789] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-22T20:32:20.855926] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-22T20:32:21.322057] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-22T20:32:22.469775] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T20:32:22.480224] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-22T20:32:22.513741] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T20:32:22.518209] [INFO ] [REMOTE ] ONTF: Full fetch complete (31915 records). [2025-09-22T20:32:22.518302] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-22T20:32:22.938332] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-22T20:32:22.938419] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-22T20:32:22.939079] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-22T20:32:22.939142] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-22T20:32:22.940046] [DEBUG] [LOCAL ] ONTF: Trimmed 31915 records to 23020 (keeping 200 days of data) [2025-09-22T20:32:23.070114] [DEBUG] [LOCAL ] ONTF: Primary data saved (23020 records). [2025-09-22T20:32:23.070259] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-22T20:32:23.070350] [INFO ] [MAIN ] Update Progress: 1599/2372 symbols completed. ONTF took 22.7s. Estimated remaining: 1h 42m 39s. Rate: 7.5 symbols/min [2025-09-22T20:32:24.455608] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T20:32:24.467889] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-22T20:32:26.831613] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-22T20:32:26.841406] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-22T20:32:29.005333] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-22T20:32:29.019446] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-22T20:32:30.872092] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T20:32:30.882350] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-22T20:32:32.589480] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T20:32:32.601497] [INFO ] [REMOTE ] ONTO: Full fetch complete (65477 records). [2025-09-22T20:32:32.601776] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-22T20:32:32.996687] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-22T20:32:32.996782] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-22T20:32:32.997808] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-22T20:32:32.997872] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-22T20:32:32.999267] [DEBUG] [LOCAL ] ONTO: Trimmed 65477 records to 46581 (keeping 200 days of data) [2025-09-22T20:32:33.274548] [DEBUG] [LOCAL ] ONTO: Primary data saved (46581 records). [2025-09-22T20:32:33.274708] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-22T20:32:33.274804] [INFO ] [MAIN ] Update Progress: 1600/2372 symbols completed. ONTO took 25.5s. Estimated remaining: 1h 42m 32s. Rate: 7.5 symbols/min [2025-09-22T20:32:33.900548] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:32:33.908902] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:32:33.976417] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:32:33.995512] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:32:34.017954] [DEBUG] [LOCAL ] OPP: Loaded 11926 existing records from primary storage. [2025-09-22T20:32:34.024679] [DEBUG] [LOCAL ] OOMA: Loaded 19448 existing records from primary storage. [2025-09-22T20:32:34.024794] [INFO ] [MAIN ] OPP: Loaded 11926 existing records. [2025-09-22T20:32:34.024863] [INFO ] [MAIN ] OOMA: Loaded 19448 existing records. [2025-09-22T20:32:34.094361] [DEBUG] [LOCAL ] OPAD: Loaded 19367 existing records from primary storage. [2025-09-22T20:32:34.120798] [INFO ] [MAIN ] OPAD: Loaded 19367 existing records. [2025-09-22T20:32:34.366431] [DEBUG] [LOCAL ] OPFI: Loaded 47512 existing records from primary storage. [2025-09-22T20:32:34.435559] [INFO ] [MAIN ] OPFI: Loaded 47512 existing records. [2025-09-22T20:32:34.679520] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:32:34.709757] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:32:34.732740] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:32:34.759112] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-22T20:32:34.759269] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-22T20:32:34.764949] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-22T20:32:34.770563] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-22T20:32:34.775830] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-22T20:32:34.775717] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-22T20:32:34.781160] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-22T20:32:34.799765] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-22T20:32:34.872029] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-22T20:32:34.872128] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:32:34.887854] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-22T20:32:34.902707] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-22T20:32:34.942044] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-22T20:32:34.947282] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-22T20:32:34.957747] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-22T20:32:34.996709] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-22T20:32:35.057735] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-22T20:32:36.198872] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:32:36.274218] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:32:36.265502] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-22T20:32:36.298419] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-22T20:32:36.395056] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:32:36.399596] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:32:36.400215] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-22T20:32:36.402170] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-22T20:32:37.219217] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-22T20:32:37.221958] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-22T20:32:37.306132] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T20:32:37.310857] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-22T20:32:37.535575] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T20:32:37.543097] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-22T20:32:37.590035] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T20:32:37.594548] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-22T20:32:38.061135] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T20:32:38.062971] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-22T20:32:38.256180] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T20:32:38.259537] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-22T20:32:38.277027] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T20:32:38.279996] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-22T20:32:38.655139] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T20:32:38.657043] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-22T20:32:39.104277] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T20:32:39.107216] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-22T20:32:39.174489] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T20:32:39.176637] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-22T20:32:39.285095] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T20:32:39.288599] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-22T20:32:39.491791] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T20:32:39.501929] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-22T20:32:39.662672] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-22T20:32:39.664995] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-22T20:32:39.975313] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-22T20:32:39.978335] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-22T20:32:40.369811] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T20:32:40.483182] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T20:32:40.522029] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-22T20:32:40.954238] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-22T20:32:41.322010] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-22T20:32:41.371637] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-22T20:32:41.411992] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T20:32:42.122083] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-22T20:32:42.167743] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T20:32:42.922057] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-22T20:32:43.098286] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-22T20:32:43.722079] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-22T20:32:44.320379] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T20:32:44.383200] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T20:32:44.522067] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-22T20:32:45.322073] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-22T20:32:45.357325] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T20:32:46.122110] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-22T20:32:46.854567] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T20:32:46.922007] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-22T20:32:47.722028] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-22T20:32:47.962113] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T20:32:48.522065] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-22T20:32:48.689259] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T20:32:48.796726] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T20:32:49.300889] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T20:32:49.322006] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-22T20:32:50.122052] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-22T20:32:50.223347] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T20:32:50.922070] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-22T20:32:51.722089] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-22T20:32:51.998363] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T20:32:52.264359] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-22T20:32:52.267060] [INFO ] [REMOTE ] OPP: Full fetch complete (17818 records). [2025-09-22T20:32:52.267185] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-22T20:32:52.534311] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-22T20:32:52.667796] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-22T20:32:52.667907] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-22T20:32:52.668428] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-22T20:32:52.668475] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-22T20:32:52.669439] [DEBUG] [LOCAL ] OPP: Trimmed 17818 records to 11679 (keeping 200 days of data) [2025-09-22T20:32:52.749227] [DEBUG] [LOCAL ] OPP: Primary data saved (11679 records). [2025-09-22T20:32:52.749449] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-22T20:32:52.749568] [INFO ] [MAIN ] Update Progress: 1601/2372 symbols completed. OPP took 19.5s. Estimated remaining: 1h 42m 29s. Rate: 7.5 symbols/min [2025-09-22T20:32:52.954235] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:32:52.954829] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-22T20:32:52.954891] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-22T20:32:52.955077] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-22T20:32:52.955146] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-22T20:32:52.955262] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-22T20:32:52.955314] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-22T20:32:53.329410] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-22T20:32:53.381685] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-22T20:32:53.379254] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:32:53.391454] [INFO ] [REMOTE ] OPAD: Full fetch complete (22531 records). [2025-09-22T20:32:53.391550] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-22T20:32:53.764176] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-22T20:32:53.764265] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-22T20:32:53.764792] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-22T20:32:53.764855] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-22T20:32:53.765664] [DEBUG] [LOCAL ] OPAD: Trimmed 22531 records to 19413 (keeping 200 days of data) [2025-09-22T20:32:53.878544] [DEBUG] [LOCAL ] OPAD: Primary data saved (19413 records). [2025-09-22T20:32:53.878719] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-22T20:32:53.878822] [INFO ] [MAIN ] Update Progress: 1602/2372 symbols completed. OPAD took 20.6s. Estimated remaining: 1h 42m 18s. Rate: 7.5 symbols/min [2025-09-22T20:32:54.056972] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:32:54.101380] [DEBUG] [LOCAL ] OR: Loaded 46633 existing records from primary storage. [2025-09-22T20:32:54.101531] [INFO ] [MAIN ] OR: Loaded 46633 existing records. [2025-09-22T20:32:54.132730] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-22T20:32:54.289491] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:32:54.289959] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-22T20:32:54.290190] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-22T20:32:54.292017] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-22T20:32:54.292087] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-22T20:32:54.580933] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-22T20:32:54.639109] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T20:32:54.722861] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:32:54.922066] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-22T20:32:54.984713] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T20:32:55.722128] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-22T20:32:56.522053] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-22T20:32:56.586552] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T20:32:56.639414] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T20:32:57.322066] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-22T20:32:58.122050] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-22T20:32:58.169086] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T20:32:58.188842] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T20:32:58.192267] [INFO ] [REMOTE ] OOMA: Full fetch complete (26495 records). [2025-09-22T20:32:58.192354] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-22T20:32:58.599541] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-22T20:32:58.599616] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-22T20:32:58.600183] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-22T20:32:58.600239] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-22T20:32:58.600947] [DEBUG] [LOCAL ] OOMA: Trimmed 26495 records to 19185 (keeping 200 days of data) [2025-09-22T20:32:58.717604] [DEBUG] [LOCAL ] OOMA: Primary data saved (19185 records). [2025-09-22T20:32:58.717809] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-22T20:32:58.717907] [INFO ] [MAIN ] Update Progress: 1603/2372 symbols completed. OOMA took 25.4s. Estimated remaining: 1h 42m 8s. Rate: 7.5 symbols/min [2025-09-22T20:32:58.907507] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:32:58.908703] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T20:32:58.922001] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-22T20:32:58.946989] [DEBUG] [LOCAL ] ORA: Loaded 33165 existing records from primary storage. [2025-09-22T20:32:58.947152] [INFO ] [MAIN ] ORA: Loaded 33165 existing records. [2025-09-22T20:32:59.130583] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:32:59.130919] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-22T20:32:59.130976] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-22T20:32:59.132119] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-22T20:32:59.132181] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-22T20:32:59.488291] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:32:59.716094] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T20:32:59.721995] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-22T20:33:00.387898] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T20:33:00.522085] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-22T20:33:01.322063] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-22T20:33:01.389160] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T20:33:02.122093] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-22T20:33:02.922105] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-22T20:33:03.063821] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T20:33:03.663817] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T20:33:03.722071] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-22T20:33:04.522060] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-22T20:33:04.542244] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T20:33:04.803569] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T20:33:05.322070] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-22T20:33:06.056043] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T20:33:06.122062] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-22T20:33:06.919681] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T20:33:06.927521] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-22T20:33:07.722102] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-22T20:33:07.797788] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-22T20:33:07.852256] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T20:33:07.859608] [INFO ] [REMOTE ] OPFI: Full fetch complete (67328 records). [2025-09-22T20:33:07.859765] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-22T20:33:08.266701] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-22T20:33:08.266801] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-22T20:33:08.267865] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-22T20:33:08.267932] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-22T20:33:08.269407] [DEBUG] [LOCAL ] OPFI: Trimmed 67328 records to 46680 (keeping 200 days of data) [2025-09-22T20:33:08.532318] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-22T20:33:08.563362] [DEBUG] [LOCAL ] OPFI: Primary data saved (46680 records). [2025-09-22T20:33:08.563553] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-22T20:33:08.563678] [INFO ] [MAIN ] Update Progress: 1604/2372 symbols completed. OPFI took 35.3s. Estimated remaining: 1h 42m 1s. Rate: 7.5 symbols/min [2025-09-22T20:33:08.738398] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:33:08.791046] [DEBUG] [LOCAL ] ORC: Loaded 53032 existing records from primary storage. [2025-09-22T20:33:08.791248] [INFO ] [MAIN ] ORC: Loaded 53032 existing records. [2025-09-22T20:33:08.970818] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:33:08.971101] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-22T20:33:08.971159] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-22T20:33:08.972446] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-22T20:33:08.972509] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-22T20:33:09.324493] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-22T20:33:09.349050] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:33:09.370040] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T20:33:09.383764] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-22T20:33:10.122058] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-22T20:33:10.922065] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-22T20:33:11.128923] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T20:33:11.188047] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T20:33:11.689122] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T20:33:11.722003] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-22T20:33:12.522072] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-22T20:33:12.615764] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T20:33:12.618679] [INFO ] [REMOTE ] OPY: Full fetch complete (10121 records). [2025-09-22T20:33:12.618785] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-22T20:33:12.810026] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T20:33:12.810346] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:33:12.810416] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:33:12.810487] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-22T20:33:12.810564] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-22T20:33:12.810620] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-22T20:33:12.810699] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-22T20:33:12.810773] [INFO ] [MAIN ] Update Progress: 1605/2372 symbols completed. OPY took 20.1s. Estimated remaining: 1h 41m 52s. Rate: 7.5 symbols/min [2025-09-22T20:33:12.984221] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:33:12.984454] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-22T20:33:12.984509] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-22T20:33:12.984680] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-22T20:33:12.984733] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-22T20:33:12.984775] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-22T20:33:12.984807] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-22T20:33:13.328906] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-22T20:33:13.352177] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:33:14.045919] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T20:33:14.122020] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-22T20:33:14.922059] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-22T20:33:15.722071] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-22T20:33:15.908508] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-22T20:33:16.318089] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-22T20:33:16.522101] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-22T20:33:17.322107] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-22T20:33:17.802516] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-22T20:33:18.122128] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-22T20:33:18.255567] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (3.33 seconds). [2025-09-22T20:33:18.683511] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-22T20:33:18.806195] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T20:33:18.922097] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-22T20:33:19.722044] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-22T20:33:20.229481] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-22T20:33:20.522091] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-22T20:33:20.571091] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T20:33:21.322069] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-22T20:33:22.122067] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-22T20:33:22.365350] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-22T20:33:22.497616] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-22T20:33:22.639126] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T20:33:22.922053] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-22T20:33:23.722083] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-22T20:33:23.845425] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T20:33:24.166305] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T20:33:24.522100] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-22T20:33:25.322079] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-22T20:33:25.894434] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T20:33:25.899799] [INFO ] [REMOTE ] ORA: Full fetch complete (49360 records). [2025-09-22T20:33:25.899931] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-22T20:33:26.122532] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-22T20:33:26.291014] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-22T20:33:26.291232] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-22T20:33:26.292364] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-22T20:33:26.292456] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-22T20:33:26.293951] [DEBUG] [LOCAL ] ORA: Trimmed 49360 records to 32632 (keeping 200 days of data) [2025-09-22T20:33:26.417086] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-22T20:33:26.552253] [DEBUG] [LOCAL ] ORA: Primary data saved (32632 records). [2025-09-22T20:33:26.552409] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-22T20:33:26.552499] [INFO ] [MAIN ] Update Progress: 1606/2372 symbols completed. ORA took 27.8s. Estimated remaining: 1h 41m 46s. Rate: 7.5 symbols/min [2025-09-22T20:33:26.733901] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:33:26.734105] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-22T20:33:26.734162] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-22T20:33:26.734318] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-22T20:33:26.734361] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-22T20:33:26.734402] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-22T20:33:26.734434] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-22T20:33:26.923316] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-22T20:33:27.098679] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:33:27.539256] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-22T20:33:27.722068] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-22T20:33:28.522053] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-22T20:33:28.714229] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-22T20:33:29.322075] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-22T20:33:29.658375] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-22T20:33:29.666301] [INFO ] [REMOTE ] OR: Full fetch complete (64893 records). [2025-09-22T20:33:29.666448] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-22T20:33:30.078409] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-22T20:33:30.078593] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-22T20:33:30.079977] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-22T20:33:30.080062] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-22T20:33:30.106376] [DEBUG] [LOCAL ] OR: Trimmed 64893 records to 45994 (keeping 200 days of data) [2025-09-22T20:33:30.107853] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T20:33:30.121999] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-22T20:33:30.406851] [DEBUG] [LOCAL ] OR: Primary data saved (45994 records). [2025-09-22T20:33:30.406994] [INFO ] [MAIN ] OR: Full history saved. [2025-09-22T20:33:30.407154] [INFO ] [MAIN ] Update Progress: 1607/2372 symbols completed. OR took 36.5s. Estimated remaining: 1h 41m 36s. Rate: 7.5 symbols/min [2025-09-22T20:33:30.583964] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:33:30.616844] [DEBUG] [LOCAL ] ORN: Loaded 32390 existing records from primary storage. [2025-09-22T20:33:30.616989] [INFO ] [MAIN ] ORN: Loaded 32390 existing records. [2025-09-22T20:33:30.814892] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:33:30.815365] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-22T20:33:30.815548] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-22T20:33:30.816605] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-22T20:33:30.816708] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-22T20:33:31.223672] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:33:31.167359] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (4.24 seconds). [2025-09-22T20:33:31.235377] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-22T20:33:31.507658] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-22T20:33:31.639812] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T20:33:31.722081] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-22T20:33:32.522097] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-22T20:33:32.559936] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T20:33:33.322064] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-22T20:33:34.122026] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-22T20:33:34.354758] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-22T20:33:34.472040] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T20:33:34.814252] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T20:33:34.922047] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-22T20:33:35.495797] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T20:33:35.722059] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-22T20:33:36.522041] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-22T20:33:36.923295] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T20:33:37.217206] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-22T20:33:37.322065] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-22T20:33:38.122037] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-22T20:33:38.497764] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-22T20:33:38.796845] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T20:33:38.922155] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-22T20:33:39.722180] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-22T20:33:40.217505] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-22T20:33:40.522135] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-22T20:33:40.719692] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T20:33:41.322089] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-22T20:33:42.122040] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-22T20:33:42.166773] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-22T20:33:42.597519] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-22T20:33:42.710981] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T20:33:42.922071] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-22T20:33:43.091951] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T20:33:43.722117] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-22T20:33:44.522125] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-22T20:33:45.322084] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-22T20:33:45.998367] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-22T20:33:46.100313] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (3.18 seconds). [2025-09-22T20:33:46.127126] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-22T20:33:46.139357] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T20:33:46.922127] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-22T20:33:47.591429] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-22T20:33:47.599785] [INFO ] [REMOTE ] ORC: Full fetch complete (75111 records). [2025-09-22T20:33:47.600019] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-22T20:33:47.725812] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-22T20:33:47.798609] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T20:33:48.054810] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-22T20:33:48.054932] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-22T20:33:48.058026] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-22T20:33:48.058179] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-22T20:33:48.062823] [DEBUG] [LOCAL ] ORC: Trimmed 75111 records to 52290 (keeping 200 days of data) [2025-09-22T20:33:48.388037] [DEBUG] [LOCAL ] ORC: Primary data saved (52290 records). [2025-09-22T20:33:48.388177] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-22T20:33:48.388304] [INFO ] [MAIN ] Update Progress: 1608/2372 symbols completed. ORC took 39.8s. Estimated remaining: 1h 41m 33s. Rate: 7.5 symbols/min [2025-09-22T20:33:48.530609] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-22T20:33:48.566491] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:33:48.625257] [DEBUG] [LOCAL ] OSCR: Loaded 54475 existing records from primary storage. [2025-09-22T20:33:48.625427] [INFO ] [MAIN ] OSCR: Loaded 54475 existing records. [2025-09-22T20:33:48.836233] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:33:48.854508] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-22T20:33:48.856184] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T20:33:48.855076] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-22T20:33:48.868056] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-22T20:33:48.868172] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-22T20:33:49.223950] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:33:49.322010] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-22T20:33:49.988985] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T20:33:50.122061] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-22T20:33:50.588084] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-22T20:33:50.922025] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-22T20:33:51.421872] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-22T20:33:51.498408] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T20:33:51.722065] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-22T20:33:52.025604] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T20:33:52.522060] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-22T20:33:53.322073] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-22T20:33:53.719436] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T20:33:53.725064] [INFO ] [REMOTE ] ORN: Full fetch complete (45738 records). [2025-09-22T20:33:53.725170] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-22T20:33:54.127110] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-22T20:33:54.145880] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-22T20:33:54.146017] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-22T20:33:54.147109] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-22T20:33:54.147340] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-22T20:33:54.149772] [DEBUG] [LOCAL ] ORN: Trimmed 45738 records to 31755 (keeping 200 days of data) [2025-09-22T20:33:54.291631] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-22T20:33:54.403830] [DEBUG] [LOCAL ] ORN: Primary data saved (31755 records). [2025-09-22T20:33:54.404022] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-22T20:33:54.404222] [INFO ] [MAIN ] Update Progress: 1609/2372 symbols completed. ORN took 24.0s. Estimated remaining: 1h 41m 24s. Rate: 7.5 symbols/min [2025-09-22T20:33:54.613323] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:33:54.613836] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-22T20:33:54.613894] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-22T20:33:54.614164] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-22T20:33:54.614223] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-22T20:33:54.614267] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-22T20:33:54.614300] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-22T20:33:54.929874] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-22T20:33:55.081667] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:33:55.170173] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-22T20:33:55.722117] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-22T20:33:55.854080] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T20:33:55.864075] [INFO ] [REMOTE ] ORI: Full fetch complete (70086 records). [2025-09-22T20:33:55.864507] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-22T20:33:56.084720] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T20:33:56.085632] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:33:56.085731] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:33:56.085785] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-22T20:33:56.085861] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-22T20:33:56.085899] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-22T20:33:56.085941] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-22T20:33:56.086023] [INFO ] [MAIN ] Update Progress: 1610/2372 symbols completed. ORI took 29.5s. Estimated remaining: 1h 41m 13s. Rate: 7.5 symbols/min [2025-09-22T20:33:56.253933] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:33:56.254166] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-22T20:33:56.254228] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-22T20:33:56.254380] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-22T20:33:56.254421] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-22T20:33:56.254461] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-22T20:33:56.254492] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-22T20:33:56.534681] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-22T20:33:56.625510] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:33:57.322080] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-22T20:33:57.445608] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-22T20:33:57.454765] [INFO ] [REMOTE ] ORCL: Full fetch complete (77532 records). [2025-09-22T20:33:57.454978] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-22T20:33:57.578253] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:33:57.578756] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-22T20:33:57.686697] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T20:33:57.687750] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:33:57.687829] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:33:57.687903] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-22T20:33:57.687976] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-22T20:33:57.688013] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-22T20:33:57.688055] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-22T20:33:57.688128] [INFO ] [MAIN ] Update Progress: 1611/2372 symbols completed. ORCL took 44.9s. Estimated remaining: 1h 41m 2s. Rate: 7.5 symbols/min [2025-09-22T20:33:57.876078] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:33:57.908041] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-22T20:33:57.973447] [DEBUG] [LOCAL ] OTIS: Loaded 53491 existing records from primary storage. [2025-09-22T20:33:57.973602] [INFO ] [MAIN ] OTIS: Loaded 53491 existing records. [2025-09-22T20:33:58.130137] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-22T20:33:58.153375] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:33:58.153686] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-22T20:33:58.153851] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-22T20:33:58.156261] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-22T20:33:58.156327] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-22T20:33:58.290321] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T20:33:58.551748] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:33:58.922130] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-09-22T20:33:59.210965] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:33:59.211421] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-09-22T20:33:59.722060] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-22T20:34:00.268450] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-22T20:34:00.522080] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-22T20:34:01.322036] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-22T20:34:01.499369] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T20:34:01.577257] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:34:01.577540] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-22T20:34:02.122028] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-22T20:34:02.302390] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T20:34:02.922091] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-22T20:34:03.722054] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-22T20:34:03.959998] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T20:34:04.522041] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-22T20:34:04.699279] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T20:34:05.322031] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-22T20:34:05.416050] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T20:34:06.122109] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-22T20:34:06.439969] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:34:06.460099] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-22T20:34:06.464215] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T20:34:06.922100] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-22T20:34:07.232866] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-22T20:34:07.722086] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-22T20:34:07.994342] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:34:07.994700] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-22T20:34:08.522066] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-22T20:34:08.596753] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T20:34:08.799409] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:34:08.799768] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-22T20:34:09.322060] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-22T20:34:10.122075] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-22T20:34:10.922047] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-22T20:34:11.030440] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-22T20:34:11.265092] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T20:34:11.722113] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-22T20:34:12.522082] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-22T20:34:12.716154] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T20:34:13.322040] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-22T20:34:14.122063] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-22T20:34:14.350244] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-22T20:34:14.742414] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-22T20:34:14.922050] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-22T20:34:14.931907] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-22T20:34:15.066500] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-22T20:34:15.722130] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-22T20:34:16.522095] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-22T20:34:16.933131] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T20:34:17.322120] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-22T20:34:17.502356] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T20:34:18.122121] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-22T20:34:18.638493] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-09-22T20:34:18.685012] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T20:34:18.922058] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-22T20:34:18.944468] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T20:34:18.949678] [INFO ] [REMOTE ] OTF: Full fetch complete (8051 records). [2025-09-22T20:34:18.949768] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-22T20:34:19.131687] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 70 unique days, need 200 days [2025-09-22T20:34:19.131978] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:34:19.132065] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:34:19.132148] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-22T20:34:19.132259] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-22T20:34:19.132331] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-22T20:34:19.132435] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-22T20:34:19.132553] [INFO ] [MAIN ] Update Progress: 1612/2372 symbols completed. OTF took 23.0s. Estimated remaining: 1h 41m 1s. Rate: 7.5 symbols/min [2025-09-22T20:34:19.315353] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:34:19.371925] [DEBUG] [LOCAL ] OUT: Loaded 48911 existing records from primary storage. [2025-09-22T20:34:19.372080] [INFO ] [MAIN ] OUT: Loaded 48911 existing records. [2025-09-22T20:34:19.566913] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:34:19.567185] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-22T20:34:19.567234] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-22T20:34:19.568971] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-22T20:34:19.569032] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-22T20:34:19.743487] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-22T20:34:19.928664] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:34:20.522126] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-22T20:34:21.322080] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-22T20:34:21.464958] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T20:34:21.626688] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-22T20:34:22.122062] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-22T20:34:22.215353] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T20:34:22.922036] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-22T20:34:23.243490] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T20:34:23.722060] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-22T20:34:24.269956] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T20:34:24.455719] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-22T20:34:24.465703] [INFO ] [REMOTE ] OSCR: Full fetch complete (77478 records). [2025-09-22T20:34:24.465837] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-22T20:34:24.529679] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-22T20:34:24.863244] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-22T20:34:24.863336] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-22T20:34:24.864424] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-22T20:34:24.864489] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-22T20:34:24.867266] [DEBUG] [LOCAL ] OSCR: Trimmed 77478 records to 53722 (keeping 200 days of data) [2025-09-22T20:34:25.201082] [DEBUG] [LOCAL ] OSCR: Primary data saved (53722 records). [2025-09-22T20:34:25.201286] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-22T20:34:25.201415] [INFO ] [MAIN ] Update Progress: 1613/2372 symbols completed. OSCR took 36.8s. Estimated remaining: 1h 40m 52s. Rate: 7.5 symbols/min [2025-09-22T20:34:25.327117] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-22T20:34:25.381179] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:34:25.381514] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-09-22T20:34:25.381611] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-09-22T20:34:25.381864] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-22T20:34:25.381943] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-22T20:34:25.382115] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-09-22T20:34:25.382182] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-22T20:34:25.762564] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:34:25.792457] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-22T20:34:25.938145] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T20:34:26.122076] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-22T20:34:26.922080] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-22T20:34:27.035734] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T20:34:27.722027] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-22T20:34:27.845672] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T20:34:27.858231] [INFO ] [REMOTE ] OTIS: Full fetch complete (75750 records). [2025-09-22T20:34:27.858407] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-22T20:34:28.285161] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-22T20:34:28.285278] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-22T20:34:28.286406] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-22T20:34:28.286476] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-22T20:34:28.288047] [DEBUG] [LOCAL ] OTIS: Trimmed 75750 records to 52715 (keeping 200 days of data) [2025-09-22T20:34:28.522189] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-22T20:34:28.575150] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T20:34:28.660453] [DEBUG] [LOCAL ] OTIS: Primary data saved (52715 records). [2025-09-22T20:34:28.660591] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-22T20:34:28.660701] [INFO ] [MAIN ] Update Progress: 1614/2372 symbols completed. OTIS took 31.0s. Estimated remaining: 1h 40m 42s. Rate: 7.5 symbols/min [2025-09-22T20:34:28.834202] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:34:28.887936] [DEBUG] [LOCAL ] OWL: Loaded 54336 existing records from primary storage. [2025-09-22T20:34:28.888110] [INFO ] [MAIN ] OWL: Loaded 54336 existing records. [2025-09-22T20:34:29.065772] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:34:29.066027] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-22T20:34:29.066074] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-22T20:34:29.067679] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-22T20:34:29.067740] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-22T20:34:29.337447] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-22T20:34:29.428464] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:34:29.823286] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-22T20:34:30.122076] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-22T20:34:30.291696] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T20:34:30.922059] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-22T20:34:31.199112] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T20:34:31.205893] [INFO ] [REMOTE ] OSK: Full fetch complete (61562 records). [2025-09-22T20:34:31.206001] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-22T20:34:31.398066] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T20:34:31.398781] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:34:31.398874] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:34:31.398946] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-22T20:34:31.399014] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-22T20:34:31.399050] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-22T20:34:31.399088] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-22T20:34:31.399152] [INFO ] [MAIN ] Update Progress: 1615/2372 symbols completed. OSK took 37.0s. Estimated remaining: 1h 40m 31s. Rate: 7.5 symbols/min [2025-09-22T20:34:31.570818] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:34:31.580891] [DEBUG] [LOCAL ] OWLT: Loaded 8963 existing records from primary storage. [2025-09-22T20:34:31.581045] [INFO ] [MAIN ] OWLT: Loaded 8963 existing records. [2025-09-22T20:34:31.726813] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-22T20:34:31.763231] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:34:31.764806] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-22T20:34:31.764904] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-22T20:34:31.768733] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-22T20:34:31.768830] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-22T20:34:32.149745] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:34:32.182154] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-22T20:34:32.522095] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-22T20:34:32.624215] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T20:34:33.322051] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-22T20:34:33.548163] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-22T20:34:33.662259] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-22T20:34:34.122059] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-22T20:34:34.922033] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-22T20:34:35.030932] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T20:34:35.722042] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-22T20:34:35.995777] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T20:34:36.522045] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-22T20:34:36.757211] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T20:34:37.086681] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T20:34:37.322116] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-22T20:34:38.122098] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-22T20:34:38.195233] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T20:34:38.783511] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-22T20:34:38.922111] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-22T20:34:39.149090] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T20:34:39.722179] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-22T20:34:40.421935] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-22T20:34:40.522063] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-22T20:34:40.924859] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T20:34:41.322092] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-22T20:34:42.122103] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-22T20:34:42.922100] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-22T20:34:43.644693] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (3.12 seconds). [2025-09-22T20:34:43.722095] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-22T20:34:45.669166] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (3.55 seconds). [2025-09-22T20:34:45.671813] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-22T20:34:45.861588] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-09-22T20:34:45.873223] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-22T20:34:45.931386] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-22T20:34:46.122114] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-22T20:34:46.184549] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (4.86 seconds). [2025-09-22T20:34:46.578384] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-22T20:34:46.922164] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-22T20:34:47.532985] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T20:34:47.541987] [INFO ] [REMOTE ] OUT: Full fetch complete (69083 records). [2025-09-22T20:34:47.542223] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-22T20:34:47.723875] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-22T20:34:47.956929] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-22T20:34:47.957201] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-22T20:34:47.958459] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-22T20:34:47.958584] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-22T20:34:47.960540] [DEBUG] [LOCAL ] OUT: Trimmed 69083 records to 48126 (keeping 200 days of data) [2025-09-22T20:34:48.092009] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-22T20:34:48.321472] [DEBUG] [LOCAL ] OUT: Primary data saved (48126 records). [2025-09-22T20:34:48.321621] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-22T20:34:48.321745] [INFO ] [MAIN ] Update Progress: 1616/2372 symbols completed. OUT took 29.2s. Estimated remaining: 1h 40m 28s. Rate: 7.5 symbols/min [2025-09-22T20:34:48.517380] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:34:48.518857] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T20:34:48.521989] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-22T20:34:48.557505] [DEBUG] [LOCAL ] OXM: Loaded 34131 existing records from primary storage. [2025-09-22T20:34:48.557680] [INFO ] [MAIN ] OXM: Loaded 34131 existing records. [2025-09-22T20:34:48.767774] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:34:48.768269] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-22T20:34:48.768349] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-22T20:34:48.769727] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-22T20:34:48.769795] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-22T20:34:48.963810] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-22T20:34:49.188190] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:34:49.322115] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-22T20:34:49.455179] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T20:34:50.122137] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-22T20:34:50.765550] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T20:34:50.922056] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-22T20:34:51.073155] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-22T20:34:51.722078] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-22T20:34:52.205122] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T20:34:52.522115] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-22T20:34:52.604203] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T20:34:53.322056] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-22T20:34:54.085827] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T20:34:54.087961] [INFO ] [REMOTE ] OWLT: Full fetch complete (11645 records). [2025-09-22T20:34:54.088043] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-22T20:34:54.127280] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-22T20:34:54.472550] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-22T20:34:54.482699] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-22T20:34:54.490705] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-22T20:34:54.500773] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-22T20:34:54.503116] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-22T20:34:54.503327] [DEBUG] [LOCAL ] OWLT: Trimmed 11645 records to 8904 (keeping 200 days of data) [2025-09-22T20:34:54.565069] [DEBUG] [LOCAL ] OWLT: Primary data saved (8904 records). [2025-09-22T20:34:54.565231] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-22T20:34:54.565333] [INFO ] [MAIN ] Update Progress: 1617/2372 symbols completed. OWLT took 23.2s. Estimated remaining: 1h 40m 19s. Rate: 7.5 symbols/min [2025-09-22T20:34:54.734070] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:34:54.734263] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-22T20:34:54.734301] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-22T20:34:54.734449] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-22T20:34:54.734492] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-22T20:34:54.734534] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-22T20:34:54.734565] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-22T20:34:54.931502] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-22T20:34:55.098720] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:34:55.722113] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-22T20:34:56.228965] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-22T20:34:56.522045] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-22T20:34:56.966448] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-22T20:34:57.322054] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-22T20:34:58.122125] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-22T20:34:59.324405] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-22T20:34:59.330436] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-22T20:34:59.456871] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (3.73 seconds). [2025-09-22T20:34:59.502520] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-22T20:34:59.722073] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-22T20:35:00.522022] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-22T20:35:00.935218] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-22T20:35:00.991846] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T20:35:01.322074] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-22T20:35:02.122312] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-22T20:35:02.374978] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T20:35:02.421570] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-22T20:35:02.922157] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-22T20:35:03.074210] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T20:35:03.722100] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-22T20:35:03.801720] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T20:35:03.811320] [INFO ] [REMOTE ] OWL: Full fetch complete (77519 records). [2025-09-22T20:35:03.811583] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-22T20:35:04.245442] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-22T20:35:04.245570] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-22T20:35:04.247405] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-22T20:35:04.247481] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-22T20:35:04.249585] [DEBUG] [LOCAL ] OWL: Trimmed 77519 records to 53555 (keeping 200 days of data) [2025-09-22T20:35:04.522683] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-22T20:35:04.558300] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T20:35:04.571047] [INFO ] [REMOTE ] OVV: Full fetch complete (77294 records). [2025-09-22T20:35:04.571864] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-22T20:35:05.087893] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-22T20:35:05.088414] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-22T20:35:05.090304] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-22T20:35:05.091241] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-22T20:35:05.095234] [DEBUG] [LOCAL ] OVV: Trimmed 77294 records to 53516 (keeping 200 days of data) [2025-09-22T20:35:05.197332] [DEBUG] [LOCAL ] OWL: Primary data saved (53555 records). [2025-09-22T20:35:05.198149] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-22T20:35:05.198551] [INFO ] [MAIN ] Update Progress: 1618/2372 symbols completed. OWL took 36.5s. Estimated remaining: 1h 40m 12s. Rate: 7.5 symbols/min [2025-09-22T20:35:05.321771] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T20:35:05.366630] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-22T20:35:05.427852] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:35:05.492980] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-22T20:35:05.549604] [INFO ] [MAIN ] PAAS: Loaded 54383 existing records. [2025-09-22T20:35:05.782736] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:35:05.784495] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-22T20:35:05.784850] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-22T20:35:05.788002] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-22T20:35:05.788353] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-22T20:35:06.232570] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:35:06.238532] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-22T20:35:06.322296] [DEBUG] [LOCAL ] OVV: Primary data saved (53516 records). [2025-09-22T20:35:06.322436] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-22T20:35:06.322517] [INFO ] [MAIN ] Update Progress: 1619/2372 symbols completed. OVV took 41.1s. Estimated remaining: 1h 40m 1s. Rate: 7.5 symbols/min [2025-09-22T20:35:06.493748] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:35:06.507539] [DEBUG] [LOCAL ] PAC: Loaded 11793 existing records from primary storage. [2025-09-22T20:35:06.507698] [INFO ] [MAIN ] PAC: Loaded 11793 existing records. [2025-09-22T20:35:06.703261] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:35:06.703590] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-22T20:35:06.703802] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-22T20:35:06.704515] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-22T20:35:06.704578] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-22T20:35:06.832917] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T20:35:06.923362] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-22T20:35:07.127577] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:35:07.178459] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-22T20:35:07.722090] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-22T20:35:08.149960] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T20:35:08.281827] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-22T20:35:08.522058] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-22T20:35:09.322047] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-22T20:35:10.122090] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-22T20:35:10.451728] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-22T20:35:10.746663] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T20:35:10.922035] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-22T20:35:10.966910] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-22T20:35:11.722053] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-22T20:35:11.786390] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T20:35:11.883213] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T20:35:12.522075] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-22T20:35:13.322028] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-22T20:35:13.636472] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-22T20:35:14.122056] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-22T20:35:14.784133] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T20:35:14.791872] [INFO ] [REMOTE ] OXM: Full fetch complete (46259 records). [2025-09-22T20:35:14.792130] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-22T20:35:14.927301] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-22T20:35:15.184431] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-22T20:35:15.266348] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-22T20:35:15.266440] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-22T20:35:15.267422] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-22T20:35:15.267491] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-22T20:35:15.268920] [DEBUG] [LOCAL ] OXM: Trimmed 46259 records to 33539 (keeping 200 days of data) [2025-09-22T20:35:15.482002] [DEBUG] [LOCAL ] OXM: Primary data saved (33539 records). [2025-09-22T20:35:15.482158] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-22T20:35:15.482246] [INFO ] [MAIN ] Update Progress: 1620/2372 symbols completed. OXM took 27.2s. Estimated remaining: 1h 39m 54s. Rate: 7.5 symbols/min [2025-09-22T20:35:15.653276] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:35:15.685023] [DEBUG] [LOCAL ] PACK: Loaded 32597 existing records from primary storage. [2025-09-22T20:35:15.685212] [INFO ] [MAIN ] PACK: Loaded 32597 existing records. [2025-09-22T20:35:15.744076] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-22T20:35:15.885979] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:35:15.886674] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-22T20:35:15.886763] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-22T20:35:15.887721] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-22T20:35:15.887781] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-22T20:35:16.054802] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-22T20:35:16.277110] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:35:16.309011] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-22T20:35:16.522039] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-22T20:35:17.322087] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-22T20:35:17.657455] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T20:35:17.941286] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T20:35:18.122060] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-22T20:35:18.447720] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-22T20:35:18.922019] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-22T20:35:19.295939] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T20:35:19.722071] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-22T20:35:20.522116] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-22T20:35:20.978486] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T20:35:21.322031] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-22T20:35:21.559119] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-22T20:35:22.122075] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-22T20:35:22.820372] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T20:35:22.899103] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T20:35:22.922025] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-22T20:35:22.971544] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-22T20:35:23.722112] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-22T20:35:24.308989] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T20:35:24.522117] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-22T20:35:25.322064] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-22T20:35:25.469763] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T20:35:26.122103] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-22T20:35:26.393238] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-22T20:35:26.922076] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-22T20:35:27.195815] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T20:35:27.358784] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-22T20:35:27.722069] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-22T20:35:28.522071] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-22T20:35:29.119262] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T20:35:29.322041] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-22T20:35:29.409541] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-22T20:35:29.429372] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-22T20:35:30.122046] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-22T20:35:30.532326] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T20:35:30.922053] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-22T20:35:31.722116] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-22T20:35:31.732354] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-22T20:35:32.366012] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-22T20:35:32.374019] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-22T20:35:32.374156] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-22T20:35:32.527151] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-22T20:35:32.579045] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T20:35:32.580061] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:35:32.580144] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:35:32.580219] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-22T20:35:32.580291] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-22T20:35:32.580328] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-22T20:35:32.580367] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-22T20:35:32.580436] [INFO ] [MAIN ] Update Progress: 1621/2372 symbols completed. OXY took 38.0s. Estimated remaining: 1h 39m 50s. Rate: 7.5 symbols/min [2025-09-22T20:35:32.753930] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:35:32.790109] [DEBUG] [LOCAL ] PACS: Loaded 34403 existing records from primary storage. [2025-09-22T20:35:32.790255] [INFO ] [MAIN ] PACS: Loaded 34403 existing records. [2025-09-22T20:35:32.971336] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:35:32.971637] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-22T20:35:32.971771] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-22T20:35:32.972902] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-22T20:35:32.972963] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-22T20:35:33.328725] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-22T20:35:33.334364] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:35:33.389090] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-22T20:35:33.390976] [INFO ] [REMOTE ] PAC: Full fetch complete (16411 records). [2025-09-22T20:35:33.391050] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-22T20:35:33.759378] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-22T20:35:33.759544] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-22T20:35:33.760008] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-22T20:35:33.760184] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-22T20:35:33.761237] [DEBUG] [LOCAL ] PAC: Trimmed 16411 records to 11560 (keeping 200 days of data) [2025-09-22T20:35:33.846802] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-22T20:35:33.872864] [DEBUG] [LOCAL ] PAC: Primary data saved (11560 records). [2025-09-22T20:35:33.872989] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-22T20:35:33.873075] [INFO ] [MAIN ] Update Progress: 1622/2372 symbols completed. PAC took 27.6s. Estimated remaining: 1h 39m 39s. Rate: 7.5 symbols/min [2025-09-22T20:35:34.041578] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:35:34.041815] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-09-22T20:35:34.041869] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-09-22T20:35:34.042011] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-22T20:35:34.042057] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-22T20:35:34.042111] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-09-22T20:35:34.042142] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-22T20:35:34.131743] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-22T20:35:34.402386] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:35:34.419141] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T20:35:34.922069] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-22T20:35:35.571060] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T20:35:35.722066] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-22T20:35:36.481738] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T20:35:36.522040] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-22T20:35:37.322061] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-22T20:35:37.472003] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T20:35:37.581045] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T20:35:37.586777] [INFO ] [REMOTE ] PACK: Full fetch complete (43209 records). [2025-09-22T20:35:37.586893] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-22T20:35:37.963048] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-22T20:35:37.963138] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-22T20:35:37.963969] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-22T20:35:37.964032] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-22T20:35:37.965249] [DEBUG] [LOCAL ] PACK: Trimmed 43209 records to 32100 (keeping 200 days of data) [2025-09-22T20:35:38.126556] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-22T20:35:38.149712] [DEBUG] [LOCAL ] PACK: Primary data saved (32100 records). [2025-09-22T20:35:38.149815] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-22T20:35:38.149916] [INFO ] [MAIN ] Update Progress: 1623/2372 symbols completed. PACK took 22.7s. Estimated remaining: 1h 39m 29s. Rate: 7.5 symbols/min [2025-09-22T20:35:38.318428] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:35:38.370011] [DEBUG] [LOCAL ] PAGS: Loaded 53457 existing records from primary storage. [2025-09-22T20:35:38.370172] [INFO ] [MAIN ] PAGS: Loaded 53457 existing records. [2025-09-22T20:35:38.560106] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:35:38.560388] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-22T20:35:38.560436] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-22T20:35:38.562271] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-22T20:35:38.562334] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-22T20:35:38.923004] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-22T20:35:38.917701] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T20:35:38.986536] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:35:39.722056] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-22T20:35:40.000995] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T20:35:40.283095] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-22T20:35:40.522138] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-22T20:35:41.111903] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T20:35:41.322070] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-22T20:35:41.548491] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-22T20:35:42.122092] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-22T20:35:42.922092] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-22T20:35:43.187979] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T20:35:43.404233] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-22T20:35:43.412585] [INFO ] [REMOTE ] PAAS: Full fetch complete (77368 records). [2025-09-22T20:35:43.412754] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-22T20:35:43.727166] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-22T20:35:43.808229] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-22T20:35:43.808326] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-22T20:35:43.809463] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-22T20:35:43.809534] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-22T20:35:43.811186] [DEBUG] [LOCAL ] PAAS: Trimmed 77368 records to 53603 (keeping 200 days of data) [2025-09-22T20:35:44.145364] [DEBUG] [LOCAL ] PAAS: Primary data saved (53603 records). [2025-09-22T20:35:44.145528] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-22T20:35:44.145617] [INFO ] [MAIN ] Update Progress: 1624/2372 symbols completed. PAAS took 38.9s. Estimated remaining: 1h 39m 20s. Rate: 7.5 symbols/min [2025-09-22T20:35:44.315241] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:35:44.319630] [DEBUG] [LOCAL ] PAI: Loaded 2767 existing records from primary storage. [2025-09-22T20:35:44.319732] [INFO ] [MAIN ] PAI: Loaded 2767 existing records. [2025-09-22T20:35:44.496736] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:35:44.496988] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-22T20:35:44.497034] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-22T20:35:44.497314] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-22T20:35:44.497372] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-22T20:35:44.528914] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-22T20:35:44.871521] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:35:44.947840] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-22T20:35:45.006473] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T20:35:45.322062] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-22T20:35:45.688957] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T20:35:46.122081] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-22T20:35:46.922025] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-22T20:35:47.181549] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-22T20:35:47.369267] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-22T20:35:47.502422] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-22T20:35:47.722057] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-22T20:35:48.522101] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-22T20:35:49.072307] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T20:35:49.322079] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-22T20:35:50.122086] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-22T20:35:50.327579] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-22T20:35:50.788563] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T20:35:50.922060] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-22T20:35:51.112865] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T20:35:51.722109] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-22T20:35:52.522113] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-22T20:35:52.754632] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T20:35:53.261942] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T20:35:53.273034] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T20:35:53.322005] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-22T20:35:54.029047] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T20:35:54.122075] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-22T20:35:54.675373] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-22T20:35:54.922147] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-22T20:35:55.722114] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-22T20:35:56.522049] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-22T20:35:56.790939] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T20:35:57.178128] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-22T20:35:57.279577] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T20:35:57.322022] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-22T20:35:58.122064] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-22T20:35:58.775236] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T20:35:58.782490] [INFO ] [REMOTE ] PACS: Full fetch complete (50792 records). [2025-09-22T20:35:58.782603] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-22T20:35:58.935144] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-22T20:35:59.208082] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-22T20:35:59.208168] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-22T20:35:59.209239] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-22T20:35:59.209306] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-22T20:35:59.210712] [DEBUG] [LOCAL ] PACS: Trimmed 50792 records to 34010 (keeping 200 days of data) [2025-09-22T20:35:59.406577] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T20:35:59.434075] [DEBUG] [LOCAL ] PACS: Primary data saved (34010 records). [2025-09-22T20:35:59.434211] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-22T20:35:59.434294] [INFO ] [MAIN ] Update Progress: 1625/2372 symbols completed. PACS took 26.9s. Estimated remaining: 1h 39m 16s. Rate: 7.5 symbols/min [2025-09-22T20:35:59.607543] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:35:59.607892] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-22T20:35:59.607951] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-22T20:35:59.608145] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-22T20:35:59.608207] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-22T20:35:59.608266] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-22T20:35:59.608312] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-22T20:35:59.726332] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-22T20:36:00.013215] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:36:00.032559] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T20:36:00.522055] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-22T20:36:01.264410] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T20:36:01.322013] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-22T20:36:02.122113] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-22T20:36:02.922141] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-22T20:36:03.283428] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-22T20:36:03.722099] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-22T20:36:04.019286] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-22T20:36:04.401080] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:36:04.401413] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-22T20:36:04.522104] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-22T20:36:04.610048] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-22T20:36:05.322053] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-22T20:36:06.122076] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-09-22T20:36:06.425917] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:36:06.426290] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-09-22T20:36:06.508462] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T20:36:06.741139] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T20:36:06.744944] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-09-22T20:36:06.922069] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-22T20:36:07.722143] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-22T20:36:08.316860] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-22T20:36:08.522104] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-22T20:36:08.804934] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T20:36:09.322013] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-22T20:36:09.719836] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-22T20:36:10.122069] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-22T20:36:10.653047] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T20:36:10.662800] [INFO ] [REMOTE ] PAGS: Full fetch complete (76330 records). [2025-09-22T20:36:10.663109] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-22T20:36:10.927472] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-22T20:36:11.101278] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-22T20:36:11.101461] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-22T20:36:11.102799] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-22T20:36:11.102902] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-22T20:36:11.114764] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-22T20:36:11.118439] [INFO ] [REMOTE ] PAG: Full fetch complete (29859 records). [2025-09-22T20:36:11.118543] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-22T20:36:11.118742] [DEBUG] [LOCAL ] PAGS: Trimmed 76330 records to 52686 (keeping 200 days of data) [2025-09-22T20:36:11.627182] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-22T20:36:11.627569] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-22T20:36:11.629344] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-22T20:36:11.629707] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-22T20:36:11.633045] [DEBUG] [LOCAL ] PAG: Trimmed 29859 records to 21984 (keeping 200 days of data) [2025-09-22T20:36:11.762117] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-22T20:36:11.845811] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T20:36:11.850546] [INFO ] [REMOTE ] PAI: Full fetch complete (4129 records). [2025-09-22T20:36:11.851742] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-22T20:36:12.224542] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:36:12.247980] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-22T20:36:12.272395] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-22T20:36:12.274094] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-22T20:36:12.274932] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-22T20:36:12.275291] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-22T20:36:12.277599] [DEBUG] [LOCAL ] PAI: Trimmed 4129 records to 2709 (keeping 200 days of data) [2025-09-22T20:36:12.309386] [DEBUG] [LOCAL ] PAI: Primary data saved (2709 records). [2025-09-22T20:36:12.311212] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-22T20:36:12.311687] [INFO ] [MAIN ] Update Progress: 1626/2372 symbols completed. PAI took 28.2s. Estimated remaining: 1h 39m 10s. Rate: 7.5 symbols/min [2025-09-22T20:36:12.530262] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-22T20:36:12.572024] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:36:12.596540] [DEBUG] [LOCAL ] PAG: Primary data saved (21984 records). [2025-09-22T20:36:12.597684] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-22T20:36:12.598920] [INFO ] [MAIN ] Update Progress: 1627/2372 symbols completed. PAG took 38.7s. Estimated remaining: 1h 38m 58s. Rate: 7.5 symbols/min [2025-09-22T20:36:12.743507] [DEBUG] [LOCAL ] PAM: Loaded 28046 existing records from primary storage. [2025-09-22T20:36:12.750152] [INFO ] [MAIN ] PAM: Loaded 28046 existing records. [2025-09-22T20:36:12.916089] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:36:12.985233] [DEBUG] [LOCAL ] PAGS: Primary data saved (52686 records). [2025-09-22T20:36:13.004750] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-22T20:36:13.005140] [INFO ] [MAIN ] Update Progress: 1628/2372 symbols completed. PAGS took 34.9s. Estimated remaining: 1h 38m 47s. Rate: 7.5 symbols/min [2025-09-22T20:36:13.028229] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:36:13.098248] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-22T20:36:13.155715] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-22T20:36:13.201439] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-22T20:36:13.205990] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-22T20:36:13.328291] [DEBUG] [LOCAL ] PAR: Loaded 33100 existing records from primary storage. [2025-09-22T20:36:13.380862] [INFO ] [MAIN ] PAR: Loaded 33100 existing records. [2025-09-22T20:36:13.375598] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:36:13.801216] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:36:13.826349] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-22T20:36:13.833214] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-22T20:36:13.870525] [DEBUG] [LOCAL ] PARR: Loaded 49140 existing records from primary storage. [2025-09-22T20:36:13.881766] [INFO ] [MAIN ] PARR: Loaded 49140 existing records. [2025-09-22T20:36:13.881675] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-22T20:36:13.937532] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:36:13.954081] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-22T20:36:14.024487] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:36:14.005370] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-22T20:36:14.054592] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-22T20:36:14.127535] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-22T20:36:14.289298] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:36:14.350191] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-22T20:36:14.375972] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-22T20:36:14.398943] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-22T20:36:14.416816] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-22T20:36:14.637982] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:36:14.897903] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:36:14.922030] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-22T20:36:14.996861] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:36:14.997329] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-22T20:36:15.722087] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-22T20:36:15.936433] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-22T20:36:16.024863] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:36:16.025221] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-22T20:36:16.522062] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-22T20:36:16.838592] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:36:16.838972] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-22T20:36:16.874596] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T20:36:17.322072] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-22T20:36:18.122125] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-22T20:36:18.903338] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T20:36:18.922013] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-22T20:36:19.599932] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T20:36:19.722075] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-22T20:36:20.000533] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:36:20.000905] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-22T20:36:20.522030] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-22T20:36:20.623320] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T20:36:20.813318] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:36:20.813710] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-22T20:36:21.322080] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-22T20:36:22.122054] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-22T20:36:22.922046] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-22T20:36:22.997299] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T20:36:23.276483] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-22T20:36:23.277184] [INFO ] [REMOTE ] PAII: Full fetch complete (79 records). [2025-09-22T20:36:23.277251] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-22T20:36:23.500278] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 9 unique days, need 200 days [2025-09-22T20:36:23.500624] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:36:23.500765] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:36:23.501175] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-22T20:36:23.501292] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-22T20:36:23.501364] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-22T20:36:23.501445] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-22T20:36:23.501550] [INFO ] [MAIN ] Update Progress: 1629/2372 symbols completed. PAII took 24.1s. Estimated remaining: 1h 38m 40s. Rate: 7.5 symbols/min [2025-09-22T20:36:23.681136] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:36:23.719423] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T20:36:23.729007] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-22T20:36:23.805851] [DEBUG] [LOCAL ] PATH: Loaded 54458 existing records from primary storage. [2025-09-22T20:36:23.806053] [INFO ] [MAIN ] PATH: Loaded 54458 existing records. [2025-09-22T20:36:23.999816] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:36:24.000215] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-22T20:36:24.000293] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-22T20:36:24.001619] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-22T20:36:24.001724] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-22T20:36:24.451692] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:36:24.522104] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-22T20:36:25.322065] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-22T20:36:25.364617] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T20:36:26.122057] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-22T20:36:26.354596] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T20:36:26.903731] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T20:36:26.921999] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-22T20:36:27.473288] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T20:36:27.722047] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-22T20:36:27.870028] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T20:36:28.522050] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-22T20:36:29.273043] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T20:36:29.322059] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-22T20:36:29.913553] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T20:36:30.122051] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-22T20:36:30.922067] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-22T20:36:31.579024] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-22T20:36:31.620965] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T20:36:31.722012] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-22T20:36:32.522042] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-22T20:36:32.642174] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T20:36:33.322084] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-22T20:36:33.752003] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T20:36:34.122127] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-22T20:36:34.177262] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-22T20:36:34.681093] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T20:36:34.922123] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-22T20:36:35.618925] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T20:36:35.722076] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-22T20:36:36.310355] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T20:36:36.522108] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-22T20:36:37.020142] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T20:36:37.322080] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-22T20:36:38.122061] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-22T20:36:38.593966] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T20:36:38.811634] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-22T20:36:38.922031] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-22T20:36:39.663535] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T20:36:39.722096] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-22T20:36:40.373797] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T20:36:40.522050] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-22T20:36:40.963249] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T20:36:40.971374] [INFO ] [REMOTE ] PARR: Full fetch complete (68439 records). [2025-09-22T20:36:40.971549] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-22T20:36:41.329709] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-22T20:36:41.381343] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-22T20:36:41.381588] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-22T20:36:41.382834] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-22T20:36:41.382906] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-22T20:36:41.385760] [DEBUG] [LOCAL ] PARR: Trimmed 68439 records to 48356 (keeping 200 days of data) [2025-09-22T20:36:41.680312] [DEBUG] [LOCAL ] PARR: Primary data saved (48356 records). [2025-09-22T20:36:41.680489] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-22T20:36:41.680677] [INFO ] [MAIN ] Update Progress: 1630/2372 symbols completed. PARR took 28.7s. Estimated remaining: 1h 38m 37s. Rate: 7.5 symbols/min [2025-09-22T20:36:41.861945] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:36:41.886143] [DEBUG] [LOCAL ] PAXS: Loaded 21415 existing records from primary storage. [2025-09-22T20:36:41.886306] [INFO ] [MAIN ] PAXS: Loaded 21415 existing records. [2025-09-22T20:36:42.071552] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:36:42.071932] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-22T20:36:42.071991] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-22T20:36:42.072851] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-22T20:36:42.072914] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-22T20:36:42.138170] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-22T20:36:42.463776] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:36:42.840676] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T20:36:42.922032] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-22T20:36:43.038891] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-22T20:36:43.569613] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T20:36:43.722057] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-22T20:36:44.522040] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-22T20:36:44.626936] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T20:36:45.129804] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T20:36:45.136229] [INFO ] [REMOTE ] PAM: Full fetch complete (41923 records). [2025-09-22T20:36:45.136391] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-22T20:36:45.323637] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-22T20:36:45.538941] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-22T20:36:45.539279] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-22T20:36:45.540243] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-22T20:36:45.540309] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-22T20:36:45.541413] [DEBUG] [LOCAL ] PAM: Trimmed 41923 records to 27892 (keeping 200 days of data) [2025-09-22T20:36:45.719782] [DEBUG] [LOCAL ] PAM: Primary data saved (27892 records). [2025-09-22T20:36:45.719939] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-22T20:36:45.720051] [INFO ] [MAIN ] Update Progress: 1631/2372 symbols completed. PAM took 33.4s. Estimated remaining: 1h 38m 27s. Rate: 7.5 symbols/min [2025-09-22T20:36:45.905376] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:36:45.948449] [DEBUG] [LOCAL ] PAY: Loaded 38809 existing records from primary storage. [2025-09-22T20:36:45.948628] [INFO ] [MAIN ] PAY: Loaded 38809 existing records. [2025-09-22T20:36:46.127762] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-22T20:36:46.134020] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:36:46.135089] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-22T20:36:46.135138] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-22T20:36:46.136411] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-22T20:36:46.136474] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-22T20:36:46.531085] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:36:46.723239] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T20:36:46.730368] [INFO ] [REMOTE ] PAR: Full fetch complete (46970 records). [2025-09-22T20:36:46.730673] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-22T20:36:46.938684] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-22T20:36:47.144502] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-22T20:36:47.172808] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-22T20:36:47.172901] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-22T20:36:47.174209] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-22T20:36:47.174273] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-22T20:36:47.176260] [DEBUG] [LOCAL ] PAR: Trimmed 46970 records to 32523 (keeping 200 days of data) [2025-09-22T20:36:47.368625] [DEBUG] [LOCAL ] PAR: Primary data saved (32523 records). [2025-09-22T20:36:47.369000] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-22T20:36:47.369170] [INFO ] [MAIN ] Update Progress: 1632/2372 symbols completed. PAR took 34.8s. Estimated remaining: 1h 38m 16s. Rate: 7.5 symbols/min [2025-09-22T20:36:47.547181] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:36:47.567327] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T20:36:47.618336] [DEBUG] [LOCAL ] PAYC: Loaded 36966 existing records from primary storage. [2025-09-22T20:36:47.618507] [INFO ] [MAIN ] PAYC: Loaded 36966 existing records. [2025-09-22T20:36:47.722842] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-22T20:36:47.804909] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:36:47.805176] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-22T20:36:47.805495] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-22T20:36:47.806515] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-22T20:36:47.806579] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-22T20:36:48.170743] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:36:48.397097] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T20:36:48.522089] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-22T20:36:48.951027] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T20:36:49.322065] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-22T20:36:49.760920] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T20:36:50.122076] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-22T20:36:50.810311] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T20:36:50.922086] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-22T20:36:51.618820] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T20:36:51.722093] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-22T20:36:52.240731] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T20:36:52.522083] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-22T20:36:52.793532] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T20:36:53.322063] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-22T20:36:54.096636] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T20:36:54.122038] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-22T20:36:54.402150] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T20:36:54.922054] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-22T20:36:55.722087] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-22T20:36:55.836029] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T20:36:55.889098] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T20:36:56.522122] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-22T20:36:57.322080] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-22T20:36:58.058442] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T20:36:58.087829] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-22T20:36:58.122011] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-22T20:36:58.517686] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T20:36:58.922065] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-22T20:36:59.722021] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-22T20:37:00.116173] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-22T20:37:00.401639] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-22T20:37:00.522078] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-22T20:37:01.309033] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T20:37:01.322031] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-22T20:37:02.122136] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-22T20:37:02.153980] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T20:37:02.929015] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-22T20:37:02.944543] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T20:37:03.324319] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T20:37:03.722054] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-22T20:37:04.522100] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-22T20:37:05.285035] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-22T20:37:05.322217] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-22T20:37:05.323775] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T20:37:05.806506] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T20:37:06.122056] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-22T20:37:06.922157] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-22T20:37:07.589786] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T20:37:07.641368] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-22T20:37:07.722042] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-22T20:37:08.192231] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T20:37:08.522091] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-22T20:37:09.322093] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-22T20:37:09.897149] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-22T20:37:09.906203] [INFO ] [REMOTE ] PATH: Full fetch complete (77763 records). [2025-09-22T20:37:09.906381] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-22T20:37:10.129310] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-22T20:37:10.375214] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-22T20:37:10.374940] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T20:37:10.376796] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-22T20:37:10.376733] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T20:37:10.378220] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-22T20:37:10.391427] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-22T20:37:10.394158] [DEBUG] [LOCAL ] PATH: Trimmed 77763 records to 53678 (keeping 200 days of data) [2025-09-22T20:37:10.733067] [DEBUG] [LOCAL ] PATH: Primary data saved (53678 records). [2025-09-22T20:37:10.733213] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-22T20:37:10.733296] [INFO ] [MAIN ] Update Progress: 1633/2372 symbols completed. PATH took 47.2s. Estimated remaining: 1h 38m 15s. Rate: 7.5 symbols/min [2025-09-22T20:37:10.903805] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:37:10.927584] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-22T20:37:10.947133] [DEBUG] [LOCAL ] PB: Loaded 41998 existing records from primary storage. [2025-09-22T20:37:10.947269] [INFO ] [MAIN ] PB: Loaded 41998 existing records. [2025-09-22T20:37:11.168398] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:37:11.168705] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-22T20:37:11.168762] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-22T20:37:11.169861] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-22T20:37:11.169922] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-22T20:37:11.527874] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:37:11.722104] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-22T20:37:11.761946] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T20:37:12.045313] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T20:37:12.048721] [INFO ] [REMOTE ] PAXS: Full fetch complete (31465 records). [2025-09-22T20:37:12.048803] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-22T20:37:12.430553] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-22T20:37:12.430662] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-22T20:37:12.431326] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-22T20:37:12.431386] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-22T20:37:12.432241] [DEBUG] [LOCAL ] PAXS: Trimmed 31465 records to 21101 (keeping 200 days of data) [2025-09-22T20:37:12.526333] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-22T20:37:12.564896] [DEBUG] [LOCAL ] PAXS: Primary data saved (21101 records). [2025-09-22T20:37:12.565020] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-22T20:37:12.565098] [INFO ] [MAIN ] Update Progress: 1634/2372 symbols completed. PAXS took 30.9s. Estimated remaining: 1h 38m 4s. Rate: 7.5 symbols/min [2025-09-22T20:37:12.736632] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:37:12.782859] [DEBUG] [LOCAL ] PBA: Loaded 49752 existing records from primary storage. [2025-09-22T20:37:12.783039] [INFO ] [MAIN ] PBA: Loaded 49752 existing records. [2025-09-22T20:37:12.965156] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:37:12.965402] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-22T20:37:12.965449] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-22T20:37:12.966561] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-22T20:37:12.966622] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-22T20:37:13.350399] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-22T20:37:13.373330] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:37:13.375993] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T20:37:14.114344] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T20:37:14.122038] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-22T20:37:14.857784] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T20:37:14.864435] [INFO ] [REMOTE ] PAY: Full fetch complete (53183 records). [2025-09-22T20:37:14.864538] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-22T20:37:14.929756] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-22T20:37:15.277780] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-22T20:37:15.277878] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-22T20:37:15.278799] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-22T20:37:15.278862] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-22T20:37:15.279977] [DEBUG] [LOCAL ] PAY: Trimmed 53183 records to 38308 (keeping 200 days of data) [2025-09-22T20:37:15.502100] [DEBUG] [LOCAL ] PAY: Primary data saved (38308 records). [2025-09-22T20:37:15.502246] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-22T20:37:15.502333] [INFO ] [MAIN ] Update Progress: 1635/2372 symbols completed. PAY took 29.8s. Estimated remaining: 1h 37m 54s. Rate: 7.5 symbols/min [2025-09-22T20:37:15.682358] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:37:15.705384] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T20:37:15.722009] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-22T20:37:15.762359] [DEBUG] [LOCAL ] PBF: Loaded 53870 existing records from primary storage. [2025-09-22T20:37:15.762513] [INFO ] [MAIN ] PBF: Loaded 53870 existing records. [2025-09-22T20:37:15.943980] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:37:15.944264] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-22T20:37:15.944314] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-22T20:37:15.945526] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-22T20:37:15.945586] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-22T20:37:16.304198] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:37:16.522057] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-22T20:37:16.753731] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T20:37:17.217392] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T20:37:17.322030] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-22T20:37:18.122051] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-22T20:37:18.487319] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-22T20:37:18.569352] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-22T20:37:18.922077] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-22T20:37:19.722074] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-22T20:37:19.881610] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T20:37:20.252689] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T20:37:20.522094] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-22T20:37:21.097739] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T20:37:21.104230] [INFO ] [REMOTE ] PAYC: Full fetch complete (52759 records). [2025-09-22T20:37:21.104393] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-22T20:37:21.330639] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-22T20:37:21.524255] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-22T20:37:21.524345] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-22T20:37:21.525480] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-22T20:37:21.525550] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-22T20:37:21.526821] [DEBUG] [LOCAL ] PAYC: Trimmed 52759 records to 36350 (keeping 200 days of data) [2025-09-22T20:37:21.765445] [DEBUG] [LOCAL ] PAYC: Primary data saved (36350 records). [2025-09-22T20:37:21.765609] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-22T20:37:21.765725] [INFO ] [MAIN ] Update Progress: 1636/2372 symbols completed. PAYC took 34.4s. Estimated remaining: 1h 37m 45s. Rate: 7.5 symbols/min [2025-09-22T20:37:21.942475] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:37:21.977714] [DEBUG] [LOCAL ] PBH: Loaded 31950 existing records from primary storage. [2025-09-22T20:37:21.977864] [INFO ] [MAIN ] PBH: Loaded 31950 existing records. [2025-09-22T20:37:22.131963] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-22T20:37:22.178153] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:37:22.178707] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-22T20:37:22.178837] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-22T20:37:22.179675] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-22T20:37:22.179752] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-22T20:37:22.419594] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T20:37:22.644726] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:37:22.922091] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-22T20:37:23.165800] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T20:37:23.722084] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-22T20:37:23.861837] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T20:37:24.418741] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T20:37:24.522020] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-22T20:37:24.793959] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T20:37:25.322115] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-22T20:37:26.011201] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T20:37:26.122055] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-22T20:37:26.632090] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T20:37:26.922061] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-22T20:37:27.722115] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-22T20:37:27.908494] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T20:37:28.212499] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T20:37:28.522134] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-22T20:37:29.322066] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-22T20:37:29.628287] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T20:37:30.122044] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-22T20:37:30.189470] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T20:37:30.927177] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-22T20:37:30.941917] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T20:37:31.722048] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-22T20:37:32.127144] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-22T20:37:32.522126] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-22T20:37:33.161774] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-22T20:37:33.322219] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-22T20:37:33.349776] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T20:37:33.784907] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T20:37:34.122115] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-22T20:37:34.922046] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-22T20:37:35.324955] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-22T20:37:35.591687] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T20:37:35.722052] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-22T20:37:36.218506] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T20:37:36.522145] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-22T20:37:37.066456] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T20:37:37.074577] [INFO ] [REMOTE ] PBA: Full fetch complete (71526 records). [2025-09-22T20:37:37.074812] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-22T20:37:37.322688] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-22T20:37:37.587444] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-22T20:37:37.587599] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-22T20:37:37.588863] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-22T20:37:37.588934] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-22T20:37:37.590634] [DEBUG] [LOCAL ] PBA: Trimmed 71526 records to 48983 (keeping 200 days of data) [2025-09-22T20:37:38.029529] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T20:37:38.069144] [DEBUG] [LOCAL ] PBA: Primary data saved (48983 records). [2025-09-22T20:37:38.069368] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-22T20:37:38.069499] [INFO ] [MAIN ] Update Progress: 1637/2372 symbols completed. PBA took 25.5s. Estimated remaining: 1h 37m 41s. Rate: 7.5 symbols/min [2025-09-22T20:37:38.122102] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-22T20:37:38.922131] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-22T20:37:39.388062] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-22T20:37:39.641773] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T20:37:39.722051] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-22T20:37:40.516543] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T20:37:40.525857] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-22T20:37:40.578295] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T20:37:41.322079] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-22T20:37:42.122090] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-22T20:37:42.445602] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T20:37:42.836827] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T20:37:42.844933] [INFO ] [REMOTE ] PB: Full fetch complete (57771 records). [2025-09-22T20:37:42.845093] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-22T20:37:42.927317] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-22T20:37:43.264429] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-22T20:37:43.264561] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-22T20:37:43.265688] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-22T20:37:43.265806] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-22T20:37:43.287157] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T20:37:43.294603] [DEBUG] [LOCAL ] PB: Trimmed 57771 records to 41351 (keeping 200 days of data) [2025-09-22T20:37:43.558413] [DEBUG] [LOCAL ] PB: Primary data saved (41351 records). [2025-09-22T20:37:43.558769] [INFO ] [MAIN ] PB: Full history saved. [2025-09-22T20:37:43.558869] [INFO ] [MAIN ] Update Progress: 1638/2372 symbols completed. PB took 32.8s. Estimated remaining: 1h 37m 32s. Rate: 7.5 symbols/min [2025-09-22T20:37:43.722060] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-22T20:37:44.877487] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T20:37:44.888812] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-22T20:37:45.291063] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T20:37:45.322082] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-22T20:37:46.634307] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T20:37:46.648614] [INFO ] [REMOTE ] PBF: Full fetch complete (76559 records). [2025-09-22T20:37:46.648923] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-22T20:37:47.017827] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T20:37:47.081783] [INFO ] [REMOTE ] PBH: Full fetch complete (42681 records). [2025-09-22T20:37:47.139359] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-22T20:37:47.139101] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-22T20:37:47.139836] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-22T20:37:47.142387] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-22T20:37:47.142575] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-22T20:37:47.257815] [DEBUG] [LOCAL ] PBF: Trimmed 76559 records to 53091 (keeping 200 days of data) [2025-09-22T20:37:47.721099] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-22T20:37:47.722055] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-22T20:37:47.726009] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-22T20:37:47.726865] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-22T20:37:47.733338] [DEBUG] [LOCAL ] PBH: Trimmed 42681 records to 31557 (keeping 200 days of data) [2025-09-22T20:37:48.171902] [DEBUG] [LOCAL ] PBH: Primary data saved (31557 records). [2025-09-22T20:37:48.172697] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-22T20:37:48.172831] [INFO ] [MAIN ] Update Progress: 1639/2372 symbols completed. PBH took 26.4s. Estimated remaining: 1h 37m 23s. Rate: 7.5 symbols/min [2025-09-22T20:37:48.177019] [DEBUG] [LOCAL ] PBF: Primary data saved (53091 records). [2025-09-22T20:37:48.177108] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-22T20:37:48.177188] [INFO ] [MAIN ] Update Progress: 1640/2372 symbols completed. PBF took 32.7s. Estimated remaining: 1h 37m 11s. Rate: 7.5 symbols/min [2025-09-22T20:37:48.869961] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:37:48.834119] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:37:48.920488] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:37:48.946553] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:37:48.957844] [DEBUG] [LOCAL ] PCF: Loaded 8854 existing records from primary storage. [2025-09-22T20:37:48.958187] [INFO ] [MAIN ] PCF: Loaded 8854 existing records. [2025-09-22T20:37:49.088638] [DEBUG] [LOCAL ] PBT: Loaded 17804 existing records from primary storage. [2025-09-22T20:37:49.110208] [INFO ] [MAIN ] PBT: Loaded 17804 existing records. [2025-09-22T20:37:49.238765] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:37:49.285666] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-22T20:37:49.291248] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-22T20:37:49.346805] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-22T20:37:49.364853] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-22T20:37:49.371139] [DEBUG] [LOCAL ] PBI: Loaded 50856 existing records from primary storage. [2025-09-22T20:37:49.406750] [DEBUG] [LOCAL ] PBR: Loaded 54493 existing records from primary storage. [2025-09-22T20:37:49.445927] [INFO ] [MAIN ] PBR: Loaded 54493 existing records. [2025-09-22T20:37:49.414449] [INFO ] [MAIN ] PBI: Loaded 50856 existing records. [2025-09-22T20:37:49.463456] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:37:49.631439] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-22T20:37:49.722552] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-22T20:37:49.802080] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-22T20:37:49.830330] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-22T20:37:50.171597] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:37:50.216132] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-22T20:37:50.239525] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-22T20:37:50.293847] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:37:50.305404] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-22T20:37:50.305288] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-22T20:37:50.310713] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-22T20:37:50.337415] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-22T20:37:50.321737] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-22T20:37:50.352559] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-22T20:37:50.591612] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:37:50.663563] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-22T20:37:51.252854] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:37:51.286683] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-22T20:37:51.413170] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:37:51.432475] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-22T20:37:51.455956] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:37:51.456266] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-22T20:37:52.177724] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T20:37:52.181672] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-22T20:37:52.605989] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T20:37:52.610708] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-22T20:37:52.909389] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T20:37:52.920170] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-22T20:37:53.037327] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T20:37:53.040173] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-22T20:37:53.803256] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-22T20:37:53.814499] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-22T20:37:53.900700] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T20:37:53.905242] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-22T20:37:53.938436] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T20:37:54.122073] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-22T20:37:54.695381] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T20:37:54.841234] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T20:37:54.850091] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-22T20:37:54.922033] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-22T20:37:55.722020] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-22T20:37:55.893582] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-22T20:37:56.072754] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-22T20:37:56.522065] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-22T20:37:57.193995] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T20:37:57.322067] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-22T20:37:57.564670] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T20:37:58.122049] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-22T20:37:58.370198] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T20:37:58.922064] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-22T20:37:59.722080] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-22T20:37:59.883996] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T20:38:00.020758] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T20:38:00.522068] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-22T20:38:01.322018] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-22T20:38:01.695158] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T20:38:01.855473] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-22T20:38:02.001489] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-22T20:38:02.122233] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-22T20:38:02.922076] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-22T20:38:03.722046] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-22T20:38:03.768610] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T20:38:04.308070] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-22T20:38:04.522098] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-22T20:38:04.880050] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T20:38:05.322096] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-22T20:38:05.390175] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-22T20:38:06.122109] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-22T20:38:06.922073] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-22T20:38:07.190000] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T20:38:07.193873] [INFO ] [REMOTE ] PBT: Full fetch complete (25290 records). [2025-09-22T20:38:07.194041] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-22T20:38:07.626393] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-22T20:38:07.626504] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-22T20:38:07.627406] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-22T20:38:07.643559] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-22T20:38:07.658992] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-22T20:38:07.670208] [DEBUG] [LOCAL ] PBT: Trimmed 25290 records to 17357 (keeping 200 days of data) [2025-09-22T20:38:07.727240] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-22T20:38:07.784044] [DEBUG] [LOCAL ] PBT: Primary data saved (17357 records). [2025-09-22T20:38:07.784206] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-22T20:38:07.784387] [INFO ] [MAIN ] Update Progress: 1641/2372 symbols completed. PBT took 19.6s. Estimated remaining: 1h 37m 8s. Rate: 7.5 symbols/min [2025-09-22T20:38:07.952436] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:38:07.952680] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-09-22T20:38:07.952734] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-09-22T20:38:07.952885] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-22T20:38:07.952928] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-22T20:38:07.952968] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-22T20:38:07.953000] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-22T20:38:08.321381] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:38:08.522051] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-22T20:38:08.590321] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T20:38:08.783008] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T20:38:09.322057] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-22T20:38:10.122060] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-22T20:38:10.164330] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T20:38:10.812887] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-22T20:38:10.922027] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-22T20:38:11.459431] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-22T20:38:11.461774] [INFO ] [REMOTE ] PCF: Full fetch complete (14405 records). [2025-09-22T20:38:11.461866] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-22T20:38:11.723284] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-22T20:38:11.850019] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-22T20:38:11.850216] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-22T20:38:11.850622] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-22T20:38:11.850756] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-22T20:38:11.863779] [DEBUG] [LOCAL ] PCF: Trimmed 14405 records to 8638 (keeping 200 days of data) [2025-09-22T20:38:11.884289] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T20:38:11.953482] [DEBUG] [LOCAL ] PCF: Primary data saved (8638 records). [2025-09-22T20:38:11.953886] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-22T20:38:11.954246] [INFO ] [MAIN ] Update Progress: 1642/2372 symbols completed. PCF took 23.8s. Estimated remaining: 1h 36m 59s. Rate: 7.5 symbols/min [2025-09-22T20:38:12.132039] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:38:12.141094] [DEBUG] [LOCAL ] PCM: Loaded 6920 existing records from primary storage. [2025-09-22T20:38:12.141182] [INFO ] [MAIN ] PCM: Loaded 6920 existing records. [2025-09-22T20:38:12.322727] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:38:12.323020] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-22T20:38:12.323070] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-22T20:38:12.323483] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-22T20:38:12.323561] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-22T20:38:12.529270] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-22T20:38:12.698800] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:38:13.322034] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-22T20:38:13.655162] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T20:38:14.122082] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-22T20:38:14.396937] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T20:38:14.922082] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-22T20:38:15.194129] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T20:38:15.523219] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-22T20:38:15.722078] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-22T20:38:16.522084] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-22T20:38:16.592123] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T20:38:16.626889] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T20:38:17.322064] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-22T20:38:18.081258] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T20:38:18.122102] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-22T20:38:18.790632] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-22T20:38:18.808529] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-22T20:38:18.922038] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-22T20:38:19.722074] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-22T20:38:19.755988] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-22T20:38:20.522057] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-22T20:38:21.239492] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T20:38:21.322091] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-22T20:38:22.109055] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T20:38:22.112771] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-22T20:38:22.123548] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-22T20:38:22.922055] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-22T20:38:23.722113] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-22T20:38:23.723165] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-22T20:38:24.088999] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T20:38:24.522048] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-22T20:38:25.322029] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-22T20:38:25.586617] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T20:38:26.122035] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-22T20:38:26.359229] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T20:38:26.922020] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-22T20:38:27.316119] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-22T20:38:27.328290] [INFO ] [REMOTE ] PBR: Full fetch complete (77777 records). [2025-09-22T20:38:27.328561] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-22T20:38:27.732557] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-22T20:38:27.784013] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-22T20:38:27.784347] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-22T20:38:27.786250] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-22T20:38:27.786731] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-22T20:38:27.792719] [DEBUG] [LOCAL ] PBR: Trimmed 77777 records to 53713 (keeping 200 days of data) [2025-09-22T20:38:27.957238] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T20:38:28.208677] [DEBUG] [LOCAL ] PBR: Primary data saved (53713 records). [2025-09-22T20:38:28.208876] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-22T20:38:28.210770] [INFO ] [MAIN ] Update Progress: 1643/2372 symbols completed. PBR took 40.0s. Estimated remaining: 1h 36m 54s. Rate: 7.5 symbols/min [2025-09-22T20:38:28.375469] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T20:38:28.398598] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:38:28.434271] [DEBUG] [LOCAL ] PCN: Loaded 24489 existing records from primary storage. [2025-09-22T20:38:28.434543] [INFO ] [MAIN ] PCN: Loaded 24489 existing records. [2025-09-22T20:38:28.534194] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-22T20:38:28.625252] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:38:28.625739] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-22T20:38:28.626021] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-22T20:38:28.627039] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-22T20:38:28.647268] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-22T20:38:28.654336] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T20:38:28.761161] [INFO ] [REMOTE ] PBI: Full fetch complete (71906 records). [2025-09-22T20:38:28.763815] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-22T20:38:29.359524] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:38:29.365090] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-22T20:38:29.512531] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-22T20:38:29.512630] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-22T20:38:29.513767] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-22T20:38:29.513834] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-22T20:38:29.519224] [DEBUG] [LOCAL ] PBI: Trimmed 71906 records to 50061 (keeping 200 days of data) [2025-09-22T20:38:29.880998] [DEBUG] [LOCAL ] PBI: Primary data saved (50061 records). [2025-09-22T20:38:29.881211] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-22T20:38:29.881433] [INFO ] [MAIN ] Update Progress: 1644/2372 symbols completed. PBI took 41.7s. Estimated remaining: 1h 36m 44s. Rate: 7.5 symbols/min [2025-09-22T20:38:30.065157] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:38:30.115846] [DEBUG] [LOCAL ] PCOR: Loaded 48854 existing records from primary storage. [2025-09-22T20:38:30.116000] [INFO ] [MAIN ] PCOR: Loaded 48854 existing records. [2025-09-22T20:38:30.137054] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-22T20:38:30.306216] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:38:30.315056] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-22T20:38:30.315167] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-22T20:38:30.314763] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T20:38:30.317452] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-22T20:38:30.317574] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-22T20:38:30.388352] [INFO ] [REMOTE ] PCM: Full fetch complete (10406 records). [2025-09-22T20:38:30.395503] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-22T20:38:31.166011] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:38:31.182636] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-22T20:38:31.300482] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-22T20:38:31.404867] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-22T20:38:31.405002] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-22T20:38:31.405721] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-22T20:38:31.405804] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-22T20:38:31.406762] [DEBUG] [LOCAL ] PCM: Trimmed 10406 records to 6779 (keeping 200 days of data) [2025-09-22T20:38:31.462276] [DEBUG] [LOCAL ] PCM: Primary data saved (6779 records). [2025-09-22T20:38:31.462467] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-22T20:38:31.462620] [INFO ] [MAIN ] Update Progress: 1645/2372 symbols completed. PCM took 19.5s. Estimated remaining: 1h 36m 33s. Rate: 7.5 symbols/min [2025-09-22T20:38:31.724803] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-22T20:38:31.768481] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:38:31.772099] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T20:38:31.792616] [DEBUG] [LOCAL ] PCQ: Loaded 12264 existing records from primary storage. [2025-09-22T20:38:31.792806] [INFO ] [MAIN ] PCQ: Loaded 12264 existing records. [2025-09-22T20:38:32.015318] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:38:32.015754] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-22T20:38:32.015814] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-22T20:38:32.016309] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-22T20:38:32.016370] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-22T20:38:32.397756] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:38:32.522011] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-22T20:38:32.998377] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T20:38:33.322038] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-22T20:38:33.603223] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T20:38:33.791795] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-22T20:38:34.122103] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-22T20:38:34.922033] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-22T20:38:35.015768] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T20:38:35.722123] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-22T20:38:35.959258] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T20:38:35.982372] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T20:38:36.522111] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-22T20:38:37.060995] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T20:38:37.322069] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-22T20:38:38.122073] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-22T20:38:38.583300] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-22T20:38:38.922061] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-22T20:38:39.322057] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-22T20:38:39.722022] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-22T20:38:39.812364] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T20:38:40.522090] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-22T20:38:41.322126] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-22T20:38:41.477334] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T20:38:41.621128] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T20:38:41.754838] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-22T20:38:42.122129] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-22T20:38:42.318763] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T20:38:42.922089] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-22T20:38:42.975807] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T20:38:42.985003] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-09-22T20:38:42.985164] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-22T20:38:42.987385] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:38:42.987575] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:38:42.987672] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:38:42.987924] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-22T20:38:42.988038] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-22T20:38:42.988111] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-22T20:38:42.988197] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-09-22T20:38:42.988293] [INFO ] [MAIN ] Update Progress: 1646/2372 symbols completed. PCG took 35.2s. Estimated remaining: 1h 36m 26s. Rate: 7.5 symbols/min [2025-09-22T20:38:43.178637] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:38:43.233695] [DEBUG] [LOCAL ] PD: Loaded 48486 existing records from primary storage. [2025-09-22T20:38:43.233875] [INFO ] [MAIN ] PD: Loaded 48486 existing records. [2025-09-22T20:38:43.436177] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:38:43.436420] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-22T20:38:43.436468] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-22T20:38:43.438151] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-22T20:38:43.438213] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-22T20:38:43.728433] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-22T20:38:43.821223] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:38:43.832252] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T20:38:44.522068] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-22T20:38:45.029535] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T20:38:45.092197] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-22T20:38:45.322081] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-22T20:38:46.122112] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-22T20:38:46.922086] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-22T20:38:47.080041] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T20:38:47.124383] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T20:38:47.722063] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-22T20:38:48.364781] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T20:38:48.522076] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-22T20:38:49.161797] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T20:38:49.322069] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-22T20:38:50.122054] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-22T20:38:50.297930] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T20:38:50.789935] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T20:38:50.922092] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-22T20:38:51.400522] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T20:38:51.722067] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-22T20:38:52.522103] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-22T20:38:52.592219] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T20:38:53.322029] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-22T20:38:53.384485] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T20:38:53.566799] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-22T20:38:54.122080] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-22T20:38:54.922117] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-22T20:38:55.323614] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-22T20:38:55.722129] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-22T20:38:56.233241] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-22T20:38:56.522088] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-22T20:38:56.764010] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T20:38:56.983398] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T20:38:57.322025] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-22T20:38:57.380954] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T20:38:58.122064] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-22T20:38:58.486776] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T20:38:58.491340] [INFO ] [REMOTE ] PCN: Full fetch complete (33793 records). [2025-09-22T20:38:58.491433] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-22T20:38:58.866166] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-22T20:38:58.866252] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-22T20:38:58.867022] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-22T20:38:58.867083] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-22T20:38:58.868004] [DEBUG] [LOCAL ] PCN: Trimmed 33793 records to 24213 (keeping 200 days of data) [2025-09-22T20:38:58.926858] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-22T20:38:59.025673] [DEBUG] [LOCAL ] PCN: Primary data saved (24213 records). [2025-09-22T20:38:59.025815] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-22T20:38:59.025902] [INFO ] [MAIN ] Update Progress: 1647/2372 symbols completed. PCN took 30.8s. Estimated remaining: 1h 36m 22s. Rate: 7.5 symbols/min [2025-09-22T20:38:59.198997] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:38:59.199196] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-22T20:38:59.199246] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-22T20:38:59.199414] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-22T20:38:59.199476] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-22T20:38:59.199545] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-22T20:38:59.199592] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-22T20:38:59.562847] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:38:59.628769] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T20:38:59.722035] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-22T20:39:00.204552] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T20:39:00.522109] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-22T20:39:01.322087] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-22T20:39:01.614379] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T20:39:01.881384] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-22T20:39:01.889964] [INFO ] [REMOTE ] PCOR: Full fetch complete (69681 records). [2025-09-22T20:39:01.890126] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-22T20:39:02.127199] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-22T20:39:02.292568] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-22T20:39:02.292699] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-22T20:39:02.293877] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-22T20:39:02.293963] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-22T20:39:02.295606] [DEBUG] [LOCAL ] PCOR: Trimmed 69681 records to 48114 (keeping 200 days of data) [2025-09-22T20:39:02.574972] [DEBUG] [LOCAL ] PCOR: Primary data saved (48114 records). [2025-09-22T20:39:02.575102] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-22T20:39:02.575234] [INFO ] [MAIN ] Update Progress: 1648/2372 symbols completed. PCOR took 32.7s. Estimated remaining: 1h 36m 12s. Rate: 7.5 symbols/min [2025-09-22T20:39:02.745027] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:39:02.797714] [DEBUG] [LOCAL ] PDI: Loaded 51004 existing records from primary storage. [2025-09-22T20:39:02.797896] [INFO ] [MAIN ] PDI: Loaded 51004 existing records. [2025-09-22T20:39:02.927127] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-22T20:39:03.047732] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:39:03.048023] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-22T20:39:03.048082] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-22T20:39:03.049311] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-22T20:39:03.049372] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-22T20:39:03.409416] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T20:39:03.413228] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:39:03.527471] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T20:39:03.722057] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-22T20:39:04.361598] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T20:39:04.399011] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (3.08 seconds). [2025-09-22T20:39:04.522011] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-22T20:39:05.020725] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-22T20:39:05.322052] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-22T20:39:06.122067] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-22T20:39:06.611958] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-22T20:39:06.922094] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-22T20:39:07.446458] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-22T20:39:07.722079] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-22T20:39:08.021952] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T20:39:08.522053] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-22T20:39:09.322049] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-22T20:39:09.452021] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T20:39:09.736751] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-22T20:39:10.122121] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-22T20:39:10.344342] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T20:39:10.922075] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-22T20:39:11.328073] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-22T20:39:11.722075] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-22T20:39:11.911634] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T20:39:12.522062] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-22T20:39:13.322105] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-22T20:39:13.632223] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T20:39:13.895681] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T20:39:13.898380] [INFO ] [REMOTE ] PCQ: Full fetch complete (17482 records). [2025-09-22T20:39:13.898453] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-22T20:39:14.127187] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-22T20:39:14.284459] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-22T20:39:14.284538] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-22T20:39:14.284961] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-22T20:39:14.285024] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-22T20:39:14.285598] [DEBUG] [LOCAL ] PCQ: Trimmed 17482 records to 11973 (keeping 200 days of data) [2025-09-22T20:39:14.360037] [DEBUG] [LOCAL ] PCQ: Primary data saved (11973 records). [2025-09-22T20:39:14.360170] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-22T20:39:14.360253] [INFO ] [MAIN ] Update Progress: 1649/2372 symbols completed. PCQ took 42.9s. Estimated remaining: 1h 36m 6s. Rate: 7.5 symbols/min [2025-09-22T20:39:14.534592] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:39:14.565117] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-22T20:39:14.593358] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-22T20:39:14.621989] [DEBUG] [LOCAL ] PDM: Loaded 40500 existing records from primary storage. [2025-09-22T20:39:14.622135] [INFO ] [MAIN ] PDM: Loaded 40500 existing records. [2025-09-22T20:39:14.798689] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:39:14.798938] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-22T20:39:14.798987] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-22T20:39:14.799952] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-22T20:39:14.800014] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-22T20:39:14.927232] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-22T20:39:15.158297] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:39:15.722071] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-22T20:39:16.100667] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-22T20:39:16.522111] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-22T20:39:16.839600] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-22T20:39:16.848296] [INFO ] [REMOTE ] PD: Full fetch complete (67460 records). [2025-09-22T20:39:16.848452] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-22T20:39:16.962047] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-22T20:39:16.968848] [INFO ] [REMOTE ] PDCC: Full fetch complete (1321 records). [2025-09-22T20:39:16.979239] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-22T20:39:17.331093] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-22T20:39:17.392852] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-22T20:39:17.393766] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:39:17.393893] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:39:17.394043] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-22T20:39:17.399750] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-22T20:39:17.415298] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-22T20:39:17.438712] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-22T20:39:17.447219] [INFO ] [MAIN ] Update Progress: 1650/2372 symbols completed. PDCC took 18.4s. Estimated remaining: 1h 35m 56s. Rate: 7.5 symbols/min [2025-09-22T20:39:17.595754] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-22T20:39:17.598580] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-22T20:39:17.599633] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-22T20:39:17.600025] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-22T20:39:17.672623] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:39:17.673302] [DEBUG] [LOCAL ] PD: Trimmed 67460 records to 47862 (keeping 200 days of data) [2025-09-22T20:39:17.814678] [DEBUG] [LOCAL ] PDO: Loaded 32308 existing records from primary storage. [2025-09-22T20:39:17.814852] [INFO ] [MAIN ] PDO: Loaded 32308 existing records. [2025-09-22T20:39:18.105728] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:39:18.114971] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-22T20:39:18.115051] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-22T20:39:18.133629] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-22T20:39:18.133786] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-22T20:39:18.133854] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-22T20:39:18.274016] [DEBUG] [LOCAL ] PD: Primary data saved (47862 records). [2025-09-22T20:39:18.284384] [INFO ] [MAIN ] PD: Full history saved. [2025-09-22T20:39:18.289589] [INFO ] [MAIN ] Update Progress: 1651/2372 symbols completed. PD took 35.3s. Estimated remaining: 1h 35m 45s. Rate: 7.5 symbols/min [2025-09-22T20:39:18.646009] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:39:18.711837] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:39:18.725041] [DEBUG] [LOCAL ] PDS: Loaded 18902 existing records from primary storage. [2025-09-22T20:39:18.725144] [INFO ] [MAIN ] PDS: Loaded 18902 existing records. [2025-09-22T20:39:18.901827] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:39:18.902081] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-22T20:39:18.902128] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-22T20:39:18.902733] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-22T20:39:18.902792] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-22T20:39:18.934251] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-22T20:39:19.266005] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:39:19.398388] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-22T20:39:19.721891] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T20:39:19.722092] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-22T20:39:20.522123] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-22T20:39:20.586193] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T20:39:21.322052] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-22T20:39:21.356349] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T20:39:21.771634] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-22T20:39:22.122084] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-22T20:39:22.842997] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T20:39:22.922027] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-22T20:39:23.242906] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T20:39:23.722048] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-22T20:39:24.261178] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T20:39:24.522110] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-22T20:39:25.322143] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-22T20:39:25.480963] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T20:39:25.953833] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T20:39:26.122055] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-22T20:39:26.800684] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T20:39:26.922097] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-22T20:39:27.722055] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-22T20:39:27.981791] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-22T20:39:28.064525] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T20:39:28.522125] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-22T20:39:29.334794] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-22T20:39:29.337762] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T20:39:29.827478] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T20:39:30.122148] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-22T20:39:30.696693] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T20:39:30.922103] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-22T20:39:31.522978] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T20:39:31.722120] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-22T20:39:32.484276] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T20:39:32.522025] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-22T20:39:33.211453] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T20:39:33.322090] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-22T20:39:34.122028] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-22T20:39:34.248539] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-22T20:39:34.316123] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T20:39:34.922109] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-22T20:39:35.392968] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T20:39:35.722085] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-22T20:39:36.522088] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-22T20:39:36.704808] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T20:39:37.096335] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T20:39:37.322071] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-22T20:39:38.122067] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-22T20:39:38.213616] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T20:39:38.224418] [INFO ] [REMOTE ] PDI: Full fetch complete (73097 records). [2025-09-22T20:39:38.224539] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-22T20:39:38.633506] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T20:39:38.657751] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-22T20:39:38.658055] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-22T20:39:38.666416] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-22T20:39:38.666588] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-22T20:39:38.668372] [DEBUG] [LOCAL ] PDI: Trimmed 73097 records to 50242 (keeping 200 days of data) [2025-09-22T20:39:38.922265] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-22T20:39:38.995403] [DEBUG] [LOCAL ] PDI: Primary data saved (50242 records). [2025-09-22T20:39:38.995566] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-22T20:39:38.995679] [INFO ] [MAIN ] Update Progress: 1652/2372 symbols completed. PDI took 36.4s. Estimated remaining: 1h 35m 42s. Rate: 7.5 symbols/min [2025-09-22T20:39:39.176639] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:39:39.190963] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T20:39:39.209460] [DEBUG] [LOCAL ] PDT: Loaded 17765 existing records from primary storage. [2025-09-22T20:39:39.209607] [INFO ] [MAIN ] PDT: Loaded 17765 existing records. [2025-09-22T20:39:39.384788] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:39:39.385085] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-22T20:39:39.385136] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-22T20:39:39.385741] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-22T20:39:39.385832] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-22T20:39:39.730115] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-22T20:39:39.762562] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:39:40.522130] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-22T20:39:40.602252] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T20:39:40.968222] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T20:39:41.322104] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-22T20:39:41.707091] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T20:39:42.122068] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-22T20:39:42.791943] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T20:39:42.798910] [INFO ] [REMOTE ] PDO: Full fetch complete (48216 records). [2025-09-22T20:39:42.799154] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-22T20:39:42.923145] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-22T20:39:43.127396] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T20:39:43.222757] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-22T20:39:43.222870] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-22T20:39:43.224078] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-22T20:39:43.224144] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-22T20:39:43.225523] [DEBUG] [LOCAL ] PDO: Trimmed 48216 records to 31798 (keeping 200 days of data) [2025-09-22T20:39:43.435168] [DEBUG] [LOCAL ] PDO: Primary data saved (31798 records). [2025-09-22T20:39:43.435407] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-22T20:39:43.435539] [INFO ] [MAIN ] Update Progress: 1653/2372 symbols completed. PDO took 26.0s. Estimated remaining: 1h 35m 33s. Rate: 7.5 symbols/min [2025-09-22T20:39:43.618740] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:39:43.636468] [DEBUG] [LOCAL ] PDX: Loaded 14674 existing records from primary storage. [2025-09-22T20:39:43.636680] [INFO ] [MAIN ] PDX: Loaded 14674 existing records. [2025-09-22T20:39:43.731187] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-22T20:39:43.832601] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:39:43.833048] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-22T20:39:43.833125] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-22T20:39:43.833823] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-22T20:39:43.833887] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-22T20:39:44.200229] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:39:44.500576] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T20:39:44.522051] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-22T20:39:44.632246] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T20:39:44.634871] [INFO ] [REMOTE ] PDS: Full fetch complete (25654 records). [2025-09-22T20:39:44.634953] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-22T20:39:45.019946] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-22T20:39:45.020048] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-22T20:39:45.020580] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-22T20:39:45.020621] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-22T20:39:45.021324] [DEBUG] [LOCAL ] PDS: Trimmed 25654 records to 18281 (keeping 200 days of data) [2025-09-22T20:39:45.131967] [DEBUG] [LOCAL ] PDS: Primary data saved (18281 records). [2025-09-22T20:39:45.132131] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-22T20:39:45.132237] [INFO ] [MAIN ] Update Progress: 1654/2372 symbols completed. PDS took 26.8s. Estimated remaining: 1h 35m 22s. Rate: 7.5 symbols/min [2025-09-22T20:39:45.309323] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:39:45.322042] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-22T20:39:45.361893] [DEBUG] [LOCAL ] PEB: Loaded 51497 existing records from primary storage. [2025-09-22T20:39:45.362053] [INFO ] [MAIN ] PEB: Loaded 51497 existing records. [2025-09-22T20:39:45.547035] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:39:45.547299] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-22T20:39:45.547359] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-22T20:39:45.548572] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-22T20:39:45.548672] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-22T20:39:45.915275] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:39:46.040024] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T20:39:46.122080] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-22T20:39:46.528091] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T20:39:46.922036] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-22T20:39:47.082963] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T20:39:47.722064] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-22T20:39:48.522022] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-22T20:39:48.601397] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T20:39:48.631331] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T20:39:49.322085] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-22T20:39:49.916534] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T20:39:50.122079] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-22T20:39:50.834693] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T20:39:50.922011] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-22T20:39:51.220509] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T20:39:51.722055] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-22T20:39:52.522025] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-22T20:39:52.792147] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T20:39:53.322029] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-22T20:39:53.598530] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T20:39:53.858662] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-09-22T20:39:54.122075] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-22T20:39:54.249912] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T20:39:54.922062] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-22T20:39:55.722026] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-22T20:39:55.775973] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T20:39:56.357256] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T20:39:56.430244] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-22T20:39:56.522084] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-22T20:39:57.322035] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-22T20:39:57.618229] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T20:39:58.122023] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-22T20:39:58.295692] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T20:39:58.922057] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-22T20:39:59.722031] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-22T20:39:59.948057] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T20:39:59.969177] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T20:40:00.522058] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-22T20:40:00.876889] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T20:40:00.882924] [INFO ] [REMOTE ] PDM: Full fetch complete (57210 records). [2025-09-22T20:40:00.883045] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-22T20:40:01.281087] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-22T20:40:01.281170] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-22T20:40:01.282240] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-22T20:40:01.282306] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-22T20:40:01.283547] [DEBUG] [LOCAL ] PDM: Trimmed 57210 records to 39828 (keeping 200 days of data) [2025-09-22T20:40:01.335262] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-22T20:40:01.523011] [DEBUG] [LOCAL ] PDM: Primary data saved (39828 records). [2025-09-22T20:40:01.523169] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-22T20:40:01.523273] [INFO ] [MAIN ] Update Progress: 1655/2372 symbols completed. PDM took 47.2s. Estimated remaining: 1h 35m 18s. Rate: 7.5 symbols/min [2025-09-22T20:40:01.692235] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:40:01.692421] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-09-22T20:40:01.692475] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-09-22T20:40:01.692614] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-22T20:40:01.692688] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-22T20:40:01.692749] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-22T20:40:01.692782] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-22T20:40:02.083066] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:40:02.114961] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T20:40:02.124995] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-22T20:40:02.136917] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T20:40:02.922053] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-22T20:40:03.722067] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-22T20:40:04.088784] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T20:40:04.522028] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-22T20:40:04.561079] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-22T20:40:05.322096] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-22T20:40:05.542991] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T20:40:05.668614] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T20:40:06.122032] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-22T20:40:06.346153] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-22T20:40:06.922083] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-22T20:40:07.052678] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T20:40:07.055566] [INFO ] [REMOTE ] PDT: Full fetch complete (25127 records). [2025-09-22T20:40:07.055688] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-22T20:40:07.427461] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-22T20:40:07.427568] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-22T20:40:07.428121] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-22T20:40:07.428182] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-22T20:40:07.428839] [DEBUG] [LOCAL ] PDT: Trimmed 25127 records to 17373 (keeping 200 days of data) [2025-09-22T20:40:07.532341] [DEBUG] [LOCAL ] PDT: Primary data saved (17373 records). [2025-09-22T20:40:07.532479] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-22T20:40:07.532566] [INFO ] [MAIN ] Update Progress: 1656/2372 symbols completed. PDT took 28.5s. Estimated remaining: 1h 35m 9s. Rate: 7.5 symbols/min [2025-09-22T20:40:07.700287] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:40:07.729513] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-22T20:40:07.732085] [DEBUG] [LOCAL ] PEN: Loaded 31122 existing records from primary storage. [2025-09-22T20:40:07.732219] [INFO ] [MAIN ] PEN: Loaded 31122 existing records. [2025-09-22T20:40:07.910562] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:40:07.910877] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-22T20:40:07.910950] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-22T20:40:07.911781] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-22T20:40:07.911846] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-22T20:40:08.261129] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:40:08.522025] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-22T20:40:08.650867] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T20:40:08.769616] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-22T20:40:09.322043] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-22T20:40:09.888531] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T20:40:10.122039] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-22T20:40:10.146380] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T20:40:10.149069] [INFO ] [REMOTE ] PDX: Full fetch complete (24783 records). [2025-09-22T20:40:10.149145] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-22T20:40:10.517273] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-22T20:40:10.517352] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-22T20:40:10.517875] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-22T20:40:10.517936] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-22T20:40:10.518588] [DEBUG] [LOCAL ] PDX: Trimmed 24783 records to 14466 (keeping 200 days of data) [2025-09-22T20:40:10.607160] [DEBUG] [LOCAL ] PDX: Primary data saved (14466 records). [2025-09-22T20:40:10.607314] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-22T20:40:10.607402] [INFO ] [MAIN ] Update Progress: 1657/2372 symbols completed. PDX took 27.2s. Estimated remaining: 1h 34m 59s. Rate: 7.5 symbols/min [2025-09-22T20:40:10.775170] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:40:10.787424] [DEBUG] [LOCAL ] PEO: Loaded 11030 existing records from primary storage. [2025-09-22T20:40:10.787551] [INFO ] [MAIN ] PEO: Loaded 11030 existing records. [2025-09-22T20:40:10.927133] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-22T20:40:10.969910] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:40:10.970288] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-22T20:40:10.970357] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-22T20:40:10.970874] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-22T20:40:10.970936] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-22T20:40:11.330519] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:40:11.533313] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T20:40:11.722095] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-22T20:40:12.522095] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-22T20:40:12.836799] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-22T20:40:13.322107] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-22T20:40:13.545400] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T20:40:13.577857] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T20:40:14.122132] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-22T20:40:14.760113] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T20:40:14.922036] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-22T20:40:15.722030] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-22T20:40:16.110394] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T20:40:16.472458] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T20:40:16.522019] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-22T20:40:16.549122] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T20:40:17.322072] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-22T20:40:18.084375] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T20:40:18.122390] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-22T20:40:18.125034] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T20:40:18.922102] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-22T20:40:19.722060] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-22T20:40:20.100442] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-22T20:40:20.389532] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T20:40:20.522060] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-22T20:40:21.322047] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-22T20:40:21.698051] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-22T20:40:21.851873] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T20:40:22.122106] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-22T20:40:22.922080] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-22T20:40:23.036723] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T20:40:23.381246] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-22T20:40:23.722073] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-22T20:40:24.318109] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T20:40:24.345527] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-22T20:40:24.522086] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-22T20:40:25.322123] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-22T20:40:26.122072] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-22T20:40:26.156439] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T20:40:26.164595] [INFO ] [REMOTE ] PEB: Full fetch complete (72780 records). [2025-09-22T20:40:26.164858] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-22T20:40:26.571561] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-22T20:40:26.571686] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-22T20:40:26.573828] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-22T20:40:26.573895] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-22T20:40:26.577940] [DEBUG] [LOCAL ] PEB: Trimmed 72780 records to 50729 (keeping 200 days of data) [2025-09-22T20:40:26.888177] [DEBUG] [LOCAL ] PEB: Primary data saved (50729 records). [2025-09-22T20:40:26.888318] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-22T20:40:26.888470] [INFO ] [MAIN ] Update Progress: 1658/2372 symbols completed. PEB took 41.8s. Estimated remaining: 1h 34m 54s. Rate: 7.5 symbols/min [2025-09-22T20:40:26.927313] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-22T20:40:27.090821] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:40:27.108065] [DEBUG] [LOCAL ] PERF: Loaded 14289 existing records from primary storage. [2025-09-22T20:40:27.108214] [INFO ] [MAIN ] PERF: Loaded 14289 existing records. [2025-09-22T20:40:27.298531] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:40:27.299614] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-22T20:40:27.299798] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-22T20:40:27.310215] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-22T20:40:27.325998] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-22T20:40:27.346453] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-22T20:40:27.526948] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T20:40:27.727275] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-22T20:40:27.775514] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:40:27.816887] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-22T20:40:28.522067] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-22T20:40:29.322051] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-22T20:40:29.631495] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T20:40:29.794780] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-22T20:40:30.117254] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-22T20:40:30.121760] [INFO ] [REMOTE ] PEN: Full fetch complete (44010 records). [2025-09-22T20:40:30.121926] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-22T20:40:30.122093] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-22T20:40:30.517315] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-22T20:40:30.517467] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-22T20:40:30.518761] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-22T20:40:30.518860] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-22T20:40:30.519912] [DEBUG] [LOCAL ] PEN: Trimmed 44010 records to 30535 (keeping 200 days of data) [2025-09-22T20:40:30.722094] [DEBUG] [LOCAL ] PEN: Primary data saved (30535 records). [2025-09-22T20:40:30.722238] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-22T20:40:30.722410] [INFO ] [MAIN ] Update Progress: 1659/2372 symbols completed. PEN took 23.2s. Estimated remaining: 1h 34m 45s. Rate: 7.5 symbols/min [2025-09-22T20:40:30.890256] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:40:30.890490] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-22T20:40:30.890545] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-22T20:40:30.890725] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-22T20:40:30.890776] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-22T20:40:30.890818] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-22T20:40:30.890865] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-22T20:40:30.927240] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-22T20:40:31.260285] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:40:31.722031] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-22T20:40:32.161683] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T20:40:32.204261] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T20:40:32.299616] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T20:40:32.522044] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-22T20:40:33.322033] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-22T20:40:33.569297] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T20:40:33.573467] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:40:33.574047] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-22T20:40:34.122058] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-22T20:40:34.922048] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-22T20:40:34.976355] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T20:40:35.223275] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:40:35.223621] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-22T20:40:35.722052] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-22T20:40:36.040921] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:40:36.041245] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-22T20:40:36.522072] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-22T20:40:37.317607] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-22T20:40:37.325028] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-22T20:40:37.327427] [INFO ] [REMOTE ] PEG: Full fetch complete (76283 records). [2025-09-22T20:40:37.327540] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-22T20:40:37.328733] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:40:37.328822] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:40:37.328879] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:40:37.328970] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-22T20:40:37.329063] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-22T20:40:37.329144] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-22T20:40:37.329232] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-09-22T20:40:37.329368] [INFO ] [MAIN ] Update Progress: 1660/2372 symbols completed. PEG took 35.8s. Estimated remaining: 1h 34m 36s. Rate: 7.5 symbols/min [2025-09-22T20:40:37.504032] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:40:37.512151] [DEBUG] [LOCAL ] PFD: Loaded 5232 existing records from primary storage. [2025-09-22T20:40:37.512274] [INFO ] [MAIN ] PFD: Loaded 5232 existing records. [2025-09-22T20:40:37.633811] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:40:37.672744] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-22T20:40:37.693823] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:40:37.694058] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-22T20:40:37.694105] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-22T20:40:37.694412] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-22T20:40:37.694472] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-22T20:40:38.058700] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:40:38.122063] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-22T20:40:38.922069] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-22T20:40:39.047769] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T20:40:39.722079] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-22T20:40:39.754437] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T20:40:39.756768] [INFO ] [REMOTE ] PEO: Full fetch complete (16358 records). [2025-09-22T20:40:39.756856] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-22T20:40:40.062965] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:40:40.078719] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-22T20:40:40.140492] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-22T20:40:40.140566] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-22T20:40:40.140968] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-22T20:40:40.141059] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-22T20:40:40.141630] [DEBUG] [LOCAL ] PEO: Trimmed 16358 records to 10828 (keeping 200 days of data) [2025-09-22T20:40:40.220067] [DEBUG] [LOCAL ] PEO: Primary data saved (10828 records). [2025-09-22T20:40:40.220201] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-22T20:40:40.220357] [INFO ] [MAIN ] Update Progress: 1661/2372 symbols completed. PEO took 29.6s. Estimated remaining: 1h 34m 26s. Rate: 7.5 symbols/min [2025-09-22T20:40:40.400503] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:40:40.400835] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-09-22T20:40:40.400890] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-09-22T20:40:40.401059] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-22T20:40:40.401102] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-22T20:40:40.401143] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-22T20:40:40.401175] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-22T20:40:40.527153] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-22T20:40:40.759069] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:40:41.322067] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-22T20:40:41.609236] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:40:41.609562] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-22T20:40:41.722067] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T20:40:42.122069] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-22T20:40:42.922038] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-22T20:40:43.003343] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T20:40:43.193625] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:40:43.193999] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-22T20:40:43.722060] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-22T20:40:44.522055] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-22T20:40:45.304374] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T20:40:45.322052] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-22T20:40:45.498201] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T20:40:46.122085] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-22T20:40:46.771850] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T20:40:46.922050] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-22T20:40:47.722140] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-22T20:40:47.822422] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T20:40:48.155463] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-22T20:40:48.522101] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-22T20:40:49.322157] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-22T20:40:49.631442] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T20:40:49.686379] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T20:40:49.994891] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T20:40:50.122095] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-22T20:40:50.922078] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-22T20:40:51.483940] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T20:40:51.501087] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T20:40:51.722059] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-22T20:40:52.522053] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-22T20:40:53.322024] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-22T20:40:53.633940] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T20:40:53.976165] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-22T20:40:54.122081] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-22T20:40:54.374345] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-22T20:40:54.922054] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-22T20:40:55.709292] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T20:40:55.715099] [INFO ] [REMOTE ] PEW: Full fetch complete (15170 records). [2025-09-22T20:40:55.715172] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-22T20:40:55.727447] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-22T20:40:55.839957] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T20:40:55.881543] [INFO ] [REMOTE ] PERF: Full fetch complete (21930 records). [2025-09-22T20:40:55.890932] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-22T20:40:55.956826] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 48 unique days, need 200 days [2025-09-22T20:40:56.001921] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:40:56.018124] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:40:56.026295] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-22T20:40:56.028842] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-22T20:40:56.028943] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-22T20:40:56.029060] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-22T20:40:56.029206] [INFO ] [MAIN ] Update Progress: 1662/2372 symbols completed. PEW took 25.3s. Estimated remaining: 1h 34m 21s. Rate: 7.5 symbols/min [2025-09-22T20:40:56.394992] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:40:56.508840] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-22T20:40:56.511999] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-22T20:40:56.512225] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-22T20:40:56.514459] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-22T20:40:56.515668] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-22T20:40:56.522464] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-22T20:40:56.524712] [DEBUG] [LOCAL ] PERF: Trimmed 21930 records to 13989 (keeping 200 days of data) [2025-09-22T20:40:56.620833] [DEBUG] [LOCAL ] PFGC: Loaded 47747 existing records from primary storage. [2025-09-22T20:40:56.621522] [INFO ] [MAIN ] PFGC: Loaded 47747 existing records. [2025-09-22T20:40:56.814125] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:40:56.815908] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-22T20:40:56.816623] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-22T20:40:56.819391] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-22T20:40:56.819738] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-22T20:40:56.933103] [DEBUG] [LOCAL ] PERF: Primary data saved (13989 records). [2025-09-22T20:40:56.943889] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-22T20:40:56.954497] [INFO ] [MAIN ] Update Progress: 1663/2372 symbols completed. PERF took 30.1s. Estimated remaining: 1h 34m 10s. Rate: 7.5 symbols/min [2025-09-22T20:40:57.337853] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-22T20:40:57.371935] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:40:57.410537] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:40:57.422549] [DEBUG] [LOCAL ] PFH: Loaded 7016 existing records from primary storage. [2025-09-22T20:40:57.422837] [INFO ] [MAIN ] PFH: Loaded 7016 existing records. [2025-09-22T20:40:57.607576] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:40:57.607925] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-22T20:40:57.607982] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-22T20:40:57.608410] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-22T20:40:57.608471] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-22T20:40:58.004907] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:40:58.032248] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T20:40:58.122062] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-22T20:40:58.922084] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-22T20:40:59.143323] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-22T20:40:59.170676] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T20:40:59.699043] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T20:40:59.721999] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-22T20:41:00.525723] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-22T20:41:00.530487] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T20:41:01.322131] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-22T20:41:02.031963] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T20:41:02.108147] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T20:41:02.122011] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-22T20:41:02.922064] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-22T20:41:03.722079] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-22T20:41:04.036959] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-22T20:41:04.522080] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-22T20:41:04.740726] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T20:41:05.322033] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-22T20:41:05.792948] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-22T20:41:06.059887] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T20:41:06.063038] [INFO ] [REMOTE ] PFD: Full fetch complete (7387 records). [2025-09-22T20:41:06.063333] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-22T20:41:06.127163] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-22T20:41:06.426470] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T20:41:06.514266] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-22T20:41:06.514356] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-22T20:41:06.514624] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-22T20:41:06.514699] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-22T20:41:06.515155] [DEBUG] [LOCAL ] PFD: Trimmed 7387 records to 5143 (keeping 200 days of data) [2025-09-22T20:41:06.548622] [DEBUG] [LOCAL ] PFD: Primary data saved (5143 records). [2025-09-22T20:41:06.548832] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-22T20:41:06.548973] [INFO ] [MAIN ] Update Progress: 1664/2372 symbols completed. PFD took 29.2s. Estimated remaining: 1h 34m 3s. Rate: 7.5 symbols/min [2025-09-22T20:41:06.735911] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:41:06.751185] [DEBUG] [LOCAL ] PFL: Loaded 13980 existing records from primary storage. [2025-09-22T20:41:06.751442] [INFO ] [MAIN ] PFL: Loaded 13980 existing records. [2025-09-22T20:41:06.922757] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-22T20:41:06.922623] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T20:41:06.966969] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:41:06.967304] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-22T20:41:06.967362] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-22T20:41:06.968314] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-22T20:41:06.968398] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-22T20:41:07.347104] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:41:07.722094] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-22T20:41:08.522035] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-22T20:41:08.625852] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T20:41:09.322053] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-22T20:41:09.350494] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-22T20:41:10.122063] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-22T20:41:10.300834] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-22T20:41:10.922047] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-22T20:41:10.942466] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T20:41:11.004985] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T20:41:11.722101] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-22T20:41:12.195891] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T20:41:12.522067] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-22T20:41:13.322044] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-22T20:41:13.512490] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T20:41:14.122033] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-22T20:41:14.198370] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T20:41:14.920118] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (3.20 seconds). [2025-09-22T20:41:14.930673] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-22T20:41:14.944589] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T20:41:15.722083] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-22T20:41:16.522035] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-22T20:41:16.705710] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T20:41:16.817549] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T20:41:17.322071] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-22T20:41:17.336098] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-22T20:41:18.122084] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-22T20:41:18.873380] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T20:41:18.891820] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T20:41:18.922099] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-22T20:41:19.722049] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-22T20:41:19.737145] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T20:41:20.522052] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-22T20:41:21.322081] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-22T20:41:21.540802] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T20:41:21.958815] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T20:41:21.960880] [INFO ] [REMOTE ] PFH: Full fetch complete (10714 records). [2025-09-22T20:41:21.961168] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-22T20:41:22.122737] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-22T20:41:22.327693] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-22T20:41:22.327783] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-22T20:41:22.328062] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-22T20:41:22.328102] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-22T20:41:22.328560] [DEBUG] [LOCAL ] PFH: Trimmed 10714 records to 6912 (keeping 200 days of data) [2025-09-22T20:41:22.371842] [DEBUG] [LOCAL ] PFH: Primary data saved (6912 records). [2025-09-22T20:41:22.371997] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-22T20:41:22.372093] [INFO ] [MAIN ] Update Progress: 1665/2372 symbols completed. PFH took 25.4s. Estimated remaining: 1h 33m 58s. Rate: 7.5 symbols/min [2025-09-22T20:41:22.541606] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:41:22.588513] [DEBUG] [LOCAL ] PFLT: Loaded 44319 existing records from primary storage. [2025-09-22T20:41:22.588713] [INFO ] [MAIN ] PFLT: Loaded 44319 existing records. [2025-09-22T20:41:22.775169] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:41:22.775496] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-22T20:41:22.775565] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-22T20:41:22.777071] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-22T20:41:22.777134] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-22T20:41:22.931998] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-22T20:41:23.211664] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:41:23.241832] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-22T20:41:23.490005] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T20:41:23.722042] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-22T20:41:23.884730] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T20:41:24.522065] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-22T20:41:25.322126] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-22T20:41:26.088728] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T20:41:26.096325] [INFO ] [REMOTE ] PFGC: Full fetch complete (67255 records). [2025-09-22T20:41:26.096455] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-22T20:41:26.128111] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-22T20:41:26.228568] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-22T20:41:26.511307] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-22T20:41:26.511482] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-22T20:41:26.512623] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-22T20:41:26.512777] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-22T20:41:26.515455] [DEBUG] [LOCAL ] PFGC: Trimmed 67255 records to 47028 (keeping 200 days of data) [2025-09-22T20:41:26.664151] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-22T20:41:26.846612] [DEBUG] [LOCAL ] PFGC: Primary data saved (47028 records). [2025-09-22T20:41:26.846800] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-22T20:41:26.846898] [INFO ] [MAIN ] Update Progress: 1666/2372 symbols completed. PFGC took 30.8s. Estimated remaining: 1h 33m 49s. Rate: 7.5 symbols/min [2025-09-22T20:41:26.927149] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-22T20:41:27.019269] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:41:27.040252] [DEBUG] [LOCAL ] PFN: Loaded 22003 existing records from primary storage. [2025-09-22T20:41:27.040377] [INFO ] [MAIN ] PFN: Loaded 22003 existing records. [2025-09-22T20:41:27.217428] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:41:27.217725] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-22T20:41:27.217780] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-22T20:41:27.218545] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-22T20:41:27.218605] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-22T20:41:27.573929] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:41:27.722097] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-22T20:41:28.002020] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T20:41:28.522033] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-22T20:41:28.678723] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T20:41:29.322079] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-22T20:41:29.617773] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-22T20:41:30.122072] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-22T20:41:30.275491] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T20:41:30.373493] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T20:41:30.922151] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-22T20:41:31.526365] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T20:41:31.722080] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-22T20:41:32.522122] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-22T20:41:32.609302] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T20:41:32.785007] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T20:41:33.322055] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-22T20:41:33.494938] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T20:41:33.498110] [INFO ] [REMOTE ] PFL: Full fetch complete (20160 records). [2025-09-22T20:41:33.498188] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-22T20:41:33.907928] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-22T20:41:33.908015] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-22T20:41:33.908499] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-22T20:41:33.908561] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-22T20:41:33.909185] [DEBUG] [LOCAL ] PFL: Trimmed 20160 records to 13814 (keeping 200 days of data) [2025-09-22T20:41:34.013789] [DEBUG] [LOCAL ] PFL: Primary data saved (13814 records). [2025-09-22T20:41:34.013965] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-22T20:41:34.014118] [INFO ] [MAIN ] Update Progress: 1667/2372 symbols completed. PFL took 27.5s. Estimated remaining: 1h 33m 41s. Rate: 7.5 symbols/min [2025-09-22T20:41:34.126062] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-22T20:41:34.209025] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:41:34.216127] [DEBUG] [LOCAL ] PFO: Loaded 5940 existing records from primary storage. [2025-09-22T20:41:34.216214] [INFO ] [MAIN ] PFO: Loaded 5940 existing records. [2025-09-22T20:41:34.415174] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:41:34.415463] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-22T20:41:34.415513] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-22T20:41:34.415815] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-22T20:41:34.415877] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-22T20:41:34.541243] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T20:41:34.831729] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:41:34.922107] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-22T20:41:35.722052] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-22T20:41:35.920876] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-22T20:41:35.980454] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T20:41:36.522069] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-22T20:41:36.806710] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T20:41:37.322063] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-22T20:41:37.935469] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T20:41:38.122041] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-22T20:41:38.257371] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T20:41:38.922110] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-22T20:41:39.036775] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-22T20:41:39.329685] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-22T20:41:39.722076] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-22T20:41:40.522167] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-22T20:41:41.212615] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-22T20:41:41.322077] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-22T20:41:41.445286] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T20:41:41.844629] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-22T20:41:41.853146] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-09-22T20:41:41.853333] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-22T20:41:41.854206] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:41:41.854355] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:41:41.854401] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:41:41.854484] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-22T20:41:41.854568] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-22T20:41:41.854606] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-22T20:41:41.854675] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-09-22T20:41:41.854761] [INFO ] [MAIN ] Update Progress: 1668/2372 symbols completed. PFE took 1m 2s. Estimated remaining: 1h 33m 33s. Rate: 7.5 symbols/min [2025-09-22T20:41:42.032758] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:41:42.080789] [DEBUG] [LOCAL ] PFS: Loaded 36345 existing records from primary storage. [2025-09-22T20:41:42.080933] [INFO ] [MAIN ] PFS: Loaded 36345 existing records. [2025-09-22T20:41:42.127150] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-22T20:41:42.269717] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:41:42.269968] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-22T20:41:42.270017] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-22T20:41:42.271049] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-22T20:41:42.271109] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-22T20:41:42.678038] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:41:42.922065] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-22T20:41:43.722090] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-22T20:41:43.811783] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T20:41:43.826199] [DEBUG] [REMOTE ] PFN: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-22T20:41:43.826587] [WARN ] [REMOTE ] PFN: No data returned for month 2025-05 [2025-09-22T20:41:44.349751] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-22T20:41:44.522091] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-22T20:41:45.322052] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-22T20:41:45.988925] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T20:41:46.122040] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-22T20:41:46.922141] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-22T20:41:47.104205] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T20:41:47.495549] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T20:41:47.502874] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-22T20:41:47.722062] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-22T20:41:48.522069] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-22T20:41:49.322094] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-22T20:41:49.370481] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T20:41:50.061566] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-22T20:41:50.102635] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T20:41:50.122015] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-22T20:41:50.922070] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-22T20:41:51.687374] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T20:41:51.722032] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-22T20:41:52.017465] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T20:41:52.522107] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-22T20:41:53.113428] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T20:41:53.322063] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-22T20:41:54.122111] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-22T20:41:54.233575] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T20:41:54.240532] [INFO ] [REMOTE ] PFLT: Full fetch complete (63185 records). [2025-09-22T20:41:54.240640] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-22T20:41:54.659549] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-22T20:41:54.659675] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-22T20:41:54.660885] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-22T20:41:54.660963] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-22T20:41:54.662319] [DEBUG] [LOCAL ] PFLT: Trimmed 63185 records to 43652 (keeping 200 days of data) [2025-09-22T20:41:54.781392] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T20:41:54.931146] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-22T20:41:54.956113] [DEBUG] [LOCAL ] PFLT: Primary data saved (43652 records). [2025-09-22T20:41:54.956242] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-22T20:41:54.956342] [INFO ] [MAIN ] Update Progress: 1669/2372 symbols completed. PFLT took 32.6s. Estimated remaining: 1h 33m 27s. Rate: 7.5 symbols/min [2025-09-22T20:41:55.134587] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:41:55.150585] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T20:41:55.190165] [DEBUG] [LOCAL ] PFSI: Loaded 29233 existing records from primary storage. [2025-09-22T20:41:55.190371] [INFO ] [MAIN ] PFSI: Loaded 29233 existing records. [2025-09-22T20:41:55.396329] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:41:55.396618] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-22T20:41:55.396704] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-22T20:41:55.397743] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-22T20:41:55.397805] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-22T20:41:55.691053] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-22T20:41:55.727146] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-22T20:41:55.815557] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:41:56.522057] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-22T20:41:56.999397] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-22T20:41:57.326724] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-22T20:41:57.330117] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T20:41:58.122127] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-22T20:41:58.476675] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T20:41:58.922118] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-22T20:41:59.280200] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T20:41:59.722073] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-22T20:42:00.242633] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T20:42:00.520630] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T20:42:00.522546] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-22T20:42:01.322050] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-22T20:42:02.122072] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-22T20:42:02.294934] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T20:42:02.922035] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-22T20:42:03.375093] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T20:42:03.722061] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-22T20:42:04.522188] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-22T20:42:04.818982] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T20:42:04.821201] [INFO ] [REMOTE ] PFO: Full fetch complete (7860 records). [2025-09-22T20:42:04.821277] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-22T20:42:05.172263] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (3.05 seconds). [2025-09-22T20:42:05.182994] [INFO ] [REMOTE ] PFN: Full fetch complete (27775 records). [2025-09-22T20:42:05.203843] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-22T20:42:05.317238] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-22T20:42:05.325949] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-22T20:42:05.350380] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-22T20:42:05.355590] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-22T20:42:05.381111] [DEBUG] [LOCAL ] PFO: Trimmed 7860 records to 5850 (keeping 200 days of data) [2025-09-22T20:42:05.516580] [WARN ] [VALIDATOR ] PFN: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-22T20:42:05.517751] [FATAL] [MAIN ] PFN: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:42:05.518392] [WARN ] [MAIN ] PFN: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:42:05.524361] [DEBUG] [LOCAL ] PFO: Primary data saved (5850 records). [2025-09-22T20:42:05.522049] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-22T20:42:05.524481] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-22T20:42:05.524875] [DEBUG] [LOCAL ] PFN: No primary data file found to delete. [2025-09-22T20:42:05.525070] [INFO ] [MAIN ] Update Progress: 1670/2372 symbols completed. PFO took 31.5s. Estimated remaining: 1h 33m 20s. Rate: 7.5 symbols/min [2025-09-22T20:42:05.525150] [INFO ] [LOCAL ] PFN: Starting deletion of derivative data. [2025-09-22T20:42:05.530866] [DEBUG] [LOCAL ] PFN: Deleted derivative data file. [2025-09-22T20:42:05.548851] [INFO ] [MAIN ] Update Progress: 1671/2372 symbols completed. PFN took 38.7s. Estimated remaining: 1h 33m 9s. Rate: 7.5 symbols/min [2025-09-22T20:42:05.692493] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-22T20:42:05.778036] [INFO ] [REMOTE ] PFS: Full fetch complete (51459 records). [2025-09-22T20:42:05.814247] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-22T20:42:05.919960] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:42:05.975466] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-09-22T20:42:06.026428] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-09-22T20:42:06.059529] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:42:06.065192] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-22T20:42:06.065704] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-22T20:42:06.066155] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-22T20:42:06.082135] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-22T20:42:06.273431] [DEBUG] [LOCAL ] PGP: Loaded 5490 existing records from primary storage. [2025-09-22T20:42:06.331989] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T20:42:06.330274] [INFO ] [MAIN ] PGP: Loaded 5490 existing records. [2025-09-22T20:42:06.392996] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-22T20:42:06.823244] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-22T20:42:06.862729] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-22T20:42:06.910945] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-22T20:42:06.909831] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:42:06.911155] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-22T20:42:06.916992] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-22T20:42:06.932458] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-22T20:42:06.966213] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-22T20:42:06.994742] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:42:06.995095] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-22T20:42:06.995417] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-22T20:42:07.017490] [DEBUG] [LOCAL ] PFS: Trimmed 51459 records to 35756 (keeping 200 days of data) [2025-09-22T20:42:07.488549] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:42:07.490029] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-22T20:42:07.610259] [DEBUG] [LOCAL ] PFS: Primary data saved (35756 records). [2025-09-22T20:42:07.610417] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-22T20:42:07.610502] [INFO ] [MAIN ] Update Progress: 1672/2372 symbols completed. PFS took 25.8s. Estimated remaining: 1h 32m 58s. Rate: 7.5 symbols/min [2025-09-22T20:42:07.781748] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:42:07.781956] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-09-22T20:42:07.782012] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-09-22T20:42:07.782161] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-22T20:42:07.782206] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-22T20:42:07.782248] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-22T20:42:07.782279] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-22T20:42:08.158473] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:42:08.158901] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-22T20:42:08.182072] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T20:42:08.427882] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T20:42:08.522108] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-22T20:42:08.977107] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-22T20:42:09.164573] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T20:42:09.322068] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-22T20:42:10.127137] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-22T20:42:10.146593] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-22T20:42:10.582802] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T20:42:10.922082] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-22T20:42:11.722092] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-22T20:42:12.409942] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-22T20:42:12.522061] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-22T20:42:13.060678] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T20:42:13.101899] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-22T20:42:13.322060] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-22T20:42:14.122091] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-22T20:42:14.487218] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-22T20:42:14.785747] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T20:42:14.797436] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-22T20:42:14.922040] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-22T20:42:15.722065] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-22T20:42:16.165903] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T20:42:16.522033] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-22T20:42:17.322021] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-22T20:42:17.790124] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-22T20:42:18.122057] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-22T20:42:18.874209] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-22T20:42:18.922015] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-22T20:42:18.982069] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T20:42:19.568422] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-22T20:42:19.722037] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-22T20:42:20.522066] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-22T20:42:21.036018] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-22T20:42:21.322071] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-22T20:42:21.816609] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T20:42:21.822294] [INFO ] [REMOTE ] PFSI: Full fetch complete (40503 records). [2025-09-22T20:42:21.822412] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-22T20:42:22.125514] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-22T20:42:22.299219] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-22T20:42:22.299318] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-22T20:42:22.300273] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-22T20:42:22.300344] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-22T20:42:22.301789] [DEBUG] [LOCAL ] PFSI: Trimmed 40503 records to 28855 (keeping 200 days of data) [2025-09-22T20:42:22.334381] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-22T20:42:22.538143] [DEBUG] [LOCAL ] PFSI: Primary data saved (28855 records). [2025-09-22T20:42:22.538311] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-22T20:42:22.538408] [INFO ] [MAIN ] Update Progress: 1673/2372 symbols completed. PFSI took 27.6s. Estimated remaining: 1h 32m 53s. Rate: 7.5 symbols/min [2025-09-22T20:42:22.715887] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:42:22.762004] [DEBUG] [LOCAL ] PGRE: Loaded 46920 existing records from primary storage. [2025-09-22T20:42:22.762154] [INFO ] [MAIN ] PGRE: Loaded 46920 existing records. [2025-09-22T20:42:22.926719] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-22T20:42:22.968835] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:42:22.969148] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-22T20:42:22.969206] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-22T20:42:22.970502] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-22T20:42:22.970570] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-22T20:42:23.062019] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T20:42:23.384828] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:42:23.431318] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-22T20:42:23.722130] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-22T20:42:24.398084] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T20:42:24.522118] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-22T20:42:25.327185] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-22T20:42:25.344921] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-22T20:42:25.973029] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T20:42:26.117537] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T20:42:26.121990] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-22T20:42:26.921283] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T20:42:26.923076] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-22T20:42:27.722124] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-22T20:42:28.522041] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-22T20:42:28.559886] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T20:42:28.561427] [INFO ] [REMOTE ] PGP: Full fetch complete (7926 records). [2025-09-22T20:42:28.561497] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-22T20:42:28.942133] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-22T20:42:28.942268] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-22T20:42:28.942480] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-22T20:42:28.942521] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-22T20:42:28.942959] [DEBUG] [LOCAL ] PGP: Trimmed 7926 records to 5449 (keeping 200 days of data) [2025-09-22T20:42:28.977308] [DEBUG] [LOCAL ] PGP: Primary data saved (5449 records). [2025-09-22T20:42:28.977430] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-22T20:42:28.977519] [INFO ] [MAIN ] Update Progress: 1674/2372 symbols completed. PGP took 23.4s. Estimated remaining: 1h 32m 44s. Rate: 7.5 symbols/min [2025-09-22T20:42:29.156136] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:42:29.176325] [DEBUG] [LOCAL ] PGZ: Loaded 5490 existing records from primary storage. [2025-09-22T20:42:29.194636] [INFO ] [MAIN ] PGZ: Loaded 5490 existing records. [2025-09-22T20:42:29.298771] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-22T20:42:29.327190] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-22T20:42:29.404501] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:42:29.404813] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-22T20:42:29.404879] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-22T20:42:29.405277] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-22T20:42:29.405341] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-22T20:42:29.778271] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:42:30.061226] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T20:42:30.122022] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-22T20:42:30.922140] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-22T20:42:31.621930] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T20:42:31.698713] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-22T20:42:31.722008] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-22T20:42:32.522042] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-22T20:42:32.665825] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T20:42:33.322086] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-22T20:42:33.668209] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T20:42:34.122037] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-22T20:42:34.229701] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-22T20:42:34.762167] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T20:42:34.922082] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-22T20:42:35.722059] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-22T20:42:36.292110] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-22T20:42:36.359702] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T20:42:36.506677] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T20:42:36.522015] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-22T20:42:37.147361] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T20:42:37.322062] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-22T20:42:38.122082] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-22T20:42:38.781349] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-22T20:42:38.922086] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-22T20:42:39.353804] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T20:42:39.610628] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T20:42:39.722100] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-22T20:42:40.381916] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T20:42:40.522060] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-22T20:42:41.322063] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-22T20:42:42.122036] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-22T20:42:42.214982] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T20:42:42.222862] [INFO ] [REMOTE ] PGR: Full fetch complete (76212 records). [2025-09-22T20:42:42.223032] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-22T20:42:42.223846] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:42:42.223995] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:42:42.224063] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:42:42.224136] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-22T20:42:42.224216] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-22T20:42:42.224273] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-22T20:42:42.224339] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-09-22T20:42:42.224437] [INFO ] [MAIN ] Update Progress: 1675/2372 symbols completed. PGR took 34.6s. Estimated remaining: 1h 32m 39s. Rate: 7.5 symbols/min [2025-09-22T20:42:42.402128] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:42:42.446308] [DEBUG] [LOCAL ] PH: Loaded 39897 existing records from primary storage. [2025-09-22T20:42:42.446463] [INFO ] [MAIN ] PH: Loaded 39897 existing records. [2025-09-22T20:42:42.639989] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:42:42.640436] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-22T20:42:42.640494] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-22T20:42:42.641576] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-22T20:42:42.641638] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-22T20:42:42.932859] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-22T20:42:43.017341] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:42:43.052584] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-22T20:42:43.648814] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T20:42:43.663616] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T20:42:43.722025] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-22T20:42:44.436491] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T20:42:44.522108] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-22T20:42:45.322080] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-22T20:42:45.969753] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T20:42:46.130424] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-22T20:42:46.136049] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T20:42:46.144598] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-09-22T20:42:46.144802] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-22T20:42:46.145810] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:42:46.145907] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:42:46.145958] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:42:46.146049] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-22T20:42:46.146140] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-22T20:42:46.146197] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-22T20:42:46.146294] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-09-22T20:42:46.146404] [INFO ] [MAIN ] Update Progress: 1676/2372 symbols completed. PG took 40.6s. Estimated remaining: 1h 32m 29s. Rate: 7.5 symbols/min [2025-09-22T20:42:46.322588] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:42:46.333110] [DEBUG] [LOCAL ] PHD: Loaded 9763 existing records from primary storage. [2025-09-22T20:42:46.333210] [INFO ] [MAIN ] PHD: Loaded 9763 existing records. [2025-09-22T20:42:46.510700] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:42:46.510987] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-22T20:42:46.511037] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-22T20:42:46.511445] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-22T20:42:46.511505] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-22T20:42:46.871188] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:42:46.922009] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-22T20:42:47.462554] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T20:42:47.722130] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-22T20:42:48.145400] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T20:42:48.522119] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-22T20:42:49.243477] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T20:42:49.322095] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-22T20:42:49.541581] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T20:42:50.036476] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T20:42:50.039076] [INFO ] [REMOTE ] PGZ: Full fetch complete (8979 records). [2025-09-22T20:42:50.039212] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-22T20:42:50.127236] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-22T20:42:50.417557] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-22T20:42:50.417702] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-22T20:42:50.418104] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-22T20:42:50.418207] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-22T20:42:50.418857] [DEBUG] [LOCAL ] PGZ: Trimmed 8979 records to 5402 (keeping 200 days of data) [2025-09-22T20:42:50.456519] [DEBUG] [LOCAL ] PGZ: Primary data saved (5402 records). [2025-09-22T20:42:50.456698] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-22T20:42:50.456860] [INFO ] [MAIN ] Update Progress: 1677/2372 symbols completed. PGZ took 21.5s. Estimated remaining: 1h 32m 20s. Rate: 7.5 symbols/min [2025-09-22T20:42:50.922018] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-22T20:42:51.559773] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T20:42:51.722082] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-22T20:42:52.285471] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T20:42:52.522074] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-22T20:42:53.314328] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T20:42:53.322315] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-22T20:42:53.574080] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T20:42:54.122058] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-22T20:42:54.899325] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T20:42:54.922001] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-22T20:42:55.000555] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T20:42:55.008017] [INFO ] [REMOTE ] PGRE: Full fetch complete (63216 records). [2025-09-22T20:42:55.008142] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-22T20:42:55.403351] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-22T20:42:55.403456] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-22T20:42:55.404504] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-22T20:42:55.404570] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-22T20:42:55.408590] [DEBUG] [LOCAL ] PGRE: Trimmed 63216 records to 46338 (keeping 200 days of data) [2025-09-22T20:42:55.508562] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T20:42:55.690994] [DEBUG] [LOCAL ] PGRE: Primary data saved (46338 records). [2025-09-22T20:42:55.691144] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-22T20:42:55.691269] [INFO ] [MAIN ] Update Progress: 1678/2372 symbols completed. PGRE took 33.2s. Estimated remaining: 1h 32m 10s. Rate: 7.5 symbols/min [2025-09-22T20:42:55.722022] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-22T20:42:56.522095] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-22T20:42:56.636867] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-22T20:42:57.322075] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-22T20:42:58.148463] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T20:42:58.150838] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-22T20:42:58.396593] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T20:42:58.661388] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T20:42:58.922049] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-22T20:42:59.722090] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-22T20:42:59.808345] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-22T20:43:00.522119] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-22T20:43:01.452566] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T20:43:01.455205] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-22T20:43:01.742156] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T20:43:02.122069] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-22T20:43:02.290617] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T20:43:02.293170] [INFO ] [REMOTE ] PHD: Full fetch complete (13800 records). [2025-09-22T20:43:02.293282] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-22T20:43:02.682824] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-22T20:43:02.682913] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-22T20:43:02.683227] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-22T20:43:02.683287] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-22T20:43:02.683991] [DEBUG] [LOCAL ] PHD: Trimmed 13800 records to 9661 (keeping 200 days of data) [2025-09-22T20:43:02.745288] [DEBUG] [LOCAL ] PHD: Primary data saved (9661 records). [2025-09-22T20:43:02.745480] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-22T20:43:02.745681] [INFO ] [MAIN ] Update Progress: 1679/2372 symbols completed. PHD took 16.6s. Estimated remaining: 1h 32m 2s. Rate: 7.5 symbols/min [2025-09-22T20:43:03.792941] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T20:43:03.802000] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-22T20:43:05.288524] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T20:43:05.296862] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-22T20:43:06.797105] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T20:43:06.805214] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-22T20:43:08.398191] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T20:43:08.407162] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-22T20:43:09.979301] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T20:43:09.984782] [INFO ] [REMOTE ] PH: Full fetch complete (56712 records). [2025-09-22T20:43:09.984918] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-22T20:43:10.378081] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-22T20:43:10.378171] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-22T20:43:10.379139] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-22T20:43:10.379206] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-22T20:43:10.380500] [DEBUG] [LOCAL ] PH: Trimmed 56712 records to 39033 (keeping 200 days of data) [2025-09-22T20:43:10.653493] [DEBUG] [LOCAL ] PH: Primary data saved (39033 records). [2025-09-22T20:43:10.653844] [INFO ] [MAIN ] PH: Full history saved. [2025-09-22T20:43:10.655893] [INFO ] [MAIN ] Update Progress: 1680/2372 symbols completed. PH took 28.4s. Estimated remaining: 1h 31m 54s. Rate: 7.5 symbols/min [2025-09-22T20:43:11.304126] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:43:11.336007] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:43:11.408476] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:43:11.425928] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:43:11.455143] [DEBUG] [LOCAL ] PHI: Loaded 15124 existing records from primary storage. [2025-09-22T20:43:11.455413] [INFO ] [MAIN ] PHI: Loaded 15124 existing records. [2025-09-22T20:43:11.649906] [DEBUG] [LOCAL ] PHK: Loaded 27059 existing records from primary storage. [2025-09-22T20:43:11.678329] [DEBUG] [LOCAL ] PHIN: Loaded 34030 existing records from primary storage. [2025-09-22T20:43:11.697922] [INFO ] [MAIN ] PHK: Loaded 27059 existing records. [2025-09-22T20:43:11.698110] [INFO ] [MAIN ] PHIN: Loaded 34030 existing records. [2025-09-22T20:43:11.758952] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:43:11.881108] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-22T20:43:11.913428] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-22T20:43:11.961624] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-22T20:43:11.983308] [DEBUG] [LOCAL ] PHG: Loaded 46960 existing records from primary storage. [2025-09-22T20:43:11.983496] [INFO ] [MAIN ] PHG: Loaded 46960 existing records. [2025-09-22T20:43:11.967062] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-22T20:43:12.232226] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:43:12.281062] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:43:12.330267] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-22T20:43:12.334238] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-22T20:43:12.344215] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-22T20:43:12.340756] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-22T20:43:12.344872] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-22T20:43:12.376992] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-22T20:43:12.471828] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-22T20:43:12.505608] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-22T20:43:12.586520] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:43:12.663160] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-22T20:43:12.703801] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-22T20:43:12.749976] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-22T20:43:12.782073] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-22T20:43:13.241768] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:43:13.377097] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-22T20:43:13.682196] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:43:13.723793] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-22T20:43:13.779841] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:43:13.785429] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-22T20:43:13.863466] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:43:13.863807] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-22T20:43:14.767399] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T20:43:14.771229] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-22T20:43:15.325446] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T20:43:15.332634] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-22T20:43:15.392094] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T20:43:15.398612] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-22T20:43:15.598486] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T20:43:15.607477] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-22T20:43:15.638948] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T20:43:15.642134] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-22T20:43:16.566009] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-22T20:43:16.569315] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-22T20:43:16.734557] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T20:43:16.742360] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-22T20:43:16.813904] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T20:43:16.820600] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-22T20:43:16.994453] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T20:43:17.005532] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-22T20:43:17.511248] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-22T20:43:17.518195] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-22T20:43:18.205372] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T20:43:18.217248] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-22T20:43:18.263180] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T20:43:18.272688] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-22T20:43:18.599586] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T20:43:18.755495] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T20:43:18.922108] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-22T20:43:19.491170] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T20:43:19.722034] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-22T20:43:19.857985] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T20:43:19.966686] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-22T20:43:20.522099] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-22T20:43:21.166202] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T20:43:21.322045] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-22T20:43:22.122152] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-22T20:43:22.324563] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T20:43:22.518819] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T20:43:22.922075] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-22T20:43:23.441475] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T20:43:23.722090] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-22T20:43:24.522056] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-22T20:43:24.625560] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T20:43:25.133762] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T20:43:25.322060] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-22T20:43:25.812364] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T20:43:26.122104] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-22T20:43:26.613971] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T20:43:26.791361] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-22T20:43:26.922144] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-22T20:43:27.722087] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-22T20:43:28.308298] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T20:43:28.522051] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-22T20:43:28.795411] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-22T20:43:29.322074] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-22T20:43:29.695371] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T20:43:30.122008] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-22T20:43:30.580118] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T20:43:30.922030] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-22T20:43:31.180978] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T20:43:31.722076] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-22T20:43:32.522029] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-22T20:43:32.696495] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T20:43:32.882993] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T20:43:32.886637] [INFO ] [REMOTE ] PHI: Full fetch complete (20674 records). [2025-09-22T20:43:32.886739] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-22T20:43:33.267866] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-22T20:43:33.267957] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-22T20:43:33.268460] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-22T20:43:33.268523] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-22T20:43:33.269214] [DEBUG] [LOCAL ] PHI: Trimmed 20674 records to 15014 (keeping 200 days of data) [2025-09-22T20:43:33.327404] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-22T20:43:33.377949] [DEBUG] [LOCAL ] PHI: Primary data saved (15014 records). [2025-09-22T20:43:33.378089] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-22T20:43:33.378234] [INFO ] [MAIN ] Update Progress: 1681/2372 symbols completed. PHI took 22.7s. Estimated remaining: 1h 31m 52s. Rate: 7.5 symbols/min [2025-09-22T20:43:33.560634] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:43:33.561004] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-09-22T20:43:33.561146] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-09-22T20:43:33.561478] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-22T20:43:33.561544] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-22T20:43:33.561689] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-22T20:43:33.566916] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-22T20:43:33.640886] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T20:43:33.691764] [INFO ] [REMOTE ] PHIN: Full fetch complete (48212 records). [2025-09-22T20:43:33.707278] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-22T20:43:34.132404] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-22T20:43:34.219028] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:43:34.347030] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-22T20:43:34.347126] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-22T20:43:34.347981] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-22T20:43:34.348043] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-22T20:43:34.349111] [DEBUG] [LOCAL ] PHIN: Trimmed 48212 records to 33369 (keeping 200 days of data) [2025-09-22T20:43:34.561389] [DEBUG] [LOCAL ] PHIN: Primary data saved (33369 records). [2025-09-22T20:43:34.561519] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-22T20:43:34.561598] [INFO ] [MAIN ] Update Progress: 1682/2372 symbols completed. PHIN took 23.9s. Estimated remaining: 1h 31m 41s. Rate: 7.5 symbols/min [2025-09-22T20:43:34.734137] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:43:34.773761] [DEBUG] [LOCAL ] PHR: Loaded 37775 existing records from primary storage. [2025-09-22T20:43:34.773954] [INFO ] [MAIN ] PHR: Loaded 37775 existing records. [2025-09-22T20:43:34.922367] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-22T20:43:34.974719] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:43:34.975381] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-22T20:43:34.975479] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-22T20:43:34.985823] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-22T20:43:35.000979] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-22T20:43:35.038897] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T20:43:35.378529] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:43:35.653559] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T20:43:35.722096] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-22T20:43:36.529475] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-22T20:43:36.535282] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T20:43:37.004372] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T20:43:37.009380] [INFO ] [REMOTE ] PHK: Full fetch complete (39344 records). [2025-09-22T20:43:37.009493] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-22T20:43:37.327181] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-22T20:43:37.395844] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-22T20:43:37.395924] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-22T20:43:37.396718] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-22T20:43:37.396780] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-22T20:43:37.398707] [DEBUG] [LOCAL ] PHK: Trimmed 39344 records to 26488 (keeping 200 days of data) [2025-09-22T20:43:37.572538] [DEBUG] [LOCAL ] PHK: Primary data saved (26488 records). [2025-09-22T20:43:37.572698] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-22T20:43:37.572800] [INFO ] [MAIN ] Update Progress: 1683/2372 symbols completed. PHK took 26.9s. Estimated remaining: 1h 31m 31s. Rate: 7.5 symbols/min [2025-09-22T20:43:37.740189] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:43:37.740398] [DEBUG] [LOCAL ] PHT: No existing data file found in primary storage. [2025-09-22T20:43:37.740453] [WARN ] [MAIN ] PHT: No existing data found, performing full refresh instead. [2025-09-22T20:43:37.740596] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-22T20:43:37.740638] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-22T20:43:37.740724] [DEBUG] [LOCAL ] PHT: No primary data file found to delete. [2025-09-22T20:43:37.740767] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-22T20:43:38.121403] [INFO ] [REMOTE ] PHT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:43:38.122000] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-12. [2025-09-22T20:43:38.238254] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T20:43:38.830724] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T20:43:38.922019] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-22T20:43:39.130689] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T20:43:39.722118] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-01. [2025-09-22T20:43:40.501761] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T20:43:40.521999] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-22T20:43:40.761529] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T20:43:41.078867] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T20:43:41.322057] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-22T20:43:42.122054] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-22T20:43:42.922106] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-22T20:43:43.182720] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T20:43:43.727174] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-22T20:43:43.739975] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T20:43:43.786260] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-22T20:43:44.522076] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-22T20:43:45.322037] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-22T20:43:45.461829] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T20:43:45.716672] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T20:43:46.122050] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-22T20:43:46.918591] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T20:43:46.927831] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-22T20:43:46.930518] [INFO ] [REMOTE ] PHG: Full fetch complete (65715 records). [2025-09-22T20:43:46.930736] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-22T20:43:47.363376] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-22T20:43:47.363481] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-22T20:43:47.364549] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-22T20:43:47.364634] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-22T20:43:47.366186] [DEBUG] [LOCAL ] PHG: Trimmed 65715 records to 46232 (keeping 200 days of data) [2025-09-22T20:43:47.669176] [DEBUG] [LOCAL ] PHG: Primary data saved (46232 records). [2025-09-22T20:43:47.669310] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-22T20:43:47.669399] [INFO ] [MAIN ] Update Progress: 1684/2372 symbols completed. PHG took 37.0s. Estimated remaining: 1h 31m 24s. Rate: 7.5 symbols/min [2025-09-22T20:43:47.733445] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-22T20:43:47.853374] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:43:47.902364] [DEBUG] [LOCAL ] PII: Loaded 50081 existing records from primary storage. [2025-09-22T20:43:47.902572] [INFO ] [MAIN ] PII: Loaded 50081 existing records. [2025-09-22T20:43:48.064743] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T20:43:48.112182] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:43:48.112569] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-22T20:43:48.112671] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-22T20:43:48.114395] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-22T20:43:48.114459] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-22T20:43:48.284341] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-22T20:43:48.525417] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-22T20:43:48.567199] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:43:49.262888] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T20:43:49.322024] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-22T20:43:49.579936] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T20:43:50.122073] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-22T20:43:50.686489] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T20:43:50.922068] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-22T20:43:51.722138] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-22T20:43:52.014195] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T20:43:52.471457] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T20:43:52.522057] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-22T20:43:53.322034] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-22T20:43:53.448811] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T20:43:54.122033] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-22T20:43:54.328189] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T20:43:54.718319] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T20:43:54.922076] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-22T20:43:55.629858] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T20:43:55.722030] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-22T20:43:55.793676] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-22T20:43:56.522072] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-22T20:43:57.322069] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-22T20:43:57.421683] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T20:43:58.122121] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-22T20:43:58.627938] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-22T20:43:58.732058] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T20:43:58.834006] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T20:43:58.922047] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-22T20:43:59.722093] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-22T20:44:00.388261] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T20:44:00.522100] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-22T20:44:01.322031] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-22T20:44:01.561790] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T20:44:01.565057] [INFO ] [REMOTE ] PHT: Full fetch complete (19325 records). [2025-09-22T20:44:01.565137] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-22T20:44:01.881828] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-22T20:44:02.008157] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-22T20:44:02.008241] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-22T20:44:02.008707] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-22T20:44:02.008792] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-22T20:44:02.009500] [DEBUG] [LOCAL ] PHT: Trimmed 19325 records to 15339 (keeping 200 days of data) [2025-09-22T20:44:02.107212] [DEBUG] [LOCAL ] PHT: Primary data saved (15339 records). [2025-09-22T20:44:02.107366] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-22T20:44:02.107445] [INFO ] [MAIN ] Update Progress: 1685/2372 symbols completed. PHT took 24.5s. Estimated remaining: 1h 31m 19s. Rate: 7.5 symbols/min [2025-09-22T20:44:02.130930] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-22T20:44:02.297489] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:44:02.304343] [DEBUG] [LOCAL ] PIM: Loaded 4840 existing records from primary storage. [2025-09-22T20:44:02.304510] [INFO ] [MAIN ] PIM: Loaded 4840 existing records. [2025-09-22T20:44:02.502304] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:44:02.502665] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-22T20:44:02.502755] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-22T20:44:02.503161] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-22T20:44:02.503232] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-22T20:44:02.889363] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T20:44:02.935927] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-22T20:44:02.928806] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:44:03.722055] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-22T20:44:04.159607] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-22T20:44:04.522096] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-22T20:44:04.579707] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T20:44:05.322065] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-22T20:44:05.380571] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T20:44:05.574339] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T20:44:05.892507] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T20:44:05.900368] [INFO ] [REMOTE ] PHM: Full fetch complete (74641 records). [2025-09-22T20:44:05.900546] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-22T20:44:05.902634] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:44:05.902781] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:44:05.902856] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:44:05.902947] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-22T20:44:05.903021] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-22T20:44:05.903081] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-22T20:44:05.903200] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-09-22T20:44:05.903292] [INFO ] [MAIN ] Update Progress: 1686/2372 symbols completed. PHM took 32.5s. Estimated remaining: 1h 31m 9s. Rate: 7.5 symbols/min [2025-09-22T20:44:06.093601] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:44:06.111453] [DEBUG] [LOCAL ] PINE: Loaded 14460 existing records from primary storage. [2025-09-22T20:44:06.111599] [INFO ] [MAIN ] PINE: Loaded 14460 existing records. [2025-09-22T20:44:06.132154] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-22T20:44:06.297756] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:44:06.298068] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-22T20:44:06.298127] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-22T20:44:06.298778] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-22T20:44:06.298839] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-22T20:44:06.649521] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:44:06.922085] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-22T20:44:07.722077] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-22T20:44:07.803710] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T20:44:08.398873] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-22T20:44:08.522058] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-22T20:44:09.294368] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T20:44:09.301913] [INFO ] [REMOTE ] PHR: Full fetch complete (52206 records). [2025-09-22T20:44:09.302021] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-22T20:44:09.334079] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-22T20:44:09.703880] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-22T20:44:09.703956] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-22T20:44:09.704882] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-22T20:44:09.704966] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-22T20:44:09.706135] [DEBUG] [LOCAL ] PHR: Trimmed 52206 records to 37361 (keeping 200 days of data) [2025-09-22T20:44:09.936834] [DEBUG] [LOCAL ] PHR: Primary data saved (37361 records). [2025-09-22T20:44:09.937020] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-22T20:44:09.937138] [INFO ] [MAIN ] Update Progress: 1687/2372 symbols completed. PHR took 35.4s. Estimated remaining: 1h 30m 60s. Rate: 7.5 symbols/min [2025-09-22T20:44:10.113457] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:44:10.122020] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-22T20:44:10.178402] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-22T20:44:10.178576] [INFO ] [MAIN ] PINS: Loaded 54473 existing records. [2025-09-22T20:44:10.374620] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:44:10.375083] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-22T20:44:10.375158] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-22T20:44:10.377364] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-22T20:44:10.377430] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-22T20:44:10.592140] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-22T20:44:10.593504] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T20:44:10.767756] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-22T20:44:10.843805] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:44:10.922047] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-22T20:44:11.535137] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T20:44:11.722141] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-22T20:44:12.522114] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-22T20:44:13.185265] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-22T20:44:13.322027] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-22T20:44:13.508437] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T20:44:14.038778] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-22T20:44:14.122018] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-22T20:44:14.803175] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-22T20:44:14.922065] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-22T20:44:15.512488] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-22T20:44:15.722061] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-22T20:44:16.522070] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-22T20:44:17.322048] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-22T20:44:17.427631] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T20:44:17.495055] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T20:44:18.122097] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-22T20:44:18.922148] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-22T20:44:19.420688] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-22T20:44:19.657095] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-22T20:44:19.722094] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-22T20:44:19.750068] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T20:44:19.758402] [INFO ] [REMOTE ] PII: Full fetch complete (71073 records). [2025-09-22T20:44:19.758540] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-22T20:44:20.179630] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-22T20:44:20.179822] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-22T20:44:20.180929] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-22T20:44:20.181000] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-22T20:44:20.182997] [DEBUG] [LOCAL ] PII: Trimmed 71073 records to 49284 (keeping 200 days of data) [2025-09-22T20:44:20.491731] [DEBUG] [LOCAL ] PII: Primary data saved (49284 records). [2025-09-22T20:44:20.491899] [INFO ] [MAIN ] PII: Full history saved. [2025-09-22T20:44:20.491996] [INFO ] [MAIN ] Update Progress: 1688/2372 symbols completed. PII took 32.8s. Estimated remaining: 1h 30m 53s. Rate: 7.5 symbols/min [2025-09-22T20:44:20.527680] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-22T20:44:20.693134] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:44:20.711557] [DEBUG] [LOCAL ] PIPR: Loaded 15659 existing records from primary storage. [2025-09-22T20:44:20.711725] [INFO ] [MAIN ] PIPR: Loaded 15659 existing records. [2025-09-22T20:44:20.905345] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:44:20.905698] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-22T20:44:20.905764] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-22T20:44:20.906513] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-22T20:44:20.906575] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-22T20:44:21.289253] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:44:21.322038] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-22T20:44:21.471796] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T20:44:21.722790] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-22T20:44:21.893349] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T20:44:22.122077] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-22T20:44:22.922059] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-22T20:44:23.570530] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-22T20:44:23.722065] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-22T20:44:24.052402] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-22T20:44:24.457579] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-22T20:44:24.522008] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-22T20:44:25.322054] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-22T20:44:25.404261] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-22T20:44:26.122039] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-22T20:44:26.260382] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T20:44:26.922029] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-22T20:44:27.212228] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T20:44:27.722070] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-22T20:44:28.227599] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-22T20:44:28.522035] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-22T20:44:28.968420] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-22T20:44:29.327064] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-22T20:44:29.329883] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T20:44:30.122088] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-22T20:44:30.927160] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-22T20:44:30.928051] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T20:44:30.931598] [INFO ] [REMOTE ] PIM: Full fetch complete (6571 records). [2025-09-22T20:44:30.931713] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-22T20:44:31.299458] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-22T20:44:31.299539] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-22T20:44:31.299746] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-22T20:44:31.299808] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-22T20:44:31.300218] [DEBUG] [LOCAL ] PIM: Trimmed 6571 records to 4732 (keeping 200 days of data) [2025-09-22T20:44:31.328835] [DEBUG] [LOCAL ] PIM: Primary data saved (4732 records). [2025-09-22T20:44:31.328956] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-22T20:44:31.329044] [INFO ] [MAIN ] Update Progress: 1689/2372 symbols completed. PIM took 29.2s. Estimated remaining: 1h 30m 46s. Rate: 7.5 symbols/min [2025-09-22T20:44:31.513081] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:44:31.549243] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-22T20:44:31.577270] [DEBUG] [LOCAL ] PJT: Loaded 23163 existing records from primary storage. [2025-09-22T20:44:31.577408] [INFO ] [MAIN ] PJT: Loaded 23163 existing records. [2025-09-22T20:44:31.732271] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-22T20:44:31.768135] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:44:31.768384] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-22T20:44:31.768432] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-22T20:44:31.769249] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-22T20:44:31.769313] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-22T20:44:32.147012] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:44:32.148359] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T20:44:32.522057] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-22T20:44:32.696320] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T20:44:33.322013] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-22T20:44:33.712190] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T20:44:34.122070] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-22T20:44:34.154990] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T20:44:34.157602] [INFO ] [REMOTE ] PINE: Full fetch complete (21141 records). [2025-09-22T20:44:34.157735] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-22T20:44:34.559878] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-22T20:44:34.559956] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-22T20:44:34.560389] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-22T20:44:34.560425] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-22T20:44:34.561057] [DEBUG] [LOCAL ] PINE: Trimmed 21141 records to 14270 (keeping 200 days of data) [2025-09-22T20:44:34.654976] [DEBUG] [LOCAL ] PINE: Primary data saved (14270 records). [2025-09-22T20:44:34.655111] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-22T20:44:34.655200] [INFO ] [MAIN ] Update Progress: 1690/2372 symbols completed. PINE took 28.8s. Estimated remaining: 1h 30m 36s. Rate: 7.5 symbols/min [2025-09-22T20:44:34.830888] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:44:34.887625] [DEBUG] [LOCAL ] PK: Loaded 53672 existing records from primary storage. [2025-09-22T20:44:34.887815] [INFO ] [MAIN ] PK: Loaded 53672 existing records. [2025-09-22T20:44:34.929713] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-22T20:44:35.074946] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:44:35.075267] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-22T20:44:35.075332] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-22T20:44:35.076777] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-22T20:44:35.076842] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-22T20:44:35.433705] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:44:35.722065] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-22T20:44:36.214329] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T20:44:36.452747] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-22T20:44:36.522018] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-22T20:44:36.793928] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T20:44:37.322059] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-22T20:44:38.122105] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-22T20:44:38.383089] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T20:44:38.559280] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-22T20:44:38.922053] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-22T20:44:39.264117] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T20:44:39.722102] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-22T20:44:40.522087] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-22T20:44:40.772463] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T20:44:41.309548] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T20:44:41.321998] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-22T20:44:41.810920] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-22T20:44:42.122025] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-22T20:44:42.352235] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-22T20:44:42.922073] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-22T20:44:43.343450] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-22T20:44:43.722120] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-22T20:44:44.522039] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-22T20:44:44.674783] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T20:44:44.677569] [INFO ] [REMOTE ] PIPR: Full fetch complete (20341 records). [2025-09-22T20:44:44.677689] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-22T20:44:44.840308] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T20:44:45.100215] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-22T20:44:45.100303] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-22T20:44:45.100755] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-22T20:44:45.100817] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-22T20:44:45.101434] [DEBUG] [LOCAL ] PIPR: Trimmed 20341 records to 15261 (keeping 200 days of data) [2025-09-22T20:44:45.198425] [DEBUG] [LOCAL ] PIPR: Primary data saved (15261 records). [2025-09-22T20:44:45.198571] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-22T20:44:45.198680] [INFO ] [MAIN ] Update Progress: 1691/2372 symbols completed. PIPR took 24.7s. Estimated remaining: 1h 30m 29s. Rate: 7.5 symbols/min [2025-09-22T20:44:45.327121] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-22T20:44:45.372844] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:44:45.386792] [DEBUG] [LOCAL ] PKE: Loaded 12512 existing records from primary storage. [2025-09-22T20:44:45.387000] [INFO ] [MAIN ] PKE: Loaded 12512 existing records. [2025-09-22T20:44:45.571158] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:44:45.571378] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-22T20:44:45.571442] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-22T20:44:45.572086] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-22T20:44:45.572149] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-22T20:44:45.967717] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:44:45.984458] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-22T20:44:46.122043] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-22T20:44:46.922028] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-22T20:44:47.033824] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-22T20:44:47.699995] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-22T20:44:47.722006] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-22T20:44:48.522065] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-22T20:44:48.623255] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T20:44:49.181628] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T20:44:49.190166] [INFO ] [REMOTE ] PINS: Full fetch complete (77738 records). [2025-09-22T20:44:49.190304] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-22T20:44:49.332606] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-22T20:44:49.611008] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-22T20:44:49.611188] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-22T20:44:49.612482] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-22T20:44:49.612638] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-22T20:44:49.614389] [DEBUG] [LOCAL ] PINS: Trimmed 77738 records to 53693 (keeping 200 days of data) [2025-09-22T20:44:49.957601] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T20:44:49.993445] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-22T20:44:50.000821] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-09-22T20:44:50.001481] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-22T20:44:50.001657] [INFO ] [MAIN ] Update Progress: 1692/2372 symbols completed. PINS took 40.1s. Estimated remaining: 1h 30m 20s. Rate: 7.5 symbols/min [2025-09-22T20:44:50.127188] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-22T20:44:50.175028] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:44:50.217483] [DEBUG] [LOCAL ] PKG: Loaded 40008 existing records from primary storage. [2025-09-22T20:44:50.217628] [INFO ] [MAIN ] PKG: Loaded 40008 existing records. [2025-09-22T20:44:50.396728] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:44:50.397002] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-22T20:44:50.397051] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-22T20:44:50.398408] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-22T20:44:50.398469] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-22T20:44:50.762323] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:44:50.922068] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-22T20:44:51.722074] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-22T20:44:51.982632] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T20:44:52.100846] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T20:44:52.373533] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-22T20:44:52.522067] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-22T20:44:53.322032] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-22T20:44:53.360704] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T20:44:54.122121] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-22T20:44:54.700490] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T20:44:54.922074] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-22T20:44:55.722021] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-22T20:44:55.788976] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T20:44:55.903677] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T20:44:56.522089] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-22T20:44:57.322062] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-22T20:44:57.650014] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-22T20:44:57.992192] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T20:44:58.122084] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-22T20:44:58.436835] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T20:44:58.922090] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-22T20:44:59.431537] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T20:44:59.692977] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T20:44:59.722048] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-22T20:45:00.522127] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-22T20:45:00.596055] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-22T20:45:01.322133] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-22T20:45:02.122104] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-22T20:45:02.922132] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-22T20:45:03.204757] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-22T20:45:03.722177] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-22T20:45:04.026391] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-22T20:45:04.522113] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-22T20:45:04.957507] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-22T20:45:05.322057] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-22T20:45:05.988211] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-09-22T20:45:06.122088] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-22T20:45:06.152875] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T20:45:06.491172] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T20:45:06.802419] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (3.08 seconds). [2025-09-22T20:45:06.922066] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-22T20:45:07.329847] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T20:45:07.722061] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-22T20:45:08.349016] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T20:45:08.522052] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-22T20:45:08.676154] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T20:45:08.679193] [INFO ] [REMOTE ] PKE: Full fetch complete (16796 records). [2025-09-22T20:45:08.679293] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-22T20:45:09.077438] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-22T20:45:09.077552] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-22T20:45:09.077956] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-22T20:45:09.078020] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-22T20:45:09.079086] [DEBUG] [LOCAL ] PKE: Trimmed 16796 records to 12499 (keeping 200 days of data) [2025-09-22T20:45:09.160625] [DEBUG] [LOCAL ] PKE: Primary data saved (12499 records). [2025-09-22T20:45:09.160829] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-22T20:45:09.160975] [INFO ] [MAIN ] Update Progress: 1693/2372 symbols completed. PKE took 24.0s. Estimated remaining: 1h 30m 16s. Rate: 7.5 symbols/min [2025-09-22T20:45:09.327480] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-22T20:45:09.379115] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:45:09.404332] [DEBUG] [LOCAL ] PKST: Loaded 19892 existing records from primary storage. [2025-09-22T20:45:09.404530] [INFO ] [MAIN ] PKST: Loaded 19892 existing records. [2025-09-22T20:45:09.597677] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:45:09.597974] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-22T20:45:09.598032] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-22T20:45:09.598718] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-22T20:45:09.598779] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-22T20:45:09.986897] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:45:10.122063] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-22T20:45:10.158234] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T20:45:10.326122] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-22T20:45:10.330926] [INFO ] [REMOTE ] PJT: Full fetch complete (32081 records). [2025-09-22T20:45:10.331006] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-22T20:45:10.722746] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-22T20:45:10.722905] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-22T20:45:10.724349] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-22T20:45:10.724448] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-22T20:45:10.725796] [DEBUG] [LOCAL ] PJT: Trimmed 32081 records to 22637 (keeping 200 days of data) [2025-09-22T20:45:10.880829] [DEBUG] [LOCAL ] PJT: Primary data saved (22637 records). [2025-09-22T20:45:10.880964] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-22T20:45:10.881222] [INFO ] [MAIN ] Update Progress: 1694/2372 symbols completed. PJT took 39.6s. Estimated remaining: 1h 30m 6s. Rate: 7.5 symbols/min [2025-09-22T20:45:10.928816] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-22T20:45:11.078736] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:45:11.110242] [DEBUG] [LOCAL ] PKX: Loaded 25728 existing records from primary storage. [2025-09-22T20:45:11.110397] [INFO ] [MAIN ] PKX: Loaded 25728 existing records. [2025-09-22T20:45:11.324183] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:45:11.324604] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-22T20:45:11.325030] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-22T20:45:11.332151] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-22T20:45:11.341693] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-22T20:45:11.376726] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-22T20:45:11.705601] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:45:11.722007] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-22T20:45:12.467738] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T20:45:12.522011] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-22T20:45:13.322081] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-22T20:45:14.122760] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-22T20:45:14.122686] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-22T20:45:14.706886] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-22T20:45:14.713132] [INFO ] [REMOTE ] PKG: Full fetch complete (57446 records). [2025-09-22T20:45:14.713289] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-22T20:45:14.937400] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-22T20:45:15.104104] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-22T20:45:15.104270] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-22T20:45:15.105370] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-22T20:45:15.105443] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-22T20:45:15.107273] [DEBUG] [LOCAL ] PKG: Trimmed 57446 records to 39360 (keeping 200 days of data) [2025-09-22T20:45:15.245093] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T20:45:15.401726] [DEBUG] [LOCAL ] PKG: Primary data saved (39360 records). [2025-09-22T20:45:15.401961] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-22T20:45:15.402228] [INFO ] [MAIN ] Update Progress: 1695/2372 symbols completed. PKG took 25.4s. Estimated remaining: 1h 29m 57s. Rate: 7.5 symbols/min [2025-09-22T20:45:15.602133] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:45:15.659143] [DEBUG] [LOCAL ] PL: Loaded 53884 existing records from primary storage. [2025-09-22T20:45:15.659325] [INFO ] [MAIN ] PL: Loaded 53884 existing records. [2025-09-22T20:45:15.728513] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-22T20:45:15.860145] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:45:15.860431] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-22T20:45:15.860493] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-22T20:45:15.861830] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-22T20:45:15.861918] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-22T20:45:16.320405] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:45:16.394133] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T20:45:16.522037] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-22T20:45:16.775098] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-22T20:45:16.894564] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T20:45:17.322051] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-22T20:45:17.504958] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-22T20:45:18.122061] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-22T20:45:18.329627] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T20:45:18.922103] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-22T20:45:19.722043] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-22T20:45:19.724765] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T20:45:20.522048] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-22T20:45:20.819314] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T20:45:21.257900] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-22T20:45:21.322069] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-22T20:45:22.122057] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-22T20:45:22.415211] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T20:45:22.452293] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T20:45:22.922052] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-22T20:45:23.722125] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-22T20:45:24.380808] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T20:45:24.522132] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-22T20:45:24.821872] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-22T20:45:25.322028] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-22T20:45:25.647838] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T20:45:25.666891] [INFO ] [REMOTE ] PK: Full fetch complete (76383 records). [2025-09-22T20:45:25.667157] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-22T20:45:26.133531] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-22T20:45:26.139224] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-22T20:45:26.139460] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-22T20:45:26.140788] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-22T20:45:26.140882] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-22T20:45:26.164720] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T20:45:26.171166] [DEBUG] [LOCAL ] PK: Trimmed 76383 records to 52893 (keeping 200 days of data) [2025-09-22T20:45:26.538812] [DEBUG] [LOCAL ] PK: Primary data saved (52893 records). [2025-09-22T20:45:26.538958] [INFO ] [MAIN ] PK: Full history saved. [2025-09-22T20:45:26.539074] [INFO ] [MAIN ] Update Progress: 1696/2372 symbols completed. PK took 51.9s. Estimated remaining: 1h 29m 50s. Rate: 7.5 symbols/min [2025-09-22T20:45:26.740176] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:45:26.810744] [DEBUG] [LOCAL ] PLD: Loaded 54265 existing records from primary storage. [2025-09-22T20:45:26.810913] [INFO ] [MAIN ] PLD: Loaded 54265 existing records. [2025-09-22T20:45:26.922491] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-22T20:45:27.008315] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:45:27.008637] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-22T20:45:27.008723] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-22T20:45:27.010070] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-22T20:45:27.010134] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-22T20:45:27.387019] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:45:27.396358] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T20:45:27.692839] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-22T20:45:27.722014] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-22T20:45:28.252623] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T20:45:28.522072] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-22T20:45:29.322072] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-22T20:45:29.443796] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T20:45:29.971503] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-22T20:45:30.122094] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-22T20:45:30.611885] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-22T20:45:30.922092] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-22T20:45:31.722035] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-22T20:45:32.086152] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-22T20:45:32.122756] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-22T20:45:32.522155] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-22T20:45:33.322094] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-22T20:45:33.797211] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-22T20:45:34.114811] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T20:45:34.121461] [INFO ] [REMOTE ] PKST: Full fetch complete (29711 records). [2025-09-22T20:45:34.121686] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-22T20:45:34.122041] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-22T20:45:34.540440] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-22T20:45:34.540633] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-22T20:45:34.541365] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-22T20:45:34.541568] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-22T20:45:34.542602] [DEBUG] [LOCAL ] PKST: Trimmed 29711 records to 19390 (keeping 200 days of data) [2025-09-22T20:45:34.625316] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-22T20:45:34.707223] [DEBUG] [LOCAL ] PKST: Primary data saved (19390 records). [2025-09-22T20:45:34.707388] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-22T20:45:34.707540] [INFO ] [MAIN ] Update Progress: 1697/2372 symbols completed. PKST took 25.5s. Estimated remaining: 1h 29m 42s. Rate: 7.5 symbols/min [2025-09-22T20:45:34.878879] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:45:34.933356] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-22T20:45:34.936609] [DEBUG] [LOCAL ] PLNT: Loaded 49283 existing records from primary storage. [2025-09-22T20:45:34.936837] [INFO ] [MAIN ] PLNT: Loaded 49283 existing records. [2025-09-22T20:45:35.133353] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:45:35.143358] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-22T20:45:35.144318] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T20:45:35.144005] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-22T20:45:35.148118] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-22T20:45:35.148622] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-22T20:45:35.530917] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:45:35.722070] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-22T20:45:36.522059] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-22T20:45:36.828981] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T20:45:37.271949] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T20:45:37.322001] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-22T20:45:38.122074] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-22T20:45:38.651457] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-22T20:45:38.724636] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T20:45:38.922096] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-22T20:45:39.237759] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T20:45:39.242471] [INFO ] [REMOTE ] PKX: Full fetch complete (38201 records). [2025-09-22T20:45:39.242677] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-22T20:45:39.632334] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-22T20:45:39.632433] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-22T20:45:39.633218] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-22T20:45:39.633279] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-22T20:45:39.634212] [DEBUG] [LOCAL ] PKX: Trimmed 38201 records to 25251 (keeping 200 days of data) [2025-09-22T20:45:39.732372] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-22T20:45:39.798399] [DEBUG] [LOCAL ] PKX: Primary data saved (25251 records). [2025-09-22T20:45:39.798539] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-22T20:45:39.798624] [INFO ] [MAIN ] Update Progress: 1698/2372 symbols completed. PKX took 28.9s. Estimated remaining: 1h 29m 33s. Rate: 7.5 symbols/min [2025-09-22T20:45:40.028697] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:45:40.050362] [DEBUG] [LOCAL ] PLOW: Loaded 20993 existing records from primary storage. [2025-09-22T20:45:40.050486] [INFO ] [MAIN ] PLOW: Loaded 20993 existing records. [2025-09-22T20:45:40.228752] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:45:40.229036] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-22T20:45:40.229086] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-22T20:45:40.229843] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-22T20:45:40.229905] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-22T20:45:40.527190] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-22T20:45:40.587203] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:45:41.156783] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-22T20:45:41.322030] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-22T20:45:41.759845] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-22T20:45:41.889461] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T20:45:42.122077] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-22T20:45:42.922072] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-22T20:45:43.722039] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-22T20:45:43.834283] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-22T20:45:44.041697] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T20:45:44.137631] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T20:45:44.522078] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-22T20:45:45.322047] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-22T20:45:45.501886] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T20:45:46.122100] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-22T20:45:46.518103] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-22T20:45:46.543266] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T20:45:46.922073] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-22T20:45:47.722118] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-22T20:45:48.427542] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-22T20:45:48.522052] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-22T20:45:48.852817] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-22T20:45:48.884700] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T20:45:49.322071] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-22T20:45:50.122168] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-22T20:45:50.771364] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-22T20:45:50.783666] [INFO ] [REMOTE ] PL: Full fetch complete (76944 records). [2025-09-22T20:45:50.783875] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-22T20:45:50.928768] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-22T20:45:51.194308] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-22T20:45:51.194396] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-22T20:45:51.195518] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-22T20:45:51.195593] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-22T20:45:51.197071] [DEBUG] [LOCAL ] PL: Trimmed 76944 records to 53112 (keeping 200 days of data) [2025-09-22T20:45:51.446418] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-22T20:45:51.559174] [DEBUG] [LOCAL ] PL: Primary data saved (53112 records). [2025-09-22T20:45:51.559314] [INFO ] [MAIN ] PL: Full history saved. [2025-09-22T20:45:51.559402] [INFO ] [MAIN ] Update Progress: 1699/2372 symbols completed. PL took 36.2s. Estimated remaining: 1h 29m 26s. Rate: 7.5 symbols/min [2025-09-22T20:45:51.733062] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-22T20:45:51.736856] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:45:51.772168] [DEBUG] [LOCAL ] PLYM: Loaded 33622 existing records from primary storage. [2025-09-22T20:45:51.772297] [INFO ] [MAIN ] PLYM: Loaded 33622 existing records. [2025-09-22T20:45:51.959972] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:45:51.976201] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-22T20:45:51.976386] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-22T20:45:51.992482] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-22T20:45:51.998382] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-22T20:45:52.005596] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T20:45:52.007064] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T20:45:52.374954] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:45:52.522015] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-22T20:45:53.322023] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-22T20:45:53.604220] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-22T20:45:53.711700] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T20:45:54.122083] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-22T20:45:54.927953] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-22T20:45:54.941937] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T20:45:55.386096] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T20:45:55.722082] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-22T20:45:56.522061] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-22T20:45:56.741528] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-22T20:45:56.755469] [INFO ] [REMOTE ] PLD: Full fetch complete (77432 records). [2025-09-22T20:45:56.755695] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-22T20:45:57.168881] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T20:45:57.219583] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-22T20:45:57.219713] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-22T20:45:57.220855] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-22T20:45:57.220925] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-22T20:45:57.222507] [DEBUG] [LOCAL ] PLD: Trimmed 77432 records to 53488 (keeping 200 days of data) [2025-09-22T20:45:57.325350] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-22T20:45:57.571307] [DEBUG] [LOCAL ] PLD: Primary data saved (53488 records). [2025-09-22T20:45:57.571472] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-22T20:45:57.571575] [INFO ] [MAIN ] Update Progress: 1700/2372 symbols completed. PLD took 31.0s. Estimated remaining: 1h 29m 18s. Rate: 7.5 symbols/min [2025-09-22T20:45:57.743461] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:45:57.743703] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-09-22T20:45:57.743758] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-09-22T20:45:57.743918] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-22T20:45:57.743961] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-22T20:45:57.744002] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-22T20:45:57.744037] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-22T20:45:58.104210] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:45:58.122006] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-22T20:45:58.269734] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T20:45:58.761585] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T20:45:58.922109] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-22T20:45:59.722061] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-22T20:46:00.228493] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T20:46:00.323352] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-22T20:46:00.522052] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-22T20:46:01.320766] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T20:46:01.330387] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-22T20:46:02.122078] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-22T20:46:02.455579] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T20:46:02.634760] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-22T20:46:02.922064] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-22T20:46:03.722038] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-22T20:46:03.752367] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T20:46:04.088217] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T20:46:04.522059] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-22T20:46:05.322059] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-22T20:46:05.590291] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T20:46:05.737154] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-22T20:46:06.122063] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-22T20:46:06.559937] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T20:46:06.567369] [INFO ] [REMOTE ] PLNT: Full fetch complete (70084 records). [2025-09-22T20:46:06.567491] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-22T20:46:06.924110] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-22T20:46:06.964741] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-22T20:46:06.964831] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-22T20:46:06.965926] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-22T20:46:06.965993] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-22T20:46:06.967576] [DEBUG] [LOCAL ] PLNT: Trimmed 70084 records to 48488 (keeping 200 days of data) [2025-09-22T20:46:07.277806] [DEBUG] [LOCAL ] PLNT: Primary data saved (48488 records). [2025-09-22T20:46:07.277951] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-22T20:46:07.278042] [INFO ] [MAIN ] Update Progress: 1701/2372 symbols completed. PLNT took 32.6s. Estimated remaining: 1h 29m 10s. Rate: 7.5 symbols/min [2025-09-22T20:46:07.448944] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:46:07.469713] [DEBUG] [LOCAL ] PML: Loaded 20606 existing records from primary storage. [2025-09-22T20:46:07.469856] [INFO ] [MAIN ] PML: Loaded 20606 existing records. [2025-09-22T20:46:07.651061] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:46:07.651337] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-22T20:46:07.651387] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-22T20:46:07.651944] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-22T20:46:07.652005] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-22T20:46:07.730068] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-22T20:46:08.042996] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:46:08.309840] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-22T20:46:08.401097] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T20:46:08.522044] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-22T20:46:08.595568] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T20:46:08.598434] [INFO ] [REMOTE ] PLOW: Full fetch complete (28809 records). [2025-09-22T20:46:08.598514] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-22T20:46:09.001518] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-22T20:46:09.001596] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-22T20:46:09.002272] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-22T20:46:09.002334] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-22T20:46:09.003126] [DEBUG] [LOCAL ] PLOW: Trimmed 28809 records to 20572 (keeping 200 days of data) [2025-09-22T20:46:09.138601] [DEBUG] [LOCAL ] PLOW: Primary data saved (20572 records). [2025-09-22T20:46:09.138787] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-22T20:46:09.138903] [INFO ] [MAIN ] Update Progress: 1702/2372 symbols completed. PLOW took 29.3s. Estimated remaining: 1h 29m 0s. Rate: 7.5 symbols/min [2025-09-22T20:46:09.327179] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-22T20:46:09.333503] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:46:09.349955] [DEBUG] [LOCAL ] PMM: Loaded 10862 existing records from primary storage. [2025-09-22T20:46:09.350100] [INFO ] [MAIN ] PMM: Loaded 10862 existing records. [2025-09-22T20:46:09.539327] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:46:09.539622] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-22T20:46:09.539705] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-22T20:46:09.540179] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-22T20:46:09.540242] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-22T20:46:09.934586] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:46:10.122061] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-22T20:46:10.760895] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-22T20:46:10.922016] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-22T20:46:11.052067] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T20:46:11.683886] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T20:46:11.722036] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-22T20:46:12.522055] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-22T20:46:12.959414] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-22T20:46:12.993040] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T20:46:13.322092] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-22T20:46:13.866995] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T20:46:14.122084] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-22T20:46:14.165965] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T20:46:14.922054] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-22T20:46:15.365623] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T20:46:15.722076] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-22T20:46:16.058754] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T20:46:16.522027] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-22T20:46:16.784813] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T20:46:17.322042] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-22T20:46:17.603993] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T20:46:18.122160] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-22T20:46:18.922097] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-22T20:46:19.304038] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-22T20:46:19.371307] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T20:46:19.722074] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-22T20:46:20.366326] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T20:46:20.522087] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-22T20:46:20.795817] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T20:46:21.322057] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-22T20:46:22.033273] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T20:46:22.122049] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-22T20:46:22.371312] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T20:46:22.922061] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-22T20:46:23.590431] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T20:46:23.597038] [INFO ] [REMOTE ] PLYM: Full fetch complete (46314 records). [2025-09-22T20:46:23.597152] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-22T20:46:23.727177] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-22T20:46:23.983429] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T20:46:24.000325] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-22T20:46:24.003883] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-22T20:46:24.004892] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-22T20:46:24.005359] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-22T20:46:24.006381] [DEBUG] [LOCAL ] PLYM: Trimmed 46314 records to 33185 (keeping 200 days of data) [2025-09-22T20:46:24.208165] [DEBUG] [LOCAL ] PLYM: Primary data saved (33185 records). [2025-09-22T20:46:24.208307] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-22T20:46:24.208404] [INFO ] [MAIN ] Update Progress: 1703/2372 symbols completed. PLYM took 32.6s. Estimated remaining: 1h 28m 55s. Rate: 7.5 symbols/min [2025-09-22T20:46:24.386743] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:46:24.398078] [DEBUG] [LOCAL ] PMO: Loaded 10805 existing records from primary storage. [2025-09-22T20:46:24.398173] [INFO ] [MAIN ] PMO: Loaded 10805 existing records. [2025-09-22T20:46:24.542979] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-22T20:46:24.589701] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:46:24.591133] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-22T20:46:24.601162] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-22T20:46:24.604228] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-22T20:46:24.604746] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-22T20:46:24.604914] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-22T20:46:24.974386] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:46:25.322061] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-22T20:46:25.762768] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T20:46:26.122155] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-22T20:46:26.530140] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T20:46:26.922087] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-22T20:46:27.722053] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-22T20:46:28.031706] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-22T20:46:28.213835] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-22T20:46:28.521781] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-22T20:46:28.524788] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-22T20:46:29.322015] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-22T20:46:29.403458] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T20:46:30.122068] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-22T20:46:30.144683] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T20:46:30.922016] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-22T20:46:31.255052] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T20:46:31.722055] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-22T20:46:32.522045] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-22T20:46:32.556712] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T20:46:33.042396] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-22T20:46:33.322004] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-22T20:46:33.719580] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-22T20:46:34.122109] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-22T20:46:34.161989] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T20:46:34.922083] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-22T20:46:35.385060] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T20:46:35.389806] [INFO ] [REMOTE ] PML: Full fetch complete (29602 records). [2025-09-22T20:46:35.389911] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-22T20:46:35.731824] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-22T20:46:35.789324] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-22T20:46:35.789553] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-22T20:46:35.790355] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-22T20:46:35.790529] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-22T20:46:35.791894] [DEBUG] [LOCAL ] PML: Trimmed 29602 records to 20451 (keeping 200 days of data) [2025-09-22T20:46:35.877173] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T20:46:35.922325] [INFO ] [REMOTE ] PM: Full fetch complete (77311 records). [2025-09-22T20:46:35.932777] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-22T20:46:35.940611] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:46:35.941863] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:46:35.942775] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:46:35.943924] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-22T20:46:35.944280] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-22T20:46:35.944904] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-22T20:46:35.946132] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-09-22T20:46:35.946787] [INFO ] [MAIN ] Update Progress: 1704/2372 symbols completed. PM took 38.4s. Estimated remaining: 1h 28m 48s. Rate: 7.5 symbols/min [2025-09-22T20:46:36.031635] [DEBUG] [LOCAL ] PML: Primary data saved (20451 records). [2025-09-22T20:46:36.059486] [INFO ] [MAIN ] PML: Full history saved. [2025-09-22T20:46:36.060036] [INFO ] [MAIN ] Update Progress: 1705/2372 symbols completed. PML took 28.8s. Estimated remaining: 1h 28m 37s. Rate: 7.5 symbols/min [2025-09-22T20:46:36.255505] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:46:36.339418] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:46:36.339709] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-22T20:46:36.339770] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-22T20:46:36.339934] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-22T20:46:36.339978] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-22T20:46:36.340019] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-22T20:46:36.340051] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-22T20:46:36.530718] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-22T20:46:36.606116] [DEBUG] [LOCAL ] PMT: Loaded 40944 existing records from primary storage. [2025-09-22T20:46:36.611736] [INFO ] [MAIN ] PMT: Loaded 40944 existing records. [2025-09-22T20:46:36.970315] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:46:36.971107] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T20:46:36.982414] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:46:36.982983] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-22T20:46:36.983036] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-22T20:46:36.984534] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-22T20:46:36.984613] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-22T20:46:37.322563] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-22T20:46:37.342399] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:46:37.431277] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T20:46:37.433414] [INFO ] [REMOTE ] PMM: Full fetch complete (18275 records). [2025-09-22T20:46:37.433489] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-22T20:46:37.841742] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-22T20:46:37.828938] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-22T20:46:37.842748] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-22T20:46:37.843333] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-22T20:46:37.843396] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-22T20:46:37.843992] [DEBUG] [LOCAL ] PMM: Trimmed 18275 records to 10544 (keeping 200 days of data) [2025-09-22T20:46:37.909748] [DEBUG] [LOCAL ] PMM: Primary data saved (10544 records). [2025-09-22T20:46:37.909910] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-22T20:46:37.910014] [INFO ] [MAIN ] Update Progress: 1706/2372 symbols completed. PMM took 28.8s. Estimated remaining: 1h 28m 27s. Rate: 7.5 symbols/min [2025-09-22T20:46:38.088280] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:46:38.088495] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-22T20:46:38.088549] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-22T20:46:38.088727] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-22T20:46:38.088789] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-22T20:46:38.088855] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-22T20:46:38.088889] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-22T20:46:38.127255] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-22T20:46:38.445629] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:46:38.574156] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T20:46:38.922064] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-22T20:46:39.195184] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:46:39.195536] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-22T20:46:39.722080] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-22T20:46:40.522073] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-22T20:46:40.786887] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:46:40.787348] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-22T20:46:41.324085] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-22T20:46:41.327536] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T20:46:42.122024] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-22T20:46:42.384832] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T20:46:42.922105] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-22T20:46:42.930544] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T20:46:43.720576] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-22T20:46:43.722871] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-22T20:46:44.522072] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-22T20:46:45.304427] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T20:46:45.322006] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-22T20:46:45.349315] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T20:46:46.122059] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-22T20:46:46.844127] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T20:46:46.865629] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T20:46:46.922003] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-22T20:46:47.722068] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-22T20:46:48.469750] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T20:46:48.522014] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-22T20:46:48.588382] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-22T20:46:49.322045] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-22T20:46:50.122020] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-22T20:46:50.198011] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T20:46:50.270867] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T20:46:50.754596] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T20:46:50.922067] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-22T20:46:51.532197] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-22T20:46:51.722064] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-22T20:46:52.522098] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-22T20:46:53.172179] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T20:46:53.333572] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-22T20:46:53.339721] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T20:46:54.009833] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T20:46:54.122015] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-22T20:46:54.922086] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-22T20:46:55.352129] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T20:46:55.631407] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T20:46:55.722070] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-22T20:46:56.522113] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-22T20:46:57.222335] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-22T20:46:57.224472] [INFO ] [REMOTE ] PMO: Full fetch complete (17392 records). [2025-09-22T20:46:57.224556] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-22T20:46:57.324554] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-22T20:46:57.600811] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-22T20:46:57.600914] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-22T20:46:57.601340] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-22T20:46:57.601480] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-22T20:46:57.612081] [DEBUG] [LOCAL ] PMO: Trimmed 17392 records to 10536 (keeping 200 days of data) [2025-09-22T20:46:57.630055] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-22T20:46:57.704093] [DEBUG] [LOCAL ] PMO: Primary data saved (10536 records). [2025-09-22T20:46:57.704241] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-22T20:46:57.704330] [INFO ] [MAIN ] Update Progress: 1707/2372 symbols completed. PMO took 33.5s. Estimated remaining: 1h 28m 24s. Rate: 7.5 symbols/min [2025-09-22T20:46:57.888004] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:46:57.888296] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-22T20:46:57.888352] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-22T20:46:57.888519] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-22T20:46:57.888563] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-22T20:46:57.888605] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-22T20:46:57.888637] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-22T20:46:58.003883] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T20:46:58.127192] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-22T20:46:58.267700] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:46:58.907020] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T20:46:58.922007] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-22T20:46:59.307315] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-22T20:46:59.308472] [INFO ] [REMOTE ] PMTV: Full fetch complete (6087 records). [2025-09-22T20:46:59.308548] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-22T20:46:59.489583] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 151 unique days, need 200 days [2025-09-22T20:46:59.489856] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:46:59.489946] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:46:59.490033] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-22T20:46:59.490117] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-22T20:46:59.490242] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-22T20:46:59.490359] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-22T20:46:59.490461] [INFO ] [MAIN ] Update Progress: 1708/2372 symbols completed. PMTV took 21.6s. Estimated remaining: 1h 28m 13s. Rate: 7.5 symbols/min [2025-09-22T20:46:59.675013] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:46:59.675226] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-09-22T20:46:59.675315] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-09-22T20:46:59.675515] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-22T20:46:59.675571] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-22T20:46:59.675617] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-22T20:46:59.675676] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-22T20:46:59.727961] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-22T20:47:00.032698] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:47:00.062599] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:47:00.062970] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-22T20:47:00.522081] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-22T20:47:01.024688] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T20:47:01.322051] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-22T20:47:01.784734] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-22T20:47:02.122071] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-22T20:47:02.542861] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-22T20:47:02.922123] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-22T20:47:03.215797] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:47:03.216129] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-22T20:47:03.722061] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-22T20:47:03.997099] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:47:03.997427] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-22T20:47:04.522066] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-22T20:47:04.939850] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T20:47:05.322059] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-22T20:47:05.785805] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-22T20:47:06.122056] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-22T20:47:06.922049] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-22T20:47:07.318587] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-22T20:47:07.319498] [INFO ] [REMOTE ] PMTU: Full fetch complete (1206 records). [2025-09-22T20:47:07.319575] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-22T20:47:07.507897] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-22T20:47:07.508146] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:47:07.508227] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:47:07.508297] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-22T20:47:07.508360] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-22T20:47:07.508404] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-22T20:47:07.508458] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-22T20:47:07.508573] [INFO ] [MAIN ] Update Progress: 1709/2372 symbols completed. PMTU took 31.4s. Estimated remaining: 1h 28m 5s. Rate: 7.5 symbols/min [2025-09-22T20:47:07.697014] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:47:07.708563] [DEBUG] [LOCAL ] PNI: Loaded 6860 existing records from primary storage. [2025-09-22T20:47:07.708735] [INFO ] [MAIN ] PNI: Loaded 6860 existing records. [2025-09-22T20:47:07.725717] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-22T20:47:07.903066] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:47:07.903935] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-22T20:47:07.904418] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-22T20:47:07.904980] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-22T20:47:07.905073] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-22T20:47:08.240176] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-22T20:47:08.320211] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:47:08.522060] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-22T20:47:09.322062] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-22T20:47:09.406499] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T20:47:09.538733] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T20:47:09.583119] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:47:09.583478] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-22T20:47:10.122060] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-22T20:47:10.436812] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:47:10.437150] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-22T20:47:10.922048] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-22T20:47:11.204000] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:47:11.204446] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-22T20:47:11.722058] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-22T20:47:12.522060] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-22T20:47:13.322015] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-22T20:47:13.538027] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T20:47:13.640174] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T20:47:13.812065] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-22T20:47:14.122051] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-22T20:47:14.922109] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-22T20:47:15.715979] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T20:47:15.721993] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-22T20:47:16.111558] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-22T20:47:16.362378] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T20:47:16.522059] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-22T20:47:17.322048] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-22T20:47:18.090572] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T20:47:18.122005] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-22T20:47:18.586782] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-22T20:47:18.922100] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-22T20:47:19.452954] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-22T20:47:19.454167] [INFO ] [REMOTE ] PMTW: Full fetch complete (3647 records). [2025-09-22T20:47:19.454263] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-22T20:47:19.626349] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T20:47:19.657599] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 70 unique days, need 200 days [2025-09-22T20:47:19.665567] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:47:19.665731] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:47:19.665858] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-22T20:47:19.665966] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-22T20:47:19.666034] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-22T20:47:19.666244] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-22T20:47:19.666377] [INFO ] [MAIN ] Update Progress: 1710/2372 symbols completed. PMTW took 22.0s. Estimated remaining: 1h 27m 59s. Rate: 7.5 symbols/min [2025-09-22T20:47:19.701584] [INFO ] [REMOTE ] PMT: Full fetch complete (58089 records). [2025-09-22T20:47:19.732587] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-22T20:47:19.753405] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-22T20:47:19.983905] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:47:20.329854] [DEBUG] [LOCAL ] PNNT: Loaded 33466 existing records from primary storage. [2025-09-22T20:47:20.340427] [INFO ] [MAIN ] PNNT: Loaded 33466 existing records. [2025-09-22T20:47:20.340929] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T20:47:20.340586] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-22T20:47:20.348562] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-22T20:47:20.378433] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-22T20:47:20.391738] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-22T20:47:20.465441] [DEBUG] [LOCAL ] PMT: Trimmed 58089 records to 40323 (keeping 200 days of data) [2025-09-22T20:47:20.565607] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-22T20:47:20.659969] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:47:20.661351] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-22T20:47:20.662111] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-22T20:47:20.664089] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-22T20:47:20.664518] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-22T20:47:21.061942] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:47:21.228329] [DEBUG] [LOCAL ] PMT: Primary data saved (40323 records). [2025-09-22T20:47:21.228545] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-22T20:47:21.228775] [INFO ] [MAIN ] Update Progress: 1711/2372 symbols completed. PMT took 45.3s. Estimated remaining: 1h 27m 48s. Rate: 7.5 symbols/min [2025-09-22T20:47:21.327196] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-22T20:47:21.414358] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:47:21.414818] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-22T20:47:21.414876] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-22T20:47:21.415029] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-22T20:47:21.415090] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-22T20:47:21.415188] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-22T20:47:21.415274] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-22T20:47:21.688353] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-22T20:47:21.820691] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:47:22.122070] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-22T20:47:22.922083] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-22T20:47:23.344232] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T20:47:23.587030] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T20:47:23.722027] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-22T20:47:23.845078] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T20:47:24.408343] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T20:47:24.522088] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-22T20:47:25.322044] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-22T20:47:26.122084] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-22T20:47:26.313497] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T20:47:26.653698] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T20:47:26.922075] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-22T20:47:27.610851] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T20:47:27.722072] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-22T20:47:28.522033] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-22T20:47:28.552468] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T20:47:29.071763] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T20:47:29.322053] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-22T20:47:30.122071] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-22T20:47:30.407982] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T20:47:30.787735] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T20:47:30.808251] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T20:47:30.922122] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-22T20:47:31.722118] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-22T20:47:32.265117] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T20:47:32.522066] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-22T20:47:33.322051] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-22T20:47:33.563821] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T20:47:34.122080] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-22T20:47:34.181813] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T20:47:34.282304] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T20:47:34.922139] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-22T20:47:35.722025] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-22T20:47:35.829627] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T20:47:35.832452] [INFO ] [REMOTE ] PNI: Full fetch complete (10023 records). [2025-09-22T20:47:35.832546] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-22T20:47:36.220860] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-22T20:47:36.221113] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-22T20:47:36.221373] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-22T20:47:36.221463] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-22T20:47:36.222205] [DEBUG] [LOCAL ] PNI: Trimmed 10023 records to 6722 (keeping 200 days of data) [2025-09-22T20:47:36.283615] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-22T20:47:36.302557] [DEBUG] [LOCAL ] PNI: Primary data saved (6722 records). [2025-09-22T20:47:36.302692] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-22T20:47:36.302831] [INFO ] [MAIN ] Update Progress: 1712/2372 symbols completed. PNI took 28.8s. Estimated remaining: 1h 27m 43s. Rate: 7.5 symbols/min [2025-09-22T20:47:36.476249] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:47:36.531582] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-22T20:47:36.535570] [DEBUG] [LOCAL ] PNW: Loaded 46778 existing records from primary storage. [2025-09-22T20:47:36.535688] [INFO ] [MAIN ] PNW: Loaded 46778 existing records. [2025-09-22T20:47:36.714297] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:47:36.714596] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-22T20:47:36.714664] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-22T20:47:36.716222] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-22T20:47:36.716284] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-22T20:47:37.071867] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:47:37.322056] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-22T20:47:37.693125] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T20:47:37.930505] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T20:47:38.122050] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-22T20:47:38.922038] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-22T20:47:39.061975] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T20:47:39.597579] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T20:47:39.722082] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-22T20:47:40.268912] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T20:47:40.522087] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-22T20:47:41.183809] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T20:47:41.322017] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-22T20:47:42.122058] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-22T20:47:42.218048] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T20:47:42.922072] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-22T20:47:42.961319] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T20:47:42.988115] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T20:47:42.995750] [INFO ] [REMOTE ] PNC: Full fetch complete (75141 records). [2025-09-22T20:47:42.995878] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-22T20:47:42.996752] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:47:42.996865] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:47:42.996908] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:47:42.996947] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-22T20:47:42.997019] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-22T20:47:42.997074] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-22T20:47:42.997118] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-09-22T20:47:42.997188] [INFO ] [MAIN ] Update Progress: 1713/2372 symbols completed. PNC took 43.5s. Estimated remaining: 1h 27m 35s. Rate: 7.5 symbols/min [2025-09-22T20:47:43.178102] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:47:43.241721] [DEBUG] [LOCAL ] POR: Loaded 47675 existing records from primary storage. [2025-09-22T20:47:43.241890] [INFO ] [MAIN ] POR: Loaded 47675 existing records. [2025-09-22T20:47:43.422050] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:47:43.422288] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-22T20:47:43.422335] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-22T20:47:43.423822] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-22T20:47:43.423882] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-22T20:47:43.727245] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-22T20:47:43.789321] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:47:44.522045] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-22T20:47:44.615164] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T20:47:45.258010] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T20:47:45.322072] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-22T20:47:46.036932] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T20:47:46.122078] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-22T20:47:46.922066] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-22T20:47:47.067602] [DEBUG] [REMOTE ] POR: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-22T20:47:47.068058] [WARN ] [REMOTE ] POR: No data returned for month 2024-12 [2025-09-22T20:47:47.176160] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T20:47:47.533483] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T20:47:47.722057] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-22T20:47:48.522056] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-22T20:47:48.984196] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T20:47:48.990220] [INFO ] [REMOTE ] PNNT: Full fetch complete (47311 records). [2025-09-22T20:47:48.990373] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-22T20:47:49.325935] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-22T20:47:49.419980] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-22T20:47:49.420185] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-22T20:47:49.421097] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-22T20:47:49.421162] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-22T20:47:49.422226] [DEBUG] [LOCAL ] PNNT: Trimmed 47311 records to 32871 (keeping 200 days of data) [2025-09-22T20:47:49.629914] [DEBUG] [LOCAL ] PNNT: Primary data saved (32871 records). [2025-09-22T20:47:49.630050] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-22T20:47:49.630158] [INFO ] [MAIN ] Update Progress: 1714/2372 symbols completed. PNNT took 30.0s. Estimated remaining: 1h 27m 26s. Rate: 7.5 symbols/min [2025-09-22T20:47:49.812037] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:47:49.855452] [DEBUG] [LOCAL ] POST: Loaded 39517 existing records from primary storage. [2025-09-22T20:47:49.855598] [INFO ] [MAIN ] POST: Loaded 39517 existing records. [2025-09-22T20:47:50.043795] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:47:50.044094] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-22T20:47:50.044147] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-22T20:47:50.045498] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-22T20:47:50.045563] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-22T20:47:50.123761] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-22T20:47:50.416350] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:47:50.448161] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-22T20:47:50.922080] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-22T20:47:50.983055] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T20:47:51.722034] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-22T20:47:51.897678] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T20:47:52.527416] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-22T20:47:52.545523] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T20:47:53.322055] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-22T20:47:53.352102] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T20:47:53.359138] [INFO ] [REMOTE ] PNR: Full fetch complete (68963 records). [2025-09-22T20:47:53.359275] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-22T20:47:53.360134] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:47:53.360249] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:47:53.360293] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:47:53.360334] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-22T20:47:53.360395] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-22T20:47:53.360431] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-22T20:47:53.360468] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-09-22T20:47:53.360528] [INFO ] [MAIN ] Update Progress: 1715/2372 symbols completed. PNR took 32.1s. Estimated remaining: 1h 27m 17s. Rate: 7.5 symbols/min [2025-09-22T20:47:53.543230] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:47:53.578884] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T20:47:53.651963] [DEBUG] [LOCAL ] PPG: Loaded 51474 existing records from primary storage. [2025-09-22T20:47:53.652186] [INFO ] [MAIN ] PPG: Loaded 51474 existing records. [2025-09-22T20:47:53.847670] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:47:53.847945] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-22T20:47:53.847995] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-22T20:47:53.849903] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-22T20:47:53.849966] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-22T20:47:54.127290] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-22T20:47:54.250076] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:47:54.922090] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-22T20:47:55.104417] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T20:47:55.684116] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T20:47:55.722017] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-22T20:47:56.522087] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-22T20:47:56.777480] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T20:47:57.237560] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T20:47:57.322074] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-22T20:47:58.122104] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-22T20:47:58.267155] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T20:47:58.922086] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-22T20:47:59.074967] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T20:47:59.574243] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T20:47:59.722076] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-22T20:48:00.095223] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T20:48:00.522060] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-22T20:48:00.879130] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T20:48:01.322066] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-22T20:48:02.122084] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-22T20:48:02.252606] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T20:48:02.860698] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T20:48:02.922022] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-22T20:48:03.722051] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-22T20:48:03.924157] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T20:48:04.522109] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-22T20:48:04.581168] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T20:48:05.322075] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-22T20:48:05.559098] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T20:48:06.122098] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-22T20:48:06.506946] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-22T20:48:06.922031] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-22T20:48:07.012419] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T20:48:07.591034] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T20:48:07.722048] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-22T20:48:08.143463] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T20:48:08.522072] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-22T20:48:09.322024] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-22T20:48:09.367060] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T20:48:09.374461] [INFO ] [REMOTE ] POR: Full fetch complete (61671 records). [2025-09-22T20:48:09.374606] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-22T20:48:09.626475] [WARN ] [VALIDATOR ] POR: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-22T20:48:09.627113] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:48:09.627187] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:48:09.627258] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-22T20:48:09.627326] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-09-22T20:48:09.627363] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-09-22T20:48:09.627896] [DEBUG] [LOCAL ] POR: Deleted derivative data file. [2025-09-22T20:48:09.628010] [INFO ] [MAIN ] Update Progress: 1716/2372 symbols completed. POR took 26.6s. Estimated remaining: 1h 27m 12s. Rate: 7.5 symbols/min [2025-09-22T20:48:09.794828] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:48:09.795023] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-09-22T20:48:09.795080] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-09-22T20:48:09.795224] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-22T20:48:09.795305] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-22T20:48:09.795357] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-22T20:48:09.795391] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-22T20:48:10.145747] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-22T20:48:10.151257] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:48:10.433300] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T20:48:10.922030] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-22T20:48:10.942507] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T20:48:11.460853] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T20:48:11.722069] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-22T20:48:12.522092] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-22T20:48:12.835032] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T20:48:13.327211] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-22T20:48:13.340923] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-22T20:48:14.122069] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-22T20:48:14.922085] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-22T20:48:15.193489] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-22T20:48:15.722126] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-22T20:48:16.276895] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-09-22T20:48:16.375608] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-22T20:48:16.522062] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-22T20:48:17.229499] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-22T20:48:17.236437] [INFO ] [REMOTE ] PNW: Full fetch complete (66231 records). [2025-09-22T20:48:17.236576] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-22T20:48:17.328841] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-22T20:48:17.673434] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-22T20:48:17.673669] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-22T20:48:17.674941] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-22T20:48:17.675032] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-22T20:48:17.676882] [DEBUG] [LOCAL ] PNW: Trimmed 66231 records to 45967 (keeping 200 days of data) [2025-09-22T20:48:17.770185] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-22T20:48:18.011242] [DEBUG] [LOCAL ] PNW: Primary data saved (45967 records). [2025-09-22T20:48:18.011396] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-22T20:48:18.011494] [INFO ] [MAIN ] Update Progress: 1717/2372 symbols completed. PNW took 41.7s. Estimated remaining: 1h 27m 4s. Rate: 7.5 symbols/min [2025-09-22T20:48:18.107752] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T20:48:18.114786] [INFO ] [REMOTE ] POST: Full fetch complete (55738 records). [2025-09-22T20:48:18.114910] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-22T20:48:18.146798] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-22T20:48:18.501744] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-22T20:48:18.501830] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-22T20:48:18.502824] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-22T20:48:18.502888] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-22T20:48:18.504063] [DEBUG] [LOCAL ] POST: Trimmed 55738 records to 38990 (keeping 200 days of data) [2025-09-22T20:48:18.749156] [DEBUG] [LOCAL ] POST: Primary data saved (38990 records). [2025-09-22T20:48:18.749352] [INFO ] [MAIN ] POST: Full history saved. [2025-09-22T20:48:18.749466] [INFO ] [MAIN ] Update Progress: 1718/2372 symbols completed. POST took 29.1s. Estimated remaining: 1h 26m 53s. Rate: 7.5 symbols/min [2025-09-22T20:48:18.852523] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T20:48:18.922042] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-22T20:48:19.999417] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T20:48:20.010546] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-22T20:48:20.868843] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-22T20:48:20.880070] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-22T20:48:21.847809] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T20:48:21.861424] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-22T20:48:22.826392] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T20:48:22.840805] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-22T20:48:23.676472] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-22T20:48:23.684449] [INFO ] [REMOTE ] PPG: Full fetch complete (73738 records). [2025-09-22T20:48:23.684819] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-22T20:48:24.076607] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-22T20:48:24.076719] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-22T20:48:24.077814] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-22T20:48:24.077878] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-22T20:48:24.079334] [DEBUG] [LOCAL ] PPG: Trimmed 73738 records to 50700 (keeping 200 days of data) [2025-09-22T20:48:24.410020] [DEBUG] [LOCAL ] PPG: Primary data saved (50700 records). [2025-09-22T20:48:24.410182] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-22T20:48:24.410272] [INFO ] [MAIN ] Update Progress: 1719/2372 symbols completed. PPG took 31.0s. Estimated remaining: 1h 26m 44s. Rate: 7.5 symbols/min [2025-09-22T20:48:24.699760] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T20:48:24.710887] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-22T20:48:26.593165] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T20:48:26.604964] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-22T20:48:28.667863] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-22T20:48:28.680815] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-22T20:48:31.150168] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-22T20:48:31.161780] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-22T20:48:32.036009] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T20:48:32.043624] [INFO ] [REMOTE ] PPL: Full fetch complete (77027 records). [2025-09-22T20:48:32.043771] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-22T20:48:32.044461] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:48:32.044586] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:48:32.044636] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:48:32.044716] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-22T20:48:32.044781] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-22T20:48:32.044816] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-22T20:48:32.044878] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-09-22T20:48:32.044959] [INFO ] [MAIN ] Update Progress: 1720/2372 symbols completed. PPL took 22.4s. Estimated remaining: 1h 26m 36s. Rate: 7.5 symbols/min [2025-09-22T20:48:32.640884] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:48:32.639963] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:48:32.677002] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-22T20:48:32.715889] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-22T20:48:32.766801] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:48:32.770683] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:48:32.771577] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-22T20:48:32.771872] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-22T20:48:32.771943] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-22T20:48:32.771984] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-22T20:48:32.941721] [DEBUG] [LOCAL ] PPT: Loaded 20609 existing records from primary storage. [2025-09-22T20:48:32.947974] [DEBUG] [LOCAL ] PRA: Loaded 35074 existing records from primary storage. [2025-09-22T20:48:32.987235] [INFO ] [MAIN ] PPT: Loaded 20609 existing records. [2025-09-22T20:48:32.989171] [INFO ] [MAIN ] PRA: Loaded 35074 existing records. [2025-09-22T20:48:33.381465] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-22T20:48:33.444197] [INFO ] [MAIN ] PR: Loaded 54389 existing records. [2025-09-22T20:48:33.580287] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:48:33.715783] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:48:33.709412] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-22T20:48:33.680403] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:48:33.716575] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-22T20:48:33.716502] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-22T20:48:33.737918] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-22T20:48:33.746574] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-22T20:48:33.738819] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-22T20:48:33.751160] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-22T20:48:33.751031] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-22T20:48:33.756810] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-22T20:48:33.997358] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:48:34.099889] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-22T20:48:34.100142] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-22T20:48:34.162907] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-22T20:48:34.168807] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-22T20:48:34.376004] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-22T20:48:34.428104] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-22T20:48:34.706588] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:48:34.741926] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-22T20:48:34.881347] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:48:34.904019] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-22T20:48:35.025345] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:48:35.025706] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-22T20:48:35.129743] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T20:48:35.130988] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-22T20:48:35.658195] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-22T20:48:35.659745] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-22T20:48:36.042311] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T20:48:36.047016] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-22T20:48:36.183997] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T20:48:36.185631] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-22T20:48:36.200399] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T20:48:36.206027] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-22T20:48:36.621108] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T20:48:36.635774] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-22T20:48:36.637972] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-22T20:48:36.637384] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-22T20:48:36.743447] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T20:48:36.749794] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-22T20:48:37.074621] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T20:48:37.076329] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-22T20:48:37.312329] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-22T20:48:37.321991] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-22T20:48:37.735992] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T20:48:37.784903] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-22T20:48:38.122157] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-22T20:48:38.424591] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T20:48:38.611680] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-22T20:48:38.612319] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-22T20:48:38.922090] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-22T20:48:39.505665] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-22T20:48:39.722091] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-22T20:48:40.220675] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-22T20:48:40.221745] [INFO ] [REMOTE ] PRCS: Full fetch complete (3755 records). [2025-09-22T20:48:40.221821] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-22T20:48:40.412875] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-22T20:48:40.413112] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:48:40.413159] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:48:40.413199] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-22T20:48:40.413256] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-22T20:48:40.413291] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-22T20:48:40.413329] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-22T20:48:40.413410] [INFO ] [MAIN ] Update Progress: 1721/2372 symbols completed. PRCS took 8.4s. Estimated remaining: 1h 26m 29s. Rate: 7.5 symbols/min [2025-09-22T20:48:40.527195] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-22T20:48:40.587421] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:48:40.620188] [DEBUG] [LOCAL ] PRG: Loaded 30917 existing records from primary storage. [2025-09-22T20:48:40.620341] [INFO ] [MAIN ] PRG: Loaded 30917 existing records. [2025-09-22T20:48:40.803388] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:48:40.803828] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-22T20:48:40.803907] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-22T20:48:40.804899] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-22T20:48:40.804960] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-22T20:48:41.175224] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:48:41.322045] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-22T20:48:41.910428] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T20:48:42.122073] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-22T20:48:42.727931] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T20:48:42.922077] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-22T20:48:43.208931] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T20:48:43.722109] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-22T20:48:44.150849] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T20:48:44.522074] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-22T20:48:44.945942] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T20:48:45.322047] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-22T20:48:45.711502] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T20:48:46.122061] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-22T20:48:46.922028] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-22T20:48:46.976889] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T20:48:47.247597] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T20:48:47.722125] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-22T20:48:48.306363] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T20:48:48.522064] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-22T20:48:48.874871] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T20:48:49.322083] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-22T20:48:50.122072] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-22T20:48:50.264922] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T20:48:50.274705] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T20:48:50.922063] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-22T20:48:51.519099] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T20:48:51.722077] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-22T20:48:52.055381] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T20:48:52.059317] [INFO ] [REMOTE ] PPT: Full fetch complete (29194 records). [2025-09-22T20:48:52.059458] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-22T20:48:52.438289] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-22T20:48:52.438400] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-22T20:48:52.439066] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-22T20:48:52.439127] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-22T20:48:52.439935] [DEBUG] [LOCAL ] PPT: Trimmed 29194 records to 20406 (keeping 200 days of data) [2025-09-22T20:48:52.525453] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-22T20:48:52.561771] [DEBUG] [LOCAL ] PPT: Primary data saved (20406 records). [2025-09-22T20:48:52.561898] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-22T20:48:52.561978] [INFO ] [MAIN ] Update Progress: 1722/2372 symbols completed. PPT took 20.5s. Estimated remaining: 1h 26m 22s. Rate: 7.5 symbols/min [2025-09-22T20:48:52.731424] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:48:52.777580] [DEBUG] [LOCAL ] PRGO: Loaded 47667 existing records from primary storage. [2025-09-22T20:48:52.777747] [INFO ] [MAIN ] PRGO: Loaded 47667 existing records. [2025-09-22T20:48:52.962406] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:48:52.962733] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-22T20:48:52.962806] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-22T20:48:52.964553] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-22T20:48:52.964619] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-22T20:48:53.322286] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-22T20:48:53.345177] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:48:53.366258] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T20:48:54.122057] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-22T20:48:54.241749] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T20:48:54.922101] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-22T20:48:55.303124] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-22T20:48:55.337635] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T20:48:55.722062] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-22T20:48:56.522024] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-22T20:48:56.632447] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T20:48:57.322023] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-22T20:48:57.402345] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T20:48:57.841790] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T20:48:58.122067] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-22T20:48:58.408024] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T20:48:58.922129] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-22T20:48:59.722083] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-22T20:49:00.092987] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-22T20:49:00.300079] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T20:49:00.522055] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-22T20:49:01.322087] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-22T20:49:01.577539] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-22T20:49:02.037685] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T20:49:02.122057] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-22T20:49:02.922098] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-22T20:49:03.240159] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T20:49:03.461196] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T20:49:03.465739] [INFO ] [REMOTE ] PRG: Full fetch complete (43992 records). [2025-09-22T20:49:03.465854] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-22T20:49:03.727243] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-22T20:49:03.857296] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-22T20:49:03.857388] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-22T20:49:03.858273] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-22T20:49:03.858338] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-22T20:49:03.859404] [DEBUG] [LOCAL ] PRG: Trimmed 43992 records to 30223 (keeping 200 days of data) [2025-09-22T20:49:04.057200] [DEBUG] [LOCAL ] PRG: Primary data saved (30223 records). [2025-09-22T20:49:04.057345] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-22T20:49:04.057431] [INFO ] [MAIN ] Update Progress: 1723/2372 symbols completed. PRG took 23.6s. Estimated remaining: 1h 26m 16s. Rate: 7.5 symbols/min [2025-09-22T20:49:04.271044] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:49:04.279229] [DEBUG] [LOCAL ] PRH: Loaded 5020 existing records from primary storage. [2025-09-22T20:49:04.279367] [INFO ] [MAIN ] PRH: Loaded 5020 existing records. [2025-09-22T20:49:04.473798] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:49:04.474379] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-22T20:49:04.474544] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-22T20:49:04.475167] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-22T20:49:04.475234] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-22T20:49:04.526077] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-22T20:49:04.709562] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T20:49:04.918488] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:49:05.322064] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-22T20:49:05.371918] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T20:49:06.067103] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-22T20:49:06.107317] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T20:49:06.122010] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-22T20:49:06.922048] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-22T20:49:07.589700] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T20:49:07.646349] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T20:49:07.722056] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-22T20:49:08.522056] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-22T20:49:09.322053] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-22T20:49:09.330736] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T20:49:09.612832] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T20:49:10.122105] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-22T20:49:10.519811] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T20:49:10.524430] [INFO ] [REMOTE ] PRA: Full fetch complete (43305 records). [2025-09-22T20:49:10.524525] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-22T20:49:10.904602] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-22T20:49:10.904712] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-22T20:49:10.905516] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-22T20:49:10.905577] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-22T20:49:10.906527] [DEBUG] [LOCAL ] PRA: Trimmed 43305 records to 34733 (keeping 200 days of data) [2025-09-22T20:49:10.958735] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-22T20:49:11.117384] [DEBUG] [LOCAL ] PRA: Primary data saved (34733 records). [2025-09-22T20:49:11.117531] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-22T20:49:11.117635] [INFO ] [MAIN ] Update Progress: 1724/2372 symbols completed. PRA took 39.0s. Estimated remaining: 1h 26m 7s. Rate: 7.5 symbols/min [2025-09-22T20:49:11.288027] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:49:11.307521] [DEBUG] [LOCAL ] PRI: Loaded 18684 existing records from primary storage. [2025-09-22T20:49:11.307729] [INFO ] [MAIN ] PRI: Loaded 18684 existing records. [2025-09-22T20:49:11.488542] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:49:11.488786] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-22T20:49:11.488838] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-22T20:49:11.489795] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-22T20:49:11.489858] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-22T20:49:11.724922] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T20:49:11.723362] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-22T20:49:11.893827] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:49:11.947382] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T20:49:12.522107] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-22T20:49:13.322064] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-22T20:49:13.481293] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T20:49:13.515816] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T20:49:14.122104] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-22T20:49:14.879850] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T20:49:14.922111] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-22T20:49:15.108129] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T20:49:15.616618] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T20:49:15.722062] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-22T20:49:16.367737] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-22T20:49:16.522053] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-22T20:49:17.227446] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T20:49:17.322057] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-22T20:49:18.122021] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-22T20:49:18.436856] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T20:49:18.757289] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T20:49:18.759924] [INFO ] [REMOTE ] PRH: Full fetch complete (7735 records). [2025-09-22T20:49:18.760161] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-22T20:49:18.927266] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-22T20:49:19.255341] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-22T20:49:19.255437] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-22T20:49:19.255752] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-22T20:49:19.255815] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-22T20:49:19.256344] [DEBUG] [LOCAL ] PRH: Trimmed 7735 records to 4919 (keeping 200 days of data) [2025-09-22T20:49:19.291039] [DEBUG] [LOCAL ] PRH: Primary data saved (4919 records). [2025-09-22T20:49:19.291200] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-22T20:49:19.291298] [INFO ] [MAIN ] Update Progress: 1725/2372 symbols completed. PRH took 15.2s. Estimated remaining: 1h 25m 59s. Rate: 7.5 symbols/min [2025-09-22T20:49:19.493496] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:49:19.541234] [DEBUG] [LOCAL ] PRIM: Loaded 45230 existing records from primary storage. [2025-09-22T20:49:19.541418] [INFO ] [MAIN ] PRIM: Loaded 45230 existing records. [2025-09-22T20:49:19.727579] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-22T20:49:19.752757] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:49:19.754022] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-22T20:49:19.754103] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-22T20:49:19.756139] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-22T20:49:19.756203] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-22T20:49:20.118461] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:49:20.522124] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-22T20:49:20.551618] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T20:49:21.322065] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-22T20:49:21.529585] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T20:49:21.539015] [INFO ] [REMOTE ] PR: Full fetch complete (77592 records). [2025-09-22T20:49:21.539141] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-22T20:49:21.968801] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-22T20:49:21.968919] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-22T20:49:21.970247] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-22T20:49:21.970332] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-22T20:49:21.973264] [DEBUG] [LOCAL ] PR: Trimmed 77592 records to 53609 (keeping 200 days of data) [2025-09-22T20:49:22.098447] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T20:49:22.122482] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-22T20:49:22.355185] [DEBUG] [LOCAL ] PR: Primary data saved (53609 records). [2025-09-22T20:49:22.355358] [INFO ] [MAIN ] PR: Full history saved. [2025-09-22T20:49:22.355515] [INFO ] [MAIN ] Update Progress: 1726/2372 symbols completed. PR took 50.3s. Estimated remaining: 1h 25m 49s. Rate: 7.5 symbols/min [2025-09-22T20:49:22.530142] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:49:22.574750] [DEBUG] [LOCAL ] PRKS: Loaded 43351 existing records from primary storage. [2025-09-22T20:49:22.574921] [INFO ] [MAIN ] PRKS: Loaded 43351 existing records. [2025-09-22T20:49:22.761280] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:49:22.761585] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-22T20:49:22.761667] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-22T20:49:22.762989] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-22T20:49:22.763049] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-22T20:49:22.924512] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-22T20:49:23.149902] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:49:23.168942] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T20:49:23.289912] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T20:49:23.722075] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-22T20:49:24.522069] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-22T20:49:24.653580] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T20:49:25.322086] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-22T20:49:25.539673] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T20:49:25.608142] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T20:49:26.122056] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-22T20:49:26.802010] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T20:49:26.922136] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-22T20:49:27.722039] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-22T20:49:27.753228] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T20:49:27.763386] [INFO ] [REMOTE ] PRGO: Full fetch complete (68312 records). [2025-09-22T20:49:27.763503] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-22T20:49:28.164589] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-22T20:49:28.164750] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-22T20:49:28.166498] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-22T20:49:28.166599] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-22T20:49:28.168095] [DEBUG] [LOCAL ] PRGO: Trimmed 68312 records to 46912 (keeping 200 days of data) [2025-09-22T20:49:28.473210] [DEBUG] [LOCAL ] PRGO: Primary data saved (46912 records). [2025-09-22T20:49:28.473345] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-22T20:49:28.473610] [INFO ] [MAIN ] Update Progress: 1727/2372 symbols completed. PRGO took 35.9s. Estimated remaining: 1h 25m 41s. Rate: 7.5 symbols/min [2025-09-22T20:49:28.530858] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-22T20:49:28.686027] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:49:28.687585] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T20:49:28.717282] [DEBUG] [LOCAL ] PRLB: Loaded 21223 existing records from primary storage. [2025-09-22T20:49:28.717425] [INFO ] [MAIN ] PRLB: Loaded 21223 existing records. [2025-09-22T20:49:28.903614] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:49:28.904427] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-22T20:49:28.904554] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-22T20:49:28.905304] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-22T20:49:28.905372] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-22T20:49:29.047331] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T20:49:29.281590] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:49:29.322051] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-22T20:49:30.122025] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-22T20:49:30.215187] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T20:49:30.550205] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T20:49:30.922071] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-22T20:49:31.575902] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T20:49:31.722077] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-22T20:49:32.093258] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T20:49:32.522052] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-22T20:49:33.308483] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T20:49:33.322117] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-22T20:49:33.723196] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T20:49:34.122071] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-22T20:49:34.577383] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T20:49:34.922035] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-22T20:49:35.200975] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T20:49:35.722022] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-22T20:49:36.095398] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-22T20:49:36.522020] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-22T20:49:36.881621] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T20:49:37.322051] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-22T20:49:38.122481] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-22T20:49:38.165127] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T20:49:38.413045] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T20:49:38.922096] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-22T20:49:39.311147] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T20:49:39.722123] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-22T20:49:40.008449] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-22T20:49:40.522116] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-22T20:49:41.281911] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T20:49:41.322037] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-22T20:49:41.489714] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T20:49:41.493045] [INFO ] [REMOTE ] PRI: Full fetch complete (25642 records). [2025-09-22T20:49:41.493221] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-22T20:49:41.883828] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-22T20:49:41.883981] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-22T20:49:41.884530] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-22T20:49:41.884591] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-22T20:49:41.886428] [DEBUG] [LOCAL ] PRI: Trimmed 25642 records to 18382 (keeping 200 days of data) [2025-09-22T20:49:42.013708] [DEBUG] [LOCAL ] PRI: Primary data saved (18382 records). [2025-09-22T20:49:42.013873] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-22T20:49:42.014011] [INFO ] [MAIN ] Update Progress: 1728/2372 symbols completed. PRI took 30.9s. Estimated remaining: 1h 25m 35s. Rate: 7.5 symbols/min [2025-09-22T20:49:42.127185] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-22T20:49:42.186509] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:49:42.250374] [DEBUG] [LOCAL ] PRM: Loaded 45339 existing records from primary storage. [2025-09-22T20:49:42.250536] [INFO ] [MAIN ] PRM: Loaded 45339 existing records. [2025-09-22T20:49:42.427575] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:49:42.427901] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-22T20:49:42.427948] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-22T20:49:42.430205] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-22T20:49:42.430276] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-22T20:49:42.801263] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:49:42.831280] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T20:49:42.922050] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-22T20:49:43.248097] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T20:49:43.722096] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-22T20:49:44.468894] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T20:49:44.522053] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-22T20:49:45.322038] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-22T20:49:45.452502] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T20:49:46.097369] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T20:49:46.122009] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-22T20:49:46.378224] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T20:49:46.922061] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-22T20:49:47.599597] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T20:49:47.722058] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-22T20:49:47.983889] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-22T20:49:48.522059] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-22T20:49:48.966059] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-22T20:49:49.322101] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-22T20:49:50.122060] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-22T20:49:50.176362] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T20:49:50.253333] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T20:49:50.922069] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-22T20:49:51.722103] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-22T20:49:51.872958] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T20:49:52.522041] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-22T20:49:52.584455] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T20:49:52.631180] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T20:49:52.636280] [INFO ] [REMOTE ] PRLB: Full fetch complete (31059 records). [2025-09-22T20:49:52.636385] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-22T20:49:53.060897] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-22T20:49:53.061026] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-22T20:49:53.062115] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-22T20:49:53.062185] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-22T20:49:53.063481] [DEBUG] [LOCAL ] PRLB: Trimmed 31059 records to 20804 (keeping 200 days of data) [2025-09-22T20:49:53.217629] [DEBUG] [LOCAL ] PRLB: Primary data saved (20804 records). [2025-09-22T20:49:53.217865] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-22T20:49:53.218041] [INFO ] [MAIN ] Update Progress: 1729/2372 symbols completed. PRLB took 24.7s. Estimated remaining: 1h 25m 28s. Rate: 7.5 symbols/min [2025-09-22T20:49:53.328986] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-22T20:49:53.417081] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:49:53.484824] [DEBUG] [LOCAL ] PRMB: Loaded 53904 existing records from primary storage. [2025-09-22T20:49:53.485065] [INFO ] [MAIN ] PRMB: Loaded 53904 existing records. [2025-09-22T20:49:53.683661] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:49:53.683949] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-22T20:49:53.683998] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-22T20:49:53.686016] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-22T20:49:53.686250] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-22T20:49:54.084210] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:49:54.122015] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-22T20:49:54.279941] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T20:49:54.922080] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-22T20:49:54.978193] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T20:49:55.722120] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-22T20:49:56.206727] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-22T20:49:56.522077] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-22T20:49:56.639582] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T20:49:57.281486] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T20:49:57.322020] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-22T20:49:58.025080] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T20:49:58.122020] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-22T20:49:58.874274] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T20:49:58.881915] [INFO ] [REMOTE ] PRKS: Full fetch complete (60892 records). [2025-09-22T20:49:58.882073] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-22T20:49:58.927320] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-22T20:49:59.277276] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-22T20:49:59.277353] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-22T20:49:59.278320] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-22T20:49:59.278383] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-22T20:49:59.279543] [DEBUG] [LOCAL ] PRKS: Trimmed 60892 records to 42728 (keeping 200 days of data) [2025-09-22T20:49:59.540584] [DEBUG] [LOCAL ] PRKS: Primary data saved (42728 records). [2025-09-22T20:49:59.540759] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-22T20:49:59.540872] [INFO ] [MAIN ] Update Progress: 1730/2372 symbols completed. PRKS took 37.2s. Estimated remaining: 1h 25m 20s. Rate: 7.5 symbols/min [2025-09-22T20:49:59.716986] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:49:59.722045] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-22T20:49:59.774052] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T20:49:59.796068] [DEBUG] [LOCAL ] PRO: Loaded 37833 existing records from primary storage. [2025-09-22T20:49:59.796614] [INFO ] [MAIN ] PRO: Loaded 37833 existing records. [2025-09-22T20:49:59.971875] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:49:59.972157] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-22T20:49:59.972205] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-22T20:49:59.973174] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-22T20:49:59.973247] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-22T20:50:00.339489] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:50:00.365845] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T20:50:00.522089] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-22T20:50:01.322051] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-22T20:50:01.584337] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-22T20:50:02.122087] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-22T20:50:02.249843] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T20:50:02.257289] [INFO ] [REMOTE ] PRIM: Full fetch complete (63263 records). [2025-09-22T20:50:02.257487] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-22T20:50:02.656451] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-22T20:50:02.656542] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-22T20:50:02.657674] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-22T20:50:02.657741] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-22T20:50:02.661158] [DEBUG] [LOCAL ] PRIM: Trimmed 63263 records to 44558 (keeping 200 days of data) [2025-09-22T20:50:02.924818] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-22T20:50:02.978791] [DEBUG] [LOCAL ] PRIM: Primary data saved (44558 records). [2025-09-22T20:50:02.978944] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-22T20:50:02.979065] [INFO ] [MAIN ] Update Progress: 1731/2372 symbols completed. PRIM took 43.7s. Estimated remaining: 1h 25m 10s. Rate: 7.5 symbols/min [2025-09-22T20:50:03.159744] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:50:03.160097] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-22T20:50:03.160341] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-22T20:50:03.160568] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-22T20:50:03.160727] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-22T20:50:03.160798] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-22T20:50:03.160834] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-22T20:50:03.506131] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-22T20:50:03.644001] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:50:03.722027] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-22T20:50:03.765571] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T20:50:04.021580] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T20:50:04.022066] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-22T20:50:04.352139] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-22T20:50:04.522063] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-22T20:50:05.322028] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-22T20:50:06.122024] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-22T20:50:06.170132] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T20:50:06.621237] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T20:50:06.922138] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-22T20:50:07.408671] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T20:50:07.722081] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-22T20:50:08.372496] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T20:50:08.379852] [INFO ] [REMOTE ] PRM: Full fetch complete (64221 records). [2025-09-22T20:50:08.379999] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-22T20:50:08.527199] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-22T20:50:08.789833] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-22T20:50:08.790050] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-22T20:50:08.791102] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-22T20:50:08.791169] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-22T20:50:08.793266] [DEBUG] [LOCAL ] PRM: Trimmed 64221 records to 44595 (keeping 200 days of data) [2025-09-22T20:50:09.015027] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T20:50:09.074893] [DEBUG] [LOCAL ] PRM: Primary data saved (44595 records). [2025-09-22T20:50:09.075031] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-22T20:50:09.075119] [INFO ] [MAIN ] Update Progress: 1732/2372 symbols completed. PRM took 27.1s. Estimated remaining: 1h 25m 1s. Rate: 7.5 symbols/min [2025-09-22T20:50:09.248701] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:50:09.256539] [DEBUG] [LOCAL ] PRT: Loaded 5488 existing records from primary storage. [2025-09-22T20:50:09.256676] [INFO ] [MAIN ] PRT: Loaded 5488 existing records. [2025-09-22T20:50:09.327221] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-22T20:50:09.440175] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:50:09.440414] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-22T20:50:09.440483] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-22T20:50:09.440911] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-22T20:50:09.440974] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-22T20:50:09.801809] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:50:09.824521] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T20:50:10.122073] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-22T20:50:10.672031] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T20:50:10.922047] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-22T20:50:10.960791] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T20:50:11.722079] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-22T20:50:12.320052] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T20:50:12.522134] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-22T20:50:12.565833] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T20:50:13.322075] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-22T20:50:14.122063] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-22T20:50:14.155506] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T20:50:14.468745] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-22T20:50:14.922112] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-22T20:50:15.342893] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T20:50:15.722079] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-22T20:50:16.181420] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T20:50:16.522040] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-22T20:50:16.999934] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T20:50:17.322071] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-22T20:50:18.119595] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T20:50:18.121968] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-22T20:50:18.420778] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T20:50:18.865008] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T20:50:18.922038] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-22T20:50:19.548109] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T20:50:19.722074] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-22T20:50:20.522053] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-22T20:50:20.614436] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-22T20:50:21.322061] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-22T20:50:22.018745] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T20:50:22.122054] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-22T20:50:22.418265] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-22T20:50:22.922061] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-22T20:50:23.243425] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T20:50:23.722112] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-22T20:50:24.436994] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T20:50:24.522069] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-22T20:50:24.934777] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T20:50:25.322062] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-22T20:50:26.058593] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-22T20:50:26.060340] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T20:50:26.122037] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-22T20:50:26.922058] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-22T20:50:27.609834] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T20:50:27.611737] [INFO ] [REMOTE ] PRT: Full fetch complete (9169 records). [2025-09-22T20:50:27.611813] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-22T20:50:27.724366] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-22T20:50:27.933303] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T20:50:28.051608] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-22T20:50:28.051717] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-22T20:50:28.051960] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-22T20:50:28.051999] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-22T20:50:28.052433] [DEBUG] [LOCAL ] PRT: Trimmed 9169 records to 5343 (keeping 200 days of data) [2025-09-22T20:50:28.083920] [DEBUG] [LOCAL ] PRT: Primary data saved (5343 records). [2025-09-22T20:50:28.084060] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-22T20:50:28.084151] [INFO ] [MAIN ] Update Progress: 1733/2372 symbols completed. PRT took 19.0s. Estimated remaining: 1h 24m 57s. Rate: 7.5 symbols/min [2025-09-22T20:50:28.259030] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:50:28.319425] [DEBUG] [LOCAL ] PRU: Loaded 52304 existing records from primary storage. [2025-09-22T20:50:28.319609] [INFO ] [MAIN ] PRU: Loaded 52304 existing records. [2025-09-22T20:50:28.501568] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:50:28.501885] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-22T20:50:28.501935] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-22T20:50:28.503669] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-22T20:50:28.503733] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-22T20:50:28.534488] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-22T20:50:28.871135] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:50:28.972987] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T20:50:29.322067] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-22T20:50:30.122087] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-22T20:50:30.451314] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T20:50:30.508599] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T20:50:30.922061] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-22T20:50:31.456791] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T20:50:31.722083] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-22T20:50:32.527264] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-22T20:50:32.544969] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T20:50:33.125452] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T20:50:33.131803] [INFO ] [REMOTE ] PRO: Full fetch complete (51132 records). [2025-09-22T20:50:33.131915] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-22T20:50:33.327132] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-22T20:50:33.520761] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-22T20:50:33.520862] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-22T20:50:33.521814] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-22T20:50:33.521945] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-22T20:50:33.523054] [DEBUG] [LOCAL ] PRO: Trimmed 51132 records to 37483 (keeping 200 days of data) [2025-09-22T20:50:33.729382] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T20:50:33.734772] [INFO ] [REMOTE ] PRSU: Full fetch complete (31715 records). [2025-09-22T20:50:33.735663] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-22T20:50:33.935775] [WARN ] [VALIDATOR ] PRSU: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-22T20:50:33.937155] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:50:33.937861] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:50:33.938831] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-22T20:50:33.940464] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-22T20:50:33.940828] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-22T20:50:33.941211] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-22T20:50:33.941609] [INFO ] [MAIN ] Update Progress: 1734/2372 symbols completed. PRSU took 31.0s. Estimated remaining: 1h 24m 49s. Rate: 7.5 symbols/min [2025-09-22T20:50:34.122618] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-22T20:50:34.126579] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:50:34.129004] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-22T20:50:34.129372] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-22T20:50:34.132770] [DEBUG] [LOCAL ] PRO: Primary data saved (37483 records). [2025-09-22T20:50:34.133211] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-22T20:50:34.133273] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-22T20:50:34.133420] [INFO ] [MAIN ] Update Progress: 1735/2372 symbols completed. PRO took 34.6s. Estimated remaining: 1h 24m 38s. Rate: 7.5 symbols/min [2025-09-22T20:50:34.133507] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-22T20:50:34.178217] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-22T20:50:34.206359] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-22T20:50:34.489560] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:50:34.701694] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:50:34.730555] [DEBUG] [LOCAL ] PSA: Loaded 42535 existing records from primary storage. [2025-09-22T20:50:34.730769] [INFO ] [MAIN ] PSA: Loaded 42535 existing records. [2025-09-22T20:50:34.909866] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:50:34.910147] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-22T20:50:34.910206] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-22T20:50:34.911778] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-22T20:50:34.911841] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-22T20:50:34.943591] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-22T20:50:35.299813] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:50:35.351280] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T20:50:35.485722] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-22T20:50:35.722043] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-22T20:50:35.902839] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T20:50:35.911346] [INFO ] [REMOTE ] PRMB: Full fetch complete (76050 records). [2025-09-22T20:50:35.911493] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-22T20:50:36.307571] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-22T20:50:36.307681] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-22T20:50:36.308891] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-22T20:50:36.308955] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-22T20:50:36.310532] [DEBUG] [LOCAL ] PRMB: Trimmed 76050 records to 53164 (keeping 200 days of data) [2025-09-22T20:50:36.527055] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-22T20:50:36.650907] [DEBUG] [LOCAL ] PRMB: Primary data saved (53164 records). [2025-09-22T20:50:36.651049] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-22T20:50:36.651133] [INFO ] [MAIN ] Update Progress: 1736/2372 symbols completed. PRMB took 43.4s. Estimated remaining: 1h 24m 28s. Rate: 7.5 symbols/min [2025-09-22T20:50:36.822394] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:50:36.831371] [DEBUG] [LOCAL ] PSBD: Loaded 6916 existing records from primary storage. [2025-09-22T20:50:36.831469] [INFO ] [MAIN ] PSBD: Loaded 6916 existing records. [2025-09-22T20:50:37.013080] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:50:37.013359] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-22T20:50:37.013417] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-22T20:50:37.013788] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-22T20:50:37.013849] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-22T20:50:37.336624] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-22T20:50:37.379295] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:50:37.762574] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-22T20:50:37.838157] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-22T20:50:38.109026] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T20:50:38.122015] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-22T20:50:38.922071] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-22T20:50:39.722045] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-22T20:50:39.846874] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T20:50:40.465401] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-22T20:50:40.522021] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-22T20:50:40.726758] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T20:50:41.301886] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T20:50:41.322017] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-22T20:50:41.960605] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T20:50:42.122065] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-22T20:50:42.922060] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-22T20:50:43.313973] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-22T20:50:43.722057] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-22T20:50:43.961247] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T20:50:44.522070] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-22T20:50:44.544580] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T20:50:45.322055] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-22T20:50:46.122024] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-22T20:50:46.515195] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-22T20:50:46.588750] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-22T20:50:46.922092] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-22T20:50:47.045506] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T20:50:47.722102] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-22T20:50:48.426019] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T20:50:48.522021] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-22T20:50:48.753452] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T20:50:49.255522] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T20:50:49.322054] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-22T20:50:50.085163] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-22T20:50:50.122004] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-22T20:50:50.868092] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-22T20:50:50.922002] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-22T20:50:51.722020] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-22T20:50:51.775716] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T20:50:52.522053] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-22T20:50:53.322065] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-22T20:50:53.442749] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T20:50:53.798150] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-22T20:50:54.122076] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-22T20:50:54.267290] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T20:50:54.798233] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T20:50:54.800104] [INFO ] [REMOTE ] PSBD: Full fetch complete (9144 records). [2025-09-22T20:50:54.800202] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-22T20:50:54.927159] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-22T20:50:55.188119] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-22T20:50:55.188211] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-22T20:50:55.188459] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-22T20:50:55.188499] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-22T20:50:55.189045] [DEBUG] [LOCAL ] PSBD: Trimmed 9144 records to 6859 (keeping 200 days of data) [2025-09-22T20:50:55.232525] [DEBUG] [LOCAL ] PSBD: Primary data saved (6859 records). [2025-09-22T20:50:55.232723] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-22T20:50:55.232835] [INFO ] [MAIN ] Update Progress: 1737/2372 symbols completed. PSBD took 18.6s. Estimated remaining: 1h 24m 24s. Rate: 7.5 symbols/min [2025-09-22T20:50:55.404315] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:50:55.412752] [DEBUG] [LOCAL ] PSF: Loaded 6842 existing records from primary storage. [2025-09-22T20:50:55.412856] [INFO ] [MAIN ] PSF: Loaded 6842 existing records. [2025-09-22T20:50:55.587534] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:50:55.587764] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-22T20:50:55.587828] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-22T20:50:55.588231] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-22T20:50:55.588290] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-22T20:50:55.727185] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-22T20:50:55.946854] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:50:56.522058] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-22T20:50:56.851168] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-22T20:50:56.883775] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T20:50:57.322070] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-22T20:50:57.577926] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T20:50:57.728192] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-22T20:50:58.122069] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-22T20:50:58.922083] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-22T20:50:59.285786] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-22T20:50:59.722089] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-22T20:50:59.937521] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T20:51:00.522053] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-22T20:51:01.322065] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-22T20:51:01.449516] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T20:51:02.122055] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-22T20:51:02.463098] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-22T20:51:02.472396] [INFO ] [REMOTE ] PRU: Full fetch complete (74277 records). [2025-09-22T20:51:02.472570] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-22T20:51:02.914016] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-22T20:51:02.914103] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-22T20:51:02.915394] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-22T20:51:02.915467] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-22T20:51:02.917094] [DEBUG] [LOCAL ] PRU: Trimmed 74277 records to 51519 (keeping 200 days of data) [2025-09-22T20:51:02.922134] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-22T20:51:03.269056] [DEBUG] [LOCAL ] PRU: Primary data saved (51519 records). [2025-09-22T20:51:03.269207] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-22T20:51:03.269305] [INFO ] [MAIN ] Update Progress: 1738/2372 symbols completed. PRU took 35.2s. Estimated remaining: 1h 24m 16s. Rate: 7.5 symbols/min [2025-09-22T20:51:03.450828] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:51:03.486365] [DEBUG] [LOCAL ] PSFE: Loaded 31222 existing records from primary storage. [2025-09-22T20:51:03.486509] [INFO ] [MAIN ] PSFE: Loaded 31222 existing records. [2025-09-22T20:51:03.671275] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-22T20:51:03.693804] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:51:03.694036] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-22T20:51:03.694084] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-22T20:51:03.695044] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-22T20:51:03.695105] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-22T20:51:03.727148] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-22T20:51:04.052246] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:51:04.161693] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T20:51:04.522091] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-22T20:51:04.889198] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T20:51:05.183581] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T20:51:05.184541] [INFO ] [REMOTE ] PRVS: Full fetch complete (1241 records). [2025-09-22T20:51:05.184769] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-22T20:51:05.334895] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-22T20:51:05.387283] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-22T20:51:05.402119] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:51:05.407573] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:51:05.427041] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-22T20:51:05.427192] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-22T20:51:05.427265] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-22T20:51:05.427383] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-22T20:51:05.427479] [INFO ] [MAIN ] Update Progress: 1739/2372 symbols completed. PRVS took 31.5s. Estimated remaining: 1h 24m 6s. Rate: 7.5 symbols/min [2025-09-22T20:51:05.436633] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (3.31 seconds). [2025-09-22T20:51:05.704559] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:51:05.771511] [DEBUG] [LOCAL ] PSN: Loaded 47118 existing records from primary storage. [2025-09-22T20:51:05.771735] [INFO ] [MAIN ] PSN: Loaded 47118 existing records. [2025-09-22T20:51:06.001257] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:51:06.001610] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-22T20:51:06.001696] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-22T20:51:06.002840] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-22T20:51:06.002905] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-22T20:51:06.123450] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-22T20:51:06.419542] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T20:51:06.531066] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:51:06.922104] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-22T20:51:07.600138] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-22T20:51:07.722035] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-22T20:51:07.952693] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T20:51:08.522066] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-22T20:51:09.084157] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T20:51:09.322066] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-22T20:51:10.122084] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-22T20:51:10.263275] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T20:51:10.569772] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T20:51:10.869962] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T20:51:10.922082] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-22T20:51:11.722067] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-22T20:51:12.522078] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-22T20:51:12.595429] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T20:51:13.057712] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T20:51:13.322076] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-22T20:51:13.525830] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T20:51:14.122071] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-22T20:51:14.922075] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-22T20:51:15.609221] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T20:51:15.610767] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-22T20:51:15.722074] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-22T20:51:15.973148] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T20:51:16.248486] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T20:51:16.522059] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-22T20:51:17.322060] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-22T20:51:18.086494] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T20:51:18.122014] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-22T20:51:18.186485] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T20:51:18.876392] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T20:51:18.878274] [INFO ] [REMOTE ] PSF: Full fetch complete (9633 records). [2025-09-22T20:51:18.878363] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-22T20:51:18.927235] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-22T20:51:19.256414] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-22T20:51:19.256502] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-22T20:51:19.256832] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-22T20:51:19.256894] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-22T20:51:19.257338] [DEBUG] [LOCAL ] PSF: Trimmed 9633 records to 6776 (keeping 200 days of data) [2025-09-22T20:51:19.299373] [DEBUG] [LOCAL ] PSF: Primary data saved (6776 records). [2025-09-22T20:51:19.299528] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-22T20:51:19.299630] [INFO ] [MAIN ] Update Progress: 1740/2372 symbols completed. PSF took 24.1s. Estimated remaining: 1h 23m 60s. Rate: 7.5 symbols/min [2025-09-22T20:51:19.472853] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:51:19.517576] [DEBUG] [LOCAL ] PSO: Loaded 38334 existing records from primary storage. [2025-09-22T20:51:19.517759] [INFO ] [MAIN ] PSO: Loaded 38334 existing records. [2025-09-22T20:51:19.695839] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:51:19.696082] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-22T20:51:19.696129] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-22T20:51:19.697350] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-22T20:51:19.697412] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-22T20:51:19.728058] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-22T20:51:20.064233] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:51:20.522172] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-22T20:51:20.720563] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T20:51:21.322040] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-22T20:51:21.437408] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T20:51:21.444234] [INFO ] [REMOTE ] PSA: Full fetch complete (59010 records). [2025-09-22T20:51:21.444380] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-22T20:51:21.743416] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T20:51:21.884095] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-22T20:51:21.884183] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-22T20:51:21.885216] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-22T20:51:21.885341] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-22T20:51:21.886765] [DEBUG] [LOCAL ] PSA: Trimmed 59010 records to 41908 (keeping 200 days of data) [2025-09-22T20:51:22.126795] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-22T20:51:22.167234] [DEBUG] [LOCAL ] PSA: Primary data saved (41908 records). [2025-09-22T20:51:22.167376] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-22T20:51:22.167466] [INFO ] [MAIN ] Update Progress: 1741/2372 symbols completed. PSA took 48.0s. Estimated remaining: 1h 23m 50s. Rate: 7.5 symbols/min [2025-09-22T20:51:22.368099] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:51:22.408908] [DEBUG] [LOCAL ] PSQH: Loaded 35077 existing records from primary storage. [2025-09-22T20:51:22.409103] [INFO ] [MAIN ] PSQH: Loaded 35077 existing records. [2025-09-22T20:51:22.591356] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:51:22.591724] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-22T20:51:22.591814] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-22T20:51:22.592927] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-22T20:51:22.592991] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-22T20:51:22.930081] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-22T20:51:22.961478] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:51:23.175596] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T20:51:23.583305] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T20:51:23.722079] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-22T20:51:24.255579] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T20:51:24.522116] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-22T20:51:24.823613] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T20:51:25.322062] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-22T20:51:26.122136] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-22T20:51:26.922080] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-22T20:51:27.089619] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-22T20:51:27.546047] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T20:51:27.577330] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-22T20:51:27.722102] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-22T20:51:28.355385] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T20:51:28.522031] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-22T20:51:29.068094] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T20:51:29.322039] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-22T20:51:30.122113] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-22T20:51:30.254553] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T20:51:30.586410] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T20:51:30.922060] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-22T20:51:31.722030] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-22T20:51:31.816751] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T20:51:32.522056] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-22T20:51:32.584486] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T20:51:33.178773] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T20:51:33.322065] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-22T20:51:33.911011] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T20:51:34.110105] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T20:51:34.114211] [INFO ] [REMOTE ] PSFE: Full fetch complete (43239 records). [2025-09-22T20:51:34.114326] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-22T20:51:34.127274] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-22T20:51:34.538332] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-22T20:51:34.538471] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-22T20:51:34.539699] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-22T20:51:34.539806] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-22T20:51:34.545853] [DEBUG] [LOCAL ] PSFE: Trimmed 43239 records to 30551 (keeping 200 days of data) [2025-09-22T20:51:34.745444] [DEBUG] [LOCAL ] PSFE: Primary data saved (30551 records). [2025-09-22T20:51:34.745612] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-22T20:51:34.745859] [INFO ] [MAIN ] Update Progress: 1742/2372 symbols completed. PSFE took 31.5s. Estimated remaining: 1h 23m 44s. Rate: 7.5 symbols/min [2025-09-22T20:51:34.918574] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:51:34.922082] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-22T20:51:34.978737] [DEBUG] [LOCAL ] PSTG: Loaded 53628 existing records from primary storage. [2025-09-22T20:51:34.978887] [INFO ] [MAIN ] PSTG: Loaded 53628 existing records. [2025-09-22T20:51:35.171256] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:51:35.171536] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-22T20:51:35.171585] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-22T20:51:35.172787] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-22T20:51:35.172857] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-22T20:51:35.615952] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:51:35.722088] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-22T20:51:35.757605] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T20:51:36.522121] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-22T20:51:36.646223] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T20:51:37.322066] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-22T20:51:37.813582] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-22T20:51:38.085064] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T20:51:38.093107] [INFO ] [REMOTE ] PSN: Full fetch complete (66793 records). [2025-09-22T20:51:38.093312] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-22T20:51:38.130323] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-22T20:51:38.530293] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-22T20:51:38.530426] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-22T20:51:38.532543] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-22T20:51:38.532687] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-22T20:51:38.538533] [DEBUG] [LOCAL ] PSN: Trimmed 66793 records to 46289 (keeping 200 days of data) [2025-09-22T20:51:38.890115] [DEBUG] [LOCAL ] PSN: Primary data saved (46289 records). [2025-09-22T20:51:38.890314] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-22T20:51:38.890471] [INFO ] [MAIN ] Update Progress: 1743/2372 symbols completed. PSN took 33.5s. Estimated remaining: 1h 23m 34s. Rate: 7.5 symbols/min [2025-09-22T20:51:38.925818] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-22T20:51:39.083033] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T20:51:39.170091] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:51:39.193972] [DEBUG] [LOCAL ] PSTL: Loaded 20982 existing records from primary storage. [2025-09-22T20:51:39.194199] [INFO ] [MAIN ] PSTL: Loaded 20982 existing records. [2025-09-22T20:51:39.384276] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:51:39.384548] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-22T20:51:39.384598] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-22T20:51:39.385681] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-22T20:51:39.385745] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-22T20:51:39.742947] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-22T20:51:39.748589] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:51:40.087145] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-22T20:51:40.522018] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-22T20:51:40.548158] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T20:51:41.309983] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T20:51:41.321993] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-22T20:51:42.122025] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-22T20:51:42.386811] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T20:51:42.809182] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T20:51:42.922096] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-22T20:51:43.168775] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T20:51:43.722094] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-22T20:51:44.512355] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T20:51:44.522003] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-22T20:51:45.322047] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-22T20:51:45.368912] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T20:51:46.041463] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T20:51:46.122055] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-22T20:51:46.857977] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T20:51:46.922017] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-22T20:51:47.722031] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-22T20:51:47.930546] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T20:51:48.399484] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T20:51:48.522051] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-22T20:51:48.873582] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T20:51:49.322053] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-22T20:51:49.813805] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T20:51:49.820366] [INFO ] [REMOTE ] PSO: Full fetch complete (51741 records). [2025-09-22T20:51:49.820492] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-22T20:51:50.124848] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-22T20:51:50.224122] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-22T20:51:50.224215] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-22T20:51:50.225182] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-22T20:51:50.225267] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-22T20:51:50.226405] [DEBUG] [LOCAL ] PSO: Trimmed 51741 records to 37585 (keeping 200 days of data) [2025-09-22T20:51:50.471517] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-22T20:51:50.491371] [DEBUG] [LOCAL ] PSO: Primary data saved (37585 records). [2025-09-22T20:51:50.491541] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-22T20:51:50.491670] [INFO ] [MAIN ] Update Progress: 1744/2372 symbols completed. PSO took 31.2s. Estimated remaining: 1h 23m 28s. Rate: 7.5 symbols/min [2025-09-22T20:51:50.682878] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:51:50.747167] [DEBUG] [LOCAL ] PSX: Loaded 53908 existing records from primary storage. [2025-09-22T20:51:50.747405] [INFO ] [MAIN ] PSX: Loaded 53908 existing records. [2025-09-22T20:51:50.927211] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-22T20:51:50.931374] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:51:50.932926] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-22T20:51:50.932991] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-22T20:51:50.934877] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-22T20:51:50.935040] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-22T20:51:51.292391] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:51:51.718001] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T20:51:51.724474] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-22T20:51:52.522030] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-22T20:51:52.873706] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T20:51:53.322056] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-22T20:51:53.682373] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-22T20:51:53.792086] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T20:51:54.122056] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-22T20:51:54.922037] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-22T20:51:55.106151] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T20:51:55.292132] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T20:51:55.722060] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-22T20:51:56.522107] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-22T20:51:56.756500] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T20:51:56.853514] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-22T20:51:57.322054] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-22T20:51:58.122023] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-22T20:51:58.515953] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T20:51:58.546875] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T20:51:58.922095] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-22T20:51:59.703187] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T20:51:59.722147] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-22T20:52:00.144009] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T20:52:00.522053] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-22T20:52:01.322087] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-22T20:52:01.470085] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T20:52:01.702106] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T20:52:01.709239] [INFO ] [REMOTE ] PSQH: Full fetch complete (53858 records). [2025-09-22T20:52:01.709402] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-22T20:52:02.130205] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-22T20:52:02.134895] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-22T20:52:02.135025] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-22T20:52:02.136374] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-22T20:52:02.136588] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-22T20:52:02.138135] [DEBUG] [LOCAL ] PSQH: Trimmed 53858 records to 34454 (keeping 200 days of data) [2025-09-22T20:52:02.357753] [DEBUG] [LOCAL ] PSQH: Primary data saved (34454 records). [2025-09-22T20:52:02.357922] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-22T20:52:02.358028] [INFO ] [MAIN ] Update Progress: 1745/2372 symbols completed. PSQH took 40.2s. Estimated remaining: 1h 23m 21s. Rate: 7.5 symbols/min [2025-09-22T20:52:02.539927] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:52:02.556041] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T20:52:02.574991] [DEBUG] [LOCAL ] PTA: Loaded 15248 existing records from primary storage. [2025-09-22T20:52:02.575140] [INFO ] [MAIN ] PTA: Loaded 15248 existing records. [2025-09-22T20:52:02.770745] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:52:02.771050] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-22T20:52:02.771124] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-22T20:52:02.771777] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-22T20:52:02.771849] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-22T20:52:02.927259] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-22T20:52:03.149676] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:52:03.722060] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-22T20:52:04.092591] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T20:52:04.522071] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-22T20:52:05.044290] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T20:52:05.090409] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-22T20:52:05.322059] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-22T20:52:06.122067] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-22T20:52:06.483875] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T20:52:06.922041] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-22T20:52:07.156132] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T20:52:07.174310] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T20:52:07.174003] [INFO ] [REMOTE ] PSTG: Full fetch complete (76545 records). [2025-09-22T20:52:07.177600] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-22T20:52:07.178232] [INFO ] [REMOTE ] PSTL: Full fetch complete (29545 records). [2025-09-22T20:52:07.178310] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-22T20:52:07.739437] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-22T20:52:07.967930] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-22T20:52:08.055441] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-22T20:52:08.051574] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-22T20:52:08.055755] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-22T20:52:08.057739] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-22T20:52:08.056844] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-22T20:52:08.057893] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-22T20:52:08.058284] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-22T20:52:08.070811] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T20:52:08.076105] [DEBUG] [LOCAL ] PSTL: Trimmed 29545 records to 20481 (keeping 200 days of data) [2025-09-22T20:52:08.076590] [DEBUG] [LOCAL ] PSTG: Trimmed 76545 records to 52848 (keeping 200 days of data) [2025-09-22T20:52:08.324540] [DEBUG] [LOCAL ] PSTL: Primary data saved (20481 records). [2025-09-22T20:52:08.326248] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-22T20:52:08.328187] [INFO ] [MAIN ] Update Progress: 1746/2372 symbols completed. PSTL took 29.4s. Estimated remaining: 1h 23m 12s. Rate: 7.5 symbols/min [2025-09-22T20:52:08.526578] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-22T20:52:08.603369] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:52:08.654952] [DEBUG] [LOCAL ] PTY: Loaded 37923 existing records from primary storage. [2025-09-22T20:52:08.655413] [INFO ] [MAIN ] PTY: Loaded 37923 existing records. [2025-09-22T20:52:08.922539] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:52:08.927523] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-22T20:52:08.928186] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-22T20:52:08.929701] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-22T20:52:08.930637] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-22T20:52:09.111674] [DEBUG] [LOCAL ] PSTG: Primary data saved (52848 records). [2025-09-22T20:52:09.120177] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-22T20:52:09.120319] [INFO ] [MAIN ] Update Progress: 1747/2372 symbols completed. PSTG took 34.4s. Estimated remaining: 1h 23m 2s. Rate: 7.5 symbols/min [2025-09-22T20:52:09.467973] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:52:09.490517] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:52:09.491082] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-22T20:52:09.516401] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T20:52:09.552778] [DEBUG] [LOCAL ] PUK: Loaded 45716 existing records from primary storage. [2025-09-22T20:52:09.552942] [INFO ] [MAIN ] PUK: Loaded 45716 existing records. [2025-09-22T20:52:09.748746] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:52:09.749140] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-22T20:52:09.749309] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-22T20:52:09.750516] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-22T20:52:09.750581] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-22T20:52:10.108791] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-22T20:52:10.124322] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-22T20:52:10.197886] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:52:10.922058] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-22T20:52:11.306153] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T20:52:11.330749] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T20:52:11.722077] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-22T20:52:12.522030] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-22T20:52:12.695097] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T20:52:12.855920] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-22T20:52:13.322054] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-22T20:52:13.937109] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T20:52:14.122063] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-22T20:52:14.922025] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-22T20:52:15.280437] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T20:52:15.681560] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T20:52:15.722016] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-22T20:52:16.341297] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T20:52:16.522080] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-22T20:52:17.151088] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T20:52:17.322076] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-22T20:52:18.122039] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-22T20:52:18.179491] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T20:52:18.263851] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T20:52:18.922059] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-22T20:52:19.556170] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T20:52:19.722097] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-22T20:52:20.253157] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T20:52:20.522061] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-22T20:52:21.322077] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-22T20:52:21.419873] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T20:52:22.122117] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-22T20:52:22.248361] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T20:52:22.352052] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T20:52:22.922170] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-22T20:52:23.722023] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-22T20:52:23.924139] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T20:52:23.936704] [INFO ] [REMOTE ] PSX: Full fetch complete (77042 records). [2025-09-22T20:52:23.936900] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-22T20:52:24.403902] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-22T20:52:24.404116] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-22T20:52:24.405937] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-22T20:52:24.406019] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-22T20:52:24.410763] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T20:52:24.425890] [DEBUG] [LOCAL ] PSX: Trimmed 77042 records to 53126 (keeping 200 days of data) [2025-09-22T20:52:24.523031] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-22T20:52:24.765883] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T20:52:24.789380] [DEBUG] [LOCAL ] PSX: Primary data saved (53126 records). [2025-09-22T20:52:24.789544] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-22T20:52:24.789666] [INFO ] [MAIN ] Update Progress: 1748/2372 symbols completed. PSX took 34.3s. Estimated remaining: 1h 22m 57s. Rate: 7.5 symbols/min [2025-09-22T20:52:24.983522] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:52:25.029876] [DEBUG] [LOCAL ] PUMP: Loaded 50240 existing records from primary storage. [2025-09-22T20:52:25.030024] [INFO ] [MAIN ] PUMP: Loaded 50240 existing records. [2025-09-22T20:52:25.217041] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:52:25.217387] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-22T20:52:25.217443] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-22T20:52:25.218500] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-22T20:52:25.218582] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-22T20:52:25.330405] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-22T20:52:25.606585] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:52:25.929435] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T20:52:26.122081] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-22T20:52:26.552718] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T20:52:26.922153] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-22T20:52:27.722094] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-22T20:52:27.864278] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T20:52:28.522137] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-22T20:52:28.544161] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-22T20:52:28.547213] [INFO ] [REMOTE ] PTA: Full fetch complete (23622 records). [2025-09-22T20:52:28.547320] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-22T20:52:28.981384] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-22T20:52:28.981549] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-22T20:52:28.982253] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-22T20:52:28.982342] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-22T20:52:28.986008] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-22T20:52:28.998018] [DEBUG] [LOCAL ] PTA: Trimmed 23622 records to 14962 (keeping 200 days of data) [2025-09-22T20:52:29.091838] [DEBUG] [LOCAL ] PTA: Primary data saved (14962 records). [2025-09-22T20:52:29.091994] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-22T20:52:29.092083] [INFO ] [MAIN ] Update Progress: 1749/2372 symbols completed. PTA took 26.7s. Estimated remaining: 1h 22m 47s. Rate: 7.5 symbols/min [2025-09-22T20:52:29.265666] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:52:29.315727] [DEBUG] [LOCAL ] PVH: Loaded 51116 existing records from primary storage. [2025-09-22T20:52:29.315884] [INFO ] [MAIN ] PVH: Loaded 51116 existing records. [2025-09-22T20:52:29.327156] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-22T20:52:29.502763] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:52:29.503046] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-22T20:52:29.503096] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-22T20:52:29.504224] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-22T20:52:29.504285] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-22T20:52:29.889400] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:52:30.122073] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-22T20:52:30.192619] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T20:52:30.922034] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-22T20:52:31.073012] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T20:52:31.685294] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T20:52:31.722007] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-22T20:52:32.522066] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-22T20:52:32.651829] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T20:52:32.833535] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T20:52:32.839882] [INFO ] [REMOTE ] PTY: Full fetch complete (53845 records). [2025-09-22T20:52:32.839999] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-22T20:52:33.237065] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-22T20:52:33.237144] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-22T20:52:33.238187] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-22T20:52:33.238261] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-22T20:52:33.239429] [DEBUG] [LOCAL ] PTY: Trimmed 53845 records to 37378 (keeping 200 days of data) [2025-09-22T20:52:33.327174] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-22T20:52:33.469270] [DEBUG] [LOCAL ] PTY: Primary data saved (37378 records). [2025-09-22T20:52:33.469417] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-22T20:52:33.469506] [INFO ] [MAIN ] Update Progress: 1750/2372 symbols completed. PTY took 25.1s. Estimated remaining: 1h 22m 38s. Rate: 7.5 symbols/min [2025-09-22T20:52:33.645318] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:52:33.651630] [DEBUG] [LOCAL ] PVL: Loaded 4822 existing records from primary storage. [2025-09-22T20:52:33.651743] [INFO ] [MAIN ] PVL: Loaded 4822 existing records. [2025-09-22T20:52:33.840384] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:52:33.841083] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-22T20:52:33.841164] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-22T20:52:33.841417] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-22T20:52:33.841476] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-22T20:52:34.126900] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-22T20:52:34.225279] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:52:34.250283] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T20:52:34.922054] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-22T20:52:35.085635] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T20:52:35.727164] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-22T20:52:35.741790] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T20:52:36.522019] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-22T20:52:36.628990] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T20:52:37.111544] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-22T20:52:37.322047] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-22T20:52:37.561474] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T20:52:38.030063] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T20:52:38.122118] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-22T20:52:38.797660] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-22T20:52:38.922107] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-22T20:52:39.722078] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-22T20:52:40.531734] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-22T20:52:40.537835] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T20:52:41.210814] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-22T20:52:41.322057] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-22T20:52:41.404190] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T20:52:42.122076] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-22T20:52:42.884212] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T20:52:42.922071] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-22T20:52:43.722031] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-22T20:52:43.839405] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T20:52:44.530025] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-22T20:52:44.534781] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T20:52:44.542503] [INFO ] [REMOTE ] PUK: Full fetch complete (65052 records). [2025-09-22T20:52:44.542639] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-22T20:52:44.936867] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-22T20:52:44.936945] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-22T20:52:44.937968] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-22T20:52:44.938064] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-22T20:52:44.939346] [DEBUG] [LOCAL ] PUK: Trimmed 65052 records to 44939 (keeping 200 days of data) [2025-09-22T20:52:45.221162] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T20:52:45.229288] [DEBUG] [LOCAL ] PUK: Primary data saved (44939 records). [2025-09-22T20:52:45.229358] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-22T20:52:45.229432] [INFO ] [MAIN ] Update Progress: 1751/2372 symbols completed. PUK took 36.1s. Estimated remaining: 1h 22m 31s. Rate: 7.5 symbols/min [2025-09-22T20:52:45.328972] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-22T20:52:45.407167] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:52:45.463369] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T20:52:45.488726] [DEBUG] [LOCAL ] PWR: Loaded 48250 existing records from primary storage. [2025-09-22T20:52:45.488876] [INFO ] [MAIN ] PWR: Loaded 48250 existing records. [2025-09-22T20:52:45.670738] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:52:45.670993] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-22T20:52:45.671042] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-22T20:52:45.672144] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-22T20:52:45.672207] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-22T20:52:46.029142] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:52:46.122015] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-22T20:52:46.922048] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-22T20:52:47.032353] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T20:52:47.618546] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T20:52:47.722048] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-22T20:52:47.983212] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T20:52:48.514065] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T20:52:48.522003] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-22T20:52:49.111949] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-22T20:52:49.322054] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-22T20:52:50.122053] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-22T20:52:50.851971] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T20:52:50.922038] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-22T20:52:51.722056] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-22T20:52:52.238348] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-22T20:52:52.522106] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-22T20:52:52.738639] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T20:52:53.193113] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T20:52:53.322063] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-22T20:52:54.122029] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-22T20:52:54.366557] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T20:52:54.753771] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-22T20:52:54.922105] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-22T20:52:55.092607] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T20:52:55.722062] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-22T20:52:56.522095] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-22T20:52:56.565976] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T20:52:57.249044] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T20:52:57.250757] [INFO ] [REMOTE ] PVL: Full fetch complete (7560 records). [2025-09-22T20:52:57.250837] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-22T20:52:57.324445] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-22T20:52:57.466481] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T20:52:57.564281] [INFO ] [REMOTE ] PUMP: Full fetch complete (71598 records). [2025-09-22T20:52:57.586149] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-22T20:52:57.789505] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-22T20:52:57.789685] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-22T20:52:57.789941] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-22T20:52:57.790020] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-22T20:52:57.796817] [DEBUG] [LOCAL ] PVL: Trimmed 7560 records to 4716 (keeping 200 days of data) [2025-09-22T20:52:57.989445] [DEBUG] [LOCAL ] PVL: Primary data saved (4716 records). [2025-09-22T20:52:58.005411] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-22T20:52:58.005580] [INFO ] [MAIN ] Update Progress: 1752/2372 symbols completed. PVL took 24.5s. Estimated remaining: 1h 22m 25s. Rate: 7.5 symbols/min [2025-09-22T20:52:58.125227] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-22T20:52:58.355298] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-22T20:52:58.354974] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:52:58.355553] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-22T20:52:58.357385] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-22T20:52:58.357871] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-22T20:52:58.361716] [DEBUG] [LOCAL ] PUMP: Trimmed 71598 records to 49447 (keeping 200 days of data) [2025-09-22T20:52:58.502362] [DEBUG] [LOCAL ] PX: Loaded 35302 existing records from primary storage. [2025-09-22T20:52:58.511092] [INFO ] [MAIN ] PX: Loaded 35302 existing records. [2025-09-22T20:52:58.897527] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:52:58.903345] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-22T20:52:58.904157] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-22T20:52:58.905551] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-22T20:52:58.906001] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-22T20:52:59.363162] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:52:59.366310] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-22T20:52:59.370403] [DEBUG] [LOCAL ] PUMP: Primary data saved (49447 records). [2025-09-22T20:52:59.371778] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-22T20:52:59.372105] [INFO ] [MAIN ] Update Progress: 1753/2372 symbols completed. PUMP took 34.6s. Estimated remaining: 1h 22m 15s. Rate: 7.5 symbols/min [2025-09-22T20:52:59.609011] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:52:59.607508] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-22T20:52:59.619721] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-09-22T20:52:59.620267] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-09-22T20:52:59.620809] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-22T20:52:59.620919] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-22T20:52:59.620983] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-22T20:52:59.621020] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-22T20:52:59.723495] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-22T20:53:00.010108] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:53:00.098696] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-22T20:53:00.522041] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-22T20:53:01.324238] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-22T20:53:01.326716] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-22T20:53:01.458764] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T20:53:01.987383] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T20:53:02.122109] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-22T20:53:02.922067] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-22T20:53:03.722098] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-22T20:53:04.104014] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T20:53:04.147982] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-22T20:53:04.374068] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T20:53:04.522111] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-22T20:53:05.303777] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T20:53:05.322017] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-22T20:53:06.002540] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T20:53:06.122010] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-22T20:53:06.922081] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-22T20:53:07.033932] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T20:53:07.042237] [INFO ] [REMOTE ] PVH: Full fetch complete (70756 records). [2025-09-22T20:53:07.042355] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-22T20:53:07.455927] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-22T20:53:07.456057] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-22T20:53:07.457112] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-22T20:53:07.457177] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-22T20:53:07.461472] [DEBUG] [LOCAL ] PVH: Trimmed 70756 records to 50466 (keeping 200 days of data) [2025-09-22T20:53:07.705466] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T20:53:07.723742] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-22T20:53:07.814297] [DEBUG] [LOCAL ] PVH: Primary data saved (50466 records). [2025-09-22T20:53:07.814454] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-22T20:53:07.814563] [INFO ] [MAIN ] Update Progress: 1754/2372 symbols completed. PVH took 38.7s. Estimated remaining: 1h 22m 7s. Rate: 7.5 symbols/min [2025-09-22T20:53:07.999392] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:53:08.027921] [DEBUG] [LOCAL ] QD: Loaded 28413 existing records from primary storage. [2025-09-22T20:53:08.028135] [INFO ] [MAIN ] QD: Loaded 28413 existing records. [2025-09-22T20:53:08.218411] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:53:08.218734] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-22T20:53:08.218809] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-22T20:53:08.219560] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-22T20:53:08.219632] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-22T20:53:08.527177] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-22T20:53:08.595913] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:53:09.250979] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T20:53:09.322055] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-22T20:53:09.474312] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-22T20:53:10.122054] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-22T20:53:10.193997] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T20:53:10.755761] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T20:53:10.922033] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-22T20:53:11.722065] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-22T20:53:12.519002] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T20:53:12.526938] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-22T20:53:12.704002] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-22T20:53:13.322064] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-22T20:53:13.695575] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T20:53:13.899770] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T20:53:14.122087] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-22T20:53:14.885145] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T20:53:14.922083] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-22T20:53:15.722101] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-22T20:53:15.948865] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T20:53:16.242827] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T20:53:16.522057] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-22T20:53:17.322082] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-22T20:53:17.727348] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T20:53:17.732347] [INFO ] [REMOTE ] PX: Full fetch complete (51173 records). [2025-09-22T20:53:17.732493] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-22T20:53:18.131924] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-22T20:53:18.134954] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-22T20:53:18.135988] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-22T20:53:18.137036] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-22T20:53:18.137207] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-22T20:53:18.138500] [DEBUG] [LOCAL ] PX: Trimmed 51173 records to 34678 (keeping 200 days of data) [2025-09-22T20:53:18.379632] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-22T20:53:18.408081] [DEBUG] [LOCAL ] PX: Primary data saved (34678 records). [2025-09-22T20:53:18.408255] [INFO ] [MAIN ] PX: Full history saved. [2025-09-22T20:53:18.408353] [INFO ] [MAIN ] Update Progress: 1755/2372 symbols completed. PX took 20.4s. Estimated remaining: 1h 22m 0s. Rate: 7.5 symbols/min [2025-09-22T20:53:18.582691] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:53:18.629713] [DEBUG] [LOCAL ] QGEN: Loaded 49909 existing records from primary storage. [2025-09-22T20:53:18.629902] [INFO ] [MAIN ] QGEN: Loaded 49909 existing records. [2025-09-22T20:53:18.819537] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:53:18.832225] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T20:53:18.839048] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-22T20:53:18.839222] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-22T20:53:18.839528] [INFO ] [REMOTE ] PWR: Full fetch complete (69001 records). [2025-09-22T20:53:18.839616] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-22T20:53:18.840337] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-22T20:53:18.887667] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-22T20:53:18.925733] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-22T20:53:19.530920] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T20:53:19.610238] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-22T20:53:19.639052] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-22T20:53:19.640697] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-22T20:53:19.650591] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-22T20:53:19.658973] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:53:19.662176] [DEBUG] [LOCAL ] PWR: Trimmed 69001 records to 47457 (keeping 200 days of data) [2025-09-22T20:53:19.723713] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-22T20:53:20.005441] [DEBUG] [LOCAL ] PWR: Primary data saved (47457 records). [2025-09-22T20:53:20.005767] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-22T20:53:20.006010] [INFO ] [MAIN ] Update Progress: 1756/2372 symbols completed. PWR took 34.8s. Estimated remaining: 1h 21m 50s. Rate: 7.5 symbols/min [2025-09-22T20:53:20.194605] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:53:20.255112] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-22T20:53:20.255286] [INFO ] [MAIN ] QS: Loaded 54522 existing records. [2025-09-22T20:53:20.446859] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:53:20.447130] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-22T20:53:20.447178] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-22T20:53:20.448208] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-22T20:53:20.448267] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-22T20:53:20.527240] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-22T20:53:20.830264] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:53:20.966258] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T20:53:21.322012] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-22T20:53:21.894708] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-09-22T20:53:22.122088] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-22T20:53:22.342035] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T20:53:22.922059] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-22T20:53:23.436422] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T20:53:23.652044] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-22T20:53:23.722055] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-22T20:53:24.522137] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-22T20:53:24.698515] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T20:53:25.322089] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-22T20:53:25.899758] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-22T20:53:26.083938] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-22T20:53:26.122038] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-22T20:53:26.922060] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-22T20:53:27.722027] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-22T20:53:28.082832] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-22T20:53:28.135308] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T20:53:28.424212] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-22T20:53:28.522060] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-22T20:53:29.129846] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T20:53:29.322067] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-22T20:53:30.122128] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-22T20:53:30.804711] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-22T20:53:30.922040] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-22T20:53:31.722032] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-22T20:53:31.990699] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T20:53:32.097148] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-22T20:53:32.494371] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T20:53:32.522024] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-22T20:53:32.951471] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-22T20:53:33.322096] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-22T20:53:34.028359] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T20:53:34.122014] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-22T20:53:34.922060] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-22T20:53:35.455341] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-22T20:53:35.487227] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T20:53:35.722060] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-22T20:53:36.522100] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-22T20:53:36.871397] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T20:53:36.876354] [INFO ] [REMOTE ] QD: Full fetch complete (40786 records). [2025-09-22T20:53:36.876479] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-22T20:53:37.276307] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-22T20:53:37.276454] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-22T20:53:37.277810] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-22T20:53:37.277908] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-22T20:53:37.278875] [DEBUG] [LOCAL ] QD: Trimmed 40786 records to 28012 (keeping 200 days of data) [2025-09-22T20:53:37.332212] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-22T20:53:37.450757] [DEBUG] [LOCAL ] QD: Primary data saved (28012 records). [2025-09-22T20:53:37.450986] [INFO ] [MAIN ] QD: Full history saved. [2025-09-22T20:53:37.451192] [INFO ] [MAIN ] Update Progress: 1757/2372 symbols completed. QD took 29.6s. Estimated remaining: 1h 21m 45s. Rate: 7.5 symbols/min [2025-09-22T20:53:37.873912] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-09-22T20:53:38.122111] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-22T20:53:38.481388] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T20:53:38.922046] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-22T20:53:39.187415] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T20:53:39.722078] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-22T20:53:40.798354] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-22T20:53:40.810638] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-22T20:53:41.071181] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T20:53:41.322075] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-22T20:53:41.653575] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-22T20:53:42.122087] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-22T20:53:43.146908] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T20:53:43.157925] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-22T20:53:43.345732] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-22T20:53:43.355467] [INFO ] [REMOTE ] QBTS: Full fetch complete (77923 records). [2025-09-22T20:53:43.355629] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-22T20:53:43.757809] [DEBUG] [VALIDATOR ] QBTS: All expected trading days are present. [2025-09-22T20:53:43.757895] [DEBUG] [VALIDATOR ] QBTS: Primary data validation passed. [2025-09-22T20:53:43.759160] [INFO ] [MAIN ] QBTS: Fetched primary data is valid. [2025-09-22T20:53:43.759225] [DEBUG] [LOCAL ] QBTS: Saving primary data. [2025-09-22T20:53:43.760886] [DEBUG] [LOCAL ] QBTS: Trimmed 77923 records to 53746 (keeping 200 days of data) [2025-09-22T20:53:44.107815] [DEBUG] [LOCAL ] QBTS: Primary data saved (53746 records). [2025-09-22T20:53:44.107977] [INFO ] [MAIN ] QBTS: Full history saved. [2025-09-22T20:53:44.108057] [INFO ] [MAIN ] Update Progress: 1758/2372 symbols completed. QBTS took 44.7s. Estimated remaining: 1h 21m 37s. Rate: 7.5 symbols/min [2025-09-22T20:53:44.639500] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-22T20:53:44.652016] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-22T20:53:44.960511] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-22T20:53:44.973063] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-22T20:53:46.698470] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-22T20:53:46.709094] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-22T20:53:47.071805] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-22T20:53:47.080426] [INFO ] [REMOTE ] QS: Full fetch complete (77883 records). [2025-09-22T20:53:47.080593] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-22T20:53:47.506485] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-22T20:53:47.506567] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-22T20:53:47.507839] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-22T20:53:47.507920] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-22T20:53:47.512377] [DEBUG] [LOCAL ] QS: Trimmed 77883 records to 53742 (keeping 200 days of data) [2025-09-22T20:53:47.844476] [DEBUG] [LOCAL ] QS: Primary data saved (53742 records). [2025-09-22T20:53:47.844626] [INFO ] [MAIN ] QS: Full history saved. [2025-09-22T20:53:47.844824] [INFO ] [MAIN ] Update Progress: 1759/2372 symbols completed. QS took 27.8s. Estimated remaining: 1h 21m 27s. Rate: 7.5 symbols/min [2025-09-22T20:53:48.295439] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T20:53:48.303083] [INFO ] [REMOTE ] QGEN: Full fetch complete (69967 records). [2025-09-22T20:53:48.303223] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-22T20:53:48.705867] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-22T20:53:48.705962] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-22T20:53:48.707208] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-22T20:53:48.707284] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-22T20:53:48.708836] [DEBUG] [LOCAL ] QGEN: Trimmed 69967 records to 49200 (keeping 200 days of data) [2025-09-22T20:53:49.027926] [DEBUG] [LOCAL ] QGEN: Primary data saved (49200 records). [2025-09-22T20:53:49.028089] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-22T20:53:49.028374] [INFO ] [MAIN ] Update Progress: 1760/2372 symbols completed. QGEN took 30.6s. Estimated remaining: 1h 21m 17s. Rate: 7.5 symbols/min [2025-09-22T20:53:49.705476] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:53:49.681405] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:53:49.798499] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:53:49.799608] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:53:49.818053] [DEBUG] [LOCAL ] QVCC: Loaded 9212 existing records from primary storage. [2025-09-22T20:53:49.818204] [INFO ] [MAIN ] QVCC: Loaded 9212 existing records. [2025-09-22T20:53:49.964245] [DEBUG] [LOCAL ] QUAD: Loaded 24482 existing records from primary storage. [2025-09-22T20:53:49.985278] [INFO ] [MAIN ] QUAD: Loaded 24482 existing records. [2025-09-22T20:53:50.094066] [DEBUG] [LOCAL ] QTWO: Loaded 39758 existing records from primary storage. [2025-09-22T20:53:50.136583] [INFO ] [MAIN ] QTWO: Loaded 39758 existing records. [2025-09-22T20:53:50.148010] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:53:50.254141] [DEBUG] [LOCAL ] QSR: Loaded 53169 existing records from primary storage. [2025-09-22T20:53:50.218171] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-22T20:53:50.278530] [INFO ] [MAIN ] QSR: Loaded 53169 existing records. [2025-09-22T20:53:50.296680] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-22T20:53:50.359050] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-22T20:53:50.381047] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-22T20:53:50.419356] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:53:50.500505] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-22T20:53:50.500624] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-22T20:53:50.558819] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-22T20:53:50.594471] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-22T20:53:50.850444] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:53:50.917930] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-22T20:53:50.933814] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-22T20:53:50.944212] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:53:51.006895] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-22T20:53:51.017434] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-22T20:53:51.017548] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-22T20:53:51.027840] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-22T20:53:51.129359] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-22T20:53:51.134756] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-22T20:53:51.481135] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:53:51.490178] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-22T20:53:52.088483] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:53:52.136210] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:53:52.141801] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:53:52.142161] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-22T20:53:52.142434] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-22T20:53:52.143660] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-22T20:53:52.529452] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T20:53:52.532191] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-22T20:53:53.133336] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T20:53:53.135387] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-22T20:53:53.349068] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-22T20:53:53.354962] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-22T20:53:53.492194] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-22T20:53:53.500448] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-22T20:53:53.598332] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T20:53:53.608981] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-22T20:53:53.748892] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T20:53:53.750384] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-22T20:53:54.523350] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T20:53:54.528094] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-22T20:53:54.663428] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T20:53:54.896722] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T20:53:54.922007] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-22T20:53:55.172444] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T20:53:55.345909] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T20:53:55.722054] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-22T20:53:56.152135] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T20:53:56.522051] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-22T20:53:56.904211] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-22T20:53:57.322040] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-22T20:53:57.338860] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T20:53:58.122059] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-22T20:53:58.932615] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-22T20:53:58.938083] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T20:53:59.722035] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-22T20:53:59.828124] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T20:54:00.424482] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T20:54:00.522059] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-22T20:54:01.322159] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-22T20:54:01.430586] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T20:54:01.899875] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T20:54:02.122078] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-22T20:54:02.293353] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T20:54:02.922083] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-22T20:54:03.650164] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T20:54:03.722009] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-22T20:54:04.112529] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-22T20:54:04.522057] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-22T20:54:05.223548] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T20:54:05.304286] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T20:54:05.322010] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-22T20:54:06.122132] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-22T20:54:06.922127] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-22T20:54:07.722086] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-22T20:54:08.141660] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-09-22T20:54:08.292971] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-22T20:54:08.522037] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-22T20:54:09.322049] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-22T20:54:09.422004] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-22T20:54:09.491081] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-22T20:54:09.553329] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T20:54:10.122067] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-22T20:54:10.922153] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-22T20:54:11.458233] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T20:54:11.722118] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-22T20:54:11.965639] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-22T20:54:12.447585] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T20:54:12.449452] [INFO ] [REMOTE ] QVCC: Full fetch complete (11977 records). [2025-09-22T20:54:12.449526] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-22T20:54:12.525753] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-22T20:54:12.860088] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-22T20:54:12.862703] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-22T20:54:12.863092] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-22T20:54:12.863184] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-22T20:54:12.865305] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T20:54:12.873769] [DEBUG] [LOCAL ] QVCC: Trimmed 11977 records to 9000 (keeping 200 days of data) [2025-09-22T20:54:12.929669] [DEBUG] [LOCAL ] QVCC: Primary data saved (9000 records). [2025-09-22T20:54:12.929815] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-22T20:54:12.929900] [INFO ] [MAIN ] Update Progress: 1761/2372 symbols completed. QVCC took 23.9s. Estimated remaining: 1h 21m 15s. Rate: 7.5 symbols/min [2025-09-22T20:54:13.099552] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:54:13.106134] [DEBUG] [LOCAL ] QVCD: Loaded 4688 existing records from primary storage. [2025-09-22T20:54:13.106225] [INFO ] [MAIN ] QVCD: Loaded 4688 existing records. [2025-09-22T20:54:13.284559] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:54:13.284906] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-22T20:54:13.284954] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-22T20:54:13.285444] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-22T20:54:13.285504] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-22T20:54:13.328592] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-22T20:54:13.654213] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:54:13.663112] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T20:54:13.666539] [INFO ] [REMOTE ] QUAD: Full fetch complete (35064 records). [2025-09-22T20:54:13.666615] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-22T20:54:14.041115] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-22T20:54:14.041192] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-22T20:54:14.041895] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-22T20:54:14.041956] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-22T20:54:14.042781] [DEBUG] [LOCAL ] QUAD: Trimmed 35064 records to 23909 (keeping 200 days of data) [2025-09-22T20:54:14.128558] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-22T20:54:14.185891] [DEBUG] [LOCAL ] QUAD: Primary data saved (23909 records). [2025-09-22T20:54:14.186090] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-22T20:54:14.186182] [INFO ] [MAIN ] Update Progress: 1762/2372 symbols completed. QUAD took 25.2s. Estimated remaining: 1h 21m 4s. Rate: 7.5 symbols/min [2025-09-22T20:54:14.357108] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:54:14.413205] [DEBUG] [LOCAL ] QXO: Loaded 53922 existing records from primary storage. [2025-09-22T20:54:14.413383] [INFO ] [MAIN ] QXO: Loaded 53922 existing records. [2025-09-22T20:54:14.595346] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:54:14.595629] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-22T20:54:14.595719] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-22T20:54:14.597612] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-22T20:54:14.597698] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-22T20:54:14.931808] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-22T20:54:14.960549] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:54:14.971561] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T20:54:15.253294] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-22T20:54:15.722092] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-22T20:54:16.365223] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T20:54:16.522135] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-22T20:54:16.659272] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T20:54:16.666757] [INFO ] [REMOTE ] QTWO: Full fetch complete (57206 records). [2025-09-22T20:54:16.666879] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-22T20:54:17.055927] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-22T20:54:17.056014] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-22T20:54:17.057087] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-22T20:54:17.057154] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-22T20:54:17.058411] [DEBUG] [LOCAL ] QTWO: Trimmed 57206 records to 39065 (keeping 200 days of data) [2025-09-22T20:54:17.290563] [DEBUG] [LOCAL ] QTWO: Primary data saved (39065 records). [2025-09-22T20:54:17.290738] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-22T20:54:17.290837] [INFO ] [MAIN ] Update Progress: 1763/2372 symbols completed. QTWO took 28.3s. Estimated remaining: 1h 20m 55s. Rate: 7.5 symbols/min [2025-09-22T20:54:17.327269] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-22T20:54:17.475585] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:54:17.512593] [DEBUG] [LOCAL ] R: Loaded 30258 existing records from primary storage. [2025-09-22T20:54:17.512781] [INFO ] [MAIN ] R: Loaded 30258 existing records. [2025-09-22T20:54:17.687852] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:54:17.688083] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-22T20:54:17.688157] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-22T20:54:17.689385] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-22T20:54:17.689446] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-22T20:54:18.040961] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:54:18.122002] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-22T20:54:18.319825] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T20:54:18.922066] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-22T20:54:19.156873] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T20:54:19.296859] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T20:54:19.722063] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-22T20:54:20.522030] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-22T20:54:20.750701] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T20:54:21.322029] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-22T20:54:21.351594] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T20:54:21.535874] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T20:54:22.122059] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-22T20:54:22.922041] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-22T20:54:23.185004] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T20:54:23.391537] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-22T20:54:23.727158] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-22T20:54:23.738736] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T20:54:24.522056] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-22T20:54:25.322039] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-22T20:54:25.387470] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T20:54:25.396886] [INFO ] [REMOTE ] QSR: Full fetch complete (75802 records). [2025-09-22T20:54:25.397047] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-22T20:54:25.811136] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-22T20:54:25.811224] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-22T20:54:25.812318] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-22T20:54:25.812394] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-22T20:54:25.816064] [DEBUG] [LOCAL ] QSR: Trimmed 75802 records to 52408 (keeping 200 days of data) [2025-09-22T20:54:26.127079] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-22T20:54:26.161412] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T20:54:26.196701] [DEBUG] [LOCAL ] QSR: Primary data saved (52408 records). [2025-09-22T20:54:26.196892] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-22T20:54:26.197024] [INFO ] [MAIN ] Update Progress: 1764/2372 symbols completed. QSR took 37.2s. Estimated remaining: 1h 20m 47s. Rate: 7.5 symbols/min [2025-09-22T20:54:26.383558] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:54:26.406504] [DEBUG] [LOCAL ] RA: Loaded 22056 existing records from primary storage. [2025-09-22T20:54:26.406668] [INFO ] [MAIN ] RA: Loaded 22056 existing records. [2025-09-22T20:54:26.592012] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:54:26.592278] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-22T20:54:26.592327] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-22T20:54:26.593227] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-22T20:54:26.593289] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-22T20:54:26.825241] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-22T20:54:26.938879] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-22T20:54:26.982598] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:54:27.009534] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T20:54:27.722096] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-22T20:54:28.469683] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T20:54:28.522005] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-22T20:54:28.578913] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T20:54:29.259823] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-22T20:54:29.322052] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-22T20:54:29.926844] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T20:54:30.122105] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-22T20:54:30.922073] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-22T20:54:31.722086] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-22T20:54:32.522121] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-22T20:54:32.866773] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-22T20:54:32.897501] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T20:54:33.322065] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-22T20:54:33.484191] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T20:54:34.122068] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-22T20:54:34.922088] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-22T20:54:35.226240] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-09-22T20:54:35.245293] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T20:54:35.283319] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T20:54:35.722055] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-22T20:54:36.265321] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-22T20:54:36.266416] [INFO ] [REMOTE ] QVCD: Full fetch complete (6153 records). [2025-09-22T20:54:36.266484] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-22T20:54:36.522542] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-22T20:54:36.651521] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-22T20:54:36.651605] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-22T20:54:36.651919] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-22T20:54:36.652039] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-22T20:54:36.652605] [DEBUG] [LOCAL ] QVCD: Trimmed 6153 records to 4556 (keeping 200 days of data) [2025-09-22T20:54:36.682175] [DEBUG] [LOCAL ] QVCD: Primary data saved (4556 records). [2025-09-22T20:54:36.682322] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-22T20:54:36.682413] [INFO ] [MAIN ] Update Progress: 1765/2372 symbols completed. QVCD took 23.8s. Estimated remaining: 1h 20m 40s. Rate: 7.5 symbols/min [2025-09-22T20:54:36.866879] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:54:36.904906] [DEBUG] [LOCAL ] RACE: Loaded 33652 existing records from primary storage. [2025-09-22T20:54:36.905149] [INFO ] [MAIN ] RACE: Loaded 33652 existing records. [2025-09-22T20:54:37.091729] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-22T20:54:37.135125] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:54:37.135419] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-22T20:54:37.135470] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-22T20:54:37.136684] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-22T20:54:37.136768] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-22T20:54:37.328181] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-22T20:54:37.498558] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:54:38.005928] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T20:54:38.122030] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-22T20:54:38.638356] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T20:54:38.922008] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-22T20:54:39.029375] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-22T20:54:39.722062] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-22T20:54:39.826922] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T20:54:40.522101] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-22T20:54:41.322029] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-22T20:54:41.650681] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T20:54:41.695282] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T20:54:41.699301] [INFO ] [REMOTE ] R: Full fetch complete (41929 records). [2025-09-22T20:54:41.699397] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-22T20:54:42.085072] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-22T20:54:42.085171] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-22T20:54:42.086256] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-22T20:54:42.086324] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-22T20:54:42.087356] [DEBUG] [LOCAL ] R: Trimmed 41929 records to 29636 (keeping 200 days of data) [2025-09-22T20:54:42.144009] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-22T20:54:42.215126] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T20:54:42.307266] [DEBUG] [LOCAL ] R: Primary data saved (29636 records). [2025-09-22T20:54:42.307424] [INFO ] [MAIN ] R: Full history saved. [2025-09-22T20:54:42.307511] [INFO ] [MAIN ] Update Progress: 1766/2372 symbols completed. R took 25.0s. Estimated remaining: 1h 20m 31s. Rate: 7.5 symbols/min [2025-09-22T20:54:42.477084] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:54:42.513636] [DEBUG] [LOCAL ] RAMP: Loaded 38311 existing records from primary storage. [2025-09-22T20:54:42.513806] [INFO ] [MAIN ] RAMP: Loaded 38311 existing records. [2025-09-22T20:54:42.699083] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:54:42.699366] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-22T20:54:42.699416] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-22T20:54:42.700542] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-22T20:54:42.700603] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-22T20:54:42.930116] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-22T20:54:43.082581] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:54:43.705628] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T20:54:43.722001] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-22T20:54:44.250876] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T20:54:44.522061] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-22T20:54:45.322038] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-22T20:54:45.354889] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T20:54:46.122094] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-22T20:54:46.314977] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T20:54:46.628278] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-22T20:54:46.922066] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-22T20:54:47.515615] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T20:54:47.722086] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-22T20:54:48.522093] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-22T20:54:48.666495] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T20:54:48.771418] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T20:54:49.322058] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-22T20:54:50.122062] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-22T20:54:50.487387] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T20:54:50.789343] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T20:54:50.922080] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-22T20:54:51.722072] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-22T20:54:51.758592] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T20:54:52.522139] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-22T20:54:52.860551] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T20:54:53.322055] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-22T20:54:53.453430] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T20:54:53.770049] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T20:54:54.122086] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-22T20:54:54.617591] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T20:54:54.922060] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-22T20:54:55.722056] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-22T20:54:55.993598] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T20:54:56.002762] [INFO ] [REMOTE ] QXO: Full fetch complete (75439 records). [2025-09-22T20:54:56.002959] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-22T20:54:56.407899] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-22T20:54:56.407999] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-22T20:54:56.409261] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-22T20:54:56.409328] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-22T20:54:56.410912] [DEBUG] [LOCAL ] QXO: Trimmed 75439 records to 53160 (keeping 200 days of data) [2025-09-22T20:54:56.522131] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-22T20:54:56.650628] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T20:54:56.763963] [DEBUG] [LOCAL ] QXO: Primary data saved (53160 records). [2025-09-22T20:54:56.764117] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-22T20:54:56.764207] [INFO ] [MAIN ] Update Progress: 1767/2372 symbols completed. QXO took 42.6s. Estimated remaining: 1h 20m 25s. Rate: 7.5 symbols/min [2025-09-22T20:54:56.968424] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:54:57.016168] [DEBUG] [LOCAL ] RBA: Loaded 46765 existing records from primary storage. [2025-09-22T20:54:57.016364] [INFO ] [MAIN ] RBA: Loaded 46765 existing records. [2025-09-22T20:54:57.210857] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:54:57.211301] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-22T20:54:57.211383] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-22T20:54:57.220744] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-22T20:54:57.235126] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-22T20:54:57.303462] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T20:54:57.323524] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-22T20:54:57.652605] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:54:57.983865] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T20:54:58.122051] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-22T20:54:58.922066] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-22T20:54:58.951716] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T20:54:59.352014] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T20:54:59.722090] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-22T20:55:00.061770] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T20:55:00.522067] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-22T20:55:00.843907] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T20:55:00.848886] [INFO ] [REMOTE ] RA: Full fetch complete (31885 records). [2025-09-22T20:55:00.849126] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-22T20:55:01.327134] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-22T20:55:01.420939] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-22T20:55:01.421037] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-22T20:55:01.421801] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-22T20:55:01.421866] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-22T20:55:01.422912] [DEBUG] [LOCAL ] RA: Trimmed 31885 records to 21611 (keeping 200 days of data) [2025-09-22T20:55:01.568839] [DEBUG] [LOCAL ] RA: Primary data saved (21611 records). [2025-09-22T20:55:01.569001] [INFO ] [MAIN ] RA: Full history saved. [2025-09-22T20:55:01.569100] [INFO ] [MAIN ] Update Progress: 1768/2372 symbols completed. RA took 35.4s. Estimated remaining: 1h 20m 16s. Rate: 7.5 symbols/min [2025-09-22T20:55:01.775829] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:55:01.794288] [DEBUG] [LOCAL ] RBC: Loaded 15224 existing records from primary storage. [2025-09-22T20:55:01.794456] [INFO ] [MAIN ] RBC: Loaded 15224 existing records. [2025-09-22T20:55:02.008516] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:55:02.008944] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-22T20:55:02.009016] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-22T20:55:02.009695] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-22T20:55:02.009760] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-22T20:55:02.122276] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-22T20:55:02.424228] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:55:02.455468] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-22T20:55:02.922095] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-22T20:55:03.093229] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T20:55:03.722044] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-22T20:55:03.942933] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T20:55:04.158714] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T20:55:04.522087] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-22T20:55:05.048405] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-22T20:55:05.322074] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-22T20:55:05.604311] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T20:55:06.122054] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-22T20:55:06.781304] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T20:55:06.787369] [INFO ] [REMOTE ] RACE: Full fetch complete (47632 records). [2025-09-22T20:55:06.787514] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-22T20:55:06.927092] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-22T20:55:07.194312] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-22T20:55:07.194395] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-22T20:55:07.195467] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-22T20:55:07.195535] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-22T20:55:07.196717] [DEBUG] [LOCAL ] RACE: Trimmed 47632 records to 32934 (keeping 200 days of data) [2025-09-22T20:55:07.304331] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T20:55:07.417101] [DEBUG] [LOCAL ] RACE: Primary data saved (32934 records). [2025-09-22T20:55:07.417241] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-22T20:55:07.417326] [INFO ] [MAIN ] Update Progress: 1769/2372 symbols completed. RACE took 30.7s. Estimated remaining: 1h 20m 8s. Rate: 7.5 symbols/min [2025-09-22T20:55:07.589897] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:55:07.644891] [DEBUG] [LOCAL ] RBLX: Loaded 54502 existing records from primary storage. [2025-09-22T20:55:07.645041] [INFO ] [MAIN ] RBLX: Loaded 54502 existing records. [2025-09-22T20:55:07.727128] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-22T20:55:07.835006] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:55:07.835328] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-22T20:55:07.835388] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-22T20:55:07.836804] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-22T20:55:07.836867] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-22T20:55:08.211936] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:55:08.392235] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T20:55:08.522025] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-22T20:55:08.900395] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-22T20:55:09.322091] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-22T20:55:09.907521] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T20:55:10.122079] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-22T20:55:10.922076] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-22T20:55:11.678695] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T20:55:11.724199] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-22T20:55:11.732107] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-22T20:55:12.301218] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T20:55:12.488368] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-22T20:55:12.522071] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-22T20:55:13.322067] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-22T20:55:14.122096] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-22T20:55:14.671569] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T20:55:14.678473] [INFO ] [REMOTE ] RAMP: Full fetch complete (53122 records). [2025-09-22T20:55:14.678727] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-22T20:55:14.934983] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-22T20:55:15.013474] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-22T20:55:15.128287] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-22T20:55:15.128370] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-22T20:55:15.129352] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-22T20:55:15.129416] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-22T20:55:15.130595] [DEBUG] [LOCAL ] RAMP: Trimmed 53122 records to 37700 (keeping 200 days of data) [2025-09-22T20:55:15.247570] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T20:55:15.368818] [DEBUG] [LOCAL ] RAMP: Primary data saved (37700 records). [2025-09-22T20:55:15.368962] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-22T20:55:15.369048] [INFO ] [MAIN ] Update Progress: 1770/2372 symbols completed. RAMP took 33.1s. Estimated remaining: 1h 19m 60s. Rate: 7.5 symbols/min [2025-09-22T20:55:15.536907] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:55:15.543942] [DEBUG] [LOCAL ] RBOT: Loaded 5197 existing records from primary storage. [2025-09-22T20:55:15.544026] [INFO ] [MAIN ] RBOT: Loaded 5197 existing records. [2025-09-22T20:55:15.724967] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-22T20:55:15.729014] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:55:15.729455] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-22T20:55:15.730492] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-22T20:55:15.730883] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-22T20:55:15.730947] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-22T20:55:16.098554] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:55:16.522032] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-22T20:55:16.708296] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T20:55:17.322061] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-22T20:55:17.755100] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T20:55:17.999500] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-22T20:55:18.122052] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-22T20:55:18.927160] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-22T20:55:18.939553] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T20:55:19.722047] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-22T20:55:19.943673] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T20:55:20.019932] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T20:55:20.522050] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-22T20:55:21.253459] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T20:55:21.322018] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-22T20:55:21.625639] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T20:55:22.122069] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-22T20:55:22.922035] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-22T20:55:23.001879] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T20:55:23.722057] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-22T20:55:23.813434] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T20:55:23.816419] [INFO ] [REMOTE ] RBC: Full fetch complete (21945 records). [2025-09-22T20:55:23.816531] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-22T20:55:24.196415] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-22T20:55:24.196587] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-22T20:55:24.197151] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-22T20:55:24.197232] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-22T20:55:24.198163] [DEBUG] [LOCAL ] RBC: Trimmed 21945 records to 15130 (keeping 200 days of data) [2025-09-22T20:55:24.300310] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-22T20:55:24.339020] [DEBUG] [LOCAL ] RBC: Primary data saved (15130 records). [2025-09-22T20:55:24.339142] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-22T20:55:24.339221] [INFO ] [MAIN ] Update Progress: 1771/2372 symbols completed. RBC took 22.8s. Estimated remaining: 1h 19m 52s. Rate: 7.5 symbols/min [2025-09-22T20:55:24.520053] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:55:24.522009] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-22T20:55:24.562153] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T20:55:24.587156] [DEBUG] [LOCAL ] RBRK: Loaded 53851 existing records from primary storage. [2025-09-22T20:55:24.587320] [INFO ] [MAIN ] RBRK: Loaded 53851 existing records. [2025-09-22T20:55:24.770493] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:55:24.770801] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-22T20:55:24.770852] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-22T20:55:24.772044] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-22T20:55:24.772105] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-22T20:55:25.138354] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:55:25.322062] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-22T20:55:26.089229] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-22T20:55:26.122012] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-22T20:55:26.234611] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T20:55:26.889625] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T20:55:26.922023] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-22T20:55:27.722123] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-22T20:55:28.406576] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-22T20:55:28.522057] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-22T20:55:29.249997] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-22T20:55:29.251943] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-22T20:55:29.322008] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-22T20:55:30.122076] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-22T20:55:30.922062] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-22T20:55:31.667828] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-22T20:55:31.722005] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-22T20:55:32.272385] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-22T20:55:32.514927] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T20:55:32.523681] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-22T20:55:33.322076] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-22T20:55:33.867101] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-22T20:55:34.122022] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-22T20:55:34.443314] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-22T20:55:34.491272] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-22T20:55:34.651851] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-22T20:55:34.922053] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-22T20:55:35.722106] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-22T20:55:36.522167] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-22T20:55:36.667978] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T20:55:37.322038] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-22T20:55:37.382016] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T20:55:37.384188] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T20:55:37.395003] [INFO ] [REMOTE ] RBA: Full fetch complete (65294 records). [2025-09-22T20:55:37.395153] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-22T20:55:37.801321] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-22T20:55:37.801408] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-22T20:55:37.802436] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-22T20:55:37.802501] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-22T20:55:37.804792] [DEBUG] [LOCAL ] RBA: Trimmed 65294 records to 46015 (keeping 200 days of data) [2025-09-22T20:55:38.116673] [DEBUG] [LOCAL ] RBA: Primary data saved (46015 records). [2025-09-22T20:55:38.116874] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-22T20:55:38.117162] [INFO ] [MAIN ] Update Progress: 1772/2372 symbols completed. RBA took 41.4s. Estimated remaining: 1h 19m 46s. Rate: 7.5 symbols/min [2025-09-22T20:55:38.131042] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-22T20:55:38.297423] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:55:38.347383] [DEBUG] [LOCAL ] RC: Loaded 49839 existing records from primary storage. [2025-09-22T20:55:38.347532] [INFO ] [MAIN ] RC: Loaded 49839 existing records. [2025-09-22T20:55:38.525210] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:55:38.525490] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-22T20:55:38.525538] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-22T20:55:38.527228] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-22T20:55:38.527291] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-22T20:55:38.907911] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:55:38.922061] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-22T20:55:39.005120] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T20:55:39.293979] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-22T20:55:39.722095] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-22T20:55:40.522059] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-22T20:55:40.551487] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T20:55:40.553565] [INFO ] [REMOTE ] RBOT: Full fetch complete (8694 records). [2025-09-22T20:55:40.553743] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-22T20:55:40.962565] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-22T20:55:40.962677] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-22T20:55:40.962981] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-22T20:55:40.963072] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-22T20:55:40.963589] [DEBUG] [LOCAL ] RBOT: Trimmed 8694 records to 5044 (keeping 200 days of data) [2025-09-22T20:55:40.996330] [DEBUG] [LOCAL ] RBOT: Primary data saved (5044 records). [2025-09-22T20:55:40.996449] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-22T20:55:40.996561] [INFO ] [MAIN ] Update Progress: 1773/2372 symbols completed. RBOT took 25.6s. Estimated remaining: 1h 19m 36s. Rate: 7.5 symbols/min [2025-09-22T20:55:41.186830] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:55:41.187029] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-22T20:55:41.187086] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-22T20:55:41.187297] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-22T20:55:41.187357] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-22T20:55:41.187440] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-22T20:55:41.187488] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-22T20:55:41.327242] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-22T20:55:41.613968] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:55:41.652546] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-22T20:55:41.936005] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T20:55:42.122053] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-22T20:55:42.598737] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-22T20:55:42.922056] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-22T20:55:43.362288] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-22T20:55:43.722068] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-22T20:55:44.522071] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-22T20:55:44.582908] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T20:55:45.033805] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-22T20:55:45.322023] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-22T20:55:45.627602] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T20:55:45.769746] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-22T20:55:46.122071] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-22T20:55:46.791601] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-22T20:55:46.922060] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-22T20:55:47.539143] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-22T20:55:47.722066] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-22T20:55:48.522112] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-22T20:55:49.322022] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-22T20:55:49.348322] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T20:55:49.992321] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-22T20:55:50.122032] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-22T20:55:50.184451] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T20:55:50.614480] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-22T20:55:50.922091] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-22T20:55:51.722055] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-22T20:55:52.522062] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-22T20:55:53.236459] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-22T20:55:53.245747] [INFO ] [REMOTE ] RBLX: Full fetch complete (77784 records). [2025-09-22T20:55:53.245891] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-22T20:55:53.328323] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-22T20:55:53.681973] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-22T20:55:53.682071] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-22T20:55:53.683402] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-22T20:55:53.683489] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-22T20:55:53.686738] [DEBUG] [LOCAL ] RBLX: Trimmed 77784 records to 53721 (keeping 200 days of data) [2025-09-22T20:55:53.866005] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-22T20:55:53.863927] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-22T20:55:54.120636] [DEBUG] [LOCAL ] RBLX: Primary data saved (53721 records). [2025-09-22T20:55:54.120837] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-22T20:55:54.121035] [INFO ] [MAIN ] Update Progress: 1774/2372 symbols completed. RBLX took 46.7s. Estimated remaining: 1h 19m 30s. Rate: 7.5 symbols/min [2025-09-22T20:55:54.127094] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-22T20:55:54.307054] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:55:54.307397] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-22T20:55:54.307662] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-22T20:55:54.308162] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-22T20:55:54.308218] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-22T20:55:54.308261] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-22T20:55:54.308303] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-22T20:55:54.635832] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-22T20:55:54.729046] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:55:54.886307] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T20:55:54.922060] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-22T20:55:55.722087] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-22T20:55:56.486545] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T20:55:56.522056] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-22T20:55:57.001310] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-22T20:55:57.195731] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-22T20:55:57.322047] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-22T20:55:57.854141] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-22T20:55:58.122051] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-22T20:55:58.505902] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-22T20:55:58.506682] [INFO ] [REMOTE ] RCB: Full fetch complete (3759 records). [2025-09-22T20:55:58.506751] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-22T20:55:58.698016] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T20:55:58.698522] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:55:58.698622] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:55:58.698819] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-22T20:55:58.698908] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-22T20:55:58.698977] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-22T20:55:58.699060] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-22T20:55:58.699221] [INFO ] [MAIN ] Update Progress: 1775/2372 symbols completed. RCB took 17.7s. Estimated remaining: 1h 19m 21s. Rate: 7.5 symbols/min [2025-09-22T20:55:58.868786] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:55:58.934370] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-22T20:55:58.939333] [DEBUG] [LOCAL ] RCI: Loaded 49535 existing records from primary storage. [2025-09-22T20:55:58.939438] [INFO ] [MAIN ] RCI: Loaded 49535 existing records. [2025-09-22T20:55:59.185443] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:55:59.185720] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-22T20:55:59.185776] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-22T20:55:59.187527] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-22T20:55:59.187587] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-22T20:55:59.550673] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:55:59.722057] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-22T20:56:00.522082] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-22T20:56:01.192371] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-22T20:56:01.202223] [INFO ] [REMOTE ] RBRK: Full fetch complete (76489 records). [2025-09-22T20:56:01.202387] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-22T20:56:01.325117] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-22T20:56:01.623485] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-22T20:56:01.623713] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-22T20:56:01.624987] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-22T20:56:01.625107] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-22T20:56:01.626778] [DEBUG] [LOCAL ] RBRK: Trimmed 76489 records to 53104 (keeping 200 days of data) [2025-09-22T20:56:01.657006] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-22T20:56:01.986886] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-22T20:56:02.015539] [DEBUG] [LOCAL ] RBRK: Primary data saved (53104 records). [2025-09-22T20:56:02.015723] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-22T20:56:02.015827] [INFO ] [MAIN ] Update Progress: 1776/2372 symbols completed. RBRK took 37.7s. Estimated remaining: 1h 19m 11s. Rate: 7.5 symbols/min [2025-09-22T20:56:02.126923] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-22T20:56:02.238853] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T20:56:02.240587] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:56:02.251892] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-09-22T20:56:02.252414] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-09-22T20:56:02.252724] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-22T20:56:02.252783] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-22T20:56:02.252832] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-22T20:56:02.252934] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-22T20:56:02.619142] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:56:02.623995] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T20:56:02.922065] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-22T20:56:03.722084] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-22T20:56:04.522066] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-22T20:56:04.578367] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T20:56:05.322061] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-22T20:56:05.788986] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-22T20:56:06.081415] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T20:56:06.122073] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-22T20:56:06.885325] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T20:56:06.925141] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-22T20:56:06.933032] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T20:56:07.722054] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-22T20:56:08.522041] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-22T20:56:08.949374] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-22T20:56:09.160172] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T20:56:09.322046] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-22T20:56:09.865372] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T20:56:10.122051] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-22T20:56:10.723510] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T20:56:10.922083] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-22T20:56:11.042471] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T20:56:11.522374] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T20:56:11.722070] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-22T20:56:12.522096] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-22T20:56:13.164412] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T20:56:13.322038] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-22T20:56:13.571143] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T20:56:13.972221] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-22T20:56:13.973741] [INFO ] [REMOTE ] RCD: Full fetch complete (6811 records). [2025-09-22T20:56:13.973813] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-22T20:56:14.127235] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-22T20:56:14.170598] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-22T20:56:14.171169] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:56:14.171246] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:56:14.171317] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-22T20:56:14.171410] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-22T20:56:14.171451] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-22T20:56:14.171570] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-22T20:56:14.171687] [INFO ] [MAIN ] Update Progress: 1777/2372 symbols completed. RCD took 20.1s. Estimated remaining: 1h 19m 5s. Rate: 7.5 symbols/min [2025-09-22T20:56:14.354865] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:56:14.375574] [DEBUG] [LOCAL ] RCS: Loaded 11739 existing records from primary storage. [2025-09-22T20:56:14.375809] [INFO ] [MAIN ] RCS: Loaded 11739 existing records. [2025-09-22T20:56:14.579633] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:56:14.580029] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-22T20:56:14.580089] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-22T20:56:14.580839] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-22T20:56:14.580908] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-22T20:56:14.927383] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-22T20:56:14.970150] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:56:15.722093] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-22T20:56:16.115500] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-22T20:56:16.522059] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-22T20:56:16.942136] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T20:56:17.124177] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-22T20:56:17.322063] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-22T20:56:18.122059] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-22T20:56:18.172421] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T20:56:18.478228] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T20:56:18.922130] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-22T20:56:19.722078] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-22T20:56:19.791576] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T20:56:20.260093] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-22T20:56:20.522044] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-22T20:56:21.322036] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-22T20:56:21.379267] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-22T20:56:21.527405] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T20:56:22.122060] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-22T20:56:22.922021] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-22T20:56:23.381755] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-22T20:56:23.722108] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-22T20:56:23.833539] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T20:56:24.522117] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-22T20:56:24.623603] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-22T20:56:24.813001] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T20:56:25.322076] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-22T20:56:26.122037] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-22T20:56:26.223534] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T20:56:26.543342] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-22T20:56:26.922038] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-22T20:56:27.722066] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-22T20:56:27.778787] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T20:56:27.786319] [INFO ] [REMOTE ] RCI: Full fetch complete (70556 records). [2025-09-22T20:56:27.786444] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-22T20:56:28.139719] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T20:56:28.200174] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-22T20:56:28.200263] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-22T20:56:28.201349] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-22T20:56:28.201426] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-22T20:56:28.202932] [DEBUG] [LOCAL ] RCI: Trimmed 70556 records to 48837 (keeping 200 days of data) [2025-09-22T20:56:28.516820] [DEBUG] [LOCAL ] RCI: Primary data saved (48837 records). [2025-09-22T20:56:28.517016] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-22T20:56:28.517142] [INFO ] [MAIN ] Update Progress: 1778/2372 symbols completed. RCI took 29.8s. Estimated remaining: 1h 18m 59s. Rate: 7.5 symbols/min [2025-09-22T20:56:28.529134] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-22T20:56:28.710192] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:56:28.752858] [DEBUG] [LOCAL ] RCUS: Loaded 43509 existing records from primary storage. [2025-09-22T20:56:28.753048] [INFO ] [MAIN ] RCUS: Loaded 43509 existing records. [2025-09-22T20:56:28.944000] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:56:28.944282] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-22T20:56:28.944348] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-22T20:56:28.945517] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-22T20:56:28.945581] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-22T20:56:29.328335] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-22T20:56:29.349997] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:56:29.441632] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-22T20:56:30.038055] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-22T20:56:30.122023] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-22T20:56:30.863351] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T20:56:30.922058] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-22T20:56:31.654183] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-22T20:56:31.722014] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-22T20:56:32.522082] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-22T20:56:32.577694] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T20:56:32.589195] [INFO ] [REMOTE ] RC: Full fetch complete (70819 records). [2025-09-22T20:56:32.589362] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-22T20:56:33.013101] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-22T20:56:33.013239] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-22T20:56:33.014754] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-22T20:56:33.014892] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-22T20:56:33.016864] [DEBUG] [LOCAL ] RC: Trimmed 70819 records to 49018 (keeping 200 days of data) [2025-09-22T20:56:33.040928] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T20:56:33.333768] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-22T20:56:33.351037] [DEBUG] [LOCAL ] RC: Primary data saved (49018 records). [2025-09-22T20:56:33.351148] [INFO ] [MAIN ] RC: Full history saved. [2025-09-22T20:56:33.351247] [INFO ] [MAIN ] Update Progress: 1779/2372 symbols completed. RC took 55.2s. Estimated remaining: 1h 18m 50s. Rate: 7.5 symbols/min [2025-09-22T20:56:33.460556] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-22T20:56:33.534749] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:56:33.595728] [DEBUG] [LOCAL ] RDDT: Loaded 54564 existing records from primary storage. [2025-09-22T20:56:33.595870] [INFO ] [MAIN ] RDDT: Loaded 54564 existing records. [2025-09-22T20:56:33.774033] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:56:33.774300] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-22T20:56:33.774347] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-22T20:56:33.776042] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-22T20:56:33.776108] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-22T20:56:34.128741] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-22T20:56:34.134258] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:56:34.665117] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T20:56:34.922081] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-22T20:56:34.943085] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T20:56:34.945744] [INFO ] [REMOTE ] RCS: Full fetch complete (19232 records). [2025-09-22T20:56:34.945825] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-22T20:56:35.335792] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-22T20:56:35.335871] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-22T20:56:35.336305] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-22T20:56:35.336342] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-22T20:56:35.336917] [DEBUG] [LOCAL ] RCS: Trimmed 19232 records to 11483 (keeping 200 days of data) [2025-09-22T20:56:35.408115] [DEBUG] [LOCAL ] RCS: Primary data saved (11483 records). [2025-09-22T20:56:35.408249] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-22T20:56:35.408354] [INFO ] [MAIN ] Update Progress: 1780/2372 symbols completed. RCS took 21.2s. Estimated remaining: 1h 18m 40s. Rate: 7.5 symbols/min [2025-09-22T20:56:35.577138] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:56:35.623299] [DEBUG] [LOCAL ] RDN: Loaded 45916 existing records from primary storage. [2025-09-22T20:56:35.623478] [INFO ] [MAIN ] RDN: Loaded 45916 existing records. [2025-09-22T20:56:35.724931] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-22T20:56:35.805933] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:56:35.806239] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-22T20:56:35.806288] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-22T20:56:35.807454] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-22T20:56:35.807514] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-22T20:56:36.166729] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:56:36.499737] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T20:56:36.522013] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-22T20:56:37.322072] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-22T20:56:38.122103] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-22T20:56:38.260007] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-22T20:56:38.308034] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T20:56:38.922068] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-22T20:56:39.373800] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T20:56:39.722101] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-22T20:56:39.782979] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T20:56:40.522084] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-22T20:56:41.294590] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T20:56:41.324293] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-22T20:56:41.329176] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T20:56:41.339276] [INFO ] [REMOTE ] RCL: Full fetch complete (75095 records). [2025-09-22T20:56:41.339631] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-22T20:56:41.359373] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T20:56:41.374600] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T20:56:41.374856] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T20:56:41.374980] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-22T20:56:41.377330] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-22T20:56:41.377439] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-22T20:56:41.377868] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-22T20:56:41.389504] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-09-22T20:56:41.390106] [INFO ] [MAIN ] Update Progress: 1781/2372 symbols completed. RCL took 39.4s. Estimated remaining: 1h 18m 31s. Rate: 7.5 symbols/min [2025-09-22T20:56:41.582893] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:56:41.638957] [DEBUG] [LOCAL ] RDW: Loaded 52768 existing records from primary storage. [2025-09-22T20:56:41.639161] [INFO ] [MAIN ] RDW: Loaded 52768 existing records. [2025-09-22T20:56:41.824024] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:56:41.824280] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-22T20:56:41.824330] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-22T20:56:41.825544] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-22T20:56:41.825606] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-22T20:56:42.127205] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-22T20:56:42.188699] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:56:42.909235] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T20:56:42.922006] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-22T20:56:43.722053] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-22T20:56:43.777203] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T20:56:44.149827] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T20:56:44.522063] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-22T20:56:45.322063] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-22T20:56:45.641241] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-22T20:56:46.115743] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T20:56:46.124163] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-22T20:56:46.922081] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-22T20:56:47.722019] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-22T20:56:47.921108] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-22T20:56:48.042987] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T20:56:48.522027] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-22T20:56:48.630438] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T20:56:48.926536] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T20:56:48.933453] [INFO ] [REMOTE ] RCUS: Full fetch complete (60299 records). [2025-09-22T20:56:48.933592] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-22T20:56:49.327173] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-22T20:56:49.373953] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-22T20:56:49.374036] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-22T20:56:49.375138] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-22T20:56:49.375203] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-22T20:56:49.376533] [DEBUG] [LOCAL ] RCUS: Trimmed 60299 records to 42754 (keeping 200 days of data) [2025-09-22T20:56:49.652731] [DEBUG] [LOCAL ] RCUS: Primary data saved (42754 records). [2025-09-22T20:56:49.652868] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-22T20:56:49.652950] [INFO ] [MAIN ] Update Progress: 1782/2372 symbols completed. RCUS took 21.1s. Estimated remaining: 1h 18m 23s. Rate: 7.5 symbols/min [2025-09-22T20:56:49.849146] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:56:49.900574] [DEBUG] [LOCAL ] RDY: Loaded 47591 existing records from primary storage. [2025-09-22T20:56:49.900759] [INFO ] [MAIN ] RDY: Loaded 47591 existing records. [2025-09-22T20:56:50.105435] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:56:50.105775] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-22T20:56:50.105833] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-22T20:56:50.106887] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-22T20:56:50.106950] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-22T20:56:50.138052] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-22T20:56:50.500156] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:56:50.635781] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-22T20:56:50.922067] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-22T20:56:51.701602] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T20:56:51.722016] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-22T20:56:51.973729] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-22T20:56:52.522072] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-22T20:56:53.020190] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-22T20:56:53.322047] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-22T20:56:53.443180] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T20:56:54.122033] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-22T20:56:54.368630] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T20:56:54.922027] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-22T20:56:55.338124] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T20:56:55.722028] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-22T20:56:55.830990] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T20:56:56.522047] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-22T20:56:56.668513] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T20:56:57.322062] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-22T20:56:58.122072] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-22T20:56:58.298310] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-22T20:56:58.378481] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T20:56:58.533227] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T20:56:58.922073] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-22T20:56:59.722035] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-22T20:56:59.892295] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T20:57:00.522103] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-22T20:57:01.322040] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-22T20:57:01.477828] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T20:57:01.599332] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-22T20:57:02.122111] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-22T20:57:02.457317] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T20:57:02.922097] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-22T20:57:03.722103] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-22T20:57:04.381774] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-22T20:57:04.522057] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-22T20:57:04.602139] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-09-22T20:57:05.322070] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-22T20:57:05.372531] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-22T20:57:05.766851] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T20:57:05.773557] [INFO ] [REMOTE ] RDN: Full fetch complete (65682 records). [2025-09-22T20:57:05.773717] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-22T20:57:06.126887] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-22T20:57:06.165783] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-22T20:57:06.165884] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-22T20:57:06.166976] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-22T20:57:06.167042] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-22T20:57:06.168417] [DEBUG] [LOCAL ] RDN: Trimmed 65682 records to 45213 (keeping 200 days of data) [2025-09-22T20:57:06.438087] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-22T20:57:06.498272] [DEBUG] [LOCAL ] RDN: Primary data saved (45213 records). [2025-09-22T20:57:06.498411] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-22T20:57:06.498497] [INFO ] [MAIN ] Update Progress: 1783/2372 symbols completed. RDN took 31.1s. Estimated remaining: 1h 18m 18s. Rate: 7.5 symbols/min [2025-09-22T20:57:06.669705] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:57:06.715013] [DEBUG] [LOCAL ] RELX: Loaded 48561 existing records from primary storage. [2025-09-22T20:57:06.715159] [INFO ] [MAIN ] RELX: Loaded 48561 existing records. [2025-09-22T20:57:06.895782] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:57:06.896056] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-22T20:57:06.896104] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-22T20:57:06.897842] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-22T20:57:06.897905] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-22T20:57:06.929061] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-22T20:57:07.262661] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:57:07.378182] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-22T20:57:07.418441] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T20:57:07.722124] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-22T20:57:08.522129] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-22T20:57:09.322080] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-22T20:57:09.406551] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T20:57:09.572918] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-22T20:57:10.122037] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-22T20:57:10.172513] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T20:57:10.922063] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-22T20:57:11.756345] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-22T20:57:11.786618] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-22T20:57:11.893178] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T20:57:12.522093] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-22T20:57:12.601898] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T20:57:13.322078] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-22T20:57:14.122084] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-22T20:57:14.821525] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-22T20:57:14.922122] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-22T20:57:14.967466] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (3.21 seconds). [2025-09-22T20:57:15.391995] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-22T20:57:15.722071] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-22T20:57:16.269289] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-22T20:57:16.280789] [INFO ] [REMOTE ] RDW: Full fetch complete (74279 records). [2025-09-22T20:57:16.280949] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-22T20:57:16.547792] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-22T20:57:16.610915] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T20:57:16.672756] [INFO ] [REMOTE ] RDY: Full fetch complete (69101 records). [2025-09-22T20:57:16.681710] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-22T20:57:16.785809] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-22T20:57:16.797198] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-22T20:57:16.803566] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-22T20:57:16.814327] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-22T20:57:16.877966] [DEBUG] [LOCAL ] RDW: Trimmed 74279 records to 52001 (keeping 200 days of data) [2025-09-22T20:57:17.245204] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-22T20:57:17.246597] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-22T20:57:17.250124] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-22T20:57:17.250309] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-22T20:57:17.259071] [DEBUG] [LOCAL ] RDY: Trimmed 69101 records to 46850 (keeping 200 days of data) [2025-09-22T20:57:17.466304] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T20:57:17.481222] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-22T20:57:17.708883] [DEBUG] [LOCAL ] RDW: Primary data saved (52001 records). [2025-09-22T20:57:17.709776] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-22T20:57:17.710119] [INFO ] [MAIN ] Update Progress: 1784/2372 symbols completed. RDW took 36.3s. Estimated remaining: 1h 18m 11s. Rate: 7.5 symbols/min [2025-09-22T20:57:17.896279] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:57:17.944463] [DEBUG] [LOCAL ] RERE: Loaded 41496 existing records from primary storage. [2025-09-22T20:57:17.945192] [INFO ] [MAIN ] RERE: Loaded 41496 existing records. [2025-09-22T20:57:18.172036] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:57:18.174137] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-22T20:57:18.175537] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-22T20:57:18.177406] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-22T20:57:18.177982] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-22T20:57:18.316072] [DEBUG] [LOCAL ] RDY: Primary data saved (46850 records). [2025-09-22T20:57:18.321873] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-22T20:57:18.332235] [INFO ] [MAIN ] Update Progress: 1785/2372 symbols completed. RDY took 28.7s. Estimated remaining: 1h 18m 1s. Rate: 7.5 symbols/min [2025-09-22T20:57:18.701987] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:57:18.779583] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:57:18.779958] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-22T20:57:18.822264] [DEBUG] [LOCAL ] RES: Loaded 48259 existing records from primary storage. [2025-09-22T20:57:18.822412] [INFO ] [MAIN ] RES: Loaded 48259 existing records. [2025-09-22T20:57:19.009898] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:57:19.010241] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-22T20:57:19.010299] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-22T20:57:19.012003] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-22T20:57:19.012065] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-22T20:57:19.432223] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:57:19.435336] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T20:57:19.436131] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-22T20:57:19.471039] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.92 seconds). [2025-09-22T20:57:19.480268] [INFO ] [REMOTE ] RDDT: Full fetch complete (77890 records). [2025-09-22T20:57:19.480410] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-22T20:57:19.747102] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-22T20:57:19.885095] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-22T20:57:19.885199] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-22T20:57:19.886532] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-22T20:57:19.886602] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-22T20:57:19.888206] [DEBUG] [LOCAL ] RDDT: Trimmed 77890 records to 53783 (keeping 200 days of data) [2025-09-22T20:57:20.231596] [DEBUG] [LOCAL ] RDDT: Primary data saved (53783 records). [2025-09-22T20:57:20.231783] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-22T20:57:20.231880] [INFO ] [MAIN ] Update Progress: 1786/2372 symbols completed. RDDT took 46.9s. Estimated remaining: 1h 17m 51s. Rate: 7.5 symbols/min [2025-09-22T20:57:20.412551] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:57:20.437397] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T20:57:20.482766] [DEBUG] [LOCAL ] REVG: Loaded 41886 existing records from primary storage. [2025-09-22T20:57:20.482915] [INFO ] [MAIN ] REVG: Loaded 41886 existing records. [2025-09-22T20:57:20.547015] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-22T20:57:20.663988] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:57:20.664233] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-22T20:57:20.664282] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-22T20:57:20.665330] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-22T20:57:20.665392] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-22T20:57:21.047421] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:57:21.209901] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T20:57:21.317947] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T20:57:21.329287] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-22T20:57:21.958593] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T20:57:22.122097] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-22T20:57:22.922108] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-22T20:57:23.039102] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T20:57:23.716683] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T20:57:23.724700] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-22T20:57:24.522044] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-22T20:57:24.684388] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T20:57:25.322139] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-22T20:57:25.542882] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T20:57:26.094003] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T20:57:26.122003] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-22T20:57:26.706555] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T20:57:26.922091] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-22T20:57:27.722061] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-22T20:57:27.833034] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T20:57:27.923609] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T20:57:28.522044] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-22T20:57:29.329045] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-22T20:57:29.335159] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T20:57:30.085793] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T20:57:30.122036] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-22T20:57:30.922067] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-22T20:57:30.973741] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T20:57:31.675477] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T20:57:31.722011] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-22T20:57:32.522024] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-22T20:57:32.587368] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T20:57:33.119840] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-22T20:57:33.322055] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-22T20:57:34.117284] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T20:57:34.126574] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-22T20:57:34.662047] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T20:57:34.922131] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-22T20:57:35.648852] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T20:57:35.722003] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-22T20:57:36.456427] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T20:57:36.522028] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-22T20:57:37.322059] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-22T20:57:37.479781] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T20:57:37.488259] [INFO ] [REMOTE ] RELX: Full fetch complete (66922 records). [2025-09-22T20:57:37.488447] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-22T20:57:37.900133] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-22T20:57:37.900256] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-22T20:57:37.901445] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-22T20:57:37.901532] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-22T20:57:37.903242] [DEBUG] [LOCAL ] RELX: Trimmed 66922 records to 47843 (keeping 200 days of data) [2025-09-22T20:57:38.129906] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-22T20:57:38.168874] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T20:57:38.252368] [DEBUG] [LOCAL ] RELX: Primary data saved (47843 records). [2025-09-22T20:57:38.252568] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-22T20:57:38.252774] [INFO ] [MAIN ] Update Progress: 1787/2372 symbols completed. RELX took 31.8s. Estimated remaining: 1h 17m 46s. Rate: 7.5 symbols/min [2025-09-22T20:57:38.437022] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:57:38.455540] [DEBUG] [LOCAL ] REX: Loaded 14095 existing records from primary storage. [2025-09-22T20:57:38.455699] [INFO ] [MAIN ] REX: Loaded 14095 existing records. [2025-09-22T20:57:38.635193] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:57:38.635443] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-22T20:57:38.635493] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-22T20:57:38.636357] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-22T20:57:38.636417] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-22T20:57:38.925506] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-22T20:57:39.070801] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T20:57:39.069358] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:57:39.722035] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-22T20:57:40.012067] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T20:57:40.475304] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T20:57:40.522027] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-22T20:57:41.322030] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-22T20:57:41.682924] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T20:57:41.995110] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T20:57:42.122037] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-22T20:57:42.922041] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-22T20:57:43.096172] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T20:57:43.327930] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T20:57:43.336114] [INFO ] [REMOTE ] REVG: Full fetch complete (58370 records). [2025-09-22T20:57:43.336281] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-22T20:57:43.729113] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-22T20:57:43.733045] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-22T20:57:43.733123] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-22T20:57:43.734141] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-22T20:57:43.734329] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-22T20:57:43.738099] [DEBUG] [LOCAL ] REVG: Trimmed 58370 records to 41123 (keeping 200 days of data) [2025-09-22T20:57:44.010487] [DEBUG] [LOCAL ] REVG: Primary data saved (41123 records). [2025-09-22T20:57:44.010226] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T20:57:44.014577] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-22T20:57:44.019731] [INFO ] [MAIN ] Update Progress: 1788/2372 symbols completed. REVG took 23.8s. Estimated remaining: 1h 17m 38s. Rate: 7.5 symbols/min [2025-09-22T20:57:44.196236] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:57:44.258700] [DEBUG] [LOCAL ] REXR: Loaded 52797 existing records from primary storage. [2025-09-22T20:57:44.258872] [INFO ] [MAIN ] REXR: Loaded 52797 existing records. [2025-09-22T20:57:44.441368] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:57:44.441635] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-22T20:57:44.441717] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-22T20:57:44.442935] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-22T20:57:44.443009] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-22T20:57:44.532231] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-22T20:57:44.811902] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:57:45.322052] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-22T20:57:45.363081] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T20:57:45.370678] [INFO ] [REMOTE ] RERE: Full fetch complete (57469 records). [2025-09-22T20:57:45.370849] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-22T20:57:45.764717] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-22T20:57:45.764815] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-22T20:57:45.765806] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-22T20:57:45.765885] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-22T20:57:45.767109] [DEBUG] [LOCAL ] RERE: Trimmed 57469 records to 41004 (keeping 200 days of data) [2025-09-22T20:57:46.019575] [DEBUG] [LOCAL ] RERE: Primary data saved (41004 records). [2025-09-22T20:57:46.019748] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-22T20:57:46.019884] [INFO ] [MAIN ] Update Progress: 1789/2372 symbols completed. RERE took 28.3s. Estimated remaining: 1h 17m 28s. Rate: 7.5 symbols/min [2025-09-22T20:57:46.127960] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-22T20:57:46.203300] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:57:46.250949] [DEBUG] [LOCAL ] REZI: Loaded 47558 existing records from primary storage. [2025-09-22T20:57:46.251098] [INFO ] [MAIN ] REZI: Loaded 47558 existing records. [2025-09-22T20:57:46.462562] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:57:46.465750] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-22T20:57:46.466040] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-22T20:57:46.467874] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T20:57:46.467945] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-22T20:57:46.478190] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-22T20:57:46.844908] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:57:46.878022] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T20:57:46.922010] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-22T20:57:47.114393] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T20:57:47.722080] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-22T20:57:48.522039] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-22T20:57:48.656393] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T20:57:48.714814] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T20:57:49.322064] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-22T20:57:49.964425] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T20:57:50.122057] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-22T20:57:50.354957] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T20:57:50.922060] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-22T20:57:51.722070] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-22T20:57:51.868888] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-22T20:57:52.522028] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-22T20:57:52.726976] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T20:57:52.835990] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T20:57:53.322063] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-22T20:57:54.122060] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-22T20:57:54.419910] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T20:57:54.845837] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T20:57:54.922016] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-22T20:57:55.663974] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T20:57:55.673171] [INFO ] [REMOTE ] RES: Full fetch complete (68815 records). [2025-09-22T20:57:55.673326] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-22T20:57:55.729917] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-22T20:57:56.074199] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-22T20:57:56.074533] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-22T20:57:56.075781] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-22T20:57:56.075847] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-22T20:57:56.079204] [DEBUG] [LOCAL ] RES: Trimmed 68815 records to 47534 (keeping 200 days of data) [2025-09-22T20:57:56.378144] [DEBUG] [LOCAL ] RES: Primary data saved (47534 records). [2025-09-22T20:57:56.378292] [INFO ] [MAIN ] RES: Full history saved. [2025-09-22T20:57:56.378397] [INFO ] [MAIN ] Update Progress: 1790/2372 symbols completed. RES took 38.0s. Estimated remaining: 1h 17m 21s. Rate: 7.5 symbols/min [2025-09-22T20:57:56.524833] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-22T20:57:56.580865] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:57:56.577157] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T20:57:56.644125] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-22T20:57:56.644277] [INFO ] [MAIN ] RF: Loaded 54410 existing records. [2025-09-22T20:57:56.898828] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T20:57:56.904577] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:57:56.908611] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-22T20:57:56.908983] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-22T20:57:56.910577] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-22T20:57:56.910665] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-22T20:57:57.265137] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:57:57.322023] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-22T20:57:58.122037] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-22T20:57:58.367617] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T20:57:58.922048] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-22T20:57:59.236969] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T20:57:59.458233] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T20:57:59.722111] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-22T20:58:00.471301] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T20:58:00.522044] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-22T20:58:01.096104] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T20:58:01.322071] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-22T20:58:02.122083] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-22T20:58:02.363671] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T20:58:02.875755] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-22T20:58:02.922128] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-22T20:58:03.010557] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T20:58:03.722054] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-22T20:58:03.747899] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T20:58:04.522074] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-22T20:58:05.251972] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T20:58:05.322042] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-22T20:58:05.619347] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-22T20:58:06.122128] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-22T20:58:06.922020] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-22T20:58:07.016868] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T20:58:07.176502] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T20:58:07.179896] [INFO ] [REMOTE ] REX: Full fetch complete (21169 records). [2025-09-22T20:58:07.179981] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-22T20:58:07.559144] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-22T20:58:07.559262] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-22T20:58:07.559741] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-22T20:58:07.559802] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-22T20:58:07.560374] [DEBUG] [LOCAL ] REX: Trimmed 21169 records to 13909 (keeping 200 days of data) [2025-09-22T20:58:07.652349] [DEBUG] [LOCAL ] REX: Primary data saved (13909 records). [2025-09-22T20:58:07.652493] [INFO ] [MAIN ] REX: Full history saved. [2025-09-22T20:58:07.652593] [INFO ] [MAIN ] Update Progress: 1791/2372 symbols completed. REX took 29.4s. Estimated remaining: 1h 17m 14s. Rate: 7.5 symbols/min [2025-09-22T20:58:07.729331] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-22T20:58:07.831069] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:58:07.846498] [DEBUG] [LOCAL ] RFI: Loaded 10657 existing records from primary storage. [2025-09-22T20:58:07.846670] [INFO ] [MAIN ] RFI: Loaded 10657 existing records. [2025-09-22T20:58:08.034834] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:58:08.035130] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-22T20:58:08.035178] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-22T20:58:08.035681] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-22T20:58:08.035741] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-22T20:58:08.400756] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:58:08.492951] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T20:58:08.522057] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-22T20:58:09.322169] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-22T20:58:09.491058] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T20:58:09.567307] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T20:58:10.122088] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-22T20:58:10.922046] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-22T20:58:11.219618] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T20:58:11.722037] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-22T20:58:11.763844] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T20:58:12.430504] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T20:58:12.522059] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-22T20:58:13.322045] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-22T20:58:13.391386] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T20:58:13.734409] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-22T20:58:14.122069] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-22T20:58:14.922081] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-22T20:58:15.008437] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T20:58:15.016322] [INFO ] [REMOTE ] REZI: Full fetch complete (65550 records). [2025-09-22T20:58:15.016437] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-22T20:58:15.403535] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-22T20:58:15.403636] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-22T20:58:15.404704] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-22T20:58:15.404777] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-22T20:58:15.406124] [DEBUG] [LOCAL ] REZI: Trimmed 65550 records to 46841 (keeping 200 days of data) [2025-09-22T20:58:15.680351] [DEBUG] [LOCAL ] REZI: Primary data saved (46841 records). [2025-09-22T20:58:15.680487] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-22T20:58:15.680572] [INFO ] [MAIN ] Update Progress: 1792/2372 symbols completed. REZI took 29.7s. Estimated remaining: 1h 17m 6s. Rate: 7.5 symbols/min [2025-09-22T20:58:15.724089] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-22T20:58:15.854899] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:58:15.866296] [DEBUG] [LOCAL ] RFL: Loaded 10839 existing records from primary storage. [2025-09-22T20:58:15.866429] [INFO ] [MAIN ] RFL: Loaded 10839 existing records. [2025-09-22T20:58:16.050973] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:58:16.051511] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-22T20:58:16.051592] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-22T20:58:16.052134] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-22T20:58:16.052194] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-22T20:58:16.203799] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-22T20:58:16.444806] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T20:58:16.468609] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:58:16.522006] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-22T20:58:16.614502] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-22T20:58:17.237304] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-22T20:58:17.322011] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-22T20:58:18.122073] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-22T20:58:18.922112] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-22T20:58:18.992742] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T20:58:19.002939] [INFO ] [REMOTE ] REXR: Full fetch complete (75079 records). [2025-09-22T20:58:19.003150] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-22T20:58:19.445541] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-22T20:58:19.445663] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-22T20:58:19.446967] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-22T20:58:19.447079] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-22T20:58:19.448671] [DEBUG] [LOCAL ] REXR: Trimmed 75079 records to 52060 (keeping 200 days of data) [2025-09-22T20:58:19.723046] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-22T20:58:19.811083] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T20:58:19.816765] [DEBUG] [LOCAL ] REXR: Primary data saved (52060 records). [2025-09-22T20:58:19.816860] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-22T20:58:19.817086] [INFO ] [MAIN ] Update Progress: 1793/2372 symbols completed. REXR took 35.8s. Estimated remaining: 1h 16m 56s. Rate: 7.5 symbols/min [2025-09-22T20:58:20.023336] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-22T20:58:20.026402] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:58:20.044187] [DEBUG] [LOCAL ] RFM: Loaded 4122 existing records from primary storage. [2025-09-22T20:58:20.044306] [INFO ] [MAIN ] RFM: Loaded 4122 existing records. [2025-09-22T20:58:20.230899] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:58:20.231277] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-22T20:58:20.231337] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-22T20:58:20.231596] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-22T20:58:20.231690] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-22T20:58:20.449843] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T20:58:20.522941] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-22T20:58:20.602515] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:58:21.322029] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-22T20:58:21.518066] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T20:58:22.122061] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-22T20:58:22.922056] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-22T20:58:22.975713] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T20:58:23.300087] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T20:58:23.722061] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-22T20:58:23.734383] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-22T20:58:24.522123] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-22T20:58:24.652567] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T20:58:25.144709] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T20:58:25.322077] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-22T20:58:25.954701] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T20:58:26.122058] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-22T20:58:26.922070] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-22T20:58:27.132277] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T20:58:27.722072] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-22T20:58:28.235265] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-22T20:58:28.522024] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-22T20:58:28.956396] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T20:58:29.315680] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T20:58:29.322013] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-22T20:58:30.122030] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-22T20:58:30.242277] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T20:58:30.922067] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-22T20:58:31.004817] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T20:58:31.536211] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T20:58:31.722064] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-22T20:58:32.522032] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-22T20:58:32.589626] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T20:58:32.591941] [INFO ] [REMOTE ] RFI: Full fetch complete (15780 records). [2025-09-22T20:58:32.592016] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-22T20:58:32.977793] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-22T20:58:32.977899] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-22T20:58:32.978254] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-22T20:58:32.978296] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-22T20:58:32.978824] [DEBUG] [LOCAL ] RFI: Trimmed 15780 records to 10479 (keeping 200 days of data) [2025-09-22T20:58:33.041213] [DEBUG] [LOCAL ] RFI: Primary data saved (10479 records). [2025-09-22T20:58:33.041346] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-22T20:58:33.041432] [INFO ] [MAIN ] Update Progress: 1794/2372 symbols completed. RFI took 25.4s. Estimated remaining: 1h 16m 50s. Rate: 7.5 symbols/min [2025-09-22T20:58:33.211311] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:58:33.221842] [DEBUG] [LOCAL ] RFMZ: Loaded 8608 existing records from primary storage. [2025-09-22T20:58:33.221972] [INFO ] [MAIN ] RFMZ: Loaded 8608 existing records. [2025-09-22T20:58:33.323501] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-22T20:58:33.401418] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:58:33.401730] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-22T20:58:33.401793] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-22T20:58:33.402156] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-22T20:58:33.402216] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-22T20:58:33.761137] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:58:34.127217] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-22T20:58:34.140677] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T20:58:34.149413] [INFO ] [REMOTE ] RF: Full fetch complete (77620 records). [2025-09-22T20:58:34.149601] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-22T20:58:34.310762] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T20:58:34.563494] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-22T20:58:34.563580] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-22T20:58:34.564749] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-22T20:58:34.564874] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-22T20:58:34.566484] [DEBUG] [LOCAL ] RF: Trimmed 77620 records to 53630 (keeping 200 days of data) [2025-09-22T20:58:34.908505] [DEBUG] [LOCAL ] RF: Primary data saved (53630 records). [2025-09-22T20:58:34.908673] [INFO ] [MAIN ] RF: Full history saved. [2025-09-22T20:58:34.908779] [INFO ] [MAIN ] Update Progress: 1795/2372 symbols completed. RF took 38.5s. Estimated remaining: 1h 16m 40s. Rate: 7.5 symbols/min [2025-09-22T20:58:34.929822] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-22T20:58:35.025898] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-22T20:58:35.100242] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:58:35.134550] [DEBUG] [LOCAL ] RGA: Loaded 30740 existing records from primary storage. [2025-09-22T20:58:35.134728] [INFO ] [MAIN ] RGA: Loaded 30740 existing records. [2025-09-22T20:58:35.319474] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:58:35.319795] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-22T20:58:35.319849] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-22T20:58:35.320798] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-22T20:58:35.320866] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-22T20:58:35.690082] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:58:35.722050] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-22T20:58:36.067930] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T20:58:36.522054] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-22T20:58:37.238619] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T20:58:37.322032] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-22T20:58:37.337329] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-22T20:58:38.122060] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-22T20:58:38.806460] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T20:58:38.922056] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-22T20:58:39.349990] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T20:58:39.603223] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-22T20:58:39.722082] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-22T20:58:40.477750] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-22T20:58:40.522086] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-22T20:58:41.322031] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-22T20:58:41.402571] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T20:58:41.955548] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T20:58:42.122067] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-22T20:58:42.922037] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-22T20:58:43.000758] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-22T20:58:43.663424] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-22T20:58:43.722078] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-22T20:58:44.522508] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-22T20:58:44.902332] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T20:58:44.905751] [INFO ] [REMOTE ] RFL: Full fetch complete (12703 records). [2025-09-22T20:58:44.905827] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-22T20:58:45.188502] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-22T20:58:45.303370] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-22T20:58:45.303448] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-22T20:58:45.303799] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-22T20:58:45.303863] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-22T20:58:45.304370] [DEBUG] [LOCAL ] RFL: Trimmed 12703 records to 10857 (keeping 200 days of data) [2025-09-22T20:58:45.329167] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-22T20:58:45.371929] [DEBUG] [LOCAL ] RFL: Primary data saved (10857 records). [2025-09-22T20:58:45.372036] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-22T20:58:45.372119] [INFO ] [MAIN ] Update Progress: 1796/2372 symbols completed. RFL took 29.7s. Estimated remaining: 1h 16m 33s. Rate: 7.5 symbols/min [2025-09-22T20:58:45.554620] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:58:45.575205] [DEBUG] [LOCAL ] RGR: Loaded 20432 existing records from primary storage. [2025-09-22T20:58:45.575356] [INFO ] [MAIN ] RGR: Loaded 20432 existing records. [2025-09-22T20:58:45.768209] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:58:45.768486] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-22T20:58:45.768553] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-22T20:58:45.769130] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-22T20:58:45.769191] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-22T20:58:46.056623] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T20:58:46.148820] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-22T20:58:46.154756] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:58:46.841812] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T20:58:46.922016] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-22T20:58:47.722046] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-22T20:58:48.522114] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-22T20:58:49.322059] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-22T20:58:49.349815] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-22T20:58:49.522145] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T20:58:49.523695] [INFO ] [REMOTE ] RFM: Full fetch complete (6025 records). [2025-09-22T20:58:49.523764] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-22T20:58:49.901106] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-22T20:58:49.901297] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-22T20:58:49.901496] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-22T20:58:49.901538] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-22T20:58:49.901987] [DEBUG] [LOCAL ] RFM: Trimmed 6025 records to 4119 (keeping 200 days of data) [2025-09-22T20:58:49.927204] [DEBUG] [LOCAL ] RFM: Primary data saved (4119 records). [2025-09-22T20:58:49.927321] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-22T20:58:49.927419] [INFO ] [MAIN ] Update Progress: 1797/2372 symbols completed. RFM took 30.1s. Estimated remaining: 1h 16m 24s. Rate: 7.5 symbols/min [2025-09-22T20:58:50.028077] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T20:58:50.122015] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-22T20:58:50.372201] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T20:58:50.922051] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-22T20:58:51.608961] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T20:58:51.632737] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T20:58:51.722049] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-22T20:58:52.522102] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-22T20:58:53.227809] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T20:58:53.273809] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T20:58:53.322061] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-22T20:58:54.122057] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-22T20:58:54.752829] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T20:58:54.882064] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T20:58:54.922057] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-22T20:58:55.722128] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-22T20:58:55.807068] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T20:58:55.809275] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12902 records). [2025-09-22T20:58:55.809363] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-22T20:58:56.285695] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-22T20:58:56.285831] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-22T20:58:56.286256] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-22T20:58:56.286304] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-22T20:58:56.287168] [DEBUG] [LOCAL ] RFMZ: Trimmed 12902 records to 8608 (keeping 200 days of data) [2025-09-22T20:58:56.355729] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8608 records). [2025-09-22T20:58:56.355893] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-22T20:58:56.356009] [INFO ] [MAIN ] Update Progress: 1798/2372 symbols completed. RFMZ took 23.3s. Estimated remaining: 1h 16m 16s. Rate: 7.5 symbols/min [2025-09-22T20:58:56.522140] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-22T20:58:56.789533] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T20:58:57.322123] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-22T20:58:57.806113] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T20:58:58.122102] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-22T20:58:58.458399] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T20:58:58.922119] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-22T20:58:59.121962] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T20:58:59.722094] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-22T20:59:00.464049] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T20:59:00.522143] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-22T20:59:02.010272] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-22T20:59:02.020063] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-22T20:59:02.036949] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T20:59:02.122185] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-22T20:59:03.313937] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T20:59:03.319577] [INFO ] [REMOTE ] RGA: Full fetch complete (45699 records). [2025-09-22T20:59:03.319790] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-22T20:59:03.726860] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T20:59:03.774551] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-22T20:59:03.774326] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-22T20:59:03.774804] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-22T20:59:03.775880] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-22T20:59:03.776212] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-22T20:59:03.778794] [DEBUG] [LOCAL ] RGA: Trimmed 45699 records to 30179 (keeping 200 days of data) [2025-09-22T20:59:03.971010] [DEBUG] [LOCAL ] RGA: Primary data saved (30179 records). [2025-09-22T20:59:03.971168] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-22T20:59:03.971259] [INFO ] [MAIN ] Update Progress: 1799/2372 symbols completed. RGA took 29.1s. Estimated remaining: 1h 16m 7s. Rate: 7.5 symbols/min [2025-09-22T20:59:04.896173] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T20:59:04.902084] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-22T20:59:06.023709] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T20:59:06.028946] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-22T20:59:07.163635] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-22T20:59:07.168465] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-22T20:59:08.279988] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T20:59:08.283982] [INFO ] [REMOTE ] RGR: Full fetch complete (28440 records). [2025-09-22T20:59:08.284065] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-22T20:59:08.664546] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-22T20:59:08.664624] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-22T20:59:08.665385] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-22T20:59:08.665453] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-22T20:59:08.666207] [DEBUG] [LOCAL ] RGR: Trimmed 28440 records to 20285 (keeping 200 days of data) [2025-09-22T20:59:08.792347] [DEBUG] [LOCAL ] RGR: Primary data saved (20285 records). [2025-09-22T20:59:08.792482] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-22T20:59:08.792563] [INFO ] [MAIN ] Update Progress: 1800/2372 symbols completed. RGR took 23.4s. Estimated remaining: 1h 15m 59s. Rate: 7.5 symbols/min [2025-09-22T20:59:09.387485] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:59:09.435621] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:59:09.516415] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:59:09.550608] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:59:09.556763] [DEBUG] [LOCAL ] RGT: Loaded 2966 existing records from primary storage. [2025-09-22T20:59:09.556995] [INFO ] [MAIN ] RGT: Loaded 2966 existing records. [2025-09-22T20:59:09.801021] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:59:09.816230] [DEBUG] [LOCAL ] RHP: Loaded 42353 existing records from primary storage. [2025-09-22T20:59:09.815264] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-22T20:59:09.828728] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-22T20:59:09.828601] [INFO ] [MAIN ] RHP: Loaded 42353 existing records. [2025-09-22T20:59:09.891231] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-22T20:59:09.892990] [DEBUG] [LOCAL ] RHI: Loaded 49966 existing records from primary storage. [2025-09-22T20:59:09.899888] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-22T20:59:09.908890] [INFO ] [MAIN ] RHI: Loaded 49966 existing records. [2025-09-22T20:59:09.931292] [DEBUG] [LOCAL ] RH: Loaded 48447 existing records from primary storage. [2025-09-22T20:59:10.093945] [INFO ] [MAIN ] RH: Loaded 48447 existing records. [2025-09-22T20:59:10.319393] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:59:10.431922] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-22T20:59:10.573457] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-22T20:59:10.573326] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:59:10.683232] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:59:10.678021] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-22T20:59:10.683474] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-22T20:59:10.677935] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-22T20:59:10.694057] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-22T20:59:10.699246] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-22T20:59:10.738771] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-22T20:59:10.729875] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-22T20:59:10.759776] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-22T20:59:10.814875] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-22T20:59:10.815031] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-22T20:59:11.041858] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:59:11.110751] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-22T20:59:11.831618] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:59:11.869148] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:59:11.870176] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-22T20:59:11.869785] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-22T20:59:11.954209] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:59:11.954538] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-22T20:59:12.005813] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-22T20:59:12.007309] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-22T20:59:12.605503] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T20:59:12.606934] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-22T20:59:13.264412] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T20:59:13.265607] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-22T20:59:13.537961] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T20:59:13.546192] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-22T20:59:13.579408] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T20:59:13.588252] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-22T20:59:13.625883] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T20:59:13.634378] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-22T20:59:13.669276] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-22T20:59:14.122072] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-22T20:59:14.812629] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T20:59:14.922024] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-22T20:59:15.062445] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T20:59:15.272928] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T20:59:15.359554] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T20:59:15.364006] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T20:59:15.722068] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-22T20:59:16.522055] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-22T20:59:17.133306] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-22T20:59:17.271731] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T20:59:17.322040] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-22T20:59:18.122058] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-22T20:59:18.662154] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-22T20:59:18.922043] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-22T20:59:19.170167] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T20:59:19.722100] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-22T20:59:20.521941] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T20:59:20.522090] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-22T20:59:21.137937] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T20:59:21.322055] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-22T20:59:22.122132] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-22T20:59:22.633849] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-22T20:59:22.716947] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T20:59:22.922113] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-22T20:59:23.490227] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T20:59:23.722054] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-22T20:59:24.522100] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-22T20:59:24.842828] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-22T20:59:24.910333] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-22T20:59:25.214285] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T20:59:25.322017] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-22T20:59:26.122059] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-22T20:59:26.628161] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-22T20:59:26.629249] [INFO ] [REMOTE ] RGT: Full fetch complete (4168 records). [2025-09-22T20:59:26.629317] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-22T20:59:26.924786] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-22T20:59:27.004470] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-22T20:59:27.004705] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-22T20:59:27.004994] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-22T20:59:27.005074] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-22T20:59:27.005724] [DEBUG] [LOCAL ] RGT: Trimmed 4168 records to 2903 (keeping 200 days of data) [2025-09-22T20:59:27.023829] [DEBUG] [LOCAL ] RGT: Primary data saved (2903 records). [2025-09-22T20:59:27.023913] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-22T20:59:27.023992] [INFO ] [MAIN ] Update Progress: 1801/2372 symbols completed. RGT took 18.2s. Estimated remaining: 1h 15m 54s. Rate: 7.5 symbols/min [2025-09-22T20:59:27.201362] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T20:59:27.236269] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:59:27.292312] [DEBUG] [LOCAL ] RIG: Loaded 54450 existing records from primary storage. [2025-09-22T20:59:27.292463] [INFO ] [MAIN ] RIG: Loaded 54450 existing records. [2025-09-22T20:59:27.468794] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:59:27.469096] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-22T20:59:27.469173] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-22T20:59:27.470878] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-22T20:59:27.470940] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-22T20:59:27.727157] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-22T20:59:27.825978] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:59:28.522106] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-22T20:59:29.011565] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-22T20:59:29.322014] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-22T20:59:29.399078] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T20:59:29.963722] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T20:59:30.122049] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-22T20:59:30.922036] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-22T20:59:31.235707] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T20:59:31.722037] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-22T20:59:31.861883] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T20:59:32.522039] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-22T20:59:32.753429] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T20:59:33.322030] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-22T20:59:33.380856] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T20:59:34.122040] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-22T20:59:34.346487] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T20:59:34.922101] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-22T20:59:35.239342] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T20:59:35.722131] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-22T20:59:35.998500] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T20:59:36.452171] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T20:59:36.522048] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-22T20:59:37.322045] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-22T20:59:37.611380] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T20:59:38.024718] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T20:59:38.122064] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-22T20:59:38.902293] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T20:59:38.913979] [INFO ] [REMOTE ] RHI: Full fetch complete (69608 records). [2025-09-22T20:59:38.914170] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-22T20:59:38.929204] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-22T20:59:39.314433] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-22T20:59:39.314593] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-22T20:59:39.315761] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-22T20:59:39.315836] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-22T20:59:39.317816] [DEBUG] [LOCAL ] RHI: Trimmed 69608 records to 49247 (keeping 200 days of data) [2025-09-22T20:59:39.658039] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T20:59:39.678416] [DEBUG] [LOCAL ] RHI: Primary data saved (49247 records). [2025-09-22T20:59:39.678535] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-22T20:59:39.678615] [INFO ] [MAIN ] Update Progress: 1802/2372 symbols completed. RHI took 30.9s. Estimated remaining: 1h 15m 47s. Rate: 7.5 symbols/min [2025-09-22T20:59:39.733722] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-22T20:59:39.852399] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:59:39.906994] [DEBUG] [LOCAL ] RIO: Loaded 54177 existing records from primary storage. [2025-09-22T20:59:39.907144] [INFO ] [MAIN ] RIO: Loaded 54177 existing records. [2025-09-22T20:59:40.082886] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:59:40.083133] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-22T20:59:40.083225] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-22T20:59:40.085707] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-22T20:59:40.085770] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-22T20:59:40.434400] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:59:40.522008] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-22T20:59:41.010199] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-22T20:59:41.322021] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-22T20:59:41.594243] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-22T20:59:41.602928] [INFO ] [REMOTE ] RH: Full fetch complete (65577 records). [2025-09-22T20:59:41.603056] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-22T20:59:41.985661] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-22T20:59:41.985751] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-22T20:59:41.986812] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-22T20:59:41.986876] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-22T20:59:41.988371] [DEBUG] [LOCAL ] RH: Trimmed 65577 records to 47705 (keeping 200 days of data) [2025-09-22T20:59:42.171083] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-22T20:59:42.298902] [DEBUG] [LOCAL ] RH: Primary data saved (47705 records). [2025-09-22T20:59:42.299039] [INFO ] [MAIN ] RH: Full history saved. [2025-09-22T20:59:42.299125] [INFO ] [MAIN ] Update Progress: 1803/2372 symbols completed. RH took 33.5s. Estimated remaining: 1h 15m 38s. Rate: 7.5 symbols/min [2025-09-22T20:59:42.506806] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:59:42.565704] [DEBUG] [LOCAL ] RITM: Loaded 53575 existing records from primary storage. [2025-09-22T20:59:42.566008] [INFO ] [MAIN ] RITM: Loaded 53575 existing records. [2025-09-22T20:59:42.745350] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-22T20:59:42.819345] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:59:42.819888] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-22T20:59:42.819967] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-22T20:59:42.821693] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-22T20:59:42.821759] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-22T20:59:42.933054] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-22T20:59:42.978667] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T20:59:43.021967] [INFO ] [REMOTE ] RHP: Full fetch complete (57983 records). [2025-09-22T20:59:43.081183] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-22T20:59:43.410274] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:59:43.635197] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-22T20:59:43.635297] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-22T20:59:43.636344] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-22T20:59:43.636410] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-22T20:59:43.637664] [DEBUG] [LOCAL ] RHP: Trimmed 57983 records to 41809 (keeping 200 days of data) [2025-09-22T20:59:43.740630] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-22T20:59:43.925927] [DEBUG] [LOCAL ] RHP: Primary data saved (41809 records). [2025-09-22T20:59:43.926060] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-22T20:59:43.926221] [INFO ] [MAIN ] Update Progress: 1804/2372 symbols completed. RHP took 35.1s. Estimated remaining: 1h 15m 28s. Rate: 7.5 symbols/min [2025-09-22T20:59:44.105118] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T20:59:44.148915] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-22T20:59:44.154334] [DEBUG] [LOCAL ] RIV: Loaded 11910 existing records from primary storage. [2025-09-22T20:59:44.165778] [INFO ] [MAIN ] RIV: Loaded 11910 existing records. [2025-09-22T20:59:44.351571] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T20:59:44.351882] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-22T20:59:44.351947] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-22T20:59:44.352501] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-22T20:59:44.352563] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-22T20:59:44.532728] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-22T20:59:44.750696] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T20:59:44.874463] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-22T20:59:45.330605] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-22T20:59:45.353135] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T20:59:46.122012] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-22T20:59:46.335804] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T20:59:46.653770] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-22T20:59:46.922109] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-22T20:59:47.722051] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-22T20:59:47.832890] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T20:59:48.280977] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-22T20:59:48.522114] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-22T20:59:49.322061] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-22T20:59:49.383372] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T20:59:49.652604] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-22T20:59:50.122159] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-22T20:59:50.922018] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-22T20:59:51.279505] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T20:59:51.532930] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T20:59:51.722104] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-22T20:59:52.419962] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-22T20:59:52.522135] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-22T20:59:53.322024] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-22T20:59:53.426738] [DEBUG] [REMOTE ] RIO: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-22T20:59:53.427107] [WARN ] [REMOTE ] RIO: No data returned for month 2025-04 [2025-09-22T20:59:53.441343] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T20:59:53.638308] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T20:59:54.122069] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-22T20:59:54.922118] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-22T20:59:55.722080] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-22T20:59:55.989061] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-22T20:59:56.522072] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-22T20:59:56.569207] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T20:59:56.716729] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T20:59:57.322062] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-22T20:59:58.122035] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-22T20:59:58.602013] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-22T20:59:58.922065] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-22T20:59:59.120850] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T20:59:59.722033] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-22T21:00:00.039616] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T21:00:00.522119] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-22T21:00:00.574837] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T21:00:01.220000] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-22T21:00:01.322109] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-22T21:00:02.122146] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-22T21:00:02.713734] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-22T21:00:02.922124] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-22T21:00:03.257822] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T21:00:03.586344] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-22T21:00:03.595890] [INFO ] [REMOTE ] RIG: Full fetch complete (77703 records). [2025-09-22T21:00:03.596211] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-22T21:00:03.723684] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-22T21:00:04.141367] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-22T21:00:04.141481] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-22T21:00:04.143287] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-22T21:00:04.143367] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-22T21:00:04.146247] [DEBUG] [LOCAL ] RIG: Trimmed 77703 records to 53669 (keeping 200 days of data) [2025-09-22T21:00:04.509079] [DEBUG] [LOCAL ] RIG: Primary data saved (53669 records). [2025-09-22T21:00:04.509361] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-22T21:00:04.509608] [INFO ] [MAIN ] Update Progress: 1805/2372 symbols completed. RIG took 37.5s. Estimated remaining: 1h 15m 24s. Rate: 7.5 symbols/min [2025-09-22T21:00:04.546017] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-22T21:00:04.733429] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:00:04.799326] [DEBUG] [LOCAL ] RJF: Loaded 47859 existing records from primary storage. [2025-09-22T21:00:04.799572] [INFO ] [MAIN ] RJF: Loaded 47859 existing records. [2025-09-22T21:00:05.009149] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:00:05.009555] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-22T21:00:05.009611] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-22T21:00:05.011165] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-22T21:00:05.011241] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-22T21:00:05.386121] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:00:05.434691] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-22T21:00:05.471993] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:00:05.985216] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-09-22T21:00:06.122070] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-22T21:00:06.699039] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T21:00:06.703487] [INFO ] [REMOTE ] RIV: Full fetch complete (17261 records). [2025-09-22T21:00:06.703673] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-22T21:00:06.929175] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-22T21:00:07.110478] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-22T21:00:07.110637] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-22T21:00:07.111250] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-22T21:00:07.111297] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-22T21:00:07.112094] [DEBUG] [LOCAL ] RIV: Trimmed 17261 records to 11847 (keeping 200 days of data) [2025-09-22T21:00:07.191345] [DEBUG] [LOCAL ] RIV: Primary data saved (11847 records). [2025-09-22T21:00:07.191521] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-22T21:00:07.191668] [INFO ] [MAIN ] Update Progress: 1806/2372 symbols completed. RIV took 23.3s. Estimated remaining: 1h 15m 14s. Rate: 7.5 symbols/min [2025-09-22T21:00:07.387982] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:00:07.471689] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-09-22T21:00:07.505311] [DEBUG] [LOCAL ] RKT: Loaded 54500 existing records from primary storage. [2025-09-22T21:00:07.505477] [INFO ] [MAIN ] RKT: Loaded 54500 existing records. [2025-09-22T21:00:07.688383] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:00:07.688668] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-22T21:00:07.688729] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-22T21:00:07.689820] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-22T21:00:07.689880] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-22T21:00:07.732134] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-22T21:00:08.085177] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:00:08.177367] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-22T21:00:08.522086] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-22T21:00:08.756857] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T21:00:09.322080] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-22T21:00:09.522392] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T21:00:09.531225] [INFO ] [REMOTE ] RIO: Full fetch complete (69183 records). [2025-09-22T21:00:09.531390] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-22T21:00:09.731935] [WARN ] [VALIDATOR ] RIO: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-22T21:00:09.732766] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:00:09.732840] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:00:09.732978] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-22T21:00:09.733064] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-09-22T21:00:09.733103] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-09-22T21:00:09.733676] [DEBUG] [LOCAL ] RIO: Deleted derivative data file. [2025-09-22T21:00:09.733854] [INFO ] [MAIN ] Update Progress: 1807/2372 symbols completed. RIO took 30.1s. Estimated remaining: 1h 15m 4s. Rate: 7.5 symbols/min [2025-09-22T21:00:09.907197] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:00:09.960681] [DEBUG] [LOCAL ] RL: Loaded 42549 existing records from primary storage. [2025-09-22T21:00:09.960853] [INFO ] [MAIN ] RL: Loaded 42549 existing records. [2025-09-22T21:00:10.123463] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-22T21:00:10.150865] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:00:10.151121] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-22T21:00:10.151170] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-22T21:00:10.152210] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-22T21:00:10.152276] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-22T21:00:10.544847] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:00:10.579107] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-22T21:00:10.922117] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-22T21:00:11.525495] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-22T21:00:11.722063] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-22T21:00:11.983756] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-22T21:00:12.522044] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-22T21:00:12.840565] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T21:00:13.322075] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-22T21:00:13.368302] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T21:00:14.122057] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-22T21:00:14.186715] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T21:00:14.922068] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-22T21:00:15.722072] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-22T21:00:15.761208] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-22T21:00:16.522151] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-22T21:00:16.835674] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-09-22T21:00:16.935122] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-22T21:00:17.322037] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-22T21:00:17.664296] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-22T21:00:17.672755] [INFO ] [REMOTE ] RITM: Full fetch complete (76529 records). [2025-09-22T21:00:17.672896] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-22T21:00:18.076333] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-22T21:00:18.076535] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-22T21:00:18.077711] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-22T21:00:18.077788] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-22T21:00:18.105188] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T21:00:18.113474] [DEBUG] [LOCAL ] RITM: Trimmed 76529 records to 52818 (keeping 200 days of data) [2025-09-22T21:00:18.122010] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-22T21:00:18.458393] [DEBUG] [LOCAL ] RITM: Primary data saved (52818 records). [2025-09-22T21:00:18.458582] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-22T21:00:18.458719] [INFO ] [MAIN ] Update Progress: 1808/2372 symbols completed. RITM took 36.2s. Estimated remaining: 1h 14m 57s. Rate: 7.5 symbols/min [2025-09-22T21:00:18.627827] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:00:18.665367] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-22T21:00:18.665514] [INFO ] [MAIN ] RLI: Loaded 33794 existing records. [2025-09-22T21:00:18.841148] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:00:18.841444] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-22T21:00:18.841491] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-22T21:00:18.842441] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-22T21:00:18.842501] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-22T21:00:18.943887] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-22T21:00:19.211832] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:00:19.242707] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T21:00:19.722019] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-22T21:00:19.808202] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T21:00:20.522032] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-22T21:00:20.790600] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T21:00:20.831431] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T21:00:21.322081] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-22T21:00:22.122038] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-22T21:00:22.339077] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T21:00:22.922049] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-22T21:00:23.108575] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T21:00:23.587686] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T21:00:23.722113] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-22T21:00:24.428994] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T21:00:24.522068] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-22T21:00:25.101117] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T21:00:25.322110] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-22T21:00:26.122121] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-22T21:00:26.615009] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-22T21:00:26.922055] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-22T21:00:27.170939] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T21:00:27.722019] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-22T21:00:28.245725] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-22T21:00:28.424058] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T21:00:28.522042] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-22T21:00:28.902396] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T21:00:29.322057] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-22T21:00:30.127233] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-22T21:00:30.143732] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:00:30.895089] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T21:00:30.922054] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-22T21:00:31.686271] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T21:00:31.722160] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-22T21:00:32.522074] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-22T21:00:33.065842] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-22T21:00:33.265826] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-22T21:00:33.322053] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-22T21:00:34.122052] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-22T21:00:34.241469] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T21:00:34.922059] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-22T21:00:35.618831] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-22T21:00:35.691101] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T21:00:35.722075] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-22T21:00:36.522129] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-22T21:00:36.581720] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:00:37.322051] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-22T21:00:37.971246] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T21:00:38.002107] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-22T21:00:38.010806] [INFO ] [REMOTE ] RKT: Full fetch complete (77329 records). [2025-09-22T21:00:38.010969] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-22T21:00:38.127128] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-22T21:00:38.429407] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-22T21:00:38.429501] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-22T21:00:38.430776] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-22T21:00:38.430856] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-22T21:00:38.432401] [DEBUG] [LOCAL ] RKT: Trimmed 77329 records to 53721 (keeping 200 days of data) [2025-09-22T21:00:38.800442] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T21:00:38.808276] [INFO ] [REMOTE ] RL: Full fetch complete (60070 records). [2025-09-22T21:00:38.809042] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-22T21:00:38.927067] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-22T21:00:39.220835] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-22T21:00:39.221452] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-22T21:00:39.223073] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-22T21:00:39.223446] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-22T21:00:39.226777] [DEBUG] [LOCAL ] RKT: Primary data saved (53721 records). [2025-09-22T21:00:39.226973] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-22T21:00:39.227180] [INFO ] [MAIN ] Update Progress: 1809/2372 symbols completed. RKT took 32.0s. Estimated remaining: 1h 14m 53s. Rate: 7.5 symbols/min [2025-09-22T21:00:39.259532] [DEBUG] [LOCAL ] RL: Trimmed 60070 records to 41735 (keeping 200 days of data) [2025-09-22T21:00:39.511429] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:00:39.672895] [DEBUG] [LOCAL ] RLJ: Loaded 49043 existing records from primary storage. [2025-09-22T21:00:39.673533] [INFO ] [MAIN ] RLJ: Loaded 49043 existing records. [2025-09-22T21:00:39.866081] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:00:39.867385] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-22T21:00:39.868186] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-22T21:00:39.870388] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-22T21:00:39.870714] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-22T21:00:40.006869] [DEBUG] [LOCAL ] RL: Primary data saved (41735 records). [2025-09-22T21:00:40.112639] [INFO ] [MAIN ] RL: Full history saved. [2025-09-22T21:00:40.153805] [INFO ] [MAIN ] Update Progress: 1810/2372 symbols completed. RL took 30.4s. Estimated remaining: 1h 14m 42s. Rate: 7.5 symbols/min [2025-09-22T21:00:40.167977] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T21:00:40.321625] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-22T21:00:40.438756] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:00:40.510606] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:00:40.524262] [DEBUG] [LOCAL ] RLTY: Loaded 11412 existing records from primary storage. [2025-09-22T21:00:40.523903] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-22T21:00:40.525355] [INFO ] [MAIN ] RLTY: Loaded 11412 existing records. [2025-09-22T21:00:40.714077] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:00:40.714636] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-22T21:00:40.714809] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-22T21:00:40.724208] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-22T21:00:40.738858] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-22T21:00:40.805720] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T21:00:41.108726] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:00:41.322084] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-22T21:00:41.742890] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T21:00:41.750227] [INFO ] [REMOTE ] RJF: Full fetch complete (68307 records). [2025-09-22T21:00:41.750344] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-22T21:00:42.126311] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-22T21:00:42.187903] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-22T21:00:42.188033] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-22T21:00:42.189251] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-22T21:00:42.189348] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-22T21:00:42.191463] [DEBUG] [LOCAL ] RJF: Trimmed 68307 records to 47125 (keeping 200 days of data) [2025-09-22T21:00:42.333909] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T21:00:42.550804] [DEBUG] [LOCAL ] RJF: Primary data saved (47125 records). [2025-09-22T21:00:42.550959] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-22T21:00:42.551066] [INFO ] [MAIN ] Update Progress: 1811/2372 symbols completed. RJF took 38.0s. Estimated remaining: 1h 14m 33s. Rate: 7.5 symbols/min [2025-09-22T21:00:42.753924] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:00:42.778504] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T21:00:42.829347] [DEBUG] [LOCAL ] RLX: Loaded 48839 existing records from primary storage. [2025-09-22T21:00:42.829505] [INFO ] [MAIN ] RLX: Loaded 48839 existing records. [2025-09-22T21:00:42.928767] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-22T21:00:43.014940] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:00:43.015214] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-22T21:00:43.015263] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-22T21:00:43.016526] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-22T21:00:43.016586] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-22T21:00:43.373341] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:00:43.384579] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T21:00:43.722074] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-22T21:00:44.181404] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T21:00:44.187069] [INFO ] [REMOTE ] RLI: Full fetch complete (45948 records). [2025-09-22T21:00:44.187167] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-22T21:00:44.528545] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-22T21:00:44.621224] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-22T21:00:44.621639] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-22T21:00:44.622686] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-22T21:00:44.622750] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-22T21:00:44.623741] [DEBUG] [LOCAL ] RLI: Trimmed 45948 records to 33263 (keeping 200 days of data) [2025-09-22T21:00:44.695485] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T21:00:44.840611] [DEBUG] [LOCAL ] RLI: Primary data saved (33263 records). [2025-09-22T21:00:44.840793] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-22T21:00:44.840892] [INFO ] [MAIN ] Update Progress: 1812/2372 symbols completed. RLI took 26.4s. Estimated remaining: 1h 14m 23s. Rate: 7.5 symbols/min [2025-09-22T21:00:45.009578] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:00:45.020288] [DEBUG] [LOCAL ] RM: Loaded 7872 existing records from primary storage. [2025-09-22T21:00:45.020435] [INFO ] [MAIN ] RM: Loaded 7872 existing records. [2025-09-22T21:00:45.214774] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:00:45.215101] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-22T21:00:45.215168] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-22T21:00:45.215579] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-22T21:00:45.215697] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-22T21:00:45.327204] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-22T21:00:45.579013] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:00:46.122018] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-22T21:00:46.270482] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T21:00:46.406995] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T21:00:46.922056] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-22T21:00:47.722052] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-22T21:00:47.936899] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T21:00:48.100589] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T21:00:48.522029] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-22T21:00:48.645213] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-22T21:00:49.322058] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-22T21:00:50.122091] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-22T21:00:50.357013] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T21:00:50.607825] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T21:00:50.922099] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-22T21:00:50.968213] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T21:00:51.722054] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-22T21:00:51.868184] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-22T21:00:52.522075] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-22T21:00:52.955132] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T21:00:53.322060] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-22T21:00:54.122060] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-22T21:00:54.174957] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T21:00:54.230462] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T21:00:54.922106] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-22T21:00:55.504863] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T21:00:55.725167] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-22T21:00:55.726226] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T21:00:56.522085] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-22T21:00:57.327244] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-22T21:00:57.351678] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T21:00:57.369154] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T21:00:58.122063] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-22T21:00:58.922028] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-22T21:00:58.997119] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T21:00:59.056703] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T21:00:59.558948] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T21:00:59.722065] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-22T21:01:00.522167] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-22T21:01:01.180498] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T21:01:01.322060] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-22T21:01:01.636184] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T21:01:02.122093] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-22T21:01:02.922119] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-22T21:01:02.994573] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T21:01:03.179199] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-22T21:01:03.722130] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-22T21:01:03.918670] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T21:01:04.349175] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-22T21:01:04.522084] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-22T21:01:05.322143] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-22T21:01:06.122059] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-22T21:01:06.319939] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-22T21:01:06.764029] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T21:01:06.922105] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-22T21:01:07.020382] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T21:01:07.722085] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-22T21:01:07.739620] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-22T21:01:08.522098] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-22T21:01:08.620867] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T21:01:08.623458] [INFO ] [REMOTE ] RLTY: Full fetch complete (18172 records). [2025-09-22T21:01:08.623574] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-22T21:01:09.013607] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-22T21:01:09.013718] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-22T21:01:09.014165] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-22T21:01:09.014207] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-22T21:01:09.014816] [DEBUG] [LOCAL ] RLTY: Trimmed 18172 records to 11142 (keeping 200 days of data) [2025-09-22T21:01:09.088608] [DEBUG] [LOCAL ] RLTY: Primary data saved (11142 records). [2025-09-22T21:01:09.088782] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-22T21:01:09.088877] [INFO ] [MAIN ] Update Progress: 1813/2372 symbols completed. RLTY took 28.9s. Estimated remaining: 1h 14m 20s. Rate: 7.5 symbols/min [2025-09-22T21:01:09.260308] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:01:09.281384] [DEBUG] [LOCAL ] RMAX: Loaded 22107 existing records from primary storage. [2025-09-22T21:01:09.281519] [INFO ] [MAIN ] RMAX: Loaded 22107 existing records. [2025-09-22T21:01:09.327348] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-22T21:01:09.468571] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:01:09.468870] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-22T21:01:09.468920] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-22T21:01:09.469614] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-22T21:01:09.469719] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-22T21:01:09.825831] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:01:10.095549] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T21:01:10.122009] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-22T21:01:10.922053] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-22T21:01:11.153224] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T21:01:11.642396] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T21:01:11.651950] [INFO ] [REMOTE ] RLJ: Full fetch complete (69247 records). [2025-09-22T21:01:11.652112] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-22T21:01:11.727180] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-22T21:01:11.785584] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T21:01:12.104195] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-22T21:01:12.104275] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-22T21:01:12.105560] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-22T21:01:12.105625] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-22T21:01:12.107098] [DEBUG] [LOCAL ] RLJ: Trimmed 69247 records to 48288 (keeping 200 days of data) [2025-09-22T21:01:12.397213] [DEBUG] [LOCAL ] RLJ: Primary data saved (48288 records). [2025-09-22T21:01:12.397347] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-22T21:01:12.397430] [INFO ] [MAIN ] Update Progress: 1814/2372 symbols completed. RLJ took 33.2s. Estimated remaining: 1h 14m 11s. Rate: 7.5 symbols/min [2025-09-22T21:01:12.527245] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-22T21:01:12.572511] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:01:12.621605] [DEBUG] [LOCAL ] RMD: Loaded 43125 existing records from primary storage. [2025-09-22T21:01:12.621789] [INFO ] [MAIN ] RMD: Loaded 43125 existing records. [2025-09-22T21:01:12.813947] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:01:12.814266] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-22T21:01:12.814325] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-22T21:01:12.815485] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-22T21:01:12.815549] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-22T21:01:13.192118] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:01:13.220874] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T21:01:13.306881] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-22T21:01:13.308823] [INFO ] [REMOTE ] RM: Full fetch complete (11538 records). [2025-09-22T21:01:13.309082] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-22T21:01:13.330896] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-22T21:01:13.693431] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-22T21:01:13.693509] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-22T21:01:13.693830] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-22T21:01:13.693891] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-22T21:01:13.694419] [DEBUG] [LOCAL ] RM: Trimmed 11538 records to 7663 (keeping 200 days of data) [2025-09-22T21:01:13.742394] [DEBUG] [LOCAL ] RM: Primary data saved (7663 records). [2025-09-22T21:01:13.742526] [INFO ] [MAIN ] RM: Full history saved. [2025-09-22T21:01:13.742613] [INFO ] [MAIN ] Update Progress: 1815/2372 symbols completed. RM took 28.9s. Estimated remaining: 1h 14m 1s. Rate: 7.5 symbols/min [2025-09-22T21:01:13.915969] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:01:13.922980] [DEBUG] [LOCAL ] RMI: Loaded 4687 existing records from primary storage. [2025-09-22T21:01:13.923099] [INFO ] [MAIN ] RMI: Loaded 4687 existing records. [2025-09-22T21:01:14.112883] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:01:14.113194] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-22T21:01:14.113264] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-22T21:01:14.113586] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-22T21:01:14.113680] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-22T21:01:14.127135] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-22T21:01:14.510163] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:01:14.521579] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T21:01:14.922054] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-22T21:01:15.722045] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-22T21:01:15.863243] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-22T21:01:15.871366] [INFO ] [REMOTE ] RLX: Full fetch complete (70305 records). [2025-09-22T21:01:15.871515] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-22T21:01:16.307559] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-22T21:01:16.307639] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-22T21:01:16.308763] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-22T21:01:16.308827] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-22T21:01:16.310806] [DEBUG] [LOCAL ] RLX: Trimmed 70305 records to 48160 (keeping 200 days of data) [2025-09-22T21:01:16.522133] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-22T21:01:16.617887] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T21:01:16.643492] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T21:01:16.654971] [DEBUG] [LOCAL ] RLX: Primary data saved (48160 records). [2025-09-22T21:01:16.655124] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-22T21:01:16.655213] [INFO ] [MAIN ] Update Progress: 1816/2372 symbols completed. RLX took 34.1s. Estimated remaining: 1h 13m 51s. Rate: 7.5 symbols/min [2025-09-22T21:01:16.830813] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:01:16.842937] [DEBUG] [LOCAL ] RMM: Loaded 10324 existing records from primary storage. [2025-09-22T21:01:16.843061] [INFO ] [MAIN ] RMM: Loaded 10324 existing records. [2025-09-22T21:01:17.034960] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:01:17.035220] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-22T21:01:17.035268] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-22T21:01:17.035767] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-22T21:01:17.035829] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-22T21:01:17.329689] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-22T21:01:17.407000] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T21:01:17.438938] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:01:18.122067] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-22T21:01:18.643304] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-22T21:01:18.922030] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-22T21:01:19.083895] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T21:01:19.478095] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T21:01:19.722054] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-22T21:01:20.301979] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-22T21:01:20.522108] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-22T21:01:21.065445] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-22T21:01:21.322063] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-22T21:01:22.043784] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-22T21:01:22.122059] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-22T21:01:22.876975] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T21:01:22.922050] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-22T21:01:23.564031] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T21:01:23.722071] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-22T21:01:24.139627] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T21:01:24.522064] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-22T21:01:25.120811] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T21:01:25.322060] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-22T21:01:26.122100] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-22T21:01:26.922049] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-22T21:01:27.022844] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T21:01:27.202596] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T21:01:27.456829] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-22T21:01:27.722075] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-22T21:01:28.391172] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-22T21:01:28.522085] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-22T21:01:29.322106] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-22T21:01:30.122035] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-22T21:01:30.280361] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T21:01:30.387159] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T21:01:30.926076] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T21:01:30.924948] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-22T21:01:31.698182] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T21:01:31.722051] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-22T21:01:32.522050] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-22T21:01:32.543689] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T21:01:33.322040] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-22T21:01:33.679086] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T21:01:34.122095] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-22T21:01:34.282245] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T21:01:34.922104] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-22T21:01:35.350059] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T21:01:35.395890] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-22T21:01:35.722061] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-22T21:01:36.522090] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-22T21:01:37.117856] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-22T21:01:37.322072] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-22T21:01:37.721326] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T21:01:38.122025] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-22T21:01:38.268560] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T21:01:38.271338] [INFO ] [REMOTE ] RMM: Full fetch complete (14825 records). [2025-09-22T21:01:38.271409] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-22T21:01:38.645500] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-22T21:01:38.645635] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-22T21:01:38.646049] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-22T21:01:38.646114] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-22T21:01:38.646680] [DEBUG] [LOCAL ] RMM: Trimmed 14825 records to 10264 (keeping 200 days of data) [2025-09-22T21:01:38.709593] [DEBUG] [LOCAL ] RMM: Primary data saved (10264 records). [2025-09-22T21:01:38.709755] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-22T21:01:38.709852] [INFO ] [MAIN ] Update Progress: 1817/2372 symbols completed. RMM took 22.1s. Estimated remaining: 1h 13m 47s. Rate: 7.5 symbols/min [2025-09-22T21:01:38.884006] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:01:38.891746] [DEBUG] [LOCAL ] RMMZ: Loaded 4862 existing records from primary storage. [2025-09-22T21:01:38.891865] [INFO ] [MAIN ] RMMZ: Loaded 4862 existing records. [2025-09-22T21:01:38.927274] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-22T21:01:39.082541] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:01:39.082819] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-22T21:01:39.082881] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-22T21:01:39.083250] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-22T21:01:39.083309] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-22T21:01:39.329929] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T21:01:39.470853] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:01:39.722063] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-22T21:01:40.405765] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T21:01:40.491768] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T21:01:40.522003] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-22T21:01:41.193870] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-22T21:01:41.322063] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-22T21:01:41.838096] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-22T21:01:42.122077] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-22T21:01:42.922060] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-22T21:01:43.574341] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-22T21:01:43.576205] [INFO ] [REMOTE ] RMI: Full fetch complete (6361 records). [2025-09-22T21:01:43.576288] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-22T21:01:43.726883] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-22T21:01:43.931400] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T21:01:43.997315] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-22T21:01:43.997404] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-22T21:01:43.997633] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-22T21:01:43.997720] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-22T21:01:43.998153] [DEBUG] [LOCAL ] RMI: Trimmed 6361 records to 4662 (keeping 200 days of data) [2025-09-22T21:01:44.026972] [DEBUG] [LOCAL ] RMI: Primary data saved (4662 records). [2025-09-22T21:01:44.027058] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-22T21:01:44.027136] [INFO ] [MAIN ] Update Progress: 1818/2372 symbols completed. RMI took 30.3s. Estimated remaining: 1h 13m 39s. Rate: 7.5 symbols/min [2025-09-22T21:01:44.197249] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:01:44.215432] [DEBUG] [LOCAL ] RMT: Loaded 18024 existing records from primary storage. [2025-09-22T21:01:44.215559] [INFO ] [MAIN ] RMT: Loaded 18024 existing records. [2025-09-22T21:01:44.402803] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:01:44.403055] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-22T21:01:44.403102] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-22T21:01:44.403843] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-22T21:01:44.403903] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-22T21:01:44.527183] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-22T21:01:44.764199] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:01:45.054026] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-22T21:01:45.151461] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T21:01:45.322060] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-22T21:01:46.122030] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-22T21:01:46.434598] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T21:01:46.567027] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-22T21:01:46.922067] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-22T21:01:47.416866] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-22T21:01:47.722100] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-22T21:01:48.385731] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T21:01:48.522097] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-22T21:01:49.322058] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-22T21:01:49.763728] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T21:01:49.991889] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-22T21:01:50.122062] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-22T21:01:50.922065] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-22T21:01:51.654262] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T21:01:51.657964] [INFO ] [REMOTE ] RMAX: Full fetch complete (29672 records). [2025-09-22T21:01:51.658082] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-22T21:01:51.725441] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-22T21:01:52.079862] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-22T21:01:52.080556] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-22T21:01:52.081847] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T21:01:52.082708] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-22T21:01:52.091377] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-22T21:01:52.093125] [DEBUG] [LOCAL ] RMAX: Trimmed 29672 records to 21874 (keeping 200 days of data) [2025-09-22T21:01:52.224970] [DEBUG] [LOCAL ] RMAX: Primary data saved (21874 records). [2025-09-22T21:01:52.225105] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-22T21:01:52.225186] [INFO ] [MAIN ] Update Progress: 1819/2372 symbols completed. RMAX took 43.1s. Estimated remaining: 1h 13m 31s. Rate: 7.5 symbols/min [2025-09-22T21:01:52.394401] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:01:52.439078] [DEBUG] [LOCAL ] RNG: Loaded 48950 existing records from primary storage. [2025-09-22T21:01:52.439218] [INFO ] [MAIN ] RNG: Loaded 48950 existing records. [2025-09-22T21:01:52.531269] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-22T21:01:52.623738] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:01:52.623955] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-22T21:01:52.624013] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-22T21:01:52.625321] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-22T21:01:52.625392] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-22T21:01:53.012234] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:01:53.024932] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T21:01:53.322063] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-22T21:01:54.122100] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-22T21:01:54.155364] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T21:01:54.574782] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T21:01:54.922060] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-22T21:01:55.469469] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-22T21:01:55.470726] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7239 records). [2025-09-22T21:01:55.470796] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-22T21:01:55.732361] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-22T21:01:55.877777] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-22T21:01:55.877957] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-22T21:01:55.878175] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-22T21:01:55.878249] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-22T21:01:55.878921] [DEBUG] [LOCAL ] RMMZ: Trimmed 7239 records to 4827 (keeping 200 days of data) [2025-09-22T21:01:55.929193] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T21:01:55.947191] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4827 records). [2025-09-22T21:01:55.947281] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-22T21:01:55.947355] [INFO ] [MAIN ] Update Progress: 1820/2372 symbols completed. RMMZ took 17.2s. Estimated remaining: 1h 13m 21s. Rate: 7.5 symbols/min [2025-09-22T21:01:56.127211] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:01:56.153039] [DEBUG] [LOCAL ] RNGR: Loaded 20800 existing records from primary storage. [2025-09-22T21:01:56.153180] [INFO ] [MAIN ] RNGR: Loaded 20800 existing records. [2025-09-22T21:01:56.353055] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:01:56.353328] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-22T21:01:56.353377] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-22T21:01:56.354910] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-22T21:01:56.354973] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-22T21:01:56.527198] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-22T21:01:56.840096] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T21:01:56.923310] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:01:57.322079] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-22T21:01:57.867366] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T21:01:57.874384] [INFO ] [REMOTE ] RMD: Full fetch complete (60905 records). [2025-09-22T21:01:57.874596] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-22T21:01:58.128066] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-22T21:01:58.298167] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-22T21:01:58.298263] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-22T21:01:58.299323] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-22T21:01:58.299392] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-22T21:01:58.301056] [DEBUG] [LOCAL ] RMD: Trimmed 60905 records to 42401 (keeping 200 days of data) [2025-09-22T21:01:58.429905] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T21:01:58.621908] [DEBUG] [LOCAL ] RMD: Primary data saved (42401 records). [2025-09-22T21:01:58.622049] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-22T21:01:58.622229] [INFO ] [MAIN ] Update Progress: 1821/2372 symbols completed. RMD took 46.2s. Estimated remaining: 1h 13m 12s. Rate: 7.5 symbols/min [2025-09-22T21:01:58.808163] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:01:58.826674] [DEBUG] [LOCAL ] RNP: Loaded 16058 existing records from primary storage. [2025-09-22T21:01:58.826844] [INFO ] [MAIN ] RNP: Loaded 16058 existing records. [2025-09-22T21:01:58.927247] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-22T21:01:59.031529] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:01:59.031794] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-22T21:01:59.031849] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-22T21:01:59.032395] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-22T21:01:59.032461] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-22T21:01:59.252144] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T21:01:59.458521] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:01:59.722105] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-22T21:02:00.436784] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T21:02:00.522090] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-22T21:02:00.845898] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T21:02:01.322054] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-22T21:02:02.122105] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-22T21:02:02.293347] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T21:02:02.323345] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T21:02:02.922074] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-22T21:02:03.279505] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T21:02:03.722104] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-22T21:02:04.012348] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T21:02:04.522109] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-22T21:02:05.322175] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-22T21:02:05.471354] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T21:02:05.640619] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T21:02:06.122110] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-22T21:02:06.377920] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-22T21:02:06.922038] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-22T21:02:07.114162] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T21:02:07.722037] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-22T21:02:07.990474] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T21:02:08.522024] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-22T21:02:08.898980] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T21:02:09.322067] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-22T21:02:09.610225] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T21:02:10.113739] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T21:02:10.122009] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-22T21:02:10.922086] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-22T21:02:11.286518] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T21:02:11.722053] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-22T21:02:11.877479] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T21:02:12.522106] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-22T21:02:12.765928] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T21:02:13.322087] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-22T21:02:13.504359] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T21:02:14.122052] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-22T21:02:14.922040] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-22T21:02:15.069840] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T21:02:15.100914] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-22T21:02:15.722090] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-22T21:02:15.922348] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T21:02:16.522088] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-22T21:02:16.552300] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T21:02:16.555327] [INFO ] [REMOTE ] RMT: Full fetch complete (25486 records). [2025-09-22T21:02:16.555457] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-22T21:02:16.959360] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-22T21:02:16.959483] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-22T21:02:16.960204] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-22T21:02:16.960312] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-22T21:02:16.961466] [DEBUG] [LOCAL ] RMT: Trimmed 25486 records to 17603 (keeping 200 days of data) [2025-09-22T21:02:17.093197] [DEBUG] [LOCAL ] RMT: Primary data saved (17603 records). [2025-09-22T21:02:17.093355] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-22T21:02:17.093570] [INFO ] [MAIN ] Update Progress: 1822/2372 symbols completed. RMT took 33.1s. Estimated remaining: 1h 13m 7s. Rate: 7.5 symbols/min [2025-09-22T21:02:17.281892] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:02:17.329674] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-22T21:02:17.333174] [DEBUG] [LOCAL ] RNR: Loaded 35210 existing records from primary storage. [2025-09-22T21:02:17.333276] [INFO ] [MAIN ] RNR: Loaded 35210 existing records. [2025-09-22T21:02:17.521846] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:02:17.522215] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-22T21:02:17.522267] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-22T21:02:17.523524] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-22T21:02:17.523595] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-22T21:02:17.772590] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T21:02:17.917214] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:02:18.122053] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-22T21:02:18.922035] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-22T21:02:19.145928] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T21:02:19.229446] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T21:02:19.722061] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-22T21:02:20.087063] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T21:02:20.093035] [INFO ] [REMOTE ] RNGR: Full fetch complete (28508 records). [2025-09-22T21:02:20.093217] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-22T21:02:20.492315] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-22T21:02:20.492410] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-22T21:02:20.493101] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-22T21:02:20.493181] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-22T21:02:20.495380] [DEBUG] [LOCAL ] RNGR: Trimmed 28508 records to 20420 (keeping 200 days of data) [2025-09-22T21:02:20.554770] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-22T21:02:20.635430] [DEBUG] [LOCAL ] RNGR: Primary data saved (20420 records). [2025-09-22T21:02:20.635563] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-22T21:02:20.635726] [INFO ] [MAIN ] Update Progress: 1823/2372 symbols completed. RNGR took 24.7s. Estimated remaining: 1h 12m 58s. Rate: 7.5 symbols/min [2025-09-22T21:02:20.805887] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:02:20.860443] [DEBUG] [LOCAL ] RNST: Loaded 37867 existing records from primary storage. [2025-09-22T21:02:20.860621] [INFO ] [MAIN ] RNST: Loaded 37867 existing records. [2025-09-22T21:02:21.053563] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:02:21.054061] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-22T21:02:21.054155] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-22T21:02:21.055347] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-22T21:02:21.055436] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-22T21:02:21.326063] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-22T21:02:21.353174] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T21:02:21.465278] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:02:22.123697] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-22T21:02:22.126709] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T21:02:22.266302] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T21:02:22.922080] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-22T21:02:23.582791] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T21:02:23.722081] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-22T21:02:24.237767] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T21:02:24.522089] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-22T21:02:25.162545] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T21:02:25.322056] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-22T21:02:25.677283] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T21:02:26.122134] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-22T21:02:26.837304] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T21:02:26.922054] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-22T21:02:27.696384] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T21:02:27.722005] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-22T21:02:28.463621] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T21:02:28.522057] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-22T21:02:29.322061] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-22T21:02:29.452587] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-22T21:02:30.124158] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-22T21:02:30.126925] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T21:02:30.922027] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-22T21:02:31.117675] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T21:02:31.722028] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-22T21:02:31.758459] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T21:02:31.768710] [INFO ] [REMOTE ] RNG: Full fetch complete (69502 records). [2025-09-22T21:02:31.768839] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-22T21:02:32.198276] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-22T21:02:32.198467] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-22T21:02:32.199688] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-22T21:02:32.199812] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-22T21:02:32.203325] [DEBUG] [LOCAL ] RNG: Trimmed 69502 records to 48169 (keeping 200 days of data) [2025-09-22T21:02:32.524449] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-22T21:02:32.527035] [DEBUG] [LOCAL ] RNG: Primary data saved (48169 records). [2025-09-22T21:02:32.527301] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-22T21:02:32.527598] [INFO ] [MAIN ] Update Progress: 1824/2372 symbols completed. RNG took 40.3s. Estimated remaining: 1h 12m 51s. Rate: 7.5 symbols/min [2025-09-22T21:02:32.668958] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T21:02:32.754193] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:02:32.778350] [DEBUG] [LOCAL ] ROG: Loaded 23676 existing records from primary storage. [2025-09-22T21:02:32.778503] [INFO ] [MAIN ] ROG: Loaded 23676 existing records. [2025-09-22T21:02:32.955835] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:02:32.956120] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-22T21:02:32.956168] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-22T21:02:32.956978] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-22T21:02:32.957038] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-22T21:02:33.328730] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:02:33.324390] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-22T21:02:33.378425] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T21:02:33.441989] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T21:02:34.122116] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-22T21:02:34.892902] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T21:02:34.922017] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-22T21:02:35.518326] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T21:02:35.722055] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-22T21:02:36.080227] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T21:02:36.522064] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-22T21:02:37.318933] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T21:02:37.322028] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-22T21:02:37.659271] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T21:02:38.122058] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-22T21:02:38.183450] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-22T21:02:38.922068] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-22T21:02:39.637551] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T21:02:39.722009] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-22T21:02:40.249230] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T21:02:40.522031] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-22T21:02:41.015163] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T21:02:41.021020] [INFO ] [REMOTE ] RNST: Full fetch complete (52749 records). [2025-09-22T21:02:41.021171] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-22T21:02:41.327112] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-22T21:02:41.405619] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-22T21:02:41.405725] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-22T21:02:41.406630] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-22T21:02:41.406708] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-22T21:02:41.407770] [DEBUG] [LOCAL ] RNST: Trimmed 52749 records to 37229 (keeping 200 days of data) [2025-09-22T21:02:41.601736] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T21:02:41.658345] [DEBUG] [LOCAL ] RNST: Primary data saved (37229 records). [2025-09-22T21:02:41.658448] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-22T21:02:41.658527] [INFO ] [MAIN ] Update Progress: 1825/2372 symbols completed. RNST took 21.0s. Estimated remaining: 1h 12m 43s. Rate: 7.5 symbols/min [2025-09-22T21:02:41.826456] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:02:41.874694] [DEBUG] [LOCAL ] ROK: Loaded 44736 existing records from primary storage. [2025-09-22T21:02:41.874833] [INFO ] [MAIN ] ROK: Loaded 44736 existing records. [2025-09-22T21:02:42.050751] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:02:42.051038] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-22T21:02:42.051085] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-22T21:02:42.052624] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-22T21:02:42.052713] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-22T21:02:42.127235] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-22T21:02:42.399201] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T21:02:42.432020] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:02:42.922062] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-22T21:02:43.310778] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T21:02:43.722051] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-22T21:02:44.522025] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-22T21:02:44.629085] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T21:02:45.131082] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T21:02:45.322054] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-22T21:02:45.773557] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T21:02:45.778733] [INFO ] [REMOTE ] RNR: Full fetch complete (51439 records). [2025-09-22T21:02:45.778876] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-22T21:02:46.127202] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-22T21:02:46.243495] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-22T21:02:46.243591] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-22T21:02:46.244556] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-22T21:02:46.244623] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-22T21:02:46.247927] [DEBUG] [LOCAL ] RNR: Trimmed 51439 records to 34514 (keeping 200 days of data) [2025-09-22T21:02:46.483454] [DEBUG] [LOCAL ] RNR: Primary data saved (34514 records). [2025-09-22T21:02:46.483602] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-22T21:02:46.485831] [INFO ] [MAIN ] Update Progress: 1826/2372 symbols completed. RNR took 29.4s. Estimated remaining: 1h 12m 34s. Rate: 7.5 symbols/min [2025-09-22T21:02:46.667447] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:02:46.725204] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T21:02:46.750440] [DEBUG] [LOCAL ] ROL: Loaded 51014 existing records from primary storage. [2025-09-22T21:02:46.750598] [INFO ] [MAIN ] ROL: Loaded 51014 existing records. [2025-09-22T21:02:46.932368] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-22T21:02:46.939376] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:02:46.939626] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-22T21:02:46.939731] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-22T21:02:46.940921] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-22T21:02:46.941004] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-22T21:02:47.315897] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:02:47.324299] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T21:02:47.327288] [INFO ] [REMOTE ] RNP: Full fetch complete (23411 records). [2025-09-22T21:02:47.327375] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-22T21:02:47.701997] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-22T21:02:47.702095] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-22T21:02:47.702639] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-22T21:02:47.702732] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-22T21:02:47.703368] [DEBUG] [LOCAL ] RNP: Trimmed 23411 records to 15794 (keeping 200 days of data) [2025-09-22T21:02:47.751324] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-22T21:02:47.809441] [DEBUG] [LOCAL ] RNP: Primary data saved (15794 records). [2025-09-22T21:02:47.809563] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-22T21:02:47.809673] [INFO ] [MAIN ] Update Progress: 1827/2372 symbols completed. RNP took 49.2s. Estimated remaining: 1h 12m 24s. Rate: 7.5 symbols/min [2025-09-22T21:02:47.982954] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:02:48.030955] [DEBUG] [LOCAL ] RPM: Loaded 41664 existing records from primary storage. [2025-09-22T21:02:48.031129] [INFO ] [MAIN ] RPM: Loaded 41664 existing records. [2025-09-22T21:02:48.212176] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:02:48.212444] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-22T21:02:48.212497] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-22T21:02:48.213576] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-22T21:02:48.213638] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-22T21:02:48.524261] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-22T21:02:48.589866] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:02:48.615838] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T21:02:49.322027] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-22T21:02:49.616359] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T21:02:50.034458] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T21:02:50.122102] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-22T21:02:50.857639] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T21:02:50.922124] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-22T21:02:51.722116] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-22T21:02:51.943580] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T21:02:52.388857] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T21:02:52.522085] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-22T21:02:52.975795] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T21:02:53.322068] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-22T21:02:53.889830] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T21:02:54.122035] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-22T21:02:54.404336] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-22T21:02:54.922121] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-22T21:02:55.722044] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-22T21:02:55.981380] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T21:02:56.034285] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T21:02:56.522097] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-22T21:02:57.322065] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-22T21:02:57.452448] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T21:02:57.510403] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T21:02:58.122059] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-22T21:02:58.922064] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-22T21:02:59.089774] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T21:02:59.403394] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-22T21:02:59.722061] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-22T21:03:00.409892] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T21:03:00.522077] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-22T21:03:00.773969] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T21:03:00.778696] [INFO ] [REMOTE ] ROG: Full fetch complete (30582 records). [2025-09-22T21:03:00.778822] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-22T21:03:01.171902] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-22T21:03:01.171987] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-22T21:03:01.172604] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-22T21:03:01.172664] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-22T21:03:01.173396] [DEBUG] [LOCAL ] ROG: Trimmed 30582 records to 23190 (keeping 200 days of data) [2025-09-22T21:03:01.310375] [DEBUG] [LOCAL ] ROG: Primary data saved (23190 records). [2025-09-22T21:03:01.310507] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-22T21:03:01.310590] [INFO ] [MAIN ] Update Progress: 1828/2372 symbols completed. ROG took 28.8s. Estimated remaining: 1h 12m 18s. Rate: 7.5 symbols/min [2025-09-22T21:03:01.331564] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-22T21:03:01.482480] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:03:01.482637] [DEBUG] [LOCAL ] RPT: No existing data file found in primary storage. [2025-09-22T21:03:01.482715] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-09-22T21:03:01.482852] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-22T21:03:01.482895] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-22T21:03:01.482984] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-09-22T21:03:01.483032] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-22T21:03:01.834400] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:03:02.122057] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-22T21:03:02.922900] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-22T21:03:02.925946] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-22T21:03:03.722063] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-22T21:03:04.841335] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (3.51 seconds). [2025-09-22T21:03:04.850881] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-22T21:03:04.913603] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-09-22T21:03:05.322079] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-22T21:03:05.528321] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-22T21:03:05.570545] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T21:03:06.122070] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-22T21:03:06.204631] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T21:03:06.455329] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T21:03:06.922074] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-22T21:03:07.727148] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-22T21:03:07.741357] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:03:08.438356] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T21:03:08.522079] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-22T21:03:09.322053] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-22T21:03:09.457985] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T21:03:10.122099] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-22T21:03:10.400304] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T21:03:10.890750] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T21:03:10.922022] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-22T21:03:11.722064] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-22T21:03:11.966576] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T21:03:12.522123] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-22T21:03:13.322026] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-22T21:03:13.594050] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-22T21:03:14.022152] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-22T21:03:14.122064] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-22T21:03:14.243003] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-22T21:03:14.922111] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-22T21:03:15.430439] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-22T21:03:15.632068] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T21:03:15.638771] [INFO ] [REMOTE ] RPM: Full fetch complete (58581 records). [2025-09-22T21:03:15.638932] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-22T21:03:15.727262] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-22T21:03:16.050837] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-22T21:03:16.051077] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-22T21:03:16.052131] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-22T21:03:16.052284] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-22T21:03:16.056191] [DEBUG] [LOCAL ] RPM: Trimmed 58581 records to 41138 (keeping 200 days of data) [2025-09-22T21:03:16.174092] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T21:03:16.183404] [INFO ] [REMOTE ] ROK: Full fetch complete (63438 records). [2025-09-22T21:03:16.185490] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-22T21:03:16.526284] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-22T21:03:16.649376] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-22T21:03:16.649474] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-22T21:03:16.650753] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-22T21:03:16.705935] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-22T21:03:16.755771] [DEBUG] [LOCAL ] ROK: Trimmed 63438 records to 43991 (keeping 200 days of data) [2025-09-22T21:03:16.894821] [DEBUG] [LOCAL ] RPM: Primary data saved (41138 records). [2025-09-22T21:03:16.896289] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-22T21:03:16.897684] [INFO ] [MAIN ] Update Progress: 1829/2372 symbols completed. RPM took 29.1s. Estimated remaining: 1h 12m 12s. Rate: 7.5 symbols/min [2025-09-22T21:03:17.097994] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:03:17.232032] [DEBUG] [LOCAL ] RQI: Loaded 29618 existing records from primary storage. [2025-09-22T21:03:17.232968] [INFO ] [MAIN ] RQI: Loaded 29618 existing records. [2025-09-22T21:03:17.452713] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:03:17.456205] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-22T21:03:17.456339] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-22T21:03:17.464439] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-22T21:03:17.478304] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-22T21:03:17.491494] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T21:03:17.563468] [INFO ] [REMOTE ] ROL: Full fetch complete (72548 records). [2025-09-22T21:03:17.564354] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-22T21:03:18.134285] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T21:03:18.225851] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:03:18.236676] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-22T21:03:18.247299] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-22T21:03:18.303357] [DEBUG] [LOCAL ] ROK: Primary data saved (43991 records). [2025-09-22T21:03:18.308969] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-22T21:03:18.314721] [INFO ] [MAIN ] Update Progress: 1830/2372 symbols completed. ROK took 36.7s. Estimated remaining: 1h 12m 3s. Rate: 7.5 symbols/min [2025-09-22T21:03:18.486357] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-22T21:03:18.498413] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-22T21:03:18.499853] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-22T21:03:18.505321] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-22T21:03:18.554939] [DEBUG] [LOCAL ] ROL: Trimmed 72548 records to 50278 (keeping 200 days of data) [2025-09-22T21:03:18.572695] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:03:18.732341] [DEBUG] [LOCAL ] RRC: Loaded 53556 existing records from primary storage. [2025-09-22T21:03:18.732506] [INFO ] [MAIN ] RRC: Loaded 53556 existing records. [2025-09-22T21:03:19.021582] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:03:19.023379] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-22T21:03:19.024006] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-22T21:03:19.026155] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-22T21:03:19.027233] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-22T21:03:19.420270] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:03:19.421863] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-22T21:03:19.493521] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T21:03:19.514208] [DEBUG] [LOCAL ] ROL: Primary data saved (50278 records). [2025-09-22T21:03:19.514383] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-22T21:03:19.514525] [INFO ] [MAIN ] Update Progress: 1831/2372 symbols completed. ROL took 33.0s. Estimated remaining: 1h 11m 53s. Rate: 7.5 symbols/min [2025-09-22T21:03:19.693543] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:03:19.723354] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-22T21:03:19.743530] [DEBUG] [LOCAL ] RRX: Loaded 41720 existing records from primary storage. [2025-09-22T21:03:19.743742] [INFO ] [MAIN ] RRX: Loaded 41720 existing records. [2025-09-22T21:03:19.954725] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:03:19.956244] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T21:03:19.956494] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-22T21:03:19.963417] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-22T21:03:19.964349] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-22T21:03:19.964417] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-22T21:03:20.334988] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:03:20.522037] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-22T21:03:20.830083] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T21:03:20.864472] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T21:03:21.322051] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-22T21:03:21.692926] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-22T21:03:22.122136] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-22T21:03:22.732171] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T21:03:22.922065] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-22T21:03:23.722090] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-22T21:03:23.838693] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T21:03:24.164115] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-22T21:03:24.522071] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-22T21:03:25.322065] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-22T21:03:25.437829] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T21:03:25.584219] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T21:03:26.122088] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-22T21:03:26.824722] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T21:03:26.922091] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-22T21:03:27.074499] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-22T21:03:27.077600] [INFO ] [REMOTE ] RPT: Full fetch complete (28676 records). [2025-09-22T21:03:27.077736] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-22T21:03:27.465545] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-22T21:03:27.465632] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-22T21:03:27.466316] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-22T21:03:27.466392] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-22T21:03:27.467301] [DEBUG] [LOCAL ] RPT: Trimmed 28676 records to 19586 (keeping 200 days of data) [2025-09-22T21:03:27.582437] [DEBUG] [LOCAL ] RPT: Primary data saved (19586 records). [2025-09-22T21:03:27.582591] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-22T21:03:27.582693] [INFO ] [MAIN ] Update Progress: 1832/2372 symbols completed. RPT took 26.3s. Estimated remaining: 1h 11m 45s. Rate: 7.5 symbols/min [2025-09-22T21:03:27.725176] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-22T21:03:27.757437] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:03:27.785055] [DEBUG] [LOCAL ] RS: Loaded 26305 existing records from primary storage. [2025-09-22T21:03:27.785186] [INFO ] [MAIN ] RS: Loaded 26305 existing records. [2025-09-22T21:03:27.969894] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:03:27.970286] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-22T21:03:27.970356] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-22T21:03:27.971072] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-22T21:03:27.971131] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-22T21:03:28.371097] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T21:03:28.377841] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:03:28.522091] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-22T21:03:29.322055] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-22T21:03:29.447965] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T21:03:29.645376] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T21:03:30.122067] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-22T21:03:30.347266] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T21:03:30.922061] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-22T21:03:31.722036] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-22T21:03:31.766250] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T21:03:32.522066] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-22T21:03:32.820720] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T21:03:32.850615] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-22T21:03:33.322083] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-22T21:03:33.558569] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-22T21:03:34.122064] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-22T21:03:34.430540] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T21:03:34.922062] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-22T21:03:35.722086] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-22T21:03:35.813468] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T21:03:36.313466] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T21:03:36.522144] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-22T21:03:36.785905] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T21:03:37.322077] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-22T21:03:38.103364] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:03:38.122030] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-22T21:03:38.656993] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T21:03:38.922060] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-22T21:03:39.420613] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T21:03:39.722055] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-22T21:03:40.307342] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T21:03:40.522080] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-22T21:03:41.294398] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T21:03:41.322041] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-22T21:03:41.861229] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T21:03:42.122058] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-22T21:03:42.922027] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-22T21:03:42.956769] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T21:03:43.722062] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-22T21:03:44.170599] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-22T21:03:44.230462] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T21:03:44.522125] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-22T21:03:45.054550] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T21:03:45.322093] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-22T21:03:45.913115] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T21:03:46.122096] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-22T21:03:46.912329] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T21:03:46.919463] [INFO ] [REMOTE ] RRX: Full fetch complete (57920 records). [2025-09-22T21:03:46.919630] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-22T21:03:46.933088] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-22T21:03:47.351698] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-22T21:03:47.351787] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-22T21:03:47.352768] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-22T21:03:47.352830] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-22T21:03:47.354060] [DEBUG] [LOCAL ] RRX: Trimmed 57920 records to 41123 (keeping 200 days of data) [2025-09-22T21:03:47.610166] [DEBUG] [LOCAL ] RRX: Primary data saved (41123 records). [2025-09-22T21:03:47.610321] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-22T21:03:47.611065] [INFO ] [MAIN ] Update Progress: 1833/2372 symbols completed. RRX took 28.1s. Estimated remaining: 1h 11m 40s. Rate: 7.5 symbols/min [2025-09-22T21:03:47.724508] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-22T21:03:47.785392] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:03:47.792552] [DEBUG] [LOCAL ] RSF: Loaded 4199 existing records from primary storage. [2025-09-22T21:03:47.793056] [INFO ] [MAIN ] RSF: Loaded 4199 existing records. [2025-09-22T21:03:48.000457] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:03:48.005442] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-22T21:03:48.005799] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-22T21:03:48.008676] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T21:03:48.008779] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-22T21:03:48.008983] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-22T21:03:48.410903] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:03:48.522021] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-22T21:03:48.540791] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T21:03:49.060864] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-22T21:03:49.215347] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T21:03:49.322050] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-22T21:03:50.122085] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-22T21:03:50.497679] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T21:03:50.503470] [INFO ] [REMOTE ] RQI: Full fetch complete (43159 records). [2025-09-22T21:03:50.503559] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-22T21:03:50.889399] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-22T21:03:50.889511] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-22T21:03:50.890392] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-22T21:03:50.890457] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-22T21:03:50.891709] [DEBUG] [LOCAL ] RQI: Trimmed 43159 records to 29114 (keeping 200 days of data) [2025-09-22T21:03:50.947077] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-22T21:03:51.085048] [DEBUG] [LOCAL ] RQI: Primary data saved (29114 records). [2025-09-22T21:03:51.085223] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-22T21:03:51.085352] [INFO ] [MAIN ] Update Progress: 1834/2372 symbols completed. RQI took 34.2s. Estimated remaining: 1h 11m 31s. Rate: 7.5 symbols/min [2025-09-22T21:03:51.274020] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:03:51.322062] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-22T21:03:51.343285] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-22T21:03:51.343932] [INFO ] [MAIN ] RSG: Loaded 48173 existing records. [2025-09-22T21:03:51.539776] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:03:51.540043] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-22T21:03:51.540113] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-22T21:03:51.541402] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-22T21:03:51.541481] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-22T21:03:51.732105] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-22T21:03:51.925061] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:03:52.522049] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-22T21:03:52.678594] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T21:03:52.700007] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T21:03:52.703879] [INFO ] [REMOTE ] RS: Full fetch complete (39423 records). [2025-09-22T21:03:52.703973] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-22T21:03:53.096085] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-22T21:03:53.096202] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-22T21:03:53.096995] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-22T21:03:53.097058] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-22T21:03:53.097989] [DEBUG] [LOCAL ] RS: Trimmed 39423 records to 25645 (keeping 200 days of data) [2025-09-22T21:03:53.266504] [DEBUG] [LOCAL ] RS: Primary data saved (25645 records). [2025-09-22T21:03:53.266669] [INFO ] [MAIN ] RS: Full history saved. [2025-09-22T21:03:53.266794] [INFO ] [MAIN ] Update Progress: 1835/2372 symbols completed. RS took 25.7s. Estimated remaining: 1h 11m 21s. Rate: 7.5 symbols/min [2025-09-22T21:03:53.332005] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-22T21:03:53.444780] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:03:53.490556] [DEBUG] [LOCAL ] RSI: Loaded 47971 existing records from primary storage. [2025-09-22T21:03:53.490738] [INFO ] [MAIN ] RSI: Loaded 47971 existing records. [2025-09-22T21:03:53.682802] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:03:53.683131] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-22T21:03:53.683194] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-22T21:03:53.684499] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-22T21:03:53.684581] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-22T21:03:54.073126] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:03:54.078008] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T21:03:54.127155] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-22T21:03:54.142018] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T21:03:54.922068] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-22T21:03:55.536065] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T21:03:55.722035] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-22T21:03:56.093816] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-22T21:03:56.096877] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-22T21:03:56.522094] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-22T21:03:57.322074] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-22T21:03:57.951668] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-22T21:03:58.122060] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-22T21:03:58.372560] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T21:03:58.922105] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-22T21:03:59.543291] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T21:03:59.556592] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T21:03:59.722056] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-22T21:04:00.522053] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-22T21:04:01.098865] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T21:04:01.322035] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-22T21:04:01.565207] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T21:04:02.122129] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-22T21:04:02.781162] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T21:04:02.922051] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-22T21:04:02.996636] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T21:04:03.005132] [INFO ] [REMOTE ] RRC: Full fetch complete (76224 records). [2025-09-22T21:04:03.005315] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-22T21:04:03.420971] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-22T21:04:03.421056] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-22T21:04:03.422312] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-22T21:04:03.422379] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-22T21:04:03.425437] [DEBUG] [LOCAL ] RRC: Trimmed 76224 records to 52775 (keeping 200 days of data) [2025-09-22T21:04:03.736471] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-22T21:04:03.762566] [DEBUG] [LOCAL ] RRC: Primary data saved (52775 records). [2025-09-22T21:04:03.762714] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-22T21:04:03.762826] [INFO ] [MAIN ] Update Progress: 1836/2372 symbols completed. RRC took 45.4s. Estimated remaining: 1h 11m 14s. Rate: 7.5 symbols/min [2025-09-22T21:04:03.936322] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:04:03.971159] [DEBUG] [LOCAL ] RSKD: Loaded 34859 existing records from primary storage. [2025-09-22T21:04:03.971322] [INFO ] [MAIN ] RSKD: Loaded 34859 existing records. [2025-09-22T21:04:04.160828] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:04:04.161157] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-22T21:04:04.161218] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-22T21:04:04.161965] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-22T21:04:04.162026] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-22T21:04:04.524690] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-22T21:04:04.547849] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:04:05.156544] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-22T21:04:05.195147] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-22T21:04:05.322030] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-22T21:04:05.478300] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T21:04:05.756103] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-22T21:04:05.757247] [INFO ] [REMOTE ] RSF: Full fetch complete (5597 records). [2025-09-22T21:04:05.757318] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-22T21:04:06.124582] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-22T21:04:06.125072] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-22T21:04:06.126170] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-22T21:04:06.126407] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-22T21:04:06.126451] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-22T21:04:06.127192] [DEBUG] [LOCAL ] RSF: Trimmed 5597 records to 4117 (keeping 200 days of data) [2025-09-22T21:04:06.155722] [DEBUG] [LOCAL ] RSF: Primary data saved (4117 records). [2025-09-22T21:04:06.155941] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-22T21:04:06.156099] [INFO ] [MAIN ] Update Progress: 1837/2372 symbols completed. RSF took 18.5s. Estimated remaining: 1h 11m 4s. Rate: 7.5 symbols/min [2025-09-22T21:04:06.922088] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-22T21:04:07.722046] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-22T21:04:07.887632] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T21:04:08.522017] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-22T21:04:08.684952] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T21:04:08.914906] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T21:04:09.322073] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-22T21:04:10.122103] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-22T21:04:10.287357] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T21:04:10.922049] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-22T21:04:11.018324] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T21:04:11.172174] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T21:04:11.722069] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-22T21:04:12.522052] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-22T21:04:12.883629] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T21:04:13.322027] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-22T21:04:13.570679] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-22T21:04:13.783985] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T21:04:14.122128] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-22T21:04:14.886094] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T21:04:14.922033] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-22T21:04:15.722087] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-22T21:04:15.975701] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T21:04:16.420083] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T21:04:16.522023] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-22T21:04:17.016601] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T21:04:17.322054] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-22T21:04:18.080526] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T21:04:18.122008] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-22T21:04:18.545766] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T21:04:18.922050] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-22T21:04:19.722133] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-22T21:04:19.779510] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T21:04:19.859875] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T21:04:20.522088] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-22T21:04:21.322042] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-22T21:04:21.425074] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T21:04:22.122090] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-22T21:04:22.409453] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T21:04:22.635924] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T21:04:22.922120] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-22T21:04:23.722238] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-22T21:04:23.774361] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T21:04:23.782766] [INFO ] [REMOTE ] RSG: Full fetch complete (67808 records). [2025-09-22T21:04:23.782921] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-22T21:04:24.180958] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-22T21:04:24.181065] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-22T21:04:24.182444] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-22T21:04:24.182559] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-22T21:04:24.184140] [DEBUG] [LOCAL ] RSG: Trimmed 67808 records to 47449 (keeping 200 days of data) [2025-09-22T21:04:24.505672] [DEBUG] [LOCAL ] RSG: Primary data saved (47449 records). [2025-09-22T21:04:24.505817] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-22T21:04:24.505927] [INFO ] [MAIN ] Update Progress: 1838/2372 symbols completed. RSG took 33.4s. Estimated remaining: 1h 10m 59s. Rate: 7.5 symbols/min [2025-09-22T21:04:24.760406] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T21:04:24.768086] [INFO ] [REMOTE ] RSI: Full fetch complete (69464 records). [2025-09-22T21:04:24.768219] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-22T21:04:25.174321] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-22T21:04:25.174493] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-22T21:04:25.193293] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-22T21:04:25.194739] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T21:04:25.193995] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-22T21:04:25.203310] [DEBUG] [LOCAL ] RSI: Trimmed 69464 records to 47135 (keeping 200 days of data) [2025-09-22T21:04:25.203191] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-22T21:04:25.492530] [DEBUG] [LOCAL ] RSI: Primary data saved (47135 records). [2025-09-22T21:04:25.492699] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-22T21:04:25.492799] [INFO ] [MAIN ] Update Progress: 1839/2372 symbols completed. RSI took 32.2s. Estimated remaining: 1h 10m 49s. Rate: 7.5 symbols/min [2025-09-22T21:04:26.725828] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T21:04:26.734247] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-22T21:04:27.676356] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T21:04:27.681963] [INFO ] [REMOTE ] RSKD: Full fetch complete (48531 records). [2025-09-22T21:04:27.682062] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-22T21:04:28.059290] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-22T21:04:28.059369] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-22T21:04:28.060271] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-22T21:04:28.060401] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-22T21:04:28.061501] [DEBUG] [LOCAL ] RSKD: Trimmed 48531 records to 34175 (keeping 200 days of data) [2025-09-22T21:04:28.257600] [DEBUG] [LOCAL ] RSKD: Primary data saved (34175 records). [2025-09-22T21:04:28.257796] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-22T21:04:28.258025] [INFO ] [MAIN ] Update Progress: 1840/2372 symbols completed. RSKD took 24.5s. Estimated remaining: 1h 10m 40s. Rate: 7.5 symbols/min [2025-09-22T21:04:28.827568] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:04:28.898203] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:04:28.953418] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:04:29.014529] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:04:29.101965] [DEBUG] [LOCAL ] RVT: Loaded 27865 existing records from primary storage. [2025-09-22T21:04:29.102923] [DEBUG] [LOCAL ] RVLV: Loaded 48685 existing records from primary storage. [2025-09-22T21:04:29.103061] [INFO ] [MAIN ] RVT: Loaded 27865 existing records. [2025-09-22T21:04:29.103152] [INFO ] [MAIN ] RVLV: Loaded 48685 existing records. [2025-09-22T21:04:29.270205] [DEBUG] [LOCAL ] RTO: Loaded 41208 existing records from primary storage. [2025-09-22T21:04:29.296342] [INFO ] [MAIN ] RTO: Loaded 41208 existing records. [2025-09-22T21:04:29.545084] [DEBUG] [LOCAL ] RTX: Loaded 54491 existing records from primary storage. [2025-09-22T21:04:29.606948] [INFO ] [MAIN ] RTX: Loaded 54491 existing records. [2025-09-22T21:04:29.600748] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:04:29.729039] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:04:29.803609] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-22T21:04:29.814834] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:04:29.829985] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-22T21:04:29.808875] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-22T21:04:29.855151] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-22T21:04:29.865624] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-22T21:04:29.870981] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-22T21:04:29.879502] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-22T21:04:29.879609] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-22T21:04:29.883694] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-22T21:04:29.879682] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-22T21:04:29.894908] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-22T21:04:29.986834] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-22T21:04:30.212747] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:04:30.299632] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-22T21:04:30.310052] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-22T21:04:30.442555] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-22T21:04:30.489176] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-22T21:04:31.162611] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:04:31.212962] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-22T21:04:31.376082] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:04:31.418506] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-22T21:04:31.438087] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:04:31.439156] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-22T21:04:31.524511] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:04:31.524893] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-22T21:04:32.940871] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T21:04:32.969077] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-22T21:04:32.971313] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T21:04:32.978585] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-22T21:04:33.003593] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T21:04:33.011861] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-22T21:04:33.475068] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T21:04:33.486024] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-22T21:04:34.164039] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T21:04:34.170375] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-22T21:04:34.533471] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T21:04:34.543023] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-22T21:04:34.622213] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T21:04:34.632482] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-22T21:04:35.333079] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T21:04:35.339383] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-22T21:04:35.536857] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-22T21:04:35.722048] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-22T21:04:35.830758] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T21:04:36.395840] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T21:04:36.426831] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T21:04:36.522015] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-22T21:04:37.322027] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-22T21:04:37.617611] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T21:04:37.726983] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-22T21:04:38.122071] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-22T21:04:38.922069] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-22T21:04:39.719445] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-22T21:04:39.729704] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-22T21:04:40.522064] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-22T21:04:40.929351] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T21:04:41.322096] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-22T21:04:41.679967] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-22T21:04:42.122119] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-22T21:04:42.579128] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (4.46 seconds). [2025-09-22T21:04:42.649392] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T21:04:42.819216] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-22T21:04:42.922035] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-22T21:04:43.598489] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T21:04:43.722062] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-22T21:04:44.265896] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T21:04:44.522044] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-22T21:04:45.322027] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-22T21:04:45.412210] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T21:04:46.122057] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-22T21:04:46.583424] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T21:04:46.854412] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-22T21:04:46.922068] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-22T21:04:47.722047] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-22T21:04:47.769108] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T21:04:48.170265] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T21:04:48.176043] [INFO ] [REMOTE ] RVT: Full fetch complete (40145 records). [2025-09-22T21:04:48.176188] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-22T21:04:48.529687] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-22T21:04:48.586212] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-22T21:04:48.586334] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-22T21:04:48.587696] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-22T21:04:48.587779] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-22T21:04:48.589118] [DEBUG] [LOCAL ] RVT: Trimmed 40145 records to 27209 (keeping 200 days of data) [2025-09-22T21:04:48.785872] [DEBUG] [LOCAL ] RVT: Primary data saved (27209 records). [2025-09-22T21:04:48.786084] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-22T21:04:48.786209] [INFO ] [MAIN ] Update Progress: 1841/2372 symbols completed. RVT took 20.5s. Estimated remaining: 1h 10m 36s. Rate: 7.5 symbols/min [2025-09-22T21:04:48.965751] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:04:49.018880] [DEBUG] [LOCAL ] RVTY: Loaded 48310 existing records from primary storage. [2025-09-22T21:04:49.019062] [INFO ] [MAIN ] RVTY: Loaded 48310 existing records. [2025-09-22T21:04:49.200248] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:04:49.200547] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-22T21:04:49.200597] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-22T21:04:49.202375] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-22T21:04:49.202437] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-22T21:04:49.327258] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-22T21:04:49.567799] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:04:50.126450] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-22T21:04:50.120749] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-22T21:04:50.149671] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T21:04:50.922090] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-22T21:04:51.106995] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T21:04:51.722102] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-22T21:04:52.299281] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-22T21:04:52.522060] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-22T21:04:53.322411] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-22T21:04:53.322493] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-22T21:04:54.122040] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-22T21:04:54.372101] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-22T21:04:54.479364] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-22T21:04:54.922060] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-22T21:04:55.089743] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T21:04:55.722114] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-22T21:04:55.763479] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T21:04:56.271008] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T21:04:56.522071] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-22T21:04:57.285281] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T21:04:57.296864] [INFO ] [REMOTE ] RVLV: Full fetch complete (68851 records). [2025-09-22T21:04:57.297106] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-22T21:04:57.327829] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-22T21:04:57.800113] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-22T21:04:57.800211] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-22T21:04:57.801335] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-22T21:04:57.801409] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-22T21:04:57.803291] [DEBUG] [LOCAL ] RVLV: Trimmed 68851 records to 47877 (keeping 200 days of data) [2025-09-22T21:04:58.113156] [DEBUG] [LOCAL ] RVLV: Primary data saved (47877 records). [2025-09-22T21:04:58.113364] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-22T21:04:58.113481] [INFO ] [MAIN ] Update Progress: 1842/2372 symbols completed. RVLV took 29.9s. Estimated remaining: 1h 10m 28s. Rate: 7.5 symbols/min [2025-09-22T21:04:58.145538] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-22T21:04:58.289557] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:04:58.323402] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T21:04:58.365942] [DEBUG] [LOCAL ] RWT: Loaded 41133 existing records from primary storage. [2025-09-22T21:04:58.366120] [INFO ] [MAIN ] RWT: Loaded 41133 existing records. [2025-09-22T21:04:58.540679] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:04:58.540959] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-22T21:04:58.541047] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-22T21:04:58.542457] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-22T21:04:58.542520] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-22T21:04:58.898689] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:04:58.922012] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-22T21:04:59.494950] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-22T21:04:59.722123] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-22T21:05:00.034474] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T21:05:00.522063] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-22T21:05:00.639223] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T21:05:00.680689] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T21:05:01.322090] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-22T21:05:02.122114] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-22T21:05:02.592866] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-22T21:05:02.922070] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-22T21:05:03.501439] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-22T21:05:03.722087] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-22T21:05:03.746073] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T21:05:03.752911] [INFO ] [REMOTE ] RTO: Full fetch complete (58398 records). [2025-09-22T21:05:03.753043] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-22T21:05:04.156848] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-22T21:05:04.156954] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-22T21:05:04.158148] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-22T21:05:04.158219] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-22T21:05:04.162143] [DEBUG] [LOCAL ] RTO: Trimmed 58398 records to 40406 (keeping 200 days of data) [2025-09-22T21:05:04.423910] [DEBUG] [LOCAL ] RTO: Primary data saved (40406 records). [2025-09-22T21:05:04.424044] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-22T21:05:04.424127] [INFO ] [MAIN ] Update Progress: 1843/2372 symbols completed. RTO took 36.2s. Estimated remaining: 1h 10m 20s. Rate: 7.5 symbols/min [2025-09-22T21:05:04.529009] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-22T21:05:04.616026] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:05:04.616386] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-22T21:05:04.616452] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-22T21:05:04.616859] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-22T21:05:04.616940] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-22T21:05:04.617081] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-22T21:05:04.617151] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-22T21:05:04.927495] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T21:05:05.062410] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:05:05.158574] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T21:05:05.322035] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-22T21:05:06.122077] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-22T21:05:06.461395] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-22T21:05:06.470636] [INFO ] [REMOTE ] RTX: Full fetch complete (77728 records). [2025-09-22T21:05:06.470915] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-22T21:05:06.770538] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-22T21:05:06.918148] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T21:05:06.924813] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-22T21:05:06.946271] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-22T21:05:06.955024] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-22T21:05:06.960242] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-22T21:05:06.961134] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-22T21:05:06.963746] [DEBUG] [LOCAL ] RTX: Trimmed 77728 records to 53710 (keeping 200 days of data) [2025-09-22T21:05:07.345005] [DEBUG] [LOCAL ] RTX: Primary data saved (53710 records). [2025-09-22T21:05:07.345240] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-22T21:05:07.345397] [INFO ] [MAIN ] Update Progress: 1844/2372 symbols completed. RTX took 39.1s. Estimated remaining: 1h 10m 10s. Rate: 7.5 symbols/min [2025-09-22T21:05:07.531865] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:05:07.532145] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-22T21:05:07.532183] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-22T21:05:07.532374] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-22T21:05:07.532446] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-22T21:05:07.532511] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-22T21:05:07.532549] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-22T21:05:07.737262] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-22T21:05:07.939589] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:05:08.522058] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-22T21:05:08.693081] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T21:05:08.964602] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-22T21:05:09.322031] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-22T21:05:09.636544] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T21:05:10.122070] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-22T21:05:10.464113] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-22T21:05:10.922112] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-22T21:05:11.039665] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T21:05:11.722109] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-22T21:05:12.216348] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-22T21:05:12.522104] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-22T21:05:12.581366] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T21:05:13.051903] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-22T21:05:13.322054] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-22T21:05:14.122116] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-22T21:05:14.880805] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T21:05:14.922006] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-22T21:05:15.722067] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-22T21:05:15.791543] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T21:05:16.149484] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T21:05:16.306431] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T21:05:16.522057] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-22T21:05:17.322068] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-22T21:05:17.866892] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-22T21:05:18.100888] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T21:05:18.122014] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-22T21:05:18.922051] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-22T21:05:19.682138] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T21:05:19.688977] [INFO ] [REMOTE ] RWT: Full fetch complete (58456 records). [2025-09-22T21:05:19.689101] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-22T21:05:19.727162] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-22T21:05:20.091270] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-22T21:05:20.091427] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-22T21:05:20.092578] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-22T21:05:20.092675] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-22T21:05:20.093991] [DEBUG] [LOCAL ] RWT: Trimmed 58456 records to 40595 (keeping 200 days of data) [2025-09-22T21:05:20.327498] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-22T21:05:20.339328] [DEBUG] [LOCAL ] RWT: Primary data saved (40595 records). [2025-09-22T21:05:20.339441] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-22T21:05:20.339518] [INFO ] [MAIN ] Update Progress: 1845/2372 symbols completed. RWT took 22.2s. Estimated remaining: 1h 10m 4s. Rate: 7.5 symbols/min [2025-09-22T21:05:20.513729] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:05:20.513920] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-22T21:05:20.513962] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-22T21:05:20.514115] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-22T21:05:20.514157] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-22T21:05:20.514198] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-22T21:05:20.514229] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-22T21:05:20.527201] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-22T21:05:20.825023] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T21:05:20.859556] [INFO ] [REMOTE ] RVTY: Full fetch complete (66372 records). [2025-09-22T21:05:20.877505] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-22T21:05:21.013941] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:05:21.109757] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T21:05:21.318592] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-22T21:05:21.318704] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-22T21:05:21.319786] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-22T21:05:21.319852] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-22T21:05:21.321237] [DEBUG] [LOCAL ] RVTY: Trimmed 66372 records to 47584 (keeping 200 days of data) [2025-09-22T21:05:21.322040] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-22T21:05:21.622125] [DEBUG] [LOCAL ] RVTY: Primary data saved (47584 records). [2025-09-22T21:05:21.622268] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-22T21:05:21.622366] [INFO ] [MAIN ] Update Progress: 1846/2372 symbols completed. RVTY took 32.8s. Estimated remaining: 1h 9m 54s. Rate: 7.5 symbols/min [2025-09-22T21:05:21.688126] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:05:21.705212] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-22T21:05:21.796419] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:05:21.844250] [DEBUG] [LOCAL ] RXO: Loaded 48495 existing records from primary storage. [2025-09-22T21:05:21.844430] [INFO ] [MAIN ] RXO: Loaded 48495 existing records. [2025-09-22T21:05:22.026351] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:05:22.026606] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-22T21:05:22.026685] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-22T21:05:22.028056] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-22T21:05:22.028122] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-22T21:05:22.127226] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-22T21:05:22.387514] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:05:22.815563] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-22T21:05:22.922068] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-22T21:05:23.386577] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-22T21:05:23.722058] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-22T21:05:24.329751] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T21:05:24.522034] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-22T21:05:25.196041] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T21:05:25.322052] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-22T21:05:26.122094] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-22T21:05:26.637094] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-22T21:05:26.922051] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-22T21:05:26.985256] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T21:05:27.547667] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T21:05:27.722056] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-22T21:05:28.250757] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-22T21:05:28.522040] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-22T21:05:29.322069] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-22T21:05:29.860203] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-22T21:05:30.129099] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-22T21:05:30.151429] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T21:05:30.677195] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-22T21:05:30.922106] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-22T21:05:31.437329] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-22T21:05:31.722056] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-22T21:05:32.236963] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-22T21:05:32.522039] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-22T21:05:33.046871] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-22T21:05:33.322065] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-22T21:05:34.122052] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-22T21:05:34.552855] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-22T21:05:34.922060] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-22T21:05:35.054110] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T21:05:35.342661] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-22T21:05:35.722061] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-22T21:05:36.363328] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T21:05:36.522042] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-22T21:05:36.929323] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-22T21:05:37.322061] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-22T21:05:37.932824] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T21:05:38.122079] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-22T21:05:38.922069] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-22T21:05:39.568086] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-22T21:05:39.569462] [INFO ] [REMOTE ] RWTO: Full fetch complete (4730 records). [2025-09-22T21:05:39.569531] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-22T21:05:39.731743] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-22T21:05:39.776699] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T21:05:39.777017] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:05:39.777131] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:05:39.777335] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-22T21:05:39.777464] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-22T21:05:39.777593] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-22T21:05:39.777830] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-22T21:05:39.777926] [INFO ] [MAIN ] Update Progress: 1847/2372 symbols completed. RWTO took 32.4s. Estimated remaining: 1h 9m 49s. Rate: 7.5 symbols/min [2025-09-22T21:05:39.915142] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T21:05:39.997348] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:05:40.045268] [DEBUG] [LOCAL ] RY: Loaded 48722 existing records from primary storage. [2025-09-22T21:05:40.045494] [INFO ] [MAIN ] RY: Loaded 48722 existing records. [2025-09-22T21:05:40.230288] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:05:40.230557] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-22T21:05:40.230608] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-22T21:05:40.232096] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-22T21:05:40.232161] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-22T21:05:40.526531] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-22T21:05:40.612503] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T21:05:40.612363] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:05:40.614004] [INFO ] [REMOTE ] RWTN: Full fetch complete (3175 records). [2025-09-22T21:05:40.614445] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-22T21:05:40.798523] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-22T21:05:40.798769] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:05:40.798850] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:05:40.798925] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-22T21:05:40.798994] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-22T21:05:40.799031] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-22T21:05:40.799073] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-22T21:05:40.799132] [INFO ] [MAIN ] Update Progress: 1848/2372 symbols completed. RWTN took 36.4s. Estimated remaining: 1h 9m 39s. Rate: 7.5 symbols/min [2025-09-22T21:05:40.967348] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:05:41.004614] [DEBUG] [LOCAL ] RYAM: Loaded 35771 existing records from primary storage. [2025-09-22T21:05:41.004791] [INFO ] [MAIN ] RYAM: Loaded 35771 existing records. [2025-09-22T21:05:41.184115] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:05:41.184365] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-22T21:05:41.184412] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-22T21:05:41.185268] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-22T21:05:41.185350] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-22T21:05:41.325112] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-22T21:05:41.439791] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T21:05:41.458709] [INFO ] [REMOTE ] RWTP: Full fetch complete (4415 records). [2025-09-22T21:05:41.477617] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-22T21:05:41.707057] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:05:41.748845] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-09-22T21:05:41.749048] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:05:41.749114] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:05:41.749163] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-22T21:05:41.749219] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-22T21:05:41.749253] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-22T21:05:41.749291] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-22T21:05:41.749348] [INFO ] [MAIN ] Update Progress: 1849/2372 symbols completed. RWTP took 21.4s. Estimated remaining: 1h 9m 29s. Rate: 7.5 symbols/min [2025-09-22T21:05:41.921135] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:05:41.966773] [DEBUG] [LOCAL ] RYAN: Loaded 44703 existing records from primary storage. [2025-09-22T21:05:41.966937] [INFO ] [MAIN ] RYAN: Loaded 44703 existing records. [2025-09-22T21:05:42.125777] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-22T21:05:42.148945] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:05:42.149172] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-22T21:05:42.149220] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-22T21:05:42.150490] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-22T21:05:42.150554] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-22T21:05:42.503142] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:05:42.922056] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-22T21:05:43.055554] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T21:05:43.527299] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T21:05:43.722088] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-22T21:05:44.535124] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-22T21:05:44.538059] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T21:05:45.322075] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-22T21:05:45.450855] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T21:05:45.988766] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T21:05:46.122077] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-22T21:05:46.397730] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T21:05:46.922073] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-22T21:05:47.722074] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-22T21:05:47.761079] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T21:05:48.208763] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T21:05:48.522122] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-22T21:05:49.274577] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T21:05:49.322113] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-22T21:05:49.423084] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T21:05:50.122058] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-22T21:05:50.922099] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-22T21:05:51.183128] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-22T21:05:51.254748] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-22T21:05:51.722162] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-22T21:05:52.522128] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-22T21:05:52.586031] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T21:05:53.322140] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-22T21:05:53.742468] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T21:05:54.122036] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-22T21:05:54.209434] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T21:05:54.673400] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T21:05:54.922070] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-22T21:05:55.722047] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-22T21:05:55.955180] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T21:05:56.522051] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-22T21:05:56.732426] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T21:05:56.853788] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T21:05:57.322076] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-22T21:05:58.122034] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-22T21:05:58.217378] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T21:05:58.864513] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T21:05:58.922026] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-22T21:05:59.576280] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T21:05:59.584102] [INFO ] [REMOTE ] RXO: Full fetch complete (67897 records). [2025-09-22T21:05:59.584246] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-22T21:05:59.727130] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-22T21:05:59.977242] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-22T21:05:59.977338] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-22T21:05:59.978415] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-22T21:05:59.978495] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-22T21:05:59.979944] [DEBUG] [LOCAL ] RXO: Trimmed 67897 records to 47790 (keeping 200 days of data) [2025-09-22T21:06:00.264633] [DEBUG] [LOCAL ] RXO: Primary data saved (47790 records). [2025-09-22T21:06:00.264855] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-22T21:06:00.264973] [INFO ] [MAIN ] Update Progress: 1850/2372 symbols completed. RXO took 38.6s. Estimated remaining: 1h 9m 24s. Rate: 7.5 symbols/min [2025-09-22T21:06:00.457478] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:06:00.480937] [DEBUG] [LOCAL ] RYI: Loaded 21926 existing records from primary storage. [2025-09-22T21:06:00.481085] [INFO ] [MAIN ] RYI: Loaded 21926 existing records. [2025-09-22T21:06:00.541090] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-22T21:06:00.704340] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T21:06:00.716837] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:06:00.717427] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-22T21:06:00.717518] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-22T21:06:00.718539] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-22T21:06:00.718611] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-22T21:06:01.097663] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:06:01.322046] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-22T21:06:02.122101] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-22T21:06:02.164899] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-22T21:06:02.653473] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-22T21:06:02.922061] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-22T21:06:03.328911] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-22T21:06:03.722087] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-22T21:06:04.479545] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-22T21:06:04.522006] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-22T21:06:04.605503] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T21:06:05.322070] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-22T21:06:05.576337] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T21:06:06.028053] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T21:06:06.122033] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-22T21:06:06.610914] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T21:06:06.922070] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-22T21:06:07.613632] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T21:06:07.722058] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-22T21:06:08.522041] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-22T21:06:08.644035] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T21:06:09.270998] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T21:06:09.277194] [INFO ] [REMOTE ] RYAM: Full fetch complete (48640 records). [2025-09-22T21:06:09.277331] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-22T21:06:09.333926] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-22T21:06:09.667948] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-22T21:06:09.668025] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-22T21:06:09.668930] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-22T21:06:09.668991] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-22T21:06:09.670061] [DEBUG] [LOCAL ] RYAM: Trimmed 48640 records to 35308 (keeping 200 days of data) [2025-09-22T21:06:09.871921] [DEBUG] [LOCAL ] RYAM: Primary data saved (35308 records). [2025-09-22T21:06:09.872204] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-22T21:06:09.872369] [INFO ] [MAIN ] Update Progress: 1851/2372 symbols completed. RYAM took 29.1s. Estimated remaining: 1h 9m 16s. Rate: 7.5 symbols/min [2025-09-22T21:06:10.047835] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:06:10.091800] [DEBUG] [LOCAL ] RYN: Loaded 46475 existing records from primary storage. [2025-09-22T21:06:10.091965] [INFO ] [MAIN ] RYN: Loaded 46475 existing records. [2025-09-22T21:06:10.124336] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-22T21:06:10.282894] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:06:10.306625] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-22T21:06:10.306864] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-22T21:06:10.310032] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-22T21:06:10.310186] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-22T21:06:10.362402] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T21:06:10.504871] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T21:06:10.739331] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:06:10.922067] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-22T21:06:11.722060] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-22T21:06:11.782913] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T21:06:11.790144] [INFO ] [REMOTE ] RY: Full fetch complete (68549 records). [2025-09-22T21:06:11.790288] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-22T21:06:12.194161] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-22T21:06:12.194246] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-22T21:06:12.195394] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-22T21:06:12.195466] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-22T21:06:12.196931] [DEBUG] [LOCAL ] RY: Trimmed 68549 records to 47940 (keeping 200 days of data) [2025-09-22T21:06:12.521325] [DEBUG] [LOCAL ] RY: Primary data saved (47940 records). [2025-09-22T21:06:12.521507] [INFO ] [MAIN ] RY: Full history saved. [2025-09-22T21:06:12.521613] [INFO ] [MAIN ] Update Progress: 1852/2372 symbols completed. RY took 32.7s. Estimated remaining: 1h 9m 7s. Rate: 7.5 symbols/min [2025-09-22T21:06:12.527152] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-22T21:06:12.699951] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:06:12.707708] [DEBUG] [LOCAL ] RZB: Loaded 6406 existing records from primary storage. [2025-09-22T21:06:12.707798] [INFO ] [MAIN ] RZB: Loaded 6406 existing records. [2025-09-22T21:06:12.887822] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:06:12.888061] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-22T21:06:12.888120] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-22T21:06:12.888484] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-22T21:06:12.888542] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-22T21:06:13.260412] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:06:13.282310] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-22T21:06:13.321999] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-22T21:06:14.122083] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-22T21:06:14.293505] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-22T21:06:14.787800] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-22T21:06:14.909097] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-22T21:06:14.921997] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-22T21:06:15.260727] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-22T21:06:15.641069] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T21:06:15.722049] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-22T21:06:16.522059] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-22T21:06:17.158215] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-22T21:06:17.307607] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T21:06:17.322006] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-22T21:06:18.122100] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-22T21:06:18.922041] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-22T21:06:19.057903] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-22T21:06:19.094598] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T21:06:19.722065] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-22T21:06:20.370501] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T21:06:20.378123] [INFO ] [REMOTE ] RYAN: Full fetch complete (63353 records). [2025-09-22T21:06:20.378283] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-22T21:06:20.527141] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-22T21:06:20.801274] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-22T21:06:20.806610] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-22T21:06:20.815778] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-22T21:06:20.815941] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-22T21:06:20.817848] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-22T21:06:20.827382] [DEBUG] [LOCAL ] RYAN: Trimmed 63353 records to 44061 (keeping 200 days of data) [2025-09-22T21:06:21.104273] [DEBUG] [LOCAL ] RYAN: Primary data saved (44061 records). [2025-09-22T21:06:21.104410] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-22T21:06:21.104496] [INFO ] [MAIN ] Update Progress: 1853/2372 symbols completed. RYAN took 39.4s. Estimated remaining: 1h 8m 59s. Rate: 7.5 symbols/min [2025-09-22T21:06:21.281053] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:06:21.287979] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-22T21:06:21.296206] [DEBUG] [LOCAL ] RZC: Loaded 6940 existing records from primary storage. [2025-09-22T21:06:21.296301] [INFO ] [MAIN ] RZC: Loaded 6940 existing records. [2025-09-22T21:06:21.327147] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-22T21:06:21.479291] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:06:21.479566] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-22T21:06:21.479615] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-22T21:06:21.479989] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-22T21:06:21.480049] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-22T21:06:21.858090] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:06:22.061357] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T21:06:22.122068] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-22T21:06:22.922094] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-22T21:06:23.191568] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T21:06:23.722040] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-22T21:06:23.893266] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T21:06:24.522035] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-22T21:06:24.786361] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T21:06:25.322058] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-22T21:06:25.928190] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-22T21:06:26.122049] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-22T21:06:26.141121] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-22T21:06:26.922060] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-22T21:06:27.722048] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-22T21:06:27.781229] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T21:06:28.163516] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-22T21:06:28.417396] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-22T21:06:28.522076] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-22T21:06:29.322034] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-22T21:06:29.339973] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T21:06:29.956764] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-22T21:06:30.122056] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-22T21:06:30.922076] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-22T21:06:31.722029] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-22T21:06:31.769231] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T21:06:32.141436] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T21:06:32.414925] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T21:06:32.522061] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-22T21:06:33.233930] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T21:06:33.322014] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-22T21:06:34.020203] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-22T21:06:34.122020] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-22T21:06:34.912735] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T21:06:34.921993] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-22T21:06:35.690898] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T21:06:35.722059] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-22T21:06:36.493148] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T21:06:36.522054] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-22T21:06:37.177173] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T21:06:37.178727] [INFO ] [REMOTE ] RZC: Full fetch complete (9922 records). [2025-09-22T21:06:37.178817] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-22T21:06:37.327222] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-22T21:06:37.560195] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-22T21:06:37.560280] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-22T21:06:37.560538] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-22T21:06:37.560579] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-22T21:06:37.561046] [DEBUG] [LOCAL ] RZC: Trimmed 9922 records to 6799 (keeping 200 days of data) [2025-09-22T21:06:37.603834] [DEBUG] [LOCAL ] RZC: Primary data saved (6799 records). [2025-09-22T21:06:37.604009] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-22T21:06:37.604173] [INFO ] [MAIN ] Update Progress: 1854/2372 symbols completed. RZC took 16.5s. Estimated remaining: 1h 8m 53s. Rate: 7.5 symbols/min [2025-09-22T21:06:37.803754] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:06:37.866965] [DEBUG] [LOCAL ] S: Loaded 54324 existing records from primary storage. [2025-09-22T21:06:37.867147] [INFO ] [MAIN ] S: Loaded 54324 existing records. [2025-09-22T21:06:38.047107] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:06:38.047430] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-22T21:06:38.047502] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-22T21:06:38.049408] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-22T21:06:38.049470] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-22T21:06:38.127238] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-22T21:06:38.410237] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:06:38.537330] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T21:06:38.542123] [INFO ] [REMOTE ] RYI: Full fetch complete (32405 records). [2025-09-22T21:06:38.542270] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-22T21:06:38.931024] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-22T21:06:38.974175] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-22T21:06:38.974275] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-22T21:06:38.975209] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-22T21:06:38.975335] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-22T21:06:38.976589] [DEBUG] [LOCAL ] RYI: Trimmed 32405 records to 21599 (keeping 200 days of data) [2025-09-22T21:06:39.121059] [DEBUG] [LOCAL ] RYI: Primary data saved (21599 records). [2025-09-22T21:06:39.121189] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-22T21:06:39.121344] [INFO ] [MAIN ] Update Progress: 1855/2372 symbols completed. RYI took 38.9s. Estimated remaining: 1h 8m 44s. Rate: 7.5 symbols/min [2025-09-22T21:06:39.294661] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:06:39.344071] [DEBUG] [LOCAL ] SA: Loaded 43662 existing records from primary storage. [2025-09-22T21:06:39.344235] [INFO ] [MAIN ] SA: Loaded 43662 existing records. [2025-09-22T21:06:39.522089] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:06:39.522376] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-22T21:06:39.522432] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-22T21:06:39.523467] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-22T21:06:39.523543] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-22T21:06:39.727228] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-22T21:06:39.913042] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:06:39.944231] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T21:06:40.459628] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T21:06:40.461026] [INFO ] [REMOTE ] RZB: Full fetch complete (8830 records). [2025-09-22T21:06:40.461097] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-22T21:06:40.527158] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-22T21:06:40.848368] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-22T21:06:40.848469] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-22T21:06:40.848983] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-22T21:06:40.849073] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-22T21:06:40.849579] [DEBUG] [LOCAL ] RZB: Trimmed 8830 records to 6288 (keeping 200 days of data) [2025-09-22T21:06:40.890341] [DEBUG] [LOCAL ] RZB: Primary data saved (6288 records). [2025-09-22T21:06:40.890460] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-22T21:06:40.890597] [INFO ] [MAIN ] Update Progress: 1856/2372 symbols completed. RZB took 28.4s. Estimated remaining: 1h 8m 34s. Rate: 7.5 symbols/min [2025-09-22T21:06:41.089760] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:06:41.104780] [DEBUG] [LOCAL ] SABA: Loaded 9519 existing records from primary storage. [2025-09-22T21:06:41.104927] [INFO ] [MAIN ] SABA: Loaded 9519 existing records. [2025-09-22T21:06:41.295997] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:06:41.296319] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-22T21:06:41.296383] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-22T21:06:41.297347] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-22T21:06:41.297491] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-22T21:06:41.329501] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-22T21:06:41.662722] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-22T21:06:41.738107] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:06:42.122058] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-22T21:06:42.298810] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T21:06:42.528974] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T21:06:42.922036] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-22T21:06:42.997285] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T21:06:43.722102] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-22T21:06:44.522040] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-22T21:06:44.688126] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T21:06:44.749396] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-22T21:06:45.322066] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-22T21:06:45.976334] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-22T21:06:46.122117] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-22T21:06:46.922111] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-22T21:06:46.965780] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T21:06:47.577384] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-22T21:06:47.722064] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-22T21:06:48.493815] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-22T21:06:48.502069] [INFO ] [REMOTE ] RYN: Full fetch complete (64550 records). [2025-09-22T21:06:48.502292] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-22T21:06:48.527212] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-22T21:06:48.895559] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-22T21:06:48.895665] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-22T21:06:48.896749] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-22T21:06:48.896812] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-22T21:06:48.900974] [DEBUG] [LOCAL ] RYN: Trimmed 64550 records to 45734 (keeping 200 days of data) [2025-09-22T21:06:49.199789] [DEBUG] [LOCAL ] RYN: Primary data saved (45734 records). [2025-09-22T21:06:49.199956] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-22T21:06:49.200128] [INFO ] [MAIN ] Update Progress: 1857/2372 symbols completed. RYN took 39.3s. Estimated remaining: 1h 8m 26s. Rate: 7.5 symbols/min [2025-09-22T21:06:49.323367] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-22T21:06:49.383318] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-22T21:06:49.403240] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:06:49.446121] [DEBUG] [LOCAL ] SAFE: Loaded 30915 existing records from primary storage. [2025-09-22T21:06:49.446287] [INFO ] [MAIN ] SAFE: Loaded 30915 existing records. [2025-09-22T21:06:49.634999] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:06:49.635542] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-22T21:06:49.635675] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-22T21:06:49.636706] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-22T21:06:49.636775] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-22T21:06:49.998846] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-22T21:06:50.084057] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:06:50.122076] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-22T21:06:50.922043] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-22T21:06:51.017277] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T21:06:51.722526] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-22T21:06:52.224713] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T21:06:52.297632] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-22T21:06:52.379287] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-22T21:06:52.522062] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-22T21:06:53.322143] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-22T21:06:53.977258] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T21:06:54.125201] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-22T21:06:54.130249] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-22T21:06:54.922066] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-22T21:06:55.719036] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T21:06:55.721977] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-22T21:06:55.800240] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T21:06:56.522074] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-22T21:06:56.635810] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-22T21:06:57.322065] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-22T21:06:58.122055] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-22T21:06:58.467863] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T21:06:58.690359] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T21:06:58.922065] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-22T21:06:59.584283] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T21:06:59.722053] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-22T21:07:00.522096] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-22T21:07:01.159745] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T21:07:01.284791] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-22T21:07:01.322026] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-22T21:07:01.947459] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T21:07:02.122025] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-22T21:07:02.922080] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-22T21:07:03.449546] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-22T21:07:03.570939] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T21:07:03.722011] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-22T21:07:03.776711] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T21:07:04.522067] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-22T21:07:05.215380] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T21:07:05.227868] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T21:07:05.230755] [INFO ] [REMOTE ] SABA: Full fetch complete (15506 records). [2025-09-22T21:07:05.230852] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-22T21:07:05.330860] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-22T21:07:05.602458] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-22T21:07:05.602544] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-22T21:07:05.602902] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-22T21:07:05.602962] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-22T21:07:05.603780] [DEBUG] [LOCAL ] SABA: Trimmed 15506 records to 9221 (keeping 200 days of data) [2025-09-22T21:07:05.663749] [DEBUG] [LOCAL ] SABA: Primary data saved (9221 records). [2025-09-22T21:07:05.663923] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-22T21:07:05.664050] [INFO ] [MAIN ] Update Progress: 1858/2372 symbols completed. SABA took 24.8s. Estimated remaining: 1h 8m 20s. Rate: 7.5 symbols/min [2025-09-22T21:07:05.845127] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:07:05.870435] [DEBUG] [LOCAL ] SAH: Loaded 22598 existing records from primary storage. [2025-09-22T21:07:05.870575] [INFO ] [MAIN ] SAH: Loaded 22598 existing records. [2025-09-22T21:07:06.048459] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:07:06.048785] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-22T21:07:06.048839] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-22T21:07:06.049551] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-22T21:07:06.049610] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-22T21:07:06.127114] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-22T21:07:06.414479] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:07:06.728968] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T21:07:06.922036] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-22T21:07:07.722022] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-22T21:07:07.889265] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T21:07:08.371308] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-22T21:07:08.522096] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-22T21:07:09.070319] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T21:07:09.322055] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-22T21:07:09.613614] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T21:07:10.122115] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-22T21:07:10.699857] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T21:07:10.922081] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-22T21:07:11.349135] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T21:07:11.722059] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-22T21:07:12.295151] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T21:07:12.300324] [INFO ] [REMOTE ] SAFE: Full fetch complete (44931 records). [2025-09-22T21:07:12.300421] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-22T21:07:12.530144] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-22T21:07:12.681534] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-22T21:07:12.681610] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-22T21:07:12.682484] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-22T21:07:12.682546] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-22T21:07:12.683474] [DEBUG] [LOCAL ] SAFE: Trimmed 44931 records to 30287 (keeping 200 days of data) [2025-09-22T21:07:12.877666] [DEBUG] [LOCAL ] SAFE: Primary data saved (30287 records). [2025-09-22T21:07:12.877900] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-22T21:07:12.878104] [INFO ] [MAIN ] Update Progress: 1859/2372 symbols completed. SAFE took 23.7s. Estimated remaining: 1h 8m 12s. Rate: 7.5 symbols/min [2025-09-22T21:07:13.072341] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:07:13.072574] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-22T21:07:13.072713] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-22T21:07:13.073912] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-22T21:07:13.074996] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-22T21:07:13.074887] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T21:07:13.075118] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-22T21:07:13.081322] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-22T21:07:13.327232] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-22T21:07:13.443846] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:07:14.122104] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-22T21:07:14.191587] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T21:07:14.922113] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-22T21:07:15.334908] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-22T21:07:15.575995] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T21:07:15.643810] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-22T21:07:15.722015] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-22T21:07:16.522090] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-22T21:07:16.947264] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-22T21:07:17.322056] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-22T21:07:17.786620] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-22T21:07:17.836085] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-22T21:07:17.845018] [INFO ] [REMOTE ] S: Full fetch complete (77556 records). [2025-09-22T21:07:17.845161] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-22T21:07:18.127124] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-22T21:07:18.251137] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-22T21:07:18.251225] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-22T21:07:18.252418] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-22T21:07:18.252485] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-22T21:07:18.254135] [DEBUG] [LOCAL ] S: Trimmed 77556 records to 53545 (keeping 200 days of data) [2025-09-22T21:07:18.594981] [DEBUG] [LOCAL ] S: Primary data saved (53545 records). [2025-09-22T21:07:18.595174] [INFO ] [MAIN ] S: Full history saved. [2025-09-22T21:07:18.595295] [INFO ] [MAIN ] Update Progress: 1860/2372 symbols completed. S took 41.0s. Estimated remaining: 1h 8m 4s. Rate: 7.5 symbols/min [2025-09-22T21:07:18.831927] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:07:18.854080] [DEBUG] [LOCAL ] SAM: Loaded 22014 existing records from primary storage. [2025-09-22T21:07:18.854231] [INFO ] [MAIN ] SAM: Loaded 22014 existing records. [2025-09-22T21:07:18.927125] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-22T21:07:19.035141] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:07:19.035408] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-22T21:07:19.035474] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-22T21:07:19.036231] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-22T21:07:19.036298] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-22T21:07:19.357350] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T21:07:19.427392] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T21:07:19.426766] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:07:19.722066] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-22T21:07:20.522072] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-22T21:07:20.919667] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-22T21:07:21.322020] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-22T21:07:21.406893] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T21:07:21.671295] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-22T21:07:22.122077] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-22T21:07:22.526294] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-22T21:07:22.922081] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-22T21:07:23.722058] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-22T21:07:23.892238] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T21:07:24.522069] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-22T21:07:25.288627] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T21:07:25.322043] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-22T21:07:25.687707] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-22T21:07:25.810298] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-22T21:07:26.122053] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-22T21:07:26.526202] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-22T21:07:26.922065] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-22T21:07:27.498550] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-22T21:07:27.499302] [INFO ] [REMOTE ] SAJ: Full fetch complete (944 records). [2025-09-22T21:07:27.499370] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-22T21:07:27.707254] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-22T21:07:27.707492] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:07:27.707565] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:07:27.707666] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-22T21:07:27.707756] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-22T21:07:27.707797] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-22T21:07:27.707867] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-22T21:07:27.707969] [INFO ] [MAIN ] Update Progress: 1861/2372 symbols completed. SAJ took 14.8s. Estimated remaining: 1h 7m 56s. Rate: 7.5 symbols/min [2025-09-22T21:07:27.731088] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-22T21:07:27.907268] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:07:27.962006] [DEBUG] [LOCAL ] SAN: Loaded 53804 existing records from primary storage. [2025-09-22T21:07:27.962178] [INFO ] [MAIN ] SAN: Loaded 53804 existing records. [2025-09-22T21:07:28.139182] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:07:28.139445] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-22T21:07:28.139496] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-22T21:07:28.141039] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-22T21:07:28.141100] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-22T21:07:28.503191] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:07:28.522007] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-22T21:07:29.274308] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T21:07:29.282929] [INFO ] [REMOTE ] SA: Full fetch complete (61692 records). [2025-09-22T21:07:29.283182] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-22T21:07:29.327273] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-22T21:07:29.716344] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-22T21:07:29.716457] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-22T21:07:29.717571] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-22T21:07:29.717675] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-22T21:07:29.719203] [DEBUG] [LOCAL ] SA: Trimmed 61692 records to 43072 (keeping 200 days of data) [2025-09-22T21:07:29.976356] [DEBUG] [LOCAL ] SA: Primary data saved (43072 records). [2025-09-22T21:07:29.976495] [INFO ] [MAIN ] SA: Full history saved. [2025-09-22T21:07:29.976610] [INFO ] [MAIN ] Update Progress: 1862/2372 symbols completed. SA took 50.9s. Estimated remaining: 1h 7m 46s. Rate: 7.5 symbols/min [2025-09-22T21:07:30.132371] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-22T21:07:30.152410] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:07:30.209352] [DEBUG] [LOCAL ] SAND: Loaded 52509 existing records from primary storage. [2025-09-22T21:07:30.209513] [INFO ] [MAIN ] SAND: Loaded 52509 existing records. [2025-09-22T21:07:30.395085] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:07:30.395458] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-22T21:07:30.395523] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-22T21:07:30.396769] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-22T21:07:30.396836] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-22T21:07:30.542630] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T21:07:30.823118] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:07:30.824595] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T21:07:30.922012] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-22T21:07:31.310337] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T21:07:31.722024] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-22T21:07:32.069576] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T21:07:32.522068] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-22T21:07:32.932383] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T21:07:33.322059] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-22T21:07:33.461519] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T21:07:33.465009] [INFO ] [REMOTE ] SAH: Full fetch complete (30360 records). [2025-09-22T21:07:33.465097] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-22T21:07:33.853225] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-22T21:07:33.853304] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-22T21:07:33.853940] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-22T21:07:33.854001] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-22T21:07:33.854756] [DEBUG] [LOCAL ] SAH: Trimmed 30360 records to 22148 (keeping 200 days of data) [2025-09-22T21:07:34.002579] [DEBUG] [LOCAL ] SAH: Primary data saved (22148 records). [2025-09-22T21:07:34.002750] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-22T21:07:34.002857] [INFO ] [MAIN ] Update Progress: 1863/2372 symbols completed. SAH took 28.3s. Estimated remaining: 1h 7m 37s. Rate: 7.5 symbols/min [2025-09-22T21:07:34.127140] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-22T21:07:34.179611] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:07:34.238516] [DEBUG] [LOCAL ] SAP: Loaded 50851 existing records from primary storage. [2025-09-22T21:07:34.238712] [INFO ] [MAIN ] SAP: Loaded 50851 existing records. [2025-09-22T21:07:34.420407] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:07:34.420730] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-22T21:07:34.420786] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-22T21:07:34.422456] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-22T21:07:34.422518] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-22T21:07:34.780802] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:07:34.922031] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-22T21:07:35.124619] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T21:07:35.722123] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-22T21:07:35.959143] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T21:07:36.522048] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-22T21:07:36.654122] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T21:07:37.322103] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-22T21:07:37.463263] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T21:07:38.122039] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-22T21:07:38.411552] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T21:07:38.922082] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-22T21:07:39.287400] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-22T21:07:39.706537] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T21:07:39.722012] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-22T21:07:40.522063] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-22T21:07:40.824428] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T21:07:41.284018] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T21:07:41.322087] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-22T21:07:42.122133] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-22T21:07:42.409244] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T21:07:42.922206] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-22T21:07:43.233201] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T21:07:43.722134] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-22T21:07:43.872310] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T21:07:44.522096] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-22T21:07:44.920206] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T21:07:45.295479] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T21:07:45.322001] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-22T21:07:45.636633] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T21:07:46.122118] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-22T21:07:46.922073] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-22T21:07:47.146204] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T21:07:47.722081] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-22T21:07:48.248857] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-22T21:07:48.522121] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-22T21:07:48.569421] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T21:07:49.322052] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-22T21:07:49.681809] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T21:07:50.122021] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-22T21:07:50.529701] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T21:07:50.587737] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-22T21:07:50.922068] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-22T21:07:51.722067] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-22T21:07:51.772760] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T21:07:52.029151] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T21:07:52.522064] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-22T21:07:53.322069] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-22T21:07:53.604334] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T21:07:54.122037] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-22T21:07:54.346064] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T21:07:54.398436] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-22T21:07:54.922071] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-22T21:07:55.722100] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-22T21:07:56.235129] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-22T21:07:56.522037] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-22T21:07:56.755774] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-22T21:07:56.765864] [INFO ] [REMOTE ] SAND: Full fetch complete (74259 records). [2025-09-22T21:07:56.766113] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-22T21:07:57.185461] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T21:07:57.189164] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-22T21:07:57.195477] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-22T21:07:57.196689] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-22T21:07:57.196774] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-22T21:07:57.198411] [DEBUG] [LOCAL ] SAND: Trimmed 74259 records to 51786 (keeping 200 days of data) [2025-09-22T21:07:57.324714] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-22T21:07:57.517551] [DEBUG] [LOCAL ] SAND: Primary data saved (51786 records). [2025-09-22T21:07:57.517850] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-22T21:07:57.517970] [INFO ] [MAIN ] Update Progress: 1864/2372 symbols completed. SAND took 27.5s. Estimated remaining: 1h 7m 34s. Rate: 7.5 symbols/min [2025-09-22T21:07:57.691026] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:07:57.708829] [DEBUG] [LOCAL ] SAR: Loaded 16703 existing records from primary storage. [2025-09-22T21:07:57.708955] [INFO ] [MAIN ] SAR: Loaded 16703 existing records. [2025-09-22T21:07:57.888772] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:07:57.889059] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-22T21:07:57.889152] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-22T21:07:57.889773] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-22T21:07:57.889833] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-22T21:07:58.134628] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-22T21:07:58.254017] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:07:58.551976] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-22T21:07:58.577600] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T21:07:58.922067] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-22T21:07:59.722082] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-22T21:07:59.815967] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T21:08:00.522075] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-22T21:08:00.812556] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T21:08:00.816779] [INFO ] [REMOTE ] SAM: Full fetch complete (30272 records). [2025-09-22T21:08:00.816856] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-22T21:08:01.041621] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-22T21:08:01.154145] [INFO ] [REMOTE ] SAP: Full fetch complete (71614 records). [2025-09-22T21:08:01.175215] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-22T21:08:01.328568] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-22T21:08:01.424092] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-22T21:08:01.435428] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-22T21:08:01.436608] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-22T21:08:01.469965] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-22T21:08:01.547207] [DEBUG] [LOCAL ] SAM: Trimmed 30272 records to 21661 (keeping 200 days of data) [2025-09-22T21:08:01.724791] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T21:08:01.826712] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-22T21:08:01.827946] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-22T21:08:01.829520] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-22T21:08:01.829616] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-22T21:08:01.834687] [DEBUG] [LOCAL ] SAP: Trimmed 71614 records to 50093 (keeping 200 days of data) [2025-09-22T21:08:01.973934] [DEBUG] [LOCAL ] SAM: Primary data saved (21661 records). [2025-09-22T21:08:01.974575] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-22T21:08:01.974968] [INFO ] [MAIN ] Update Progress: 1865/2372 symbols completed. SAM took 43.4s. Estimated remaining: 1h 7m 25s. Rate: 7.5 symbols/min [2025-09-22T21:08:02.134918] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-22T21:08:02.167834] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:08:02.316035] [DEBUG] [LOCAL ] SARO: Loaded 49469 existing records from primary storage. [2025-09-22T21:08:02.316391] [INFO ] [MAIN ] SARO: Loaded 49469 existing records. [2025-09-22T21:08:02.505086] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:08:02.506709] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-22T21:08:02.506791] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-22T21:08:02.508260] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-22T21:08:02.508339] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-22T21:08:02.998272] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T21:08:03.003256] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:08:03.005928] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-22T21:08:03.017299] [DEBUG] [LOCAL ] SAP: Primary data saved (50093 records). [2025-09-22T21:08:03.017461] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-22T21:08:03.017570] [INFO ] [MAIN ] Update Progress: 1866/2372 symbols completed. SAP took 29.0s. Estimated remaining: 1h 7m 15s. Rate: 7.5 symbols/min [2025-09-22T21:08:03.194948] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:08:03.195159] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-22T21:08:03.195213] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-22T21:08:03.195395] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-22T21:08:03.195445] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-22T21:08:03.195486] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-22T21:08:03.195518] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-22T21:08:03.587879] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:08:03.615249] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-22T21:08:03.722086] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-22T21:08:03.829087] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T21:08:04.522125] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-22T21:08:05.322156] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-22T21:08:05.413298] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T21:08:05.699449] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-22T21:08:06.122085] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-22T21:08:06.922041] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-22T21:08:07.168189] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T21:08:07.176354] [INFO ] [REMOTE ] SAN: Full fetch complete (76159 records). [2025-09-22T21:08:07.176480] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-22T21:08:07.548677] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-22T21:08:07.606726] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-22T21:08:07.606834] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-22T21:08:07.608244] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-22T21:08:07.608316] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-22T21:08:07.610011] [DEBUG] [LOCAL ] SAN: Trimmed 76159 records to 53019 (keeping 200 days of data) [2025-09-22T21:08:07.722695] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-22T21:08:07.943275] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T21:08:07.962900] [DEBUG] [LOCAL ] SAN: Primary data saved (53019 records). [2025-09-22T21:08:07.963067] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-22T21:08:07.963160] [INFO ] [MAIN ] Update Progress: 1867/2372 symbols completed. SAN took 40.3s. Estimated remaining: 1h 7m 6s. Rate: 7.5 symbols/min [2025-09-22T21:08:08.134475] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:08:08.134698] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-22T21:08:08.134752] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-22T21:08:08.134893] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-22T21:08:08.134937] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-22T21:08:08.134979] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-22T21:08:08.135012] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-22T21:08:08.498747] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:08:08.522007] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-22T21:08:08.564958] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-22T21:08:09.142590] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-22T21:08:09.322091] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-22T21:08:10.122028] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-22T21:08:10.510330] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-22T21:08:10.589036] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-22T21:08:10.922063] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-22T21:08:11.722083] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-22T21:08:12.452268] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-22T21:08:12.477019] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T21:08:12.522035] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-22T21:08:13.322079] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-22T21:08:13.707356] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-22T21:08:14.122074] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-22T21:08:14.216887] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T21:08:14.565296] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-22T21:08:14.922070] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-22T21:08:15.378043] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-22T21:08:15.722074] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-22T21:08:16.185697] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T21:08:16.522086] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-22T21:08:17.322118] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-22T21:08:17.793543] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T21:08:18.122059] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-22T21:08:18.276362] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T21:08:18.663493] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-22T21:08:18.922099] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-22T21:08:19.343313] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-22T21:08:19.722067] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-22T21:08:20.221959] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-22T21:08:20.522123] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-22T21:08:21.322057] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-22T21:08:21.699553] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-22T21:08:22.122054] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-22T21:08:22.348237] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T21:08:22.922074] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-22T21:08:23.246859] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T21:08:23.316429] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-22T21:08:23.722060] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-22T21:08:24.522063] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-22T21:08:24.905400] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-22T21:08:24.949049] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T21:08:25.322085] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-22T21:08:25.810854] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T21:08:26.122074] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-22T21:08:26.922020] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-22T21:08:27.305141] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T21:08:27.722063] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-22T21:08:28.522052] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-22T21:08:28.653142] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T21:08:28.887316] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T21:08:28.890502] [INFO ] [REMOTE ] SAR: Full fetch complete (22527 records). [2025-09-22T21:08:28.890575] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-22T21:08:28.984355] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-22T21:08:28.996045] [INFO ] [REMOTE ] SAY: Full fetch complete (1458 records). [2025-09-22T21:08:28.996180] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-22T21:08:29.323692] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-22T21:08:29.358143] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-22T21:08:29.379877] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:08:29.385752] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:08:29.390981] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-22T21:08:29.401702] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-22T21:08:29.432982] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-22T21:08:29.468161] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-22T21:08:29.468341] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-22T21:08:29.468465] [INFO ] [MAIN ] Update Progress: 1868/2372 symbols completed. SAY took 21.5s. Estimated remaining: 1h 7m 2s. Rate: 7.5 symbols/min [2025-09-22T21:08:29.468541] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-22T21:08:29.507694] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-22T21:08:29.542854] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-22T21:08:29.576554] [DEBUG] [LOCAL ] SAR: Trimmed 22527 records to 16175 (keeping 200 days of data) [2025-09-22T21:08:29.730101] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:08:29.731968] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-22T21:08:29.732053] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-22T21:08:29.733545] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-22T21:08:29.733610] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-22T21:08:29.734074] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-22T21:08:29.734514] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-22T21:08:29.855023] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-22T21:08:30.128386] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-22T21:08:30.128516] [DEBUG] [LOCAL ] SAR: Primary data saved (16175 records). [2025-09-22T21:08:30.135528] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-22T21:08:30.135687] [INFO ] [MAIN ] Update Progress: 1869/2372 symbols completed. SAR took 32.6s. Estimated remaining: 1h 6m 52s. Rate: 7.5 symbols/min [2025-09-22T21:08:30.173010] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:08:30.331595] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:08:30.364815] [DEBUG] [LOCAL ] SB: Loaded 34106 existing records from primary storage. [2025-09-22T21:08:30.364953] [INFO ] [MAIN ] SB: Loaded 34106 existing records. [2025-09-22T21:08:30.541131] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:08:30.541461] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-22T21:08:30.541515] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-22T21:08:30.542307] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-22T21:08:30.542367] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-22T21:08:30.689877] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-22T21:08:30.915140] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:08:30.922023] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-22T21:08:31.436931] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-22T21:08:31.722054] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-22T21:08:32.522059] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-22T21:08:33.322031] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-22T21:08:33.384535] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T21:08:33.700843] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-22T21:08:33.701559] [INFO ] [REMOTE ] SAT: Full fetch complete (1604 records). [2025-09-22T21:08:33.701627] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-22T21:08:33.882547] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-22T21:08:33.882768] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:08:33.882817] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:08:33.882879] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-22T21:08:33.882957] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-22T21:08:33.883013] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-22T21:08:33.883058] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-22T21:08:33.883117] [INFO ] [MAIN ] Update Progress: 1870/2372 symbols completed. SAT took 30.9s. Estimated remaining: 1h 6m 43s. Rate: 7.5 symbols/min [2025-09-22T21:08:34.062014] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:08:34.062234] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-22T21:08:34.062277] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-22T21:08:34.062416] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-22T21:08:34.062457] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-22T21:08:34.062498] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-22T21:08:34.062529] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-22T21:08:34.127637] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-22T21:08:34.484787] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-22T21:08:34.488268] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:08:34.922070] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-22T21:08:35.187158] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:08:35.187491] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-22T21:08:35.722063] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-09-22T21:08:36.064584] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:08:36.065089] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-09-22T21:08:36.186327] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-22T21:08:36.522061] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-22T21:08:36.791177] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:08:36.791506] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-22T21:08:37.322062] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-22T21:08:38.122085] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-22T21:08:38.375986] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:08:38.376304] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-22T21:08:38.525252] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-22T21:08:38.922067] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-22T21:08:39.722048] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-22T21:08:40.026411] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:08:40.026782] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-22T21:08:40.358944] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T21:08:40.522095] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-22T21:08:41.322057] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-22T21:08:42.028852] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T21:08:42.051191] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T21:08:42.061130] [INFO ] [REMOTE ] SARO: Full fetch complete (68912 records). [2025-09-22T21:08:42.061256] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-22T21:08:42.127193] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-22T21:08:42.494770] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-22T21:08:42.494865] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-22T21:08:42.496019] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-22T21:08:42.496086] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-22T21:08:42.497699] [DEBUG] [LOCAL ] SARO: Trimmed 68912 records to 48810 (keeping 200 days of data) [2025-09-22T21:08:42.710692] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-22T21:08:42.802001] [DEBUG] [LOCAL ] SARO: Primary data saved (48810 records). [2025-09-22T21:08:42.802162] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-22T21:08:42.802264] [INFO ] [MAIN ] Update Progress: 1871/2372 symbols completed. SARO took 40.8s. Estimated remaining: 1h 6m 35s. Rate: 7.5 symbols/min [2025-09-22T21:08:42.927120] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-22T21:08:42.976860] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:08:43.026089] [DEBUG] [LOCAL ] SBH: Loaded 50554 existing records from primary storage. [2025-09-22T21:08:43.026239] [INFO ] [MAIN ] SBH: Loaded 50554 existing records. [2025-09-22T21:08:43.202257] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:08:43.202546] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-22T21:08:43.202599] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-22T21:08:43.203729] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-22T21:08:43.203792] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-22T21:08:43.562820] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:08:43.722074] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-22T21:08:44.493673] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T21:08:44.522004] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-22T21:08:45.329538] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-22T21:08:45.335926] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T21:08:45.823346] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-22T21:08:46.122026] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-22T21:08:46.157112] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T21:08:46.424419] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:08:46.424793] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-22T21:08:46.922056] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-22T21:08:47.481560] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-22T21:08:47.722050] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-22T21:08:48.208764] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-22T21:08:48.522083] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-22T21:08:49.322055] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-22T21:08:49.961336] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T21:08:50.122055] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-22T21:08:50.596717] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T21:08:50.922061] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-22T21:08:51.328979] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-22T21:08:51.506615] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T21:08:51.722053] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-22T21:08:52.149027] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-22T21:08:52.522060] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-22T21:08:53.322084] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-22T21:08:53.763844] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T21:08:54.128198] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-22T21:08:54.137463] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T21:08:54.523741] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-22T21:08:54.524545] [INFO ] [REMOTE ] SAZ: Full fetch complete (1812 records). [2025-09-22T21:08:54.524629] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-22T21:08:54.724437] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T21:08:54.724692] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:08:54.724840] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:08:54.724924] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-22T21:08:54.725031] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-22T21:08:54.725087] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-22T21:08:54.725180] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-22T21:08:54.725345] [INFO ] [MAIN ] Update Progress: 1872/2372 symbols completed. SAZ took 25.3s. Estimated remaining: 1h 6m 28s. Rate: 7.5 symbols/min [2025-09-22T21:08:54.902848] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:08:54.919179] [DEBUG] [LOCAL ] SBI: Loaded 7869 existing records from primary storage. [2025-09-22T21:08:54.919291] [INFO ] [MAIN ] SBI: Loaded 7869 existing records. [2025-09-22T21:08:54.930098] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-22T21:08:55.099546] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:08:55.099800] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-22T21:08:55.099851] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-22T21:08:55.100238] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-22T21:08:55.100297] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-22T21:08:55.318688] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:08:55.356804] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-22T21:08:55.455084] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:08:55.722100] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-22T21:08:56.490553] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T21:08:56.522020] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-22T21:08:57.322044] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-22T21:08:57.365843] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T21:08:57.722051] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-22T21:08:58.122054] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-22T21:08:58.783011] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T21:08:58.922068] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-22T21:08:59.702723] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T21:08:59.722001] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-22T21:09:00.522057] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-22T21:09:00.633304] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-22T21:09:01.322095] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-22T21:09:02.122025] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-22T21:09:02.416501] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T21:09:02.922076] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-22T21:09:03.722098] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-22T21:09:03.973583] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T21:09:04.470597] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T21:09:04.522042] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-22T21:09:04.802262] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (3.48 seconds). [2025-09-22T21:09:05.148081] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T21:09:05.322059] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-22T21:09:05.344929] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-22T21:09:06.122066] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-22T21:09:06.889982] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-22T21:09:06.922009] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-22T21:09:07.127068] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T21:09:07.710020] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-22T21:09:07.721998] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-22T21:09:08.450821] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T21:09:08.452384] [INFO ] [REMOTE ] SBI: Full fetch complete (10720 records). [2025-09-22T21:09:08.452483] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-22T21:09:08.527228] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-22T21:09:08.856444] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-22T21:09:08.856557] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-22T21:09:08.856913] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-22T21:09:08.857015] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-22T21:09:08.857566] [DEBUG] [LOCAL ] SBI: Trimmed 10720 records to 7763 (keeping 200 days of data) [2025-09-22T21:09:08.906721] [DEBUG] [LOCAL ] SBI: Primary data saved (7763 records). [2025-09-22T21:09:08.906857] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-22T21:09:08.907023] [INFO ] [MAIN ] Update Progress: 1873/2372 symbols completed. SBI took 14.2s. Estimated remaining: 1h 6m 22s. Rate: 7.5 symbols/min [2025-09-22T21:09:09.094661] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:09:09.107816] [DEBUG] [LOCAL ] SBR: Loaded 7374 existing records from primary storage. [2025-09-22T21:09:09.107952] [INFO ] [MAIN ] SBR: Loaded 7374 existing records. [2025-09-22T21:09:09.305181] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:09:09.305480] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-22T21:09:09.305531] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-22T21:09:09.305991] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-22T21:09:09.306060] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-22T21:09:09.327792] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-22T21:09:09.692747] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:09:09.988044] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T21:09:09.989590] [INFO ] [REMOTE ] SBDS: Full fetch complete (1068 records). [2025-09-22T21:09:09.989707] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-22T21:09:10.138678] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-22T21:09:10.189383] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 42 unique days, need 200 days [2025-09-22T21:09:10.190616] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:09:10.191296] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:09:10.191990] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-22T21:09:10.192352] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-22T21:09:10.192544] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-22T21:09:10.192695] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-22T21:09:10.193173] [INFO ] [MAIN ] Update Progress: 1874/2372 symbols completed. SBDS took 36.3s. Estimated remaining: 1h 6m 12s. Rate: 7.5 symbols/min [2025-09-22T21:09:10.375578] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:09:10.412422] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T21:09:10.484844] [DEBUG] [LOCAL ] SBS: Loaded 50107 existing records from primary storage. [2025-09-22T21:09:10.485017] [INFO ] [MAIN ] SBS: Loaded 50107 existing records. [2025-09-22T21:09:10.660972] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:09:10.661253] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-22T21:09:10.661310] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-22T21:09:10.662600] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-22T21:09:10.662684] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-22T21:09:10.928614] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-22T21:09:11.017399] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:09:11.474735] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-22T21:09:11.482067] [INFO ] [REMOTE ] SB: Full fetch complete (50686 records). [2025-09-22T21:09:11.482166] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-22T21:09:11.730283] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-22T21:09:11.819134] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T21:09:11.890521] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-22T21:09:11.890597] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-22T21:09:11.891522] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-22T21:09:11.891584] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-22T21:09:11.892953] [DEBUG] [LOCAL ] SB: Trimmed 50686 records to 33353 (keeping 200 days of data) [2025-09-22T21:09:12.103952] [DEBUG] [LOCAL ] SB: Primary data saved (33353 records). [2025-09-22T21:09:12.104105] [INFO ] [MAIN ] SB: Full history saved. [2025-09-22T21:09:12.104217] [INFO ] [MAIN ] Update Progress: 1875/2372 symbols completed. SB took 41.9s. Estimated remaining: 1h 6m 2s. Rate: 7.5 symbols/min [2025-09-22T21:09:12.273730] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:09:12.295052] [DEBUG] [LOCAL ] SBSI: Loaded 14897 existing records from primary storage. [2025-09-22T21:09:12.295186] [INFO ] [MAIN ] SBSI: Loaded 14897 existing records. [2025-09-22T21:09:12.475681] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:09:12.475941] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-22T21:09:12.475988] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-22T21:09:12.476463] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-22T21:09:12.476522] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-22T21:09:12.532838] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-22T21:09:12.841382] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:09:13.322056] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-22T21:09:13.961950] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-22T21:09:14.122044] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-22T21:09:14.398669] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T21:09:14.801226] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-22T21:09:14.922085] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-22T21:09:15.722049] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-22T21:09:15.922839] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-22T21:09:16.522119] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-22T21:09:16.670394] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T21:09:16.791025] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T21:09:17.322071] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-22T21:09:17.997304] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T21:09:18.122072] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-22T21:09:18.224298] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-22T21:09:18.922125] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-22T21:09:19.671279] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T21:09:19.685958] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T21:09:19.686428] [INFO ] [REMOTE ] SBH: Full fetch complete (72798 records). [2025-09-22T21:09:19.690094] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-22T21:09:19.727238] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-22T21:09:20.102801] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-22T21:09:20.102902] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-22T21:09:20.104133] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-22T21:09:20.104203] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-22T21:09:20.105845] [DEBUG] [LOCAL ] SBH: Trimmed 72798 records to 49833 (keeping 200 days of data) [2025-09-22T21:09:20.410717] [DEBUG] [LOCAL ] SBH: Primary data saved (49833 records). [2025-09-22T21:09:20.411278] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-22T21:09:20.411529] [INFO ] [MAIN ] Update Progress: 1876/2372 symbols completed. SBH took 37.6s. Estimated remaining: 1h 5m 54s. Rate: 7.5 symbols/min [2025-09-22T21:09:20.527260] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-22T21:09:20.591453] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:09:20.644881] [DEBUG] [LOCAL ] SBSW: Loaded 53695 existing records from primary storage. [2025-09-22T21:09:20.645039] [INFO ] [MAIN ] SBSW: Loaded 53695 existing records. [2025-09-22T21:09:20.826237] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:09:20.836466] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-22T21:09:20.836941] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T21:09:20.837147] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-22T21:09:20.842071] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-22T21:09:20.842140] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-22T21:09:21.193436] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:09:21.322088] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-22T21:09:21.389188] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T21:09:22.122089] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-22T21:09:22.922009] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-22T21:09:23.031232] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T21:09:23.144552] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-22T21:09:23.722041] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-22T21:09:24.522006] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-22T21:09:24.662664] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T21:09:24.882838] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-22T21:09:25.322022] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-22T21:09:25.530588] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T21:09:26.122057] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-22T21:09:26.922578] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-22T21:09:26.922506] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T21:09:27.153871] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T21:09:27.707255] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-22T21:09:27.721992] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-22T21:09:28.508244] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T21:09:28.521993] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-22T21:09:29.258982] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-22T21:09:29.322057] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-22T21:09:30.122061] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-22T21:09:30.922144] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-22T21:09:31.297308] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-22T21:09:31.353002] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T21:09:31.722061] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-22T21:09:32.522080] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-22T21:09:32.569208] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T21:09:32.843067] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T21:09:33.322054] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-22T21:09:34.122062] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-22T21:09:34.723731] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-22T21:09:34.876689] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T21:09:34.878597] [INFO ] [REMOTE ] SBR: Full fetch complete (10974 records). [2025-09-22T21:09:34.878701] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-22T21:09:34.925508] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-22T21:09:35.299251] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T21:09:35.309475] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-22T21:09:35.310043] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-22T21:09:35.310409] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-22T21:09:35.310619] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-22T21:09:35.311612] [DEBUG] [LOCAL ] SBR: Trimmed 10974 records to 7156 (keeping 200 days of data) [2025-09-22T21:09:35.360196] [DEBUG] [LOCAL ] SBR: Primary data saved (7156 records). [2025-09-22T21:09:35.360328] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-22T21:09:35.360434] [INFO ] [MAIN ] Update Progress: 1877/2372 symbols completed. SBR took 26.5s. Estimated remaining: 1h 5m 48s. Rate: 7.5 symbols/min [2025-09-22T21:09:35.722068] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-22T21:09:36.522029] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-22T21:09:36.780703] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-22T21:09:36.921430] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T21:09:37.322059] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-22T21:09:37.886300] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T21:09:38.122053] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-22T21:09:38.922072] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-22T21:09:39.352237] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-22T21:09:39.679783] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T21:09:39.722018] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-22T21:09:39.865942] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T21:09:40.522068] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-22T21:09:40.725219] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-22T21:09:40.728198] [INFO ] [REMOTE ] SBSI: Full fetch complete (21045 records). [2025-09-22T21:09:40.728277] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-22T21:09:41.107249] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-22T21:09:41.107351] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-22T21:09:41.107867] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-22T21:09:41.107928] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-22T21:09:41.109440] [DEBUG] [LOCAL ] SBSI: Trimmed 21045 records to 14714 (keeping 200 days of data) [2025-09-22T21:09:41.201944] [DEBUG] [LOCAL ] SBSI: Primary data saved (14714 records). [2025-09-22T21:09:41.202090] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-22T21:09:41.202177] [INFO ] [MAIN ] Update Progress: 1878/2372 symbols completed. SBSI took 29.1s. Estimated remaining: 1h 5m 40s. Rate: 7.5 symbols/min [2025-09-22T21:09:41.322057] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-22T21:09:42.177870] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:09:42.192338] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-22T21:09:43.310434] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-22T21:09:43.321838] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-22T21:09:43.809292] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T21:09:43.817434] [INFO ] [REMOTE ] SBS: Full fetch complete (70167 records). [2025-09-22T21:09:43.817604] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-22T21:09:44.231311] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-22T21:09:44.231422] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-22T21:09:44.232535] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-22T21:09:44.232623] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-22T21:09:44.234317] [DEBUG] [LOCAL ] SBS: Trimmed 70167 records to 49482 (keeping 200 days of data) [2025-09-22T21:09:44.542899] [DEBUG] [LOCAL ] SBS: Primary data saved (49482 records). [2025-09-22T21:09:44.543037] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-22T21:09:44.543118] [INFO ] [MAIN ] Update Progress: 1879/2372 symbols completed. SBS took 34.3s. Estimated remaining: 1h 5m 31s. Rate: 7.5 symbols/min [2025-09-22T21:09:45.136549] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T21:09:45.147556] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-22T21:09:47.442250] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-22T21:09:47.455032] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-22T21:09:49.510919] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-22T21:09:49.524212] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-22T21:09:51.478065] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-22T21:09:51.486391] [INFO ] [REMOTE ] SBSW: Full fetch complete (76448 records). [2025-09-22T21:09:51.486525] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-22T21:09:51.883280] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-22T21:09:51.883371] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-22T21:09:51.884621] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-22T21:09:51.884708] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-22T21:09:51.886206] [DEBUG] [LOCAL ] SBSW: Trimmed 76448 records to 52946 (keeping 200 days of data) [2025-09-22T21:09:52.189865] [DEBUG] [LOCAL ] SBSW: Primary data saved (52946 records). [2025-09-22T21:09:52.190003] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-22T21:09:52.190112] [INFO ] [MAIN ] Update Progress: 1880/2372 symbols completed. SBSW took 31.8s. Estimated remaining: 1h 5m 22s. Rate: 7.5 symbols/min [2025-09-22T21:09:52.762001] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:09:52.891100] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:09:52.901469] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:09:52.901809] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-22T21:09:52.901888] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-22T21:09:52.902165] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-22T21:09:52.902266] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-22T21:09:52.902630] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-22T21:09:52.918205] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-22T21:09:52.927044] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:09:53.048825] [DEBUG] [LOCAL ] SCD: Loaded 12773 existing records from primary storage. [2025-09-22T21:09:53.049829] [INFO ] [MAIN ] SCD: Loaded 12773 existing records. [2025-09-22T21:09:53.542063] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:09:53.543407] [DEBUG] [LOCAL ] SCCO: Loaded 50123 existing records from primary storage. [2025-09-22T21:09:53.557021] [INFO ] [MAIN ] SCCO: Loaded 50123 existing records. [2025-09-22T21:09:53.624857] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-22T21:09:53.673756] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-22T21:09:53.625621] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-22T21:09:53.701725] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-22T21:09:53.706925] [INFO ] [MAIN ] SCHW: Loaded 54465 existing records. [2025-09-22T21:09:53.772571] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-22T21:09:53.793989] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:09:53.839102] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-22T21:09:54.044959] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:09:54.084428] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-22T21:09:54.094986] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-22T21:09:54.120633] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-22T21:09:54.201886] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-22T21:09:54.175896] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:09:54.290909] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-22T21:09:54.337871] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-22T21:09:54.373793] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-22T21:09:54.383662] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-22T21:09:54.419441] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-22T21:09:54.467394] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-22T21:09:54.677412] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:09:54.743074] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-22T21:09:54.914487] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T21:09:54.960069] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-22T21:09:55.154808] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:09:55.174559] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-22T21:09:55.174336] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:09:55.175637] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-22T21:09:55.405763] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-22T21:09:55.406750] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-22T21:09:55.679968] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T21:09:55.682048] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-22T21:09:55.693545] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-22T21:09:55.694375] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-22T21:09:56.008095] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-22T21:09:56.008986] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-22T21:09:56.441119] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T21:09:56.443540] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-22T21:09:56.448148] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T21:09:56.449059] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-22T21:09:56.907980] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T21:09:56.917514] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-22T21:09:57.008259] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T21:09:57.019476] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-22T21:09:57.242037] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T21:09:57.295056] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T21:09:57.322004] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-22T21:09:58.122085] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-22T21:09:58.149456] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T21:09:58.325274] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T21:09:58.762814] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T21:09:58.786388] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T21:09:58.922034] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-22T21:09:59.722054] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-22T21:10:00.389474] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T21:10:00.522112] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-22T21:10:01.322034] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-22T21:10:01.462170] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T21:10:01.478852] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T21:10:01.867111] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T21:10:02.122125] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-22T21:10:02.922098] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-22T21:10:03.646067] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T21:10:03.722094] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-22T21:10:04.357206] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-22T21:10:04.522105] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-22T21:10:04.796894] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-22T21:10:05.322096] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-22T21:10:06.122033] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-22T21:10:06.442551] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-22T21:10:06.499872] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-22T21:10:06.546334] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-22T21:10:06.547161] [INFO ] [REMOTE ] SBXD: Full fetch complete (3077 records). [2025-09-22T21:10:06.547235] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-22T21:10:06.732288] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-22T21:10:06.732486] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:10:06.732532] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:10:06.732611] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-22T21:10:06.732707] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-22T21:10:06.732758] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-22T21:10:06.732800] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-22T21:10:06.732906] [INFO ] [MAIN ] Update Progress: 1881/2372 symbols completed. SBXD took 14.5s. Estimated remaining: 1h 5m 16s. Rate: 7.5 symbols/min [2025-09-22T21:10:06.906263] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:10:06.922113] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-22T21:10:06.967569] [DEBUG] [LOCAL ] SCI: Loaded 47400 existing records from primary storage. [2025-09-22T21:10:06.967744] [INFO ] [MAIN ] SCI: Loaded 47400 existing records. [2025-09-22T21:10:07.148662] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:10:07.148912] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-22T21:10:07.148962] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-22T21:10:07.150305] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-22T21:10:07.150369] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-22T21:10:07.507500] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:10:07.646382] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T21:10:07.722088] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-22T21:10:08.522073] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-22T21:10:09.322051] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-22T21:10:09.432601] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T21:10:09.435076] [INFO ] [REMOTE ] SCD: Full fetch complete (16160 records). [2025-09-22T21:10:09.435147] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-22T21:10:09.827250] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-22T21:10:09.827334] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-22T21:10:09.827730] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-22T21:10:09.827793] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-22T21:10:09.828334] [DEBUG] [LOCAL ] SCD: Trimmed 16160 records to 12603 (keeping 200 days of data) [2025-09-22T21:10:09.922528] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-22T21:10:09.949027] [DEBUG] [LOCAL ] SCD: Primary data saved (12603 records). [2025-09-22T21:10:09.949178] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-22T21:10:09.949284] [INFO ] [MAIN ] Update Progress: 1882/2372 symbols completed. SCD took 17.8s. Estimated remaining: 1h 5m 7s. Rate: 7.5 symbols/min [2025-09-22T21:10:10.127102] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:10:10.127229] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-22T21:10:10.144272] [DEBUG] [LOCAL ] SCL: Loaded 15051 existing records from primary storage. [2025-09-22T21:10:10.144511] [INFO ] [MAIN ] SCL: Loaded 15051 existing records. [2025-09-22T21:10:10.325288] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:10:10.325570] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-22T21:10:10.325617] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-22T21:10:10.326104] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-22T21:10:10.326163] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-22T21:10:10.694536] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:10:10.922165] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-22T21:10:11.359364] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-22T21:10:11.722019] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-22T21:10:11.802898] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T21:10:11.831922] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T21:10:12.522090] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-22T21:10:13.322093] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-22T21:10:13.677463] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T21:10:13.904578] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-22T21:10:14.122096] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-22T21:10:14.922054] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-22T21:10:15.125090] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-22T21:10:15.722052] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-22T21:10:16.379088] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-22T21:10:16.522079] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-22T21:10:16.956020] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-22T21:10:16.976441] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-22T21:10:17.322031] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-22T21:10:17.456510] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T21:10:18.122054] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-22T21:10:18.445062] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T21:10:18.922075] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-22T21:10:19.722167] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-22T21:10:19.973257] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T21:10:19.983113] [INFO ] [REMOTE ] SCHW: Full fetch complete (77698 records). [2025-09-22T21:10:19.983263] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-22T21:10:20.392211] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-22T21:10:20.392316] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-22T21:10:20.393599] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-22T21:10:20.393700] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-22T21:10:20.395374] [DEBUG] [LOCAL ] SCHW: Trimmed 77698 records to 53685 (keeping 200 days of data) [2025-09-22T21:10:20.522136] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-22T21:10:20.741792] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-09-22T21:10:20.741969] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-22T21:10:20.742085] [INFO ] [MAIN ] Update Progress: 1883/2372 symbols completed. SCHW took 28.6s. Estimated remaining: 1h 4m 60s. Rate: 7.5 symbols/min [2025-09-22T21:10:20.917995] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:10:20.931133] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T21:10:20.963486] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-22T21:10:20.989815] [DEBUG] [LOCAL ] SCM: Loaded 20453 existing records from primary storage. [2025-09-22T21:10:20.989947] [INFO ] [MAIN ] SCM: Loaded 20453 existing records. [2025-09-22T21:10:21.169182] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:10:21.169473] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-22T21:10:21.169566] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-22T21:10:21.170397] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-22T21:10:21.170456] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-22T21:10:21.330785] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-22T21:10:21.533777] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:10:22.122058] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-22T21:10:22.300849] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-22T21:10:22.533323] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T21:10:22.922058] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-22T21:10:23.722094] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-22T21:10:23.761300] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T21:10:24.025182] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-22T21:10:24.522061] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-22T21:10:24.871144] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T21:10:25.322052] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-22T21:10:26.122091] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-22T21:10:26.397621] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T21:10:26.656569] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-22T21:10:26.922077] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-22T21:10:27.550335] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T21:10:27.722056] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-22T21:10:28.522054] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-22T21:10:28.737251] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T21:10:29.209436] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T21:10:29.322021] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-22T21:10:29.701735] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-22T21:10:30.122056] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-22T21:10:30.552086] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T21:10:30.922050] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-22T21:10:31.727184] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-22T21:10:31.741735] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T21:10:32.073110] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T21:10:32.522056] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-22T21:10:32.536957] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-22T21:10:33.322047] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-22T21:10:33.669670] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-22T21:10:34.122036] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-22T21:10:34.335762] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-22T21:10:34.922078] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-22T21:10:35.659799] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T21:10:35.667761] [INFO ] [REMOTE ] SCCO: Full fetch complete (70701 records). [2025-09-22T21:10:35.667901] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-22T21:10:35.732469] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-22T21:10:36.049962] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T21:10:36.091469] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-22T21:10:36.092015] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-22T21:10:36.093210] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-22T21:10:36.093274] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-22T21:10:36.094932] [DEBUG] [LOCAL ] SCCO: Trimmed 70701 records to 49398 (keeping 200 days of data) [2025-09-22T21:10:36.407048] [DEBUG] [LOCAL ] SCCO: Primary data saved (49398 records). [2025-09-22T21:10:36.407202] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-22T21:10:36.407309] [INFO ] [MAIN ] Update Progress: 1884/2372 symbols completed. SCCO took 44.2s. Estimated remaining: 1h 4m 54s. Rate: 7.5 symbols/min [2025-09-22T21:10:36.527116] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-22T21:10:36.579635] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:10:36.621920] [DEBUG] [LOCAL ] SCS: Loaded 43502 existing records from primary storage. [2025-09-22T21:10:36.622065] [INFO ] [MAIN ] SCS: Loaded 43502 existing records. [2025-09-22T21:10:36.802798] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:10:36.803125] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-22T21:10:36.803190] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-22T21:10:36.804283] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-22T21:10:36.804341] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-22T21:10:37.171949] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:10:37.322081] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-22T21:10:37.367579] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T21:10:37.817862] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-22T21:10:38.012980] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T21:10:38.016200] [INFO ] [REMOTE ] SCL: Full fetch complete (20852 records). [2025-09-22T21:10:38.016283] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-22T21:10:38.127254] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-22T21:10:38.381558] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-22T21:10:38.381636] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-22T21:10:38.382175] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-22T21:10:38.382220] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-22T21:10:38.382863] [DEBUG] [LOCAL ] SCL: Trimmed 20852 records to 14740 (keeping 200 days of data) [2025-09-22T21:10:38.475841] [DEBUG] [LOCAL ] SCL: Primary data saved (14740 records). [2025-09-22T21:10:38.475995] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-22T21:10:38.476083] [INFO ] [MAIN ] Update Progress: 1885/2372 symbols completed. SCL took 28.5s. Estimated remaining: 1h 4m 44s. Rate: 7.5 symbols/min [2025-09-22T21:10:38.652173] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:10:38.683103] [DEBUG] [LOCAL ] SD: Loaded 29680 existing records from primary storage. [2025-09-22T21:10:38.683250] [INFO ] [MAIN ] SD: Loaded 29680 existing records. [2025-09-22T21:10:38.863419] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:10:38.863724] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-22T21:10:38.863780] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-22T21:10:38.864586] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-22T21:10:38.864679] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-22T21:10:38.927397] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-22T21:10:39.233206] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:10:39.722073] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-22T21:10:39.823590] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T21:10:40.522096] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-22T21:10:40.808682] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T21:10:40.850243] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-22T21:10:41.322114] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-22T21:10:42.001207] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T21:10:42.122138] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-22T21:10:42.915077] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T21:10:42.924198] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-22T21:10:43.397674] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T21:10:43.401200] [INFO ] [REMOTE ] SCM: Full fetch complete (28294 records). [2025-09-22T21:10:43.401292] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-22T21:10:43.731449] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-22T21:10:43.770610] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-22T21:10:43.770728] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-22T21:10:43.771314] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-22T21:10:43.771353] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-22T21:10:43.772115] [DEBUG] [LOCAL ] SCM: Trimmed 28294 records to 19870 (keeping 200 days of data) [2025-09-22T21:10:43.892138] [DEBUG] [LOCAL ] SCM: Primary data saved (19870 records). [2025-09-22T21:10:43.892273] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-22T21:10:43.892356] [INFO ] [MAIN ] Update Progress: 1886/2372 symbols completed. SCM took 23.2s. Estimated remaining: 1h 4m 36s. Rate: 7.5 symbols/min [2025-09-22T21:10:44.063024] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:10:44.074607] [DEBUG] [LOCAL ] SDHC: Loaded 10760 existing records from primary storage. [2025-09-22T21:10:44.074774] [INFO ] [MAIN ] SDHC: Loaded 10760 existing records. [2025-09-22T21:10:44.254177] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:10:44.254522] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-22T21:10:44.254681] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-22T21:10:44.255112] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-22T21:10:44.255172] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-22T21:10:44.527727] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-22T21:10:44.563938] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T21:10:44.649814] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:10:45.239072] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T21:10:45.322000] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-22T21:10:46.122036] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-22T21:10:46.154434] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T21:10:46.161590] [INFO ] [REMOTE ] SCI: Full fetch complete (67181 records). [2025-09-22T21:10:46.161776] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-22T21:10:46.567400] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-22T21:10:46.567532] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-22T21:10:46.568702] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-22T21:10:46.568768] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-22T21:10:46.570075] [DEBUG] [LOCAL ] SCI: Trimmed 67181 records to 46690 (keeping 200 days of data) [2025-09-22T21:10:46.814490] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T21:10:46.899278] [DEBUG] [LOCAL ] SCI: Primary data saved (46690 records). [2025-09-22T21:10:46.899485] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-22T21:10:46.899593] [INFO ] [MAIN ] Update Progress: 1887/2372 symbols completed. SCI took 40.2s. Estimated remaining: 1h 4m 26s. Rate: 7.5 symbols/min [2025-09-22T21:10:46.933010] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-22T21:10:47.089332] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:10:47.102606] [DEBUG] [LOCAL ] SDHY: Loaded 10852 existing records from primary storage. [2025-09-22T21:10:47.102789] [INFO ] [MAIN ] SDHY: Loaded 10852 existing records. [2025-09-22T21:10:47.298368] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:10:47.298749] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-22T21:10:47.298818] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-22T21:10:47.299347] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-22T21:10:47.299410] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-22T21:10:47.719626] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:10:47.722007] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-22T21:10:47.791990] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T21:10:47.897278] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T21:10:48.522075] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-22T21:10:48.745342] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T21:10:49.212504] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-22T21:10:49.322074] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-22T21:10:50.122132] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-22T21:10:50.931310] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-22T21:10:50.939003] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T21:10:51.117343] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T21:10:51.722040] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-22T21:10:51.772206] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T21:10:52.522081] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-22T21:10:53.171050] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T21:10:53.322034] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-22T21:10:53.467926] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T21:10:54.122035] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-22T21:10:54.197778] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-22T21:10:54.922034] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-22T21:10:55.300017] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T21:10:55.722039] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-22T21:10:55.832787] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T21:10:56.522077] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-22T21:10:57.318602] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T21:10:57.327332] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-22T21:10:57.362781] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-22T21:10:58.122043] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-22T21:10:58.334269] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T21:10:58.922056] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-22T21:10:59.660515] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T21:10:59.722016] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-22T21:10:59.772482] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-22T21:11:00.522061] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-22T21:11:01.322025] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-22T21:11:01.506000] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T21:11:01.616412] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T21:11:02.122048] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-22T21:11:02.219819] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T21:11:02.922074] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-22T21:11:02.972295] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T21:11:03.722105] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-22T21:11:04.332082] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T21:11:04.447833] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T21:11:04.522108] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-22T21:11:05.322095] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-22T21:11:05.384721] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T21:11:06.122112] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-22T21:11:06.792053] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T21:11:06.922065] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-22T21:11:06.953100] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T21:11:06.955495] [INFO ] [REMOTE ] SDHC: Full fetch complete (17003 records). [2025-09-22T21:11:06.955568] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-22T21:11:07.338002] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-22T21:11:07.338081] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-22T21:11:07.338503] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-22T21:11:07.338560] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-22T21:11:07.339117] [DEBUG] [LOCAL ] SDHC: Trimmed 17003 records to 10500 (keeping 200 days of data) [2025-09-22T21:11:07.402193] [DEBUG] [LOCAL ] SDHC: Primary data saved (10500 records). [2025-09-22T21:11:07.402344] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-22T21:11:07.402432] [INFO ] [MAIN ] Update Progress: 1888/2372 symbols completed. SDHC took 23.5s. Estimated remaining: 1h 4m 22s. Rate: 7.5 symbols/min [2025-09-22T21:11:07.572549] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:11:07.614999] [DEBUG] [LOCAL ] SDRL: Loaded 42790 existing records from primary storage. [2025-09-22T21:11:07.615136] [INFO ] [MAIN ] SDRL: Loaded 42790 existing records. [2025-09-22T21:11:07.727281] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-22T21:11:07.795847] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:11:07.796090] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-22T21:11:07.796146] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-22T21:11:07.797249] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-22T21:11:07.797310] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-22T21:11:08.154723] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:11:08.390090] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T21:11:08.397322] [INFO ] [REMOTE ] SCS: Full fetch complete (59897 records). [2025-09-22T21:11:08.397461] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-22T21:11:08.527150] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-22T21:11:08.787743] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-22T21:11:08.787837] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-22T21:11:08.789064] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-22T21:11:08.789129] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-22T21:11:08.791210] [DEBUG] [LOCAL ] SCS: Trimmed 59897 records to 42997 (keeping 200 days of data) [2025-09-22T21:11:08.931902] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T21:11:09.078342] [DEBUG] [LOCAL ] SCS: Primary data saved (42997 records). [2025-09-22T21:11:09.078474] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-22T21:11:09.078553] [INFO ] [MAIN ] Update Progress: 1889/2372 symbols completed. SCS took 32.7s. Estimated remaining: 1h 4m 12s. Rate: 7.5 symbols/min [2025-09-22T21:11:09.253823] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:11:09.253990] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-09-22T21:11:09.254026] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-09-22T21:11:09.254163] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-22T21:11:09.254204] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-22T21:11:09.254244] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-22T21:11:09.254274] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-22T21:11:09.328374] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-22T21:11:09.612354] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:11:09.975940] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T21:11:10.122020] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-22T21:11:10.250206] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T21:11:10.922093] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-22T21:11:11.722081] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-22T21:11:11.752230] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T21:11:12.522048] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-22T21:11:12.588475] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T21:11:13.015206] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-22T21:11:13.322075] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-22T21:11:14.129567] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-22T21:11:14.134720] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T21:11:14.172046] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T21:11:14.174358] [INFO ] [REMOTE ] SDHY: Full fetch complete (16225 records). [2025-09-22T21:11:14.174428] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-22T21:11:14.563412] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-22T21:11:14.563512] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-22T21:11:14.563982] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-22T21:11:14.564044] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-22T21:11:14.564802] [DEBUG] [LOCAL ] SDHY: Trimmed 16225 records to 10631 (keeping 200 days of data) [2025-09-22T21:11:14.636271] [DEBUG] [LOCAL ] SDHY: Primary data saved (10631 records). [2025-09-22T21:11:14.636429] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-22T21:11:14.636617] [INFO ] [MAIN ] Update Progress: 1890/2372 symbols completed. SDHY took 27.7s. Estimated remaining: 1h 4m 3s. Rate: 7.5 symbols/min [2025-09-22T21:11:14.807564] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:11:14.861723] [DEBUG] [LOCAL ] SEE: Loaded 49178 existing records from primary storage. [2025-09-22T21:11:14.861895] [INFO ] [MAIN ] SEE: Loaded 49178 existing records. [2025-09-22T21:11:14.927277] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-22T21:11:15.045605] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:11:15.045930] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-22T21:11:15.045997] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-22T21:11:15.047369] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-22T21:11:15.047434] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-22T21:11:15.418187] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:11:15.477343] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T21:11:15.722070] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-22T21:11:16.315046] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T21:11:16.522107] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-22T21:11:17.322056] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-22T21:11:17.954284] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-22T21:11:18.122041] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-22T21:11:18.355700] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T21:11:18.730925] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T21:11:18.922065] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-22T21:11:19.722099] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-22T21:11:19.822370] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T21:11:20.521893] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T21:11:20.522097] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-22T21:11:20.660717] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-22T21:11:21.322068] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-22T21:11:22.071464] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T21:11:22.122064] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-22T21:11:22.522716] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T21:11:22.527168] [INFO ] [REMOTE ] SD: Full fetch complete (41141 records). [2025-09-22T21:11:22.527274] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-22T21:11:22.914296] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-22T21:11:22.914447] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-22T21:11:22.915297] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-22T21:11:22.915403] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-22T21:11:22.916480] [DEBUG] [LOCAL ] SD: Trimmed 41141 records to 29064 (keeping 200 days of data) [2025-09-22T21:11:22.922228] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-22T21:11:23.108504] [DEBUG] [LOCAL ] SD: Primary data saved (29064 records). [2025-09-22T21:11:23.108665] [INFO ] [MAIN ] SD: Full history saved. [2025-09-22T21:11:23.108867] [INFO ] [MAIN ] Update Progress: 1891/2372 symbols completed. SD took 44.6s. Estimated remaining: 1h 3m 56s. Rate: 7.5 symbols/min [2025-09-22T21:11:23.278664] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:11:23.293659] [DEBUG] [LOCAL ] SEG: Loaded 14131 existing records from primary storage. [2025-09-22T21:11:23.293768] [INFO ] [MAIN ] SEG: Loaded 14131 existing records. [2025-09-22T21:11:23.480989] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:11:23.481235] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-22T21:11:23.481285] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-22T21:11:23.481758] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-22T21:11:23.481828] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-22T21:11:23.726221] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-22T21:11:23.900024] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:11:23.960774] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T21:11:24.522076] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-22T21:11:25.016691] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-22T21:11:25.322032] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-22T21:11:25.485382] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T21:11:26.122065] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-22T21:11:26.381379] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T21:11:26.923988] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-22T21:11:26.930938] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T21:11:27.689819] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T21:11:27.722012] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-22T21:11:28.522110] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-22T21:11:28.729059] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T21:11:29.322057] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-22T21:11:29.356049] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T21:11:29.385739] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:11:30.122049] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-22T21:11:30.922064] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-22T21:11:31.001687] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T21:11:31.722123] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-22T21:11:32.276535] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-22T21:11:32.448794] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T21:11:32.455997] [INFO ] [REMOTE ] SDRL: Full fetch complete (61980 records). [2025-09-22T21:11:32.456114] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-22T21:11:32.526992] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-22T21:11:32.635273] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T21:11:32.920829] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-22T21:11:32.920927] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-22T21:11:32.922150] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-22T21:11:32.922242] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-22T21:11:32.923763] [DEBUG] [LOCAL ] SDRL: Trimmed 61980 records to 41998 (keeping 200 days of data) [2025-09-22T21:11:33.241877] [DEBUG] [LOCAL ] SDRL: Primary data saved (41998 records). [2025-09-22T21:11:33.242078] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-22T21:11:33.242263] [INFO ] [MAIN ] Update Progress: 1892/2372 symbols completed. SDRL took 25.8s. Estimated remaining: 1h 3m 48s. Rate: 7.5 symbols/min [2025-09-22T21:11:33.327150] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-22T21:11:33.484221] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:11:33.556784] [DEBUG] [LOCAL ] SEI: Loaded 50377 existing records from primary storage. [2025-09-22T21:11:33.556949] [INFO ] [MAIN ] SEI: Loaded 50377 existing records. [2025-09-22T21:11:33.796770] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:11:33.797114] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-22T21:11:33.797171] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-22T21:11:33.799001] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-22T21:11:33.799112] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-22T21:11:34.130983] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-22T21:11:34.271460] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:11:34.922090] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-22T21:11:34.971576] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-22T21:11:35.722074] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-22T21:11:36.945017] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-09-22T21:11:36.948999] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-22T21:11:37.159759] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (3.83 seconds). [2025-09-22T21:11:37.322020] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-22T21:11:37.583283] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-22T21:11:37.666138] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-22T21:11:37.853487] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-22T21:11:38.122062] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-22T21:11:38.922038] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-22T21:11:39.270418] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-22T21:11:39.722038] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-22T21:11:39.846187] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T21:11:39.913555] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T21:11:40.522081] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-22T21:11:41.322049] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-22T21:11:41.813750] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-22T21:11:41.974684] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T21:11:41.997564] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T21:11:42.005392] [INFO ] [REMOTE ] SEE: Full fetch complete (69586 records). [2025-09-22T21:11:42.005563] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-22T21:11:42.127188] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-22T21:11:42.410225] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-22T21:11:42.410331] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-22T21:11:42.411471] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-22T21:11:42.411539] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-22T21:11:42.415882] [DEBUG] [LOCAL ] SEE: Trimmed 69586 records to 48394 (keeping 200 days of data) [2025-09-22T21:11:42.729613] [DEBUG] [LOCAL ] SEE: Primary data saved (48394 records). [2025-09-22T21:11:42.729785] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-22T21:11:42.729915] [INFO ] [MAIN ] Update Progress: 1893/2372 symbols completed. SEE took 28.1s. Estimated remaining: 1h 3m 41s. Rate: 7.5 symbols/min [2025-09-22T21:11:42.901391] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:11:42.929839] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-22T21:11:42.951686] [DEBUG] [LOCAL ] SEM: Loaded 43721 existing records from primary storage. [2025-09-22T21:11:42.951833] [INFO ] [MAIN ] SEM: Loaded 43721 existing records. [2025-09-22T21:11:43.140694] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:11:43.140950] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-22T21:11:43.141000] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-22T21:11:43.142200] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-22T21:11:43.142263] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-22T21:11:43.527056] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:11:43.540292] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-22T21:11:43.722103] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-22T21:11:43.973997] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T21:11:44.522060] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-22T21:11:45.331736] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-22T21:11:45.334265] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T21:11:46.122083] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-22T21:11:46.264725] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T21:11:46.433291] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T21:11:46.922056] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-22T21:11:47.722101] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-22T21:11:48.342789] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T21:11:48.481473] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-22T21:11:48.522083] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-22T21:11:49.322068] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-22T21:11:49.962418] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-22T21:11:50.122062] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-22T21:11:50.201824] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T21:11:50.204105] [INFO ] [REMOTE ] SEG: Full fetch complete (19785 records). [2025-09-22T21:11:50.204178] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-22T21:11:50.582464] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-22T21:11:50.582625] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-22T21:11:50.583137] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-22T21:11:50.583250] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-22T21:11:50.584075] [DEBUG] [LOCAL ] SEG: Trimmed 19785 records to 13797 (keeping 200 days of data) [2025-09-22T21:11:50.672706] [DEBUG] [LOCAL ] SEG: Primary data saved (13797 records). [2025-09-22T21:11:50.672872] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-22T21:11:50.672981] [INFO ] [MAIN ] Update Progress: 1894/2372 symbols completed. SEG took 27.6s. Estimated remaining: 1h 3m 33s. Rate: 7.5 symbols/min [2025-09-22T21:11:50.821619] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-22T21:11:50.894171] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:11:50.922060] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-22T21:11:50.939127] [DEBUG] [LOCAL ] SEMR: Loaded 42380 existing records from primary storage. [2025-09-22T21:11:50.939289] [INFO ] [MAIN ] SEMR: Loaded 42380 existing records. [2025-09-22T21:11:51.124935] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:11:51.125285] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-22T21:11:51.125394] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-22T21:11:51.126541] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-22T21:11:51.126607] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-22T21:11:51.488522] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:11:51.722089] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-22T21:11:52.173562] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-22T21:11:52.182035] [INFO ] [REMOTE ] SE: Full fetch complete (77069 records). [2025-09-22T21:11:52.182229] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-22T21:11:52.534219] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-22T21:11:52.586053] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-09-22T21:11:52.586166] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-09-22T21:11:52.587494] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-09-22T21:11:52.587562] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-09-22T21:11:52.589504] [DEBUG] [LOCAL ] SE: Trimmed 77069 records to 53377 (keeping 200 days of data) [2025-09-22T21:11:52.831718] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T21:11:52.884426] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T21:11:53.008732] [DEBUG] [LOCAL ] SE: Primary data saved (53377 records). [2025-09-22T21:11:53.008882] [INFO ] [MAIN ] SE: Full history saved. [2025-09-22T21:11:53.009035] [INFO ] [MAIN ] Update Progress: 1895/2372 symbols completed. SE took 43.9s. Estimated remaining: 1h 3m 23s. Rate: 7.5 symbols/min [2025-09-22T21:11:53.189782] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:11:53.239411] [DEBUG] [LOCAL ] SES: Loaded 52296 existing records from primary storage. [2025-09-22T21:11:53.239550] [INFO ] [MAIN ] SES: Loaded 52296 existing records. [2025-09-22T21:11:53.330286] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-22T21:11:53.423911] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:11:53.424198] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-22T21:11:53.424265] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-22T21:11:53.425338] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-22T21:11:53.425400] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-22T21:11:53.784986] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:11:53.831026] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-22T21:11:54.122053] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-22T21:11:54.922088] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-22T21:11:55.217869] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T21:11:55.722135] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-22T21:11:55.929512] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T21:11:56.119351] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-22T21:11:56.522107] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-22T21:11:57.105847] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T21:11:57.322080] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-22T21:11:57.974795] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T21:11:58.122062] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-22T21:11:58.589387] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T21:11:58.922111] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-22T21:11:59.722053] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-22T21:12:00.017490] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T21:12:00.387718] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T21:12:00.522064] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-22T21:12:01.001220] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-22T21:12:01.322077] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-22T21:12:01.854599] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T21:12:02.122103] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-22T21:12:02.922071] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-22T21:12:03.237343] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T21:12:03.722082] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-22T21:12:03.810364] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T21:12:04.522065] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-22T21:12:04.554076] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T21:12:05.322099] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-22T21:12:05.648434] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-22T21:12:05.884036] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T21:12:06.122089] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-22T21:12:06.922068] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-22T21:12:07.189095] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T21:12:07.198415] [INFO ] [REMOTE ] SEI: Full fetch complete (69536 records). [2025-09-22T21:12:07.198594] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-22T21:12:07.435526] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T21:12:07.520755] [INFO ] [REMOTE ] SEM: Full fetch complete (61789 records). [2025-09-22T21:12:07.544105] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-22T21:12:07.735197] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-22T21:12:07.790109] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-22T21:12:07.811412] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-22T21:12:07.838195] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-22T21:12:07.856950] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-22T21:12:07.988804] [DEBUG] [LOCAL ] SEI: Trimmed 69536 records to 49644 (keeping 200 days of data) [2025-09-22T21:12:08.228895] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-22T21:12:08.231790] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-22T21:12:08.263614] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-22T21:12:08.264025] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-22T21:12:08.381810] [DEBUG] [LOCAL ] SEM: Trimmed 61789 records to 42965 (keeping 200 days of data) [2025-09-22T21:12:08.381329] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T21:12:08.522031] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-22T21:12:08.637143] [DEBUG] [LOCAL ] SEI: Primary data saved (49644 records). [2025-09-22T21:12:08.638250] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-22T21:12:08.638729] [INFO ] [MAIN ] Update Progress: 1896/2372 symbols completed. SEI took 35.4s. Estimated remaining: 1h 3m 17s. Rate: 7.5 symbols/min [2025-09-22T21:12:08.829469] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:12:08.967839] [DEBUG] [LOCAL ] SF: Loaded 42554 existing records from primary storage. [2025-09-22T21:12:08.969311] [INFO ] [MAIN ] SF: Loaded 42554 existing records. [2025-09-22T21:12:09.162636] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:12:09.164589] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-22T21:12:09.165244] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-22T21:12:09.170327] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-22T21:12:09.170464] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-22T21:12:09.409390] [DEBUG] [LOCAL ] SEM: Primary data saved (42965 records). [2025-09-22T21:12:09.448632] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-22T21:12:09.454758] [INFO ] [MAIN ] Update Progress: 1897/2372 symbols completed. SEM took 26.7s. Estimated remaining: 1h 3m 7s. Rate: 7.5 symbols/min [2025-09-22T21:12:09.701048] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:12:09.732078] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-22T21:12:09.754553] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:12:09.761197] [DEBUG] [LOCAL ] SFB: Loaded 4115 existing records from primary storage. [2025-09-22T21:12:09.761298] [INFO ] [MAIN ] SFB: Loaded 4115 existing records. [2025-09-22T21:12:09.953349] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:12:09.954134] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-22T21:12:09.954305] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-22T21:12:09.954745] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-22T21:12:09.954810] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-22T21:12:10.083959] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T21:12:10.135962] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-22T21:12:10.398237] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:12:10.401270] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-22T21:12:10.922066] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-22T21:12:11.389303] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T21:12:11.420056] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-22T21:12:11.613055] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T21:12:11.722052] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-22T21:12:12.522119] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-22T21:12:13.322035] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-22T21:12:13.517076] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T21:12:13.870189] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-22T21:12:13.942737] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-22T21:12:14.122056] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-22T21:12:14.922062] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-22T21:12:15.639025] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T21:12:15.646154] [INFO ] [REMOTE ] SEMR: Full fetch complete (58758 records). [2025-09-22T21:12:15.646260] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-22T21:12:15.727194] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-22T21:12:16.039058] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-22T21:12:16.039181] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-22T21:12:16.040263] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-22T21:12:16.040326] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-22T21:12:16.041605] [DEBUG] [LOCAL ] SEMR: Trimmed 58758 records to 41647 (keeping 200 days of data) [2025-09-22T21:12:16.288879] [DEBUG] [LOCAL ] SEMR: Primary data saved (41647 records). [2025-09-22T21:12:16.289050] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-22T21:12:16.289173] [INFO ] [MAIN ] Update Progress: 1898/2372 symbols completed. SEMR took 25.6s. Estimated remaining: 1h 2m 59s. Rate: 7.5 symbols/min [2025-09-22T21:12:16.460158] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:12:16.480984] [DEBUG] [LOCAL ] SFBS: Loaded 21769 existing records from primary storage. [2025-09-22T21:12:16.481131] [INFO ] [MAIN ] SFBS: Loaded 21769 existing records. [2025-09-22T21:12:16.528948] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-22T21:12:16.670882] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:12:16.671114] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-22T21:12:16.671162] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-22T21:12:16.671767] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-22T21:12:16.671827] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-22T21:12:17.050735] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:12:17.216225] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-22T21:12:17.230531] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-22T21:12:17.254394] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T21:12:17.322007] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-22T21:12:18.122067] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-22T21:12:18.922121] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-22T21:12:19.696198] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T21:12:19.722109] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-22T21:12:19.796309] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-22T21:12:20.001038] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-22T21:12:20.522054] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-22T21:12:21.322071] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-22T21:12:21.606963] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T21:12:22.122089] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-22T21:12:22.357355] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T21:12:22.861225] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T21:12:22.922037] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-22T21:12:23.163164] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-22T21:12:23.722083] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-22T21:12:23.976996] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-22T21:12:24.382784] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-22T21:12:24.522069] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-22T21:12:25.020628] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-22T21:12:25.322055] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-22T21:12:25.943048] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-22T21:12:26.122055] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-22T21:12:26.922056] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-22T21:12:27.722060] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-22T21:12:28.164956] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T21:12:28.522027] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-22T21:12:28.661586] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-22T21:12:29.138323] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T21:12:29.322019] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-22T21:12:29.441758] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T21:12:30.122063] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-22T21:12:30.394351] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T21:12:30.683067] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-22T21:12:30.922054] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-22T21:12:31.722049] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-22T21:12:32.243254] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-22T21:12:32.244311] [INFO ] [REMOTE ] SFB: Full fetch complete (5722 records). [2025-09-22T21:12:32.244382] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-22T21:12:32.527145] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-22T21:12:32.618001] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-22T21:12:32.618089] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-22T21:12:32.618252] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-22T21:12:32.618289] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-22T21:12:32.618738] [DEBUG] [LOCAL ] SFB: Trimmed 5722 records to 4042 (keeping 200 days of data) [2025-09-22T21:12:32.643250] [DEBUG] [LOCAL ] SFB: Primary data saved (4042 records). [2025-09-22T21:12:32.643377] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-22T21:12:32.643460] [INFO ] [MAIN ] Update Progress: 1899/2372 symbols completed. SFB took 23.2s. Estimated remaining: 1h 2m 53s. Rate: 7.5 symbols/min [2025-09-22T21:12:32.820077] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:12:32.866797] [DEBUG] [LOCAL ] SFL: Loaded 46153 existing records from primary storage. [2025-09-22T21:12:32.866944] [INFO ] [MAIN ] SFL: Loaded 46153 existing records. [2025-09-22T21:12:33.049964] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:12:33.050547] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-22T21:12:33.050791] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-22T21:12:33.051878] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-22T21:12:33.051944] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-22T21:12:33.251400] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-22T21:12:33.335026] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-22T21:12:33.467426] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:12:34.127182] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-22T21:12:34.144906] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:12:34.233267] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T21:12:34.922061] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-22T21:12:35.722066] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-22T21:12:36.071463] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T21:12:36.522107] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-22T21:12:36.625727] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-22T21:12:37.322040] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-22T21:12:37.381544] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T21:12:37.779846] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T21:12:38.122085] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-22T21:12:38.922097] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-22T21:12:39.599253] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-22T21:12:39.614963] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T21:12:39.706516] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-22T21:12:39.722002] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-22T21:12:40.522267] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-22T21:12:40.916416] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T21:12:41.322065] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-22T21:12:42.058738] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T21:12:42.065565] [INFO ] [REMOTE ] SF: Full fetch complete (59404 records). [2025-09-22T21:12:42.065769] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-22T21:12:42.127149] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-22T21:12:42.471454] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-22T21:12:42.471561] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-22T21:12:42.472703] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-22T21:12:42.472772] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-22T21:12:42.474214] [DEBUG] [LOCAL ] SF: Trimmed 59404 records to 41888 (keeping 200 days of data) [2025-09-22T21:12:42.748010] [DEBUG] [LOCAL ] SF: Primary data saved (41888 records). [2025-09-22T21:12:42.748180] [INFO ] [MAIN ] SF: Full history saved. [2025-09-22T21:12:42.748285] [INFO ] [MAIN ] Update Progress: 1900/2372 symbols completed. SF took 34.1s. Estimated remaining: 1h 2m 46s. Rate: 7.5 symbols/min [2025-09-22T21:12:42.920156] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:12:42.929312] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-22T21:12:42.957515] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T21:12:43.017942] [DEBUG] [LOCAL ] SG: Loaded 54238 existing records from primary storage. [2025-09-22T21:12:43.018113] [INFO ] [MAIN ] SG: Loaded 54238 existing records. [2025-09-22T21:12:43.209168] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:12:43.209433] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-22T21:12:43.209484] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-22T21:12:43.210680] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-22T21:12:43.210742] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-22T21:12:43.572255] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:12:43.722054] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-22T21:12:44.049573] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T21:12:44.054116] [INFO ] [REMOTE ] SFBS: Full fetch complete (30236 records). [2025-09-22T21:12:44.054369] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-22T21:12:44.304725] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-22T21:12:44.367738] [INFO ] [REMOTE ] SES: Full fetch complete (74439 records). [2025-09-22T21:12:44.427706] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-22T21:12:44.528958] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-22T21:12:44.663568] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-22T21:12:44.669277] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-22T21:12:44.685474] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-22T21:12:44.691331] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-22T21:12:44.734471] [DEBUG] [LOCAL ] SFBS: Trimmed 30236 records to 21276 (keeping 200 days of data) [2025-09-22T21:12:45.081031] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-22T21:12:45.083686] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-22T21:12:45.089367] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-22T21:12:45.093732] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-22T21:12:45.107200] [DEBUG] [LOCAL ] SFBS: Primary data saved (21276 records). [2025-09-22T21:12:45.107454] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-22T21:12:45.107561] [INFO ] [MAIN ] Update Progress: 1901/2372 symbols completed. SFBS took 28.8s. Estimated remaining: 1h 2m 36s. Rate: 7.5 symbols/min [2025-09-22T21:12:45.107854] [DEBUG] [LOCAL ] SES: Trimmed 74439 records to 51527 (keeping 200 days of data) [2025-09-22T21:12:45.494858] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:12:45.632441] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T21:12:45.645784] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-22T21:12:45.650556] [DEBUG] [LOCAL ] SES: Primary data saved (51527 records). [2025-09-22T21:12:45.651276] [INFO ] [MAIN ] SES: Full history saved. [2025-09-22T21:12:45.651544] [INFO ] [MAIN ] Update Progress: 1902/2372 symbols completed. SES took 52.6s. Estimated remaining: 1h 2m 27s. Rate: 7.5 symbols/min [2025-09-22T21:12:45.697773] [DEBUG] [LOCAL ] SGHC: Loaded 46162 existing records from primary storage. [2025-09-22T21:12:45.711351] [INFO ] [MAIN ] SGHC: Loaded 46162 existing records. [2025-09-22T21:12:45.978611] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:12:46.037009] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-22T21:12:46.037288] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:12:46.037134] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-22T21:12:46.037940] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-22T21:12:46.038301] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-22T21:12:46.038182] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-22T21:12:46.038441] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-22T21:12:46.038690] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-22T21:12:46.038878] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-22T21:12:46.071214] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-22T21:12:46.127023] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-22T21:12:46.718994] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-22T21:12:46.766875] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:12:46.783144] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-22T21:12:46.841905] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:12:46.922055] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-22T21:12:47.116183] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:12:47.116541] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-22T21:12:47.722158] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-09-22T21:12:47.783547] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-22T21:12:48.198130] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:12:48.198761] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-09-22T21:12:48.379911] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T21:12:48.522107] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-22T21:12:49.322072] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-22T21:12:49.933601] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T21:12:50.122071] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-22T21:12:50.922114] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-22T21:12:51.256996] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-22T21:12:51.722064] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-22T21:12:51.754939] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T21:12:52.044781] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T21:12:52.522076] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-22T21:12:53.322040] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-22T21:12:53.547507] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T21:12:54.043842] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T21:12:54.122086] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-22T21:12:54.896470] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T21:12:54.922036] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-22T21:12:55.722140] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-22T21:12:56.037378] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T21:12:56.372441] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T21:12:56.522098] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-22T21:12:57.278449] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T21:12:57.322021] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-22T21:12:58.122147] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-22T21:12:58.363388] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T21:12:58.918865] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T21:12:58.922239] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-22T21:12:59.722078] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-22T21:12:59.850484] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T21:13:00.522069] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-22T21:13:00.646100] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T21:13:01.322031] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-22T21:13:01.418271] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T21:13:02.122106] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-22T21:13:02.433258] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T21:13:02.922039] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-22T21:13:02.950774] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T21:13:03.707611] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T21:13:03.722011] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-22T21:13:04.522161] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-22T21:13:04.931425] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T21:13:05.322103] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-22T21:13:05.506482] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T21:13:06.122094] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-22T21:13:06.483041] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T21:13:06.922085] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-22T21:13:07.201610] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T21:13:07.439179] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T21:13:07.722064] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-22T21:13:08.522117] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-22T21:13:08.971445] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-22T21:13:09.322029] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-22T21:13:09.471531] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T21:13:09.479853] [INFO ] [REMOTE ] SGHC: Full fetch complete (63142 records). [2025-09-22T21:13:09.479975] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-22T21:13:09.865589] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-22T21:13:09.865700] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-22T21:13:09.866925] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-22T21:13:09.867001] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-22T21:13:09.868507] [DEBUG] [LOCAL ] SGHC: Trimmed 63142 records to 45611 (keeping 200 days of data) [2025-09-22T21:13:10.134670] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-22T21:13:10.157076] [DEBUG] [LOCAL ] SGHC: Primary data saved (45611 records). [2025-09-22T21:13:10.157229] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-22T21:13:10.157320] [INFO ] [MAIN ] Update Progress: 1903/2372 symbols completed. SGHC took 25.0s. Estimated remaining: 1h 2m 23s. Rate: 7.5 symbols/min [2025-09-22T21:13:10.335913] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:13:10.346440] [DEBUG] [LOCAL ] SGU: Loaded 6721 existing records from primary storage. [2025-09-22T21:13:10.346580] [INFO ] [MAIN ] SGU: Loaded 6721 existing records. [2025-09-22T21:13:10.571324] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T21:13:10.570004] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:13:10.582884] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-22T21:13:10.582967] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-22T21:13:10.583732] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-22T21:13:10.583794] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-22T21:13:10.932437] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-22T21:13:10.967468] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:13:11.443049] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-22T21:13:11.722078] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-22T21:13:11.855817] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T21:13:11.863130] [INFO ] [REMOTE ] SFL: Full fetch complete (65322 records). [2025-09-22T21:13:11.863258] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-22T21:13:12.249865] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-22T21:13:12.249953] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-22T21:13:12.250983] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-22T21:13:12.251046] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-22T21:13:12.252341] [DEBUG] [LOCAL ] SFL: Trimmed 65322 records to 45361 (keeping 200 days of data) [2025-09-22T21:13:12.523286] [DEBUG] [LOCAL ] SFL: Primary data saved (45361 records). [2025-09-22T21:13:12.523406] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-22T21:13:12.523519] [INFO ] [MAIN ] Update Progress: 1904/2372 symbols completed. SFL took 39.9s. Estimated remaining: 1h 2m 13s. Rate: 7.5 symbols/min [2025-09-22T21:13:12.523191] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-22T21:13:12.696525] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:13:12.744710] [DEBUG] [LOCAL ] SHAK: Loaded 49932 existing records from primary storage. [2025-09-22T21:13:12.744856] [INFO ] [MAIN ] SHAK: Loaded 49932 existing records. [2025-09-22T21:13:12.931589] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:13:12.932107] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-22T21:13:12.932171] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-22T21:13:12.941982] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-22T21:13:12.957429] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-22T21:13:13.032242] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-22T21:13:13.334904] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-22T21:13:13.342315] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:13:13.334349] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-22T21:13:13.507506] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T21:13:14.122109] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-22T21:13:14.922065] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-22T21:13:14.985374] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T21:13:14.993791] [INFO ] [REMOTE ] SGI: Full fetch complete (56759 records). [2025-09-22T21:13:14.993963] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-22T21:13:15.187259] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 150 unique days, need 200 days [2025-09-22T21:13:15.187916] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:13:15.187992] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:13:15.188042] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-22T21:13:15.188102] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-22T21:13:15.188137] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-22T21:13:15.188191] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-22T21:13:15.188275] [INFO ] [MAIN ] Update Progress: 1905/2372 symbols completed. SGI took 29.5s. Estimated remaining: 1h 2m 4s. Rate: 7.5 symbols/min [2025-09-22T21:13:15.359767] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:13:15.386568] [DEBUG] [LOCAL ] SHCO: Loaded 26650 existing records from primary storage. [2025-09-22T21:13:15.386749] [INFO ] [MAIN ] SHCO: Loaded 26650 existing records. [2025-09-22T21:13:15.572264] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:13:15.572556] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-22T21:13:15.572612] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-22T21:13:15.573317] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-22T21:13:15.573377] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-22T21:13:15.725685] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-22T21:13:15.972389] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:13:15.974688] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T21:13:16.504117] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T21:13:16.522008] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-22T21:13:16.880773] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-22T21:13:16.892285] [INFO ] [REMOTE ] SG: Full fetch complete (77249 records). [2025-09-22T21:13:16.892459] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-22T21:13:17.297783] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T21:13:17.321569] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-22T21:13:17.323173] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-22T21:13:17.324326] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-22T21:13:17.326546] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-22T21:13:17.326771] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-22T21:13:17.328745] [DEBUG] [LOCAL ] SG: Trimmed 77249 records to 53458 (keeping 200 days of data) [2025-09-22T21:13:17.687589] [DEBUG] [LOCAL ] SG: Primary data saved (53458 records). [2025-09-22T21:13:17.687791] [INFO ] [MAIN ] SG: Full history saved. [2025-09-22T21:13:17.687884] [INFO ] [MAIN ] Update Progress: 1906/2372 symbols completed. SG took 34.9s. Estimated remaining: 1h 1m 55s. Rate: 7.5 symbols/min [2025-09-22T21:13:17.860634] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:13:17.912716] [DEBUG] [LOCAL ] SHEL: Loaded 54452 existing records from primary storage. [2025-09-22T21:13:17.912861] [INFO ] [MAIN ] SHEL: Loaded 54452 existing records. [2025-09-22T21:13:18.096864] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:13:18.097178] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-22T21:13:18.097227] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-22T21:13:18.098451] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-22T21:13:18.098514] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-22T21:13:18.129743] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-22T21:13:18.459421] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:13:18.650172] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T21:13:18.922076] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-22T21:13:19.676175] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-22T21:13:19.722067] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-22T21:13:19.948633] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T21:13:20.522061] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-22T21:13:21.322066] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-22T21:13:21.837868] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-22T21:13:22.122068] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-22T21:13:22.146608] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T21:13:22.278054] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T21:13:22.922057] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-22T21:13:23.722060] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-22T21:13:24.482502] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T21:13:24.522008] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-22T21:13:24.556473] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-22T21:13:24.882714] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T21:13:25.212923] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-22T21:13:25.322049] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-22T21:13:26.122061] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-22T21:13:26.922027] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-22T21:13:27.323567] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-22T21:13:27.362859] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T21:13:27.722055] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-22T21:13:28.522094] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-22T21:13:28.934151] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-22T21:13:29.322052] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-22T21:13:29.636374] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T21:13:29.994024] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-22T21:13:30.115739] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T21:13:30.121996] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-22T21:13:30.922029] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-22T21:13:30.986591] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T21:13:31.722072] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-22T21:13:32.442441] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-22T21:13:32.444155] [INFO ] [REMOTE ] SGU: Full fetch complete (8913 records). [2025-09-22T21:13:32.444331] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-22T21:13:32.527250] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-22T21:13:32.845461] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-22T21:13:32.845542] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-22T21:13:32.845851] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-22T21:13:32.845916] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-22T21:13:32.846498] [DEBUG] [LOCAL ] SGU: Trimmed 8913 records to 6675 (keeping 200 days of data) [2025-09-22T21:13:32.890089] [DEBUG] [LOCAL ] SGU: Primary data saved (6675 records). [2025-09-22T21:13:32.890237] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-22T21:13:32.890367] [INFO ] [MAIN ] Update Progress: 1907/2372 symbols completed. SGU took 22.7s. Estimated remaining: 1h 1m 49s. Rate: 7.5 symbols/min [2025-09-22T21:13:33.066302] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:13:33.097583] [DEBUG] [LOCAL ] SHG: Loaded 27955 existing records from primary storage. [2025-09-22T21:13:33.097854] [INFO ] [MAIN ] SHG: Loaded 27955 existing records. [2025-09-22T21:13:33.281324] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:13:33.281731] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-22T21:13:33.281890] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-22T21:13:33.282732] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-22T21:13:33.282794] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-22T21:13:33.327462] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-22T21:13:33.464311] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-22T21:13:33.706176] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:13:33.928255] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T21:13:34.122016] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-22T21:13:34.922055] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-22T21:13:35.135943] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T21:13:35.561099] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T21:13:35.722063] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-22T21:13:36.341690] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T21:13:36.522068] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-22T21:13:37.059671] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T21:13:37.322062] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-22T21:13:38.122053] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-22T21:13:38.198809] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T21:13:38.662227] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T21:13:38.831901] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T21:13:38.922091] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-22T21:13:39.722095] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-22T21:13:39.986258] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T21:13:40.522073] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-22T21:13:41.322084] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-22T21:13:41.829038] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T21:13:41.977498] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-22T21:13:42.122123] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-22T21:13:42.922083] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-22T21:13:42.962408] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T21:13:43.722044] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-22T21:13:44.226385] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-22T21:13:44.323213] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T21:13:44.522090] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-22T21:13:45.142796] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T21:13:45.322074] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-22T21:13:46.122155] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-22T21:13:46.637314] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-22T21:13:46.643078] [INFO ] [REMOTE ] SHCO: Full fetch complete (37325 records). [2025-09-22T21:13:46.643186] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-22T21:13:46.927773] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-22T21:13:47.036588] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-22T21:13:47.144354] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-22T21:13:47.144443] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-22T21:13:47.145272] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-22T21:13:47.145374] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-22T21:13:47.146312] [DEBUG] [LOCAL ] SHCO: Trimmed 37325 records to 26179 (keeping 200 days of data) [2025-09-22T21:13:47.333933] [DEBUG] [LOCAL ] SHCO: Primary data saved (26179 records). [2025-09-22T21:13:47.334402] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-22T21:13:47.334767] [INFO ] [MAIN ] Update Progress: 1908/2372 symbols completed. SHCO took 32.1s. Estimated remaining: 1h 1m 42s. Rate: 7.5 symbols/min [2025-09-22T21:13:47.545910] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:13:47.566950] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T21:13:47.627098] [DEBUG] [LOCAL ] SHO: Loaded 50584 existing records from primary storage. [2025-09-22T21:13:47.627282] [INFO ] [MAIN ] SHO: Loaded 50584 existing records. [2025-09-22T21:13:47.730776] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-22T21:13:47.830358] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:13:47.830786] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-22T21:13:47.830870] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-22T21:13:47.832114] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-22T21:13:47.832216] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-22T21:13:48.220926] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:13:48.522073] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-22T21:13:48.981503] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T21:13:49.029964] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T21:13:49.322064] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-22T21:13:50.122087] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-22T21:13:50.226709] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T21:13:50.650519] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T21:13:50.922064] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-22T21:13:51.722077] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-22T21:13:51.991780] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-22T21:13:52.533116] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-22T21:13:52.538419] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T21:13:53.311690] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T21:13:53.319501] [INFO ] [REMOTE ] SHAK: Full fetch complete (69926 records). [2025-09-22T21:13:53.319691] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-22T21:13:53.331818] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-22T21:13:53.711819] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-22T21:13:53.711909] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-22T21:13:53.713040] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-22T21:13:53.713118] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-22T21:13:53.714586] [DEBUG] [LOCAL ] SHAK: Trimmed 69926 records to 49195 (keeping 200 days of data) [2025-09-22T21:13:54.048886] [DEBUG] [LOCAL ] SHAK: Primary data saved (49195 records). [2025-09-22T21:13:54.049056] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-22T21:13:54.049271] [INFO ] [MAIN ] Update Progress: 1909/2372 symbols completed. SHAK took 41.5s. Estimated remaining: 1h 1m 34s. Rate: 7.5 symbols/min [2025-09-22T21:13:54.128845] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-22T21:13:54.247971] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:13:54.255817] [DEBUG] [LOCAL ] SHOC: Loaded 4258 existing records from primary storage. [2025-09-22T21:13:54.255948] [INFO ] [MAIN ] SHOC: Loaded 4258 existing records. [2025-09-22T21:13:54.459910] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:13:54.460585] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-22T21:13:54.460849] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-22T21:13:54.461550] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-22T21:13:54.461634] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-22T21:13:54.598472] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-22T21:13:54.657555] [INFO ] [REMOTE ] SHEL: Full fetch complete (77691 records). [2025-09-22T21:13:54.674494] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-22T21:13:55.179116] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:13:55.192847] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-22T21:13:55.382389] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-22T21:13:55.382661] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-22T21:13:55.383914] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-22T21:13:55.386943] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-22T21:13:55.385402] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-22T21:13:55.407408] [DEBUG] [LOCAL ] SHEL: Trimmed 77691 records to 53672 (keeping 200 days of data) [2025-09-22T21:13:55.420598] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-22T21:13:55.724982] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-22T21:13:55.770299] [DEBUG] [LOCAL ] SHEL: Primary data saved (53672 records). [2025-09-22T21:13:55.770410] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-22T21:13:55.770549] [INFO ] [MAIN ] Update Progress: 1910/2372 symbols completed. SHEL took 38.1s. Estimated remaining: 1h 1m 24s. Rate: 7.5 symbols/min [2025-09-22T21:13:55.952927] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:13:56.012388] [DEBUG] [LOCAL ] SHW: Loaded 51268 existing records from primary storage. [2025-09-22T21:13:56.012581] [INFO ] [MAIN ] SHW: Loaded 51268 existing records. [2025-09-22T21:13:56.200091] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:13:56.200374] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-22T21:13:56.200423] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-22T21:13:56.201813] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-22T21:13:56.201877] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-22T21:13:56.314897] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T21:13:56.527285] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-22T21:13:56.597905] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:13:57.322046] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-22T21:13:57.544718] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T21:13:57.650098] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T21:13:57.932582] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T21:13:58.122058] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-22T21:13:58.922035] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-22T21:13:58.980630] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T21:13:59.722079] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-22T21:14:00.522045] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-22T21:14:00.674940] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T21:14:00.726330] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T21:14:01.322068] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-22T21:14:02.122115] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-22T21:14:02.482128] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-22T21:14:02.811774] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-22T21:14:02.922057] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-22T21:14:03.183626] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T21:14:03.488091] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T21:14:03.722040] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-22T21:14:04.431235] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T21:14:04.522047] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-22T21:14:05.195811] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-22T21:14:05.322096] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-22T21:14:06.122068] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-22T21:14:06.576421] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T21:14:06.580916] [INFO ] [REMOTE ] SHG: Full fetch complete (41494 records). [2025-09-22T21:14:06.581031] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-22T21:14:06.924608] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-22T21:14:06.959611] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-22T21:14:06.959721] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-22T21:14:06.960553] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-22T21:14:06.960594] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-22T21:14:06.961536] [DEBUG] [LOCAL ] SHG: Trimmed 41494 records to 27156 (keeping 200 days of data) [2025-09-22T21:14:07.145987] [DEBUG] [LOCAL ] SHG: Primary data saved (27156 records). [2025-09-22T21:14:07.146137] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-22T21:14:07.146306] [INFO ] [MAIN ] Update Progress: 1911/2372 symbols completed. SHG took 34.3s. Estimated remaining: 1h 1m 17s. Rate: 7.5 symbols/min [2025-09-22T21:14:07.337449] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:14:07.337696] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-22T21:14:07.337749] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-22T21:14:07.337904] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-22T21:14:07.337949] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-22T21:14:07.337992] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-22T21:14:07.338024] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-22T21:14:07.730293] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-22T21:14:07.736971] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:14:07.899674] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T21:14:08.522034] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-22T21:14:08.689411] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T21:14:08.725475] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T21:14:08.846406] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:14:08.846775] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-22T21:14:09.322057] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-22T21:14:09.922697] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-22T21:14:09.923792] [INFO ] [REMOTE ] SHOC: Full fetch complete (7530 records). [2025-09-22T21:14:09.923884] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-22T21:14:10.127571] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-22T21:14:10.293546] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-22T21:14:10.293630] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-22T21:14:10.293882] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-22T21:14:10.293930] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-22T21:14:10.294386] [DEBUG] [LOCAL ] SHOC: Trimmed 7530 records to 3890 (keeping 200 days of data) [2025-09-22T21:14:10.318755] [DEBUG] [LOCAL ] SHOC: Primary data saved (3890 records). [2025-09-22T21:14:10.318871] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-22T21:14:10.318958] [INFO ] [MAIN ] Update Progress: 1912/2372 symbols completed. SHOC took 16.3s. Estimated remaining: 1h 1m 8s. Rate: 7.5 symbols/min [2025-09-22T21:14:10.490552] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:14:10.548178] [DEBUG] [LOCAL ] SID: Loaded 42784 existing records from primary storage. [2025-09-22T21:14:10.548337] [INFO ] [MAIN ] SID: Loaded 42784 existing records. [2025-09-22T21:14:10.728403] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:14:10.728706] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-22T21:14:10.728762] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-22T21:14:10.729966] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-22T21:14:10.730040] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-22T21:14:10.927633] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-22T21:14:11.086763] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:14:11.307236] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:14:11.307577] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-22T21:14:11.722061] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-22T21:14:11.822701] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T21:14:12.522076] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-22T21:14:12.795683] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:14:12.796020] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-22T21:14:13.322032] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-22T21:14:13.527848] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-22T21:14:13.584180] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:14:13.584528] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-22T21:14:14.122058] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-22T21:14:14.421816] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:14:14.422239] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-22T21:14:14.922073] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-22T21:14:15.722049] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-22T21:14:16.522064] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-22T21:14:16.721354] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T21:14:17.322072] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-22T21:14:17.739216] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-22T21:14:18.122074] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-22T21:14:18.206716] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T21:14:18.386818] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:14:18.387188] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-22T21:14:18.849113] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T21:14:18.922077] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-22T21:14:19.722071] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-22T21:14:20.075177] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:14:20.075814] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-22T21:14:20.398793] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T21:14:20.522077] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-22T21:14:20.987042] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-22T21:14:21.322066] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-22T21:14:22.122075] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-22T21:14:22.566173] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-22T21:14:22.922066] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-22T21:14:23.722078] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-22T21:14:24.171550] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-22T21:14:24.522075] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-22T21:14:25.190054] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T21:14:25.322028] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-22T21:14:26.122101] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-22T21:14:26.362594] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T21:14:26.922073] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-22T21:14:27.057556] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-22T21:14:27.292688] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T21:14:27.315945] [INFO ] [REMOTE ] SHO: Full fetch complete (71185 records). [2025-09-22T21:14:27.317356] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (4.40 seconds). [2025-09-22T21:14:27.317476] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-22T21:14:27.725396] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-22T21:14:27.725936] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-22T21:14:27.727097] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-22T21:14:27.728398] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-22T21:14:27.728570] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-22T21:14:27.730375] [DEBUG] [LOCAL ] SHO: Trimmed 71185 records to 49833 (keeping 200 days of data) [2025-09-22T21:14:28.039181] [DEBUG] [LOCAL ] SHO: Primary data saved (49833 records). [2025-09-22T21:14:28.039322] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-22T21:14:28.039408] [INFO ] [MAIN ] Update Progress: 1913/2372 symbols completed. SHO took 40.7s. Estimated remaining: 1h 1m 2s. Rate: 7.5 symbols/min [2025-09-22T21:14:28.226817] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:14:28.281889] [DEBUG] [LOCAL ] SIG: Loaded 47367 existing records from primary storage. [2025-09-22T21:14:28.282053] [INFO ] [MAIN ] SIG: Loaded 47367 existing records. [2025-09-22T21:14:28.464317] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:14:28.464715] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-22T21:14:28.464797] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-22T21:14:28.466081] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-22T21:14:28.466145] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-22T21:14:28.528958] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-22T21:14:28.773791] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-22T21:14:28.879500] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:14:28.932750] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T21:14:29.322063] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-22T21:14:29.371030] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T21:14:29.374279] [INFO ] [REMOTE ] SI: Full fetch complete (5558 records). [2025-09-22T21:14:29.374353] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-22T21:14:29.571768] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 37 unique days, need 200 days [2025-09-22T21:14:29.571998] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:14:29.572083] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:14:29.572157] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-22T21:14:29.572223] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-22T21:14:29.572273] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-22T21:14:29.572358] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-22T21:14:29.572455] [INFO ] [MAIN ] Update Progress: 1914/2372 symbols completed. SI took 22.4s. Estimated remaining: 1h 0m 53s. Rate: 7.5 symbols/min [2025-09-22T21:14:29.768117] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:14:29.790896] [DEBUG] [LOCAL ] SII: Loaded 23334 existing records from primary storage. [2025-09-22T21:14:29.791045] [INFO ] [MAIN ] SII: Loaded 23334 existing records. [2025-09-22T21:14:29.971817] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:14:29.972091] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-22T21:14:29.972138] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-22T21:14:29.972823] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-22T21:14:29.972882] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-22T21:14:30.127571] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-22T21:14:30.342640] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:14:30.922082] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-22T21:14:31.056392] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T21:14:31.722075] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-22T21:14:32.235692] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-22T21:14:32.522032] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-22T21:14:32.762948] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-22T21:14:33.325067] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-22T21:14:33.330607] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T21:14:33.465800] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-22T21:14:34.122058] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-22T21:14:34.922200] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-22T21:14:35.134816] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T21:14:35.722098] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-22T21:14:35.857734] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T21:14:36.129717] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-22T21:14:36.139611] [INFO ] [REMOTE ] SHW: Full fetch complete (73008 records). [2025-09-22T21:14:36.140152] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-22T21:14:36.541101] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-22T21:14:36.566141] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-22T21:14:36.566251] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-22T21:14:36.567513] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-22T21:14:36.567580] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-22T21:14:36.569199] [DEBUG] [LOCAL ] SHW: Trimmed 73008 records to 50514 (keeping 200 days of data) [2025-09-22T21:14:36.894130] [DEBUG] [LOCAL ] SHW: Primary data saved (50514 records). [2025-09-22T21:14:36.894277] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-22T21:14:36.894367] [INFO ] [MAIN ] Update Progress: 1915/2372 symbols completed. SHW took 41.1s. Estimated remaining: 1h 0m 45s. Rate: 7.5 symbols/min [2025-09-22T21:14:37.069740] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:14:37.102030] [DEBUG] [LOCAL ] SILA: Loaded 31717 existing records from primary storage. [2025-09-22T21:14:37.102213] [INFO ] [MAIN ] SILA: Loaded 31717 existing records. [2025-09-22T21:14:37.319173] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T21:14:37.317576] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:14:37.326624] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-22T21:14:37.328233] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-22T21:14:37.328332] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-22T21:14:37.329077] [INFO ] [REMOTE ] SID: Full fetch complete (60900 records). [2025-09-22T21:14:37.329263] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-22T21:14:37.329454] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-22T21:14:37.329238] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-22T21:14:38.139285] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:14:38.161114] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-22T21:14:38.222230] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-22T21:14:38.222381] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-22T21:14:38.223811] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-22T21:14:38.223958] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-22T21:14:38.225439] [DEBUG] [LOCAL ] SID: Trimmed 60900 records to 42208 (keeping 200 days of data) [2025-09-22T21:14:38.339152] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T21:14:38.477019] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-22T21:14:38.530203] [DEBUG] [LOCAL ] SID: Primary data saved (42208 records). [2025-09-22T21:14:38.530372] [INFO ] [MAIN ] SID: Full history saved. [2025-09-22T21:14:38.530476] [INFO ] [MAIN ] Update Progress: 1916/2372 symbols completed. SID took 28.2s. Estimated remaining: 1h 0m 35s. Rate: 7.5 symbols/min [2025-09-22T21:14:38.701730] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:14:38.741489] [DEBUG] [LOCAL ] SITC: Loaded 42271 existing records from primary storage. [2025-09-22T21:14:38.741639] [INFO ] [MAIN ] SITC: Loaded 42271 existing records. [2025-09-22T21:14:38.919158] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:14:38.919415] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-22T21:14:38.919463] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-22T21:14:38.920925] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-22T21:14:38.920985] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-22T21:14:38.932336] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-22T21:14:39.286612] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:14:39.571061] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T21:14:39.722079] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-22T21:14:40.522092] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-22T21:14:40.923831] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T21:14:41.087679] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-22T21:14:41.322032] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-22T21:14:41.460139] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T21:14:42.122080] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-22T21:14:42.922034] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-22T21:14:43.236316] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T21:14:43.299554] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-22T21:14:43.722101] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-22T21:14:44.249480] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T21:14:44.522107] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-22T21:14:45.322044] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-22T21:14:45.586332] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T21:14:45.649321] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T21:14:46.122069] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-22T21:14:46.922036] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-22T21:14:47.244679] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-22T21:14:47.722079] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-22T21:14:47.993112] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T21:14:48.281426] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T21:14:48.522060] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-22T21:14:49.288619] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T21:14:49.322001] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-22T21:14:50.122292] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-22T21:14:50.611889] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-22T21:14:50.874111] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T21:14:50.922055] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-22T21:14:51.602337] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T21:14:51.722009] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-22T21:14:52.169639] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-22T21:14:52.522075] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-22T21:14:53.139209] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T21:14:53.322012] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-22T21:14:53.894129] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T21:14:54.122099] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-22T21:14:54.739413] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T21:14:54.922067] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-22T21:14:55.402540] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T21:14:55.722044] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-22T21:14:56.426728] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T21:14:56.522057] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-22T21:14:56.928573] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-22T21:14:57.322062] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-22T21:14:57.764533] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T21:14:58.122109] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-22T21:14:58.245049] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-22T21:14:58.922112] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-22T21:14:59.722067] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-22T21:14:59.783152] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T21:15:00.522042] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-22T21:15:00.546431] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T21:15:00.553505] [INFO ] [REMOTE ] SIG: Full fetch complete (68340 records). [2025-09-22T21:15:00.553621] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-22T21:15:00.947556] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-22T21:15:00.947675] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-22T21:15:00.959328] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-22T21:15:00.960313] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T21:15:00.959950] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-22T21:15:00.965086] [INFO ] [REMOTE ] SILA: Full fetch complete (45292 records). [2025-09-22T21:15:00.965271] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-22T21:15:00.998295] [DEBUG] [LOCAL ] SIG: Trimmed 68340 records to 46617 (keeping 200 days of data) [2025-09-22T21:15:01.347726] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-22T21:15:01.470727] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-22T21:15:01.471544] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-22T21:15:01.472866] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-22T21:15:01.473178] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-22T21:15:01.479619] [DEBUG] [LOCAL ] SILA: Trimmed 45292 records to 31305 (keeping 200 days of data) [2025-09-22T21:15:01.787576] [DEBUG] [LOCAL ] SIG: Primary data saved (46617 records). [2025-09-22T21:15:01.787748] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-22T21:15:01.787857] [INFO ] [MAIN ] Update Progress: 1917/2372 symbols completed. SIG took 33.7s. Estimated remaining: 1h 0m 31s. Rate: 7.5 symbols/min [2025-09-22T21:15:01.861282] [DEBUG] [LOCAL ] SILA: Primary data saved (31305 records). [2025-09-22T21:15:01.861443] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-22T21:15:01.861541] [INFO ] [MAIN ] Update Progress: 1918/2372 symbols completed. SILA took 25.0s. Estimated remaining: 1h 0m 21s. Rate: 7.5 symbols/min [2025-09-22T21:15:02.593610] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-22T21:15:02.602775] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-22T21:15:05.340217] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (3.99 seconds). [2025-09-22T21:15:05.345243] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-22T21:15:05.500259] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (2.90 seconds). [2025-09-22T21:15:05.509593] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-22T21:15:06.424735] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T21:15:06.429090] [INFO ] [REMOTE ] SII: Full fetch complete (29525 records). [2025-09-22T21:15:06.429246] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-22T21:15:06.854098] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-22T21:15:06.854352] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-22T21:15:06.855301] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-22T21:15:06.855486] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-22T21:15:06.856810] [DEBUG] [LOCAL ] SII: Trimmed 29525 records to 23172 (keeping 200 days of data) [2025-09-22T21:15:06.978155] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T21:15:06.992048] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-22T21:15:07.048769] [DEBUG] [LOCAL ] SII: Primary data saved (23172 records). [2025-09-22T21:15:07.048942] [INFO ] [MAIN ] SII: Full history saved. [2025-09-22T21:15:07.049043] [INFO ] [MAIN ] Update Progress: 1919/2372 symbols completed. SII took 37.5s. Estimated remaining: 1h 0m 12s. Rate: 7.5 symbols/min [2025-09-22T21:15:08.705769] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T21:15:08.715669] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-22T21:15:10.211626] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T21:15:10.218875] [INFO ] [REMOTE ] SITC: Full fetch complete (60803 records). [2025-09-22T21:15:10.218980] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-22T21:15:10.610680] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-22T21:15:10.610769] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-22T21:15:10.611921] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-22T21:15:10.611989] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-22T21:15:10.613255] [DEBUG] [LOCAL ] SITC: Trimmed 60803 records to 41544 (keeping 200 days of data) [2025-09-22T21:15:10.857900] [DEBUG] [LOCAL ] SITC: Primary data saved (41544 records). [2025-09-22T21:15:10.858032] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-22T21:15:10.858115] [INFO ] [MAIN ] Update Progress: 1920/2372 symbols completed. SITC took 32.3s. Estimated remaining: 1h 0m 4s. Rate: 7.5 symbols/min [2025-09-22T21:15:11.398157] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:15:11.429690] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:15:11.550761] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:15:11.574175] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:15:11.610608] [DEBUG] [LOCAL ] SJT: Loaded 22386 existing records from primary storage. [2025-09-22T21:15:11.610876] [INFO ] [MAIN ] SJT: Loaded 22386 existing records. [2025-09-22T21:15:11.721735] [DEBUG] [LOCAL ] SKE: Loaded 35981 existing records from primary storage. [2025-09-22T21:15:11.747264] [INFO ] [MAIN ] SKE: Loaded 35981 existing records. [2025-09-22T21:15:11.789744] [DEBUG] [LOCAL ] SJM: Loaded 50900 existing records from primary storage. [2025-09-22T21:15:11.816608] [INFO ] [MAIN ] SJM: Loaded 50900 existing records. [2025-09-22T21:15:11.816511] [DEBUG] [LOCAL ] SITE: Loaded 35827 existing records from primary storage. [2025-09-22T21:15:11.853685] [INFO ] [MAIN ] SITE: Loaded 35827 existing records. [2025-09-22T21:15:12.125504] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:15:12.179308] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-22T21:15:12.313387] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-22T21:15:12.323899] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:15:12.381967] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-22T21:15:12.382082] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-22T21:15:12.381898] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-22T21:15:12.381818] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:15:12.382214] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-22T21:15:12.433816] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-22T21:15:12.441898] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-22T21:15:12.440941] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-22T21:15:12.451726] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-22T21:15:12.482386] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:15:12.532943] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-22T21:15:12.533055] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-22T21:15:12.573900] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-22T21:15:12.619393] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-22T21:15:12.726414] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-22T21:15:12.737720] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-22T21:15:13.625323] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:15:13.704955] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-22T21:15:13.788341] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:15:13.810717] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-22T21:15:13.891294] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:15:13.891742] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-22T21:15:13.974304] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:15:13.974700] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-22T21:15:14.964694] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T21:15:14.976011] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-22T21:15:15.007126] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T21:15:15.012745] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-22T21:15:15.372058] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T21:15:15.380242] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-22T21:15:15.736947] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T21:15:15.747136] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-22T21:15:15.846953] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T21:15:15.852995] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-22T21:15:16.450057] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T21:15:16.456678] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-22T21:15:16.788840] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T21:15:16.795720] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-22T21:15:17.033335] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T21:15:17.038316] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-22T21:15:17.474438] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T21:15:17.484380] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-22T21:15:17.882952] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T21:15:17.887916] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-22T21:15:17.999517] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T21:15:18.007042] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-22T21:15:18.332011] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T21:15:18.339543] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-22T21:15:19.263743] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-22T21:15:19.273494] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-22T21:15:19.322704] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T21:15:19.499467] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T21:15:19.530037] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T21:15:19.722061] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-22T21:15:20.522056] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-22T21:15:20.823583] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T21:15:21.067636] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T21:15:21.322053] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-22T21:15:22.128542] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-22T21:15:22.144096] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T21:15:22.617195] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T21:15:22.922052] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-22T21:15:23.710203] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:15:23.722003] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-22T21:15:24.522048] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-22T21:15:24.551726] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T21:15:25.322028] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-22T21:15:25.396790] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T21:15:26.082557] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T21:15:26.122011] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-22T21:15:26.788568] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T21:15:26.922103] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-22T21:15:27.491736] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T21:15:27.722056] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-22T21:15:28.219819] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-22T21:15:28.522116] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-22T21:15:29.322120] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-22T21:15:29.539232] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T21:15:29.810680] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T21:15:30.122089] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-22T21:15:30.442951] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T21:15:30.885923] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T21:15:30.922068] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-22T21:15:31.722052] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-22T21:15:32.337300] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T21:15:32.343958] [INFO ] [REMOTE ] SKE: Full fetch complete (50147 records). [2025-09-22T21:15:32.344099] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-22T21:15:32.539695] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-22T21:15:32.762525] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-22T21:15:32.762823] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-22T21:15:32.763849] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-22T21:15:32.763942] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-22T21:15:32.780590] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T21:15:32.786509] [DEBUG] [LOCAL ] SKE: Trimmed 50147 records to 35517 (keeping 200 days of data) [2025-09-22T21:15:33.008750] [DEBUG] [LOCAL ] SKE: Primary data saved (35517 records). [2025-09-22T21:15:33.008923] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-22T21:15:33.011189] [INFO ] [MAIN ] Update Progress: 1921/2372 symbols completed. SKE took 22.2s. Estimated remaining: 59m 59s. Rate: 7.5 symbols/min [2025-09-22T21:15:33.186422] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:15:33.200285] [DEBUG] [LOCAL ] SKIL: Loaded 6478 existing records from primary storage. [2025-09-22T21:15:33.200429] [INFO ] [MAIN ] SKIL: Loaded 6478 existing records. [2025-09-22T21:15:33.327156] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-22T21:15:33.399051] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:15:33.399375] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-22T21:15:33.399446] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-22T21:15:33.399884] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-22T21:15:33.399946] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-22T21:15:33.771198] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:15:34.122035] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-22T21:15:34.475077] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T21:15:34.479730] [INFO ] [REMOTE ] SJT: Full fetch complete (32117 records). [2025-09-22T21:15:34.479822] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-22T21:15:34.872683] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-22T21:15:34.872847] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-22T21:15:34.873595] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-22T21:15:34.873751] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-22T21:15:34.887517] [DEBUG] [LOCAL ] SJT: Trimmed 32117 records to 21980 (keeping 200 days of data) [2025-09-22T21:15:34.908053] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-22T21:15:34.959988] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-22T21:15:35.043745] [DEBUG] [LOCAL ] SJT: Primary data saved (21980 records). [2025-09-22T21:15:35.043888] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-22T21:15:35.044037] [INFO ] [MAIN ] Update Progress: 1922/2372 symbols completed. SJT took 24.2s. Estimated remaining: 59m 50s. Rate: 7.5 symbols/min [2025-09-22T21:15:35.213479] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:15:35.226188] [DEBUG] [LOCAL ] SKLZ: Loaded 12179 existing records from primary storage. [2025-09-22T21:15:35.226319] [INFO ] [MAIN ] SKLZ: Loaded 12179 existing records. [2025-09-22T21:15:35.419128] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:15:35.419406] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-22T21:15:35.419475] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-22T21:15:35.419912] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-22T21:15:35.419973] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-22T21:15:35.725488] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T21:15:35.730912] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-22T21:15:35.831521] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:15:35.837140] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T21:15:36.522113] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-22T21:15:37.322051] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-22T21:15:37.395864] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T21:15:37.721324] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-22T21:15:38.122050] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-22T21:15:38.559085] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T21:15:38.922079] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-22T21:15:39.563984] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-22T21:15:39.722037] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-22T21:15:40.026835] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T21:15:40.522133] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-22T21:15:41.322031] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-22T21:15:41.480345] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-22T21:15:41.489575] [INFO ] [REMOTE ] SJM: Full fetch complete (71986 records). [2025-09-22T21:15:41.489781] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-22T21:15:41.977056] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-22T21:15:41.977219] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-22T21:15:41.978852] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-22T21:15:41.981001] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T21:15:41.979821] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-22T21:15:41.988563] [INFO ] [REMOTE ] SITE: Full fetch complete (49191 records). [2025-09-22T21:15:41.988960] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-22T21:15:42.019268] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-22T21:15:42.045952] [DEBUG] [LOCAL ] SJM: Trimmed 71986 records to 50126 (keeping 200 days of data) [2025-09-22T21:15:42.171618] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-22T21:15:42.533975] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-22T21:15:42.534141] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-22T21:15:42.536124] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-22T21:15:42.536548] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-22T21:15:42.541132] [DEBUG] [LOCAL ] SITE: Trimmed 49191 records to 35218 (keeping 200 days of data) [2025-09-22T21:15:42.928936] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-22T21:15:42.967790] [DEBUG] [LOCAL ] SITE: Primary data saved (35218 records). [2025-09-22T21:15:42.968461] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-22T21:15:42.968966] [INFO ] [MAIN ] Update Progress: 1923/2372 symbols completed. SITE took 32.1s. Estimated remaining: 59m 42s. Rate: 7.5 symbols/min [2025-09-22T21:15:43.162253] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:15:43.164062] [DEBUG] [LOCAL ] SJM: Primary data saved (50126 records). [2025-09-22T21:15:43.164705] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-22T21:15:43.164848] [INFO ] [MAIN ] Update Progress: 1924/2372 symbols completed. SJM took 32.3s. Estimated remaining: 59m 32s. Rate: 7.5 symbols/min [2025-09-22T21:15:43.271255] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T21:15:43.410117] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:15:43.413130] [DEBUG] [LOCAL ] SKM: Loaded 35883 existing records from primary storage. [2025-09-22T21:15:43.413447] [INFO ] [MAIN ] SKM: Loaded 35883 existing records. [2025-09-22T21:15:43.615781] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:15:43.616577] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-22T21:15:43.616760] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-22T21:15:43.617823] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-22T21:15:43.617901] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-22T21:15:43.741762] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-22T21:15:43.771519] [DEBUG] [LOCAL ] SKT: Loaded 43272 existing records from primary storage. [2025-09-22T21:15:43.823995] [INFO ] [MAIN ] SKT: Loaded 43272 existing records. [2025-09-22T21:15:43.842366] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T21:15:44.216666] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:15:44.221300] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:15:44.221918] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-22T21:15:44.221981] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-22T21:15:44.223079] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-22T21:15:44.223140] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-22T21:15:44.523458] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-22T21:15:44.606534] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:15:44.799447] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T21:15:45.322056] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-22T21:15:45.831115] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T21:15:46.122057] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-22T21:15:46.275421] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-22T21:15:46.631063] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-22T21:15:46.922086] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-22T21:15:47.722127] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-22T21:15:48.129131] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T21:15:48.341116] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-22T21:15:48.522060] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-22T21:15:49.322072] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-22T21:15:50.049828] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T21:15:50.122034] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-22T21:15:50.878317] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T21:15:50.922059] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-22T21:15:51.612511] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T21:15:51.722088] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-22T21:15:52.447041] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T21:15:52.522071] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-22T21:15:53.327263] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-22T21:15:53.342772] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T21:15:54.122120] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-22T21:15:54.177411] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T21:15:54.230429] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-22T21:15:54.922060] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-22T21:15:55.672516] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T21:15:55.730886] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-22T21:15:55.753452] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T21:15:56.522090] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-22T21:15:56.642470] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-22T21:15:57.105461] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-22T21:15:57.322055] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-22T21:15:58.021007] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-22T21:15:58.122065] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-22T21:15:58.922021] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-22T21:15:58.976253] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T21:15:58.978318] [INFO ] [REMOTE ] SKIL: Full fetch complete (10030 records). [2025-09-22T21:15:58.978388] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-22T21:15:59.348232] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-22T21:15:59.348320] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-22T21:15:59.348575] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-22T21:15:59.348683] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-22T21:15:59.349222] [DEBUG] [LOCAL ] SKIL: Trimmed 10030 records to 6382 (keeping 200 days of data) [2025-09-22T21:15:59.393494] [DEBUG] [LOCAL ] SKIL: Primary data saved (6382 records). [2025-09-22T21:15:59.393622] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-22T21:15:59.393822] [INFO ] [MAIN ] Update Progress: 1925/2372 symbols completed. SKIL took 26.4s. Estimated remaining: 59m 26s. Rate: 7.5 symbols/min [2025-09-22T21:15:59.565076] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:15:59.626460] [DEBUG] [LOCAL ] SKY: Loaded 38269 existing records from primary storage. [2025-09-22T21:15:59.626617] [INFO ] [MAIN ] SKY: Loaded 38269 existing records. [2025-09-22T21:15:59.727958] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-22T21:15:59.813374] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:15:59.813607] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-22T21:15:59.813689] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-22T21:15:59.814547] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-22T21:15:59.814622] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-22T21:16:00.191022] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:16:00.303449] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T21:16:00.522064] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-22T21:16:01.322078] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-22T21:16:01.441967] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T21:16:01.797694] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-22T21:16:02.122105] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-22T21:16:02.928688] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-22T21:16:02.935391] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T21:16:03.385377] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-22T21:16:03.637163] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-22T21:16:03.722064] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-22T21:16:04.522067] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-22T21:16:05.245879] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T21:16:05.322033] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-22T21:16:05.564698] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T21:16:06.122107] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-22T21:16:06.911236] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T21:16:06.922001] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-22T21:16:07.636731] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T21:16:07.722101] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-22T21:16:08.465372] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T21:16:08.522011] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-22T21:16:09.046340] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T21:16:09.322065] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-22T21:16:10.122084] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-22T21:16:10.147537] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T21:16:10.849008] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T21:16:10.852749] [INFO ] [REMOTE ] SKLZ: Full fetch complete (19123 records). [2025-09-22T21:16:10.852932] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-22T21:16:10.944092] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-22T21:16:11.011138] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T21:16:11.292997] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-22T21:16:11.293098] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-22T21:16:11.293514] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-22T21:16:11.293574] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-22T21:16:11.294773] [DEBUG] [LOCAL ] SKLZ: Trimmed 19123 records to 12006 (keeping 200 days of data) [2025-09-22T21:16:11.364377] [DEBUG] [LOCAL ] SKLZ: Primary data saved (12006 records). [2025-09-22T21:16:11.364525] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-22T21:16:11.364766] [INFO ] [MAIN ] Update Progress: 1926/2372 symbols completed. SKLZ took 36.3s. Estimated remaining: 59m 19s. Rate: 7.5 symbols/min [2025-09-22T21:16:11.542364] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:16:11.562595] [DEBUG] [LOCAL ] SKYH: Loaded 16800 existing records from primary storage. [2025-09-22T21:16:11.562745] [INFO ] [MAIN ] SKYH: Loaded 16800 existing records. [2025-09-22T21:16:11.744089] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-22T21:16:11.750501] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:16:11.751626] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-22T21:16:11.751726] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-22T21:16:11.752229] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-22T21:16:11.752291] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-22T21:16:12.129306] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:16:12.324680] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T21:16:12.330621] [INFO ] [REMOTE ] SKM: Full fetch complete (48108 records). [2025-09-22T21:16:12.330805] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-22T21:16:12.528606] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-22T21:16:12.730298] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-22T21:16:12.730377] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-22T21:16:12.731506] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-22T21:16:12.731568] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-22T21:16:12.733334] [DEBUG] [LOCAL ] SKM: Trimmed 48108 records to 35277 (keeping 200 days of data) [2025-09-22T21:16:12.974017] [DEBUG] [LOCAL ] SKM: Primary data saved (35277 records). [2025-09-22T21:16:12.974205] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-22T21:16:12.974319] [INFO ] [MAIN ] Update Progress: 1927/2372 symbols completed. SKM took 30.0s. Estimated remaining: 59m 9s. Rate: 7.5 symbols/min [2025-09-22T21:16:13.162775] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:16:13.219345] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-22T21:16:13.219520] [INFO ] [MAIN ] SLB: Loaded 54477 existing records. [2025-09-22T21:16:13.323714] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-22T21:16:13.434382] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-22T21:16:13.457165] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:16:13.468130] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-22T21:16:13.468306] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-22T21:16:13.474495] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-22T21:16:13.480702] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-22T21:16:13.486344] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T21:16:13.867664] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:16:14.122058] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-22T21:16:14.922086] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-22T21:16:15.006721] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T21:16:15.620237] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T21:16:15.722095] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-22T21:16:16.412553] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-22T21:16:16.522071] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-22T21:16:17.322020] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-22T21:16:17.494416] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T21:16:18.122079] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-22T21:16:18.162058] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T21:16:18.170985] [INFO ] [REMOTE ] SKT: Full fetch complete (59949 records). [2025-09-22T21:16:18.171109] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-22T21:16:18.571915] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-22T21:16:18.572006] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-22T21:16:18.573067] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-22T21:16:18.573132] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-22T21:16:18.574446] [DEBUG] [LOCAL ] SKT: Trimmed 59949 records to 42608 (keeping 200 days of data) [2025-09-22T21:16:18.849854] [DEBUG] [LOCAL ] SKT: Primary data saved (42608 records). [2025-09-22T21:16:18.849998] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-22T21:16:18.850130] [INFO ] [MAIN ] Update Progress: 1928/2372 symbols completed. SKT took 35.7s. Estimated remaining: 59m 1s. Rate: 7.5 symbols/min [2025-09-22T21:16:18.926168] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-22T21:16:18.983994] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T21:16:19.065250] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:16:19.110177] [DEBUG] [LOCAL ] SLF: Loaded 39801 existing records from primary storage. [2025-09-22T21:16:19.110372] [INFO ] [MAIN ] SLF: Loaded 39801 existing records. [2025-09-22T21:16:19.324350] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:16:19.324932] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-22T21:16:19.325147] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-22T21:16:19.326336] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-22T21:16:19.326424] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-22T21:16:19.719680] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-22T21:16:19.735438] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-22T21:16:19.751510] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:16:20.522085] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-22T21:16:20.660049] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T21:16:20.719245] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T21:16:21.322059] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-22T21:16:22.122111] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-22T21:16:22.324120] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T21:16:22.543759] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-22T21:16:22.922065] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-22T21:16:23.722147] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-22T21:16:23.855499] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T21:16:24.416292] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T21:16:24.522036] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-22T21:16:24.778861] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T21:16:25.322078] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-22T21:16:26.127683] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-22T21:16:26.138927] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T21:16:26.815608] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T21:16:26.922054] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-22T21:16:27.722073] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-22T21:16:28.252682] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-22T21:16:28.411445] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T21:16:28.522031] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-22T21:16:29.262003] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T21:16:29.269016] [INFO ] [REMOTE ] SKY: Full fetch complete (54855 records). [2025-09-22T21:16:29.269136] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-22T21:16:29.335252] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-22T21:16:29.710877] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-22T21:16:29.710967] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-22T21:16:29.712071] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-22T21:16:29.712151] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-22T21:16:29.713481] [DEBUG] [LOCAL ] SKY: Trimmed 54855 records to 37728 (keeping 200 days of data) [2025-09-22T21:16:29.947252] [DEBUG] [LOCAL ] SKY: Primary data saved (37728 records). [2025-09-22T21:16:29.947434] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-22T21:16:29.947557] [INFO ] [MAIN ] Update Progress: 1929/2372 symbols completed. SKY took 30.6s. Estimated remaining: 58m 53s. Rate: 7.5 symbols/min [2025-09-22T21:16:30.139281] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-22T21:16:30.143449] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:16:30.174719] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T21:16:30.227008] [DEBUG] [LOCAL ] SLG: Loaded 46335 existing records from primary storage. [2025-09-22T21:16:30.227188] [INFO ] [MAIN ] SLG: Loaded 46335 existing records. [2025-09-22T21:16:30.430354] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:16:30.430609] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-22T21:16:30.430695] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-22T21:16:30.432132] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-22T21:16:30.432199] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-22T21:16:30.584147] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T21:16:30.855767] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:16:30.922065] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-22T21:16:31.722087] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-22T21:16:32.441995] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-22T21:16:32.522033] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-22T21:16:32.733324] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T21:16:32.733903] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T21:16:33.322095] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-22T21:16:34.122115] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-22T21:16:34.276665] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T21:16:34.760935] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-22T21:16:34.922047] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-22T21:16:35.324698] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T21:16:35.722030] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-22T21:16:35.785139] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-22T21:16:35.787864] [INFO ] [REMOTE ] SKYH: Full fetch complete (22595 records). [2025-09-22T21:16:35.787941] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-22T21:16:36.158331] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-22T21:16:36.158446] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-22T21:16:36.158952] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-22T21:16:36.159014] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-22T21:16:36.159758] [DEBUG] [LOCAL ] SKYH: Trimmed 22595 records to 16593 (keeping 200 days of data) [2025-09-22T21:16:36.262158] [DEBUG] [LOCAL ] SKYH: Primary data saved (16593 records). [2025-09-22T21:16:36.262316] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-22T21:16:36.262416] [INFO ] [MAIN ] Update Progress: 1930/2372 symbols completed. SKYH took 24.9s. Estimated remaining: 58m 45s. Rate: 7.5 symbols/min [2025-09-22T21:16:36.430240] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:16:36.473002] [DEBUG] [LOCAL ] SLGN: Loaded 40961 existing records from primary storage. [2025-09-22T21:16:36.473152] [INFO ] [MAIN ] SLGN: Loaded 40961 existing records. [2025-09-22T21:16:36.535114] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-22T21:16:36.653848] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:16:36.654125] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-22T21:16:36.654184] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-22T21:16:36.655550] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-22T21:16:36.655611] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-22T21:16:37.067776] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:16:37.288682] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T21:16:37.322047] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-22T21:16:38.122065] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-22T21:16:38.648818] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-22T21:16:38.711895] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T21:16:38.922075] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-22T21:16:39.532123] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T21:16:39.722093] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-22T21:16:40.479311] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T21:16:40.522003] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-22T21:16:41.322084] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-22T21:16:41.968234] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-22T21:16:42.084115] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T21:16:42.122113] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-22T21:16:42.847489] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-22T21:16:42.922114] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-22T21:16:43.435297] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T21:16:43.441535] [INFO ] [REMOTE ] SLF: Full fetch complete (56579 records). [2025-09-22T21:16:43.441720] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-22T21:16:43.731044] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-22T21:16:43.848817] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-22T21:16:43.848913] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-22T21:16:43.849908] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-22T21:16:43.849972] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-22T21:16:43.851184] [DEBUG] [LOCAL ] SLF: Trimmed 56579 records to 39113 (keeping 200 days of data) [2025-09-22T21:16:44.100888] [DEBUG] [LOCAL ] SLF: Primary data saved (39113 records). [2025-09-22T21:16:44.101085] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-22T21:16:44.101210] [INFO ] [MAIN ] Update Progress: 1931/2372 symbols completed. SLF took 25.3s. Estimated remaining: 58m 37s. Rate: 7.5 symbols/min [2025-09-22T21:16:44.295196] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:16:44.295555] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-22T21:16:44.295632] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-22T21:16:44.296016] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-22T21:16:44.296137] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-22T21:16:44.296329] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-22T21:16:44.296393] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-22T21:16:44.438785] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T21:16:44.527169] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-22T21:16:44.701723] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:16:45.257952] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T21:16:45.322052] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-22T21:16:45.524362] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T21:16:46.122092] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-22T21:16:46.623397] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T21:16:46.922088] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-22T21:16:47.298187] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T21:16:47.722077] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-22T21:16:48.522033] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-22T21:16:48.789162] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T21:16:48.982405] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-22T21:16:49.072146] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-22T21:16:49.322100] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-22T21:16:50.122082] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-22T21:16:50.544549] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T21:16:50.922081] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-22T21:16:51.236059] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-22T21:16:51.244748] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-09-22T21:16:51.244892] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-22T21:16:51.645606] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-22T21:16:51.645736] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-22T21:16:51.646985] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-22T21:16:51.647058] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-22T21:16:51.648874] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 53697 (keeping 200 days of data) [2025-09-22T21:16:51.742971] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-22T21:16:51.992284] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-09-22T21:16:51.992448] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-22T21:16:51.992537] [INFO ] [MAIN ] Update Progress: 1932/2372 symbols completed. SLB took 39.0s. Estimated remaining: 58m 29s. Rate: 7.5 symbols/min [2025-09-22T21:16:52.169023] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:16:52.214778] [DEBUG] [LOCAL ] SLQT: Loaded 44891 existing records from primary storage. [2025-09-22T21:16:52.215008] [INFO ] [MAIN ] SLQT: Loaded 44891 existing records. [2025-09-22T21:16:52.403872] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:16:52.404347] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-22T21:16:52.404410] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-22T21:16:52.405525] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-22T21:16:52.405588] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-22T21:16:52.526363] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-22T21:16:52.797376] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T21:16:52.810933] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:16:53.040763] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-22T21:16:53.322055] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-22T21:16:53.360356] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T21:16:54.122105] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-22T21:16:54.922064] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-22T21:16:55.055369] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T21:16:55.340978] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-22T21:16:55.617137] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T21:16:55.722057] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-22T21:16:56.522130] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-22T21:16:57.290609] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T21:16:57.322004] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-22T21:16:58.122069] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-22T21:16:58.222035] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T21:16:58.922047] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-22T21:16:59.039758] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T21:16:59.722096] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-22T21:16:59.944716] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T21:17:00.054099] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-22T21:17:00.529542] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-22T21:17:00.532276] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T21:17:01.322057] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-22T21:17:02.122033] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-22T21:17:02.306315] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T21:17:02.922141] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-22T21:17:02.994278] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T21:17:03.631784] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T21:17:03.722104] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-22T21:17:03.826325] [DEBUG] [REMOTE ] SLQT: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-22T21:17:03.826571] [WARN ] [REMOTE ] SLQT: No data returned for month 2025-04 [2025-09-22T21:17:04.522035] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-22T21:17:04.740113] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-22T21:17:04.748105] [INFO ] [REMOTE ] SLG: Full fetch complete (65394 records). [2025-09-22T21:17:04.748275] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-22T21:17:05.052589] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-22T21:17:05.153138] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-22T21:17:05.153223] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-22T21:17:05.154289] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-22T21:17:05.154354] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-22T21:17:05.155785] [DEBUG] [LOCAL ] SLG: Trimmed 65394 records to 45628 (keeping 200 days of data) [2025-09-22T21:17:05.343297] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-22T21:17:05.452043] [DEBUG] [LOCAL ] SLG: Primary data saved (45628 records). [2025-09-22T21:17:05.452189] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-22T21:17:05.452289] [INFO ] [MAIN ] Update Progress: 1933/2372 symbols completed. SLG took 35.5s. Estimated remaining: 58m 22s. Rate: 7.5 symbols/min [2025-09-22T21:17:05.624151] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:17:05.652969] [DEBUG] [LOCAL ] SLVM: Loaded 28435 existing records from primary storage. [2025-09-22T21:17:05.653116] [INFO ] [MAIN ] SLVM: Loaded 28435 existing records. [2025-09-22T21:17:05.834485] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:17:05.834799] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-22T21:17:05.834854] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-22T21:17:05.835956] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-22T21:17:05.836025] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-22T21:17:06.122191] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-22T21:17:06.205974] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:17:06.890685] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T21:17:06.922022] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-22T21:17:07.722125] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-22T21:17:07.835773] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T21:17:08.474835] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T21:17:08.522009] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-22T21:17:09.085024] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T21:17:09.322062] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-22T21:17:10.122082] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-22T21:17:10.258139] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T21:17:10.492022] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T21:17:10.516582] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-22T21:17:10.922122] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-22T21:17:11.722087] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-22T21:17:12.522111] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-22T21:17:12.589748] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T21:17:12.597693] [INFO ] [REMOTE ] SLGN: Full fetch complete (57871 records). [2025-09-22T21:17:12.597888] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-22T21:17:13.017141] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-22T21:17:13.017296] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-22T21:17:13.019009] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-22T21:17:13.019083] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-22T21:17:13.021076] [DEBUG] [LOCAL ] SLGN: Trimmed 57871 records to 40275 (keeping 200 days of data) [2025-09-22T21:17:13.300832] [DEBUG] [LOCAL ] SLGN: Primary data saved (40275 records). [2025-09-22T21:17:13.301024] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-22T21:17:13.301160] [INFO ] [MAIN ] Update Progress: 1934/2372 symbols completed. SLGN took 37.0s. Estimated remaining: 58m 14s. Rate: 7.5 symbols/min [2025-09-22T21:17:13.327309] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-22T21:17:13.495697] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:17:13.571372] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T21:17:13.600366] [DEBUG] [LOCAL ] SM: Loaded 53092 existing records from primary storage. [2025-09-22T21:17:13.600672] [INFO ] [MAIN ] SM: Loaded 53092 existing records. [2025-09-22T21:17:13.795303] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:17:13.796047] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-22T21:17:13.796263] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-22T21:17:13.798602] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-22T21:17:13.798695] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-22T21:17:13.883034] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T21:17:13.996940] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T21:17:14.127244] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-22T21:17:14.223925] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:17:14.922067] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-22T21:17:15.622590] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T21:17:15.629027] [INFO ] [REMOTE ] SLQT: Full fetch complete (56643 records). [2025-09-22T21:17:15.629127] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-22T21:17:15.729966] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-22T21:17:15.825905] [WARN ] [VALIDATOR ] SLQT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-22T21:17:15.826476] [FATAL] [MAIN ] SLQT: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:17:15.826545] [WARN ] [MAIN ] SLQT: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:17:15.826617] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-22T21:17:15.826715] [DEBUG] [LOCAL ] SLQT: No primary data file found to delete. [2025-09-22T21:17:15.826763] [INFO ] [LOCAL ] SLQT: Starting deletion of derivative data. [2025-09-22T21:17:15.827203] [DEBUG] [LOCAL ] SLQT: Deleted derivative data file. [2025-09-22T21:17:15.827301] [INFO ] [MAIN ] Update Progress: 1935/2372 symbols completed. SLQT took 23.8s. Estimated remaining: 58m 5s. Rate: 7.5 symbols/min [2025-09-22T21:17:16.001339] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:17:16.001696] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-22T21:17:16.001790] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-22T21:17:16.001944] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-22T21:17:16.001989] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-22T21:17:16.002040] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-22T21:17:16.002077] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-22T21:17:16.372788] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:17:16.522072] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-22T21:17:16.710628] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T21:17:16.897476] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-22T21:17:17.136572] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T21:17:17.322015] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-22T21:17:18.122076] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-22T21:17:18.638203] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-22T21:17:18.922069] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-22T21:17:19.722038] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-22T21:17:20.100721] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-22T21:17:20.144447] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-22T21:17:20.145242] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1050 records). [2025-09-22T21:17:20.145311] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-22T21:17:20.329765] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-22T21:17:20.345413] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:17:20.345575] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:17:20.346256] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-22T21:17:20.346828] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T21:17:20.347101] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-22T21:17:20.352911] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-22T21:17:20.353429] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-22T21:17:20.353901] [INFO ] [MAIN ] Update Progress: 1936/2372 symbols completed. SLNZ took 36.3s. Estimated remaining: 57m 56s. Rate: 7.5 symbols/min [2025-09-22T21:17:20.523674] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-22T21:17:20.525536] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:17:20.538000] [DEBUG] [LOCAL ] SMBK: Loaded 8378 existing records from primary storage. [2025-09-22T21:17:20.538159] [INFO ] [MAIN ] SMBK: Loaded 8378 existing records. [2025-09-22T21:17:20.720959] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:17:20.721275] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-22T21:17:20.721326] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-22T21:17:20.721802] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-22T21:17:20.721917] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-22T21:17:21.087183] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:17:21.322062] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-22T21:17:22.122059] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-22T21:17:22.488363] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:17:22.488731] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-22T21:17:22.654012] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-22T21:17:22.822674] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-22T21:17:22.922019] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-22T21:17:23.722048] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-22T21:17:24.522031] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-09-22T21:17:24.629222] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-22T21:17:24.805320] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:17:24.808893] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-09-22T21:17:24.811033] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T21:17:25.322055] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-22T21:17:26.122041] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-22T21:17:26.192628] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T21:17:26.922068] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-22T21:17:27.194292] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:17:27.194692] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-22T21:17:27.417893] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-22T21:17:27.722064] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-22T21:17:27.982620] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:17:27.983097] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-22T21:17:28.522026] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-22T21:17:29.322058] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-22T21:17:30.101067] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:17:30.122005] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-22T21:17:30.922046] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-22T21:17:31.290015] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-22T21:17:31.635189] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T21:17:31.722017] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-22T21:17:32.117970] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-22T21:17:32.522075] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-22T21:17:33.115617] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T21:17:33.322055] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-22T21:17:34.122015] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-22T21:17:34.436873] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T21:17:34.523902] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T21:17:34.528683] [INFO ] [REMOTE ] SLVM: Full fetch complete (39435 records). [2025-09-22T21:17:34.528773] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-22T21:17:34.912040] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-22T21:17:34.912136] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-22T21:17:34.913083] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-22T21:17:34.913149] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-22T21:17:34.914260] [DEBUG] [LOCAL ] SLVM: Trimmed 39435 records to 27918 (keeping 200 days of data) [2025-09-22T21:17:34.969231] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-22T21:17:35.097123] [DEBUG] [LOCAL ] SLVM: Primary data saved (27918 records). [2025-09-22T21:17:35.097275] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-22T21:17:35.097363] [INFO ] [MAIN ] Update Progress: 1937/2372 symbols completed. SLVM took 29.6s. Estimated remaining: 57m 50s. Rate: 7.5 symbols/min [2025-09-22T21:17:35.328492] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:17:35.346227] [DEBUG] [LOCAL ] SMC: Loaded 11624 existing records from primary storage. [2025-09-22T21:17:35.346435] [INFO ] [MAIN ] SMC: Loaded 11624 existing records. [2025-09-22T21:17:35.597690] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:17:35.598373] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-22T21:17:35.598790] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-22T21:17:35.599488] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-22T21:17:35.599571] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-22T21:17:35.722061] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-22T21:17:35.775617] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T21:17:35.944733] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-22T21:17:36.191058] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:17:36.522099] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-22T21:17:37.322071] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-22T21:17:37.426766] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T21:17:37.527219] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T21:17:38.122058] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-22T21:17:38.774674] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T21:17:38.789249] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T21:17:38.922057] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-22T21:17:39.722024] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-22T21:17:39.841350] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T21:17:40.522127] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-22T21:17:41.322025] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-22T21:17:41.576911] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T21:17:41.595673] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T21:17:42.115424] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T21:17:42.121992] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-22T21:17:42.661422] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-22T21:17:42.922045] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-22T21:17:43.722032] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-22T21:17:43.830589] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T21:17:44.522064] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-22T21:17:45.322029] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-22T21:17:45.492416] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T21:17:45.625810] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T21:17:46.122097] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-22T21:17:46.545875] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-22T21:17:46.551162] [INFO ] [REMOTE ] SMA: Full fetch complete (29063 records). [2025-09-22T21:17:46.551286] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-22T21:17:46.770554] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 119 unique days, need 200 days [2025-09-22T21:17:46.771122] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:17:46.771199] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:17:46.771278] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-22T21:17:46.771406] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-22T21:17:46.771463] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-22T21:17:46.771508] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-22T21:17:46.771671] [INFO ] [MAIN ] Update Progress: 1938/2372 symbols completed. SMA took 30.9s. Estimated remaining: 57m 43s. Rate: 7.5 symbols/min [2025-09-22T21:17:46.934671] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-22T21:17:46.971596] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:17:46.980742] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T21:17:47.046553] [DEBUG] [LOCAL ] SMFG: Loaded 48863 existing records from primary storage. [2025-09-22T21:17:47.046756] [INFO ] [MAIN ] SMFG: Loaded 48863 existing records. [2025-09-22T21:17:47.247352] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:17:47.247617] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-22T21:17:47.247705] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-22T21:17:47.249061] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-22T21:17:47.249122] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-22T21:17:47.614412] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:17:47.722073] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-22T21:17:47.796123] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T21:17:48.522183] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-22T21:17:48.590532] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-22T21:17:49.202137] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T21:17:49.322035] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-22T21:17:49.870798] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-22T21:17:50.122069] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-22T21:17:50.922087] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-22T21:17:50.999046] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T21:17:51.722063] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-22T21:17:51.825454] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T21:17:52.522101] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-22T21:17:53.322045] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-22T21:17:53.419768] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T21:17:53.437908] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T21:17:53.440378] [INFO ] [REMOTE ] SMC: Full fetch complete (16854 records). [2025-09-22T21:17:53.440469] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-22T21:17:53.808319] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-22T21:17:53.808410] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-22T21:17:53.808858] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-22T21:17:53.808960] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-22T21:17:53.810226] [DEBUG] [LOCAL ] SMC: Trimmed 16854 records to 11489 (keeping 200 days of data) [2025-09-22T21:17:53.882855] [DEBUG] [LOCAL ] SMC: Primary data saved (11489 records). [2025-09-22T21:17:53.883010] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-22T21:17:53.883183] [INFO ] [MAIN ] Update Progress: 1939/2372 symbols completed. SMC took 18.8s. Estimated remaining: 57m 35s. Rate: 7.5 symbols/min [2025-09-22T21:17:54.018173] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-22T21:17:54.052496] [INFO ] [REMOTE ] SMBK: Full fetch complete (11770 records). [2025-09-22T21:17:54.080389] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:17:54.080586] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-22T21:17:54.127381] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-22T21:17:54.460619] [DEBUG] [LOCAL ] SMG: Loaded 44842 existing records from primary storage. [2025-09-22T21:17:54.496251] [INFO ] [MAIN ] SMG: Loaded 44842 existing records. [2025-09-22T21:17:54.596078] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-22T21:17:54.607468] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-22T21:17:54.628509] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-22T21:17:54.628693] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-22T21:17:54.632841] [DEBUG] [LOCAL ] SMBK: Trimmed 11770 records to 8224 (keeping 200 days of data) [2025-09-22T21:17:54.766500] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:17:54.775493] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-22T21:17:54.775578] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-22T21:17:54.775084] [DEBUG] [LOCAL ] SMBK: Primary data saved (8224 records). [2025-09-22T21:17:54.775884] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-22T21:17:54.776147] [INFO ] [MAIN ] Update Progress: 1940/2372 symbols completed. SMBK took 34.4s. Estimated remaining: 57m 25s. Rate: 7.5 symbols/min [2025-09-22T21:17:54.812410] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-22T21:17:54.824802] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-22T21:17:54.951880] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-22T21:17:55.144052] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:17:55.301560] [DEBUG] [LOCAL ] SMHI: Loaded 14797 existing records from primary storage. [2025-09-22T21:17:55.336156] [INFO ] [MAIN ] SMHI: Loaded 14797 existing records. [2025-09-22T21:17:55.443421] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:17:55.595307] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:17:55.595712] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-22T21:17:55.595772] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-22T21:17:55.596352] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-22T21:17:55.596423] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-22T21:17:55.726765] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-22T21:17:55.992944] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:17:56.020467] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T21:17:56.030173] [INFO ] [REMOTE ] SM: Full fetch complete (75140 records). [2025-09-22T21:17:56.030371] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-22T21:17:56.463799] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-22T21:17:56.464071] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-22T21:17:56.465679] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-22T21:17:56.465852] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-22T21:17:56.471273] [DEBUG] [LOCAL ] SM: Trimmed 75140 records to 52322 (keeping 200 days of data) [2025-09-22T21:17:56.543306] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-22T21:17:56.629978] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T21:17:56.865102] [DEBUG] [LOCAL ] SM: Primary data saved (52322 records). [2025-09-22T21:17:56.865295] [INFO ] [MAIN ] SM: Full history saved. [2025-09-22T21:17:56.865462] [INFO ] [MAIN ] Update Progress: 1941/2372 symbols completed. SM took 43.6s. Estimated remaining: 57m 16s. Rate: 7.5 symbols/min [2025-09-22T21:17:57.045631] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:17:57.067764] [DEBUG] [LOCAL ] SMP: Loaded 20250 existing records from primary storage. [2025-09-22T21:17:57.067951] [INFO ] [MAIN ] SMP: Loaded 20250 existing records. [2025-09-22T21:17:57.271378] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:17:57.271954] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-22T21:17:57.272012] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-22T21:17:57.273443] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-22T21:17:57.273511] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-22T21:17:57.329797] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-22T21:17:57.627923] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-22T21:17:57.715484] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:17:57.735461] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T21:17:58.122091] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-22T21:17:58.922048] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-22T21:17:59.093500] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T21:17:59.726485] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-22T21:17:59.729272] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T21:18:00.126582] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T21:18:00.522036] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-22T21:18:00.818106] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T21:18:01.322072] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-22T21:18:02.122108] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-22T21:18:02.896433] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-22T21:18:02.922008] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-22T21:18:03.722018] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-22T21:18:04.207678] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-09-22T21:18:04.522057] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-22T21:18:05.117989] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (3.00 seconds). [2025-09-22T21:18:05.322135] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-22T21:18:05.669113] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-22T21:18:06.099774] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-22T21:18:06.122046] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-22T21:18:06.522732] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T21:18:06.922587] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-22T21:18:06.928279] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-22T21:18:07.286346] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T21:18:07.722089] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-22T21:18:07.983901] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T21:18:08.522095] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-22T21:18:09.322142] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-22T21:18:09.391357] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T21:18:09.763921] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T21:18:10.122065] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-22T21:18:10.922047] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-22T21:18:11.043226] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T21:18:11.198938] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T21:18:11.722104] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-22T21:18:11.940527] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-22T21:18:12.522083] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-22T21:18:13.309300] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T21:18:13.322016] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-22T21:18:13.887869] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T21:18:14.122066] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-22T21:18:14.923034] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-22T21:18:14.926319] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T21:18:15.722049] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-22T21:18:15.804586] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T21:18:16.112945] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-22T21:18:16.297946] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-22T21:18:16.522066] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-22T21:18:17.322094] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-22T21:18:18.122042] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-22T21:18:18.192209] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T21:18:18.276250] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T21:18:18.922060] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-22T21:18:19.722282] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-22T21:18:19.973189] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T21:18:19.983937] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T21:18:20.284270] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T21:18:20.287585] [INFO ] [REMOTE ] SMHI: Full fetch complete (24601 records). [2025-09-22T21:18:20.287695] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-22T21:18:20.527138] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-22T21:18:20.670963] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-22T21:18:20.671058] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-22T21:18:20.671637] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-22T21:18:20.671729] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-22T21:18:20.672430] [DEBUG] [LOCAL ] SMHI: Trimmed 24601 records to 14048 (keeping 200 days of data) [2025-09-22T21:18:20.759841] [DEBUG] [LOCAL ] SMHI: Primary data saved (14048 records). [2025-09-22T21:18:20.759976] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-22T21:18:20.760074] [INFO ] [MAIN ] Update Progress: 1942/2372 symbols completed. SMHI took 26.0s. Estimated remaining: 57m 11s. Rate: 7.5 symbols/min [2025-09-22T21:18:20.944055] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:18:20.944245] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-09-22T21:18:20.944282] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-09-22T21:18:20.944426] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-22T21:18:20.944469] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-22T21:18:20.944511] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-22T21:18:20.944544] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-22T21:18:21.345293] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:18:21.339677] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-22T21:18:22.122021] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-22T21:18:22.193195] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T21:18:22.922025] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-22T21:18:22.959346] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T21:18:22.970573] [INFO ] [REMOTE ] SMFG: Full fetch complete (68865 records). [2025-09-22T21:18:22.970783] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-22T21:18:23.390995] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-22T21:18:23.391328] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-22T21:18:23.392565] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-22T21:18:23.392634] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-22T21:18:23.394386] [DEBUG] [LOCAL ] SMFG: Trimmed 68865 records to 48145 (keeping 200 days of data) [2025-09-22T21:18:23.711808] [DEBUG] [LOCAL ] SMFG: Primary data saved (48145 records). [2025-09-22T21:18:23.712159] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-22T21:18:23.712282] [INFO ] [MAIN ] Update Progress: 1943/2372 symbols completed. SMFG took 36.9s. Estimated remaining: 57m 2s. Rate: 7.5 symbols/min [2025-09-22T21:18:23.745412] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-22T21:18:23.899480] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:18:23.949633] [DEBUG] [LOCAL ] SMRT: Loaded 45073 existing records from primary storage. [2025-09-22T21:18:23.949846] [INFO ] [MAIN ] SMRT: Loaded 45073 existing records. [2025-09-22T21:18:24.129631] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:18:24.130158] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-22T21:18:24.130207] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-22T21:18:24.131615] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-22T21:18:24.131700] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-22T21:18:24.512466] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:18:24.522028] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-22T21:18:25.477625] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-22T21:18:25.487253] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-22T21:18:25.537289] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T21:18:25.674327] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (3.55 seconds). [2025-09-22T21:18:26.122054] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-22T21:18:26.754803] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-22T21:18:26.922070] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-22T21:18:27.072752] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T21:18:27.079449] [INFO ] [REMOTE ] SMG: Full fetch complete (62686 records). [2025-09-22T21:18:27.079738] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-22T21:18:27.421684] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T21:18:27.504395] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-22T21:18:27.504480] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-22T21:18:27.505579] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-22T21:18:27.505664] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-22T21:18:27.507551] [DEBUG] [LOCAL ] SMG: Trimmed 62686 records to 44060 (keeping 200 days of data) [2025-09-22T21:18:27.729983] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-22T21:18:27.801038] [DEBUG] [LOCAL ] SMG: Primary data saved (44060 records). [2025-09-22T21:18:27.801249] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-22T21:18:27.801387] [INFO ] [MAIN ] Update Progress: 1944/2372 symbols completed. SMG took 33.9s. Estimated remaining: 56m 53s. Rate: 7.5 symbols/min [2025-09-22T21:18:27.971783] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:18:28.007691] [DEBUG] [LOCAL ] SMWB: Loaded 33729 existing records from primary storage. [2025-09-22T21:18:28.007836] [INFO ] [MAIN ] SMWB: Loaded 33729 existing records. [2025-09-22T21:18:28.189010] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:18:28.189336] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-22T21:18:28.189491] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-22T21:18:28.190305] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-22T21:18:28.190366] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-22T21:18:28.333732] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T21:18:28.527223] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-22T21:18:28.596561] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:18:29.322082] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-22T21:18:30.079715] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T21:18:30.122075] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-22T21:18:30.355252] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-09-22T21:18:30.798453] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T21:18:30.922121] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-22T21:18:31.722110] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-22T21:18:31.836373] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T21:18:32.522136] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-22T21:18:32.690436] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T21:18:32.693735] [INFO ] [REMOTE ] SMP: Full fetch complete (26045 records). [2025-09-22T21:18:32.693817] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-22T21:18:33.074749] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-22T21:18:33.074835] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-22T21:18:33.075408] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-22T21:18:33.075495] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-22T21:18:33.076219] [DEBUG] [LOCAL ] SMP: Trimmed 26045 records to 19843 (keeping 200 days of data) [2025-09-22T21:18:33.202730] [DEBUG] [LOCAL ] SMP: Primary data saved (19843 records). [2025-09-22T21:18:33.202894] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-22T21:18:33.202986] [INFO ] [MAIN ] Update Progress: 1945/2372 symbols completed. SMP took 36.3s. Estimated remaining: 56m 45s. Rate: 7.5 symbols/min [2025-09-22T21:18:33.365284] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-22T21:18:33.437024] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:18:33.491156] [DEBUG] [LOCAL ] SN: Loaded 50520 existing records from primary storage. [2025-09-22T21:18:33.491422] [INFO ] [MAIN ] SN: Loaded 50520 existing records. [2025-09-22T21:18:33.637128] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-22T21:18:33.720714] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:18:33.720946] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-22T21:18:33.721001] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-22T21:18:33.722222] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-22T21:18:33.722309] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-22T21:18:34.115792] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:18:34.127169] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-22T21:18:34.139557] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T21:18:34.922170] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-22T21:18:35.074206] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-22T21:18:35.722099] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-22T21:18:36.522072] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-22T21:18:36.728801] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T21:18:36.890129] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-22T21:18:37.162723] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T21:18:37.322067] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-22T21:18:38.014547] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T21:18:38.122078] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-22T21:18:38.922053] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-22T21:18:39.722039] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-22T21:18:39.907023] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-22T21:18:40.176371] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-22T21:18:40.371883] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T21:18:40.522038] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-22T21:18:41.322060] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-22T21:18:41.448361] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T21:18:42.122076] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-22T21:18:42.718727] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-22T21:18:42.922028] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-22T21:18:43.204715] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-22T21:18:43.722153] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-22T21:18:43.799609] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T21:18:44.405815] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T21:18:44.522089] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-22T21:18:45.322072] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-22T21:18:46.122128] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-22T21:18:46.189952] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-22T21:18:46.676347] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-22T21:18:46.922060] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-22T21:18:47.722031] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-22T21:18:48.058018] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T21:18:48.120062] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T21:18:48.492362] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (3.17 seconds). [2025-09-22T21:18:48.522005] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-22T21:18:48.987077] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T21:18:49.322066] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-22T21:18:50.122081] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-22T21:18:50.714832] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T21:18:50.922058] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-22T21:18:51.502596] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-22T21:18:51.722018] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-22T21:18:51.914974] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T21:18:52.199752] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T21:18:52.204845] [INFO ] [REMOTE ] SMWB: Full fetch complete (50354 records). [2025-09-22T21:18:52.204961] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-22T21:18:52.537050] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-22T21:18:52.589918] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-22T21:18:52.590101] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-22T21:18:52.591299] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-22T21:18:52.591396] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-22T21:18:52.592772] [DEBUG] [LOCAL ] SMWB: Trimmed 50354 records to 33043 (keeping 200 days of data) [2025-09-22T21:18:52.788881] [DEBUG] [LOCAL ] SMWB: Primary data saved (33043 records). [2025-09-22T21:18:52.789076] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-22T21:18:52.789195] [INFO ] [MAIN ] Update Progress: 1946/2372 symbols completed. SMWB took 25.0s. Estimated remaining: 56m 39s. Rate: 7.5 symbols/min [2025-09-22T21:18:52.965871] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:18:52.993829] [DEBUG] [LOCAL ] SNA: Loaded 26834 existing records from primary storage. [2025-09-22T21:18:52.993971] [INFO ] [MAIN ] SNA: Loaded 26834 existing records. [2025-09-22T21:18:53.176165] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:18:53.176440] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-22T21:18:53.176491] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-22T21:18:53.177359] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-22T21:18:53.177419] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-22T21:18:53.326473] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-22T21:18:53.549070] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:18:54.074693] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T21:18:54.081159] [INFO ] [REMOTE ] SMRT: Full fetch complete (62381 records). [2025-09-22T21:18:54.081326] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-22T21:18:54.127695] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-22T21:18:54.517350] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-22T21:18:54.517468] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-22T21:18:54.518688] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-22T21:18:54.518825] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-22T21:18:54.520593] [DEBUG] [LOCAL ] SMRT: Trimmed 62381 records to 44359 (keeping 200 days of data) [2025-09-22T21:18:54.652319] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-09-22T21:18:54.845411] [DEBUG] [LOCAL ] SMRT: Primary data saved (44359 records). [2025-09-22T21:18:54.845624] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-22T21:18:54.845760] [INFO ] [MAIN ] Update Progress: 1947/2372 symbols completed. SMRT took 31.1s. Estimated remaining: 56m 30s. Rate: 7.5 symbols/min [2025-09-22T21:18:54.927121] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-22T21:18:55.029791] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:18:55.083977] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-22T21:18:55.084125] [INFO ] [MAIN ] SNAP: Loaded 54576 existing records. [2025-09-22T21:18:55.314216] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:18:55.314898] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-22T21:18:55.315015] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-22T21:18:55.316361] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-22T21:18:55.316427] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-22T21:18:55.605295] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-22T21:18:55.721594] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T21:18:55.726925] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-22T21:18:55.789966] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:18:56.522065] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-22T21:18:57.322029] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-22T21:18:57.407066] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-22T21:18:57.415328] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-09-22T21:18:57.415504] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-22T21:18:57.822575] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-09-22T21:18:57.837991] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-09-22T21:18:57.848338] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-09-22T21:18:57.851319] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-09-22T21:18:57.853475] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-22T21:18:57.865449] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 53797 (keeping 200 days of data) [2025-09-22T21:18:58.142126] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-22T21:18:58.193189] [DEBUG] [LOCAL ] SMR: Primary data saved (53797 records). [2025-09-22T21:18:58.193303] [INFO ] [MAIN ] SMR: Full history saved. [2025-09-22T21:18:58.193375] [INFO ] [MAIN ] Update Progress: 1948/2372 symbols completed. SMR took 37.4s. Estimated remaining: 56m 21s. Rate: 7.5 symbols/min [2025-09-22T21:18:58.367699] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:18:58.374161] [DEBUG] [LOCAL ] SNDA: Loaded 4832 existing records from primary storage. [2025-09-22T21:18:58.374251] [INFO ] [MAIN ] SNDA: Loaded 4832 existing records. [2025-09-22T21:18:58.562027] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:18:58.562531] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-22T21:18:58.562741] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-22T21:18:58.563283] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-22T21:18:58.563565] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-22T21:18:58.874111] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T21:18:58.922091] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-22T21:18:58.990333] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:18:58.995327] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-22T21:18:59.722027] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-22T21:19:00.079603] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T21:19:00.483254] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T21:19:00.522049] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-22T21:19:01.322070] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-22T21:19:01.940684] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T21:19:01.956810] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-22T21:19:02.060240] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-22T21:19:02.122020] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-22T21:19:02.922053] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-22T21:19:03.021929] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-22T21:19:03.722084] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-22T21:19:04.397175] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T21:19:04.466328] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T21:19:04.522071] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-22T21:19:05.322059] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-22T21:19:06.085849] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-22T21:19:06.122028] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-22T21:19:06.816568] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-22T21:19:06.922038] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-22T21:19:07.660990] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T21:19:07.722069] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-22T21:19:08.043051] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T21:19:08.522094] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-22T21:19:09.322105] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-22T21:19:09.348791] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-22T21:19:10.065147] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-22T21:19:10.122055] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-22T21:19:10.922094] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-22T21:19:10.955606] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T21:19:10.963448] [INFO ] [REMOTE ] SN: Full fetch complete (70819 records). [2025-09-22T21:19:10.963621] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-22T21:19:11.378532] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-22T21:19:11.378702] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-22T21:19:11.380730] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-22T21:19:11.380810] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-22T21:19:11.382973] [DEBUG] [LOCAL ] SN: Trimmed 70819 records to 49808 (keeping 200 days of data) [2025-09-22T21:19:11.603999] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T21:19:11.713777] [DEBUG] [LOCAL ] SN: Primary data saved (49808 records). [2025-09-22T21:19:11.713984] [INFO ] [MAIN ] SN: Full history saved. [2025-09-22T21:19:11.714101] [INFO ] [MAIN ] Update Progress: 1949/2372 symbols completed. SN took 38.5s. Estimated remaining: 56m 14s. Rate: 7.5 symbols/min [2025-09-22T21:19:11.727157] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-22T21:19:11.915702] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:19:11.956012] [DEBUG] [LOCAL ] SNDR: Loaded 41145 existing records from primary storage. [2025-09-22T21:19:11.956159] [INFO ] [MAIN ] SNDR: Loaded 41145 existing records. [2025-09-22T21:19:12.134535] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:19:12.134884] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-22T21:19:12.134948] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-22T21:19:12.136277] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-22T21:19:12.136358] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-22T21:19:12.518742] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T21:19:12.522014] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-22T21:19:12.525905] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:19:12.561905] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-22T21:19:13.322057] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-22T21:19:13.820199] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T21:19:14.122129] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-22T21:19:14.922120] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-22T21:19:15.352252] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T21:19:15.722035] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-22T21:19:15.815589] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-22T21:19:16.529555] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-22T21:19:16.551538] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T21:19:17.065872] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T21:19:17.322078] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-22T21:19:17.799545] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-22T21:19:18.122086] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-22T21:19:18.754114] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-22T21:19:18.770763] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-22T21:19:18.773068] [INFO ] [REMOTE ] SNDA: Full fetch complete (8590 records). [2025-09-22T21:19:18.773147] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-22T21:19:18.927244] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-22T21:19:19.177824] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-22T21:19:19.177911] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-22T21:19:19.178147] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-22T21:19:19.178187] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-22T21:19:19.178625] [DEBUG] [LOCAL ] SNDA: Trimmed 8590 records to 4685 (keeping 200 days of data) [2025-09-22T21:19:19.207316] [DEBUG] [LOCAL ] SNDA: Primary data saved (4685 records). [2025-09-22T21:19:19.207479] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-22T21:19:19.207577] [INFO ] [MAIN ] Update Progress: 1950/2372 symbols completed. SNDA took 21.0s. Estimated remaining: 56m 6s. Rate: 7.5 symbols/min [2025-09-22T21:19:19.380620] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:19:19.424567] [DEBUG] [LOCAL ] SNN: Loaded 44955 existing records from primary storage. [2025-09-22T21:19:19.424740] [INFO ] [MAIN ] SNN: Loaded 44955 existing records. [2025-09-22T21:19:19.603715] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:19:19.604000] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-22T21:19:19.604050] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-22T21:19:19.605094] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-22T21:19:19.605157] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-22T21:19:19.727262] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-22T21:19:19.977311] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:19:20.522134] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-22T21:19:21.322091] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-22T21:19:21.376941] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T21:19:21.437756] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T21:19:21.530200] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-22T21:19:22.122118] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-22T21:19:22.922128] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-22T21:19:23.001322] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T21:19:23.191900] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T21:19:23.198364] [INFO ] [REMOTE ] SNA: Full fetch complete (39224 records). [2025-09-22T21:19:23.198694] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-22T21:19:23.577682] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-22T21:19:23.577773] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-22T21:19:23.578508] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-22T21:19:23.578549] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-22T21:19:23.579507] [DEBUG] [LOCAL ] SNA: Trimmed 39224 records to 26407 (keeping 200 days of data) [2025-09-22T21:19:23.724950] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-22T21:19:23.749314] [DEBUG] [LOCAL ] SNA: Primary data saved (26407 records). [2025-09-22T21:19:23.749474] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-22T21:19:23.749565] [INFO ] [MAIN ] Update Progress: 1951/2372 symbols completed. SNA took 31.0s. Estimated remaining: 55m 58s. Rate: 7.5 symbols/min [2025-09-22T21:19:23.928203] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:19:23.928519] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-09-22T21:19:23.928575] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-09-22T21:19:23.928750] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-22T21:19:23.928809] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-22T21:19:23.928876] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-22T21:19:23.928911] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-22T21:19:24.289664] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:19:24.463673] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T21:19:24.522022] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-22T21:19:25.293760] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T21:19:25.322012] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-22T21:19:26.122079] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-22T21:19:26.922149] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-22T21:19:26.970760] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-22T21:19:27.013710] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T21:19:27.686709] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T21:19:27.722008] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-22T21:19:28.522168] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-22T21:19:29.322031] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-22T21:19:29.371712] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-22T21:19:29.412448] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T21:19:29.814959] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T21:19:30.122150] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-22T21:19:30.922109] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-22T21:19:31.553150] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-22T21:19:31.725211] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-22T21:19:31.732335] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-22T21:19:32.522096] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-22T21:19:32.645870] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T21:19:32.774395] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T21:19:33.322093] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-22T21:19:34.122068] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-22T21:19:34.889171] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-22T21:19:34.921999] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-22T21:19:35.393835] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T21:19:35.533561] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-22T21:19:35.542239] [INFO ] [REMOTE ] SNAP: Full fetch complete (77933 records). [2025-09-22T21:19:35.542382] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-22T21:19:35.722124] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-22T21:19:35.942670] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-22T21:19:35.942802] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-22T21:19:35.944517] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-22T21:19:35.944607] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-22T21:19:35.946321] [DEBUG] [LOCAL ] SNAP: Trimmed 77933 records to 53796 (keeping 200 days of data) [2025-09-22T21:19:36.276531] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-09-22T21:19:36.276699] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-22T21:19:36.276802] [INFO ] [MAIN ] Update Progress: 1952/2372 symbols completed. SNAP took 41.4s. Estimated remaining: 55m 51s. Rate: 7.5 symbols/min [2025-09-22T21:19:36.448881] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:19:36.496774] [DEBUG] [LOCAL ] SNV: Loaded 49657 existing records from primary storage. [2025-09-22T21:19:36.496927] [INFO ] [MAIN ] SNV: Loaded 49657 existing records. [2025-09-22T21:19:36.533051] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-22T21:19:36.684026] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:19:36.684308] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-22T21:19:36.684360] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-22T21:19:36.687041] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-22T21:19:36.687107] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-22T21:19:37.101482] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:19:37.236386] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T21:19:37.322039] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-22T21:19:37.362165] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-22T21:19:38.122060] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-22T21:19:38.280976] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T21:19:38.916074] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T21:19:38.922013] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-22T21:19:38.923568] [INFO ] [REMOTE ] SNDR: Full fetch complete (58879 records). [2025-09-22T21:19:38.923688] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-22T21:19:39.316236] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-22T21:19:39.316324] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-22T21:19:39.317334] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-22T21:19:39.317399] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-22T21:19:39.318703] [DEBUG] [LOCAL ] SNDR: Trimmed 58879 records to 40586 (keeping 200 days of data) [2025-09-22T21:19:39.575566] [DEBUG] [LOCAL ] SNDR: Primary data saved (40586 records). [2025-09-22T21:19:39.575726] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-22T21:19:39.575821] [INFO ] [MAIN ] Update Progress: 1953/2372 symbols completed. SNDR took 27.9s. Estimated remaining: 55m 42s. Rate: 7.5 symbols/min [2025-09-22T21:19:39.727268] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-22T21:19:39.754969] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:19:39.798809] [DEBUG] [LOCAL ] SNX: Loaded 40267 existing records from primary storage. [2025-09-22T21:19:39.798972] [INFO ] [MAIN ] SNX: Loaded 40267 existing records. [2025-09-22T21:19:40.026230] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:19:40.026489] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-22T21:19:40.026541] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-22T21:19:40.027724] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-22T21:19:40.027784] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-22T21:19:40.423267] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:19:40.532334] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-22T21:19:40.555103] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-22T21:19:40.737831] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T21:19:41.322029] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-22T21:19:41.450567] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T21:19:42.040980] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T21:19:42.122070] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-22T21:19:42.922080] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-22T21:19:43.083448] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T21:19:43.722107] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-22T21:19:43.880912] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T21:19:44.518562] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T21:19:44.526441] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-22T21:19:45.322064] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-22T21:19:45.480573] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T21:19:46.122058] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-22T21:19:46.643209] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T21:19:46.778850] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-22T21:19:46.922080] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-22T21:19:47.676225] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T21:19:47.683197] [INFO ] [REMOTE ] SNN: Full fetch complete (62918 records). [2025-09-22T21:19:47.683339] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-22T21:19:47.727925] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-22T21:19:48.086011] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-22T21:19:48.086115] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-22T21:19:48.087782] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-22T21:19:48.087865] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-22T21:19:48.091897] [DEBUG] [LOCAL ] SNN: Trimmed 62918 records to 44348 (keeping 200 days of data) [2025-09-22T21:19:48.361400] [DEBUG] [LOCAL ] SNN: Primary data saved (44348 records). [2025-09-22T21:19:48.361544] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-22T21:19:48.361696] [INFO ] [MAIN ] Update Progress: 1954/2372 symbols completed. SNN took 29.2s. Estimated remaining: 55m 34s. Rate: 7.5 symbols/min [2025-09-22T21:19:48.532197] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-22T21:19:48.535811] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:19:48.537082] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-09-22T21:19:48.537232] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-09-22T21:19:48.537440] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-22T21:19:48.537552] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-22T21:19:48.537674] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-22T21:19:48.537733] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-22T21:19:48.994754] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-22T21:19:49.001866] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:19:49.322109] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-22T21:19:49.490461] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T21:19:50.122160] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-22T21:19:50.813213] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-22T21:19:50.922141] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-22T21:19:51.722016] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-22T21:19:51.979552] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-22T21:19:52.063704] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-22T21:19:52.522054] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-22T21:19:53.243043] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-22T21:19:53.322107] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-22T21:19:53.661966] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T21:19:54.122052] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-22T21:19:54.423104] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T21:19:54.922065] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-22T21:19:55.696923] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T21:19:55.722011] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-22T21:19:55.955716] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-22T21:19:56.522047] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-22T21:19:56.807459] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T21:19:57.322275] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-22T21:19:57.322201] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T21:19:58.122070] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-22T21:19:58.278577] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T21:19:58.922023] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-22T21:19:59.020589] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T21:19:59.722087] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-22T21:20:00.470745] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-22T21:20:00.479962] [INFO ] [REMOTE ] SNOW: Full fetch complete (77655 records). [2025-09-22T21:20:00.480172] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-22T21:20:00.525499] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-22T21:20:00.939951] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-09-22T21:20:00.940201] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-09-22T21:20:00.941556] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-09-22T21:20:00.941723] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-09-22T21:20:00.943554] [DEBUG] [LOCAL ] SNOW: Trimmed 77655 records to 53596 (keeping 200 days of data) [2025-09-22T21:20:01.072267] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-22T21:20:01.240361] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T21:20:01.328424] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-22T21:20:01.373502] [DEBUG] [LOCAL ] SNOW: Primary data saved (53596 records). [2025-09-22T21:20:01.373696] [INFO ] [MAIN ] SNOW: Full history saved. [2025-09-22T21:20:01.373826] [INFO ] [MAIN ] Update Progress: 1955/2372 symbols completed. SNOW took 37.6s. Estimated remaining: 55m 27s. Rate: 7.5 symbols/min [2025-09-22T21:20:01.576556] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:20:01.630694] [DEBUG] [LOCAL ] SOBO: Loaded 40586 existing records from primary storage. [2025-09-22T21:20:01.630885] [INFO ] [MAIN ] SOBO: Loaded 40586 existing records. [2025-09-22T21:20:01.830758] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:20:01.831890] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-22T21:20:01.831999] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-22T21:20:01.833244] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-22T21:20:01.833341] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-22T21:20:02.126579] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-22T21:20:02.288197] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:20:02.348058] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T21:20:02.922065] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-22T21:20:03.428704] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-22T21:20:03.710681] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T21:20:03.722006] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-22T21:20:04.458111] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T21:20:04.522016] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-22T21:20:05.190960] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T21:20:05.197438] [INFO ] [REMOTE ] SNX: Full fetch complete (56402 records). [2025-09-22T21:20:05.197564] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-22T21:20:05.327128] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-22T21:20:05.599913] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-22T21:20:05.600010] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-22T21:20:05.601481] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-22T21:20:05.601594] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-22T21:20:05.603078] [DEBUG] [LOCAL ] SNX: Trimmed 56402 records to 39681 (keeping 200 days of data) [2025-09-22T21:20:05.860849] [DEBUG] [LOCAL ] SNX: Primary data saved (39681 records). [2025-09-22T21:20:05.860998] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-22T21:20:05.861097] [INFO ] [MAIN ] Update Progress: 1956/2372 symbols completed. SNX took 26.3s. Estimated remaining: 55m 18s. Rate: 7.5 symbols/min [2025-09-22T21:20:06.035172] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:20:06.088868] [DEBUG] [LOCAL ] SOC: Loaded 50981 existing records from primary storage. [2025-09-22T21:20:06.089047] [INFO ] [MAIN ] SOC: Loaded 50981 existing records. [2025-09-22T21:20:06.133502] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-22T21:20:06.279969] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:20:06.280211] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-22T21:20:06.280260] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-22T21:20:06.281296] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-22T21:20:06.281358] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-22T21:20:06.664934] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:20:06.698575] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-22T21:20:06.922094] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-22T21:20:07.075818] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T21:20:07.722058] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-22T21:20:08.158368] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-22T21:20:08.522084] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-22T21:20:08.734073] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T21:20:08.981912] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T21:20:09.322050] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-22T21:20:10.122031] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-22T21:20:10.392326] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T21:20:10.845288] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T21:20:10.922019] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-22T21:20:11.551180] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T21:20:11.722033] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-22T21:20:12.305255] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-22T21:20:12.522057] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-22T21:20:13.322076] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-22T21:20:13.752549] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-22T21:20:14.122081] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-22T21:20:14.203997] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T21:20:14.213946] [INFO ] [REMOTE ] SNV: Full fetch complete (71104 records). [2025-09-22T21:20:14.214137] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-22T21:20:14.669753] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-22T21:20:14.669876] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-22T21:20:14.671561] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-22T21:20:14.671638] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-22T21:20:14.673603] [DEBUG] [LOCAL ] SNV: Trimmed 71104 records to 48919 (keeping 200 days of data) [2025-09-22T21:20:14.924919] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-22T21:20:15.047029] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T21:20:15.077833] [DEBUG] [LOCAL ] SNV: Primary data saved (48919 records). [2025-09-22T21:20:15.078026] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-22T21:20:15.078240] [INFO ] [MAIN ] Update Progress: 1957/2372 symbols completed. SNV took 38.8s. Estimated remaining: 55m 11s. Rate: 7.5 symbols/min [2025-09-22T21:20:15.414929] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T21:20:15.722039] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-22T21:20:16.522144] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-22T21:20:16.750822] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-22T21:20:16.935262] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T21:20:17.322036] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-22T21:20:17.414216] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T21:20:17.422341] [INFO ] [REMOTE ] SO: Full fetch complete (77196 records). [2025-09-22T21:20:17.422535] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-22T21:20:17.424433] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-22). Symbol may be delisted or halted. [2025-09-22T21:20:17.424546] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:20:17.424590] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:20:17.424629] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-22T21:20:17.424737] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-22T21:20:17.424830] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-09-22T21:20:17.424948] [DEBUG] [LOCAL ] SO: No derivative data file found to delete. [2025-09-22T21:20:17.425068] [INFO ] [MAIN ] Update Progress: 1958/2372 symbols completed. SO took 29.1s. Estimated remaining: 55m 1s. Rate: 7.5 symbols/min [2025-09-22T21:20:18.122113] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-22T21:20:18.919669] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T21:20:18.928724] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-22T21:20:19.795523] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T21:20:19.806354] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-22T21:20:20.461472] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T21:20:20.522051] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-22T21:20:21.531296] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T21:20:21.542043] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-22T21:20:22.124167] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T21:20:22.132901] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-22T21:20:23.315391] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T21:20:23.326277] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-22T21:20:23.464526] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T21:20:23.471176] [INFO ] [REMOTE ] SOBO: Full fetch complete (58522 records). [2025-09-22T21:20:23.471330] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-22T21:20:23.900564] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-22T21:20:23.900694] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-22T21:20:23.901881] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-22T21:20:23.901951] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-22T21:20:23.903296] [DEBUG] [LOCAL ] SOBO: Trimmed 58522 records to 39754 (keeping 200 days of data) [2025-09-22T21:20:24.158971] [DEBUG] [LOCAL ] SOBO: Primary data saved (39754 records). [2025-09-22T21:20:24.159120] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-22T21:20:24.159224] [INFO ] [MAIN ] Update Progress: 1959/2372 symbols completed. SOBO took 22.8s. Estimated remaining: 54m 53s. Rate: 7.5 symbols/min [2025-09-22T21:20:25.197789] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T21:20:25.208263] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-22T21:20:27.135330] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T21:20:27.146939] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-22T21:20:28.765056] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T21:20:28.775877] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-22T21:20:30.553619] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T21:20:30.563507] [INFO ] [REMOTE ] SOC: Full fetch complete (71232 records). [2025-09-22T21:20:30.563623] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-22T21:20:30.957600] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-22T21:20:30.957735] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-22T21:20:30.958897] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-22T21:20:30.958967] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-22T21:20:30.960466] [DEBUG] [LOCAL ] SOC: Trimmed 71232 records to 50243 (keeping 200 days of data) [2025-09-22T21:20:31.285826] [DEBUG] [LOCAL ] SOC: Primary data saved (50243 records). [2025-09-22T21:20:31.286036] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-22T21:20:31.286175] [INFO ] [MAIN ] Update Progress: 1960/2372 symbols completed. SOC took 25.4s. Estimated remaining: 54m 45s. Rate: 7.5 symbols/min [2025-09-22T21:20:31.937125] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:20:32.005704] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:20:31.968316] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:20:32.026636] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-22T21:20:32.034238] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-22T21:20:32.062755] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:20:32.065003] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-22T21:20:32.065248] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-22T21:20:32.065943] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-22T21:20:32.068760] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-22T21:20:32.103268] [DEBUG] [LOCAL ] SOJC: Loaded 5218 existing records from primary storage. [2025-09-22T21:20:32.114132] [INFO ] [MAIN ] SOJC: Loaded 5218 existing records. [2025-09-22T21:20:32.176207] [DEBUG] [LOCAL ] SOJE: Loaded 9557 existing records from primary storage. [2025-09-22T21:20:32.207787] [INFO ] [MAIN ] SOJE: Loaded 9557 existing records. [2025-09-22T21:20:32.264299] [DEBUG] [LOCAL ] SOJD: Loaded 13155 existing records from primary storage. [2025-09-22T21:20:32.359680] [INFO ] [MAIN ] SOJD: Loaded 13155 existing records. [2025-09-22T21:20:32.630197] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:20:32.742776] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-22T21:20:32.828578] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-22T21:20:32.802675] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:20:32.892693] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-22T21:20:32.866943] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-22T21:20:32.903333] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-22T21:20:32.931618] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-22T21:20:32.931480] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-22T21:20:32.990027] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-22T21:20:33.065919] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:20:33.168730] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-22T21:20:33.172504] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-22T21:20:33.211526] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:20:33.222981] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-22T21:20:33.222623] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-22T21:20:33.248168] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-22T21:20:33.649672] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:20:33.762211] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-22T21:20:33.941046] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-09-22T21:20:34.215614] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:20:34.254806] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-22T21:20:34.258554] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:20:34.278362] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-22T21:20:34.392388] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:20:34.392827] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-22T21:20:35.151754] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T21:20:35.158416] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-22T21:20:35.215560] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T21:20:35.219559] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-22T21:20:35.232437] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T21:20:35.236562] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-22T21:20:35.532098] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T21:20:35.537543] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-22T21:20:35.762392] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-22T21:20:35.771337] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-22T21:20:35.971081] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T21:20:35.979535] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T21:20:35.980299] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-22T21:20:35.983107] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-22T21:20:36.376371] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T21:20:36.378919] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-22T21:20:36.526270] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T21:20:36.529968] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-22T21:20:36.643504] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-22T21:20:36.794444] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T21:20:37.219692] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T21:20:37.322027] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-22T21:20:37.382561] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-22T21:20:38.122068] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-22T21:20:38.194512] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T21:20:38.893635] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-22T21:20:38.922064] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-22T21:20:39.722082] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-22T21:20:39.886221] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T21:20:40.514190] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T21:20:40.522003] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-22T21:20:41.165992] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-22T21:20:41.322090] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-22T21:20:42.122043] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-22T21:20:42.241716] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T21:20:42.897959] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T21:20:42.922027] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-22T21:20:43.722034] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-22T21:20:43.782397] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T21:20:44.522029] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-22T21:20:44.624541] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T21:20:45.087265] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T21:20:45.322083] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-22T21:20:46.089960] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T21:20:46.122058] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-22T21:20:46.922105] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-22T21:20:46.938939] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-22T21:20:47.505840] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T21:20:47.722093] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-22T21:20:48.522030] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-22T21:20:48.557200] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-22T21:20:49.322042] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-22T21:20:49.428835] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-22T21:20:50.122035] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-22T21:20:50.178321] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T21:20:50.759075] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T21:20:50.760742] [INFO ] [REMOTE ] SOJE: Full fetch complete (14659 records). [2025-09-22T21:20:50.760832] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-22T21:20:50.927594] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-22T21:20:51.141096] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-22T21:20:51.141199] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-22T21:20:51.141531] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-22T21:20:51.141587] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-22T21:20:51.142373] [DEBUG] [LOCAL ] SOJE: Trimmed 14659 records to 9387 (keeping 200 days of data) [2025-09-22T21:20:51.202344] [DEBUG] [LOCAL ] SOJE: Primary data saved (9387 records). [2025-09-22T21:20:51.202506] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-22T21:20:51.202612] [INFO ] [MAIN ] Update Progress: 1961/2372 symbols completed. SOJE took 19.9s. Estimated remaining: 54m 39s. Rate: 7.5 symbols/min [2025-09-22T21:20:51.380283] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:20:51.396306] [DEBUG] [LOCAL ] SOL: Loaded 13908 existing records from primary storage. [2025-09-22T21:20:51.396452] [INFO ] [MAIN ] SOL: Loaded 13908 existing records. [2025-09-22T21:20:51.575556] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:20:51.575813] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-22T21:20:51.575862] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-22T21:20:51.576293] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-22T21:20:51.576353] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-22T21:20:51.727258] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-22T21:20:51.883053] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T21:20:51.954982] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:20:52.351432] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T21:20:52.522051] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-22T21:20:53.247110] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T21:20:53.322015] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-22T21:20:54.058451] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-22T21:20:54.122057] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-22T21:20:54.893812] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T21:20:54.922035] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-22T21:20:55.536425] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T21:20:55.538189] [INFO ] [REMOTE ] SOJF: Full fetch complete (13082 records). [2025-09-22T21:20:55.538262] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-22T21:20:55.738001] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 171 unique days, need 200 days [2025-09-22T21:20:55.728858] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-22T21:20:55.739265] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:20:55.739341] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:20:55.739390] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-22T21:20:55.739441] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-22T21:20:55.739476] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-22T21:20:55.739514] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-22T21:20:55.739588] [INFO ] [MAIN ] Update Progress: 1962/2372 symbols completed. SOJF took 24.4s. Estimated remaining: 54m 31s. Rate: 7.5 symbols/min [2025-09-22T21:20:55.924101] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:20:55.970622] [DEBUG] [LOCAL ] SOLV: Loaded 44919 existing records from primary storage. [2025-09-22T21:20:55.970819] [INFO ] [MAIN ] SOLV: Loaded 44919 existing records. [2025-09-22T21:20:56.148438] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:20:56.148744] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-22T21:20:56.148800] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-22T21:20:56.149913] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-22T21:20:56.149974] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-22T21:20:56.515247] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:20:56.522019] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-22T21:20:56.863774] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T21:20:57.322065] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-22T21:20:57.788682] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T21:20:58.112843] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T21:20:58.115225] [INFO ] [REMOTE ] SOJD: Full fetch complete (20233 records). [2025-09-22T21:20:58.115305] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-22T21:20:58.127245] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-22T21:20:58.510077] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-22T21:20:58.510199] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-22T21:20:58.510676] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-22T21:20:58.510736] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-22T21:20:58.511357] [DEBUG] [LOCAL ] SOJD: Trimmed 20233 records to 12942 (keeping 200 days of data) [2025-09-22T21:20:58.603234] [DEBUG] [LOCAL ] SOJD: Primary data saved (12942 records). [2025-09-22T21:20:58.603393] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-22T21:20:58.603488] [INFO ] [MAIN ] Update Progress: 1963/2372 symbols completed. SOJD took 27.3s. Estimated remaining: 54m 22s. Rate: 7.5 symbols/min [2025-09-22T21:20:58.785248] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:20:58.790559] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-22T21:20:58.835081] [DEBUG] [LOCAL ] SON: Loaded 43516 existing records from primary storage. [2025-09-22T21:20:58.835235] [INFO ] [MAIN ] SON: Loaded 43516 existing records. [2025-09-22T21:20:58.927181] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-22T21:20:59.022416] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:20:59.022683] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-22T21:20:59.022758] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-22T21:20:59.024040] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-22T21:20:59.024123] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-22T21:20:59.425119] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:20:59.548525] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T21:20:59.550110] [INFO ] [REMOTE ] SOJC: Full fetch complete (7978 records). [2025-09-22T21:20:59.550181] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-22T21:20:59.725311] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-22T21:20:59.950528] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-22T21:20:59.950623] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-22T21:20:59.950965] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-22T21:20:59.951027] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-22T21:20:59.951481] [DEBUG] [LOCAL ] SOJC: Trimmed 7978 records to 5096 (keeping 200 days of data) [2025-09-22T21:20:59.985686] [DEBUG] [LOCAL ] SOJC: Primary data saved (5096 records). [2025-09-22T21:20:59.985840] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-22T21:20:59.985955] [INFO ] [MAIN ] Update Progress: 1964/2372 symbols completed. SOJC took 28.7s. Estimated remaining: 54m 12s. Rate: 7.5 symbols/min [2025-09-22T21:21:00.184878] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:21:00.245439] [DEBUG] [LOCAL ] SONY: Loaded 54141 existing records from primary storage. [2025-09-22T21:21:00.245623] [INFO ] [MAIN ] SONY: Loaded 54141 existing records. [2025-09-22T21:21:00.455069] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:21:00.455423] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-22T21:21:00.455482] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-22T21:21:00.456802] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-22T21:21:00.456864] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-22T21:21:00.530193] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-22T21:21:00.858370] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:21:01.322088] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-22T21:21:01.475547] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T21:21:02.052030] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T21:21:02.122051] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-22T21:21:02.922080] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-22T21:21:03.722066] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-22T21:21:05.191324] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-09-22T21:21:05.194847] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-22T21:21:05.354428] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T21:21:05.364097] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-22T21:21:05.419256] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-22T21:21:05.489091] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (4.17 seconds). [2025-09-22T21:21:06.122062] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-22T21:21:06.244066] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T21:21:06.623447] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-22T21:21:06.922055] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-22T21:21:07.722050] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-22T21:21:08.037851] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T21:21:08.522039] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-22T21:21:08.594061] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T21:21:08.660736] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T21:21:09.322070] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-22T21:21:09.946456] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T21:21:10.122068] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-22T21:21:10.195212] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T21:21:10.922064] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-22T21:21:11.593389] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T21:21:11.722022] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-22T21:21:12.522023] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-22T21:21:12.797070] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-22T21:21:13.269368] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T21:21:13.322031] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-22T21:21:13.499063] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T21:21:14.122127] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-22T21:21:14.922097] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-22T21:21:15.376455] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-22T21:21:15.722063] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-22T21:21:15.764180] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T21:21:16.522123] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-22T21:21:16.667785] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T21:21:17.322085] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-22T21:21:17.933108] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-22T21:21:18.043935] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T21:21:18.122009] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-22T21:21:18.380332] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-22T21:21:18.922057] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-22T21:21:19.571974] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-22T21:21:19.722048] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-22T21:21:20.069411] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T21:21:20.522063] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-22T21:21:21.298265] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T21:21:21.322008] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-22T21:21:21.513207] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-22T21:21:22.122049] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-22T21:21:22.918735] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-22T21:21:22.921624] [INFO ] [REMOTE ] SOL: Full fetch complete (21984 records). [2025-09-22T21:21:22.921883] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-22T21:21:22.922194] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-22T21:21:23.068813] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T21:21:23.346877] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-22T21:21:23.346953] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-22T21:21:23.347420] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-22T21:21:23.347458] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-22T21:21:23.348120] [DEBUG] [LOCAL ] SOL: Trimmed 21984 records to 13563 (keeping 200 days of data) [2025-09-22T21:21:23.426476] [DEBUG] [LOCAL ] SOL: Primary data saved (13563 records). [2025-09-22T21:21:23.426617] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-22T21:21:23.426735] [INFO ] [MAIN ] Update Progress: 1965/2372 symbols completed. SOL took 32.2s. Estimated remaining: 54m 8s. Rate: 7.5 symbols/min [2025-09-22T21:21:23.602478] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:21:23.607548] [DEBUG] [LOCAL ] SOR: Loaded 3015 existing records from primary storage. [2025-09-22T21:21:23.607626] [INFO ] [MAIN ] SOR: Loaded 3015 existing records. [2025-09-22T21:21:23.727233] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-22T21:21:23.788012] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:21:23.788370] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-22T21:21:23.788418] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-22T21:21:23.788700] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-22T21:21:23.788761] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-22T21:21:24.167069] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:21:24.475399] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T21:21:24.522080] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-22T21:21:25.253904] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T21:21:25.322020] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-22T21:21:25.878995] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-22T21:21:25.929905] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T21:21:26.122073] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-22T21:21:26.922078] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-22T21:21:27.722101] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-22T21:21:28.059025] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T21:21:28.184903] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-22T21:21:28.427586] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T21:21:28.441110] [INFO ] [REMOTE ] SON: Full fetch complete (61860 records). [2025-09-22T21:21:28.441339] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-22T21:21:28.528705] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-22T21:21:28.965418] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-22T21:21:28.965534] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-22T21:21:28.967104] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-22T21:21:28.967181] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-22T21:21:28.968740] [DEBUG] [LOCAL ] SON: Trimmed 61860 records to 42869 (keeping 200 days of data) [2025-09-22T21:21:29.262852] [DEBUG] [LOCAL ] SON: Primary data saved (42869 records). [2025-09-22T21:21:29.263020] [INFO ] [MAIN ] SON: Full history saved. [2025-09-22T21:21:29.263123] [INFO ] [MAIN ] Update Progress: 1966/2372 symbols completed. SON took 30.7s. Estimated remaining: 53m 59s. Rate: 7.5 symbols/min [2025-09-22T21:21:29.327175] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-22T21:21:29.446995] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:21:29.458159] [DEBUG] [LOCAL ] SOS: Loaded 7689 existing records from primary storage. [2025-09-22T21:21:29.458369] [INFO ] [MAIN ] SOS: Loaded 7689 existing records. [2025-09-22T21:21:29.647092] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:21:29.647391] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-22T21:21:29.647490] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-22T21:21:29.647840] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-22T21:21:29.647902] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-22T21:21:30.024907] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:21:30.122014] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-22T21:21:30.214782] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T21:21:30.640856] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-22T21:21:30.922035] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-22T21:21:31.197087] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T21:21:31.722058] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-22T21:21:32.395972] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T21:21:32.522036] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-22T21:21:32.931831] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-22T21:21:33.260180] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T21:21:33.322030] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-22T21:21:33.884554] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T21:21:34.122071] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-22T21:21:34.588768] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-22T21:21:34.922082] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-22T21:21:35.398266] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-22T21:21:35.722038] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-22T21:21:36.352917] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T21:21:36.522054] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-22T21:21:37.089605] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T21:21:37.322171] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-22T21:21:37.803861] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-22T21:21:38.122072] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-22T21:21:38.922065] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-22T21:21:39.560200] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T21:21:39.568757] [INFO ] [REMOTE ] SONY: Full fetch complete (77213 records). [2025-09-22T21:21:39.568893] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-22T21:21:39.730084] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-22T21:21:39.973889] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-22T21:21:39.973992] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-22T21:21:39.975222] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-22T21:21:39.975292] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-22T21:21:39.977398] [DEBUG] [LOCAL ] SONY: Trimmed 77213 records to 53361 (keeping 200 days of data) [2025-09-22T21:21:40.327451] [DEBUG] [LOCAL ] SONY: Primary data saved (53361 records). [2025-09-22T21:21:40.327624] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-22T21:21:40.327754] [INFO ] [MAIN ] Update Progress: 1967/2372 symbols completed. SONY took 40.3s. Estimated remaining: 53m 52s. Rate: 7.5 symbols/min [2025-09-22T21:21:40.440052] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T21:21:40.515371] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:21:40.522028] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-22T21:21:40.553919] [DEBUG] [LOCAL ] SPB: Loaded 34660 existing records from primary storage. [2025-09-22T21:21:40.554071] [INFO ] [MAIN ] SPB: Loaded 34660 existing records. [2025-09-22T21:21:40.782324] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T21:21:40.782510] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:21:40.792219] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-22T21:21:40.792715] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-22T21:21:40.793769] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-22T21:21:40.793835] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-22T21:21:41.084482] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-22T21:21:41.204045] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:21:41.322025] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-22T21:21:42.122086] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-22T21:21:42.686726] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-22T21:21:42.688371] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T21:21:42.922073] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-22T21:21:43.722048] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-22T21:21:44.191728] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-22T21:21:44.193167] [INFO ] [REMOTE ] SOR: Full fetch complete (4352 records). [2025-09-22T21:21:44.193258] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-22T21:21:44.527148] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-22T21:21:44.582274] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-22T21:21:44.582354] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-22T21:21:44.582504] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-22T21:21:44.582543] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-22T21:21:44.582944] [DEBUG] [LOCAL ] SOR: Trimmed 4352 records to 2948 (keeping 200 days of data) [2025-09-22T21:21:44.601753] [DEBUG] [LOCAL ] SOR: Primary data saved (2948 records). [2025-09-22T21:21:44.601829] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-22T21:21:44.601900] [INFO ] [MAIN ] Update Progress: 1968/2372 symbols completed. SOR took 21.2s. Estimated remaining: 53m 43s. Rate: 7.5 symbols/min [2025-09-22T21:21:44.787180] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:21:44.836836] [DEBUG] [LOCAL ] SPCE: Loaded 50549 existing records from primary storage. [2025-09-22T21:21:44.836980] [INFO ] [MAIN ] SPCE: Loaded 50549 existing records. [2025-09-22T21:21:45.019609] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:21:45.020032] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-22T21:21:45.020162] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-22T21:21:45.021676] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-22T21:21:45.021735] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-22T21:21:45.328011] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-22T21:21:45.418779] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:21:45.499481] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-22T21:21:45.716750] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T21:21:46.122074] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-22T21:21:46.742093] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T21:21:46.751329] [INFO ] [REMOTE ] SOLV: Full fetch complete (63244 records). [2025-09-22T21:21:46.751462] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-22T21:21:46.930193] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-22T21:21:47.157027] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-22T21:21:47.157129] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-22T21:21:47.158318] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-22T21:21:47.158394] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-22T21:21:47.159917] [DEBUG] [LOCAL ] SOLV: Trimmed 63244 records to 44184 (keeping 200 days of data) [2025-09-22T21:21:47.451758] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T21:21:47.465854] [DEBUG] [LOCAL ] SOLV: Primary data saved (44184 records). [2025-09-22T21:21:47.466013] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-22T21:21:47.466110] [INFO ] [MAIN ] Update Progress: 1969/2372 symbols completed. SOLV took 51.7s. Estimated remaining: 53m 34s. Rate: 7.5 symbols/min [2025-09-22T21:21:47.642975] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:21:47.653695] [DEBUG] [LOCAL ] SPE: Loaded 6519 existing records from primary storage. [2025-09-22T21:21:47.653851] [INFO ] [MAIN ] SPE: Loaded 6519 existing records. [2025-09-22T21:21:47.727771] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-22T21:21:47.848681] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:21:47.854237] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-22T21:21:47.859372] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-22T21:21:47.860729] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T21:21:47.864888] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-22T21:21:47.865284] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-22T21:21:48.234197] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:21:48.522059] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-22T21:21:49.322078] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-22T21:21:49.503948] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-22T21:21:49.507173] [INFO ] [REMOTE ] SOS: Full fetch complete (11082 records). [2025-09-22T21:21:49.507253] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-22T21:21:49.922994] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-22T21:21:49.923172] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-22T21:21:49.923460] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-22T21:21:49.923632] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-22T21:21:49.924437] [DEBUG] [LOCAL ] SOS: Trimmed 11082 records to 7756 (keeping 200 days of data) [2025-09-22T21:21:49.985277] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-22T21:21:50.010433] [DEBUG] [LOCAL ] SOS: Primary data saved (7756 records). [2025-09-22T21:21:50.010601] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-22T21:21:50.010748] [INFO ] [MAIN ] Update Progress: 1970/2372 symbols completed. SOS took 20.7s. Estimated remaining: 53m 25s. Rate: 7.5 symbols/min [2025-09-22T21:21:50.123376] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-22T21:21:50.123250] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-22T21:21:50.201061] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:21:50.253871] [DEBUG] [LOCAL ] SPG: Loaded 51198 existing records from primary storage. [2025-09-22T21:21:50.254056] [INFO ] [MAIN ] SPG: Loaded 51198 existing records. [2025-09-22T21:21:50.433433] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:21:50.433739] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-22T21:21:50.433795] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-22T21:21:50.435683] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-22T21:21:50.435744] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-22T21:21:50.794800] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:21:50.922097] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-22T21:21:51.483593] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T21:21:51.652288] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T21:21:51.722168] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-22T21:21:52.512855] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T21:21:52.522012] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-22T21:21:53.277350] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-22T21:21:53.322077] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-22T21:21:54.122163] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-22T21:21:54.922074] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-22T21:21:55.359794] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-22T21:21:55.515218] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T21:21:55.722070] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-22T21:21:56.198396] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-22T21:21:56.522066] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-22T21:21:57.126313] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T21:21:57.221358] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T21:21:57.322030] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-22T21:21:57.898112] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T21:21:58.122077] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-22T21:21:58.738192] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-22T21:21:58.922117] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-22T21:21:59.722051] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-22T21:22:00.337635] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T21:22:00.522057] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-22T21:22:01.322255] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-22T21:22:01.585947] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-22T21:22:01.863950] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T21:22:01.990483] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-22T21:22:02.122104] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-22T21:22:02.922069] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-22T21:22:03.722051] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-22T21:22:03.929723] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T21:22:04.315841] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T21:22:04.330342] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T21:22:04.522097] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-22T21:22:05.322057] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-22T21:22:05.925978] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T21:22:06.122116] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-22T21:22:06.910490] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T21:22:06.921999] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-22T21:22:07.722052] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-22T21:22:08.021430] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T21:22:08.522037] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-22T21:22:08.809087] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T21:22:08.984312] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T21:22:08.989670] [INFO ] [REMOTE ] SPB: Full fetch complete (47450 records). [2025-09-22T21:22:08.989779] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-22T21:22:09.325233] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-22T21:22:09.329119] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T21:22:09.333894] [INFO ] [REMOTE ] SPE: Full fetch complete (10184 records). [2025-09-22T21:22:09.334015] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-22T21:22:09.552724] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-22T21:22:09.558029] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-22T21:22:09.559729] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-22T21:22:09.570112] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-22T21:22:09.611576] [DEBUG] [LOCAL ] SPB: Trimmed 47450 records to 34211 (keeping 200 days of data) [2025-09-22T21:22:09.937526] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-22T21:22:09.937633] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-22T21:22:09.938378] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-22T21:22:09.940528] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-22T21:22:09.942560] [DEBUG] [LOCAL ] SPE: Trimmed 10184 records to 6383 (keeping 200 days of data) [2025-09-22T21:22:09.997745] [DEBUG] [LOCAL ] SPE: Primary data saved (6383 records). [2025-09-22T21:22:09.998341] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-22T21:22:09.998546] [INFO ] [MAIN ] Update Progress: 1971/2372 symbols completed. SPE took 22.5s. Estimated remaining: 53m 19s. Rate: 7.5 symbols/min [2025-09-22T21:22:10.127107] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-22T21:22:10.208973] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:22:10.310778] [DEBUG] [LOCAL ] SPB: Primary data saved (34211 records). [2025-09-22T21:22:10.310961] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-22T21:22:10.311113] [INFO ] [MAIN ] Update Progress: 1972/2372 symbols completed. SPB took 30.0s. Estimated remaining: 53m 10s. Rate: 7.5 symbols/min [2025-09-22T21:22:10.527626] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:22:10.530167] [DEBUG] [LOCAL ] SPGI: Loaded 46568 existing records from primary storage. [2025-09-22T21:22:10.530492] [INFO ] [MAIN ] SPGI: Loaded 46568 existing records. [2025-09-22T21:22:10.724127] [DEBUG] [LOCAL ] SPH: Loaded 18734 existing records from primary storage. [2025-09-22T21:22:10.734327] [INFO ] [MAIN ] SPH: Loaded 18734 existing records. [2025-09-22T21:22:10.850895] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:22:10.868505] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-22T21:22:10.884761] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-22T21:22:10.903059] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-22T21:22:10.903227] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-22T21:22:11.077048] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:22:11.097434] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-22T21:22:11.097599] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-22T21:22:11.108989] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-22T21:22:11.114401] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-22T21:22:11.684732] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:22:11.713410] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-22T21:22:11.819438] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-22T21:22:11.844511] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:22:11.852540] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-22T21:22:11.896119] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T21:22:12.522056] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-22T21:22:12.859062] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T21:22:13.322034] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-22T21:22:13.653299] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-22T21:22:14.122045] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-22T21:22:14.497553] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T21:22:14.621773] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-22T21:22:14.922073] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-22T21:22:15.722027] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-22T21:22:15.863046] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T21:22:16.522069] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-22T21:22:16.796852] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T21:22:16.914486] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-22T21:22:17.322058] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-22T21:22:18.122077] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-22T21:22:18.211433] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T21:22:18.922007] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-22T21:22:19.300266] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T21:22:19.414115] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T21:22:19.722058] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-22T21:22:20.522050] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-22T21:22:20.638103] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T21:22:21.322053] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-22T21:22:21.382972] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T21:22:22.127318] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-22T21:22:22.152716] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T21:22:22.922143] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-22T21:22:23.317085] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T21:22:23.722030] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-22T21:22:23.992710] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T21:22:24.480683] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T21:22:24.488818] [INFO ] [REMOTE ] SPCE: Full fetch complete (72301 records). [2025-09-22T21:22:24.489008] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-22T21:22:24.527244] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-22T21:22:24.896295] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-22T21:22:24.896399] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-22T21:22:24.897584] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-22T21:22:24.897713] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-22T21:22:24.899312] [DEBUG] [LOCAL ] SPCE: Trimmed 72301 records to 49801 (keeping 200 days of data) [2025-09-22T21:22:25.170216] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T21:22:25.254267] [DEBUG] [LOCAL ] SPCE: Primary data saved (49801 records). [2025-09-22T21:22:25.254418] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-22T21:22:25.254578] [INFO ] [MAIN ] Update Progress: 1973/2372 symbols completed. SPCE took 40.7s. Estimated remaining: 53m 3s. Rate: 7.5 symbols/min [2025-09-22T21:22:25.331450] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-22T21:22:25.432561] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:22:25.476712] [DEBUG] [LOCAL ] SPHR: Loaded 40825 existing records from primary storage. [2025-09-22T21:22:25.476861] [INFO ] [MAIN ] SPHR: Loaded 40825 existing records. [2025-09-22T21:22:25.659754] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:22:25.660064] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-22T21:22:25.660123] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-22T21:22:25.661080] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-22T21:22:25.661151] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-22T21:22:26.026200] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:22:26.122020] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-22T21:22:26.367075] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T21:22:26.511287] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T21:22:26.922097] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-22T21:22:27.722044] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-22T21:22:27.947297] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T21:22:28.037384] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T21:22:28.522103] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-22T21:22:28.950124] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T21:22:29.322060] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-22T21:22:30.122149] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-22T21:22:30.366130] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T21:22:30.714050] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-22T21:22:30.854388] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-22T21:22:30.922041] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-22T21:22:31.722097] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-22T21:22:31.917944] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T21:22:32.522057] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-22T21:22:33.322029] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-22T21:22:33.400999] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T21:22:33.409130] [INFO ] [REMOTE ] SPG: Full fetch complete (72059 records). [2025-09-22T21:22:33.409254] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-22T21:22:33.833622] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-22T21:22:33.833752] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-22T21:22:33.834873] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-22T21:22:33.834945] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-22T21:22:33.840132] [DEBUG] [LOCAL ] SPG: Trimmed 72059 records to 50466 (keeping 200 days of data) [2025-09-22T21:22:34.117562] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T21:22:34.122269] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-22T21:22:34.213194] [DEBUG] [LOCAL ] SPG: Primary data saved (50466 records). [2025-09-22T21:22:34.213337] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-22T21:22:34.213505] [INFO ] [MAIN ] Update Progress: 1974/2372 symbols completed. SPG took 44.2s. Estimated remaining: 52m 56s. Rate: 7.5 symbols/min [2025-09-22T21:22:34.403520] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:22:34.434191] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T21:22:34.479132] [DEBUG] [LOCAL ] SPIR: Loaded 38051 existing records from primary storage. [2025-09-22T21:22:34.479297] [INFO ] [MAIN ] SPIR: Loaded 38051 existing records. [2025-09-22T21:22:34.660007] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:22:34.660270] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-22T21:22:34.660329] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-22T21:22:34.661263] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-22T21:22:34.661350] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-22T21:22:34.927171] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-22T21:22:35.032374] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:22:35.169870] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-22T21:22:35.722016] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-22T21:22:35.792271] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T21:22:35.795202] [INFO ] [REMOTE ] SPH: Full fetch complete (28620 records). [2025-09-22T21:22:35.795279] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-22T21:22:36.173007] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-22T21:22:36.173085] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-22T21:22:36.173674] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-22T21:22:36.173734] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-22T21:22:36.175800] [DEBUG] [LOCAL ] SPH: Trimmed 28620 records to 18307 (keeping 200 days of data) [2025-09-22T21:22:36.298455] [DEBUG] [LOCAL ] SPH: Primary data saved (18307 records). [2025-09-22T21:22:36.298601] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-22T21:22:36.298729] [INFO ] [MAIN ] Update Progress: 1975/2372 symbols completed. SPH took 26.0s. Estimated remaining: 52m 46s. Rate: 7.5 symbols/min [2025-09-22T21:22:36.476389] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:22:36.487317] [DEBUG] [LOCAL ] SPMC: Loaded 5772 existing records from primary storage. [2025-09-22T21:22:36.487447] [INFO ] [MAIN ] SPMC: Loaded 5772 existing records. [2025-09-22T21:22:36.530149] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-22T21:22:36.674745] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:22:36.675002] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-22T21:22:36.675051] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-22T21:22:36.675486] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-22T21:22:36.675547] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-22T21:22:37.046423] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:22:37.301361] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T21:22:37.322000] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-22T21:22:37.786410] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T21:22:38.122055] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-22T21:22:38.834873] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-22T21:22:38.866298] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T21:22:38.922160] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-22T21:22:39.722092] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-22T21:22:40.301831] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T21:22:40.487754] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T21:22:40.522079] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-22T21:22:41.322073] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-22T21:22:41.805162] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T21:22:42.115532] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T21:22:42.121995] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-22T21:22:42.769322] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-22T21:22:42.922059] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-22T21:22:43.722078] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-22T21:22:44.357825] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T21:22:44.522058] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-22T21:22:45.157233] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T21:22:45.322058] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-22T21:22:45.594223] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T21:22:46.087446] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-22T21:22:46.122016] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-22T21:22:46.811281] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-22T21:22:46.922113] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-22T21:22:47.722066] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-22T21:22:48.404381] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T21:22:48.522094] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-22T21:22:48.715321] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T21:22:48.723509] [INFO ] [REMOTE ] SPGI: Full fetch complete (66451 records). [2025-09-22T21:22:48.723753] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-22T21:22:49.137388] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-22T21:22:49.137497] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-22T21:22:49.138669] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-22T21:22:49.138739] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-22T21:22:49.140211] [DEBUG] [LOCAL ] SPGI: Trimmed 66451 records to 45821 (keeping 200 days of data) [2025-09-22T21:22:49.330741] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-22T21:22:49.453319] [DEBUG] [LOCAL ] SPGI: Primary data saved (45821 records). [2025-09-22T21:22:49.453518] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-22T21:22:49.453668] [INFO ] [MAIN ] Update Progress: 1976/2372 symbols completed. SPGI took 39.5s. Estimated remaining: 52m 40s. Rate: 7.5 symbols/min [2025-09-22T21:22:49.625214] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:22:49.625396] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-22T21:22:49.625448] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-22T21:22:49.625607] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-22T21:22:49.625674] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-22T21:22:49.625738] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-22T21:22:49.625772] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-22T21:22:49.989767] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:22:49.995680] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-22T21:22:50.020945] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T21:22:50.122106] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-22T21:22:50.322761] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:22:50.323107] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-22T21:22:50.922068] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-09-22T21:22:51.132287] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:22:51.132738] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-09-22T21:22:51.722058] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-22T21:22:52.522061] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-22T21:22:53.322065] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-22T21:22:54.122095] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-22T21:23:04.596399] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:23:04.596771] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-22T21:23:04.597221] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-22T21:23:04.758948] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (12.24 seconds). [2025-09-22T21:23:04.760761] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-22T21:23:05.732780] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (12.41 seconds). [2025-09-22T21:23:05.741446] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-22T21:23:05.780434] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:23:05.780881] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-22T21:23:05.781195] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-22T21:23:06.357901] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T21:23:06.359311] [INFO ] [REMOTE ] SPMC: Full fetch complete (8154 records). [2025-09-22T21:23:06.359381] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-22T21:23:06.574082] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:23:06.607287] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-22T21:23:06.619001] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-22T21:23:06.731502] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-22T21:23:06.731581] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-22T21:23:06.731822] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-22T21:23:06.731881] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-22T21:23:06.732284] [DEBUG] [LOCAL ] SPMC: Trimmed 8154 records to 5632 (keeping 200 days of data) [2025-09-22T21:23:06.769500] [DEBUG] [LOCAL ] SPMC: Primary data saved (5632 records). [2025-09-22T21:23:06.769583] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-22T21:23:06.769681] [INFO ] [MAIN ] Update Progress: 1977/2372 symbols completed. SPMC took 30.5s. Estimated remaining: 52m 33s. Rate: 7.5 symbols/min [2025-09-22T21:23:06.952325] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:23:07.004783] [DEBUG] [LOCAL ] SPNT: Loaded 35307 existing records from primary storage. [2025-09-22T21:23:07.004935] [INFO ] [MAIN ] SPNT: Loaded 35307 existing records. [2025-09-22T21:23:07.091426] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:23:07.110287] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-22T21:23:07.114669] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-22T21:23:07.200370] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (13.08 seconds). [2025-09-22T21:23:07.231569] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:23:07.232472] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-22T21:23:07.233045] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-22T21:23:07.233133] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-22T21:23:07.235006] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-22T21:23:07.235076] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-22T21:23:07.598061] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:23:07.601912] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:23:07.602809] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-22T21:23:07.603419] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-22T21:23:07.602639] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-22T21:23:07.632044] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T21:23:07.640793] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-22T21:23:08.033141] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-22T21:23:08.034393] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-22T21:23:08.372285] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-22T21:23:08.373371] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-22T21:23:08.720580] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-22T21:23:08.722398] [INFO ] [REMOTE ] SPME: Full fetch complete (650 records). [2025-09-22T21:23:08.722474] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-22T21:23:08.922051] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T21:23:08.956921] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 46 unique days, need 200 days [2025-09-22T21:23:08.964728] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:23:08.965600] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-22T21:23:08.965861] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:23:08.966046] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-22T21:23:08.967284] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-22T21:23:08.967363] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-22T21:23:08.967451] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-22T21:23:08.967592] [INFO ] [MAIN ] Update Progress: 1978/2372 symbols completed. SPME took 19.5s. Estimated remaining: 52m 24s. Rate: 7.5 symbols/min [2025-09-22T21:23:09.214316] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:23:09.238780] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-22T21:23:09.247855] [INFO ] [REMOTE ] SPHR: Full fetch complete (57470 records). [2025-09-22T21:23:09.248067] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-22T21:23:09.613699] [DEBUG] [LOCAL ] SPOT: Loaded 51750 existing records from primary storage. [2025-09-22T21:23:09.633602] [INFO ] [MAIN ] SPOT: Loaded 51750 existing records. [2025-09-22T21:23:09.793138] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-22T21:23:09.835232] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-22T21:23:09.857100] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-22T21:23:09.864562] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-22T21:23:09.883173] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-22T21:23:09.934440] [DEBUG] [LOCAL ] SPHR: Trimmed 57470 records to 40118 (keeping 200 days of data) [2025-09-22T21:23:09.934159] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-22T21:23:09.965497] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:23:09.967884] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-22T21:23:09.968212] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-22T21:23:09.969520] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-22T21:23:09.969589] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-22T21:23:10.287930] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T21:23:10.351943] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-22T21:23:10.532939] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:23:10.534362] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-22T21:23:10.680327] [DEBUG] [LOCAL ] SPHR: Primary data saved (40118 records). [2025-09-22T21:23:10.680507] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-22T21:23:10.680618] [INFO ] [MAIN ] Update Progress: 1979/2372 symbols completed. SPHR took 45.4s. Estimated remaining: 52m 15s. Rate: 7.5 symbols/min [2025-09-22T21:23:10.852065] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:23:10.896671] [DEBUG] [LOCAL ] SPR: Loaded 42074 existing records from primary storage. [2025-09-22T21:23:10.896827] [INFO ] [MAIN ] SPR: Loaded 42074 existing records. [2025-09-22T21:23:11.076477] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:23:11.076787] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-22T21:23:11.076840] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-22T21:23:11.077773] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-22T21:23:11.077834] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-22T21:23:11.452726] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:23:11.453109] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-22T21:23:11.477112] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T21:23:11.485853] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-22T21:23:11.695496] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T21:23:11.701955] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-22T21:23:12.352362] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T21:23:12.362933] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-22T21:23:12.898813] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T21:23:12.906376] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-22T21:23:13.051699] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T21:23:13.060808] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-22T21:23:13.142098] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:23:13.149907] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-22T21:23:14.395148] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-22T21:23:14.405960] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-22T21:23:14.433974] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T21:23:14.443405] [INFO ] [REMOTE ] SPIR: Full fetch complete (52184 records). [2025-09-22T21:23:14.444254] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-22T21:23:14.745091] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T21:23:14.742928] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T21:23:14.807200] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-22T21:23:14.927484] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-22T21:23:15.044397] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-22T21:23:15.044530] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-22T21:23:15.046278] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-22T21:23:15.046359] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-22T21:23:15.047878] [DEBUG] [LOCAL ] SPIR: Trimmed 52184 records to 37422 (keeping 200 days of data) [2025-09-22T21:23:15.297350] [DEBUG] [LOCAL ] SPIR: Primary data saved (37422 records). [2025-09-22T21:23:15.297557] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-22T21:23:15.297705] [INFO ] [MAIN ] Update Progress: 1980/2372 symbols completed. SPIR took 41.1s. Estimated remaining: 52m 6s. Rate: 7.5 symbols/min [2025-09-22T21:23:15.569691] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:23:15.584945] [DEBUG] [LOCAL ] SPRU: Loaded 8469 existing records from primary storage. [2025-09-22T21:23:15.585129] [INFO ] [MAIN ] SPRU: Loaded 8469 existing records. [2025-09-22T21:23:15.852329] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:23:15.852761] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-22T21:23:15.852840] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-22T21:23:15.853290] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-22T21:23:15.853369] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-22T21:23:16.302803] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:23:16.303709] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-22T21:23:16.369351] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T21:23:16.383971] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T21:23:16.439116] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-22T21:23:16.522059] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-22T21:23:17.146517] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T21:23:17.322121] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-22T21:23:17.829923] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T21:23:18.122069] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-22T21:23:18.922131] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-22T21:23:19.500023] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T21:23:19.553365] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-22T21:23:19.727188] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-22T21:23:19.750156] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-22T21:23:20.522123] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-22T21:23:21.067738] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T21:23:21.150023] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T21:23:21.322059] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-22T21:23:22.122062] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-22T21:23:22.922076] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-22T21:23:23.389967] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T21:23:23.396002] [INFO ] [REMOTE ] SPNT: Full fetch complete (48772 records). [2025-09-22T21:23:23.396111] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-22T21:23:23.729012] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-22T21:23:23.803086] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-22T21:23:23.803220] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-22T21:23:23.804249] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-22T21:23:23.804342] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-22T21:23:23.806074] [DEBUG] [LOCAL ] SPNT: Trimmed 48772 records to 34818 (keeping 200 days of data) [2025-09-22T21:23:23.956356] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-22T21:23:24.066606] [DEBUG] [LOCAL ] SPNT: Primary data saved (34818 records). [2025-09-22T21:23:24.066805] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-22T21:23:24.066911] [INFO ] [MAIN ] Update Progress: 1981/2372 symbols completed. SPNT took 17.3s. Estimated remaining: 51m 59s. Rate: 7.5 symbols/min [2025-09-22T21:23:24.251062] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:23:24.276347] [DEBUG] [LOCAL ] SPXC: Loaded 23780 existing records from primary storage. [2025-09-22T21:23:24.276504] [INFO ] [MAIN ] SPXC: Loaded 23780 existing records. [2025-09-22T21:23:24.472957] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T21:23:24.480377] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:23:24.481611] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-22T21:23:24.481795] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-22T21:23:24.491822] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-22T21:23:24.491936] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-22T21:23:24.527287] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-22T21:23:24.619716] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T21:23:24.885756] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:23:25.322033] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-22T21:23:25.358003] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-22T21:23:26.122075] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-22T21:23:26.426508] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T21:23:26.922094] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-22T21:23:27.722071] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-22T21:23:28.410823] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-22T21:23:28.427612] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T21:23:28.522008] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-22T21:23:28.577242] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T21:23:29.199212] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T21:23:29.322063] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-22T21:23:30.122043] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-22T21:23:30.329809] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T21:23:30.922101] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-22T21:23:31.722090] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-22T21:23:32.522033] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-22T21:23:32.554391] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-22T21:23:32.675762] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T21:23:32.829879] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T21:23:33.322064] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-22T21:23:34.031373] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T21:23:34.033388] [INFO ] [REMOTE ] SPRU: Full fetch complete (11436 records). [2025-09-22T21:23:34.033459] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-22T21:23:34.127627] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-22T21:23:34.404733] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-22T21:23:34.404811] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-22T21:23:34.405047] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-22T21:23:34.405085] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-22T21:23:34.405576] [DEBUG] [LOCAL ] SPRU: Trimmed 11436 records to 8394 (keeping 200 days of data) [2025-09-22T21:23:34.453208] [DEBUG] [LOCAL ] SPRU: Primary data saved (8394 records). [2025-09-22T21:23:34.453312] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-22T21:23:34.453394] [INFO ] [MAIN ] Update Progress: 1982/2372 symbols completed. SPRU took 19.2s. Estimated remaining: 51m 51s. Rate: 7.5 symbols/min [2025-09-22T21:23:34.624842] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:23:34.636386] [DEBUG] [LOCAL ] SPXX: Loaded 9123 existing records from primary storage. [2025-09-22T21:23:34.636483] [INFO ] [MAIN ] SPXX: Loaded 9123 existing records. [2025-09-22T21:23:34.821579] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:23:34.821979] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-22T21:23:34.822147] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-22T21:23:34.822555] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-22T21:23:34.822614] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-22T21:23:34.925352] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-22T21:23:35.042191] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-22T21:23:35.229800] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:23:35.548639] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T21:23:35.722099] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-22T21:23:36.175298] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-22T21:23:36.426424] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-22T21:23:36.522073] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-22T21:23:37.322072] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-22T21:23:37.963088] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T21:23:38.099592] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-22T21:23:38.122027] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-22T21:23:38.858808] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T21:23:38.922023] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-22T21:23:39.722084] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-22T21:23:40.084327] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T21:23:40.522087] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-22T21:23:40.888481] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T21:23:41.322058] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-22T21:23:42.122049] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-22T21:23:42.279579] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T21:23:42.589014] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T21:23:42.595855] [INFO ] [REMOTE ] SPR: Full fetch complete (60058 records). [2025-09-22T21:23:42.595978] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-22T21:23:42.925898] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-22T21:23:43.055832] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-22T21:23:43.057548] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-22T21:23:43.060405] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-22T21:23:43.062812] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-22T21:23:43.062886] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-22T21:23:43.064151] [DEBUG] [LOCAL ] SPR: Trimmed 60058 records to 41299 (keeping 200 days of data) [2025-09-22T21:23:43.317251] [DEBUG] [LOCAL ] SPR: Primary data saved (41299 records). [2025-09-22T21:23:43.317412] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-22T21:23:43.317509] [INFO ] [MAIN ] Update Progress: 1983/2372 symbols completed. SPR took 32.6s. Estimated remaining: 51m 43s. Rate: 7.5 symbols/min [2025-09-22T21:23:43.491473] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:23:43.540393] [DEBUG] [LOCAL ] SQM: Loaded 49335 existing records from primary storage. [2025-09-22T21:23:43.540560] [INFO ] [MAIN ] SQM: Loaded 49335 existing records. [2025-09-22T21:23:43.722056] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-22T21:23:43.726178] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:23:43.727473] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-22T21:23:43.727544] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-22T21:23:43.729925] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-22T21:23:43.729992] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-22T21:23:44.097512] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:23:44.122354] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T21:23:44.522039] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-22T21:23:44.594402] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T21:23:45.322086] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-22T21:23:46.122034] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-22T21:23:46.343870] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-22T21:23:46.377262] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T21:23:46.922067] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-22T21:23:47.722055] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-22T21:23:47.750471] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T21:23:48.522075] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-22T21:23:49.165789] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-22T21:23:49.225836] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T21:23:49.322125] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-22T21:23:49.676974] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T21:23:50.076793] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-22T21:23:50.122018] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-22T21:23:50.886312] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T21:23:50.922013] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-22T21:23:51.689802] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T21:23:51.722017] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-22T21:23:52.463344] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T21:23:52.466113] [INFO ] [REMOTE ] SPXX: Full fetch complete (12365 records). [2025-09-22T21:23:52.466239] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-22T21:23:52.530832] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-22T21:23:52.848456] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-22T21:23:52.848579] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-22T21:23:52.848888] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-22T21:23:52.848949] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-22T21:23:52.849434] [DEBUG] [LOCAL ] SPXX: Trimmed 12365 records to 8971 (keeping 200 days of data) [2025-09-22T21:23:52.905967] [DEBUG] [LOCAL ] SPXX: Primary data saved (8971 records). [2025-09-22T21:23:52.906105] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-22T21:23:52.906192] [INFO ] [MAIN ] Update Progress: 1984/2372 symbols completed. SPXX took 18.5s. Estimated remaining: 51m 36s. Rate: 7.5 symbols/min [2025-09-22T21:23:53.077670] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:23:53.103523] [DEBUG] [LOCAL ] SQNS: Loaded 25593 existing records from primary storage. [2025-09-22T21:23:53.103722] [INFO ] [MAIN ] SQNS: Loaded 25593 existing records. [2025-09-22T21:23:53.285368] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:23:53.285718] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-22T21:23:53.285784] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-22T21:23:53.286459] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-22T21:23:53.286534] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-22T21:23:53.328973] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-22T21:23:53.659933] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:23:54.093057] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T21:23:54.122058] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-22T21:23:54.462740] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T21:23:54.922156] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-22T21:23:55.722138] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-22T21:23:55.887044] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T21:23:56.025087] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-22T21:23:56.033208] [INFO ] [REMOTE ] SPOT: Full fetch complete (74078 records). [2025-09-22T21:23:56.033357] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-22T21:23:56.434408] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-22T21:23:56.434498] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-22T21:23:56.435709] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-22T21:23:56.435777] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-22T21:23:56.437337] [DEBUG] [LOCAL ] SPOT: Trimmed 74078 records to 50923 (keeping 200 days of data) [2025-09-22T21:23:56.530462] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-22T21:23:56.780636] [DEBUG] [LOCAL ] SPOT: Primary data saved (50923 records). [2025-09-22T21:23:56.780799] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-22T21:23:56.780888] [INFO ] [MAIN ] Update Progress: 1985/2372 symbols completed. SPOT took 47.8s. Estimated remaining: 51m 27s. Rate: 7.5 symbols/min [2025-09-22T21:23:56.956451] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:23:56.991248] [DEBUG] [LOCAL ] SR: Loaded 33089 existing records from primary storage. [2025-09-22T21:23:56.991396] [INFO ] [MAIN ] SR: Loaded 33089 existing records. [2025-09-22T21:23:57.179303] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:23:57.179956] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-22T21:23:57.180117] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-22T21:23:57.187141] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-22T21:23:57.198607] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-22T21:23:57.245510] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T21:23:57.327214] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-22T21:23:57.600623] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T21:23:57.608080] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:23:58.122070] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-22T21:23:58.922048] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-22T21:23:59.278576] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-22T21:23:59.722145] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-22T21:24:00.528333] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-22T21:24:00.532386] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-22T21:24:01.011475] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-22T21:24:01.015352] [INFO ] [REMOTE ] SPXC: Full fetch complete (33946 records). [2025-09-22T21:24:01.015461] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-22T21:24:01.327150] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-22T21:24:01.408166] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-22T21:24:01.408268] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-22T21:24:01.409374] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-22T21:24:01.409444] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-22T21:24:01.411179] [DEBUG] [LOCAL ] SPXC: Trimmed 33946 records to 23401 (keeping 200 days of data) [2025-09-22T21:24:01.566132] [DEBUG] [LOCAL ] SPXC: Primary data saved (23401 records). [2025-09-22T21:24:01.566279] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-22T21:24:01.566383] [INFO ] [MAIN ] Update Progress: 1986/2372 symbols completed. SPXC took 37.5s. Estimated remaining: 51m 18s. Rate: 7.5 symbols/min [2025-09-22T21:24:01.764985] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:24:01.767712] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T21:24:01.833769] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-22T21:24:01.833986] [INFO ] [MAIN ] SRE: Loaded 54202 existing records. [2025-09-22T21:24:02.032586] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:24:02.033056] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-22T21:24:02.033105] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-22T21:24:02.034213] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-22T21:24:02.034272] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-22T21:24:02.130047] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-22T21:24:02.425253] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:24:02.468225] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-22T21:24:02.633082] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-22T21:24:02.922071] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-22T21:24:02.978714] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T21:24:03.722080] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-22T21:24:04.482358] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T21:24:04.497406] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T21:24:04.522000] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-22T21:24:05.322074] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-22T21:24:06.127637] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-22T21:24:06.132850] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T21:24:06.922036] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-22T21:24:07.057994] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T21:24:07.505458] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T21:24:07.722060] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-22T21:24:08.522065] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-22T21:24:08.645158] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T21:24:08.780525] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T21:24:08.998507] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-22T21:24:09.322060] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-22T21:24:10.122117] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-22T21:24:10.922101] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-22T21:24:11.009666] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-22T21:24:11.570173] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-22T21:24:11.722093] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-22T21:24:12.506213] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T21:24:12.522014] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-22T21:24:13.284960] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T21:24:13.292891] [INFO ] [REMOTE ] SQM: Full fetch complete (68840 records). [2025-09-22T21:24:13.293038] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-22T21:24:13.333568] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-22T21:24:13.720795] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-22T21:24:13.720884] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-22T21:24:13.722068] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-22T21:24:13.722135] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-22T21:24:13.723692] [DEBUG] [LOCAL ] SQM: Trimmed 68840 records to 48556 (keeping 200 days of data) [2025-09-22T21:24:14.014786] [DEBUG] [LOCAL ] SQM: Primary data saved (48556 records). [2025-09-22T21:24:14.014933] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-22T21:24:14.015028] [INFO ] [MAIN ] Update Progress: 1987/2372 symbols completed. SQM took 30.7s. Estimated remaining: 51m 11s. Rate: 7.5 symbols/min [2025-09-22T21:24:14.128633] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-22T21:24:14.210982] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:24:14.223832] [DEBUG] [LOCAL ] SREA: Loaded 10548 existing records from primary storage. [2025-09-22T21:24:14.223967] [INFO ] [MAIN ] SREA: Loaded 10548 existing records. [2025-09-22T21:24:14.415479] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:24:14.415853] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-22T21:24:14.415922] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-22T21:24:14.416559] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-22T21:24:14.416619] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-22T21:24:14.682725] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-22T21:24:14.748041] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-22T21:24:14.838948] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:24:14.922005] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-22T21:24:15.616487] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T21:24:15.722059] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-22T21:24:16.522097] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-22T21:24:16.612675] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T21:24:16.681276] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T21:24:17.322027] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-22T21:24:17.641837] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-22T21:24:18.127566] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-22T21:24:18.129322] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T21:24:18.922071] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-22T21:24:19.722075] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-22T21:24:20.162966] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-22T21:24:20.451371] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T21:24:20.522013] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-22T21:24:20.538147] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T21:24:21.322051] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-22T21:24:22.114275] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T21:24:22.121994] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-22T21:24:22.379975] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T21:24:22.629342] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-22T21:24:22.922049] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-22T21:24:23.722065] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-22T21:24:24.522027] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-22T21:24:25.009072] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-22T21:24:25.084580] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T21:24:25.322109] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-22T21:24:25.402927] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T21:24:26.122067] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-22T21:24:26.829608] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T21:24:26.922022] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-22T21:24:27.088689] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T21:24:27.656068] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T21:24:27.722048] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-22T21:24:28.475050] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T21:24:28.522082] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-22T21:24:29.211849] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T21:24:29.214567] [INFO ] [REMOTE ] SREA: Full fetch complete (15986 records). [2025-09-22T21:24:29.214763] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-22T21:24:29.327300] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-22T21:24:29.690252] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-22T21:24:29.690340] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-22T21:24:29.690796] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-22T21:24:29.690861] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-22T21:24:29.692543] [DEBUG] [LOCAL ] SREA: Trimmed 15986 records to 10440 (keeping 200 days of data) [2025-09-22T21:24:29.763220] [DEBUG] [LOCAL ] SREA: Primary data saved (10440 records). [2025-09-22T21:24:29.763379] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-22T21:24:29.763468] [INFO ] [MAIN ] Update Progress: 1988/2372 symbols completed. SREA took 15.7s. Estimated remaining: 51m 5s. Rate: 7.5 symbols/min [2025-09-22T21:24:29.938379] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:24:29.977419] [DEBUG] [LOCAL ] SRFM: Loaded 35580 existing records from primary storage. [2025-09-22T21:24:29.977561] [INFO ] [MAIN ] SRFM: Loaded 35580 existing records. [2025-09-22T21:24:30.127159] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-22T21:24:30.160401] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:24:30.160630] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-22T21:24:30.160717] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-22T21:24:30.161570] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-22T21:24:30.161631] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-22T21:24:30.521431] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:24:30.922080] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-22T21:24:31.116173] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T21:24:31.123954] [INFO ] [REMOTE ] SQNS: Full fetch complete (31686 records). [2025-09-22T21:24:31.124046] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-22T21:24:31.529801] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-22T21:24:31.529940] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-22T21:24:31.530969] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-22T21:24:31.531126] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-22T21:24:31.532584] [DEBUG] [LOCAL ] SQNS: Trimmed 31686 records to 25715 (keeping 200 days of data) [2025-09-22T21:24:31.663934] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-22T21:24:31.722290] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-22T21:24:31.722180] [DEBUG] [LOCAL ] SQNS: Primary data saved (25715 records). [2025-09-22T21:24:31.722675] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-22T21:24:31.723696] [INFO ] [MAIN ] Update Progress: 1989/2372 symbols completed. SQNS took 38.8s. Estimated remaining: 50m 56s. Rate: 7.5 symbols/min [2025-09-22T21:24:31.910630] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:24:31.928499] [DEBUG] [LOCAL ] SRG: Loaded 16424 existing records from primary storage. [2025-09-22T21:24:31.928624] [INFO ] [MAIN ] SRG: Loaded 16424 existing records. [2025-09-22T21:24:32.124753] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:24:32.125112] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-22T21:24:32.125392] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-22T21:24:32.126071] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-22T21:24:32.126136] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-22T21:24:32.426600] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T21:24:32.531457] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-22T21:24:32.545141] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:24:33.126618] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T21:24:33.322059] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-22T21:24:34.122071] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-22T21:24:34.173467] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T21:24:34.624691] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T21:24:34.922108] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-22T21:24:35.299802] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T21:24:35.305053] [INFO ] [REMOTE ] SR: Full fetch complete (45776 records). [2025-09-22T21:24:35.305189] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-22T21:24:35.681253] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-22T21:24:35.681330] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-22T21:24:35.682279] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-22T21:24:35.682359] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-22T21:24:35.683394] [DEBUG] [LOCAL ] SR: Trimmed 45776 records to 32752 (keeping 200 days of data) [2025-09-22T21:24:35.749802] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-22T21:24:35.899271] [DEBUG] [LOCAL ] SR: Primary data saved (32752 records). [2025-09-22T21:24:35.899406] [INFO ] [MAIN ] SR: Full history saved. [2025-09-22T21:24:35.899508] [INFO ] [MAIN ] Update Progress: 1990/2372 symbols completed. SR took 39.1s. Estimated remaining: 50m 47s. Rate: 7.5 symbols/min [2025-09-22T21:24:36.088680] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:24:36.121460] [DEBUG] [LOCAL ] SRI: Loaded 28412 existing records from primary storage. [2025-09-22T21:24:36.121744] [INFO ] [MAIN ] SRI: Loaded 28412 existing records. [2025-09-22T21:24:36.307111] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:24:36.307747] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-22T21:24:36.307865] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-22T21:24:36.316996] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-22T21:24:36.317114] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-22T21:24:36.426515] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T21:24:36.447326] [INFO ] [REMOTE ] SRE: Full fetch complete (77276 records). [2025-09-22T21:24:36.458273] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-22T21:24:36.533193] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-22T21:24:37.038699] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:24:37.057904] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T21:24:37.229265] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-22T21:24:37.229356] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-22T21:24:37.232234] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-22T21:24:37.232308] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-22T21:24:37.235395] [DEBUG] [LOCAL ] SRE: Trimmed 77276 records to 53426 (keeping 200 days of data) [2025-09-22T21:24:37.324727] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-22T21:24:37.607690] [DEBUG] [LOCAL ] SRE: Primary data saved (53426 records). [2025-09-22T21:24:37.607846] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-22T21:24:37.608010] [INFO ] [MAIN ] Update Progress: 1991/2372 symbols completed. SRE took 36.0s. Estimated remaining: 50m 38s. Rate: 7.5 symbols/min [2025-09-22T21:24:37.776314] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:24:37.776514] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-22T21:24:37.776569] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-22T21:24:37.776763] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-22T21:24:37.776811] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-22T21:24:37.776853] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-22T21:24:37.776885] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-22T21:24:38.126332] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-22T21:24:38.193999] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:24:38.283142] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T21:24:38.290428] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T21:24:38.922049] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-22T21:24:39.701082] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T21:24:39.722039] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-22T21:24:39.978970] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T21:24:40.522067] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-22T21:24:40.849067] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-22T21:24:41.301118] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T21:24:41.322039] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-22T21:24:42.122044] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-22T21:24:42.224866] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-22T21:24:42.674503] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-22T21:24:42.922124] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-22T21:24:43.722029] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-22T21:24:44.080748] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T21:24:44.527282] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-22T21:24:44.535009] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T21:24:45.322089] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-22T21:24:45.751587] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T21:24:45.833123] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-22T21:24:46.122059] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-22T21:24:46.922030] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-22T21:24:47.052354] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-22T21:24:47.722077] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-22T21:24:48.273508] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T21:24:48.288376] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-22T21:24:48.522061] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-22T21:24:49.322057] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-22T21:24:49.764287] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T21:24:49.796334] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T21:24:50.122056] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-22T21:24:50.922102] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-22T21:24:51.049912] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T21:24:51.722075] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-22T21:24:52.138510] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T21:24:52.512114] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T21:24:52.516469] [INFO ] [REMOTE ] SRG: Full fetch complete (25531 records). [2025-09-22T21:24:52.516585] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-22T21:24:52.528837] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-22T21:24:52.888072] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-22T21:24:52.888149] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-22T21:24:52.888670] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-22T21:24:52.888739] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-22T21:24:52.889423] [DEBUG] [LOCAL ] SRG: Trimmed 25531 records to 15896 (keeping 200 days of data) [2025-09-22T21:24:52.987004] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T21:24:52.993951] [DEBUG] [LOCAL ] SRG: Primary data saved (15896 records). [2025-09-22T21:24:52.994033] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-22T21:24:52.994119] [INFO ] [MAIN ] Update Progress: 1992/2372 symbols completed. SRG took 21.3s. Estimated remaining: 50m 31s. Rate: 7.5 symbols/min [2025-09-22T21:24:53.175259] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:24:53.188115] [DEBUG] [LOCAL ] SRV: Loaded 7878 existing records from primary storage. [2025-09-22T21:24:53.188236] [INFO ] [MAIN ] SRV: Loaded 7878 existing records. [2025-09-22T21:24:53.330484] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-22T21:24:53.373554] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:24:53.373774] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-22T21:24:53.373832] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-22T21:24:53.374200] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-22T21:24:53.374283] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-22T21:24:53.729698] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:24:54.122110] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-22T21:24:54.528321] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-22T21:24:54.529431] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T21:24:54.922075] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-22T21:24:55.722034] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-22T21:24:55.903798] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-22T21:24:56.522034] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-22T21:24:56.992306] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T21:24:56.993359] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T21:24:57.322089] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-22T21:24:58.122116] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-22T21:24:58.718555] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T21:24:58.885237] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T21:24:58.922060] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-22T21:24:59.722050] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-22T21:25:00.104973] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T21:25:00.193446] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-22T21:25:00.522060] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-22T21:25:00.919395] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-22T21:25:01.322082] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-22T21:25:02.091855] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T21:25:02.122065] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-22T21:25:02.922061] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-22T21:25:03.175695] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T21:25:03.179544] [INFO ] [REMOTE ] SRI: Full fetch complete (41744 records). [2025-09-22T21:25:03.179708] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-22T21:25:03.563425] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-22T21:25:03.563501] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-22T21:25:03.564355] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-22T21:25:03.564416] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-22T21:25:03.565302] [DEBUG] [LOCAL ] SRI: Trimmed 41744 records to 27710 (keeping 200 days of data) [2025-09-22T21:25:03.721031] [DEBUG] [LOCAL ] SRI: Primary data saved (27710 records). [2025-09-22T21:25:03.721165] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-22T21:25:03.721323] [INFO ] [MAIN ] Update Progress: 1993/2372 symbols completed. SRI took 27.8s. Estimated remaining: 50m 24s. Rate: 7.5 symbols/min [2025-09-22T21:25:03.733098] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-22T21:25:03.897819] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:25:03.942274] [DEBUG] [LOCAL ] SSB: Loaded 43549 existing records from primary storage. [2025-09-22T21:25:03.942436] [INFO ] [MAIN ] SSB: Loaded 43549 existing records. [2025-09-22T21:25:04.131159] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:25:04.131451] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-22T21:25:04.131499] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-22T21:25:04.132521] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-22T21:25:04.132580] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-22T21:25:04.526601] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:25:04.522907] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-22T21:25:04.585517] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T21:25:04.699492] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T21:25:04.903267] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-22T21:25:05.322049] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-22T21:25:06.122053] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-22T21:25:06.907898] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T21:25:06.922006] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-22T21:25:07.701196] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-22T21:25:07.722029] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-22T21:25:07.767870] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-22T21:25:08.437467] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-22T21:25:08.522091] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-22T21:25:09.280581] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T21:25:09.322015] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-22T21:25:10.109246] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-22T21:25:10.121994] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-22T21:25:10.771984] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-22T21:25:10.773590] [INFO ] [REMOTE ] SRV: Full fetch complete (11561 records). [2025-09-22T21:25:10.773685] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-22T21:25:10.927914] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-22T21:25:11.147843] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-22T21:25:11.147921] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-22T21:25:11.148225] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-22T21:25:11.148265] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-22T21:25:11.148848] [DEBUG] [LOCAL ] SRV: Trimmed 11561 records to 7679 (keeping 200 days of data) [2025-09-22T21:25:11.198514] [DEBUG] [LOCAL ] SRV: Primary data saved (7679 records). [2025-09-22T21:25:11.198675] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-22T21:25:11.198799] [INFO ] [MAIN ] Update Progress: 1994/2372 symbols completed. SRV took 18.2s. Estimated remaining: 50m 16s. Rate: 7.5 symbols/min [2025-09-22T21:25:11.381444] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:25:11.406849] [DEBUG] [LOCAL ] SSD: Loaded 22766 existing records from primary storage. [2025-09-22T21:25:11.407023] [INFO ] [MAIN ] SSD: Loaded 22766 existing records. [2025-09-22T21:25:11.585211] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:25:11.585530] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-22T21:25:11.585592] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-22T21:25:11.586278] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-22T21:25:11.586340] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-22T21:25:11.727258] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-22T21:25:11.950866] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:25:12.136616] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-22T21:25:12.522029] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-22T21:25:12.575225] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T21:25:13.038145] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-22T21:25:13.039185] [INFO ] [REMOTE ] SRL: Full fetch complete (1911 records). [2025-09-22T21:25:13.039270] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-22T21:25:13.243057] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-22T21:25:13.243269] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:25:13.243316] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:25:13.243355] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-22T21:25:13.243418] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-22T21:25:13.243454] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-22T21:25:13.243550] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-22T21:25:13.243665] [INFO ] [MAIN ] Update Progress: 1995/2372 symbols completed. SRL took 35.6s. Estimated remaining: 50m 6s. Rate: 7.5 symbols/min [2025-09-22T21:25:13.327238] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-22T21:25:13.418308] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:25:13.480891] [DEBUG] [LOCAL ] SSL: Loaded 41764 existing records from primary storage. [2025-09-22T21:25:13.481065] [INFO ] [MAIN ] SSL: Loaded 41764 existing records. [2025-09-22T21:25:13.663958] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:25:13.664194] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-22T21:25:13.664241] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-22T21:25:13.665139] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-22T21:25:13.665199] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-22T21:25:14.048500] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:25:14.122048] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-22T21:25:14.922020] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-22T21:25:15.012696] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T21:25:15.722031] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-22T21:25:15.759215] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T21:25:16.522062] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-22T21:25:17.146806] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-22T21:25:17.177457] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T21:25:17.322010] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-22T21:25:17.619705] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T21:25:18.122084] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-22T21:25:18.762428] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T21:25:18.922075] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-22T21:25:19.351168] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-22T21:25:19.722084] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-22T21:25:20.522068] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-22T21:25:20.804312] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T21:25:20.814909] [INFO ] [REMOTE ] SRFM: Full fetch complete (48675 records). [2025-09-22T21:25:20.815135] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-22T21:25:21.261575] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-22T21:25:21.261794] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-22T21:25:21.263019] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-22T21:25:21.263126] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-22T21:25:21.264955] [DEBUG] [LOCAL ] SRFM: Trimmed 48675 records to 35323 (keeping 200 days of data) [2025-09-22T21:25:21.329634] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-22T21:25:21.511811] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T21:25:21.542499] [DEBUG] [LOCAL ] SRFM: Primary data saved (35323 records). [2025-09-22T21:25:21.542699] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-22T21:25:21.542818] [INFO ] [MAIN ] Update Progress: 1996/2372 symbols completed. SRFM took 51.8s. Estimated remaining: 49m 59s. Rate: 7.5 symbols/min [2025-09-22T21:25:21.750958] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:25:21.767869] [DEBUG] [LOCAL ] SST: Loaded 12554 existing records from primary storage. [2025-09-22T21:25:21.768026] [INFO ] [MAIN ] SST: Loaded 12554 existing records. [2025-09-22T21:25:21.985063] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:25:21.985722] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-22T21:25:21.985794] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-22T21:25:21.986373] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-22T21:25:21.986442] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-22T21:25:22.124261] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-22T21:25:22.446705] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-22T21:25:22.544293] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:25:22.561822] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T21:25:22.922129] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-22T21:25:23.722027] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-22T21:25:23.768620] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T21:25:23.766540] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T21:25:24.522078] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-22T21:25:25.211617] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T21:25:25.322060] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-22T21:25:26.084209] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T21:25:26.122051] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-22T21:25:26.822007] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T21:25:26.922087] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-22T21:25:27.722064] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-22T21:25:27.754943] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T21:25:28.486567] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T21:25:28.522019] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-22T21:25:28.843985] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T21:25:29.322072] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-22T21:25:30.025066] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T21:25:30.122057] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-22T21:25:30.922032] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-22T21:25:30.983602] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:25:31.589868] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T21:25:31.722043] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-22T21:25:31.757331] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T21:25:32.522080] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-22T21:25:33.247948] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T21:25:33.322013] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-22T21:25:33.631220] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T21:25:34.122105] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-22T21:25:34.690595] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T21:25:34.922033] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-22T21:25:35.098854] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T21:25:35.722143] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-22T21:25:36.264006] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T21:25:36.522076] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-22T21:25:36.995139] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T21:25:37.003040] [INFO ] [REMOTE ] SSL: Full fetch complete (60382 records). [2025-09-22T21:25:37.003279] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-22T21:25:37.331913] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-22T21:25:37.442364] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-22T21:25:37.442507] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-22T21:25:37.445186] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-22T21:25:37.445296] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-22T21:25:37.447761] [DEBUG] [LOCAL ] SSL: Trimmed 60382 records to 41162 (keeping 200 days of data) [2025-09-22T21:25:37.549632] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T21:25:37.719970] [DEBUG] [LOCAL ] SSL: Primary data saved (41162 records). [2025-09-22T21:25:37.720174] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-22T21:25:37.720338] [INFO ] [MAIN ] Update Progress: 1997/2372 symbols completed. SSL took 24.5s. Estimated remaining: 49m 52s. Rate: 7.5 symbols/min [2025-09-22T21:25:38.122077] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-22T21:25:38.595820] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T21:25:38.922091] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-22T21:25:39.052846] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-22T21:25:39.722054] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-22T21:25:40.419015] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T21:25:40.426073] [INFO ] [REMOTE ] SSB: Full fetch complete (61147 records). [2025-09-22T21:25:40.426199] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-22T21:25:40.527135] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-22T21:25:40.828810] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-22T21:25:40.828946] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-22T21:25:40.830226] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-22T21:25:40.830296] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-22T21:25:40.831756] [DEBUG] [LOCAL ] SSB: Trimmed 61147 records to 42996 (keeping 200 days of data) [2025-09-22T21:25:40.950639] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T21:25:41.132523] [DEBUG] [LOCAL ] SSB: Primary data saved (42996 records). [2025-09-22T21:25:41.132721] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-22T21:25:41.132839] [INFO ] [MAIN ] Update Progress: 1998/2372 symbols completed. SSB took 37.4s. Estimated remaining: 49m 43s. Rate: 7.5 symbols/min [2025-09-22T21:25:41.322075] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-22T21:25:41.682964] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T21:25:42.122046] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-22T21:25:42.499356] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T21:25:42.885754] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T21:25:42.922020] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-22T21:25:43.691075] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T21:25:43.722027] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-22T21:25:44.335874] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T21:25:44.337958] [INFO ] [REMOTE ] SST: Full fetch complete (19109 records). [2025-09-22T21:25:44.338043] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-22T21:25:44.527277] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-22T21:25:44.762907] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-22T21:25:44.762990] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-22T21:25:44.763428] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-22T21:25:44.763467] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-22T21:25:44.764048] [DEBUG] [LOCAL ] SST: Trimmed 19109 records to 12280 (keeping 200 days of data) [2025-09-22T21:25:44.837953] [DEBUG] [LOCAL ] SST: Primary data saved (12280 records). [2025-09-22T21:25:44.838104] [INFO ] [MAIN ] SST: Full history saved. [2025-09-22T21:25:44.838193] [INFO ] [MAIN ] Update Progress: 1999/2372 symbols completed. SST took 23.3s. Estimated remaining: 49m 34s. Rate: 7.5 symbols/min [2025-09-22T21:25:45.745679] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-22T21:25:45.751428] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-22T21:25:46.812400] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T21:25:46.816345] [INFO ] [REMOTE ] SSD: Full fetch complete (32266 records). [2025-09-22T21:25:46.816455] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-22T21:25:47.220793] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-22T21:25:47.220880] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-22T21:25:47.221802] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-22T21:25:47.221869] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-22T21:25:47.222745] [DEBUG] [LOCAL ] SSD: Trimmed 32266 records to 22336 (keeping 200 days of data) [2025-09-22T21:25:47.375559] [DEBUG] [LOCAL ] SSD: Primary data saved (22336 records). [2025-09-22T21:25:47.375730] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-22T21:25:47.375831] [INFO ] [MAIN ] Update Progress: 2000/2372 symbols completed. SSD took 36.2s. Estimated remaining: 49m 26s. Rate: 7.5 symbols/min [2025-09-22T21:25:47.980318] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:25:48.129791] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:25:48.121439] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:25:48.159499] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:25:48.192392] [DEBUG] [LOCAL ] SSTK: Loaded 27464 existing records from primary storage. [2025-09-22T21:25:48.192584] [INFO ] [MAIN ] SSTK: Loaded 27464 existing records. [2025-09-22T21:25:48.253206] [DEBUG] [LOCAL ] STC: Loaded 18188 existing records from primary storage. [2025-09-22T21:25:48.258834] [INFO ] [MAIN ] STC: Loaded 18188 existing records. [2025-09-22T21:25:48.577500] [DEBUG] [LOCAL ] STAG: Loaded 50788 existing records from primary storage. [2025-09-22T21:25:48.586290] [INFO ] [MAIN ] STAG: Loaded 50788 existing records. [2025-09-22T21:25:48.614075] [DEBUG] [LOCAL ] ST: Loaded 50609 existing records from primary storage. [2025-09-22T21:25:48.595310] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:25:48.636583] [INFO ] [MAIN ] ST: Loaded 50609 existing records. [2025-09-22T21:25:48.709621] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-22T21:25:48.774920] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:25:48.774787] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-22T21:25:48.841857] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-22T21:25:48.851685] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-22T21:25:48.861179] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-22T21:25:48.878095] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-22T21:25:48.899709] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-22T21:25:48.913828] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-22T21:25:49.168503] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:25:49.192057] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-22T21:25:49.249579] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:25:49.254854] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-22T21:25:49.309309] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-22T21:25:49.309775] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-22T21:25:49.337127] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-22T21:25:49.337015] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-22T21:25:49.375389] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-22T21:25:49.375242] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-22T21:25:50.460974] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:25:50.526150] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-22T21:25:50.568181] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:25:50.613265] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-22T21:25:50.728235] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:25:50.749381] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-22T21:25:50.813002] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:25:50.813311] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-22T21:25:51.734490] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T21:25:51.738827] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-22T21:25:51.834436] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T21:25:51.841834] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-22T21:25:52.354361] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T21:25:52.365014] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-22T21:25:52.547428] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-22T21:25:52.558462] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-22T21:25:52.772623] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-22T21:25:52.778822] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-22T21:25:53.410519] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T21:25:53.419981] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-22T21:25:53.552166] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T21:25:53.663996] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T21:25:54.122114] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-22T21:25:54.346402] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T21:25:54.732449] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T21:25:54.922068] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-22T21:25:55.722016] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-22T21:25:55.822901] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T21:25:56.522051] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-22T21:25:56.651014] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T21:25:56.781702] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T21:25:57.322058] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-22T21:25:58.122013] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-22T21:25:58.313634] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T21:25:58.922036] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-22T21:25:59.090818] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-22T21:25:59.153434] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T21:25:59.722078] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-22T21:26:00.524276] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-22T21:26:00.526412] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T21:26:01.147462] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T21:26:01.322018] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-22T21:26:01.639126] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T21:26:02.122075] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-22T21:26:02.782719] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T21:26:02.922076] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-22T21:26:03.661924] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T21:26:03.722029] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-22T21:26:04.184710] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T21:26:04.522060] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-22T21:26:05.322088] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-22T21:26:05.508986] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T21:26:05.811482] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T21:26:06.122057] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-22T21:26:06.539697] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T21:26:06.922109] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-22T21:26:07.722034] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-22T21:26:07.774456] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T21:26:08.527952] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-22T21:26:08.540317] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:26:08.941523] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T21:26:09.322060] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-22T21:26:10.122061] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-22T21:26:10.357548] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T21:26:10.390741] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T21:26:10.922042] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-22T21:26:11.271705] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-22T21:26:11.722042] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-22T21:26:11.887031] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T21:26:12.522189] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-22T21:26:12.526556] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-22T21:26:12.531324] [INFO ] [REMOTE ] SSTK: Full fetch complete (42377 records). [2025-09-22T21:26:12.531414] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-22T21:26:12.988092] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-22T21:26:12.988267] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-22T21:26:12.989963] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-22T21:26:12.990035] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-22T21:26:12.991536] [DEBUG] [LOCAL ] SSTK: Trimmed 42377 records to 26778 (keeping 200 days of data) [2025-09-22T21:26:13.186459] [DEBUG] [LOCAL ] SSTK: Primary data saved (26778 records). [2025-09-22T21:26:13.186684] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-22T21:26:13.186819] [INFO ] [MAIN ] Update Progress: 2001/2372 symbols completed. SSTK took 25.8s. Estimated remaining: 49m 21s. Rate: 7.5 symbols/min [2025-09-22T21:26:13.327264] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-22T21:26:13.401352] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:26:13.442286] [DEBUG] [LOCAL ] STE: Loaded 36040 existing records from primary storage. [2025-09-22T21:26:13.442474] [INFO ] [MAIN ] STE: Loaded 36040 existing records. [2025-09-22T21:26:13.629556] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:26:13.629876] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-22T21:26:13.629927] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-22T21:26:13.630877] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-22T21:26:13.630937] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-22T21:26:14.014532] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:26:14.122044] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-22T21:26:14.363938] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T21:26:14.922110] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-22T21:26:15.187205] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T21:26:15.228041] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T21:26:15.722096] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-22T21:26:15.839477] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T21:26:16.522184] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-22T21:26:17.240263] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T21:26:17.322056] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-22T21:26:18.015982] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T21:26:18.122061] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-22T21:26:18.804348] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T21:26:18.812208] [INFO ] [REMOTE ] ST: Full fetch complete (71892 records). [2025-09-22T21:26:18.812361] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-22T21:26:18.927354] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-22T21:26:19.232921] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-22T21:26:19.233038] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-22T21:26:19.234213] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-22T21:26:19.234286] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-22T21:26:19.238739] [DEBUG] [LOCAL ] ST: Trimmed 71892 records to 49833 (keeping 200 days of data) [2025-09-22T21:26:19.553706] [DEBUG] [LOCAL ] ST: Primary data saved (49833 records). [2025-09-22T21:26:19.553858] [INFO ] [MAIN ] ST: Full history saved. [2025-09-22T21:26:19.553948] [INFO ] [MAIN ] Update Progress: 2002/2372 symbols completed. ST took 32.2s. Estimated remaining: 49m 13s. Rate: 7.5 symbols/min [2025-09-22T21:26:19.738603] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-22T21:26:19.747209] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:26:19.761247] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T21:26:19.781066] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T21:26:19.786221] [INFO ] [REMOTE ] STC: Full fetch complete (26141 records). [2025-09-22T21:26:19.786423] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-22T21:26:19.954324] [DEBUG] [LOCAL ] STEL: Loaded 24158 existing records from primary storage. [2025-09-22T21:26:19.975240] [INFO ] [MAIN ] STEL: Loaded 24158 existing records. [2025-09-22T21:26:20.387194] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:26:20.418498] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-22T21:26:20.430090] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-22T21:26:20.430351] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-22T21:26:20.431136] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-22T21:26:20.430245] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-22T21:26:20.431223] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-22T21:26:20.432420] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-22T21:26:20.432383] [DEBUG] [LOCAL ] STC: Trimmed 26141 records to 17811 (keeping 200 days of data) [2025-09-22T21:26:20.432566] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-22T21:26:20.562085] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-22T21:26:20.710373] [DEBUG] [LOCAL ] STC: Primary data saved (17811 records). [2025-09-22T21:26:20.735336] [INFO ] [MAIN ] STC: Full history saved. [2025-09-22T21:26:20.802289] [INFO ] [MAIN ] Update Progress: 2003/2372 symbols completed. STC took 33.4s. Estimated remaining: 49m 3s. Rate: 7.5 symbols/min [2025-09-22T21:26:21.114017] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:26:21.110323] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:26:21.154617] [DEBUG] [LOCAL ] STEM: Loaded 40808 existing records from primary storage. [2025-09-22T21:26:21.154799] [INFO ] [MAIN ] STEM: Loaded 40808 existing records. [2025-09-22T21:26:21.333932] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-22T21:26:21.339705] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:26:21.340823] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-22T21:26:21.340893] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-22T21:26:21.342801] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-22T21:26:21.342864] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-22T21:26:21.513928] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-22T21:26:21.571375] [INFO ] [REMOTE ] STAG: Full fetch complete (71841 records). [2025-09-22T21:26:21.624322] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-22T21:26:21.985247] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:26:22.128152] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-22T21:26:22.236591] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-22T21:26:22.236938] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-22T21:26:22.238612] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-22T21:26:22.238792] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-22T21:26:22.240904] [DEBUG] [LOCAL ] STAG: Trimmed 71841 records to 50044 (keeping 200 days of data) [2025-09-22T21:26:22.356704] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T21:26:22.408356] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T21:26:22.614765] [DEBUG] [LOCAL ] STAG: Primary data saved (50044 records). [2025-09-22T21:26:22.614939] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-22T21:26:22.617009] [INFO ] [MAIN ] Update Progress: 2004/2372 symbols completed. STAG took 35.2s. Estimated remaining: 48m 54s. Rate: 7.5 symbols/min [2025-09-22T21:26:22.791148] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:26:22.811845] [DEBUG] [LOCAL ] STEW: Loaded 16621 existing records from primary storage. [2025-09-22T21:26:22.811988] [INFO ] [MAIN ] STEW: Loaded 16621 existing records. [2025-09-22T21:26:22.927176] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-22T21:26:22.995029] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:26:22.995271] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-22T21:26:22.995322] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-22T21:26:22.995923] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-22T21:26:22.995983] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-22T21:26:23.351226] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:26:23.722023] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-22T21:26:24.078893] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T21:26:24.479006] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-22T21:26:24.504787] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:26:24.521997] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-22T21:26:25.322077] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-22T21:26:26.028788] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T21:26:26.122044] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-22T21:26:26.406695] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T21:26:26.922043] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-22T21:26:27.062277] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T21:26:27.722088] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-22T21:26:28.422460] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T21:26:28.522061] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-22T21:26:28.943837] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T21:26:29.322096] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-22T21:26:29.474912] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-22T21:26:30.122066] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-22T21:26:30.541472] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T21:26:30.922101] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-22T21:26:31.680141] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T21:26:31.722119] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-22T21:26:31.975593] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T21:26:32.522067] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-22T21:26:33.226304] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T21:26:33.317272] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-22T21:26:33.321995] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-22T21:26:34.122082] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-22T21:26:34.357981] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T21:26:34.922059] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-22T21:26:35.722070] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-22T21:26:36.171758] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T21:26:36.177437] [INFO ] [REMOTE ] STE: Full fetch complete (50716 records). [2025-09-22T21:26:36.177541] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-22T21:26:36.533662] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-22T21:26:36.579354] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-22T21:26:36.579666] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-22T21:26:36.580675] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-22T21:26:36.580751] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-22T21:26:36.582361] [DEBUG] [LOCAL ] STE: Trimmed 50716 records to 35458 (keeping 200 days of data) [2025-09-22T21:26:36.711130] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-22T21:26:36.742828] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T21:26:36.876594] [DEBUG] [LOCAL ] STE: Primary data saved (35458 records). [2025-09-22T21:26:36.876801] [INFO ] [MAIN ] STE: Full history saved. [2025-09-22T21:26:36.876907] [INFO ] [MAIN ] Update Progress: 2005/2372 symbols completed. STE took 23.7s. Estimated remaining: 48m 47s. Rate: 7.5 symbols/min [2025-09-22T21:26:37.048501] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:26:37.048736] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-22T21:26:37.048791] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-22T21:26:37.048945] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-22T21:26:37.048998] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-22T21:26:37.049065] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-22T21:26:37.049099] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-22T21:26:37.328241] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-22T21:26:37.408869] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:26:37.682248] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T21:26:38.122111] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-22T21:26:38.457890] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-22T21:26:38.784618] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T21:26:38.922065] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-22T21:26:39.344385] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T21:26:39.722093] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-22T21:26:40.522106] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-22T21:26:41.322084] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-22T21:26:41.533269] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T21:26:41.630691] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-22T21:26:41.636168] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-22T21:26:42.122061] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-22T21:26:42.500285] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-22T21:26:42.922075] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-22T21:26:43.274451] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-22T21:26:43.722074] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-22T21:26:44.522107] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-22T21:26:44.771003] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T21:26:44.868380] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-22T21:26:45.322053] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-22T21:26:46.122034] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-22T21:26:46.240913] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T21:26:46.458225] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-22T21:26:46.922044] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-22T21:26:47.722065] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-22T21:26:48.484195] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T21:26:48.522133] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-22T21:26:48.768394] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T21:26:49.164913] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T21:26:49.322067] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-22T21:26:50.122050] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-22T21:26:50.224225] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T21:26:50.922021] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-22T21:26:51.124391] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-22T21:26:51.128329] [INFO ] [REMOTE ] STEL: Full fetch complete (32105 records). [2025-09-22T21:26:51.128408] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-22T21:26:51.509827] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-22T21:26:51.509906] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-22T21:26:51.510541] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-22T21:26:51.510580] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-22T21:26:51.512720] [DEBUG] [LOCAL ] STEL: Trimmed 32105 records to 23723 (keeping 200 days of data) [2025-09-22T21:26:51.663781] [DEBUG] [LOCAL ] STEL: Primary data saved (23723 records). [2025-09-22T21:26:51.663911] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-22T21:26:51.663995] [INFO ] [MAIN ] Update Progress: 2006/2372 symbols completed. STEL took 32.1s. Estimated remaining: 48m 41s. Rate: 7.5 symbols/min [2025-09-22T21:26:51.734353] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-22T21:26:51.859736] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:26:51.870624] [DEBUG] [LOCAL ] STK: Loaded 9554 existing records from primary storage. [2025-09-22T21:26:51.870774] [INFO ] [MAIN ] STK: Loaded 9554 existing records. [2025-09-22T21:26:52.053254] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:26:52.053543] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-22T21:26:52.053624] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-22T21:26:52.054139] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-22T21:26:52.054208] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-22T21:26:52.474126] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:26:52.530427] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-22T21:26:52.559491] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T21:26:52.580212] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T21:26:52.584024] [INFO ] [REMOTE ] STEW: Full fetch complete (22087 records). [2025-09-22T21:26:52.584103] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-22T21:26:52.965991] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-22T21:26:52.966070] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-22T21:26:52.966532] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-22T21:26:52.966590] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-22T21:26:52.967456] [DEBUG] [LOCAL ] STEW: Trimmed 22087 records to 16288 (keeping 200 days of data) [2025-09-22T21:26:53.076223] [DEBUG] [LOCAL ] STEW: Primary data saved (16288 records). [2025-09-22T21:26:53.076380] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-22T21:26:53.076510] [INFO ] [MAIN ] Update Progress: 2007/2372 symbols completed. STEW took 30.5s. Estimated remaining: 48m 31s. Rate: 7.5 symbols/min [2025-09-22T21:26:53.248054] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:26:53.308524] [DEBUG] [LOCAL ] STLA: Loaded 54326 existing records from primary storage. [2025-09-22T21:26:53.308705] [INFO ] [MAIN ] STLA: Loaded 54326 existing records. [2025-09-22T21:26:53.329344] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-22T21:26:53.415263] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T21:26:53.508488] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:26:53.508764] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-22T21:26:53.508821] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-22T21:26:53.510890] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-22T21:26:53.510953] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-22T21:26:53.861554] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:26:54.122084] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-22T21:26:54.922054] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-22T21:26:54.965137] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T21:26:55.147802] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T21:26:55.722061] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-22T21:26:56.522096] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-22T21:26:57.249107] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-22T21:26:57.271979] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-22T21:26:57.322054] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-22T21:26:57.421784] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T21:26:58.122173] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-22T21:26:58.922100] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-22T21:26:58.952598] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T21:26:59.351603] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T21:26:59.531459] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-22T21:26:59.722054] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-22T21:27:00.522055] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-22T21:27:00.883485] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-22T21:27:00.884460] [INFO ] [REMOTE ] STG: Full fetch complete (2497 records). [2025-09-22T21:27:00.884550] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-22T21:27:01.112550] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-22T21:27:01.112838] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:27:01.112920] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:27:01.113015] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-22T21:27:01.113107] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-22T21:27:01.113192] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-22T21:27:01.113273] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-22T21:27:01.113416] [INFO ] [MAIN ] Update Progress: 2008/2372 symbols completed. STG took 24.2s. Estimated remaining: 48m 24s. Rate: 7.5 symbols/min [2025-09-22T21:27:01.291085] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:27:01.322055] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-22T21:27:01.374711] [DEBUG] [LOCAL ] STM: Loaded 54368 existing records from primary storage. [2025-09-22T21:27:01.374896] [INFO ] [MAIN ] STM: Loaded 54368 existing records. [2025-09-22T21:27:01.557544] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:27:01.557797] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-22T21:27:01.557848] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-22T21:27:01.559023] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-22T21:27:01.559094] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-22T21:27:01.959220] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:27:02.122080] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-22T21:27:02.922115] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-22T21:27:04.465759] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-09-22T21:27:04.478204] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-22T21:27:05.032493] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-22T21:27:05.036185] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-22T21:27:05.642248] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (3.52 seconds). [2025-09-22T21:27:05.653333] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-22T21:27:05.825224] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T21:27:06.025609] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T21:27:06.122028] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-22T21:27:06.922094] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-22T21:27:07.630093] [DEBUG] [REMOTE ] STLA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:27:07.630450] [WARN ] [REMOTE ] STLA: No data returned for month 2025-02 [2025-09-22T21:27:07.637005] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T21:27:07.731854] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-22T21:27:07.737899] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-22T21:27:08.522088] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-22T21:27:09.322149] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-22T21:27:09.951797] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-22T21:27:10.025988] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T21:27:10.122065] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-22T21:27:10.510490] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-22T21:27:10.922074] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-22T21:27:10.973943] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T21:27:11.722055] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-22T21:27:12.522109] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-22T21:27:14.109592] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (7.99 seconds). [2025-09-22T21:27:14.118699] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (3.20 seconds). [2025-09-22T21:27:14.136865] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T21:27:14.134569] [INFO ] [REMOTE ] STEM: Full fetch complete (62887 records). [2025-09-22T21:27:14.137729] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-22T21:27:14.139116] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-22T21:27:14.155117] [INFO ] [REMOTE ] STK: Full fetch complete (13943 records). [2025-09-22T21:27:14.165157] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-22T21:27:14.915154] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-22T21:27:14.929114] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-22T21:27:14.940575] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-22T21:27:14.976144] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-22T21:27:14.976794] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-22T21:27:14.976897] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-22T21:27:14.977158] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-22T21:27:14.977293] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-22T21:27:14.978214] [DEBUG] [LOCAL ] STK: Trimmed 13943 records to 9385 (keeping 200 days of data) [2025-09-22T21:27:15.052813] [DEBUG] [LOCAL ] STEM: Trimmed 62887 records to 39998 (keeping 200 days of data) [2025-09-22T21:27:15.057185] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (3.34 seconds). [2025-09-22T21:27:15.073709] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-22T21:27:15.133525] [DEBUG] [LOCAL ] STK: Primary data saved (9385 records). [2025-09-22T21:27:15.143373] [INFO ] [MAIN ] STK: Full history saved. [2025-09-22T21:27:15.143991] [INFO ] [MAIN ] Update Progress: 2009/2372 symbols completed. STK took 23.5s. Estimated remaining: 48m 17s. Rate: 7.5 symbols/min [2025-09-22T21:27:15.497304] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:27:15.533800] [DEBUG] [LOCAL ] STN: Loaded 23504 existing records from primary storage. [2025-09-22T21:27:15.534896] [INFO ] [MAIN ] STN: Loaded 23504 existing records. [2025-09-22T21:27:15.704204] [DEBUG] [LOCAL ] STEM: Primary data saved (39998 records). [2025-09-22T21:27:15.711844] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-22T21:27:15.712006] [INFO ] [MAIN ] Update Progress: 2010/2372 symbols completed. STEM took 54.9s. Estimated remaining: 48m 7s. Rate: 7.5 symbols/min [2025-09-22T21:27:15.734630] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:27:15.784781] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-22T21:27:15.799268] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-22T21:27:15.826161] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-22T21:27:15.836460] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-22T21:27:16.024366] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:27:16.280491] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:27:16.281026] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-22T21:27:16.310274] [DEBUG] [LOCAL ] STNG: Loaded 44844 existing records from primary storage. [2025-09-22T21:27:16.310499] [INFO ] [MAIN ] STNG: Loaded 44844 existing records. [2025-09-22T21:27:16.449340] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-22T21:27:16.504019] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-22T21:27:16.534747] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:27:16.535032] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-22T21:27:16.535115] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-22T21:27:16.536268] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-22T21:27:16.536331] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-22T21:27:16.889749] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:27:16.890048] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-22T21:27:17.315751] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-22T21:27:17.325048] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T21:27:17.336100] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-22T21:27:18.122019] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-22T21:27:18.415283] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-22T21:27:18.444358] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T21:27:18.466929] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-22T21:27:18.922066] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-22T21:27:19.722077] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-22T21:27:19.828920] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T21:27:20.006797] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T21:27:20.522070] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-22T21:27:21.322032] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-22T21:27:21.727264] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-22T21:27:21.753282] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T21:27:22.122059] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-22T21:27:22.922064] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-22T21:27:23.553712] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T21:27:23.722054] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-22T21:27:24.015703] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-22T21:27:24.522028] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-22T21:27:24.662315] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T21:27:25.322028] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-22T21:27:25.730260] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T21:27:25.876603] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-22T21:27:26.122131] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-22T21:27:26.796103] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T21:27:26.922074] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-22T21:27:27.722063] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-22T21:27:28.523178] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-22T21:27:28.529533] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T21:27:28.635091] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-22T21:27:29.322066] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-22T21:27:29.466197] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T21:27:29.617044] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T21:27:30.122110] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-22T21:27:30.922034] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-22T21:27:31.109532] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T21:27:31.119440] [INFO ] [REMOTE ] STM: Full fetch complete (77525 records). [2025-09-22T21:27:31.119635] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-22T21:27:31.426015] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-22T21:27:31.558578] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-22T21:27:31.558945] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-22T21:27:31.560255] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-22T21:27:31.560321] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-22T21:27:31.565888] [DEBUG] [LOCAL ] STM: Trimmed 77525 records to 53588 (keeping 200 days of data) [2025-09-22T21:27:31.757251] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-22T21:27:31.918905] [DEBUG] [LOCAL ] STM: Primary data saved (53588 records). [2025-09-22T21:27:31.919084] [INFO ] [MAIN ] STM: Full history saved. [2025-09-22T21:27:31.919234] [INFO ] [MAIN ] Update Progress: 2011/2372 symbols completed. STM took 30.8s. Estimated remaining: 48m 1s. Rate: 7.5 symbols/min [2025-09-22T21:27:32.113509] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:27:32.128392] [DEBUG] [LOCAL ] STRV: Loaded 11850 existing records from primary storage. [2025-09-22T21:27:32.128529] [INFO ] [MAIN ] STRV: Loaded 11850 existing records. [2025-09-22T21:27:32.334421] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:27:32.334817] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-22T21:27:32.334875] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-22T21:27:32.335528] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-22T21:27:32.335590] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-22T21:27:32.523529] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-22T21:27:32.731073] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:27:32.874157] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-22T21:27:32.883313] [INFO ] [REMOTE ] STLA: Full fetch complete (70146 records). [2025-09-22T21:27:32.883472] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-22T21:27:33.097123] [WARN ] [VALIDATOR ] STLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-22T21:27:33.100257] [FATAL] [MAIN ] STLA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:27:33.100475] [WARN ] [MAIN ] STLA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:27:33.105906] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-22T21:27:33.114664] [DEBUG] [LOCAL ] STLA: No primary data file found to delete. [2025-09-22T21:27:33.114811] [INFO ] [LOCAL ] STLA: Starting deletion of derivative data. [2025-09-22T21:27:33.116104] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T21:27:33.121386] [DEBUG] [LOCAL ] STLA: Deleted derivative data file. [2025-09-22T21:27:33.122186] [INFO ] [MAIN ] Update Progress: 2012/2372 symbols completed. STLA took 40.0s. Estimated remaining: 47m 52s. Rate: 7.5 symbols/min [2025-09-22T21:27:33.306499] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:27:33.322064] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-22T21:27:33.378483] [DEBUG] [LOCAL ] STT: Loaded 51945 existing records from primary storage. [2025-09-22T21:27:33.378666] [INFO ] [MAIN ] STT: Loaded 51945 existing records. [2025-09-22T21:27:33.573865] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:27:33.574145] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-22T21:27:33.574201] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-22T21:27:33.575390] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-22T21:27:33.575452] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-22T21:27:33.950071] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:27:34.036266] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-22T21:27:34.056285] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T21:27:34.060363] [INFO ] [REMOTE ] STN: Full fetch complete (32273 records). [2025-09-22T21:27:34.060438] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-22T21:27:34.127125] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-22T21:27:34.430919] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-22T21:27:34.430996] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-22T21:27:34.431675] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-22T21:27:34.431735] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-22T21:27:34.432456] [DEBUG] [LOCAL ] STN: Trimmed 32273 records to 23062 (keeping 200 days of data) [2025-09-22T21:27:34.579993] [DEBUG] [LOCAL ] STN: Primary data saved (23062 records). [2025-09-22T21:27:34.580123] [INFO ] [MAIN ] STN: Full history saved. [2025-09-22T21:27:34.580204] [INFO ] [MAIN ] Update Progress: 2013/2372 symbols completed. STN took 19.4s. Estimated remaining: 47m 43s. Rate: 7.5 symbols/min [2025-09-22T21:27:34.748510] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:27:34.748710] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-22T21:27:34.748764] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-22T21:27:34.748903] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-22T21:27:34.748944] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-22T21:27:34.748984] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-22T21:27:34.749014] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-22T21:27:34.935099] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-22T21:27:35.117387] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:27:35.248703] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T21:27:35.722084] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-22T21:27:36.522090] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-22T21:27:36.669287] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T21:27:37.115625] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T21:27:37.322090] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-22T21:27:37.444923] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T21:27:37.527556] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:27:37.528066] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-22T21:27:38.122097] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-22T21:27:38.922126] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-22T21:27:39.722107] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-22T21:27:39.993669] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T21:27:40.419337] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T21:27:40.522671] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-09-22T21:27:40.527273] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T21:27:40.782393] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:27:40.782751] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-09-22T21:27:41.322083] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-02. [2025-09-22T21:27:41.566692] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:27:41.567037] [WARN ] [REMOTE ] STUB: No data returned for month 2025-02 [2025-09-22T21:27:42.122077] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-22T21:27:42.922071] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-22T21:27:43.722114] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-22T21:27:43.761129] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T21:27:44.522086] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-22T21:27:44.616636] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T21:27:44.812971] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T21:27:45.322091] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-22T21:27:46.122093] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-22T21:27:46.271888] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T21:27:46.865573] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T21:27:46.922051] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-22T21:27:47.129949] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T21:27:47.722074] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-22T21:27:48.327083] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T21:27:48.334334] [INFO ] [REMOTE ] STNG: Full fetch complete (64416 records). [2025-09-22T21:27:48.334530] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-22T21:27:48.564770] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-03. [2025-09-22T21:27:48.747195] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T21:27:48.804105] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-22T21:27:48.804192] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-22T21:27:48.805311] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-22T21:27:48.805389] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-22T21:27:48.806756] [DEBUG] [LOCAL ] STNG: Trimmed 64416 records to 44049 (keeping 200 days of data) [2025-09-22T21:27:48.864046] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:27:48.900497] [WARN ] [REMOTE ] STUB: No data returned for month 2025-03 [2025-09-22T21:27:49.087978] [DEBUG] [LOCAL ] STNG: Primary data saved (44049 records). [2025-09-22T21:27:49.088113] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-22T21:27:49.088198] [INFO ] [MAIN ] Update Progress: 2014/2372 symbols completed. STNG took 33.4s. Estimated remaining: 47m 36s. Rate: 7.5 symbols/min [2025-09-22T21:27:49.257417] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:27:49.284300] [DEBUG] [LOCAL ] STVN: Loaded 26950 existing records from primary storage. [2025-09-22T21:27:49.284456] [INFO ] [MAIN ] STVN: Loaded 26950 existing records. [2025-09-22T21:27:49.327232] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-22T21:27:49.466564] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:27:49.466805] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-22T21:27:49.466855] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-22T21:27:49.467502] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-22T21:27:49.467561] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-22T21:27:49.817943] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:27:50.122125] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-04. [2025-09-22T21:27:50.329524] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:27:50.329891] [WARN ] [REMOTE ] STUB: No data returned for month 2025-04 [2025-09-22T21:27:50.922027] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-22T21:27:51.154231] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T21:27:51.722098] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-22T21:27:51.783200] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T21:27:52.522065] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-22T21:27:53.254324] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T21:27:53.322074] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-22T21:27:53.466392] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-22T21:27:54.122056] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-22T21:27:54.143561] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T21:27:54.922124] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-22T21:27:55.575572] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-22T21:27:55.579103] [INFO ] [REMOTE ] STRV: Full fetch complete (18616 records). [2025-09-22T21:27:55.579335] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-22T21:27:55.731374] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-22T21:27:55.978541] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-22T21:27:55.978768] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-22T21:27:55.979346] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-22T21:27:55.979425] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-22T21:27:55.980199] [DEBUG] [LOCAL ] STRV: Trimmed 18616 records to 11643 (keeping 200 days of data) [2025-09-22T21:27:56.062177] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T21:27:56.093430] [DEBUG] [LOCAL ] STRV: Primary data saved (11643 records). [2025-09-22T21:27:56.093561] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-22T21:27:56.093667] [INFO ] [MAIN ] Update Progress: 2015/2372 symbols completed. STRV took 24.2s. Estimated remaining: 47m 28s. Rate: 7.5 symbols/min [2025-09-22T21:27:56.274089] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:27:56.331404] [DEBUG] [LOCAL ] STWD: Loaded 52662 existing records from primary storage. [2025-09-22T21:27:56.331562] [INFO ] [MAIN ] STWD: Loaded 52662 existing records. [2025-09-22T21:27:56.512813] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:27:56.513104] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-22T21:27:56.513155] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-22T21:27:56.514533] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-22T21:27:56.514596] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-22T21:27:56.527725] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-22T21:27:56.888710] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:27:56.971888] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T21:27:57.322112] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-22T21:27:58.122149] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-22T21:27:58.418130] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T21:27:58.602577] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T21:27:58.922100] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-22T21:27:59.722174] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-05. [2025-09-22T21:27:59.933218] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:27:59.945045] [WARN ] [REMOTE ] STUB: No data returned for month 2025-05 [2025-09-22T21:27:59.946727] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T21:28:00.487533] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T21:28:00.522037] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-22T21:28:01.322056] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-06. [2025-09-22T21:28:01.523989] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:28:01.524322] [WARN ] [REMOTE ] STUB: No data returned for month 2025-06 [2025-09-22T21:28:02.121129] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T21:28:02.128350] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-22T21:28:02.135950] [INFO ] [REMOTE ] STT: Full fetch complete (74620 records). [2025-09-22T21:28:02.136189] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-22T21:28:02.566758] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-22T21:28:02.566914] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-22T21:28:02.568750] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-22T21:28:02.568824] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-22T21:28:02.570793] [DEBUG] [LOCAL ] STT: Trimmed 74620 records to 51136 (keeping 200 days of data) [2025-09-22T21:28:02.924377] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-22T21:28:02.932999] [DEBUG] [LOCAL ] STT: Primary data saved (51136 records). [2025-09-22T21:28:02.933272] [INFO ] [MAIN ] STT: Full history saved. [2025-09-22T21:28:02.933581] [INFO ] [MAIN ] Update Progress: 2016/2372 symbols completed. STT took 29.8s. Estimated remaining: 47m 19s. Rate: 7.5 symbols/min [2025-09-22T21:28:03.121463] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:28:03.124862] [DEBUG] [LOCAL ] STXD: Loaded 1378 existing records from primary storage. [2025-09-22T21:28:03.124937] [INFO ] [MAIN ] STXD: Loaded 1378 existing records. [2025-09-22T21:28:03.309212] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:28:03.309553] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-22T21:28:03.309609] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-22T21:28:03.309897] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-22T21:28:03.309959] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-22T21:28:03.696807] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:28:03.722015] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-22T21:28:03.903979] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T21:28:04.011408] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T21:28:04.181127] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-22T21:28:04.522077] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-22T21:28:04.980307] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T21:28:05.322068] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-22T21:28:05.911480] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T21:28:06.122060] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-07. [2025-09-22T21:28:06.353093] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:28:06.353532] [WARN ] [REMOTE ] STUB: No data returned for month 2025-07 [2025-09-22T21:28:06.922061] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-08. [2025-09-22T21:28:07.160313] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:28:07.160798] [WARN ] [REMOTE ] STUB: No data returned for month 2025-08 [2025-09-22T21:28:07.722073] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-22T21:28:08.522016] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-09. [2025-09-22T21:28:08.810491] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T21:28:09.322058] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-22T21:28:09.440319] [INFO ] [REMOTE ] STUB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-22T21:28:09.442907] [INFO ] [REMOTE ] STUB: Full fetch complete (1395 records). [2025-09-22T21:28:09.442974] [DEBUG] [VALIDATOR ] STUB: Validating primary data. [2025-09-22T21:28:09.637806] [WARN ] [VALIDATOR ] STUB: Validation failed - insufficient historical data. Have 4 unique days, need 200 days [2025-09-22T21:28:09.638015] [FATAL] [MAIN ] STUB: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:28:09.638100] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:28:09.638239] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-22T21:28:09.638335] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-22T21:28:09.638398] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-22T21:28:09.638486] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-22T21:28:09.638609] [INFO ] [MAIN ] Update Progress: 2017/2372 symbols completed. STUB took 35.1s. Estimated remaining: 47m 11s. Rate: 7.5 symbols/min [2025-09-22T21:28:09.821877] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:28:09.826839] [DEBUG] [LOCAL ] STXE: Loaded 2277 existing records from primary storage. [2025-09-22T21:28:09.826975] [INFO ] [MAIN ] STXE: Loaded 2277 existing records. [2025-09-22T21:28:09.930494] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T21:28:10.025297] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:28:10.025603] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-22T21:28:10.025685] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-22T21:28:10.025909] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-22T21:28:10.025971] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-22T21:28:10.127210] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-22T21:28:10.402099] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:28:10.608435] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-22T21:28:10.922057] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-22T21:28:11.722074] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-22T21:28:12.522060] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-22T21:28:12.646988] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-22T21:28:12.853110] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-22T21:28:12.869020] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-22T21:28:13.322060] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-22T21:28:14.122045] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-22T21:28:14.460606] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-22T21:28:14.922066] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-22T21:28:15.046328] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T21:28:15.722050] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-22T21:28:15.800215] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T21:28:16.284858] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-22T21:28:16.522064] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-22T21:28:17.096915] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T21:28:17.322058] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-22T21:28:18.122075] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-22T21:28:18.486669] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-22T21:28:18.922076] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-22T21:28:19.217373] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T21:28:19.271258] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-22T21:28:19.722104] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-22T21:28:20.522087] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-22T21:28:20.867103] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-22T21:28:20.867917] [INFO ] [REMOTE ] STXD: Full fetch complete (2077 records). [2025-09-22T21:28:20.867985] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-22T21:28:21.238133] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-22T21:28:21.238317] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-22T21:28:21.238449] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-22T21:28:21.238489] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-22T21:28:21.238899] [DEBUG] [LOCAL ] STXD: Trimmed 2077 records to 1330 (keeping 200 days of data) [2025-09-22T21:28:21.248182] [DEBUG] [LOCAL ] STXD: Primary data saved (1330 records). [2025-09-22T21:28:21.248253] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-22T21:28:21.248341] [INFO ] [MAIN ] Update Progress: 2018/2372 symbols completed. STXD took 18.3s. Estimated remaining: 47m 4s. Rate: 7.5 symbols/min [2025-09-22T21:28:21.327260] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-22T21:28:21.442334] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:28:21.448529] [DEBUG] [LOCAL ] STXG: Loaded 2705 existing records from primary storage. [2025-09-22T21:28:21.448689] [INFO ] [MAIN ] STXG: Loaded 2705 existing records. [2025-09-22T21:28:21.711146] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-22T21:28:21.748814] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:28:21.766837] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-22T21:28:21.767269] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-22T21:28:21.768466] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-22T21:28:21.768811] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-22T21:28:22.127428] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-22T21:28:22.364664] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:28:22.488281] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T21:28:22.525147] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-22T21:28:22.922109] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-22T21:28:23.722094] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-22T21:28:24.069693] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T21:28:24.211519] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-22T21:28:24.522070] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-22T21:28:25.322080] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-22T21:28:26.122025] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-22T21:28:26.185846] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T21:28:26.515321] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T21:28:26.649304] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-22T21:28:26.922071] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-22T21:28:27.722074] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-22T21:28:28.025105] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-22T21:28:28.030269] [INFO ] [REMOTE ] STVN: Full fetch complete (39242 records). [2025-09-22T21:28:28.030370] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-22T21:28:28.137282] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-22T21:28:28.423212] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-22T21:28:28.423348] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-22T21:28:28.424234] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-22T21:28:28.424300] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-22T21:28:28.425453] [DEBUG] [LOCAL ] STVN: Trimmed 39242 records to 26415 (keeping 200 days of data) [2025-09-22T21:28:28.522584] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-22T21:28:28.588360] [DEBUG] [LOCAL ] STVN: Primary data saved (26415 records). [2025-09-22T21:28:28.588509] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-22T21:28:28.588597] [INFO ] [MAIN ] Update Progress: 2019/2372 symbols completed. STVN took 39.5s. Estimated remaining: 46m 56s. Rate: 7.5 symbols/min [2025-09-22T21:28:28.761592] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:28:28.764900] [DEBUG] [LOCAL ] STXK: Loaded 1547 existing records from primary storage. [2025-09-22T21:28:28.764974] [INFO ] [MAIN ] STXK: Loaded 1547 existing records. [2025-09-22T21:28:28.946838] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:28:28.947117] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-22T21:28:28.947168] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-22T21:28:28.947385] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-22T21:28:28.947445] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-22T21:28:29.226634] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-22T21:28:29.328471] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-22T21:28:29.328334] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:28:29.903610] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T21:28:30.122076] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-22T21:28:30.664631] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-22T21:28:30.922055] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-22T21:28:31.722079] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-22T21:28:32.214518] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-22T21:28:32.528854] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-22T21:28:32.557510] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T21:28:33.017166] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-22T21:28:33.322036] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-22T21:28:33.913747] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-22T21:28:34.122076] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-22T21:28:34.620038] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-22T21:28:34.922060] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-22T21:28:35.372904] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T21:28:35.722070] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-22T21:28:36.194928] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-22T21:28:36.522078] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-22T21:28:36.976561] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-22T21:28:37.322067] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-22T21:28:37.763287] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T21:28:38.122065] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-22T21:28:38.548174] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-22T21:28:38.922098] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-22T21:28:39.366849] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-22T21:28:39.367820] [INFO ] [REMOTE ] STXE: Full fetch complete (3703 records). [2025-09-22T21:28:39.367889] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-22T21:28:39.726190] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-22T21:28:39.725904] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-22T21:28:39.726501] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-22T21:28:39.727631] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-22T21:28:39.727728] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-22T21:28:39.728116] [DEBUG] [LOCAL ] STXE: Trimmed 3703 records to 2217 (keeping 200 days of data) [2025-09-22T21:28:39.742728] [DEBUG] [LOCAL ] STXE: Primary data saved (2217 records). [2025-09-22T21:28:39.742807] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-22T21:28:39.742886] [INFO ] [MAIN ] Update Progress: 2020/2372 symbols completed. STXE took 30.1s. Estimated remaining: 46m 48s. Rate: 7.5 symbols/min [2025-09-22T21:28:39.919393] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:28:39.919587] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-22T21:28:39.919623] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-22T21:28:39.919787] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-22T21:28:39.919830] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-22T21:28:39.919870] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-22T21:28:39.919903] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-22T21:28:40.282620] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:28:40.522070] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-22T21:28:40.885231] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-22T21:28:41.322039] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-22T21:28:41.628262] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T21:28:41.763190] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T21:28:42.122079] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-22T21:28:42.551889] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-22T21:28:42.922069] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-22T21:28:43.722067] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-22T21:28:44.155637] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-22T21:28:44.509111] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T21:28:44.519172] [INFO ] [REMOTE ] STWD: Full fetch complete (74924 records). [2025-09-22T21:28:44.519312] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-22T21:28:44.527331] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-22T21:28:44.934533] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-22T21:28:44.934687] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-22T21:28:44.936402] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-22T21:28:44.936479] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-22T21:28:44.938131] [DEBUG] [LOCAL ] STWD: Trimmed 74924 records to 51899 (keeping 200 days of data) [2025-09-22T21:28:45.163069] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T21:28:45.277878] [DEBUG] [LOCAL ] STWD: Primary data saved (51899 records). [2025-09-22T21:28:45.278060] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-22T21:28:45.278157] [INFO ] [MAIN ] Update Progress: 2021/2372 symbols completed. STWD took 49.2s. Estimated remaining: 46m 40s. Rate: 7.5 symbols/min [2025-09-22T21:28:45.327164] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-22T21:28:45.463954] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:28:45.469787] [DEBUG] [LOCAL ] STXT: Loaded 2655 existing records from primary storage. [2025-09-22T21:28:45.469894] [INFO ] [MAIN ] STXT: Loaded 2655 existing records. [2025-09-22T21:28:45.656813] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:28:45.657150] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-22T21:28:45.657212] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-22T21:28:45.657680] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-22T21:28:45.657742] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-22T21:28:45.952381] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-22T21:28:46.034799] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:28:46.122021] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-22T21:28:46.735804] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-22T21:28:46.922026] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-22T21:28:47.446748] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-22T21:28:47.722069] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-22T21:28:48.144409] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T21:28:48.522065] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-22T21:28:48.999788] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-22T21:28:49.322057] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-22T21:28:49.865098] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-22T21:28:50.122081] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-22T21:28:50.581149] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-22T21:28:50.922110] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-22T21:28:51.345985] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-22T21:28:51.722115] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-22T21:28:52.152978] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-22T21:28:52.153936] [INFO ] [REMOTE ] STXG: Full fetch complete (4201 records). [2025-09-22T21:28:52.154005] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-22T21:28:52.513108] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-22T21:28:52.513294] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-22T21:28:52.513440] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-22T21:28:52.513480] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-22T21:28:52.513892] [DEBUG] [LOCAL ] STXG: Trimmed 4201 records to 2612 (keeping 200 days of data) [2025-09-22T21:28:52.522351] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-22T21:28:52.532433] [DEBUG] [LOCAL ] STXG: Primary data saved (2612 records). [2025-09-22T21:28:52.532610] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-22T21:28:52.532780] [INFO ] [MAIN ] Update Progress: 2022/2372 symbols completed. STXG took 31.3s. Estimated remaining: 46m 32s. Rate: 7.5 symbols/min [2025-09-22T21:28:52.701628] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:28:52.704950] [DEBUG] [LOCAL ] STXV: Loaded 1708 existing records from primary storage. [2025-09-22T21:28:52.705041] [INFO ] [MAIN ] STXV: Loaded 1708 existing records. [2025-09-22T21:28:52.882517] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:28:52.882789] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-22T21:28:52.882841] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-22T21:28:52.883023] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-22T21:28:52.883082] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-22T21:28:53.098835] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T21:28:53.248229] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:28:53.322001] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-22T21:28:53.769693] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-22T21:28:54.122115] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-22T21:28:54.458476] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-22T21:28:54.922102] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-22T21:28:55.368970] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-22T21:28:55.722065] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-22T21:28:56.165051] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-22T21:28:56.522064] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-22T21:28:56.980164] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-22T21:28:57.322063] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-22T21:28:57.769546] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-22T21:28:58.122060] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-22T21:28:58.554302] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T21:28:58.922057] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-22T21:28:59.284970] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-22T21:28:59.722114] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-22T21:29:00.161464] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T21:29:00.522114] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-22T21:29:00.953913] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-22T21:29:01.322064] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-22T21:29:01.790498] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-22T21:29:02.122069] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-22T21:29:02.539578] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T21:29:02.922159] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-22T21:29:03.373297] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-22T21:29:03.722060] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-22T21:29:04.035132] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-22T21:29:04.522044] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-22T21:29:04.957289] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T21:29:05.322065] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-22T21:29:05.654782] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-22T21:29:06.122055] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-22T21:29:06.506462] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-22T21:29:06.507335] [INFO ] [REMOTE ] STXV: Full fetch complete (2629 records). [2025-09-22T21:29:06.507402] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-22T21:29:06.880563] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-22T21:29:06.880695] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-22T21:29:06.880842] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-22T21:29:06.880904] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-22T21:29:06.881438] [DEBUG] [LOCAL ] STXV: Trimmed 2629 records to 1659 (keeping 200 days of data) [2025-09-22T21:29:06.893318] [DEBUG] [LOCAL ] STXV: Primary data saved (1659 records). [2025-09-22T21:29:06.893380] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-22T21:29:06.893529] [INFO ] [MAIN ] Update Progress: 2023/2372 symbols completed. STXV took 14.4s. Estimated remaining: 46m 25s. Rate: 7.5 symbols/min [2025-09-22T21:29:06.927245] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-22T21:29:07.065904] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:29:07.133067] [DEBUG] [LOCAL ] STZ: Loaded 53045 existing records from primary storage. [2025-09-22T21:29:07.133237] [INFO ] [MAIN ] STZ: Loaded 53045 existing records. [2025-09-22T21:29:07.346577] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:29:07.346914] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-22T21:29:07.346980] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-22T21:29:07.348915] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-22T21:29:07.348980] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-22T21:29:07.651089] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-22T21:29:07.730783] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:29:07.727530] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-22T21:29:08.075492] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-22T21:29:08.522047] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-22T21:29:08.851821] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-22T21:29:08.852808] [INFO ] [REMOTE ] STXM: Full fetch complete (1453 records). [2025-09-22T21:29:08.852914] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-22T21:29:09.040055] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-22T21:29:09.040240] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:29:09.040315] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:29:09.040388] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-22T21:29:09.040478] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-22T21:29:09.040535] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-22T21:29:09.040597] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-22T21:29:09.040727] [INFO ] [MAIN ] Update Progress: 2024/2372 symbols completed. STXM took 29.3s. Estimated remaining: 46m 16s. Rate: 7.5 symbols/min [2025-09-22T21:29:09.214331] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:29:09.299924] [DEBUG] [LOCAL ] SU: Loaded 54240 existing records from primary storage. [2025-09-22T21:29:09.300095] [INFO ] [MAIN ] SU: Loaded 54240 existing records. [2025-09-22T21:29:09.327259] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-22T21:29:09.497583] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:29:09.497978] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-22T21:29:09.498062] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-22T21:29:09.499398] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-22T21:29:09.499473] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-22T21:29:09.858375] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:29:10.122113] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-22T21:29:10.556036] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-22T21:29:10.922133] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-22T21:29:11.317055] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-22T21:29:11.450086] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-22T21:29:11.722122] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-22T21:29:12.522148] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-22T21:29:12.861243] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-22T21:29:13.322119] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-22T21:29:13.386767] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T21:29:13.762013] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-22T21:29:13.763028] [INFO ] [REMOTE ] STXT: Full fetch complete (4045 records). [2025-09-22T21:29:13.763110] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-22T21:29:14.139573] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-22T21:29:14.131274] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-22T21:29:14.139796] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-22T21:29:14.140145] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-22T21:29:14.142318] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-22T21:29:14.142948] [DEBUG] [LOCAL ] STXT: Trimmed 4045 records to 2590 (keeping 200 days of data) [2025-09-22T21:29:14.164239] [DEBUG] [LOCAL ] STXT: Primary data saved (2590 records). [2025-09-22T21:29:14.164319] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-22T21:29:14.164492] [INFO ] [MAIN ] Update Progress: 2025/2372 symbols completed. STXT took 28.9s. Estimated remaining: 46m 7s. Rate: 7.5 symbols/min [2025-09-22T21:29:14.343767] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:29:14.406932] [DEBUG] [LOCAL ] SUI: Loaded 42841 existing records from primary storage. [2025-09-22T21:29:14.407078] [INFO ] [MAIN ] SUI: Loaded 42841 existing records. [2025-09-22T21:29:14.586879] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:29:14.587156] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-22T21:29:14.587214] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-22T21:29:14.588373] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-22T21:29:14.588435] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-22T21:29:14.927328] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-22T21:29:14.961948] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:29:15.722133] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-22T21:29:16.112582] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-22T21:29:16.522055] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-22T21:29:16.775289] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-22T21:29:16.953312] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-22T21:29:17.322078] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-22T21:29:17.364213] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T21:29:17.718288] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-22T21:29:17.719202] [INFO ] [REMOTE ] STXK: Full fetch complete (2431 records). [2025-09-22T21:29:17.719287] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-22T21:29:18.084682] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-22T21:29:18.084769] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-22T21:29:18.084870] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-22T21:29:18.084916] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-22T21:29:18.085278] [DEBUG] [LOCAL ] STXK: Trimmed 2431 records to 1510 (keeping 200 days of data) [2025-09-22T21:29:18.096420] [DEBUG] [LOCAL ] STXK: Primary data saved (1510 records). [2025-09-22T21:29:18.096495] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-22T21:29:18.096632] [INFO ] [MAIN ] Update Progress: 2026/2372 symbols completed. STXK took 49.5s. Estimated remaining: 45m 59s. Rate: 7.5 symbols/min [2025-09-22T21:29:18.128272] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-22T21:29:18.273524] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:29:18.340370] [DEBUG] [LOCAL ] SUN: Loaded 37807 existing records from primary storage. [2025-09-22T21:29:18.340552] [INFO ] [MAIN ] SUN: Loaded 37807 existing records. [2025-09-22T21:29:18.544526] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:29:18.544933] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-22T21:29:18.545035] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-22T21:29:18.546772] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-22T21:29:18.546867] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-22T21:29:18.918626] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:29:18.922001] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-22T21:29:19.722077] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-22T21:29:19.754267] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T21:29:20.150598] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-22T21:29:20.522159] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-22T21:29:21.322058] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-22T21:29:21.750063] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-22T21:29:22.122033] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-22T21:29:22.193054] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T21:29:22.618314] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-22T21:29:22.922109] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-22T21:29:23.670488] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T21:29:23.722078] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-22T21:29:24.522049] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-22T21:29:24.843767] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T21:29:25.322095] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-22T21:29:25.753371] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-22T21:29:26.081224] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T21:29:26.122040] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-22T21:29:26.922026] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-22T21:29:27.432843] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-22T21:29:27.550382] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T21:29:27.722040] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-22T21:29:28.394284] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T21:29:28.522048] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-22T21:29:29.322062] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-22T21:29:29.626401] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T21:29:30.122045] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-22T21:29:30.466109] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T21:29:30.614541] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T21:29:30.922060] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-22T21:29:31.623252] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T21:29:31.722074] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-22T21:29:32.505032] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:29:32.522024] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-22T21:29:33.212191] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T21:29:33.322067] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-22T21:29:34.112529] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T21:29:34.121996] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-22T21:29:34.848318] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T21:29:34.922019] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-22T21:29:35.684355] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T21:29:35.722068] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-22T21:29:36.512744] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T21:29:36.522023] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-22T21:29:37.322021] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-22T21:29:37.398665] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T21:29:37.779840] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T21:29:38.122071] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-22T21:29:38.674874] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T21:29:38.681137] [INFO ] [REMOTE ] SUN: Full fetch complete (54358 records). [2025-09-22T21:29:38.681261] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-22T21:29:38.934024] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-22T21:29:39.076377] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-22T21:29:39.076465] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-22T21:29:39.077589] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-22T21:29:39.077680] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-22T21:29:39.078938] [DEBUG] [LOCAL ] SUN: Trimmed 54358 records to 37290 (keeping 200 days of data) [2025-09-22T21:29:39.318066] [DEBUG] [LOCAL ] SUN: Primary data saved (37290 records). [2025-09-22T21:29:39.318488] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-22T21:29:39.318602] [INFO ] [MAIN ] Update Progress: 2027/2372 symbols completed. SUN took 21.2s. Estimated remaining: 45m 53s. Rate: 7.5 symbols/min [2025-09-22T21:29:39.492158] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:29:39.539124] [DEBUG] [LOCAL ] SUPV: Loaded 47686 existing records from primary storage. [2025-09-22T21:29:39.539337] [INFO ] [MAIN ] SUPV: Loaded 47686 existing records. [2025-09-22T21:29:39.719553] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:29:39.719910] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-22T21:29:39.719962] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-22T21:29:39.721525] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-22T21:29:39.721587] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-22T21:29:39.753523] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-22T21:29:40.097438] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:29:40.165570] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-22T21:29:40.522057] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-22T21:29:40.928212] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-22T21:29:41.322074] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-22T21:29:41.386755] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T21:29:41.922063] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T21:29:42.122026] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-22T21:29:42.922104] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-22T21:29:43.368560] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-22T21:29:43.454122] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T21:29:43.722058] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-22T21:29:44.274214] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T21:29:44.281413] [INFO ] [REMOTE ] SUI: Full fetch complete (61162 records). [2025-09-22T21:29:44.281553] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-22T21:29:44.527147] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-22T21:29:44.693943] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-22T21:29:44.694041] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-22T21:29:44.695077] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-22T21:29:44.695138] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-22T21:29:44.696413] [DEBUG] [LOCAL ] SUI: Trimmed 61162 records to 42116 (keeping 200 days of data) [2025-09-22T21:29:44.971202] [DEBUG] [LOCAL ] SUI: Primary data saved (42116 records). [2025-09-22T21:29:44.971331] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-22T21:29:44.971424] [INFO ] [MAIN ] Update Progress: 2028/2372 symbols completed. SUI took 30.8s. Estimated remaining: 45m 45s. Rate: 7.5 symbols/min [2025-09-22T21:29:45.144687] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:29:45.190687] [DEBUG] [LOCAL ] SUZ: Loaded 46596 existing records from primary storage. [2025-09-22T21:29:45.190832] [INFO ] [MAIN ] SUZ: Loaded 46596 existing records. [2025-09-22T21:29:45.332828] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-22T21:29:45.375022] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:29:45.375222] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-22T21:29:45.375270] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-22T21:29:45.376327] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-22T21:29:45.376389] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-22T21:29:45.749453] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:29:45.872999] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-22T21:29:46.122120] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-22T21:29:46.447528] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T21:29:46.922082] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-22T21:29:47.270795] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-22T21:29:47.722090] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-22T21:29:48.082808] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T21:29:48.522060] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-22T21:29:48.548696] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T21:29:48.557091] [INFO ] [REMOTE ] SU: Full fetch complete (77400 records). [2025-09-22T21:29:48.557249] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-22T21:29:48.964542] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-22T21:29:48.964895] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-22T21:29:48.966254] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-22T21:29:48.966348] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-22T21:29:48.968142] [DEBUG] [LOCAL ] SU: Trimmed 77400 records to 53459 (keeping 200 days of data) [2025-09-22T21:29:49.108241] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T21:29:49.322492] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-22T21:29:49.349733] [DEBUG] [LOCAL ] SU: Primary data saved (53459 records). [2025-09-22T21:29:49.349843] [INFO ] [MAIN ] SU: Full history saved. [2025-09-22T21:29:49.349938] [INFO ] [MAIN ] Update Progress: 2029/2372 symbols completed. SU took 40.3s. Estimated remaining: 45m 36s. Rate: 7.5 symbols/min [2025-09-22T21:29:49.520167] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:29:49.558167] [DEBUG] [LOCAL ] SVV: Loaded 40046 existing records from primary storage. [2025-09-22T21:29:49.558307] [INFO ] [MAIN ] SVV: Loaded 40046 existing records. [2025-09-22T21:29:49.737290] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:29:49.737560] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-22T21:29:49.737620] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-22T21:29:49.738509] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-22T21:29:49.738569] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-22T21:29:50.098818] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:29:50.121997] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-22T21:29:50.375410] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T21:29:50.383892] [INFO ] [REMOTE ] STZ: Full fetch complete (75696 records). [2025-09-22T21:29:50.384047] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-22T21:29:50.788396] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-22T21:29:50.803390] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-22T21:29:50.804740] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-22T21:29:50.804824] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-22T21:29:50.818723] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T21:29:50.830181] [DEBUG] [LOCAL ] STZ: Trimmed 75696 records to 52271 (keeping 200 days of data) [2025-09-22T21:29:50.934460] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-22T21:29:51.115151] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T21:29:51.237031] [DEBUG] [LOCAL ] STZ: Primary data saved (52271 records). [2025-09-22T21:29:51.237225] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-22T21:29:51.238918] [INFO ] [MAIN ] Update Progress: 2030/2372 symbols completed. STZ took 44.3s. Estimated remaining: 45m 27s. Rate: 7.5 symbols/min [2025-09-22T21:29:51.431002] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:29:51.502351] [DEBUG] [LOCAL ] SW: Loaded 53944 existing records from primary storage. [2025-09-22T21:29:51.502544] [INFO ] [MAIN ] SW: Loaded 53944 existing records. [2025-09-22T21:29:51.687320] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:29:51.687597] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-22T21:29:51.687667] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-22T21:29:51.688840] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-22T21:29:51.688899] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-22T21:29:51.731320] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-22T21:29:52.112530] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:29:52.409599] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T21:29:52.522083] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-22T21:29:53.322080] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-22T21:29:53.386183] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T21:29:54.069270] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T21:29:54.122072] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-22T21:29:54.846463] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T21:29:54.922106] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-22T21:29:55.337897] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-22T21:29:55.722100] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-22T21:29:56.299282] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-22T21:29:56.522057] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-22T21:29:57.303360] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T21:29:57.322001] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-22T21:29:57.797680] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T21:29:58.122065] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-22T21:29:58.922084] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-22T21:29:58.972196] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T21:29:59.483849] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T21:29:59.722068] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-22T21:30:00.449979] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T21:30:00.522058] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-22T21:30:01.322066] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-22T21:30:01.730702] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-22T21:30:01.958798] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T21:30:02.122072] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-22T21:30:02.922055] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-22T21:30:03.722099] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-22T21:30:04.610210] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (3.29 seconds). [2025-09-22T21:30:04.620771] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-22T21:30:05.853477] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-22T21:30:05.863976] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-22T21:30:05.900989] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (3.78 seconds). [2025-09-22T21:30:06.122180] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-22T21:30:06.299765] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T21:30:06.922160] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-22T21:30:07.233150] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (3.51 seconds). [2025-09-22T21:30:07.607604] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T21:30:07.615831] [INFO ] [REMOTE ] SUPV: Full fetch complete (68100 records). [2025-09-22T21:30:07.615976] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-22T21:30:07.724447] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-22T21:30:07.990002] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-22T21:30:08.107061] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-22T21:30:08.107262] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-22T21:30:08.109622] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-22T21:30:08.109763] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-22T21:30:08.112122] [DEBUG] [LOCAL ] SUPV: Trimmed 68100 records to 47109 (keeping 200 days of data) [2025-09-22T21:30:08.473812] [DEBUG] [LOCAL ] SUPV: Primary data saved (47109 records). [2025-09-22T21:30:08.474000] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-22T21:30:08.474125] [INFO ] [MAIN ] Update Progress: 2031/2372 symbols completed. SUPV took 29.2s. Estimated remaining: 45m 21s. Rate: 7.5 symbols/min [2025-09-22T21:30:08.525827] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-22T21:30:08.717264] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T21:30:08.810332] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:30:08.867939] [DEBUG] [LOCAL ] SWK: Loaded 53276 existing records from primary storage. [2025-09-22T21:30:08.868149] [INFO ] [MAIN ] SWK: Loaded 53276 existing records. [2025-09-22T21:30:09.135369] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:30:09.135782] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-22T21:30:09.135862] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-22T21:30:09.137874] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-22T21:30:09.137958] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-22T21:30:09.326254] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-22T21:30:09.636991] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:30:09.669805] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T21:30:10.016879] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T21:30:10.122078] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-22T21:30:10.922118] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-22T21:30:11.062915] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T21:30:11.493691] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T21:30:11.722074] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-22T21:30:12.522139] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-22T21:30:12.671306] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T21:30:13.322060] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-22T21:30:14.118177] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-22T21:30:14.122022] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-22T21:30:14.341043] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T21:30:14.922058] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-22T21:30:15.722022] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-22T21:30:15.769823] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-22T21:30:16.522046] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-22T21:30:16.661884] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T21:30:16.698280] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-22T21:30:17.247365] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T21:30:17.254837] [INFO ] [REMOTE ] SVV: Full fetch complete (55649 records). [2025-09-22T21:30:17.254982] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-22T21:30:17.327222] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-22T21:30:17.664913] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-22T21:30:17.665012] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-22T21:30:17.666165] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-22T21:30:17.666235] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-22T21:30:17.667602] [DEBUG] [LOCAL ] SVV: Trimmed 55649 records to 39434 (keeping 200 days of data) [2025-09-22T21:30:17.908708] [DEBUG] [LOCAL ] SVV: Primary data saved (39434 records). [2025-09-22T21:30:17.908867] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-22T21:30:17.908968] [INFO ] [MAIN ] Update Progress: 2032/2372 symbols completed. SVV took 28.6s. Estimated remaining: 45m 13s. Rate: 7.5 symbols/min [2025-09-22T21:30:18.092666] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:30:18.124564] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-22T21:30:18.125292] [DEBUG] [LOCAL ] SWX: Loaded 31786 existing records from primary storage. [2025-09-22T21:30:18.126623] [INFO ] [MAIN ] SWX: Loaded 31786 existing records. [2025-09-22T21:30:18.338255] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:30:18.338906] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-22T21:30:18.339014] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-22T21:30:18.339900] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-22T21:30:18.339985] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-22T21:30:18.749533] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:30:18.752241] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-22T21:30:18.922083] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-22T21:30:19.109112] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-22T21:30:19.722091] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-22T21:30:19.823750] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T21:30:19.830753] [INFO ] [REMOTE ] SUZ: Full fetch complete (67085 records). [2025-09-22T21:30:19.830884] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-22T21:30:20.224833] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-22T21:30:20.224936] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-22T21:30:20.226113] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-22T21:30:20.226180] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-22T21:30:20.227694] [DEBUG] [LOCAL ] SUZ: Trimmed 67085 records to 45838 (keeping 200 days of data) [2025-09-22T21:30:20.499580] [DEBUG] [LOCAL ] SUZ: Primary data saved (45838 records). [2025-09-22T21:30:20.499761] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-22T21:30:20.499856] [INFO ] [MAIN ] Update Progress: 2033/2372 symbols completed. SUZ took 35.5s. Estimated remaining: 45m 4s. Rate: 7.5 symbols/min [2025-09-22T21:30:20.531127] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-22T21:30:20.672492] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:30:20.680536] [DEBUG] [LOCAL ] SWZ: Loaded 6224 existing records from primary storage. [2025-09-22T21:30:20.680669] [INFO ] [MAIN ] SWZ: Loaded 6224 existing records. [2025-09-22T21:30:20.862300] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:30:20.862836] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-22T21:30:20.862907] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-22T21:30:20.863476] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-22T21:30:20.863537] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-22T21:30:21.172293] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-22T21:30:21.268020] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T21:30:21.331074] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-22T21:30:21.336893] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:30:22.122078] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-22T21:30:22.288213] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T21:30:22.723550] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-22T21:30:22.884497] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T21:30:22.893769] [INFO ] [REMOTE ] SW: Full fetch complete (76724 records). [2025-09-22T21:30:22.894001] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-22T21:30:22.927286] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-22T21:30:23.311590] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-22T21:30:23.311717] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-22T21:30:23.312945] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-22T21:30:23.313013] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-22T21:30:23.314562] [DEBUG] [LOCAL ] SW: Trimmed 76724 records to 53164 (keeping 200 days of data) [2025-09-22T21:30:23.649167] [DEBUG] [LOCAL ] SW: Primary data saved (53164 records). [2025-09-22T21:30:23.649330] [INFO ] [MAIN ] SW: Full history saved. [2025-09-22T21:30:23.649418] [INFO ] [MAIN ] Update Progress: 2034/2372 symbols completed. SW took 32.4s. Estimated remaining: 44m 55s. Rate: 7.5 symbols/min [2025-09-22T21:30:23.727235] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-22T21:30:23.832084] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:30:23.874750] [DEBUG] [LOCAL ] SXC: Loaded 42389 existing records from primary storage. [2025-09-22T21:30:23.874915] [INFO ] [MAIN ] SXC: Loaded 42389 existing records. [2025-09-22T21:30:24.066109] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:30:24.066367] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-22T21:30:24.066415] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-22T21:30:24.067350] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-22T21:30:24.067410] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-22T21:30:24.355681] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T21:30:24.478126] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:30:24.522053] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-22T21:30:25.322124] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-22T21:30:26.122046] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-22T21:30:26.171443] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-22T21:30:26.214513] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T21:30:26.259544] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T21:30:26.766118] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T21:30:26.922065] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-22T21:30:27.722078] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-22T21:30:28.531817] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-22T21:30:28.557927] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T21:30:29.066980] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-22T21:30:29.322102] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-22T21:30:30.122165] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-22T21:30:30.512112] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-22T21:30:30.839154] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T21:30:30.922106] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-22T21:30:31.508990] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T21:30:31.722065] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-22T21:30:32.522039] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-22T21:30:32.577865] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T21:30:33.268855] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T21:30:33.322056] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-22T21:30:33.900084] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-22T21:30:34.122068] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-22T21:30:34.917403] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T21:30:34.927210] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-22T21:30:35.551308] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T21:30:35.558446] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T21:30:35.722037] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-22T21:30:36.522070] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-22T21:30:37.120721] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-22T21:30:37.322044] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-22T21:30:37.462613] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T21:30:38.122062] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-22T21:30:38.647798] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T21:30:38.922023] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-22T21:30:38.975821] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-22T21:30:39.722030] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-22T21:30:40.186207] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T21:30:40.262406] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-22T21:30:40.522068] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-22T21:30:41.322058] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-22T21:30:42.097584] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T21:30:42.122010] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-22T21:30:42.922025] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-22T21:30:42.982670] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T21:30:42.991092] [INFO ] [REMOTE ] SWK: Full fetch complete (75421 records). [2025-09-22T21:30:42.991258] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-22T21:30:43.385841] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-22T21:30:43.385960] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-22T21:30:43.387186] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-22T21:30:43.387253] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-22T21:30:43.388814] [DEBUG] [LOCAL ] SWK: Trimmed 75421 records to 52493 (keeping 200 days of data) [2025-09-22T21:30:43.586098] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-22T21:30:43.729974] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-22T21:30:43.740624] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:30:43.765789] [DEBUG] [LOCAL ] SWK: Primary data saved (52493 records). [2025-09-22T21:30:43.766017] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-22T21:30:43.766112] [INFO ] [MAIN ] Update Progress: 2035/2372 symbols completed. SWK took 35.3s. Estimated remaining: 44m 49s. Rate: 7.5 symbols/min [2025-09-22T21:30:43.935824] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:30:43.950192] [DEBUG] [LOCAL ] SXI: Loaded 11589 existing records from primary storage. [2025-09-22T21:30:43.950327] [INFO ] [MAIN ] SXI: Loaded 11589 existing records. [2025-09-22T21:30:44.126224] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:30:44.126521] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-22T21:30:44.126582] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-22T21:30:44.127087] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-22T21:30:44.127149] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-22T21:30:44.525376] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-22T21:30:44.529940] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:30:44.809411] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T21:30:44.814591] [INFO ] [REMOTE ] SWX: Full fetch complete (43684 records). [2025-09-22T21:30:44.814800] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-22T21:30:45.205843] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-22T21:30:45.205930] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-22T21:30:45.207066] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-22T21:30:45.207132] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-22T21:30:45.208178] [DEBUG] [LOCAL ] SWX: Trimmed 43684 records to 31356 (keeping 200 days of data) [2025-09-22T21:30:45.322041] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-22T21:30:45.429007] [DEBUG] [LOCAL ] SWX: Primary data saved (31356 records). [2025-09-22T21:30:45.429166] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-22T21:30:45.429258] [INFO ] [MAIN ] Update Progress: 2036/2372 symbols completed. SWX took 27.5s. Estimated remaining: 44m 40s. Rate: 7.5 symbols/min [2025-09-22T21:30:45.604768] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:30:45.637405] [DEBUG] [LOCAL ] SXT: Loaded 29369 existing records from primary storage. [2025-09-22T21:30:45.637550] [INFO ] [MAIN ] SXT: Loaded 29369 existing records. [2025-09-22T21:30:45.827783] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:30:45.828131] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-22T21:30:45.828187] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-22T21:30:45.828988] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-22T21:30:45.829051] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-22T21:30:46.120320] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-22T21:30:46.123729] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-22T21:30:46.210939] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:30:46.235284] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T21:30:46.758942] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-22T21:30:46.922081] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-22T21:30:47.722099] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-22T21:30:47.754766] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T21:30:48.338139] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T21:30:48.522060] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-22T21:30:49.272477] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-22T21:30:49.322058] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-22T21:30:49.878012] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T21:30:49.879170] [INFO ] [REMOTE ] SWZ: Full fetch complete (8078 records). [2025-09-22T21:30:49.879239] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-22T21:30:50.127169] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-22T21:30:50.253455] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-22T21:30:50.253535] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-22T21:30:50.253878] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-22T21:30:50.253940] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-22T21:30:50.255968] [DEBUG] [LOCAL ] SWZ: Trimmed 8078 records to 6107 (keeping 200 days of data) [2025-09-22T21:30:50.291162] [DEBUG] [LOCAL ] SWZ: Primary data saved (6107 records). [2025-09-22T21:30:50.291313] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-22T21:30:50.291434] [INFO ] [MAIN ] Update Progress: 2037/2372 symbols completed. SWZ took 29.8s. Estimated remaining: 44m 32s. Rate: 7.5 symbols/min [2025-09-22T21:30:50.922086] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-22T21:30:51.048544] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T21:30:51.646391] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T21:30:51.722069] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-22T21:30:52.522082] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-22T21:30:52.567063] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-22T21:30:53.322065] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-22T21:30:53.742706] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T21:30:54.122071] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-22T21:30:54.138622] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T21:30:54.922067] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-22T21:30:55.142052] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-22T21:30:55.722055] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-22T21:30:56.325241] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T21:30:56.522074] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-22T21:30:56.577101] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T21:30:57.322114] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-22T21:30:58.011011] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-22T21:30:58.018432] [INFO ] [REMOTE ] SXC: Full fetch complete (61230 records). [2025-09-22T21:30:58.018683] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-22T21:30:58.127695] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-22T21:30:58.461457] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-22T21:30:58.461668] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-22T21:30:58.464063] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-22T21:30:58.464828] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-22T21:30:58.464714] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T21:30:58.469973] [DEBUG] [LOCAL ] SXC: Trimmed 61230 records to 41630 (keeping 200 days of data) [2025-09-22T21:30:58.744199] [DEBUG] [LOCAL ] SXC: Primary data saved (41630 records). [2025-09-22T21:30:58.744340] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-22T21:30:58.744522] [INFO ] [MAIN ] Update Progress: 2038/2372 symbols completed. SXC took 35.1s. Estimated remaining: 44m 24s. Rate: 7.5 symbols/min [2025-09-22T21:30:58.922067] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-22T21:30:59.458870] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T21:30:59.722035] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-22T21:30:59.909636] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T21:31:00.522055] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-22T21:31:01.209778] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T21:31:01.322167] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-22T21:31:01.408905] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-22T21:31:02.122099] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-22T21:31:02.581680] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-22T21:31:02.922093] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-22T21:31:02.965823] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T21:31:02.970623] [INFO ] [REMOTE ] SXI: Full fetch complete (14477 records). [2025-09-22T21:31:02.970914] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-22T21:31:03.407033] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-22T21:31:03.407193] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-22T21:31:03.407839] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-22T21:31:03.407936] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-22T21:31:03.408958] [DEBUG] [LOCAL ] SXI: Trimmed 14477 records to 11475 (keeping 200 days of data) [2025-09-22T21:31:03.494095] [DEBUG] [LOCAL ] SXI: Primary data saved (11475 records). [2025-09-22T21:31:03.494322] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-22T21:31:03.494492] [INFO ] [MAIN ] Update Progress: 2039/2372 symbols completed. SXI took 19.7s. Estimated remaining: 44m 15s. Rate: 7.5 symbols/min [2025-09-22T21:31:04.182884] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T21:31:04.189586] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-22T21:31:05.596862] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T21:31:05.605259] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-22T21:31:06.766132] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-22T21:31:06.773504] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-22T21:31:07.975959] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T21:31:07.981582] [INFO ] [REMOTE ] SXT: Full fetch complete (37577 records). [2025-09-22T21:31:07.981720] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-22T21:31:08.376206] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-22T21:31:08.376312] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-22T21:31:08.377322] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-22T21:31:08.377386] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-22T21:31:08.378479] [DEBUG] [LOCAL ] SXT: Trimmed 37577 records to 29013 (keeping 200 days of data) [2025-09-22T21:31:08.593772] [DEBUG] [LOCAL ] SXT: Primary data saved (29013 records). [2025-09-22T21:31:08.593933] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-22T21:31:08.594080] [INFO ] [MAIN ] Update Progress: 2040/2372 symbols completed. SXT took 23.2s. Estimated remaining: 44m 7s. Rate: 7.5 symbols/min [2025-09-22T21:31:09.190922] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:31:09.350964] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:31:09.349709] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:31:09.389773] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:31:09.537104] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-22T21:31:09.537558] [INFO ] [MAIN ] T: Loaded 54578 existing records. [2025-09-22T21:31:09.601794] [DEBUG] [LOCAL ] SYY: Loaded 54029 existing records from primary storage. [2025-09-22T21:31:09.636095] [INFO ] [MAIN ] SYY: Loaded 54029 existing records. [2025-09-22T21:31:09.726255] [DEBUG] [LOCAL ] SYF: Loaded 54240 existing records from primary storage. [2025-09-22T21:31:09.724920] [DEBUG] [LOCAL ] SYK: Loaded 47843 existing records from primary storage. [2025-09-22T21:31:09.746299] [INFO ] [MAIN ] SYF: Loaded 54240 existing records. [2025-09-22T21:31:09.760678] [INFO ] [MAIN ] SYK: Loaded 47843 existing records. [2025-09-22T21:31:10.147194] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:31:10.237727] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-22T21:31:10.237900] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-22T21:31:10.232387] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:31:10.302547] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-22T21:31:10.338615] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-22T21:31:10.344633] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-22T21:31:10.348782] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:31:10.354617] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-22T21:31:10.356636] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-22T21:31:10.356730] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-22T21:31:10.400871] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-22T21:31:10.401009] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:31:10.410388] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-22T21:31:10.421137] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-22T21:31:10.436392] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-22T21:31:10.445328] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-22T21:31:10.450611] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-22T21:31:10.543415] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-22T21:31:10.557866] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-22T21:31:11.811804] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:31:11.808719] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:31:11.812988] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-22T21:31:11.812683] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-22T21:31:11.955999] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:31:11.965140] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-22T21:31:11.979635] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:31:11.979956] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-22T21:31:13.682855] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-22T21:31:13.695139] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-22T21:31:13.778376] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T21:31:13.788126] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-22T21:31:13.827806] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T21:31:13.839200] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-22T21:31:13.941348] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-22T21:31:13.953747] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-22T21:31:15.591606] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-22T21:31:15.603072] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-22T21:31:15.734552] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-22T21:31:15.746753] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-22T21:31:15.864044] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-22T21:31:15.875832] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-22T21:31:16.321441] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-22T21:31:16.333068] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-22T21:31:17.362821] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T21:31:17.373145] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-22T21:31:17.406164] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T21:31:17.417794] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-22T21:31:17.502970] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T21:31:17.513209] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-22T21:31:18.661173] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-22T21:31:18.671823] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-22T21:31:18.834796] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-22T21:31:18.922022] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-22T21:31:19.298634] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T21:31:19.338543] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T21:31:19.722098] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-22T21:31:20.522074] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-22T21:31:20.826293] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T21:31:21.089684] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-22T21:31:21.322029] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-22T21:31:21.775749] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-22T21:31:22.122053] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-22T21:31:22.381493] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T21:31:22.922085] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-22T21:31:23.722041] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-22T21:31:23.933040] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-22T21:31:24.168791] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-22T21:31:24.522052] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-22T21:31:24.645310] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T21:31:25.291416] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T21:31:25.322052] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-22T21:31:26.122072] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-22T21:31:26.823142] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-22T21:31:26.897178] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T21:31:26.922027] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-22T21:31:27.722123] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-22T21:31:27.901454] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T21:31:28.522038] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-22T21:31:28.780431] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T21:31:29.322058] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-22T21:31:29.987262] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-22T21:31:30.065837] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T21:31:30.122123] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-22T21:31:30.922038] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-22T21:31:31.255978] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T21:31:31.722052] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-22T21:31:32.522072] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-22T21:31:32.574979] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-22T21:31:32.644904] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T21:31:33.307835] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T21:31:33.319993] [INFO ] [REMOTE ] SYY: Full fetch complete (76982 records). [2025-09-22T21:31:33.320253] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-22T21:31:33.322026] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-22T21:31:33.729828] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-22T21:31:33.729918] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-22T21:31:33.731076] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-22T21:31:33.731143] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-22T21:31:33.732706] [DEBUG] [LOCAL ] SYY: Trimmed 76982 records to 53246 (keeping 200 days of data) [2025-09-22T21:31:34.079553] [DEBUG] [LOCAL ] SYY: Primary data saved (53246 records). [2025-09-22T21:31:34.079723] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-22T21:31:34.079833] [INFO ] [MAIN ] Update Progress: 2041/2372 symbols completed. SYY took 25.5s. Estimated remaining: 44m 2s. Rate: 7.5 symbols/min [2025-09-22T21:31:34.136869] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-22T21:31:34.260632] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:31:34.309413] [DEBUG] [LOCAL ] TAC: Loaded 43676 existing records from primary storage. [2025-09-22T21:31:34.309580] [INFO ] [MAIN ] TAC: Loaded 43676 existing records. [2025-09-22T21:31:34.501101] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:31:34.501577] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-22T21:31:34.501686] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-22T21:31:34.502839] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-22T21:31:34.502925] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-22T21:31:34.823442] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-22T21:31:34.926268] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:31:34.922473] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-22T21:31:35.641461] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-22T21:31:35.733249] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-22T21:31:35.738576] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T21:31:36.522048] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-22T21:31:36.688992] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T21:31:36.851770] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T21:31:37.322070] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-22T21:31:38.085299] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T21:31:38.093154] [INFO ] [REMOTE ] SYK: Full fetch complete (68670 records). [2025-09-22T21:31:38.093335] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-22T21:31:38.127236] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-22T21:31:38.498973] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-22T21:31:38.499274] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-22T21:31:38.500779] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-22T21:31:38.500868] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-22T21:31:38.502929] [DEBUG] [LOCAL ] SYK: Trimmed 68670 records to 47072 (keeping 200 days of data) [2025-09-22T21:31:38.654889] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T21:31:38.671833] [INFO ] [REMOTE ] SYF: Full fetch complete (77338 records). [2025-09-22T21:31:38.674696] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-22T21:31:38.942016] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-22T21:31:39.174445] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T21:31:39.270451] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-09-22T21:31:39.270601] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-22T21:31:39.270752] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-22T21:31:39.271366] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-22T21:31:39.274277] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-22T21:31:39.274745] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-22T21:31:39.372065] [DEBUG] [LOCAL ] SYF: Trimmed 77338 records to 53459 (keeping 200 days of data) [2025-09-22T21:31:39.779433] [DEBUG] [LOCAL ] SYK: Primary data saved (47072 records). [2025-09-22T21:31:39.796128] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-22T21:31:39.796887] [INFO ] [MAIN ] Update Progress: 2042/2372 symbols completed. SYK took 31.2s. Estimated remaining: 43m 54s. Rate: 7.5 symbols/min [2025-09-22T21:31:39.985977] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-22T21:31:39.992117] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-22T21:31:40.024704] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-22T21:31:40.089479] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-22T21:31:40.202103] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-09-22T21:31:40.201980] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:31:40.383222] [DEBUG] [LOCAL ] TAK: Loaded 50690 existing records from primary storage. [2025-09-22T21:31:40.387502] [INFO ] [MAIN ] TAK: Loaded 50690 existing records. [2025-09-22T21:31:40.688525] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:31:40.691910] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-22T21:31:40.694467] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-22T21:31:40.699261] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-22T21:31:40.699692] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-22T21:31:40.922145] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-22T21:31:40.970582] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-22T21:31:40.973219] [DEBUG] [LOCAL ] SYF: Primary data saved (53459 records). [2025-09-22T21:31:40.994810] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-22T21:31:41.000171] [INFO ] [MAIN ] Update Progress: 2043/2372 symbols completed. SYF took 32.4s. Estimated remaining: 43m 44s. Rate: 7.5 symbols/min [2025-09-22T21:31:41.482120] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:31:41.516697] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:31:41.521516] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-22T21:31:41.543590] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-09-22T21:31:41.543810] [INFO ] [MAIN ] T: Full history saved. [2025-09-22T21:31:41.543950] [INFO ] [MAIN ] Update Progress: 2044/2372 symbols completed. T took 32.9s. Estimated remaining: 43m 35s. Rate: 7.5 symbols/min [2025-09-22T21:31:41.756775] [DEBUG] [LOCAL ] TAL: Loaded 52924 existing records from primary storage. [2025-09-22T21:31:41.775849] [INFO ] [MAIN ] TAL: Loaded 52924 existing records. [2025-09-22T21:31:41.777421] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:31:41.965261] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:31:41.965581] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-22T21:31:41.965634] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-22T21:31:41.966949] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-22T21:31:41.967013] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-22T21:31:42.210702] [DEBUG] [LOCAL ] TALO: Loaded 51587 existing records from primary storage. [2025-09-22T21:31:42.223370] [INFO ] [MAIN ] TALO: Loaded 51587 existing records. [2025-09-22T21:31:42.563480] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:31:42.564254] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-22T21:31:42.563781] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:31:42.565546] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-22T21:31:42.565603] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-22T21:31:42.569631] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-22T21:31:42.592777] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-22T21:31:42.630400] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T21:31:42.708872] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-22T21:31:43.006665] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:31:43.007587] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-22T21:31:43.097392] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T21:31:43.722075] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-22T21:31:44.394407] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T21:31:44.480960] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-22T21:31:44.531132] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-22T21:31:44.550362] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T21:31:45.324016] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-22T21:31:45.326688] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T21:31:46.122075] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-22T21:31:46.180167] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T21:31:46.922141] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-22T21:31:47.145315] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T21:31:47.722079] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-22T21:31:47.962297] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-22T21:31:48.216949] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T21:31:48.522062] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-22T21:31:49.278800] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T21:31:49.322062] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-22T21:31:50.048745] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T21:31:50.122062] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-22T21:31:50.922094] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-22T21:31:51.163744] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T21:31:51.722021] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-22T21:31:51.989779] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T21:31:52.524286] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-22T21:31:52.536365] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T21:31:53.322052] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-22T21:31:53.606044] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T21:31:54.060906] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T21:31:54.122057] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-22T21:31:54.886022] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T21:31:54.922035] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-22T21:31:55.705805] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:31:55.722005] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-22T21:31:56.460905] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T21:31:56.522027] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-22T21:31:57.322052] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-22T21:31:57.400200] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T21:31:57.457916] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-22T21:31:57.464850] [INFO ] [REMOTE ] TAC: Full fetch complete (64342 records). [2025-09-22T21:31:57.465003] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-22T21:31:57.868982] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-22T21:31:57.869085] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-22T21:31:57.870175] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-22T21:31:57.870239] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-22T21:31:57.871664] [DEBUG] [LOCAL ] TAC: Trimmed 64342 records to 42951 (keeping 200 days of data) [2025-09-22T21:31:58.125418] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-22T21:31:58.137395] [DEBUG] [LOCAL ] TAC: Primary data saved (42951 records). [2025-09-22T21:31:58.137474] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-22T21:31:58.137557] [INFO ] [MAIN ] Update Progress: 2045/2372 symbols completed. TAC took 24.1s. Estimated remaining: 43m 29s. Rate: 7.5 symbols/min [2025-09-22T21:31:58.309451] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:31:58.360514] [DEBUG] [LOCAL ] TAP: Loaded 53624 existing records from primary storage. [2025-09-22T21:31:58.360706] [INFO ] [MAIN ] TAP: Loaded 53624 existing records. [2025-09-22T21:31:58.541842] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:31:58.542148] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-22T21:31:58.542201] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-22T21:31:58.543531] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-22T21:31:58.543594] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-22T21:31:58.931335] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-22T21:31:58.937190] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:31:59.293261] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-22T21:31:59.722050] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-22T21:32:00.043228] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T21:32:00.522032] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-22T21:32:00.739479] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T21:32:01.322058] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-22T21:32:01.505241] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T21:32:02.122027] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-22T21:32:02.161733] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T21:32:02.922071] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-22T21:32:03.139026] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-22T21:32:03.722102] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-22T21:32:03.905765] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T21:32:04.522052] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-22T21:32:04.578934] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T21:32:05.322077] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-22T21:32:05.424799] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T21:32:06.122058] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-22T21:32:06.163986] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T21:32:06.922048] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-22T21:32:07.162608] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-22T21:32:07.706487] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T21:32:07.715882] [INFO ] [REMOTE ] TALO: Full fetch complete (73160 records). [2025-09-22T21:32:07.716098] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-22T21:32:07.729106] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-22T21:32:08.135246] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-22T21:32:08.135380] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-22T21:32:08.137847] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-22T21:32:08.137925] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-22T21:32:08.140078] [DEBUG] [LOCAL ] TALO: Trimmed 73160 records to 50811 (keeping 200 days of data) [2025-09-22T21:32:08.461745] [DEBUG] [LOCAL ] TALO: Primary data saved (50811 records). [2025-09-22T21:32:08.461943] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-22T21:32:08.462064] [INFO ] [MAIN ] Update Progress: 2046/2372 symbols completed. TALO took 26.9s. Estimated remaining: 43m 21s. Rate: 7.5 symbols/min [2025-09-22T21:32:08.532201] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-22T21:32:08.655277] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:32:08.688767] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T21:32:08.710380] [DEBUG] [LOCAL ] TBB: Loaded 11863 existing records from primary storage. [2025-09-22T21:32:08.710549] [INFO ] [MAIN ] TBB: Loaded 11863 existing records. [2025-09-22T21:32:08.906934] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:32:08.907258] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-22T21:32:08.907318] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-22T21:32:08.907919] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-22T21:32:08.908019] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-22T21:32:09.271289] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:32:09.322039] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-22T21:32:10.122115] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-22T21:32:10.421237] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T21:32:10.470766] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T21:32:10.922107] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-22T21:32:11.050724] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (3.32 seconds). [2025-09-22T21:32:11.462453] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T21:32:11.722081] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-22T21:32:12.522028] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-22T21:32:12.642508] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T21:32:13.322034] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-22T21:32:13.511382] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T21:32:13.801073] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T21:32:13.809262] [INFO ] [REMOTE ] TAK: Full fetch complete (71489 records). [2025-09-22T21:32:13.809394] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-22T21:32:14.127333] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-22T21:32:14.211417] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-22T21:32:14.211554] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-22T21:32:14.213330] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-22T21:32:14.213429] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-22T21:32:14.215419] [DEBUG] [LOCAL ] TAK: Trimmed 71489 records to 49926 (keeping 200 days of data) [2025-09-22T21:32:14.546987] [DEBUG] [LOCAL ] TAK: Primary data saved (49926 records). [2025-09-22T21:32:14.547169] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-22T21:32:14.547288] [INFO ] [MAIN ] Update Progress: 2047/2372 symbols completed. TAK took 34.7s. Estimated remaining: 43m 13s. Rate: 7.5 symbols/min [2025-09-22T21:32:14.726194] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:32:14.784603] [DEBUG] [LOCAL ] TBBB: Loaded 36426 existing records from primary storage. [2025-09-22T21:32:14.786583] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T21:32:14.785471] [INFO ] [MAIN ] TBBB: Loaded 36426 existing records. [2025-09-22T21:32:14.852277] [INFO ] [REMOTE ] TAL: Full fetch complete (75687 records). [2025-09-22T21:32:14.879043] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-22T21:32:14.929782] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-22T21:32:15.102195] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:32:15.183014] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-22T21:32:15.198945] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-22T21:32:15.198812] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T21:32:15.223332] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-22T21:32:15.254045] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-22T21:32:15.681616] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-22T21:32:15.695536] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-22T21:32:15.705995] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-22T21:32:15.706125] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-22T21:32:15.724806] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-22T21:32:15.769568] [DEBUG] [LOCAL ] TAL: Trimmed 75687 records to 52123 (keeping 200 days of data) [2025-09-22T21:32:15.896949] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:32:16.157162] [DEBUG] [LOCAL ] TAL: Primary data saved (52123 records). [2025-09-22T21:32:16.157311] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-22T21:32:16.157401] [INFO ] [MAIN ] Update Progress: 2048/2372 symbols completed. TAL took 35.2s. Estimated remaining: 43m 4s. Rate: 7.5 symbols/min [2025-09-22T21:32:16.342932] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:32:16.367284] [DEBUG] [LOCAL ] TBI: Loaded 23061 existing records from primary storage. [2025-09-22T21:32:16.367519] [INFO ] [MAIN ] TBI: Loaded 23061 existing records. [2025-09-22T21:32:16.538071] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-22T21:32:16.613735] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T21:32:16.613969] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:32:16.617743] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-22T21:32:16.618230] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-22T21:32:16.618758] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-22T21:32:16.618821] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-22T21:32:17.193802] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:32:17.238632] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-22T21:32:17.322102] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-22T21:32:18.001688] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T21:32:18.122094] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-22T21:32:18.204265] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T21:32:18.922096] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-22T21:32:19.196868] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T21:32:19.722110] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-22T21:32:19.827517] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-22T21:32:20.522041] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-22T21:32:20.762999] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T21:32:21.322041] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-22T21:32:21.509573] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T21:32:22.122070] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-22T21:32:22.535999] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T21:32:22.922053] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-22T21:32:23.722029] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-22T21:32:23.925108] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T21:32:24.027623] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T21:32:24.522066] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-22T21:32:25.027044] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T21:32:25.322071] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-22T21:32:26.124690] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-22T21:32:26.130218] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T21:32:26.164937] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-22T21:32:26.922034] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-22T21:32:27.016961] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T21:32:27.722070] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-22T21:32:27.748143] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-22T21:32:28.522117] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-22T21:32:29.261818] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T21:32:29.322064] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-22T21:32:29.683369] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T21:32:30.122072] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-22T21:32:30.679061] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T21:32:30.927273] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-22T21:32:30.944064] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-22T21:32:31.722091] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-22T21:32:32.304806] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T21:32:32.509470] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-22T21:32:32.522012] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-22T21:32:33.321373] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T21:32:33.324503] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-22T21:32:34.122087] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-22T21:32:34.922072] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-22T21:32:35.181673] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T21:32:35.466916] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T21:32:35.483116] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T21:32:35.487408] [INFO ] [REMOTE ] TBB: Full fetch complete (18026 records). [2025-09-22T21:32:35.487513] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-22T21:32:35.727342] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-22T21:32:35.878839] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-22T21:32:35.878933] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-22T21:32:35.879392] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-22T21:32:35.879431] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-22T21:32:35.880024] [DEBUG] [LOCAL ] TBB: Trimmed 18026 records to 11697 (keeping 200 days of data) [2025-09-22T21:32:35.956909] [DEBUG] [LOCAL ] TBB: Primary data saved (11697 records). [2025-09-22T21:32:35.957107] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-22T21:32:35.957241] [INFO ] [MAIN ] Update Progress: 2049/2372 symbols completed. TBB took 27.5s. Estimated remaining: 42m 58s. Rate: 7.5 symbols/min [2025-09-22T21:32:36.148701] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:32:36.148950] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-22T21:32:36.149004] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-22T21:32:36.149151] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-22T21:32:36.149196] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-22T21:32:36.149236] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-22T21:32:36.149269] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-22T21:32:36.525308] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-22T21:32:36.529491] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:32:37.192673] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T21:32:37.322082] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-22T21:32:37.615546] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T21:32:38.122145] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-22T21:32:38.483070] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T21:32:38.490049] [INFO ] [REMOTE ] TBBB: Full fetch complete (51346 records). [2025-09-22T21:32:38.490297] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-22T21:32:38.576503] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-22T21:32:38.906455] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-22T21:32:38.906606] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-22T21:32:38.908539] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-22T21:32:38.908728] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-22T21:32:38.910694] [DEBUG] [LOCAL ] TBBB: Trimmed 51346 records to 35854 (keeping 200 days of data) [2025-09-22T21:32:38.962900] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-22T21:32:39.150061] [DEBUG] [LOCAL ] TBBB: Primary data saved (35854 records). [2025-09-22T21:32:39.150289] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-22T21:32:39.150415] [INFO ] [MAIN ] Update Progress: 2050/2372 symbols completed. TBBB took 24.6s. Estimated remaining: 42m 49s. Rate: 7.5 symbols/min [2025-09-22T21:32:39.346087] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:32:39.353546] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-22T21:32:39.358020] [DEBUG] [LOCAL ] TBN: Loaded 3109 existing records from primary storage. [2025-09-22T21:32:39.358180] [INFO ] [MAIN ] TBN: Loaded 3109 existing records. [2025-09-22T21:32:39.552068] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:32:39.552481] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-22T21:32:39.552560] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-22T21:32:39.553106] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-22T21:32:39.553171] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-22T21:32:39.722374] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-22T21:32:39.942954] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:32:40.133227] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-22T21:32:40.522079] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-22T21:32:40.861958] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-22T21:32:41.322069] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-22T21:32:42.082924] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T21:32:42.122078] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-22T21:32:42.922100] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-22T21:32:43.722118] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-22T21:32:43.753672] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T21:32:43.765495] [INFO ] [REMOTE ] TAP: Full fetch complete (76141 records). [2025-09-22T21:32:43.765730] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-22T21:32:44.173819] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-22T21:32:44.189094] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-22T21:32:44.192006] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T21:32:44.194638] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T21:32:44.193775] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-22T21:32:44.201078] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-22T21:32:44.204674] [DEBUG] [LOCAL ] TAP: Trimmed 76141 records to 52867 (keeping 200 days of data) [2025-09-22T21:32:44.522313] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-22T21:32:44.544989] [DEBUG] [LOCAL ] TAP: Primary data saved (52867 records). [2025-09-22T21:32:44.545112] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-22T21:32:44.545198] [INFO ] [MAIN ] Update Progress: 2051/2372 symbols completed. TAP took 46.4s. Estimated remaining: 42m 41s. Rate: 7.5 symbols/min [2025-09-22T21:32:44.717916] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:32:44.718167] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-22T21:32:44.718223] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-22T21:32:44.718373] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-22T21:32:44.718418] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-22T21:32:44.718462] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-22T21:32:44.718500] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-22T21:32:45.079295] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:32:45.322030] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-22T21:32:45.530787] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:32:45.531224] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-22T21:32:45.545753] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-22T21:32:46.122071] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-22T21:32:46.604055] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-22T21:32:46.922059] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-22T21:32:47.493705] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T21:32:47.722052] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-22T21:32:48.071136] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-22T21:32:48.522086] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-22T21:32:49.323324] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-22T21:32:49.327047] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-22T21:32:49.330931] [INFO ] [REMOTE ] TBI: Full fetch complete (31644 records). [2025-09-22T21:32:49.331012] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-22T21:32:49.559062] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:32:49.596383] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-22T21:32:49.704536] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-22T21:32:49.704671] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-22T21:32:49.705416] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-22T21:32:49.705480] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-22T21:32:49.706504] [DEBUG] [LOCAL ] TBI: Trimmed 31644 records to 22640 (keeping 200 days of data) [2025-09-22T21:32:49.839602] [DEBUG] [LOCAL ] TBI: Primary data saved (22640 records). [2025-09-22T21:32:49.839782] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-22T21:32:49.839882] [INFO ] [MAIN ] Update Progress: 2052/2372 symbols completed. TBI took 33.7s. Estimated remaining: 42m 32s. Rate: 7.5 symbols/min [2025-09-22T21:32:50.010095] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:32:50.062597] [DEBUG] [LOCAL ] TD: Loaded 53049 existing records from primary storage. [2025-09-22T21:32:50.062806] [INFO ] [MAIN ] TD: Loaded 53049 existing records. [2025-09-22T21:32:50.127167] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-22T21:32:50.242748] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:32:50.242997] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-22T21:32:50.243046] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-22T21:32:50.244752] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-22T21:32:50.244822] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-22T21:32:50.464639] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:32:50.503021] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-22T21:32:50.602300] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:32:50.922055] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-22T21:32:51.279988] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-22T21:32:51.722063] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-22T21:32:52.086016] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-22T21:32:52.522078] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-22T21:32:53.131870] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-22T21:32:53.322056] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-22T21:32:53.884138] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T21:32:54.122053] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-22T21:32:54.922056] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-22T21:32:55.352670] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-22T21:32:55.722070] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-22T21:32:55.927591] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:32:55.928021] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-22T21:32:56.014956] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T21:32:56.522062] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-22T21:32:57.322099] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-22T21:32:57.741544] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T21:32:58.128443] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-22T21:32:58.148946] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T21:32:58.625923] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-22T21:32:58.922050] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-22T21:32:59.422871] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-22T21:32:59.722050] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-22T21:32:59.926517] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:32:59.926882] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-22T21:33:00.522050] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-22T21:33:00.932483] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-22T21:33:01.322048] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-22T21:33:02.059265] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T21:33:02.060081] [INFO ] [REMOTE ] TBLU: Full fetch complete (1171 records). [2025-09-22T21:33:02.060149] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-22T21:33:02.127215] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-22T21:33:02.282088] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T21:33:02.282428] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:33:02.282498] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:33:02.282620] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-22T21:33:02.282779] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-22T21:33:02.282847] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-22T21:33:02.282930] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-22T21:33:02.283036] [INFO ] [MAIN ] Update Progress: 2053/2372 symbols completed. TBLU took 26.3s. Estimated remaining: 42m 25s. Rate: 7.5 symbols/min [2025-09-22T21:33:02.457789] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:33:02.509952] [DEBUG] [LOCAL ] TDC: Loaded 47741 existing records from primary storage. [2025-09-22T21:33:02.510108] [INFO ] [MAIN ] TDC: Loaded 47741 existing records. [2025-09-22T21:33:02.706858] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:33:02.707102] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-22T21:33:02.707152] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-22T21:33:02.708512] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-22T21:33:02.708587] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-22T21:33:02.927248] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-22T21:33:03.076371] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:33:03.722089] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-22T21:33:04.522048] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-22T21:33:04.803876] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T21:33:04.895083] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:33:04.901692] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-22T21:33:05.322081] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-22T21:33:05.482455] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (3.36 seconds). [2025-09-22T21:33:05.524458] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:33:05.524870] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-22T21:33:05.885289] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T21:33:06.122074] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-22T21:33:06.684499] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-22T21:33:06.686402] [INFO ] [REMOTE ] TBN: Full fetch complete (4787 records). [2025-09-22T21:33:06.686485] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-22T21:33:06.928074] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-22T21:33:07.072979] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-22T21:33:07.073071] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-22T21:33:07.073293] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-22T21:33:07.073372] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-22T21:33:07.073946] [DEBUG] [LOCAL ] TBN: Trimmed 4787 records to 2975 (keeping 200 days of data) [2025-09-22T21:33:07.093549] [DEBUG] [LOCAL ] TBN: Primary data saved (2975 records). [2025-09-22T21:33:07.093638] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-22T21:33:07.093839] [INFO ] [MAIN ] Update Progress: 2054/2372 symbols completed. TBN took 27.9s. Estimated remaining: 42m 16s. Rate: 7.5 symbols/min [2025-09-22T21:33:07.278176] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:33:07.294007] [DEBUG] [LOCAL ] TDF: Loaded 6581 existing records from primary storage. [2025-09-22T21:33:07.294191] [INFO ] [MAIN ] TDF: Loaded 6581 existing records. [2025-09-22T21:33:07.497988] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:33:07.498329] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-22T21:33:07.498390] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-22T21:33:07.498725] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-22T21:33:07.498787] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-22T21:33:07.733795] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-22T21:33:07.897825] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:33:08.499225] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T21:33:08.522005] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-22T21:33:09.322048] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-22T21:33:09.529860] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:33:09.533235] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-22T21:33:09.536553] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T21:33:10.122056] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-22T21:33:10.176736] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T21:33:10.767219] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-22T21:33:10.922106] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-22T21:33:11.701269] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-22T21:33:11.722002] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-22T21:33:12.522085] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-22T21:33:12.769069] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T21:33:13.322076] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-22T21:33:14.122087] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-22T21:33:14.484091] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T21:33:14.922021] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-22T21:33:15.028731] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-22T21:33:15.619368] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-22T21:33:15.722028] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-22T21:33:15.731285] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-22T21:33:16.522088] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-22T21:33:17.311207] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T21:33:17.330996] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-22T21:33:17.350196] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T21:33:17.979877] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T21:33:18.122067] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-22T21:33:18.922069] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-22T21:33:19.719052] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T21:33:19.723212] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-22T21:33:20.214067] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-22T21:33:20.215297] [INFO ] [REMOTE ] TCAI: Full fetch complete (883 records). [2025-09-22T21:33:20.215454] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-22T21:33:20.404206] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 34 unique days, need 200 days [2025-09-22T21:33:20.404490] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:33:20.404599] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:33:20.404880] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-22T21:33:20.405001] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-22T21:33:20.405082] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-22T21:33:20.405313] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-22T21:33:20.405489] [INFO ] [MAIN ] Update Progress: 2055/2372 symbols completed. TCAI took 35.9s. Estimated remaining: 42m 9s. Rate: 7.5 symbols/min [2025-09-22T21:33:20.529978] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-22T21:33:20.639175] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T21:33:20.643126] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:33:20.652330] [DEBUG] [LOCAL ] TDG: No existing data file found in primary storage. [2025-09-22T21:33:20.652518] [WARN ] [MAIN ] TDG: No existing data found, performing full refresh instead. [2025-09-22T21:33:20.653089] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-22T21:33:20.653147] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-22T21:33:20.653470] [DEBUG] [LOCAL ] TDG: No primary data file found to delete. [2025-09-22T21:33:20.653528] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-22T21:33:21.044043] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:33:21.045074] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-22T21:33:21.322052] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-22T21:33:22.122080] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-22T21:33:22.816072] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T21:33:22.857495] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-22T21:33:22.922060] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-22T21:33:23.614923] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T21:33:23.722063] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-22T21:33:24.461165] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-22T21:33:24.463045] [INFO ] [REMOTE ] TDF: Full fetch complete (10671 records). [2025-09-22T21:33:24.463116] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-22T21:33:24.527236] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-22T21:33:24.837146] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-22T21:33:24.837245] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-22T21:33:24.837524] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-22T21:33:24.837606] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-22T21:33:24.838113] [DEBUG] [LOCAL ] TDF: Trimmed 10671 records to 6452 (keeping 200 days of data) [2025-09-22T21:33:24.880523] [DEBUG] [LOCAL ] TDF: Primary data saved (6452 records). [2025-09-22T21:33:24.880610] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-22T21:33:24.880744] [INFO ] [MAIN ] Update Progress: 2056/2372 symbols completed. TDF took 17.8s. Estimated remaining: 42m 1s. Rate: 7.5 symbols/min [2025-09-22T21:33:25.047707] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:33:25.118887] [DEBUG] [LOCAL ] TDOC: Loaded 54132 existing records from primary storage. [2025-09-22T21:33:25.119077] [INFO ] [MAIN ] TDOC: Loaded 54132 existing records. [2025-09-22T21:33:25.297545] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:33:25.297835] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-22T21:33:25.297885] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-22T21:33:25.299004] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-22T21:33:25.299091] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-22T21:33:25.331512] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-22T21:33:25.664079] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:33:26.122074] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-22T21:33:26.330929] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T21:33:26.922080] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-22T21:33:27.138043] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T21:33:27.722081] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-22T21:33:28.325258] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-22T21:33:28.408212] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T21:33:28.522025] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-22T21:33:29.322075] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-22T21:33:29.489971] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T21:33:30.122119] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-22T21:33:30.295962] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-22T21:33:30.469549] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T21:33:30.922059] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-22T21:33:31.504580] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T21:33:31.722091] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-22T21:33:32.457575] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T21:33:32.469994] [INFO ] [REMOTE ] TD: Full fetch complete (75784 records). [2025-09-22T21:33:32.470203] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-22T21:33:32.531361] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-22T21:33:32.909711] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-22T21:33:32.909867] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-22T21:33:32.911179] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-22T21:33:32.911247] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-22T21:33:32.912885] [DEBUG] [LOCAL ] TD: Trimmed 75784 records to 52270 (keeping 200 days of data) [2025-09-22T21:33:33.266838] [DEBUG] [LOCAL ] TD: Primary data saved (52270 records). [2025-09-22T21:33:33.267022] [INFO ] [MAIN ] TD: Full history saved. [2025-09-22T21:33:33.267262] [INFO ] [MAIN ] Update Progress: 2057/2372 symbols completed. TD took 43.4s. Estimated remaining: 41m 53s. Rate: 7.5 symbols/min [2025-09-22T21:33:33.331783] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-22T21:33:33.466560] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:33:33.521698] [DEBUG] [LOCAL ] TDS: Loaded 43487 existing records from primary storage. [2025-09-22T21:33:33.547764] [INFO ] [MAIN ] TDS: Loaded 43487 existing records. [2025-09-22T21:33:33.624075] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T21:33:33.745515] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T21:33:33.772600] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:33:33.772841] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-22T21:33:33.772890] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-22T21:33:33.774157] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-22T21:33:33.774218] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-22T21:33:34.129297] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-22T21:33:34.135309] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:33:34.922105] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-22T21:33:34.974774] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T21:33:34.982603] [INFO ] [REMOTE ] TDC: Full fetch complete (66728 records). [2025-09-22T21:33:34.982757] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-22T21:33:35.378086] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-22T21:33:35.378397] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-22T21:33:35.379553] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-22T21:33:35.379616] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-22T21:33:35.380983] [DEBUG] [LOCAL ] TDC: Trimmed 66728 records to 46931 (keeping 200 days of data) [2025-09-22T21:33:35.674446] [DEBUG] [LOCAL ] TDC: Primary data saved (46931 records). [2025-09-22T21:33:35.674585] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-22T21:33:35.674741] [INFO ] [MAIN ] Update Progress: 2058/2372 symbols completed. TDC took 33.4s. Estimated remaining: 41m 44s. Rate: 7.5 symbols/min [2025-09-22T21:33:35.738368] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-22T21:33:35.846861] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:33:35.889309] [DEBUG] [LOCAL ] TDW: Loaded 46386 existing records from primary storage. [2025-09-22T21:33:35.889448] [INFO ] [MAIN ] TDW: Loaded 46386 existing records. [2025-09-22T21:33:36.081835] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:33:36.082290] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-22T21:33:36.082366] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-22T21:33:36.083680] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-22T21:33:36.083755] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-22T21:33:36.455473] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:33:36.504958] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T21:33:36.506890] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-22T21:33:36.526591] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-22T21:33:37.322096] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-22T21:33:38.122033] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-22T21:33:38.224685] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T21:33:38.778019] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T21:33:38.922106] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-22T21:33:39.722022] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-22T21:33:40.235361] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-22T21:33:40.288858] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (4.55 seconds). [2025-09-22T21:33:40.503100] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T21:33:40.522030] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-22T21:33:41.241598] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T21:33:41.322077] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-22T21:33:42.060698] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T21:33:42.122053] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-22T21:33:42.664918] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T21:33:42.922062] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-22T21:33:43.611325] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T21:33:43.722059] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-22T21:33:44.522071] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-22T21:33:44.640403] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T21:33:45.310846] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T21:33:45.322001] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-22T21:33:45.690072] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T21:33:46.122098] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-22T21:33:46.922565] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-22T21:33:46.924750] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-22T21:33:47.722121] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-22T21:33:48.089306] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-22T21:33:48.522074] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-22T21:33:48.669593] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T21:33:49.195832] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T21:33:49.322049] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-22T21:33:50.122103] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-22T21:33:50.390086] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T21:33:50.922029] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-22T21:33:51.034472] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T21:33:51.723469] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-22T21:33:51.729159] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T21:33:52.522061] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-22T21:33:53.037137] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-22T21:33:53.322062] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-22T21:33:53.375471] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T21:33:54.122014] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-22T21:33:54.173780] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T21:33:54.433791] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T21:33:54.922068] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-22T21:33:55.271865] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T21:33:55.278390] [INFO ] [REMOTE ] TDS: Full fetch complete (61467 records). [2025-09-22T21:33:55.278523] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-22T21:33:55.686783] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-22T21:33:55.686881] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-22T21:33:55.688132] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-22T21:33:55.688221] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-22T21:33:55.689560] [DEBUG] [LOCAL ] TDS: Trimmed 61467 records to 42835 (keeping 200 days of data) [2025-09-22T21:33:55.751943] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-22T21:33:55.998206] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T21:33:56.007049] [DEBUG] [LOCAL ] TDS: Primary data saved (42835 records). [2025-09-22T21:33:56.007325] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-22T21:33:56.007890] [INFO ] [MAIN ] Update Progress: 2059/2372 symbols completed. TDS took 22.7s. Estimated remaining: 41m 38s. Rate: 7.5 symbols/min [2025-09-22T21:33:56.183360] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:33:56.206380] [DEBUG] [LOCAL ] TDY: Loaded 23259 existing records from primary storage. [2025-09-22T21:33:56.206512] [INFO ] [MAIN ] TDY: Loaded 23259 existing records. [2025-09-22T21:33:56.388715] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:33:56.388982] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-22T21:33:56.389091] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-22T21:33:56.389806] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-22T21:33:56.389874] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-22T21:33:56.527217] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-22T21:33:56.778549] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:33:57.322076] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-22T21:33:57.871614] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-22T21:33:57.935206] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T21:33:58.122059] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-22T21:33:58.933542] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-22T21:33:58.941893] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:33:59.722042] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-22T21:33:59.875089] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T21:33:59.885100] [INFO ] [REMOTE ] TDOC: Full fetch complete (77271 records). [2025-09-22T21:33:59.885351] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-22T21:34:00.378545] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-22T21:34:00.378753] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-22T21:34:00.380939] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-22T21:34:00.382218] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-22T21:34:00.382103] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T21:34:00.389148] [DEBUG] [LOCAL ] TDOC: Trimmed 77271 records to 53347 (keeping 200 days of data) [2025-09-22T21:34:00.393691] [INFO ] [REMOTE ] TDG: Full fetch complete (32335 records). [2025-09-22T21:34:00.393951] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-22T21:34:00.542454] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-22T21:34:00.934376] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-22T21:34:00.935123] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-22T21:34:00.940264] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-22T21:34:00.941890] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-22T21:34:00.946032] [DEBUG] [LOCAL ] TDG: Trimmed 32335 records to 22170 (keeping 200 days of data) [2025-09-22T21:34:01.231955] [DEBUG] [LOCAL ] TDG: Primary data saved (22170 records). [2025-09-22T21:34:01.232342] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-22T21:34:01.232555] [INFO ] [MAIN ] Update Progress: 2060/2372 symbols completed. TDG took 40.8s. Estimated remaining: 41m 30s. Rate: 7.5 symbols/min [2025-09-22T21:34:01.521312] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:34:01.494261] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T21:34:01.523179] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-22T21:34:01.523583] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-22T21:34:01.535579] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-22T21:34:01.537114] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-22T21:34:01.538175] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-22T21:34:01.538267] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-22T21:34:01.581842] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-22T21:34:01.654484] [DEBUG] [LOCAL ] TDOC: Primary data saved (53347 records). [2025-09-22T21:34:01.655010] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-22T21:34:01.655439] [INFO ] [MAIN ] Update Progress: 2061/2372 symbols completed. TDOC took 36.8s. Estimated remaining: 41m 20s. Rate: 7.5 symbols/min [2025-09-22T21:34:02.073448] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:34:02.086726] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T21:34:02.133206] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-22T21:34:02.172944] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:34:02.177034] [DEBUG] [LOCAL ] TEAF: Loaded 7367 existing records from primary storage. [2025-09-22T21:34:02.177485] [INFO ] [MAIN ] TEAF: Loaded 7367 existing records. [2025-09-22T21:34:02.361160] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:34:02.361456] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-22T21:34:02.361511] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-22T21:34:02.361856] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-22T21:34:02.361914] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-22T21:34:02.714536] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:34:02.922069] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-22T21:34:03.030079] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T21:34:03.147808] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:34:03.148281] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-22T21:34:03.392774] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T21:34:03.722132] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-22T21:34:04.522124] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-09-22T21:34:04.784155] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:34:04.784619] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-09-22T21:34:05.275764] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T21:34:05.282921] [INFO ] [REMOTE ] TDW: Full fetch complete (67242 records). [2025-09-22T21:34:05.283119] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-22T21:34:05.327300] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-22T21:34:05.639596] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:34:05.666939] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-22T21:34:05.697019] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-22T21:34:05.697095] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-22T21:34:05.698262] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-22T21:34:05.698333] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-22T21:34:05.699800] [DEBUG] [LOCAL ] TDW: Trimmed 67242 records to 45528 (keeping 200 days of data) [2025-09-22T21:34:05.973000] [DEBUG] [LOCAL ] TDW: Primary data saved (45528 records). [2025-09-22T21:34:05.973145] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-22T21:34:05.973305] [INFO ] [MAIN ] Update Progress: 2062/2372 symbols completed. TDW took 30.3s. Estimated remaining: 41m 12s. Rate: 7.5 symbols/min [2025-09-22T21:34:06.131190] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-22T21:34:06.161439] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:34:06.216136] [DEBUG] [LOCAL ] TECK: Loaded 54219 existing records from primary storage. [2025-09-22T21:34:06.216295] [INFO ] [MAIN ] TECK: Loaded 54219 existing records. [2025-09-22T21:34:06.393324] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:34:06.393582] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-22T21:34:06.393630] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-22T21:34:06.395134] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-22T21:34:06.395195] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-22T21:34:06.746216] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:34:06.922048] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-22T21:34:07.722025] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-22T21:34:07.750534] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T21:34:08.522032] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-22T21:34:08.607544] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T21:34:08.929225] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T21:34:09.322075] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-22T21:34:10.059975] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T21:34:10.122019] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-22T21:34:10.524725] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T21:34:10.922096] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-22T21:34:11.566835] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T21:34:11.729448] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-22T21:34:11.752386] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-22T21:34:12.522063] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-22T21:34:13.322027] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-22T21:34:13.427547] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T21:34:13.779446] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T21:34:13.836586] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-22T21:34:14.122071] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-22T21:34:14.922057] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-22T21:34:15.722064] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-22T21:34:15.812775] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T21:34:15.852716] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-22T21:34:16.522107] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-22T21:34:17.322027] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-22T21:34:17.608789] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T21:34:17.686258] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T21:34:17.896600] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T21:34:18.122063] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-22T21:34:18.859931] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-22T21:34:18.922021] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-22T21:34:19.722107] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-22T21:34:20.354515] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T21:34:20.522068] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-22T21:34:21.095970] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T21:34:21.322061] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-22T21:34:22.034756] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-22T21:34:22.122055] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-22T21:34:22.922066] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-22T21:34:23.103385] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T21:34:23.722031] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-22T21:34:23.791065] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T21:34:23.945872] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T21:34:24.522061] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-22T21:34:25.133542] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T21:34:25.322077] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-22T21:34:25.385738] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T21:34:25.393258] [INFO ] [REMOTE ] TE: Full fetch complete (45913 records). [2025-09-22T21:34:25.393361] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-22T21:34:25.605022] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 141 unique days, need 200 days [2025-09-22T21:34:25.605626] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:34:25.605719] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:34:25.605795] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-22T21:34:25.605864] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-22T21:34:25.605900] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-22T21:34:25.605953] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-22T21:34:25.606037] [INFO ] [MAIN ] Update Progress: 2063/2372 symbols completed. TE took 24.4s. Estimated remaining: 41m 6s. Rate: 7.5 symbols/min [2025-09-22T21:34:25.773720] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:34:25.819933] [DEBUG] [LOCAL ] TEF: Loaded 38107 existing records from primary storage. [2025-09-22T21:34:25.820196] [INFO ] [MAIN ] TEF: Loaded 38107 existing records. [2025-09-22T21:34:26.001581] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:34:26.002020] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-22T21:34:26.002077] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-22T21:34:26.003736] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-22T21:34:26.003797] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-22T21:34:26.127558] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-22T21:34:26.127822] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-22T21:34:26.389790] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:34:26.922056] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-22T21:34:27.722129] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-22T21:34:27.943044] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T21:34:28.522040] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-22T21:34:28.691309] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T21:34:28.749101] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-22T21:34:29.322052] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-22T21:34:30.122101] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-22T21:34:30.190835] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T21:34:30.225490] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T21:34:30.229007] [INFO ] [REMOTE ] TDY: Full fetch complete (32266 records). [2025-09-22T21:34:30.229149] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-22T21:34:30.625941] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-22T21:34:30.626029] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-22T21:34:30.626732] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-22T21:34:30.626793] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-22T21:34:30.627544] [DEBUG] [LOCAL ] TDY: Trimmed 32266 records to 22743 (keeping 200 days of data) [2025-09-22T21:34:30.776454] [DEBUG] [LOCAL ] TDY: Primary data saved (22743 records). [2025-09-22T21:34:30.776683] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-22T21:34:30.776801] [INFO ] [MAIN ] Update Progress: 2064/2372 symbols completed. TDY took 34.8s. Estimated remaining: 40m 57s. Rate: 7.5 symbols/min [2025-09-22T21:34:30.883511] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T21:34:30.927123] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-22T21:34:30.960165] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:34:30.981247] [DEBUG] [LOCAL ] TEI: Loaded 20713 existing records from primary storage. [2025-09-22T21:34:30.981383] [INFO ] [MAIN ] TEI: Loaded 20713 existing records. [2025-09-22T21:34:31.156073] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:34:31.156336] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-22T21:34:31.156384] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-22T21:34:31.156972] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-22T21:34:31.157044] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-22T21:34:31.516975] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:34:31.704574] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-22T21:34:31.722006] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-22T21:34:32.398315] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T21:34:32.399980] [INFO ] [REMOTE ] TEAF: Full fetch complete (9784 records). [2025-09-22T21:34:32.400051] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-22T21:34:32.527170] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-22T21:34:32.779599] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-22T21:34:32.779703] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-22T21:34:32.779982] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-22T21:34:32.780023] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-22T21:34:32.780469] [DEBUG] [LOCAL ] TEAF: Trimmed 9784 records to 7291 (keeping 200 days of data) [2025-09-22T21:34:32.824350] [DEBUG] [LOCAL ] TEAF: Primary data saved (7291 records). [2025-09-22T21:34:32.824446] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-22T21:34:32.824525] [INFO ] [MAIN ] Update Progress: 2065/2372 symbols completed. TEAF took 31.2s. Estimated remaining: 40m 48s. Rate: 7.5 symbols/min [2025-09-22T21:34:32.998924] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:34:33.055507] [DEBUG] [LOCAL ] TEL: Loaded 51925 existing records from primary storage. [2025-09-22T21:34:33.055685] [INFO ] [MAIN ] TEL: Loaded 51925 existing records. [2025-09-22T21:34:33.234815] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:34:33.235073] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-22T21:34:33.235120] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-22T21:34:33.236324] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-22T21:34:33.236386] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-22T21:34:33.327222] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-22T21:34:33.595144] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:34:34.122059] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-22T21:34:34.236840] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T21:34:34.319854] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T21:34:34.922052] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-22T21:34:35.722029] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-22T21:34:35.846915] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T21:34:35.885127] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T21:34:36.522082] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-22T21:34:37.322026] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-22T21:34:37.420373] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T21:34:38.122034] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-22T21:34:38.315971] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T21:34:38.442763] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T21:34:38.922042] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-22T21:34:39.722019] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-22T21:34:39.903676] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T21:34:40.258988] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T21:34:40.522110] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-22T21:34:41.322044] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-22T21:34:41.546246] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-22T21:34:41.558261] [INFO ] [REMOTE ] TECK: Full fetch complete (77298 records). [2025-09-22T21:34:41.558484] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-22T21:34:41.996509] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-22T21:34:41.996780] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-22T21:34:41.998736] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-22T21:34:41.998907] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-22T21:34:42.001202] [DEBUG] [LOCAL ] TECK: Trimmed 77298 records to 53437 (keeping 200 days of data) [2025-09-22T21:34:42.122730] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-22T21:34:42.360838] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T21:34:42.399077] [DEBUG] [LOCAL ] TECK: Primary data saved (53437 records). [2025-09-22T21:34:42.399248] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-22T21:34:42.399345] [INFO ] [MAIN ] Update Progress: 2066/2372 symbols completed. TECK took 36.4s. Estimated remaining: 40m 41s. Rate: 7.5 symbols/min [2025-09-22T21:34:42.570783] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:34:42.604121] [DEBUG] [LOCAL ] TEN: Loaded 31614 existing records from primary storage. [2025-09-22T21:34:42.604263] [INFO ] [MAIN ] TEN: Loaded 31614 existing records. [2025-09-22T21:34:42.788687] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:34:42.789033] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-22T21:34:42.789167] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-22T21:34:42.798726] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-22T21:34:42.815495] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-22T21:34:42.862715] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T21:34:42.922252] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-22T21:34:43.202853] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:34:43.217491] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T21:34:43.722094] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-22T21:34:44.527186] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-22T21:34:44.542740] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T21:34:44.810497] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T21:34:45.322073] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-22T21:34:45.948782] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-22T21:34:46.122060] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-22T21:34:46.837931] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T21:34:46.922030] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-22T21:34:47.440032] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-22T21:34:47.722110] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-22T21:34:48.320950] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T21:34:48.522020] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-22T21:34:48.721952] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T21:34:49.322058] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-22T21:34:49.649686] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-22T21:34:50.122055] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-22T21:34:50.922020] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-22T21:34:51.072620] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T21:34:51.095674] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-22T21:34:51.722081] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-22T21:34:52.307901] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T21:34:52.522072] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-22T21:34:52.734639] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T21:34:53.322063] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-22T21:34:53.598523] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T21:34:54.122067] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-22T21:34:54.741026] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T21:34:54.922085] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-22T21:34:55.733567] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-22T21:34:55.739782] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T21:34:55.785531] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T21:34:56.522087] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-22T21:34:57.119847] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T21:34:57.129081] [INFO ] [REMOTE ] TEF: Full fetch complete (54450 records). [2025-09-22T21:34:57.129296] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-22T21:34:57.327268] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-22T21:34:57.675287] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-22T21:34:57.675435] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-22T21:34:57.676905] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-22T21:34:57.676985] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-22T21:34:57.678591] [DEBUG] [LOCAL ] TEF: Trimmed 54450 records to 37410 (keeping 200 days of data) [2025-09-22T21:34:57.948152] [DEBUG] [LOCAL ] TEF: Primary data saved (37410 records). [2025-09-22T21:34:57.948374] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-22T21:34:57.948509] [INFO ] [MAIN ] Update Progress: 2067/2372 symbols completed. TEF took 32.3s. Estimated remaining: 40m 34s. Rate: 7.5 symbols/min [2025-09-22T21:34:58.122736] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-22T21:34:58.158313] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:34:58.182742] [DEBUG] [LOCAL ] TEO: Loaded 22044 existing records from primary storage. [2025-09-22T21:34:58.182998] [INFO ] [MAIN ] TEO: Loaded 22044 existing records. [2025-09-22T21:34:58.367080] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:34:58.367899] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-22T21:34:58.368097] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-22T21:34:58.377875] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-22T21:34:58.394614] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-22T21:34:58.428513] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T21:34:58.488440] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T21:34:58.528516] [INFO ] [REMOTE ] TEI: Full fetch complete (29765 records). [2025-09-22T21:34:58.529493] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-22T21:34:58.931619] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-22T21:34:59.121215] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:34:59.184187] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-22T21:34:59.184255] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-22T21:34:59.184861] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-22T21:34:59.184922] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-22T21:34:59.185679] [DEBUG] [LOCAL ] TEI: Trimmed 29765 records to 20379 (keeping 200 days of data) [2025-09-22T21:34:59.308867] [DEBUG] [LOCAL ] TEI: Primary data saved (20379 records). [2025-09-22T21:34:59.308993] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-22T21:34:59.309076] [INFO ] [MAIN ] Update Progress: 2068/2372 symbols completed. TEI took 28.5s. Estimated remaining: 40m 25s. Rate: 7.5 symbols/min [2025-09-22T21:34:59.483104] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:34:59.538785] [DEBUG] [LOCAL ] TEVA: Loaded 54412 existing records from primary storage. [2025-09-22T21:34:59.538925] [INFO ] [MAIN ] TEVA: Loaded 54412 existing records. [2025-09-22T21:34:59.703849] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:34:59.743240] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-22T21:34:59.750299] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:34:59.750604] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-22T21:34:59.751521] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-22T21:34:59.753045] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-22T21:34:59.753108] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-22T21:35:00.134476] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:35:00.522012] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-22T21:35:00.707848] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T21:35:00.962022] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T21:35:01.322063] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-22T21:35:01.683052] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T21:35:02.122095] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-22T21:35:02.922076] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-22T21:35:03.211899] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T21:35:03.413275] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T21:35:03.722111] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-22T21:35:04.522035] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-22T21:35:04.686475] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T21:35:04.902252] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-22T21:35:05.322057] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-22T21:35:05.724864] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T21:35:06.122063] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-22T21:35:06.922070] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-22T21:35:07.132300] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T21:35:07.229092] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T21:35:07.722059] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-22T21:35:08.522111] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-22T21:35:08.734109] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T21:35:09.330099] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-22T21:35:09.332615] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T21:35:09.340839] [INFO ] [REMOTE ] TEL: Full fetch complete (73248 records). [2025-09-22T21:35:09.340964] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-22T21:35:09.749199] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T21:35:09.808815] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-22T21:35:09.808971] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-22T21:35:09.810389] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-22T21:35:09.810460] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-22T21:35:09.812215] [DEBUG] [LOCAL ] TEL: Trimmed 73248 records to 51150 (keeping 200 days of data) [2025-09-22T21:35:10.126824] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-22T21:35:10.151500] [DEBUG] [LOCAL ] TEL: Primary data saved (51150 records). [2025-09-22T21:35:10.151695] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-22T21:35:10.153723] [INFO ] [MAIN ] Update Progress: 2069/2372 symbols completed. TEL took 37.3s. Estimated remaining: 40m 17s. Rate: 7.5 symbols/min [2025-09-22T21:35:10.335469] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:35:10.394202] [DEBUG] [LOCAL ] TEX: Loaded 45628 existing records from primary storage. [2025-09-22T21:35:10.394365] [INFO ] [MAIN ] TEX: Loaded 45628 existing records. [2025-09-22T21:35:10.624935] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:35:10.625186] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-22T21:35:10.625233] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-22T21:35:10.626381] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-22T21:35:10.626445] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-22T21:35:10.927148] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-22T21:35:11.012843] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:35:11.218268] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T21:35:11.650780] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-22T21:35:11.722097] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-22T21:35:12.276180] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T21:35:12.522027] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-22T21:35:12.818148] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T21:35:13.322090] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-22T21:35:13.898123] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T21:35:14.122082] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-22T21:35:14.922077] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-22T21:35:15.330265] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T21:35:15.336465] [INFO ] [REMOTE ] TEN: Full fetch complete (44918 records). [2025-09-22T21:35:15.336754] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-22T21:35:15.659511] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-22T21:35:15.727150] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-22T21:35:15.801922] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-22T21:35:15.802105] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-22T21:35:15.803974] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-22T21:35:15.804408] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-22T21:35:15.806696] [DEBUG] [LOCAL ] TEN: Trimmed 44918 records to 31061 (keeping 200 days of data) [2025-09-22T21:35:15.823943] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-22T21:35:16.029578] [DEBUG] [LOCAL ] TEN: Primary data saved (31061 records). [2025-09-22T21:35:16.029744] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-22T21:35:16.029886] [INFO ] [MAIN ] Update Progress: 2070/2372 symbols completed. TEN took 33.6s. Estimated remaining: 40m 9s. Rate: 7.5 symbols/min [2025-09-22T21:35:16.199804] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:35:16.278803] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-22T21:35:16.279000] [INFO ] [MAIN ] TFC: Loaded 54447 existing records. [2025-09-22T21:35:16.485662] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:35:16.485982] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-22T21:35:16.486066] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-22T21:35:16.487223] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-22T21:35:16.487311] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-22T21:35:16.532128] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-22T21:35:16.861610] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:35:17.300174] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T21:35:17.322005] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-22T21:35:17.667890] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-22T21:35:18.122065] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-22T21:35:18.870419] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T21:35:18.922068] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-22T21:35:19.325091] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T21:35:19.331108] [INFO ] [REMOTE ] TEO: Full fetch complete (32723 records). [2025-09-22T21:35:19.331239] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-22T21:35:19.730759] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-22T21:35:19.728789] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-22T21:35:19.731701] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-22T21:35:19.732391] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-22T21:35:19.732444] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-22T21:35:19.733469] [DEBUG] [LOCAL ] TEO: Trimmed 32723 records to 21805 (keeping 200 days of data) [2025-09-22T21:35:19.872465] [DEBUG] [LOCAL ] TEO: Primary data saved (21805 records). [2025-09-22T21:35:19.872600] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-22T21:35:19.872713] [INFO ] [MAIN ] Update Progress: 2071/2372 symbols completed. TEO took 21.9s. Estimated remaining: 40m 0s. Rate: 7.5 symbols/min [2025-09-22T21:35:20.047522] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:35:20.091079] [DEBUG] [LOCAL ] TFII: Loaded 35312 existing records from primary storage. [2025-09-22T21:35:20.091224] [INFO ] [MAIN ] TFII: Loaded 35312 existing records. [2025-09-22T21:35:20.280009] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:35:20.280319] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-22T21:35:20.280454] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-22T21:35:20.281744] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-22T21:35:20.281808] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-22T21:35:20.551476] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-22T21:35:20.566044] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T21:35:20.681204] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:35:21.322032] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-22T21:35:21.502897] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T21:35:22.122054] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-22T21:35:22.548311] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T21:35:22.897352] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T21:35:22.922003] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-22T21:35:23.297837] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T21:35:23.722061] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-22T21:35:24.522073] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-22T21:35:24.577953] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-22T21:35:25.322027] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-22T21:35:25.786887] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T21:35:25.786071] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-22T21:35:26.122105] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-22T21:35:26.730429] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T21:35:26.922043] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-22T21:35:27.722080] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-22T21:35:28.132830] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-22T21:35:28.326246] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T21:35:28.522081] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-22T21:35:29.066594] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T21:35:29.322084] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-22T21:35:30.122044] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-22T21:35:30.313347] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T21:35:30.922043] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-22T21:35:30.977720] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T21:35:31.675866] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T21:35:31.722019] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-22T21:35:32.522054] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-22T21:35:32.644449] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T21:35:33.322074] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-22T21:35:33.453205] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T21:35:34.122107] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-22T21:35:34.234271] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T21:35:34.922076] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-22T21:35:35.344499] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T21:35:35.651152] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T21:35:35.722068] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-22T21:35:36.365488] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T21:35:36.522099] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-22T21:35:37.322143] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-22T21:35:37.547052] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T21:35:38.122047] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-22T21:35:38.313567] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T21:35:38.322780] [INFO ] [REMOTE ] TEVA: Full fetch complete (77671 records). [2025-09-22T21:35:38.322907] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-22T21:35:38.735006] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-22T21:35:38.735122] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-22T21:35:38.736344] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-22T21:35:38.736521] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-22T21:35:38.755506] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T21:35:38.761948] [DEBUG] [LOCAL ] TEVA: Trimmed 77671 records to 53633 (keeping 200 days of data) [2025-09-22T21:35:38.762983] [INFO ] [REMOTE ] TEX: Full fetch complete (64702 records). [2025-09-22T21:35:38.763078] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-22T21:35:38.945664] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-22T21:35:39.298817] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-22T21:35:39.299690] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-22T21:35:39.302405] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-22T21:35:39.302815] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-22T21:35:39.356510] [DEBUG] [LOCAL ] TEX: Trimmed 64702 records to 44750 (keeping 200 days of data) [2025-09-22T21:35:39.736733] [DEBUG] [LOCAL ] TEVA: Primary data saved (53633 records). [2025-09-22T21:35:39.737358] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-22T21:35:39.737733] [INFO ] [MAIN ] Update Progress: 2072/2372 symbols completed. TEVA took 40.4s. Estimated remaining: 39m 54s. Rate: 7.5 symbols/min [2025-09-22T21:35:39.925466] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:35:39.988464] [DEBUG] [LOCAL ] TFIN: Loaded 23958 existing records from primary storage. [2025-09-22T21:35:39.990347] [INFO ] [MAIN ] TFIN: Loaded 23958 existing records. [2025-09-22T21:35:40.071022] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T21:35:40.111347] [DEBUG] [LOCAL ] TEX: Primary data saved (44750 records). [2025-09-22T21:35:40.132766] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-22T21:35:40.139969] [INFO ] [MAIN ] Update Progress: 2073/2372 symbols completed. TEX took 30.0s. Estimated remaining: 39m 45s. Rate: 7.5 symbols/min [2025-09-22T21:35:40.143711] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-22T21:35:40.328612] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:35:40.332433] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-22T21:35:40.338040] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-22T21:35:40.387241] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-22T21:35:40.407059] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-22T21:35:40.406767] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:35:40.538259] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T21:35:40.585353] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-22T21:35:40.784468] [DEBUG] [LOCAL ] TFPM: Loaded 37558 existing records from primary storage. [2025-09-22T21:35:40.794902] [INFO ] [MAIN ] TFPM: Loaded 37558 existing records. [2025-09-22T21:35:40.955020] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:35:41.035251] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:35:41.035539] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-22T21:35:41.035590] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-22T21:35:41.036494] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-22T21:35:41.036554] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-22T21:35:41.327337] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-22T21:35:41.393867] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:35:42.093251] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-22T21:35:42.122070] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-22T21:35:42.201723] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-22T21:35:42.318298] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T21:35:42.922062] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-22T21:35:43.377237] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T21:35:43.722098] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-22T21:35:44.522049] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-22T21:35:44.750975] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T21:35:44.889177] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T21:35:45.322051] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-22T21:35:45.835110] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T21:35:46.122039] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-22T21:35:46.592069] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T21:35:46.922091] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-22T21:35:47.136169] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T21:35:47.722084] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-22T21:35:48.220153] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T21:35:48.522059] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-22T21:35:49.322026] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-22T21:35:49.521916] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T21:35:49.711435] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T21:35:50.122052] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-22T21:35:50.737201] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T21:35:50.922026] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-22T21:35:51.238673] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T21:35:51.722014] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-22T21:35:52.088705] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T21:35:52.093629] [INFO ] [REMOTE ] TFII: Full fetch complete (47559 records). [2025-09-22T21:35:52.093763] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-22T21:35:52.494109] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-22T21:35:52.494196] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-22T21:35:52.495126] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-22T21:35:52.495201] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-22T21:35:52.496357] [DEBUG] [LOCAL ] TFII: Trimmed 47559 records to 34464 (keeping 200 days of data) [2025-09-22T21:35:52.553159] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-22T21:35:52.716500] [DEBUG] [LOCAL ] TFII: Primary data saved (34464 records). [2025-09-22T21:35:52.716629] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-22T21:35:52.716760] [INFO ] [MAIN ] Update Progress: 2074/2372 symbols completed. TFII took 32.8s. Estimated remaining: 39m 38s. Rate: 7.5 symbols/min [2025-09-22T21:35:52.899306] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:35:52.947199] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T21:35:52.967726] [DEBUG] [LOCAL ] TFX: Loaded 38306 existing records from primary storage. [2025-09-22T21:35:52.967861] [INFO ] [MAIN ] TFX: Loaded 38306 existing records. [2025-09-22T21:35:53.146105] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:35:53.146364] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-22T21:35:53.146424] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-22T21:35:53.147399] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-22T21:35:53.147470] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-22T21:35:53.330372] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-22T21:35:53.520529] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:35:53.845333] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-22T21:35:54.122046] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-22T21:35:54.922047] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-22T21:35:55.209500] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T21:35:55.567091] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-22T21:35:55.722054] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-22T21:35:56.319391] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T21:35:56.522048] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-22T21:35:57.264917] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T21:35:57.322051] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-22T21:35:57.569883] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-22T21:35:58.122061] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-22T21:35:58.503895] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T21:35:58.922021] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-22T21:35:59.227255] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T21:35:59.722046] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-22T21:36:00.103215] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T21:36:00.522013] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-22T21:36:00.932400] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-22T21:36:01.322064] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-22T21:36:02.122068] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-22T21:36:02.160916] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T21:36:02.169434] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-09-22T21:36:02.169602] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-22T21:36:02.579394] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-22T21:36:02.579474] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-22T21:36:02.580621] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-22T21:36:02.580708] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-22T21:36:02.582146] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 53667 (keeping 200 days of data) [2025-09-22T21:36:02.922084] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-22T21:36:02.943681] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-09-22T21:36:02.943794] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-22T21:36:02.943901] [INFO ] [MAIN ] Update Progress: 2075/2372 symbols completed. TFC took 46.9s. Estimated remaining: 39m 30s. Rate: 7.5 symbols/min [2025-09-22T21:36:03.160691] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:36:03.171999] [DEBUG] [LOCAL ] TG: Loaded 10626 existing records from primary storage. [2025-09-22T21:36:03.172105] [INFO ] [MAIN ] TG: Loaded 10626 existing records. [2025-09-22T21:36:03.364880] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:36:03.365307] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-22T21:36:03.365368] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-22T21:36:03.365872] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-22T21:36:03.365935] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-22T21:36:03.732330] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-22T21:36:03.780690] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-22T21:36:03.780339] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:36:04.290786] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T21:36:04.522059] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-22T21:36:05.069785] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-22T21:36:05.076868] [INFO ] [REMOTE ] TFPM: Full fetch complete (50270 records). [2025-09-22T21:36:05.076989] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-22T21:36:05.323483] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-22T21:36:05.484211] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-22T21:36:05.484388] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-22T21:36:05.485507] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-22T21:36:05.485575] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-22T21:36:05.487215] [DEBUG] [LOCAL ] TFPM: Trimmed 50270 records to 37199 (keeping 200 days of data) [2025-09-22T21:36:05.593995] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T21:36:05.600210] [INFO ] [REMOTE ] TFIN: Full fetch complete (30758 records). [2025-09-22T21:36:05.600360] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-22T21:36:05.844334] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-22T21:36:06.055043] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-22T21:36:06.055532] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-22T21:36:06.056510] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-22T21:36:06.056939] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-22T21:36:06.060446] [DEBUG] [LOCAL ] TFIN: Trimmed 30758 records to 23616 (keeping 200 days of data) [2025-09-22T21:36:06.123625] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-22T21:36:06.283319] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T21:36:06.303256] [DEBUG] [LOCAL ] TFPM: Primary data saved (37199 records). [2025-09-22T21:36:06.303931] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-22T21:36:06.304316] [INFO ] [MAIN ] Update Progress: 2076/2372 symbols completed. TFPM took 26.2s. Estimated remaining: 39m 22s. Rate: 7.5 symbols/min [2025-09-22T21:36:06.506232] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:36:06.507737] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-22T21:36:06.508084] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-22T21:36:06.509402] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-22T21:36:06.509801] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-22T21:36:06.510441] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-22T21:36:06.510821] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-22T21:36:06.555262] [DEBUG] [LOCAL ] TFIN: Primary data saved (23616 records). [2025-09-22T21:36:06.583305] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-22T21:36:06.589163] [INFO ] [MAIN ] Update Progress: 2077/2372 symbols completed. TFIN took 26.9s. Estimated remaining: 39m 12s. Rate: 7.5 symbols/min [2025-09-22T21:36:06.880230] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:36:06.922007] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-22T21:36:07.135268] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:36:07.135726] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-22T21:36:07.722062] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-22T21:36:07.846560] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T21:36:08.522123] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-09-22T21:36:08.535555] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T21:36:08.716271] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:36:08.716625] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-09-22T21:36:09.322057] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-22T21:36:09.570842] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:36:09.571177] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-22T21:36:10.122060] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-22T21:36:10.505507] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:36:10.505878] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-22T21:36:10.922046] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-22T21:36:11.608712] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T21:36:11.722059] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-22T21:36:12.522100] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-22T21:36:13.008486] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-22T21:36:13.322107] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-22T21:36:14.122084] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-22T21:36:14.189686] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-22T21:36:14.628382] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:36:14.628859] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-22T21:36:14.654978] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-22T21:36:14.922074] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-22T21:36:15.722072] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-22T21:36:15.892009] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T21:36:16.522094] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-22T21:36:17.044058] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:36:17.056857] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-22T21:36:17.058779] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-22T21:36:17.322061] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-22T21:36:18.110060] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T21:36:18.122004] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-22T21:36:18.883371] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T21:36:18.922042] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-22T21:36:19.722076] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-22T21:36:19.759266] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T21:36:20.522061] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-22T21:36:20.774707] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T21:36:21.322062] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-22T21:36:21.771549] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T21:36:22.122074] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-22T21:36:22.535093] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-22T21:36:22.922040] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-22T21:36:23.514807] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T21:36:23.722061] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-22T21:36:23.758119] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-22T21:36:24.522084] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-22T21:36:25.134001] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T21:36:25.141224] [INFO ] [REMOTE ] TFX: Full fetch complete (54088 records). [2025-09-22T21:36:25.141377] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-22T21:36:25.327597] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-22T21:36:25.548349] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-22T21:36:25.548448] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-22T21:36:25.549502] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-22T21:36:25.549566] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-22T21:36:25.551443] [DEBUG] [LOCAL ] TFX: Trimmed 54088 records to 37490 (keeping 200 days of data) [2025-09-22T21:36:25.659116] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T21:36:25.671742] [INFO ] [REMOTE ] TGE: Full fetch complete (8566 records). [2025-09-22T21:36:25.675010] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-22T21:36:25.901006] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 75 unique days, need 200 days [2025-09-22T21:36:25.901332] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:36:25.901408] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:36:25.901470] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-22T21:36:25.901539] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-22T21:36:25.901579] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-22T21:36:25.901638] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-22T21:36:25.901763] [INFO ] [MAIN ] Update Progress: 2078/2372 symbols completed. TGE took 19.6s. Estimated remaining: 39m 6s. Rate: 7.5 symbols/min [2025-09-22T21:36:26.012620] [DEBUG] [LOCAL ] TFX: Primary data saved (37490 records). [2025-09-22T21:36:26.012808] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-22T21:36:26.012905] [INFO ] [MAIN ] Update Progress: 2079/2372 symbols completed. TFX took 33.3s. Estimated remaining: 38m 57s. Rate: 7.5 symbols/min [2025-09-22T21:36:26.096484] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-22T21:36:26.099045] [INFO ] [REMOTE ] TG: Full fetch complete (15320 records). [2025-09-22T21:36:26.099117] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-22T21:36:26.469091] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-22T21:36:26.469171] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-22T21:36:26.469531] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-22T21:36:26.469569] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-22T21:36:26.470139] [DEBUG] [LOCAL ] TG: Trimmed 15320 records to 10477 (keeping 200 days of data) [2025-09-22T21:36:26.530109] [DEBUG] [LOCAL ] TG: Primary data saved (10477 records). [2025-09-22T21:36:26.530270] [INFO ] [MAIN ] TG: Full history saved. [2025-09-22T21:36:26.530367] [INFO ] [MAIN ] Update Progress: 2080/2372 symbols completed. TG took 23.6s. Estimated remaining: 38m 48s. Rate: 7.5 symbols/min [2025-09-22T21:36:27.138355] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:36:27.198362] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:36:27.265522] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:36:27.286973] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:36:27.330795] [DEBUG] [LOCAL ] TGS: Loaded 32870 existing records from primary storage. [2025-09-22T21:36:27.330976] [INFO ] [MAIN ] TGS: Loaded 32870 existing records. [2025-09-22T21:36:27.393105] [DEBUG] [LOCAL ] TGLS: Loaded 28984 existing records from primary storage. [2025-09-22T21:36:27.459499] [INFO ] [MAIN ] TGLS: Loaded 28984 existing records. [2025-09-22T21:36:27.625053] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-22T21:36:27.630390] [INFO ] [MAIN ] TGT: Loaded 54558 existing records. [2025-09-22T21:36:27.642887] [DEBUG] [LOCAL ] TGNA: Loaded 49434 existing records from primary storage. [2025-09-22T21:36:27.715183] [INFO ] [MAIN ] TGNA: Loaded 49434 existing records. [2025-09-22T21:36:27.821726] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:36:27.871483] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-22T21:36:27.871702] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-22T21:36:27.909422] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-22T21:36:27.958842] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-22T21:36:28.018818] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:36:28.136105] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-22T21:36:28.164270] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-22T21:36:28.292930] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:36:28.292719] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-22T21:36:28.299028] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-22T21:36:28.352296] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-22T21:36:28.395601] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-22T21:36:28.461034] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:36:28.540945] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-22T21:36:28.548809] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-22T21:36:28.565922] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-22T21:36:28.566147] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-22T21:36:28.566207] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-22T21:36:28.699065] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-22T21:36:29.238379] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:36:29.282989] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-22T21:36:29.255374] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:36:29.345982] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-22T21:36:29.749603] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:36:29.755890] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:36:29.756250] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-22T21:36:29.757318] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-22T21:36:30.639263] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T21:36:30.644796] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-22T21:36:30.724166] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T21:36:30.730478] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-22T21:36:31.228289] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T21:36:31.237964] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-22T21:36:31.901739] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T21:36:31.908258] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-22T21:36:31.949876] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-22T21:36:32.128985] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-22T21:36:32.522042] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-22T21:36:32.760084] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T21:36:33.102868] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T21:36:33.322065] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-22T21:36:34.122039] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-22T21:36:34.518505] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-22T21:36:34.591247] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T21:36:34.922090] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-22T21:36:35.631692] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T21:36:35.722068] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-22T21:36:36.522062] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-22T21:36:36.975878] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-22T21:36:37.108081] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T21:36:37.322060] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-22T21:36:38.119905] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-22T21:36:38.130135] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-22T21:36:38.615976] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T21:36:38.922047] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-22T21:36:39.722072] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-22T21:36:40.277203] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T21:36:40.531850] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-22T21:36:40.537481] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-22T21:36:41.322029] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-22T21:36:41.463082] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-22T21:36:41.874036] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-22T21:36:42.122066] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-22T21:36:42.922062] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-22T21:36:43.580154] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T21:36:43.615707] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-22T21:36:43.716193] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T21:36:43.721998] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-22T21:36:44.522055] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-22T21:36:44.938744] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-22T21:36:45.322054] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-22T21:36:46.122061] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-22T21:36:46.778925] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-22T21:36:46.929431] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-22T21:36:46.935033] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-22T21:36:47.007328] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-22T21:36:47.722065] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-22T21:36:48.522051] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-22T21:36:48.955756] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T21:36:49.075366] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-22T21:36:49.322082] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-22T21:36:49.543108] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T21:36:50.122055] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-22T21:36:50.922024] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-22T21:36:50.955854] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T21:36:51.160731] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T21:36:51.165238] [INFO ] [REMOTE ] TGLS: Full fetch complete (40255 records). [2025-09-22T21:36:51.165327] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-22T21:36:51.559535] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-22T21:36:51.559619] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-22T21:36:51.560477] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-22T21:36:51.560531] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-22T21:36:51.561456] [DEBUG] [LOCAL ] TGLS: Trimmed 40255 records to 28439 (keeping 200 days of data) [2025-09-22T21:36:51.729272] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-22T21:36:51.762704] [DEBUG] [LOCAL ] TGLS: Primary data saved (28439 records). [2025-09-22T21:36:51.762852] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-22T21:36:51.763010] [INFO ] [MAIN ] Update Progress: 2081/2372 symbols completed. TGLS took 25.2s. Estimated remaining: 38m 42s. Rate: 7.5 symbols/min [2025-09-22T21:36:51.951553] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:36:52.007362] [DEBUG] [LOCAL ] THC: Loaded 48988 existing records from primary storage. [2025-09-22T21:36:52.007523] [INFO ] [MAIN ] THC: Loaded 48988 existing records. [2025-09-22T21:36:52.202331] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:36:52.202713] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-22T21:36:52.202781] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-22T21:36:52.203984] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-22T21:36:52.204045] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-22T21:36:52.495592] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T21:36:52.542670] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-22T21:36:52.648223] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:36:53.322068] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-22T21:36:54.026501] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-22T21:36:54.122036] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-22T21:36:54.254904] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T21:36:54.922013] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-22T21:36:55.018432] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T21:36:55.408469] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T21:36:55.722064] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-22T21:36:56.522056] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-22T21:36:56.582051] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:36:57.251619] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T21:36:57.322069] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-22T21:36:57.986597] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T21:36:57.993037] [INFO ] [REMOTE ] TGS: Full fetch complete (47225 records). [2025-09-22T21:36:57.993129] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-22T21:36:58.132597] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-22T21:36:58.375085] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-22T21:36:58.375167] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-22T21:36:58.376098] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-22T21:36:58.376159] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-22T21:36:58.377142] [DEBUG] [LOCAL ] TGS: Trimmed 47225 records to 32397 (keeping 200 days of data) [2025-09-22T21:36:58.568311] [DEBUG] [LOCAL ] TGS: Primary data saved (32397 records). [2025-09-22T21:36:58.568443] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-22T21:36:58.568543] [INFO ] [MAIN ] Update Progress: 2082/2372 symbols completed. TGS took 32.0s. Estimated remaining: 38m 34s. Rate: 7.5 symbols/min [2025-09-22T21:36:58.746163] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:36:58.769282] [DEBUG] [LOCAL ] THG: Loaded 22479 existing records from primary storage. [2025-09-22T21:36:58.769411] [INFO ] [MAIN ] THG: Loaded 22479 existing records. [2025-09-22T21:36:58.932565] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-22T21:36:58.959022] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:36:58.960379] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-22T21:36:58.960521] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-22T21:36:58.969915] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-22T21:36:58.970094] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-22T21:36:59.024904] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T21:36:59.462799] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:36:59.722207] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-22T21:36:59.722128] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T21:36:59.731514] [INFO ] [REMOTE ] TGNA: Full fetch complete (69827 records). [2025-09-22T21:36:59.731614] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-22T21:37:00.137631] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-22T21:37:00.137755] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-22T21:37:00.138993] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-22T21:37:00.139059] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-22T21:37:00.140595] [DEBUG] [LOCAL ] TGNA: Trimmed 69827 records to 48693 (keeping 200 days of data) [2025-09-22T21:37:00.440337] [DEBUG] [LOCAL ] TGNA: Primary data saved (48693 records). [2025-09-22T21:37:00.440474] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-22T21:37:00.440560] [INFO ] [MAIN ] Update Progress: 2083/2372 symbols completed. TGNA took 33.9s. Estimated remaining: 38m 25s. Rate: 7.5 symbols/min [2025-09-22T21:37:00.532954] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-22T21:37:00.620005] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:37:00.624341] [DEBUG] [LOCAL ] THIR: Loaded 2187 existing records from primary storage. [2025-09-22T21:37:00.624428] [INFO ] [MAIN ] THIR: Loaded 2187 existing records. [2025-09-22T21:37:00.816023] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:37:00.816317] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-22T21:37:00.816369] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-22T21:37:00.816593] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-22T21:37:00.816693] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-22T21:37:01.176624] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:37:01.322074] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-22T21:37:01.499289] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-22T21:37:01.571332] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T21:37:01.688799] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-22T21:37:01.845887] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T21:37:02.122090] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-22T21:37:02.922073] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-22T21:37:03.258020] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-22T21:37:03.722113] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-22T21:37:04.146861] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-22T21:37:04.180527] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-22T21:37:04.190159] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-09-22T21:37:04.190425] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-22T21:37:04.527258] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-22T21:37:04.621230] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-22T21:37:04.621312] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-22T21:37:04.622609] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-22T21:37:04.622699] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-22T21:37:04.625575] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 53778 (keeping 200 days of data) [2025-09-22T21:37:04.969358] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-09-22T21:37:04.969504] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-22T21:37:04.969665] [INFO ] [MAIN ] Update Progress: 2084/2372 symbols completed. TGT took 38.4s. Estimated remaining: 38m 17s. Rate: 7.5 symbols/min [2025-09-22T21:37:05.138903] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:37:05.142172] [DEBUG] [LOCAL ] THLV: Loaded 1690 existing records from primary storage. [2025-09-22T21:37:05.142245] [INFO ] [MAIN ] THLV: Loaded 1690 existing records. [2025-09-22T21:37:05.319784] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:37:05.320045] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-22T21:37:05.320092] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-22T21:37:05.320332] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-22T21:37:05.320391] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-22T21:37:05.331543] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-22T21:37:05.692515] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:37:06.122132] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-22T21:37:06.482667] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T21:37:06.477269] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T21:37:06.599270] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-22T21:37:06.922094] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-22T21:37:07.722065] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-22T21:37:08.040433] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T21:37:08.144467] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-22T21:37:08.522069] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-22T21:37:09.322043] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-22T21:37:09.642998] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T21:37:09.708896] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-22T21:37:10.122111] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-22T21:37:10.541960] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-22T21:37:10.922070] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-22T21:37:11.351451] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T21:37:11.722061] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-22T21:37:12.522102] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-22T21:37:12.965789] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-22T21:37:13.094246] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-22T21:37:13.322108] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-22T21:37:13.761435] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-22T21:37:14.122133] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-22T21:37:14.593235] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T21:37:14.922074] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-22T21:37:15.390777] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-22T21:37:15.722128] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-22T21:37:16.180494] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-22T21:37:16.522078] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-22T21:37:17.322068] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-22T21:37:17.751446] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-22T21:37:18.122031] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-22T21:37:18.303191] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T21:37:18.894921] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T21:37:18.922001] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-22T21:37:19.722037] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-22T21:37:19.965885] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T21:37:20.522052] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-22T21:37:20.854631] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-22T21:37:21.322026] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-22T21:37:21.423286] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-22T21:37:21.919798] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-22T21:37:22.122072] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-22T21:37:22.561989] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-22T21:37:22.563020] [INFO ] [REMOTE ] THIR: Full fetch complete (2607 records). [2025-09-22T21:37:22.563118] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-22T21:37:22.931176] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-22T21:37:22.940571] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-22T21:37:22.940697] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-22T21:37:22.940861] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-22T21:37:22.940964] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-22T21:37:22.941416] [DEBUG] [LOCAL ] THIR: Trimmed 2607 records to 2157 (keeping 200 days of data) [2025-09-22T21:37:22.958093] [DEBUG] [LOCAL ] THIR: Primary data saved (2157 records). [2025-09-22T21:37:22.958278] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-22T21:37:22.958502] [INFO ] [MAIN ] Update Progress: 2085/2372 symbols completed. THIR took 22.5s. Estimated remaining: 38m 10s. Rate: 7.5 symbols/min [2025-09-22T21:37:23.135268] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:37:23.199639] [DEBUG] [LOCAL ] THO: Loaded 43130 existing records from primary storage. [2025-09-22T21:37:23.199848] [INFO ] [MAIN ] THO: Loaded 43130 existing records. [2025-09-22T21:37:23.379838] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:37:23.380072] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-22T21:37:23.380138] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-22T21:37:23.381432] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-22T21:37:23.381501] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-22T21:37:23.727243] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-22T21:37:23.781784] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:37:24.162419] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-22T21:37:24.163684] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T21:37:24.522094] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-22T21:37:25.322052] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-22T21:37:25.742379] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-22T21:37:26.073259] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T21:37:26.122019] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-22T21:37:26.922066] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-22T21:37:27.722133] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-22T21:37:27.776478] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T21:37:28.051709] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-22T21:37:28.052713] [INFO ] [REMOTE ] THLV: Full fetch complete (2712 records). [2025-09-22T21:37:28.052819] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-22T21:37:28.470497] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-22T21:37:28.470671] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-22T21:37:28.470964] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-22T21:37:28.471036] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-22T21:37:28.471413] [DEBUG] [LOCAL ] THLV: Trimmed 2712 records to 1635 (keeping 200 days of data) [2025-09-22T21:37:28.483180] [DEBUG] [LOCAL ] THLV: Primary data saved (1635 records). [2025-09-22T21:37:28.483266] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-22T21:37:28.483374] [INFO ] [MAIN ] Update Progress: 2086/2372 symbols completed. THLV took 23.5s. Estimated remaining: 38m 2s. Rate: 7.5 symbols/min [2025-09-22T21:37:28.529437] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-22T21:37:28.679544] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:37:28.733290] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T21:37:28.752111] [DEBUG] [LOCAL ] THQ: Loaded 24661 existing records from primary storage. [2025-09-22T21:37:28.752482] [INFO ] [MAIN ] THQ: Loaded 24661 existing records. [2025-09-22T21:37:28.945269] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:37:28.945553] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-22T21:37:28.945612] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-22T21:37:28.946326] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-22T21:37:28.946410] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-22T21:37:29.332089] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-22T21:37:29.355820] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:37:30.019020] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T21:37:30.122013] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-22T21:37:30.378532] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T21:37:30.922046] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-22T21:37:31.722034] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-22T21:37:31.882101] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T21:37:31.928329] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T21:37:32.522014] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-22T21:37:32.589292] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T21:37:32.593123] [INFO ] [REMOTE ] THG: Full fetch complete (31132 records). [2025-09-22T21:37:32.593216] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-22T21:37:32.979900] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-22T21:37:32.980041] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-22T21:37:32.980784] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-22T21:37:32.980846] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-22T21:37:32.981670] [DEBUG] [LOCAL ] THG: Trimmed 31132 records to 21919 (keeping 200 days of data) [2025-09-22T21:37:33.136028] [DEBUG] [LOCAL ] THG: Primary data saved (21919 records). [2025-09-22T21:37:33.136157] [INFO ] [MAIN ] THG: Full history saved. [2025-09-22T21:37:33.136264] [INFO ] [MAIN ] Update Progress: 2087/2372 symbols completed. THG took 34.6s. Estimated remaining: 37m 54s. Rate: 7.5 symbols/min [2025-09-22T21:37:33.309407] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:37:33.323713] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-22T21:37:33.333764] [DEBUG] [LOCAL ] THR: Loaded 20422 existing records from primary storage. [2025-09-22T21:37:33.333863] [INFO ] [MAIN ] THR: Loaded 20422 existing records. [2025-09-22T21:37:33.528685] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:37:33.529189] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-22T21:37:33.529249] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-22T21:37:33.529935] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-22T21:37:33.529998] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-22T21:37:33.891809] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:37:34.122032] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-22T21:37:34.161477] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T21:37:34.570579] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T21:37:34.922058] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-22T21:37:35.722038] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-22T21:37:35.800871] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T21:37:35.955375] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T21:37:36.522063] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-22T21:37:36.712724] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-22T21:37:37.322078] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-22T21:37:38.122808] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T21:37:38.122904] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-22T21:37:38.451829] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-22T21:37:38.922043] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-22T21:37:39.218592] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T21:37:39.722114] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-22T21:37:40.463816] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T21:37:40.474733] [INFO ] [REMOTE ] THC: Full fetch complete (69573 records). [2025-09-22T21:37:40.474861] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-22T21:37:40.529777] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-22T21:37:40.872374] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-22T21:37:40.872461] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-22T21:37:40.873570] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-22T21:37:40.873635] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-22T21:37:40.875138] [DEBUG] [LOCAL ] THC: Trimmed 69573 records to 48174 (keeping 200 days of data) [2025-09-22T21:37:41.186243] [DEBUG] [LOCAL ] THC: Primary data saved (48174 records). [2025-09-22T21:37:41.186376] [INFO ] [MAIN ] THC: Full history saved. [2025-09-22T21:37:41.186518] [INFO ] [MAIN ] Update Progress: 2088/2372 symbols completed. THC took 49.4s. Estimated remaining: 37m 46s. Rate: 7.5 symbols/min [2025-09-22T21:37:41.329810] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-22T21:37:41.364210] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:37:41.392592] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T21:37:41.446827] [DEBUG] [LOCAL ] THS: Loaded 38516 existing records from primary storage. [2025-09-22T21:37:41.447747] [INFO ] [MAIN ] THS: Loaded 38516 existing records. [2025-09-22T21:37:41.634908] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:37:41.648306] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-22T21:37:41.649026] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-22T21:37:41.649595] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-22T21:37:41.654054] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-22T21:37:41.654574] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-22T21:37:42.039151] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:37:42.122048] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-22T21:37:42.376215] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T21:37:42.922080] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-22T21:37:43.526746] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T21:37:43.722064] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-22T21:37:44.210314] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T21:37:44.522096] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-22T21:37:45.240345] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T21:37:45.322080] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-22T21:37:45.762455] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T21:37:46.122068] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-22T21:37:46.436281] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T21:37:46.922090] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-22T21:37:47.095716] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-22T21:37:47.722074] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-22T21:37:47.949842] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-22T21:37:48.522057] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-22T21:37:49.088567] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T21:37:49.322052] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-22T21:37:49.919441] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T21:37:50.122025] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-22T21:37:50.903779] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T21:37:50.922005] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-22T21:37:51.530931] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T21:37:51.722103] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-22T21:37:51.896736] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T21:37:51.900857] [INFO ] [REMOTE ] THQ: Full fetch complete (34702 records). [2025-09-22T21:37:51.900932] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-22T21:37:52.285562] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-22T21:37:52.285784] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-22T21:37:52.286877] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-22T21:37:52.286948] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-22T21:37:52.288486] [DEBUG] [LOCAL ] THQ: Trimmed 34702 records to 24432 (keeping 200 days of data) [2025-09-22T21:37:52.451051] [DEBUG] [LOCAL ] THQ: Primary data saved (24432 records). [2025-09-22T21:37:52.451252] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-22T21:37:52.451376] [INFO ] [MAIN ] Update Progress: 2089/2372 symbols completed. THQ took 24.0s. Estimated remaining: 37m 38s. Rate: 7.5 symbols/min [2025-09-22T21:37:52.523580] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-22T21:37:52.633181] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:37:52.645353] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T21:37:52.667413] [DEBUG] [LOCAL ] THW: Loaded 19372 existing records from primary storage. [2025-09-22T21:37:52.667536] [INFO ] [MAIN ] THW: Loaded 19372 existing records. [2025-09-22T21:37:52.844028] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:37:52.844286] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-22T21:37:52.844343] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-22T21:37:52.844961] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-22T21:37:52.845020] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-22T21:37:53.260064] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:37:53.322018] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-22T21:37:53.979797] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T21:37:53.986544] [INFO ] [REMOTE ] THO: Full fetch complete (60118 records). [2025-09-22T21:37:53.986668] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-22T21:37:54.128532] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-22T21:37:54.382249] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-22T21:37:54.382407] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-22T21:37:54.383460] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-22T21:37:54.383523] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-22T21:37:54.384827] [DEBUG] [LOCAL ] THO: Trimmed 60118 records to 42359 (keeping 200 days of data) [2025-09-22T21:37:54.504498] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T21:37:54.679902] [DEBUG] [LOCAL ] THO: Primary data saved (42359 records). [2025-09-22T21:37:54.680039] [INFO ] [MAIN ] THO: Full history saved. [2025-09-22T21:37:54.680135] [INFO ] [MAIN ] Update Progress: 2090/2372 symbols completed. THO took 31.7s. Estimated remaining: 37m 29s. Rate: 7.5 symbols/min [2025-09-22T21:37:54.849497] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:37:54.849687] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-22T21:37:54.849748] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-22T21:37:54.849892] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-22T21:37:54.849949] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-22T21:37:54.850023] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-22T21:37:54.850061] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-22T21:37:54.925291] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-22T21:37:55.225832] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:37:55.240208] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-22T21:37:55.722059] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-22T21:37:55.921114] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:37:55.921443] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-22T21:37:56.485061] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T21:37:56.522048] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-09-22T21:37:56.767201] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:37:56.767561] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-09-22T21:37:57.322050] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-22T21:37:58.122065] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-22T21:37:58.456323] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-22T21:37:58.922052] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-22T21:37:59.246102] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T21:37:59.722114] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-22T21:37:59.920416] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T21:38:00.522094] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-22T21:38:00.704238] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T21:38:00.805742] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-22T21:38:01.322055] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-22T21:38:02.028443] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-22T21:38:02.122090] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-22T21:38:02.922110] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-22T21:38:03.111142] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-22T21:38:03.722116] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-22T21:38:03.934233] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-22T21:38:04.522083] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-22T21:38:04.784420] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T21:38:05.322022] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-22T21:38:05.587743] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T21:38:06.122071] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-22T21:38:06.866573] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T21:38:06.922021] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-22T21:38:07.171378] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T21:38:07.175286] [INFO ] [REMOTE ] THR: Full fetch complete (28889 records). [2025-09-22T21:38:07.175370] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-22T21:38:07.567174] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-22T21:38:07.567269] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-22T21:38:07.567902] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-22T21:38:07.567977] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-22T21:38:07.568944] [DEBUG] [LOCAL ] THR: Trimmed 28889 records to 19987 (keeping 200 days of data) [2025-09-22T21:38:07.691325] [DEBUG] [LOCAL ] THR: Primary data saved (19987 records). [2025-09-22T21:38:07.691515] [INFO ] [MAIN ] THR: Full history saved. [2025-09-22T21:38:07.691634] [INFO ] [MAIN ] Update Progress: 2091/2372 symbols completed. THR took 34.6s. Estimated remaining: 37m 22s. Rate: 7.5 symbols/min [2025-09-22T21:38:07.727229] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-22T21:38:07.879759] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:38:07.929436] [DEBUG] [LOCAL ] TIMB: Loaded 37541 existing records from primary storage. [2025-09-22T21:38:07.929632] [INFO ] [MAIN ] TIMB: Loaded 37541 existing records. [2025-09-22T21:38:08.136030] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:38:08.136375] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-22T21:38:08.136459] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-22T21:38:08.137376] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-22T21:38:08.137436] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-22T21:38:08.530681] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-22T21:38:08.542218] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:38:08.577045] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-22T21:38:09.104884] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T21:38:09.322078] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-22T21:38:09.607814] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T21:38:10.122055] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-22T21:38:10.914215] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T21:38:10.923453] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-22T21:38:11.729451] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-22T21:38:11.733191] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T21:38:11.998123] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T21:38:12.522161] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-22T21:38:13.244809] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T21:38:13.322022] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-22T21:38:13.602861] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-22T21:38:14.122089] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-22T21:38:14.874661] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T21:38:14.922022] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-22T21:38:15.581373] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T21:38:15.722059] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-22T21:38:16.421037] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T21:38:16.522041] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-22T21:38:16.848108] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T21:38:17.322061] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-22T21:38:17.936970] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-22T21:38:18.122069] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-22T21:38:18.822514] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T21:38:18.829230] [INFO ] [REMOTE ] THS: Full fetch complete (53444 records). [2025-09-22T21:38:18.829354] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-22T21:38:18.929834] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-22T21:38:19.247331] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-22T21:38:19.247432] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-22T21:38:19.248567] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-22T21:38:19.248634] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-22T21:38:19.249869] [DEBUG] [LOCAL ] THS: Trimmed 53444 records to 37927 (keeping 200 days of data) [2025-09-22T21:38:19.483961] [DEBUG] [LOCAL ] THS: Primary data saved (37927 records). [2025-09-22T21:38:19.484122] [INFO ] [MAIN ] THS: Full history saved. [2025-09-22T21:38:19.484209] [INFO ] [MAIN ] Update Progress: 2092/2372 symbols completed. THS took 38.3s. Estimated remaining: 37m 15s. Rate: 7.5 symbols/min [2025-09-22T21:38:19.659873] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:38:19.666127] [DEBUG] [LOCAL ] TISI: Loaded 3916 existing records from primary storage. [2025-09-22T21:38:19.666236] [INFO ] [MAIN ] TISI: Loaded 3916 existing records. [2025-09-22T21:38:19.722689] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-22T21:38:19.879669] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:38:19.880118] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-22T21:38:19.880194] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-22T21:38:19.880584] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-22T21:38:19.880717] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-22T21:38:20.025161] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T21:38:20.295559] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:38:20.504769] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T21:38:20.521996] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-22T21:38:20.606314] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T21:38:21.322060] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-22T21:38:21.495106] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-22T21:38:21.675488] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-22T21:38:22.122072] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-22T21:38:22.599366] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-22T21:38:22.922087] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-22T21:38:23.722088] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-22T21:38:24.335036] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T21:38:24.342309] [INFO ] [REMOTE ] TIC: Full fetch complete (37542 records). [2025-09-22T21:38:24.342401] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-22T21:38:24.527136] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-22T21:38:24.540506] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 148 unique days, need 200 days [2025-09-22T21:38:24.542066] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:38:24.542143] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:38:24.542219] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-22T21:38:24.542291] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-22T21:38:24.542330] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-22T21:38:24.542388] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-22T21:38:24.542605] [INFO ] [MAIN ] Update Progress: 2093/2372 symbols completed. TIC took 29.9s. Estimated remaining: 37m 6s. Rate: 7.5 symbols/min [2025-09-22T21:38:24.718703] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:38:24.748761] [DEBUG] [LOCAL ] TIXT: Loaded 31649 existing records from primary storage. [2025-09-22T21:38:24.748901] [INFO ] [MAIN ] TIXT: Loaded 31649 existing records. [2025-09-22T21:38:24.931545] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:38:24.931822] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-22T21:38:24.931928] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-22T21:38:24.932691] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-22T21:38:24.932750] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-22T21:38:25.120237] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T21:38:25.322627] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-22T21:38:25.330335] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:38:25.356085] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T21:38:26.122031] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-22T21:38:26.280899] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T21:38:26.284108] [INFO ] [REMOTE ] THW: Full fetch complete (29378 records). [2025-09-22T21:38:26.284202] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-22T21:38:26.661518] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-22T21:38:26.661595] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-22T21:38:26.662220] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-22T21:38:26.662282] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-22T21:38:26.663057] [DEBUG] [LOCAL ] THW: Trimmed 29378 records to 19118 (keeping 200 days of data) [2025-09-22T21:38:26.779147] [DEBUG] [LOCAL ] THW: Primary data saved (19118 records). [2025-09-22T21:38:26.779297] [INFO ] [MAIN ] THW: Full history saved. [2025-09-22T21:38:26.779387] [INFO ] [MAIN ] Update Progress: 2094/2372 symbols completed. THW took 34.3s. Estimated remaining: 36m 57s. Rate: 7.5 symbols/min [2025-09-22T21:38:26.929067] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-22T21:38:26.961813] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:38:27.027536] [DEBUG] [LOCAL ] TJX: Loaded 54453 existing records from primary storage. [2025-09-22T21:38:27.028093] [INFO ] [MAIN ] TJX: Loaded 54453 existing records. [2025-09-22T21:38:27.205113] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:38:27.205383] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-22T21:38:27.205463] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-22T21:38:27.207204] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-22T21:38:27.207266] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-22T21:38:27.575704] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:38:27.594016] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T21:38:27.722032] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-22T21:38:27.728748] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T21:38:28.522058] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-22T21:38:29.257159] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T21:38:29.322030] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-22T21:38:29.607936] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T21:38:30.122088] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-22T21:38:30.908400] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-22T21:38:30.921995] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-22T21:38:31.722036] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-22T21:38:31.901343] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T21:38:32.329881] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T21:38:32.522086] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-22T21:38:32.944419] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T21:38:33.322020] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-22T21:38:33.388906] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T21:38:33.394136] [INFO ] [REMOTE ] TIMB: Full fetch complete (55073 records). [2025-09-22T21:38:33.394238] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-22T21:38:33.783455] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-22T21:38:33.783544] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-22T21:38:33.784580] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-22T21:38:33.784721] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-22T21:38:33.786210] [DEBUG] [LOCAL ] TIMB: Trimmed 55073 records to 36889 (keeping 200 days of data) [2025-09-22T21:38:34.014627] [DEBUG] [LOCAL ] TIMB: Primary data saved (36889 records). [2025-09-22T21:38:34.014802] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-22T21:38:34.014891] [INFO ] [MAIN ] Update Progress: 2095/2372 symbols completed. TIMB took 26.3s. Estimated remaining: 36m 49s. Rate: 7.5 symbols/min [2025-09-22T21:38:34.122088] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-22T21:38:34.195781] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:38:34.236200] [DEBUG] [LOCAL ] TK: Loaded 40472 existing records from primary storage. [2025-09-22T21:38:34.236337] [INFO ] [MAIN ] TK: Loaded 40472 existing records. [2025-09-22T21:38:34.423244] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:38:34.423620] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-22T21:38:34.423725] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-22T21:38:34.424745] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-22T21:38:34.424809] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-22T21:38:34.591837] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T21:38:34.838183] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:38:34.922059] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-22T21:38:35.722098] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-22T21:38:35.942455] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T21:38:35.989562] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T21:38:36.332238] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T21:38:36.522087] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-22T21:38:37.322076] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-22T21:38:38.122034] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-22T21:38:38.485935] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-22T21:38:38.824099] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T21:38:38.916157] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T21:38:38.922115] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-22T21:38:39.722042] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-22T21:38:40.079892] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T21:38:40.522113] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-22T21:38:41.322014] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-22T21:38:41.641827] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T21:38:41.718754] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-22T21:38:41.836589] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T21:38:42.122086] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-22T21:38:42.622721] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-22T21:38:42.922064] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-22T21:38:43.722084] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-22T21:38:44.183479] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-22T21:38:44.522039] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-22T21:38:45.042976] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-22T21:38:45.322061] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-22T21:38:45.830546] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-22T21:38:45.831978] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T21:38:45.833117] [INFO ] [REMOTE ] TISI: Full fetch complete (5073 records). [2025-09-22T21:38:45.840284] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-22T21:38:46.130180] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-22T21:38:46.218765] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-22T21:38:46.218850] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-22T21:38:46.219010] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-22T21:38:46.219048] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-22T21:38:46.219432] [DEBUG] [LOCAL ] TISI: Trimmed 5073 records to 3851 (keeping 200 days of data) [2025-09-22T21:38:46.242711] [DEBUG] [LOCAL ] TISI: Primary data saved (3851 records). [2025-09-22T21:38:46.242815] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-22T21:38:46.242895] [INFO ] [MAIN ] Update Progress: 2096/2372 symbols completed. TISI took 26.8s. Estimated remaining: 36m 42s. Rate: 7.5 symbols/min [2025-09-22T21:38:46.415305] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:38:46.455156] [DEBUG] [LOCAL ] TKC: Loaded 38470 existing records from primary storage. [2025-09-22T21:38:46.455340] [INFO ] [MAIN ] TKC: Loaded 38470 existing records. [2025-09-22T21:38:46.639203] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:38:46.639473] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-22T21:38:46.639521] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-22T21:38:46.640442] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-22T21:38:46.640501] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-22T21:38:46.927140] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-22T21:38:47.025521] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:38:47.658005] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-22T21:38:47.722033] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-22T21:38:48.269615] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T21:38:48.522056] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-22T21:38:48.732424] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T21:38:49.322052] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-22T21:38:49.563734] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T21:38:49.570849] [INFO ] [REMOTE ] TIXT: Full fetch complete (45446 records). [2025-09-22T21:38:49.570948] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-22T21:38:49.958819] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-22T21:38:49.958899] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-22T21:38:49.959835] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-22T21:38:49.959898] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-22T21:38:49.960902] [DEBUG] [LOCAL ] TIXT: Trimmed 45446 records to 31270 (keeping 200 days of data) [2025-09-22T21:38:50.122882] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-22T21:38:50.141363] [DEBUG] [LOCAL ] TIXT: Primary data saved (31270 records). [2025-09-22T21:38:50.141514] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-22T21:38:50.141603] [INFO ] [MAIN ] Update Progress: 2097/2372 symbols completed. TIXT took 25.6s. Estimated remaining: 36m 33s. Rate: 7.5 symbols/min [2025-09-22T21:38:50.316811] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:38:50.364667] [DEBUG] [LOCAL ] TKO: Loaded 45040 existing records from primary storage. [2025-09-22T21:38:50.364816] [INFO ] [MAIN ] TKO: Loaded 45040 existing records. [2025-09-22T21:38:50.544526] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:38:50.544809] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-22T21:38:50.544860] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-22T21:38:50.546055] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-22T21:38:50.546115] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-22T21:38:50.922372] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-22T21:38:50.922262] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:38:50.946885] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T21:38:51.722055] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-22T21:38:52.065706] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-22T21:38:52.159864] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T21:38:52.522058] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-22T21:38:53.322097] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-22T21:38:53.369214] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T21:38:53.790820] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-22T21:38:54.122127] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-22T21:38:54.922022] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-22T21:38:55.373547] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T21:38:55.465551] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-22T21:38:55.722020] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-22T21:38:56.060832] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T21:38:56.522070] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-22T21:38:57.322052] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-22T21:38:57.673099] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-22T21:38:57.947499] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T21:38:58.122074] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-22T21:38:58.500916] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-22T21:38:58.922060] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-22T21:38:59.528369] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T21:38:59.722100] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-22T21:39:00.438341] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T21:39:00.522040] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-22T21:39:00.752805] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T21:39:00.832294] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-22T21:39:00.840814] [INFO ] [REMOTE ] TJX: Full fetch complete (77680 records). [2025-09-22T21:39:00.840944] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-22T21:39:01.252627] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-22T21:39:01.252778] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-22T21:39:01.254017] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-22T21:39:01.254087] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-22T21:39:01.256827] [DEBUG] [LOCAL ] TJX: Trimmed 77680 records to 53672 (keeping 200 days of data) [2025-09-22T21:39:01.323923] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-22T21:39:01.608881] [DEBUG] [LOCAL ] TJX: Primary data saved (53672 records). [2025-09-22T21:39:01.609047] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-22T21:39:01.609136] [INFO ] [MAIN ] Update Progress: 2098/2372 symbols completed. TJX took 34.8s. Estimated remaining: 36m 26s. Rate: 7.5 symbols/min [2025-09-22T21:39:01.813327] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:39:01.858540] [DEBUG] [LOCAL ] TKR: Loaded 40746 existing records from primary storage. [2025-09-22T21:39:01.858819] [INFO ] [MAIN ] TKR: Loaded 40746 existing records. [2025-09-22T21:39:02.052738] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:39:02.053044] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-22T21:39:02.053104] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-22T21:39:02.054151] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-22T21:39:02.054212] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-22T21:39:02.127493] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-22T21:39:02.430596] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:39:02.922107] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-22T21:39:03.293128] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-22T21:39:03.722079] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-22T21:39:04.522026] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-22T21:39:04.590810] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-22T21:39:05.208428] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-22T21:39:05.322010] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-22T21:39:05.453320] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T21:39:05.857024] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T21:39:06.122054] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-22T21:39:06.840060] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T21:39:06.922035] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-22T21:39:07.722179] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-22T21:39:07.775911] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T21:39:08.428754] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T21:39:08.522082] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-22T21:39:09.074119] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T21:39:09.322044] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-22T21:39:10.003337] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T21:39:10.122033] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-22T21:39:10.406736] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-22T21:39:10.922093] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-22T21:39:11.309890] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T21:39:11.315610] [INFO ] [REMOTE ] TK: Full fetch complete (57203 records). [2025-09-22T21:39:11.315744] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-22T21:39:11.710037] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-22T21:39:11.710124] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-22T21:39:11.711152] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-22T21:39:11.711218] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-22T21:39:11.712484] [DEBUG] [LOCAL ] TK: Trimmed 57203 records to 39812 (keeping 200 days of data) [2025-09-22T21:39:11.761880] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-22T21:39:11.962192] [DEBUG] [LOCAL ] TK: Primary data saved (39812 records). [2025-09-22T21:39:11.962387] [INFO ] [MAIN ] TK: Full history saved. [2025-09-22T21:39:11.962565] [INFO ] [MAIN ] Update Progress: 2099/2372 symbols completed. TK took 37.9s. Estimated remaining: 36m 18s. Rate: 7.5 symbols/min [2025-09-22T21:39:12.147478] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:39:12.191832] [DEBUG] [LOCAL ] TLK: Loaded 40539 existing records from primary storage. [2025-09-22T21:39:12.191983] [INFO ] [MAIN ] TLK: Loaded 40539 existing records. [2025-09-22T21:39:12.393612] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:39:12.393998] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-22T21:39:12.394252] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-22T21:39:12.395462] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-22T21:39:12.395542] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-22T21:39:12.527845] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-22T21:39:12.587869] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T21:39:12.626440] [INFO ] [REMOTE ] TKC: Full fetch complete (51195 records). [2025-09-22T21:39:12.655881] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-22T21:39:13.018822] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:39:13.224199] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-22T21:39:13.224284] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-22T21:39:13.225298] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-22T21:39:13.225362] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-22T21:39:13.226560] [DEBUG] [LOCAL ] TKC: Trimmed 51195 records to 38172 (keeping 200 days of data) [2025-09-22T21:39:13.322078] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-22T21:39:13.451712] [DEBUG] [LOCAL ] TKC: Primary data saved (38172 records). [2025-09-22T21:39:13.451872] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-22T21:39:13.451980] [INFO ] [MAIN ] Update Progress: 2100/2372 symbols completed. TKC took 27.2s. Estimated remaining: 36m 9s. Rate: 7.5 symbols/min [2025-09-22T21:39:13.625135] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:39:13.656538] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T21:39:13.678411] [DEBUG] [LOCAL ] TLYS: Loaded 17139 existing records from primary storage. [2025-09-22T21:39:13.678529] [INFO ] [MAIN ] TLYS: Loaded 17139 existing records. [2025-09-22T21:39:13.862904] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:39:13.863140] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-22T21:39:13.863195] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-22T21:39:13.863631] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-22T21:39:13.863725] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-22T21:39:14.124536] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-22T21:39:14.229689] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:39:14.298207] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T21:39:14.922090] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-22T21:39:14.992124] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T21:39:15.722068] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-22T21:39:16.522034] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-22T21:39:16.870525] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-22T21:39:17.088047] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-22T21:39:17.322092] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-22T21:39:17.641918] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T21:39:17.710149] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-22T21:39:18.122092] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-22T21:39:18.502369] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T21:39:18.922054] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-22T21:39:19.711126] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T21:39:19.721997] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-22T21:39:20.382469] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T21:39:20.522149] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-22T21:39:21.285137] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T21:39:21.302001] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T21:39:21.322007] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-22T21:39:22.122063] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-22T21:39:22.864070] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-22T21:39:22.889512] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T21:39:22.922009] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-22T21:39:23.720134] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T21:39:23.729119] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-22T21:39:24.522096] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-22T21:39:25.084795] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T21:39:25.322066] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-22T21:39:26.087342] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T21:39:26.122046] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-22T21:39:26.728254] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T21:39:26.735112] [INFO ] [REMOTE ] TKR: Full fetch complete (57409 records). [2025-09-22T21:39:26.735248] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-22T21:39:26.936570] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-22T21:39:27.145181] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-22T21:39:27.145266] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-22T21:39:27.151790] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-22T21:39:27.151963] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-22T21:39:27.154198] [DEBUG] [LOCAL ] TKR: Trimmed 57409 records to 40056 (keeping 200 days of data) [2025-09-22T21:39:27.419877] [DEBUG] [LOCAL ] TKR: Primary data saved (40056 records). [2025-09-22T21:39:27.420022] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-22T21:39:27.420174] [INFO ] [MAIN ] Update Progress: 2101/2372 symbols completed. TKR took 25.8s. Estimated remaining: 36m 2s. Rate: 7.5 symbols/min [2025-09-22T21:39:27.599020] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:39:27.624839] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T21:39:27.636816] [INFO ] [REMOTE ] TKO: Full fetch complete (64627 records). [2025-09-22T21:39:27.637021] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-22T21:39:27.724983] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-22T21:39:27.878474] [DEBUG] [LOCAL ] TM: Loaded 37448 existing records from primary storage. [2025-09-22T21:39:27.924718] [INFO ] [MAIN ] TM: Loaded 37448 existing records. [2025-09-22T21:39:28.262783] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:39:28.266138] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-22T21:39:28.266236] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-22T21:39:28.267495] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-22T21:39:28.267671] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-22T21:39:28.268045] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-22T21:39:28.268128] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-22T21:39:28.269309] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-22T21:39:28.269413] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-22T21:39:28.303077] [DEBUG] [LOCAL ] TKO: Trimmed 64627 records to 44254 (keeping 200 days of data) [2025-09-22T21:39:28.611580] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T21:39:28.650199] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-22T21:39:28.805089] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:39:28.848135] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T21:39:29.028549] [DEBUG] [LOCAL ] TKO: Primary data saved (44254 records). [2025-09-22T21:39:29.028735] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-22T21:39:29.030416] [INFO ] [MAIN ] Update Progress: 2102/2372 symbols completed. TKO took 38.9s. Estimated remaining: 35m 53s. Rate: 7.5 symbols/min [2025-09-22T21:39:29.202246] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:39:29.272456] [DEBUG] [LOCAL ] TME: Loaded 53980 existing records from primary storage. [2025-09-22T21:39:29.272601] [INFO ] [MAIN ] TME: Loaded 53980 existing records. [2025-09-22T21:39:29.335213] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-22T21:39:29.458890] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:39:29.459280] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-22T21:39:29.459340] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-22T21:39:29.460479] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-22T21:39:29.460551] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-22T21:39:29.589300] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T21:39:29.833249] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:39:30.122049] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-22T21:39:30.922089] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-22T21:39:30.956885] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T21:39:30.997338] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-22T21:39:31.722073] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-22T21:39:32.522041] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-22T21:39:32.775377] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T21:39:33.137217] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T21:39:33.322071] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-22T21:39:33.904797] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T21:39:34.122062] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-22T21:39:34.665520] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-22T21:39:34.922079] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-22T21:39:35.190069] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-22T21:39:35.722081] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-22T21:39:36.522033] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-22T21:39:36.571600] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T21:39:37.322032] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-22T21:39:37.398090] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T21:39:37.623340] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-22T21:39:38.122062] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-22T21:39:38.770096] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T21:39:38.922104] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-22T21:39:39.323119] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T21:39:39.722122] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-22T21:39:40.522049] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-22T21:39:40.707716] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T21:39:40.873065] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-22T21:39:41.322025] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-22T21:39:41.334247] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T21:39:41.337301] [INFO ] [REMOTE ] TLYS: Full fetch complete (22004 records). [2025-09-22T21:39:41.337377] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-22T21:39:41.708877] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-22T21:39:41.708983] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-22T21:39:41.709441] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-22T21:39:41.709479] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-22T21:39:41.710220] [DEBUG] [LOCAL ] TLYS: Trimmed 22004 records to 16940 (keeping 200 days of data) [2025-09-22T21:39:41.816458] [DEBUG] [LOCAL ] TLYS: Primary data saved (16940 records). [2025-09-22T21:39:41.816612] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-22T21:39:41.816760] [INFO ] [MAIN ] Update Progress: 2103/2372 symbols completed. TLYS took 28.4s. Estimated remaining: 35m 46s. Rate: 7.5 symbols/min [2025-09-22T21:39:41.991520] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:39:42.052212] [DEBUG] [LOCAL ] TMHC: Loaded 46324 existing records from primary storage. [2025-09-22T21:39:42.052369] [INFO ] [MAIN ] TMHC: Loaded 46324 existing records. [2025-09-22T21:39:42.127194] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-22T21:39:42.244835] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:39:42.245151] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-22T21:39:42.245200] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-22T21:39:42.246444] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-22T21:39:42.246507] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-22T21:39:42.611409] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:39:42.679954] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-22T21:39:42.922078] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-22T21:39:43.722030] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-22T21:39:43.996950] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T21:39:44.498529] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T21:39:44.522009] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-22T21:39:45.322070] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-22T21:39:45.518445] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T21:39:46.072665] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T21:39:46.122068] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-22T21:39:46.400685] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-22T21:39:46.922533] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-22T21:39:47.722065] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-22T21:39:48.072273] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T21:39:48.122416] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T21:39:48.522063] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-22T21:39:49.126530] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T21:39:49.134398] [INFO ] [REMOTE ] TLK: Full fetch complete (57534 records). [2025-09-22T21:39:49.134528] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-22T21:39:49.322872] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-22T21:39:49.543290] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-22T21:39:49.543378] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-22T21:39:49.544425] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-22T21:39:49.544488] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-22T21:39:49.546023] [DEBUG] [LOCAL ] TLK: Trimmed 57534 records to 39680 (keeping 200 days of data) [2025-09-22T21:39:49.809919] [DEBUG] [LOCAL ] TLK: Primary data saved (39680 records). [2025-09-22T21:39:49.810078] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-22T21:39:49.810166] [INFO ] [MAIN ] Update Progress: 2104/2372 symbols completed. TLK took 37.8s. Estimated remaining: 35m 38s. Rate: 7.5 symbols/min [2025-09-22T21:39:49.986892] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:39:50.044782] [DEBUG] [LOCAL ] TMO: Loaded 53102 existing records from primary storage. [2025-09-22T21:39:50.044938] [INFO ] [MAIN ] TMO: Loaded 53102 existing records. [2025-09-22T21:39:50.126197] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-22T21:39:50.230776] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:39:50.252412] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-22T21:39:50.252551] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-22T21:39:50.253960] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T21:39:50.257032] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-22T21:39:50.263255] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-22T21:39:50.630009] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:39:50.922033] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-22T21:39:50.959934] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T21:39:51.722085] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-22T21:39:52.013307] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T21:39:52.453187] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T21:39:52.522057] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-22T21:39:53.322046] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-22T21:39:53.533145] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T21:39:53.706874] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T21:39:54.122050] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-22T21:39:54.922064] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-22T21:39:55.000198] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T21:39:55.372711] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T21:39:55.377497] [INFO ] [REMOTE ] TM: Full fetch complete (53143 records). [2025-09-22T21:39:55.377615] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-22T21:39:55.731983] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-22T21:39:55.770225] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-22T21:39:55.770415] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-22T21:39:55.771618] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-22T21:39:55.771724] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-22T21:39:55.772973] [DEBUG] [LOCAL ] TM: Trimmed 53143 records to 36688 (keeping 200 days of data) [2025-09-22T21:39:56.008494] [DEBUG] [LOCAL ] TM: Primary data saved (36688 records). [2025-09-22T21:39:56.008665] [INFO ] [MAIN ] TM: Full history saved. [2025-09-22T21:39:56.008828] [INFO ] [MAIN ] Update Progress: 2105/2372 symbols completed. TM took 28.6s. Estimated remaining: 35m 30s. Rate: 7.5 symbols/min [2025-09-22T21:39:56.181308] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:39:56.181518] [DEBUG] [LOCAL ] TNC: No existing data file found in primary storage. [2025-09-22T21:39:56.181560] [WARN ] [MAIN ] TNC: No existing data found, performing full refresh instead. [2025-09-22T21:39:56.181770] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-22T21:39:56.181814] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-22T21:39:56.181855] [DEBUG] [LOCAL ] TNC: No primary data file found to delete. [2025-09-22T21:39:56.181886] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-22T21:39:56.527470] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-22T21:39:56.553316] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:39:56.838910] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T21:39:57.322075] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-22T21:39:57.549003] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T21:39:58.122086] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-22T21:39:58.258182] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-22T21:39:58.383260] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-22T21:39:58.922081] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-22T21:39:59.722131] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-22T21:39:59.889483] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T21:40:00.522155] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-22T21:40:00.597556] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T21:40:00.895978] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T21:40:01.322093] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-22T21:40:02.109437] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T21:40:02.122056] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-22T21:40:02.477728] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T21:40:02.922112] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-22T21:40:03.722078] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-22T21:40:03.920253] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T21:40:04.434512] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T21:40:04.522053] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-22T21:40:04.839058] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-22T21:40:05.322083] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-22T21:40:06.122076] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-22T21:40:06.367920] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T21:40:06.412008] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T21:40:06.922153] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-22T21:40:07.722066] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-22T21:40:07.959752] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T21:40:07.968958] [INFO ] [REMOTE ] TME: Full fetch complete (76919 records). [2025-09-22T21:40:07.969179] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-22T21:40:08.402349] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-22T21:40:08.402545] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-22T21:40:08.404485] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-22T21:40:08.404580] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-22T21:40:08.406848] [DEBUG] [LOCAL ] TME: Trimmed 76919 records to 53200 (keeping 200 days of data) [2025-09-22T21:40:08.530738] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-22T21:40:08.699610] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T21:40:08.810397] [DEBUG] [LOCAL ] TME: Primary data saved (53200 records). [2025-09-22T21:40:08.810614] [INFO ] [MAIN ] TME: Full history saved. [2025-09-22T21:40:08.810755] [INFO ] [MAIN ] Update Progress: 2106/2372 symbols completed. TME took 39.8s. Estimated remaining: 35m 23s. Rate: 7.5 symbols/min [2025-09-22T21:40:08.994325] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:40:09.029452] [DEBUG] [LOCAL ] TNET: Loaded 29575 existing records from primary storage. [2025-09-22T21:40:09.029713] [INFO ] [MAIN ] TNET: Loaded 29575 existing records. [2025-09-22T21:40:09.215551] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:40:09.216074] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-22T21:40:09.216144] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-22T21:40:09.216978] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-22T21:40:09.217037] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-22T21:40:09.327213] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-22T21:40:09.590365] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:40:09.601384] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-22T21:40:09.707120] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T21:40:10.122086] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-22T21:40:10.922035] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-22T21:40:11.181322] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-22T21:40:11.722053] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-22T21:40:11.877861] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T21:40:12.201213] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-22T21:40:12.522121] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-22T21:40:12.640817] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-22T21:40:13.322069] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-22T21:40:14.122088] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-22T21:40:14.397129] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T21:40:14.430829] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-22T21:40:14.922035] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-22T21:40:15.159837] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T21:40:15.722102] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-22T21:40:16.216820] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T21:40:16.522058] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-22T21:40:17.322066] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-22T21:40:17.891750] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-22T21:40:17.925880] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T21:40:18.122103] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-22T21:40:18.768199] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T21:40:18.775955] [INFO ] [REMOTE ] TMHC: Full fetch complete (65817 records). [2025-09-22T21:40:18.776074] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-22T21:40:18.928905] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-22T21:40:19.187699] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-22T21:40:19.187884] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-22T21:40:19.189207] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-22T21:40:19.189370] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-22T21:40:19.191385] [DEBUG] [LOCAL ] TMHC: Trimmed 65817 records to 45672 (keeping 200 days of data) [2025-09-22T21:40:19.318835] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T21:40:19.531467] [DEBUG] [LOCAL ] TMHC: Primary data saved (45672 records). [2025-09-22T21:40:19.531666] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-22T21:40:19.531815] [INFO ] [MAIN ] Update Progress: 2107/2372 symbols completed. TMHC took 37.7s. Estimated remaining: 35m 15s. Rate: 7.5 symbols/min [2025-09-22T21:40:19.724730] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:40:19.724826] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-22T21:40:19.726152] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-22T21:40:19.726223] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-22T21:40:19.726382] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-22T21:40:19.726425] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-22T21:40:19.726465] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-22T21:40:19.726496] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-22T21:40:20.049563] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-22T21:40:20.109814] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:40:20.522096] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-22T21:40:21.322070] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-22T21:40:21.728949] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-22T21:40:21.756116] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-22T21:40:22.122110] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-22T21:40:22.149944] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T21:40:22.153157] [INFO ] [REMOTE ] TNC: Full fetch complete (23269 records). [2025-09-22T21:40:22.153298] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-22T21:40:22.538007] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-22T21:40:22.538105] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-22T21:40:22.538672] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-22T21:40:22.538735] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-22T21:40:22.539578] [DEBUG] [LOCAL ] TNC: Trimmed 23269 records to 15270 (keeping 200 days of data) [2025-09-22T21:40:22.639548] [DEBUG] [LOCAL ] TNC: Primary data saved (15270 records). [2025-09-22T21:40:22.639735] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-22T21:40:22.639828] [INFO ] [MAIN ] Update Progress: 2108/2372 symbols completed. TNC took 26.6s. Estimated remaining: 35m 6s. Rate: 7.5 symbols/min [2025-09-22T21:40:22.818952] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:40:22.851499] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-22T21:40:22.861438] [INFO ] [REMOTE ] TMO: Full fetch complete (75464 records). [2025-09-22T21:40:22.861808] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-22T21:40:22.927196] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-22T21:40:23.084234] [DEBUG] [LOCAL ] TNK: Loaded 35945 existing records from primary storage. [2025-09-22T21:40:23.103450] [INFO ] [MAIN ] TNK: Loaded 35945 existing records. [2025-09-22T21:40:23.506601] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-22T21:40:23.506917] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-22T21:40:23.506819] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:40:23.508260] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-22T21:40:23.508351] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-22T21:40:23.508764] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-22T21:40:23.508828] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-22T21:40:23.509974] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-22T21:40:23.510041] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-22T21:40:23.541869] [DEBUG] [LOCAL ] TMO: Trimmed 75464 records to 52335 (keeping 200 days of data) [2025-09-22T21:40:23.726517] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-22T21:40:24.004231] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:40:24.011008] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:40:24.012702] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-22T21:40:24.151345] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T21:40:24.272353] [DEBUG] [LOCAL ] TMO: Primary data saved (52335 records). [2025-09-22T21:40:24.272495] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-22T21:40:24.272582] [INFO ] [MAIN ] Update Progress: 2109/2372 symbols completed. TMO took 34.5s. Estimated remaining: 34m 58s. Rate: 7.5 symbols/min [2025-09-22T21:40:24.453496] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:40:24.496083] [DEBUG] [LOCAL ] TNL: Loaded 42508 existing records from primary storage. [2025-09-22T21:40:24.496243] [INFO ] [MAIN ] TNL: Loaded 42508 existing records. [2025-09-22T21:40:24.527149] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-09-22T21:40:24.686259] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:40:24.686536] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-22T21:40:24.686585] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-22T21:40:24.687570] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-22T21:40:24.687667] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-22T21:40:24.817190] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:40:24.842761] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-09-22T21:40:25.051455] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:40:25.322073] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-22T21:40:25.528994] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:40:25.529326] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-22T21:40:26.122054] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-22T21:40:26.922068] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-22T21:40:27.477716] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T21:40:27.722056] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-22T21:40:28.259222] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T21:40:28.522070] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-22T21:40:29.318451] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T21:40:29.328334] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-22T21:40:29.977166] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T21:40:30.122038] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-22T21:40:30.690867] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T21:40:30.922106] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-22T21:40:31.181793] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:40:31.182122] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-22T21:40:31.532680] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T21:40:31.722070] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-22T21:40:32.522053] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-22T21:40:33.106457] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T21:40:33.322017] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-22T21:40:33.692185] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:40:33.692500] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-22T21:40:33.707086] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-22T21:40:33.711476] [INFO ] [REMOTE ] TNET: Full fetch complete (41626 records). [2025-09-22T21:40:33.711566] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-22T21:40:34.120235] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-22T21:40:34.120328] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-22T21:40:34.121437] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-22T21:40:34.121503] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-22T21:40:34.122072] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-22T21:40:34.123902] [DEBUG] [LOCAL ] TNET: Trimmed 41626 records to 28907 (keeping 200 days of data) [2025-09-22T21:40:34.312871] [DEBUG] [LOCAL ] TNET: Primary data saved (28907 records). [2025-09-22T21:40:34.313037] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-22T21:40:34.313158] [INFO ] [MAIN ] Update Progress: 2110/2372 symbols completed. TNET took 25.5s. Estimated remaining: 34m 50s. Rate: 7.5 symbols/min [2025-09-22T21:40:34.495319] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:40:34.550597] [DEBUG] [LOCAL ] TOL: Loaded 51876 existing records from primary storage. [2025-09-22T21:40:34.550821] [INFO ] [MAIN ] TOL: Loaded 51876 existing records. [2025-09-22T21:40:34.745393] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:40:34.745743] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-22T21:40:34.745802] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-22T21:40:34.747093] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-22T21:40:34.747170] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-22T21:40:34.927539] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-22T21:40:35.125184] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:40:35.620692] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T21:40:35.722063] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-22T21:40:36.376701] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T21:40:36.522053] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-22T21:40:37.275456] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T21:40:37.322053] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-22T21:40:37.949874] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-22T21:40:38.122062] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-22T21:40:38.922048] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-22T21:40:39.048198] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T21:40:39.594835] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T21:40:39.722026] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-22T21:40:40.224384] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T21:40:40.522059] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-22T21:40:40.780875] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:40:40.781195] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-22T21:40:41.160259] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T21:40:41.322072] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-22T21:40:42.122106] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-22T21:40:42.566484] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-22T21:40:42.727855] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-22T21:40:42.922062] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-22T21:40:43.722061] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-22T21:40:44.340463] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T21:40:44.527696] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-22T21:40:44.542066] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T21:40:45.322059] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-22T21:40:46.122077] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-22T21:40:46.255930] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-22T21:40:46.608796] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T21:40:46.808438] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T21:40:46.922016] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-22T21:40:47.722056] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-22T21:40:48.409185] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T21:40:48.410913] [INFO ] [REMOTE ] TNGY: Full fetch complete (3148 records). [2025-09-22T21:40:48.410982] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-22T21:40:48.529568] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-22T21:40:48.565589] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T21:40:48.680316] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 68 unique days, need 200 days [2025-09-22T21:40:48.680558] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:40:48.680666] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:40:48.680752] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-22T21:40:48.680890] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-22T21:40:48.680959] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-22T21:40:48.681059] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-22T21:40:48.681171] [INFO ] [MAIN ] Update Progress: 2111/2372 symbols completed. TNGY took 29.1s. Estimated remaining: 34m 43s. Rate: 7.5 symbols/min [2025-09-22T21:40:48.855843] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:40:48.911030] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-22T21:40:48.911175] [INFO ] [MAIN ] TOST: Loaded 54461 existing records. [2025-09-22T21:40:49.097662] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:40:49.097942] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-22T21:40:49.097994] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-22T21:40:49.100588] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-22T21:40:49.100678] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-22T21:40:49.327209] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-22T21:40:49.469953] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:40:50.122076] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-22T21:40:50.312842] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-22T21:40:50.907541] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T21:40:50.922004] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-22T21:40:51.722080] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-22T21:40:52.052842] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-22T21:40:52.379494] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T21:40:52.386034] [INFO ] [REMOTE ] TNL: Full fetch complete (58702 records). [2025-09-22T21:40:52.386203] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-22T21:40:52.527993] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-22T21:40:52.778783] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-22T21:40:52.778865] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-22T21:40:52.779960] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-22T21:40:52.780023] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-22T21:40:52.781380] [DEBUG] [LOCAL ] TNL: Trimmed 58702 records to 41900 (keeping 200 days of data) [2025-09-22T21:40:53.052134] [DEBUG] [LOCAL ] TNL: Primary data saved (41900 records). [2025-09-22T21:40:53.052366] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-22T21:40:53.052481] [INFO ] [MAIN ] Update Progress: 2112/2372 symbols completed. TNL took 28.8s. Estimated remaining: 34m 34s. Rate: 7.5 symbols/min [2025-09-22T21:40:53.230557] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:40:53.258242] [DEBUG] [LOCAL ] TPB: Loaded 25347 existing records from primary storage. [2025-09-22T21:40:53.258404] [INFO ] [MAIN ] TPB: Loaded 25347 existing records. [2025-09-22T21:40:53.336132] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-22T21:40:53.474244] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T21:40:53.521791] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:40:53.522730] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-22T21:40:53.523260] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-22T21:40:53.524033] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-22T21:40:53.524095] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-22T21:40:53.878522] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:40:54.122058] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-22T21:40:54.531575] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-22T21:40:54.851038] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T21:40:54.922030] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-22T21:40:55.240239] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T21:40:55.722058] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-22T21:40:56.315848] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T21:40:56.321600] [INFO ] [REMOTE ] TNK: Full fetch complete (51930 records). [2025-09-22T21:40:56.321721] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-22T21:40:56.525739] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-22T21:40:56.749684] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-22T21:40:56.749779] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-22T21:40:56.750931] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-22T21:40:56.750999] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-22T21:40:56.752427] [DEBUG] [LOCAL ] TNK: Trimmed 51930 records to 35274 (keeping 200 days of data) [2025-09-22T21:40:56.768707] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-22T21:40:56.990148] [DEBUG] [LOCAL ] TNK: Primary data saved (35274 records). [2025-09-22T21:40:56.990289] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-22T21:40:56.990391] [INFO ] [MAIN ] Update Progress: 2113/2372 symbols completed. TNK took 34.4s. Estimated remaining: 34m 26s. Rate: 7.5 symbols/min [2025-09-22T21:40:57.168497] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:40:57.208491] [DEBUG] [LOCAL ] TPC: Loaded 39544 existing records from primary storage. [2025-09-22T21:40:57.208671] [INFO ] [MAIN ] TPC: Loaded 39544 existing records. [2025-09-22T21:40:57.328205] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-22T21:40:57.416262] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:40:57.416590] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-22T21:40:57.416704] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-22T21:40:57.417632] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-22T21:40:57.417735] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-22T21:40:57.790595] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:40:58.122084] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-22T21:40:58.533318] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-22T21:40:58.922039] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-22T21:40:59.214783] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T21:40:59.480306] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T21:40:59.722149] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-22T21:41:00.522020] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-22T21:41:00.853609] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T21:41:01.322074] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-22T21:41:01.715727] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-22T21:41:01.941801] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T21:41:02.122108] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-22T21:41:02.419927] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T21:41:02.922088] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-22T21:41:03.444355] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T21:41:03.722073] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-22T21:41:04.522022] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-22T21:41:04.683038] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T21:41:05.032542] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-22T21:41:05.322040] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-22T21:41:06.122117] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-22T21:41:06.365279] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T21:41:06.564975] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-22T21:41:06.922076] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-22T21:41:07.722029] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-22T21:41:07.913583] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T21:41:08.514059] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T21:41:08.522004] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-22T21:41:08.787529] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-22T21:41:09.322037] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-22T21:41:09.721270] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T21:41:10.122119] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-22T21:41:10.678232] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T21:41:10.922078] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-22T21:41:11.504063] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T21:41:11.722073] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-22T21:41:12.366905] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-22T21:41:12.522053] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-22T21:41:13.244332] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T21:41:13.322014] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-22T21:41:14.122037] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-22T21:41:14.438288] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T21:41:14.781256] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T21:41:14.922066] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-22T21:41:15.586212] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T21:41:15.722047] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-22T21:41:16.479681] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T21:41:16.522013] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-22T21:41:16.969030] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T21:41:16.973412] [INFO ] [REMOTE ] TPB: Full fetch complete (34682 records). [2025-09-22T21:41:16.973506] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-22T21:41:17.344409] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-22T21:41:17.360036] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-22T21:41:17.360129] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-22T21:41:17.360868] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-22T21:41:17.361042] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-22T21:41:17.362059] [DEBUG] [LOCAL ] TPB: Trimmed 34682 records to 24943 (keeping 200 days of data) [2025-09-22T21:41:17.523727] [DEBUG] [LOCAL ] TPB: Primary data saved (24943 records). [2025-09-22T21:41:17.523862] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-22T21:41:17.523948] [INFO ] [MAIN ] Update Progress: 2114/2372 symbols completed. TPB took 24.5s. Estimated remaining: 34m 19s. Rate: 7.5 symbols/min [2025-09-22T21:41:17.699710] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:41:17.747193] [DEBUG] [LOCAL ] TPH: Loaded 45991 existing records from primary storage. [2025-09-22T21:41:17.747475] [INFO ] [MAIN ] TPH: Loaded 45991 existing records. [2025-09-22T21:41:17.936254] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:41:17.936945] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-22T21:41:17.937037] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-22T21:41:17.947781] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-22T21:41:17.962120] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-22T21:41:18.021940] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T21:41:18.127233] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-22T21:41:18.345817] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:41:18.922069] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-22T21:41:19.136142] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-22T21:41:19.144535] [INFO ] [REMOTE ] TOL: Full fetch complete (73938 records). [2025-09-22T21:41:19.144802] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-22T21:41:19.544009] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-22T21:41:19.544092] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-22T21:41:19.545240] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-22T21:41:19.545306] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-22T21:41:19.546850] [DEBUG] [LOCAL ] TOL: Trimmed 73938 records to 51121 (keeping 200 days of data) [2025-09-22T21:41:19.729316] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-22T21:41:19.875947] [DEBUG] [LOCAL ] TOL: Primary data saved (51121 records). [2025-09-22T21:41:19.876114] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-22T21:41:19.877709] [INFO ] [MAIN ] Update Progress: 2115/2372 symbols completed. TOL took 45.6s. Estimated remaining: 34m 11s. Rate: 7.5 symbols/min [2025-09-22T21:41:20.054663] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:41:20.074291] [DEBUG] [LOCAL ] TPL: Loaded 12621 existing records from primary storage. [2025-09-22T21:41:20.074419] [INFO ] [MAIN ] TPL: Loaded 12621 existing records. [2025-09-22T21:41:20.262998] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:41:20.263540] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-22T21:41:20.263680] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-22T21:41:20.264293] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-22T21:41:20.264424] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-22T21:41:20.591767] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-22T21:41:20.684423] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:41:20.678902] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-22T21:41:20.711251] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T21:41:21.276802] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T21:41:21.322056] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-22T21:41:22.122066] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-22T21:41:22.443817] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T21:41:22.490447] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T21:41:22.497601] [INFO ] [REMOTE ] TPC: Full fetch complete (54685 records). [2025-09-22T21:41:22.497798] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-22T21:41:22.914116] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-22T21:41:22.914218] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-22T21:41:22.915382] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-22T21:41:22.915483] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-22T21:41:22.916996] [DEBUG] [LOCAL ] TPC: Trimmed 54685 records to 38846 (keeping 200 days of data) [2025-09-22T21:41:22.968149] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-22T21:41:23.158247] [DEBUG] [LOCAL ] TPC: Primary data saved (38846 records). [2025-09-22T21:41:23.158412] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-22T21:41:23.158500] [INFO ] [MAIN ] Update Progress: 2116/2372 symbols completed. TPC took 26.2s. Estimated remaining: 34m 2s. Rate: 7.5 symbols/min [2025-09-22T21:41:23.334411] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:41:23.359331] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-22T21:41:23.415094] [DEBUG] [LOCAL ] TPR: Loaded 54265 existing records from primary storage. [2025-09-22T21:41:23.415312] [INFO ] [MAIN ] TPR: Loaded 54265 existing records. [2025-09-22T21:41:23.593762] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:41:23.594036] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-22T21:41:23.594085] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-22T21:41:23.595693] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-22T21:41:23.595754] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-22T21:41:23.731999] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-22T21:41:24.011430] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:41:24.510638] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T21:41:24.519266] [INFO ] [REMOTE ] TOST: Full fetch complete (77698 records). [2025-09-22T21:41:24.519420] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-22T21:41:24.531461] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-22T21:41:24.934322] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-22T21:41:24.934482] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-22T21:41:24.935873] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-22T21:41:24.935998] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-22T21:41:24.948507] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-22T21:41:24.953598] [DEBUG] [LOCAL ] TOST: Trimmed 77698 records to 53681 (keeping 200 days of data) [2025-09-22T21:41:25.297606] [DEBUG] [LOCAL ] TOST: Primary data saved (53681 records). [2025-09-22T21:41:25.297789] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-22T21:41:25.297901] [INFO ] [MAIN ] Update Progress: 2117/2372 symbols completed. TOST took 36.6s. Estimated remaining: 33m 53s. Rate: 7.5 symbols/min [2025-09-22T21:41:25.322081] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-22T21:41:26.130414] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-22T21:41:26.135817] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T21:41:26.262091] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T21:41:26.922060] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-22T21:41:27.722047] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-22T21:41:27.958764] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T21:41:28.527139] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-22T21:41:28.547165] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T21:41:28.584896] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T21:41:29.322065] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-22T21:41:30.122019] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-22T21:41:30.399269] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T21:41:30.524575] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-22T21:41:30.922033] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-22T21:41:31.044003] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-22T21:41:31.722074] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-22T21:41:32.449154] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T21:41:32.522021] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-22T21:41:32.805250] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-22T21:41:33.322075] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-22T21:41:34.038752] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T21:41:34.058945] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-22T21:41:34.122061] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-22T21:41:34.922079] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-22T21:41:35.722053] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-22T21:41:35.827302] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T21:41:36.033404] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-22T21:41:36.522063] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-22T21:41:37.322156] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-22T21:41:37.413885] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T21:41:37.536889] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T21:41:38.122059] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-22T21:41:38.887020] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T21:41:38.922028] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-22T21:41:39.026678] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T21:41:39.722060] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-22T21:41:40.283305] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T21:41:40.290201] [INFO ] [REMOTE ] TPH: Full fetch complete (64883 records). [2025-09-22T21:41:40.290368] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-22T21:41:40.535784] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-22T21:41:40.617012] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T21:41:40.636118] [INFO ] [REMOTE ] TPL: Full fetch complete (18408 records). [2025-09-22T21:41:40.646536] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-22T21:41:40.836182] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-22T21:41:40.841419] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-22T21:41:40.848403] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-22T21:41:40.866839] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-22T21:41:40.904233] [DEBUG] [LOCAL ] TPH: Trimmed 64883 records to 45252 (keeping 200 days of data) [2025-09-22T21:41:41.193450] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-22T21:41:41.193913] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-22T21:41:41.195109] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-22T21:41:41.195824] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-22T21:41:41.197935] [DEBUG] [LOCAL ] TPL: Trimmed 18408 records to 12372 (keeping 200 days of data) [2025-09-22T21:41:41.309028] [DEBUG] [LOCAL ] TPL: Primary data saved (12372 records). [2025-09-22T21:41:41.309879] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-22T21:41:41.310304] [INFO ] [MAIN ] Update Progress: 2118/2372 symbols completed. TPL took 21.4s. Estimated remaining: 33m 46s. Rate: 7.5 symbols/min [2025-09-22T21:41:41.470264] [DEBUG] [LOCAL ] TPH: Primary data saved (45252 records). [2025-09-22T21:41:41.470417] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-22T21:41:41.470508] [INFO ] [MAIN ] Update Progress: 2119/2372 symbols completed. TPH took 23.9s. Estimated remaining: 33m 38s. Rate: 7.5 symbols/min [2025-09-22T21:41:42.586724] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-22T21:41:42.598195] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-22T21:41:44.487696] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T21:41:44.499313] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-22T21:41:46.391384] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-22T21:41:46.403502] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-22T21:41:48.199574] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T21:41:48.210611] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-22T21:41:50.140073] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T21:41:50.151636] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-22T21:41:52.176553] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T21:41:52.189560] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-22T21:41:53.791864] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T21:41:53.804618] [INFO ] [REMOTE ] TPR: Full fetch complete (77442 records). [2025-09-22T21:41:53.804894] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-22T21:41:54.389278] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-22T21:41:54.389398] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-22T21:41:54.392262] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-22T21:41:54.392354] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-22T21:41:54.394046] [DEBUG] [LOCAL ] TPR: Trimmed 77442 records to 53483 (keeping 200 days of data) [2025-09-22T21:41:54.780901] [DEBUG] [LOCAL ] TPR: Primary data saved (53483 records). [2025-09-22T21:41:54.781062] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-22T21:41:54.781188] [INFO ] [MAIN ] Update Progress: 2120/2372 symbols completed. TPR took 31.6s. Estimated remaining: 33m 30s. Rate: 7.5 symbols/min [2025-09-22T21:41:55.520877] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:41:55.516838] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:41:55.533202] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:41:55.610001] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:41:55.618804] [DEBUG] [LOCAL ] TPZ: Loaded 5353 existing records from primary storage. [2025-09-22T21:41:55.623110] [INFO ] [MAIN ] TPZ: Loaded 5353 existing records. [2025-09-22T21:41:55.623012] [DEBUG] [LOCAL ] TPYP: Loaded 8107 existing records from primary storage. [2025-09-22T21:41:55.634734] [INFO ] [MAIN ] TPYP: Loaded 8107 existing records. [2025-09-22T21:41:55.840092] [DEBUG] [LOCAL ] TPVG: Loaded 27486 existing records from primary storage. [2025-09-22T21:41:55.850905] [INFO ] [MAIN ] TPVG: Loaded 27486 existing records. [2025-09-22T21:41:55.850825] [DEBUG] [LOCAL ] TR: Loaded 18499 existing records from primary storage. [2025-09-22T21:41:55.875539] [INFO ] [MAIN ] TR: Loaded 18499 existing records. [2025-09-22T21:41:56.226958] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:41:56.246531] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:41:56.262517] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-22T21:41:56.273115] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-22T21:41:56.283500] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-22T21:41:56.345030] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-22T21:41:56.354251] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-22T21:41:56.378677] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-22T21:41:56.396831] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-22T21:41:56.402593] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-22T21:41:56.434397] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:41:56.440436] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:41:56.537001] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-22T21:41:56.531794] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-22T21:41:56.555442] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-22T21:41:56.571616] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-22T21:41:56.603377] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-22T21:41:56.609339] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-22T21:41:56.612823] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-22T21:41:56.623382] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-22T21:41:57.663569] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:41:57.751704] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:41:57.748249] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-22T21:41:57.805473] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-22T21:41:57.838891] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:41:57.840987] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-22T21:41:57.937424] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:41:57.937940] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-22T21:41:58.584381] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T21:41:58.586698] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-22T21:41:58.660420] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T21:41:58.662920] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-22T21:41:58.870418] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T21:41:58.873696] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-22T21:41:59.076399] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T21:41:59.084305] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-22T21:41:59.168520] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-22T21:41:59.171620] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-22T21:41:59.434449] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-22T21:41:59.437184] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-22T21:41:59.540899] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-22T21:41:59.544883] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-22T21:41:59.843725] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-22T21:41:59.845914] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-22T21:41:59.939627] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-22T21:41:59.942189] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-22T21:41:59.998443] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T21:42:00.004388] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-22T21:42:00.176547] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T21:42:00.180283] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-22T21:42:00.382919] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-22T21:42:00.385261] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-22T21:42:00.541471] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-22T21:42:00.543917] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-22T21:42:01.128859] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T21:42:01.132520] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-22T21:42:01.173062] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T21:42:01.175885] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-22T21:42:01.281459] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-22T21:42:01.293320] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-22T21:42:01.321999] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-22T21:42:02.039999] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T21:42:02.122026] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-22T21:42:02.180338] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T21:42:02.291669] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T21:42:02.922110] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-22T21:42:03.722084] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-22T21:42:04.516250] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T21:42:04.521993] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-22T21:42:04.667955] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-22T21:42:04.725140] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T21:42:05.225173] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T21:42:05.322020] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-22T21:42:05.982132] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T21:42:06.122063] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-22T21:42:06.922120] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-22T21:42:07.545823] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T21:42:07.722076] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-22T21:42:08.341896] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T21:42:08.410487] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T21:42:08.522020] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-22T21:42:09.072159] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T21:42:09.322054] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-22T21:42:10.122120] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-22T21:42:10.510797] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-22T21:42:10.922076] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-22T21:42:11.441848] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T21:42:11.639121] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T21:42:11.722071] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-22T21:42:12.221149] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-22T21:42:12.223022] [INFO ] [REMOTE ] TPZ: Full fetch complete (9253 records). [2025-09-22T21:42:12.223172] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-22T21:42:12.527159] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-22T21:42:12.613241] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-22T21:42:12.613323] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-22T21:42:12.613548] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-22T21:42:12.613596] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-22T21:42:12.614078] [DEBUG] [LOCAL ] TPZ: Trimmed 9253 records to 5195 (keeping 200 days of data) [2025-09-22T21:42:12.647749] [DEBUG] [LOCAL ] TPZ: Primary data saved (5195 records). [2025-09-22T21:42:12.647872] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-22T21:42:12.648008] [INFO ] [MAIN ] Update Progress: 2121/2372 symbols completed. TPZ took 17.9s. Estimated remaining: 33m 23s. Rate: 7.5 symbols/min [2025-09-22T21:42:12.817367] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:42:12.833984] [DEBUG] [LOCAL ] TRAK: Loaded 9553 existing records from primary storage. [2025-09-22T21:42:12.834109] [INFO ] [MAIN ] TRAK: Loaded 9553 existing records. [2025-09-22T21:42:13.024097] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:42:13.024685] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-22T21:42:13.024744] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-22T21:42:13.025316] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-22T21:42:13.025398] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-22T21:42:13.327199] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-22T21:42:13.395606] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:42:13.599670] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-22T21:42:14.122049] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-22T21:42:14.236517] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T21:42:14.238206] [INFO ] [REMOTE ] TPYP: Full fetch complete (12505 records). [2025-09-22T21:42:14.238284] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-22T21:42:14.615771] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-22T21:42:14.615866] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-22T21:42:14.616223] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-22T21:42:14.616263] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-22T21:42:14.616962] [DEBUG] [LOCAL ] TPYP: Trimmed 12505 records to 7872 (keeping 200 days of data) [2025-09-22T21:42:14.665803] [DEBUG] [LOCAL ] TPYP: Primary data saved (7872 records). [2025-09-22T21:42:14.665942] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-22T21:42:14.666029] [INFO ] [MAIN ] Update Progress: 2122/2372 symbols completed. TPYP took 19.9s. Estimated remaining: 33m 15s. Rate: 7.5 symbols/min [2025-09-22T21:42:14.841533] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:42:14.865288] [DEBUG] [LOCAL ] TRC: Loaded 16277 existing records from primary storage. [2025-09-22T21:42:14.865482] [INFO ] [MAIN ] TRC: Loaded 16277 existing records. [2025-09-22T21:42:14.927149] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-22T21:42:15.056908] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:42:15.057172] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-22T21:42:15.057221] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-22T21:42:15.057869] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-22T21:42:15.057931] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-22T21:42:15.423239] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:42:15.722026] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-22T21:42:16.034732] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-22T21:42:16.057969] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T21:42:16.522048] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-22T21:42:16.798169] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T21:42:16.804057] [INFO ] [REMOTE ] TR: Full fetch complete (24792 records). [2025-09-22T21:42:16.804169] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-22T21:42:17.195006] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-22T21:42:17.195090] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-22T21:42:17.195907] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-22T21:42:17.195968] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-22T21:42:17.196622] [DEBUG] [LOCAL ] TR: Trimmed 24792 records to 18292 (keeping 200 days of data) [2025-09-22T21:42:17.320144] [DEBUG] [LOCAL ] TR: Primary data saved (18292 records). [2025-09-22T21:42:17.320806] [INFO ] [MAIN ] TR: Full history saved. [2025-09-22T21:42:17.321069] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T21:42:17.323259] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-22T21:42:17.321195] [INFO ] [MAIN ] Update Progress: 2123/2372 symbols completed. TR took 22.5s. Estimated remaining: 33m 6s. Rate: 7.5 symbols/min [2025-09-22T21:42:17.498763] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:42:17.547901] [DEBUG] [LOCAL ] TREX: Loaded 50744 existing records from primary storage. [2025-09-22T21:42:17.548047] [INFO ] [MAIN ] TREX: Loaded 50744 existing records. [2025-09-22T21:42:17.726511] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:42:17.726853] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-22T21:42:17.726902] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-22T21:42:17.728282] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-22T21:42:17.728343] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-22T21:42:18.089418] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:42:18.122009] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-22T21:42:18.398441] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T21:42:18.922072] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-22T21:42:19.683429] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-22T21:42:19.722059] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-22T21:42:19.772391] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T21:42:20.522073] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-22T21:42:20.542526] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T21:42:21.322040] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-22T21:42:21.716972] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T21:42:22.122113] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-22T21:42:22.921744] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T21:42:22.922049] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-22T21:42:23.038026] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T21:42:23.722071] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-22T21:42:24.108144] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T21:42:24.522096] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-22T21:42:25.260341] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T21:42:25.313201] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T21:42:25.318252] [INFO ] [REMOTE ] TPVG: Full fetch complete (40186 records). [2025-09-22T21:42:25.318353] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-22T21:42:25.330936] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-22T21:42:25.727214] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-22T21:42:25.727292] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-22T21:42:25.728131] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-22T21:42:25.728194] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-22T21:42:25.729155] [DEBUG] [LOCAL ] TPVG: Trimmed 40186 records to 27100 (keeping 200 days of data) [2025-09-22T21:42:25.908342] [DEBUG] [LOCAL ] TPVG: Primary data saved (27100 records). [2025-09-22T21:42:25.908489] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-22T21:42:25.908599] [INFO ] [MAIN ] Update Progress: 2124/2372 symbols completed. TPVG took 31.1s. Estimated remaining: 32m 58s. Rate: 7.5 symbols/min [2025-09-22T21:42:26.092727] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:42:26.133879] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-22T21:42:26.157846] [DEBUG] [LOCAL ] TRGP: Loaded 51625 existing records from primary storage. [2025-09-22T21:42:26.157990] [INFO ] [MAIN ] TRGP: Loaded 51625 existing records. [2025-09-22T21:42:26.271863] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-22T21:42:26.358270] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:42:26.358536] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-22T21:42:26.358603] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-22T21:42:26.360123] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-22T21:42:26.360188] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-22T21:42:26.739036] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:42:26.922076] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-22T21:42:27.697466] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T21:42:27.722006] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-22T21:42:27.893876] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T21:42:28.522083] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-22T21:42:28.547528] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T21:42:29.322052] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-22T21:42:30.122048] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-22T21:42:30.277943] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T21:42:30.427954] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T21:42:30.922067] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-22T21:42:31.722046] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-22T21:42:31.959169] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-22T21:42:32.190675] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T21:42:32.522056] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-22T21:42:33.322062] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-22T21:42:33.491950] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-22T21:42:34.122047] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-22T21:42:34.172400] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (4.05 seconds). [2025-09-22T21:42:34.922058] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-22T21:42:35.013256] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T21:42:35.055523] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-22T21:42:35.397359] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-22T21:42:35.722049] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-22T21:42:36.522108] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-22T21:42:37.271089] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-22T21:42:37.322031] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-22T21:42:37.597457] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-22T21:42:38.122116] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-22T21:42:38.922097] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-22T21:42:38.985304] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-22T21:42:38.989090] [INFO ] [REMOTE ] TRC: Full fetch complete (22110 records). [2025-09-22T21:42:38.989488] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-22T21:42:39.373018] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-22T21:42:39.437312] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-22T21:42:39.437513] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-22T21:42:39.438113] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-22T21:42:39.438224] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-22T21:42:39.439528] [DEBUG] [LOCAL ] TRC: Trimmed 22110 records to 16078 (keeping 200 days of data) [2025-09-22T21:42:39.550313] [DEBUG] [LOCAL ] TRC: Primary data saved (16078 records). [2025-09-22T21:42:39.550510] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-22T21:42:39.550678] [INFO ] [MAIN ] Update Progress: 2125/2372 symbols completed. TRC took 24.9s. Estimated remaining: 32m 51s. Rate: 7.5 symbols/min [2025-09-22T21:42:39.728456] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-22T21:42:39.764795] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:42:39.813898] [DEBUG] [LOCAL ] TRN: Loaded 38047 existing records from primary storage. [2025-09-22T21:42:39.814055] [INFO ] [MAIN ] TRN: Loaded 38047 existing records. [2025-09-22T21:42:39.998348] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:42:39.998629] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-22T21:42:39.998714] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-22T21:42:39.999717] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-22T21:42:39.999780] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-22T21:42:40.415949] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:42:40.522049] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-22T21:42:40.665614] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T21:42:41.134331] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-22T21:42:41.322054] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-22T21:42:41.380484] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T21:42:42.122052] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-22T21:42:42.809724] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-22T21:42:42.922035] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-22T21:42:43.007534] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T21:42:43.722057] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-22T21:42:44.213939] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-22T21:42:44.522061] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-22T21:42:45.303256] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T21:42:45.311233] [INFO ] [REMOTE ] TREX: Full fetch complete (70889 records). [2025-09-22T21:42:45.311368] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-22T21:42:45.327127] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-22T21:42:45.723569] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-22T21:42:45.723689] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-22T21:42:45.725032] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-22T21:42:45.725099] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-22T21:42:45.727039] [DEBUG] [LOCAL ] TREX: Trimmed 70889 records to 50024 (keeping 200 days of data) [2025-09-22T21:42:46.051436] [DEBUG] [LOCAL ] TREX: Primary data saved (50024 records). [2025-09-22T21:42:46.051692] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-22T21:42:46.051933] [INFO ] [MAIN ] Update Progress: 2126/2372 symbols completed. TREX took 28.7s. Estimated remaining: 32m 43s. Rate: 7.5 symbols/min [2025-09-22T21:42:46.125144] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-22T21:42:46.164034] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-22T21:42:46.202979] [INFO ] [REMOTE ] TRAK: Full fetch complete (13361 records). [2025-09-22T21:42:46.233686] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-22T21:42:46.269284] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:42:46.692949] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-22T21:42:46.693231] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-22T21:42:46.694517] [DEBUG] [LOCAL ] TRNO: Loaded 44882 existing records from primary storage. [2025-09-22T21:42:46.694680] [INFO ] [MAIN ] TRNO: Loaded 44882 existing records. [2025-09-22T21:42:46.693721] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-22T21:42:46.694884] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-22T21:42:46.772230] [DEBUG] [LOCAL ] TRAK: Trimmed 13361 records to 9317 (keeping 200 days of data) [2025-09-22T21:42:46.895991] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-22T21:42:46.973948] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-22T21:42:46.993186] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:42:46.995137] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-22T21:42:46.995668] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-22T21:42:46.998161] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-22T21:42:46.998850] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-22T21:42:47.298739] [DEBUG] [LOCAL ] TRAK: Primary data saved (9317 records). [2025-09-22T21:42:47.308459] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-22T21:42:47.316607] [INFO ] [MAIN ] Update Progress: 2127/2372 symbols completed. TRAK took 34.7s. Estimated remaining: 32m 34s. Rate: 7.5 symbols/min [2025-09-22T21:42:47.773006] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:42:47.799788] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-22T21:42:47.837863] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:42:47.878782] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T21:42:47.951778] [DEBUG] [LOCAL ] TROX: Loaded 52525 existing records from primary storage. [2025-09-22T21:42:47.951965] [INFO ] [MAIN ] TROX: Loaded 52525 existing records. [2025-09-22T21:42:48.198189] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:42:48.198529] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-22T21:42:48.198587] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-22T21:42:48.199697] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-22T21:42:48.199762] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-22T21:42:48.524398] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-22T21:42:48.614546] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:42:48.812662] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T21:42:49.322016] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-22T21:42:49.482871] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T21:42:49.984913] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-22T21:42:50.122036] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-22T21:42:50.921989] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-22T21:42:51.075133] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T21:42:51.609940] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T21:42:51.722083] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-22T21:42:52.219682] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T21:42:52.522116] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-22T21:42:53.268845] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T21:42:53.322092] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-22T21:42:54.122036] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-22T21:42:54.521886] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-22T21:42:54.807251] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T21:42:54.922042] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-22T21:42:55.358041] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-22T21:42:55.722069] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-22T21:42:56.522046] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-22T21:42:56.652131] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T21:42:57.322047] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-22T21:42:57.500727] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T21:42:58.068382] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T21:42:58.122012] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-22T21:42:58.922024] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-22T21:42:58.979226] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:42:59.672407] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T21:42:59.722036] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-22T21:43:00.308158] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T21:43:00.405094] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-22T21:43:00.413278] [INFO ] [REMOTE ] TRGP: Full fetch complete (73506 records). [2025-09-22T21:43:00.413412] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-22T21:43:00.527156] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-22T21:43:00.833365] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-22T21:43:00.833449] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-22T21:43:00.834578] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-22T21:43:00.834662] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-22T21:43:00.836111] [DEBUG] [LOCAL ] TRGP: Trimmed 73506 records to 50848 (keeping 200 days of data) [2025-09-22T21:43:01.178092] [DEBUG] [LOCAL ] TRGP: Primary data saved (50848 records). [2025-09-22T21:43:01.178252] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-22T21:43:01.178341] [INFO ] [MAIN ] Update Progress: 2128/2372 symbols completed. TRGP took 35.3s. Estimated remaining: 32m 27s. Rate: 7.5 symbols/min [2025-09-22T21:43:01.328947] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-22T21:43:01.357160] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:43:01.412376] [DEBUG] [LOCAL ] TRP: Loaded 52906 existing records from primary storage. [2025-09-22T21:43:01.412543] [INFO ] [MAIN ] TRP: Loaded 52906 existing records. [2025-09-22T21:43:01.588301] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:43:01.588560] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-22T21:43:01.588608] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-22T21:43:01.589968] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-22T21:43:01.590057] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-22T21:43:01.943162] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:43:02.122069] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-22T21:43:02.415186] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-22T21:43:02.922081] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-22T21:43:03.107466] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T21:43:03.442371] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T21:43:03.722108] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-22T21:43:04.220769] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-22T21:43:04.522081] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-22T21:43:05.209377] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T21:43:05.322076] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-22T21:43:06.122051] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-22T21:43:06.214451] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T21:43:06.922075] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-22T21:43:06.974524] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T21:43:07.722100] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-22T21:43:07.790124] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T21:43:08.522067] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-22T21:43:08.595948] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T21:43:09.118376] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T21:43:09.322069] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-22T21:43:10.122186] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-22T21:43:10.393706] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T21:43:10.787758] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T21:43:10.922085] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-22T21:43:11.722100] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-22T21:43:12.029348] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-22T21:43:12.522159] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-22T21:43:12.731284] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-22T21:43:12.962219] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T21:43:12.967855] [INFO ] [REMOTE ] TRN: Full fetch complete (52873 records). [2025-09-22T21:43:12.967949] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-22T21:43:13.327116] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-22T21:43:13.379978] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-22T21:43:13.380066] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-22T21:43:13.381109] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-22T21:43:13.381177] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-22T21:43:13.382395] [DEBUG] [LOCAL ] TRN: Trimmed 52873 records to 37376 (keeping 200 days of data) [2025-09-22T21:43:13.632587] [DEBUG] [LOCAL ] TRN: Primary data saved (37376 records). [2025-09-22T21:43:13.632762] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-22T21:43:13.632886] [INFO ] [MAIN ] Update Progress: 2129/2372 symbols completed. TRN took 34.1s. Estimated remaining: 32m 19s. Rate: 7.5 symbols/min [2025-09-22T21:43:13.801473] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:43:13.843882] [DEBUG] [LOCAL ] TRTX: Loaded 37925 existing records from primary storage. [2025-09-22T21:43:13.844108] [INFO ] [MAIN ] TRTX: Loaded 37925 existing records. [2025-09-22T21:43:14.058788] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:43:14.059269] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-22T21:43:14.059353] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-22T21:43:14.060323] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-22T21:43:14.060386] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-22T21:43:14.124123] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-22T21:43:14.337658] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T21:43:14.475349] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:43:14.930667] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-22T21:43:14.935348] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T21:43:14.943727] [INFO ] [REMOTE ] TROX: Full fetch complete (72441 records). [2025-09-22T21:43:14.943832] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-22T21:43:15.333831] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-22T21:43:15.333924] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-22T21:43:15.335066] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-22T21:43:15.335131] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-22T21:43:15.336688] [DEBUG] [LOCAL ] TROX: Trimmed 72441 records to 51770 (keeping 200 days of data) [2025-09-22T21:43:15.657446] [DEBUG] [LOCAL ] TROX: Primary data saved (51770 records). [2025-09-22T21:43:15.657602] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-22T21:43:15.657735] [INFO ] [MAIN ] Update Progress: 2130/2372 symbols completed. TROX took 28.3s. Estimated remaining: 32m 11s. Rate: 7.5 symbols/min [2025-09-22T21:43:15.732968] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-22T21:43:15.832740] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:43:15.860590] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T21:43:15.917477] [DEBUG] [LOCAL ] TRU: Loaded 51951 existing records from primary storage. [2025-09-22T21:43:15.917660] [INFO ] [MAIN ] TRU: Loaded 51951 existing records. [2025-09-22T21:43:16.094081] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:43:16.094297] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-22T21:43:16.094345] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-22T21:43:16.096057] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-22T21:43:16.096117] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-22T21:43:16.457232] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:43:16.489366] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T21:43:16.521998] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-22T21:43:16.894797] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T21:43:17.322071] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-22T21:43:18.119230] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T21:43:18.128189] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-22T21:43:18.919034] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T21:43:18.922741] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-22T21:43:19.722081] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-22T21:43:19.886217] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T21:43:20.383263] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T21:43:20.522000] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-22T21:43:20.998535] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T21:43:21.322077] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-22T21:43:22.122033] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-22T21:43:22.165389] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T21:43:22.670225] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T21:43:22.922099] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-22T21:43:23.722076] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-22T21:43:23.905284] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T21:43:24.522064] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-22T21:43:24.621195] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T21:43:25.207807] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T21:43:25.322073] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-22T21:43:25.955067] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T21:43:25.962697] [INFO ] [REMOTE ] TRNO: Full fetch complete (64084 records). [2025-09-22T21:43:25.962823] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-22T21:43:26.138003] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-22T21:43:26.362695] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-22T21:43:26.362790] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-22T21:43:26.363943] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-22T21:43:26.364007] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-22T21:43:26.365346] [DEBUG] [LOCAL ] TRNO: Trimmed 64084 records to 44161 (keeping 200 days of data) [2025-09-22T21:43:26.630503] [DEBUG] [LOCAL ] TRNO: Primary data saved (44161 records). [2025-09-22T21:43:26.630637] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-22T21:43:26.630757] [INFO ] [MAIN ] Update Progress: 2131/2372 symbols completed. TRNO took 40.6s. Estimated remaining: 32m 3s. Rate: 7.5 symbols/min [2025-09-22T21:43:26.809226] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:43:26.857678] [DEBUG] [LOCAL ] TRV: Loaded 49097 existing records from primary storage. [2025-09-22T21:43:26.857833] [INFO ] [MAIN ] TRV: Loaded 49097 existing records. [2025-09-22T21:43:26.927761] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-22T21:43:27.043592] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:43:27.044003] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-22T21:43:27.044062] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-22T21:43:27.045423] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-22T21:43:27.045507] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-22T21:43:27.422736] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:43:27.491446] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T21:43:27.530223] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-22T21:43:27.722072] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-22T21:43:28.531698] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-22T21:43:28.555074] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T21:43:29.322038] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-22T21:43:29.549512] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T21:43:29.610955] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T21:43:30.122115] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-22T21:43:30.810855] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T21:43:30.922064] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-22T21:43:31.722031] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-22T21:43:31.926468] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-22T21:43:32.527194] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-22T21:43:32.540357] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:43:33.094557] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T21:43:33.322060] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-22T21:43:34.122031] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-22T21:43:34.428543] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T21:43:34.468479] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T21:43:34.922080] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-22T21:43:35.722078] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-22T21:43:35.927825] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T21:43:36.522049] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-22T21:43:36.734073] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T21:43:37.322062] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-22T21:43:37.419204] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T21:43:38.127444] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-22T21:43:38.143288] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T21:43:38.922032] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-22T21:43:39.001583] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T21:43:39.009938] [INFO ] [REMOTE ] TRP: Full fetch complete (75565 records). [2025-09-22T21:43:39.010100] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-22T21:43:39.437338] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-22T21:43:39.437423] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-22T21:43:39.438582] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-22T21:43:39.438667] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-22T21:43:39.440165] [DEBUG] [LOCAL ] TRP: Trimmed 75565 records to 52131 (keeping 200 days of data) [2025-09-22T21:43:39.728173] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-22T21:43:39.774737] [DEBUG] [LOCAL ] TRP: Primary data saved (52131 records). [2025-09-22T21:43:39.774857] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-22T21:43:39.774942] [INFO ] [MAIN ] Update Progress: 2132/2372 symbols completed. TRP took 38.6s. Estimated remaining: 31m 55s. Rate: 7.5 symbols/min [2025-09-22T21:43:39.950510] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:43:40.002541] [DEBUG] [LOCAL ] TS: Loaded 52447 existing records from primary storage. [2025-09-22T21:43:40.002774] [INFO ] [MAIN ] TS: Loaded 52447 existing records. [2025-09-22T21:43:40.186363] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:43:40.186818] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-22T21:43:40.186881] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-22T21:43:40.211827] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-22T21:43:40.215059] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-22T21:43:40.217025] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-22T21:43:40.524361] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-22T21:43:40.613834] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:43:40.645080] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-22T21:43:40.655119] [INFO ] [REMOTE ] TRU: Full fetch complete (72995 records). [2025-09-22T21:43:40.655369] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-22T21:43:41.111345] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-22T21:43:41.111497] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-22T21:43:41.113217] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-22T21:43:41.113306] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-22T21:43:41.147534] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-22T21:43:41.155058] [DEBUG] [LOCAL ] TRU: Trimmed 72995 records to 51198 (keeping 200 days of data) [2025-09-22T21:43:41.372707] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-22T21:43:41.517111] [DEBUG] [LOCAL ] TRU: Primary data saved (51198 records). [2025-09-22T21:43:41.517267] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-22T21:43:41.517464] [INFO ] [MAIN ] Update Progress: 2133/2372 symbols completed. TRU took 25.9s. Estimated remaining: 31m 47s. Rate: 7.5 symbols/min [2025-09-22T21:43:41.692585] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:43:41.722844] [DEBUG] [LOCAL ] TSE: Loaded 29327 existing records from primary storage. [2025-09-22T21:43:41.723014] [INFO ] [MAIN ] TSE: Loaded 29327 existing records. [2025-09-22T21:43:41.912456] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:43:41.912741] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-22T21:43:41.912796] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-22T21:43:41.913449] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-22T21:43:41.913513] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-22T21:43:42.130400] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-22T21:43:42.298732] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:43:42.331937] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T21:43:42.922036] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-22T21:43:43.131426] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T21:43:43.532436] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T21:43:43.540467] [INFO ] [REMOTE ] TRTX: Full fetch complete (52794 records). [2025-09-22T21:43:43.540583] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-22T21:43:43.732601] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-22T21:43:43.927568] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-22T21:43:43.927681] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-22T21:43:43.928709] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-22T21:43:43.928798] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-22T21:43:43.932299] [DEBUG] [LOCAL ] TRTX: Trimmed 52794 records to 37353 (keeping 200 days of data) [2025-09-22T21:43:44.160663] [DEBUG] [LOCAL ] TRTX: Primary data saved (37353 records). [2025-09-22T21:43:44.160812] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-22T21:43:44.160928] [INFO ] [MAIN ] Update Progress: 2134/2372 symbols completed. TRTX took 30.5s. Estimated remaining: 31m 38s. Rate: 7.5 symbols/min [2025-09-22T21:43:44.343291] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:43:44.355666] [DEBUG] [LOCAL ] TSI: Loaded 8745 existing records from primary storage. [2025-09-22T21:43:44.355790] [INFO ] [MAIN ] TSI: Loaded 8745 existing records. [2025-09-22T21:43:44.539777] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-22T21:43:44.539920] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:43:44.542032] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-22T21:43:44.542154] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-22T21:43:44.542598] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-22T21:43:44.542790] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-22T21:43:44.859625] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T21:43:44.958044] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:43:45.289040] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-22T21:43:45.322039] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-22T21:43:45.999348] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T21:43:46.056913] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T21:43:46.122109] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-22T21:43:46.922049] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-22T21:43:47.335507] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T21:43:47.618754] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-22T21:43:47.722070] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-22T21:43:48.522032] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-22T21:43:48.738565] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-22T21:43:49.322050] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-22T21:43:50.122080] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-22T21:43:50.289134] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-22T21:43:50.417150] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T21:43:50.922066] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-22T21:43:51.727171] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-22T21:43:51.746312] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:43:52.201003] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-22T21:43:52.522084] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-22T21:43:53.322062] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-22T21:43:53.592381] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T21:43:53.769804] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T21:43:54.122095] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-22T21:43:54.922069] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-22T21:43:55.342082] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-22T21:43:55.413914] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-22T21:43:55.722087] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-22T21:43:56.522158] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-22T21:43:56.768273] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T21:43:56.953840] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-22T21:43:57.322069] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-22T21:43:58.122044] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-22T21:43:58.590220] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-22T21:43:58.619600] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-22T21:43:58.922072] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-22T21:43:59.722052] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-22T21:43:59.924470] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T21:44:00.184259] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-22T21:44:00.269555] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-22T21:44:00.277416] [INFO ] [REMOTE ] TRV: Full fetch complete (70050 records). [2025-09-22T21:44:00.277677] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-22T21:44:00.528216] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-22T21:44:00.860383] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-22T21:44:00.860556] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-22T21:44:00.861869] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-22T21:44:00.861973] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-22T21:44:00.863714] [DEBUG] [LOCAL ] TRV: Trimmed 70050 records to 48275 (keeping 200 days of data) [2025-09-22T21:44:01.210849] [DEBUG] [LOCAL ] TRV: Primary data saved (48275 records). [2025-09-22T21:44:01.211025] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-22T21:44:01.211152] [INFO ] [MAIN ] Update Progress: 2135/2372 symbols completed. TRV took 34.6s. Estimated remaining: 31m 31s. Rate: 7.5 symbols/min [2025-09-22T21:44:01.323454] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-22T21:44:01.401753] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:44:01.442386] [DEBUG] [LOCAL ] TSLX: Loaded 35905 existing records from primary storage. [2025-09-22T21:44:01.442570] [INFO ] [MAIN ] TSLX: Loaded 35905 existing records. [2025-09-22T21:44:01.581460] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T21:44:01.666461] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:44:01.666793] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-22T21:44:01.666845] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-22T21:44:01.668068] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-22T21:44:01.668141] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-22T21:44:02.050482] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:44:02.122063] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-22T21:44:02.922080] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-22T21:44:03.077632] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T21:44:03.380202] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T21:44:03.395092] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-22T21:44:03.722068] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-22T21:44:04.522065] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-22T21:44:05.322038] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-22T21:44:05.446574] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T21:44:05.619360] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-22T21:44:05.625108] [INFO ] [REMOTE ] TSE: Full fetch complete (41982 records). [2025-09-22T21:44:05.625224] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-22T21:44:05.952678] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T21:44:06.036631] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-22T21:44:06.036751] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-22T21:44:06.037773] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-22T21:44:06.037837] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-22T21:44:06.038901] [DEBUG] [LOCAL ] TSE: Trimmed 41982 records to 28835 (keeping 200 days of data) [2025-09-22T21:44:06.137103] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-22T21:44:06.223986] [DEBUG] [LOCAL ] TSE: Primary data saved (28835 records). [2025-09-22T21:44:06.224135] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-22T21:44:06.224335] [INFO ] [MAIN ] Update Progress: 2136/2372 symbols completed. TSE took 24.7s. Estimated remaining: 31m 23s. Rate: 7.5 symbols/min [2025-09-22T21:44:06.402160] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:44:06.466425] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-22T21:44:06.466594] [INFO ] [MAIN ] TSM: Loaded 54599 existing records. [2025-09-22T21:44:06.673898] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:44:06.674209] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-22T21:44:06.674263] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-22T21:44:06.676785] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-22T21:44:06.676850] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-22T21:44:06.927280] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-22T21:44:07.050180] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:44:07.705365] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T21:44:07.727114] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-22T21:44:07.742854] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T21:44:08.522058] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-22T21:44:08.984156] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T21:44:09.322085] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-22T21:44:10.122064] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-22T21:44:10.199767] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-22T21:44:10.212215] [INFO ] [REMOTE ] TS: Full fetch complete (74438 records). [2025-09-22T21:44:10.212388] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-22T21:44:10.631826] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-22T21:44:10.631930] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-22T21:44:10.633138] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-22T21:44:10.633211] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-22T21:44:10.635112] [DEBUG] [LOCAL ] TS: Trimmed 74438 records to 51670 (keeping 200 days of data) [2025-09-22T21:44:10.882518] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-22T21:44:10.951234] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-22T21:44:10.995305] [DEBUG] [LOCAL ] TS: Primary data saved (51670 records). [2025-09-22T21:44:10.995474] [INFO ] [MAIN ] TS: Full history saved. [2025-09-22T21:44:10.995637] [INFO ] [MAIN ] Update Progress: 2137/2372 symbols completed. TS took 31.2s. Estimated remaining: 31m 15s. Rate: 7.5 symbols/min [2025-09-22T21:44:11.168979] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:44:11.226398] [DEBUG] [LOCAL ] TSN: Loaded 53612 existing records from primary storage. [2025-09-22T21:44:11.226622] [INFO ] [MAIN ] TSN: Loaded 53612 existing records. [2025-09-22T21:44:11.409876] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:44:11.410199] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-22T21:44:11.410256] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-22T21:44:11.412303] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-22T21:44:11.412376] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-22T21:44:11.724869] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-22T21:44:11.767939] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T21:44:11.840066] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:44:11.947699] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-22T21:44:12.522105] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-22T21:44:13.105389] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T21:44:13.322059] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-22T21:44:13.968716] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-22T21:44:13.970535] [INFO ] [REMOTE ] TSI: Full fetch complete (13306 records). [2025-09-22T21:44:13.970607] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-22T21:44:14.128585] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-22T21:44:14.398893] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-22T21:44:14.398980] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-22T21:44:14.399317] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-22T21:44:14.399397] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-22T21:44:14.399960] [DEBUG] [LOCAL ] TSI: Trimmed 13306 records to 8336 (keeping 200 days of data) [2025-09-22T21:44:14.452547] [DEBUG] [LOCAL ] TSI: Primary data saved (8336 records). [2025-09-22T21:44:14.452710] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-22T21:44:14.452830] [INFO ] [MAIN ] Update Progress: 2138/2372 symbols completed. TSI took 30.3s. Estimated remaining: 31m 6s. Rate: 7.5 symbols/min [2025-09-22T21:44:14.647349] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:44:14.664115] [DEBUG] [LOCAL ] TSQ: Loaded 12203 existing records from primary storage. [2025-09-22T21:44:14.664257] [INFO ] [MAIN ] TSQ: Loaded 12203 existing records. [2025-09-22T21:44:14.854131] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:44:14.854382] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-22T21:44:14.854446] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-22T21:44:14.854951] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-22T21:44:14.855013] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-22T21:44:14.949439] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-22T21:44:15.243596] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:44:15.273756] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-09-22T21:44:15.722032] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-22T21:44:15.886026] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T21:44:16.505063] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T21:44:16.522003] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-22T21:44:17.322053] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-22T21:44:17.834842] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-22T21:44:18.105698] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-22T21:44:18.122018] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-22T21:44:18.180557] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-22T21:44:18.922034] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-22T21:44:18.974371] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-22T21:44:19.722060] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-22T21:44:20.522140] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-22T21:44:21.274952] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T21:44:21.322034] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-22T21:44:21.363757] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-22T21:44:22.122046] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-22T21:44:22.307631] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T21:44:22.816035] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T21:44:22.922062] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-22T21:44:23.124766] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T21:44:23.722092] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-22T21:44:24.522092] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-22T21:44:25.322076] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-22T21:44:25.547614] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-22T21:44:25.779340] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-22T21:44:26.009962] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T21:44:26.026052] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-22T21:44:26.122027] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-22T21:44:26.922102] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-22T21:44:26.978910] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-22T21:44:27.722062] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-22T21:44:28.522040] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-22T21:44:28.822520] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-22T21:44:29.322028] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-22T21:44:29.531930] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T21:44:30.122068] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-22T21:44:30.527452] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-22T21:44:30.752576] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T21:44:30.922066] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-22T21:44:31.722031] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-22T21:44:32.090272] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-22T21:44:32.400547] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T21:44:32.408617] [INFO ] [REMOTE ] TSLX: Full fetch complete (48930 records). [2025-09-22T21:44:32.408845] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-22T21:44:32.531202] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-22T21:44:32.813763] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T21:44:32.842411] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-22T21:44:32.842484] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-22T21:44:32.843455] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-22T21:44:32.843529] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-22T21:44:32.844525] [DEBUG] [LOCAL ] TSLX: Trimmed 48930 records to 35314 (keeping 200 days of data) [2025-09-22T21:44:33.068818] [DEBUG] [LOCAL ] TSLX: Primary data saved (35314 records). [2025-09-22T21:44:33.069034] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-22T21:44:33.069154] [INFO ] [MAIN ] Update Progress: 2139/2372 symbols completed. TSLX took 31.9s. Estimated remaining: 30m 59s. Rate: 7.5 symbols/min [2025-09-22T21:44:33.241925] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:44:33.290002] [DEBUG] [LOCAL ] TT: Loaded 48717 existing records from primary storage. [2025-09-22T21:44:33.290169] [INFO ] [MAIN ] TT: Loaded 48717 existing records. [2025-09-22T21:44:33.327180] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-22T21:44:33.471851] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:44:33.472073] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-22T21:44:33.472121] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-22T21:44:33.473216] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-22T21:44:33.473275] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-22T21:44:33.836375] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:44:34.122023] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-22T21:44:34.206471] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-22T21:44:34.359421] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T21:44:34.922059] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-22T21:44:35.639143] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T21:44:35.722077] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-22T21:44:36.522100] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-22T21:44:37.322023] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-22T21:44:37.540159] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T21:44:37.578397] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-22T21:44:38.122061] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-22T21:44:38.258428] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-22T21:44:38.319519] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-22T21:44:38.922083] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-22T21:44:39.722129] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-22T21:44:40.522076] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-22T21:44:40.908392] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T21:44:40.951950] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-22T21:44:41.010717] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-22T21:44:41.013451] [INFO ] [REMOTE ] TSQ: Full fetch complete (16746 records). [2025-09-22T21:44:41.013537] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-22T21:44:41.334900] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-22T21:44:41.455749] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-22T21:44:41.455847] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-22T21:44:41.456316] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-22T21:44:41.456490] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-22T21:44:41.457269] [DEBUG] [LOCAL ] TSQ: Trimmed 16746 records to 12128 (keeping 200 days of data) [2025-09-22T21:44:41.530209] [DEBUG] [LOCAL ] TSQ: Primary data saved (12128 records). [2025-09-22T21:44:41.530340] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-22T21:44:41.530425] [INFO ] [MAIN ] Update Progress: 2140/2372 symbols completed. TSQ took 27.1s. Estimated remaining: 30m 51s. Rate: 7.5 symbols/min [2025-09-22T21:44:41.666294] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-22T21:44:41.742274] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:44:41.742498] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-22T21:44:41.742565] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-22T21:44:41.742764] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-22T21:44:41.742811] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-22T21:44:41.742855] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-22T21:44:41.742889] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-22T21:44:42.125058] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-22T21:44:42.124990] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:44:42.922061] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-22T21:44:43.171976] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T21:44:43.687221] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T21:44:43.722004] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-22T21:44:44.522052] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-22T21:44:44.748587] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:44:44.748983] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-22T21:44:45.322032] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-22T21:44:45.538256] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T21:44:45.578029] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-22T21:44:46.122051] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-22T21:44:46.678454] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T21:44:46.687029] [INFO ] [REMOTE ] TSN: Full fetch complete (76224 records). [2025-09-22T21:44:46.687269] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-22T21:44:46.927187] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-22T21:44:47.093194] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-22T21:44:47.093277] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-22T21:44:47.094436] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-22T21:44:47.094502] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-22T21:44:47.096121] [DEBUG] [LOCAL ] TSN: Trimmed 76224 records to 52850 (keeping 200 days of data) [2025-09-22T21:44:47.424383] [DEBUG] [LOCAL ] TSN: Primary data saved (52850 records). [2025-09-22T21:44:47.424529] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-22T21:44:47.424632] [INFO ] [MAIN ] Update Progress: 2141/2372 symbols completed. TSN took 36.4s. Estimated remaining: 30m 43s. Rate: 7.5 symbols/min [2025-09-22T21:44:47.602432] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:44:47.643910] [DEBUG] [LOCAL ] TTC: Loaded 43603 existing records from primary storage. [2025-09-22T21:44:47.644080] [INFO ] [MAIN ] TTC: Loaded 43603 existing records. [2025-09-22T21:44:47.725758] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-09-22T21:44:47.833922] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:44:47.834536] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-22T21:44:47.834629] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-22T21:44:47.836095] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-22T21:44:47.836166] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-22T21:44:48.024346] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:44:48.098582] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-09-22T21:44:48.172628] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-22T21:44:48.282524] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:44:48.522079] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-22T21:44:49.322063] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-22T21:44:49.371484] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-22T21:44:49.383442] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-09-22T21:44:49.383724] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-22T21:44:49.798244] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-22T21:44:49.798357] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-22T21:44:49.799572] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-22T21:44:49.808031] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-22T21:44:49.814919] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-22T21:44:49.821426] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-09-22T21:44:50.126800] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-22T21:44:50.173690] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-09-22T21:44:50.173895] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-22T21:44:50.173995] [INFO ] [MAIN ] Update Progress: 2142/2372 symbols completed. TSM took 43.9s. Estimated remaining: 30m 35s. Rate: 7.5 symbols/min [2025-09-22T21:44:50.343778] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:44:50.396826] [DEBUG] [LOCAL ] TTE: Loaded 52436 existing records from primary storage. [2025-09-22T21:44:50.396991] [INFO ] [MAIN ] TTE: Loaded 52436 existing records. [2025-09-22T21:44:50.577604] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:44:50.578009] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-22T21:44:50.578088] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-22T21:44:50.579341] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-22T21:44:50.579403] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-22T21:44:50.760574] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T21:44:50.927210] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-22T21:44:50.980903] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:44:51.722028] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-22T21:44:51.750851] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T21:44:52.367366] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T21:44:52.522121] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-22T21:44:53.322066] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-22T21:44:53.444933] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T21:44:53.533374] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T21:44:54.122093] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-22T21:44:54.656634] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T21:44:54.922065] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-22T21:44:55.722018] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-22T21:44:55.830792] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T21:44:55.899851] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-22T21:44:56.522109] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-22T21:44:57.322046] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-22T21:44:57.521482] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T21:44:58.122088] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-22T21:44:58.166824] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T21:44:58.447455] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-22T21:44:58.456513] [INFO ] [REMOTE ] TT: Full fetch complete (69813 records). [2025-09-22T21:44:58.456673] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-22T21:44:58.639353] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T21:44:58.884793] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-22T21:44:58.884891] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-22T21:44:58.886164] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-22T21:44:58.886230] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-22T21:44:58.889911] [DEBUG] [LOCAL ] TT: Trimmed 69813 records to 47955 (keeping 200 days of data) [2025-09-22T21:44:58.946704] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-22T21:44:59.220421] [DEBUG] [LOCAL ] TT: Primary data saved (47955 records). [2025-09-22T21:44:59.220724] [INFO ] [MAIN ] TT: Full history saved. [2025-09-22T21:44:59.220825] [INFO ] [MAIN ] Update Progress: 2143/2372 symbols completed. TT took 26.2s. Estimated remaining: 30m 27s. Rate: 7.5 symbols/min [2025-09-22T21:44:59.393966] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:44:59.438812] [DEBUG] [LOCAL ] TTI: Loaded 45947 existing records from primary storage. [2025-09-22T21:44:59.438955] [INFO ] [MAIN ] TTI: Loaded 45947 existing records. [2025-09-22T21:44:59.621943] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:44:59.622205] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-22T21:44:59.622270] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-22T21:44:59.623233] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-22T21:44:59.623293] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-22T21:44:59.725936] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-22T21:44:59.983132] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:45:00.324827] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T21:45:00.522063] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-22T21:45:01.322026] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-22T21:45:01.818603] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-22T21:45:02.122050] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-22T21:45:02.376307] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T21:45:02.922056] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-22T21:45:03.722115] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-22T21:45:04.533107] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (3.21 seconds). [2025-09-22T21:45:04.543356] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-22T21:45:04.602568] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-22T21:45:04.703445] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T21:45:05.322142] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-22T21:45:05.490285] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T21:45:06.108566] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T21:45:06.121994] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-22T21:45:06.223291] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T21:45:06.228612] [INFO ] [REMOTE ] TTAM: Full fetch complete (32538 records). [2025-09-22T21:45:06.228858] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-22T21:45:06.438571] [WARN ] [VALIDATOR ] TTAM: Validation failed - insufficient historical data. Have 156 unique days, need 200 days [2025-09-22T21:45:06.439365] [FATAL] [MAIN ] TTAM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:45:06.439455] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:45:06.439539] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-22T21:45:06.439707] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-22T21:45:06.439795] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-22T21:45:06.439883] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-22T21:45:06.440033] [INFO ] [MAIN ] Update Progress: 2144/2372 symbols completed. TTAM took 24.9s. Estimated remaining: 30m 19s. Rate: 7.5 symbols/min [2025-09-22T21:45:06.629096] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:45:06.688444] [DEBUG] [LOCAL ] TU: Loaded 50687 existing records from primary storage. [2025-09-22T21:45:06.688693] [INFO ] [MAIN ] TU: Loaded 50687 existing records. [2025-09-22T21:45:06.867032] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:45:06.867259] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-22T21:45:06.867307] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-22T21:45:06.868440] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-22T21:45:06.868501] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-22T21:45:06.931476] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-22T21:45:07.281215] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:45:07.722022] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-22T21:45:07.948468] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T21:45:08.522134] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-22T21:45:08.804804] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T21:45:09.212042] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T21:45:09.322062] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-22T21:45:09.988818] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T21:45:10.122024] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-22T21:45:10.861964] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T21:45:10.922004] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-22T21:45:11.722090] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-22T21:45:11.805588] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T21:45:12.522029] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-22T21:45:12.720163] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T21:45:13.322031] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-22T21:45:13.643293] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-22T21:45:14.122110] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-22T21:45:14.916966] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-22T21:45:14.927795] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-22T21:45:15.608104] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-22T21:45:15.722062] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-22T21:45:16.231961] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-22T21:45:16.522136] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-22T21:45:17.210082] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T21:45:17.306995] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-22T21:45:17.322002] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-22T21:45:18.122095] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-22T21:45:18.159916] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T21:45:18.922066] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-22T21:45:19.169387] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-22T21:45:19.722036] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-22T21:45:19.909583] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-22T21:45:20.145683] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T21:45:20.522104] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-22T21:45:21.322033] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-22T21:45:21.472182] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-22T21:45:22.122032] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-22T21:45:22.209762] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T21:45:22.709825] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T21:45:22.922072] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-22T21:45:23.697287] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-22T21:45:23.705250] [INFO ] [REMOTE ] TTE: Full fetch complete (75080 records). [2025-09-22T21:45:23.705395] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-22T21:45:23.727135] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-22T21:45:24.104633] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-22T21:45:24.104788] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-22T21:45:24.106027] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-22T21:45:24.106095] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-22T21:45:24.107751] [DEBUG] [LOCAL ] TTE: Trimmed 75080 records to 51653 (keeping 200 days of data) [2025-09-22T21:45:24.385861] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T21:45:24.469954] [DEBUG] [LOCAL ] TTE: Primary data saved (51653 records). [2025-09-22T21:45:24.470129] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-22T21:45:24.470250] [INFO ] [MAIN ] Update Progress: 2145/2372 symbols completed. TTE took 34.3s. Estimated remaining: 30m 12s. Rate: 7.5 symbols/min [2025-09-22T21:45:24.528219] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-22T21:45:24.652886] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:45:24.699050] [DEBUG] [LOCAL ] TUYA: Loaded 47368 existing records from primary storage. [2025-09-22T21:45:24.699254] [INFO ] [MAIN ] TUYA: Loaded 47368 existing records. [2025-09-22T21:45:24.882140] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:45:24.882491] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-22T21:45:24.882575] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-22T21:45:24.883967] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-22T21:45:24.884056] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-22T21:45:25.269506] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:45:25.292928] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T21:45:25.322015] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-22T21:45:26.122102] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-22T21:45:26.154179] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T21:45:26.922045] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-22T21:45:27.097087] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T21:45:27.277213] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T21:45:27.722113] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-22T21:45:28.524030] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-22T21:45:28.531321] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T21:45:28.539035] [INFO ] [REMOTE ] TTI: Full fetch complete (64713 records). [2025-09-22T21:45:28.539176] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-22T21:45:28.938933] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-22T21:45:28.939015] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-22T21:45:28.940105] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-22T21:45:28.940169] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-22T21:45:28.941443] [DEBUG] [LOCAL ] TTI: Trimmed 64713 records to 45260 (keeping 200 days of data) [2025-09-22T21:45:29.229584] [DEBUG] [LOCAL ] TTI: Primary data saved (45260 records). [2025-09-22T21:45:29.229805] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-22T21:45:29.229960] [INFO ] [MAIN ] Update Progress: 2146/2372 symbols completed. TTI took 30.0s. Estimated remaining: 30m 4s. Rate: 7.5 symbols/min [2025-09-22T21:45:29.267508] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T21:45:29.326868] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-22T21:45:29.423619] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:45:29.465081] [DEBUG] [LOCAL ] TV: Loaded 43675 existing records from primary storage. [2025-09-22T21:45:29.465295] [INFO ] [MAIN ] TV: Loaded 43675 existing records. [2025-09-22T21:45:29.648698] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:45:29.648963] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-22T21:45:29.649012] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-22T21:45:29.650696] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-22T21:45:29.650757] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-22T21:45:30.025983] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:45:30.052611] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T21:45:30.122068] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-22T21:45:30.922076] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-22T21:45:31.027831] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T21:45:31.622318] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-22T21:45:31.629088] [INFO ] [REMOTE ] TTC: Full fetch complete (62207 records). [2025-09-22T21:45:31.629220] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-22T21:45:31.727166] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-22T21:45:32.019911] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-22T21:45:32.019995] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-22T21:45:32.021106] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-22T21:45:32.021171] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-22T21:45:32.022457] [DEBUG] [LOCAL ] TTC: Trimmed 62207 records to 42753 (keeping 200 days of data) [2025-09-22T21:45:32.297224] [DEBUG] [LOCAL ] TTC: Primary data saved (42753 records). [2025-09-22T21:45:32.297366] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-22T21:45:32.297459] [INFO ] [MAIN ] Update Progress: 2147/2372 symbols completed. TTC took 44.9s. Estimated remaining: 29m 55s. Rate: 7.5 symbols/min [2025-09-22T21:45:32.471008] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:45:32.476771] [DEBUG] [LOCAL ] TVC: Loaded 3577 existing records from primary storage. [2025-09-22T21:45:32.476869] [INFO ] [MAIN ] TVC: Loaded 3577 existing records. [2025-09-22T21:45:32.530918] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-22T21:45:32.687763] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T21:45:32.701360] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:45:32.702218] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-22T21:45:32.702278] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-22T21:45:32.702533] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-22T21:45:32.702592] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-22T21:45:33.053453] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:45:33.322037] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-22T21:45:33.602378] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-22T21:45:33.729142] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-22T21:45:33.738074] [INFO ] [REMOTE ] TU: Full fetch complete (72955 records). [2025-09-22T21:45:33.738221] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-22T21:45:34.130835] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-22T21:45:34.134531] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-22T21:45:34.135547] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-22T21:45:34.136863] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-22T21:45:34.137041] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-22T21:45:34.138441] [DEBUG] [LOCAL ] TU: Trimmed 72955 records to 49920 (keeping 200 days of data) [2025-09-22T21:45:34.465100] [DEBUG] [LOCAL ] TU: Primary data saved (49920 records). [2025-09-22T21:45:34.465238] [INFO ] [MAIN ] TU: Full history saved. [2025-09-22T21:45:34.465327] [INFO ] [MAIN ] Update Progress: 2148/2372 symbols completed. TU took 28.0s. Estimated remaining: 29m 46s. Rate: 7.5 symbols/min [2025-09-22T21:45:34.642704] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:45:34.648846] [DEBUG] [LOCAL ] TVE: Loaded 2875 existing records from primary storage. [2025-09-22T21:45:34.648946] [INFO ] [MAIN ] TVE: Loaded 2875 existing records. [2025-09-22T21:45:34.840140] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:45:34.840436] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-22T21:45:34.840488] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-22T21:45:34.840722] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-22T21:45:34.840783] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-22T21:45:34.948224] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-22T21:45:34.960443] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T21:45:35.206218] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-22T21:45:35.289171] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:45:35.722062] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-22T21:45:36.290984] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-22T21:45:36.522083] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-22T21:45:36.755799] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-22T21:45:37.116760] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-22T21:45:37.322069] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-22T21:45:37.909286] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-22T21:45:38.122017] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-22T21:45:38.781326] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-22T21:45:38.922063] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-22T21:45:39.479228] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T21:45:39.722069] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-22T21:45:40.375888] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-22T21:45:40.522067] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-22T21:45:41.131247] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-22T21:45:41.322055] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-22T21:45:41.996769] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-22T21:45:42.122055] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-22T21:45:42.763621] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T21:45:42.922113] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-22T21:45:43.722112] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-22T21:45:44.427268] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T21:45:44.450895] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T21:45:44.522054] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-22T21:45:45.027405] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-22T21:45:45.322063] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-22T21:45:46.122052] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-22T21:45:46.898497] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-22T21:45:46.932139] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-22T21:45:46.941596] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-22T21:45:47.722052] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-22T21:45:48.239384] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-22T21:45:48.522078] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-22T21:45:48.580735] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-22T21:45:49.070716] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-22T21:45:49.322076] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-22T21:45:49.785771] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-22T21:45:49.786844] [INFO ] [REMOTE ] TVC: Full fetch complete (5729 records). [2025-09-22T21:45:49.786919] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-22T21:45:50.127141] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-22T21:45:50.167471] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-22T21:45:50.167699] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-22T21:45:50.167951] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-22T21:45:50.168027] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-22T21:45:50.169079] [DEBUG] [LOCAL ] TVC: Trimmed 5729 records to 3510 (keeping 200 days of data) [2025-09-22T21:45:50.195905] [DEBUG] [LOCAL ] TVC: Primary data saved (3510 records). [2025-09-22T21:45:50.195986] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-22T21:45:50.196110] [INFO ] [MAIN ] Update Progress: 2149/2372 symbols completed. TVC took 17.9s. Estimated remaining: 29m 39s. Rate: 7.5 symbols/min [2025-09-22T21:45:50.366189] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:45:50.402708] [DEBUG] [LOCAL ] TWI: Loaded 35388 existing records from primary storage. [2025-09-22T21:45:50.402847] [INFO ] [MAIN ] TWI: Loaded 35388 existing records. [2025-09-22T21:45:50.581776] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:45:50.582077] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-22T21:45:50.582153] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-22T21:45:50.583003] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-22T21:45:50.583066] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-22T21:45:50.929700] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-22T21:45:51.015938] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:45:51.722024] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-22T21:45:51.991394] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T21:45:52.092555] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T21:45:52.522060] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-22T21:45:53.320720] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T21:45:53.329166] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-22T21:45:54.084727] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T21:45:54.122084] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-22T21:45:54.893282] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T21:45:54.922067] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-22T21:45:55.563243] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T21:45:55.722069] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-22T21:45:56.315901] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T21:45:56.522118] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-22T21:45:57.135342] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T21:45:57.322083] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-22T21:45:57.913499] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-22T21:45:58.122079] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-22T21:45:58.172816] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T21:45:58.922090] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-22T21:45:59.643139] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-22T21:45:59.671931] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-22T21:45:59.722102] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-22T21:46:00.160454] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-22T21:46:00.522065] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-22T21:46:01.322081] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-22T21:46:01.644607] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-22T21:46:01.646040] [INFO ] [REMOTE ] TVE: Full fetch complete (4421 records). [2025-09-22T21:46:01.646129] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-22T21:46:02.011824] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-22T21:46:02.011929] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-22T21:46:02.012118] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-22T21:46:02.012214] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-22T21:46:02.012901] [DEBUG] [LOCAL ] TVE: Trimmed 4421 records to 2815 (keeping 200 days of data) [2025-09-22T21:46:02.032249] [DEBUG] [LOCAL ] TVE: Primary data saved (2815 records). [2025-09-22T21:46:02.032370] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-22T21:46:02.032528] [INFO ] [MAIN ] Update Progress: 2150/2372 symbols completed. TVE took 27.6s. Estimated remaining: 29m 32s. Rate: 7.5 symbols/min [2025-09-22T21:46:02.127182] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-22T21:46:02.211336] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:46:02.285505] [DEBUG] [LOCAL ] TWLO: Loaded 53497 existing records from primary storage. [2025-09-22T21:46:02.285696] [INFO ] [MAIN ] TWLO: Loaded 53497 existing records. [2025-09-22T21:46:02.485861] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:46:02.486147] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-22T21:46:02.486215] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-22T21:46:02.487616] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-22T21:46:02.487708] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-22T21:46:02.861200] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:46:02.922053] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-22T21:46:03.008731] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T21:46:03.660590] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T21:46:03.722087] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-22T21:46:04.422301] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T21:46:04.522016] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-22T21:46:05.322069] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-22T21:46:05.541113] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T21:46:06.127023] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-22T21:46:06.133596] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T21:46:06.732613] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T21:46:06.922117] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-22T21:46:07.722043] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-22T21:46:08.152827] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-22T21:46:08.522048] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-22T21:46:08.607596] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T21:46:08.615024] [INFO ] [REMOTE ] TUYA: Full fetch complete (65849 records). [2025-09-22T21:46:08.615181] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-22T21:46:08.977526] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T21:46:09.054094] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-22T21:46:09.054322] [INFO ] [REMOTE ] TV: Full fetch complete (62609 records). [2025-09-22T21:46:09.054237] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-22T21:46:09.057481] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-22T21:46:09.057626] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-22T21:46:09.057784] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-22T21:46:09.065297] [DEBUG] [LOCAL ] TUYA: Trimmed 65849 records to 46618 (keeping 200 days of data) [2025-09-22T21:46:09.341335] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-22T21:46:09.684787] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-22T21:46:09.688785] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-22T21:46:09.689894] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-22T21:46:09.693757] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-22T21:46:09.714195] [DEBUG] [LOCAL ] TV: Trimmed 62609 records to 43023 (keeping 200 days of data) [2025-09-22T21:46:09.817111] [DEBUG] [LOCAL ] TUYA: Primary data saved (46618 records). [2025-09-22T21:46:09.844219] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-22T21:46:09.852207] [INFO ] [MAIN ] Update Progress: 2151/2372 symbols completed. TUYA took 45.4s. Estimated remaining: 29m 24s. Rate: 7.5 symbols/min [2025-09-22T21:46:10.177761] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:46:10.206935] [DEBUG] [LOCAL ] TV: Primary data saved (43023 records). [2025-09-22T21:46:10.207106] [INFO ] [MAIN ] TV: Full history saved. [2025-09-22T21:46:10.207316] [INFO ] [MAIN ] Update Progress: 2152/2372 symbols completed. TV took 41.0s. Estimated remaining: 29m 15s. Rate: 7.5 symbols/min [2025-09-22T21:46:10.209990] [DEBUG] [LOCAL ] TWN: Loaded 3371 existing records from primary storage. [2025-09-22T21:46:10.253215] [INFO ] [MAIN ] TWN: Loaded 3371 existing records. [2025-09-22T21:46:10.510937] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:46:10.586288] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:46:10.586858] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-22T21:46:10.586935] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-22T21:46:10.587802] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-22T21:46:10.587898] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-22T21:46:10.829026] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-22T21:46:10.953980] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-22T21:46:10.953472] [DEBUG] [LOCAL ] TWO: Loaded 48924 existing records from primary storage. [2025-09-22T21:46:10.960743] [INFO ] [MAIN ] TWO: Loaded 48924 existing records. [2025-09-22T21:46:11.135720] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:46:11.131449] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T21:46:11.167348] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-22T21:46:11.252727] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:46:11.252943] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-22T21:46:11.252991] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-22T21:46:11.254194] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-22T21:46:11.254253] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-22T21:46:11.608613] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:46:11.722014] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-22T21:46:11.843501] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-22T21:46:12.522073] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-22T21:46:12.833683] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T21:46:12.890902] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-22T21:46:13.322099] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-22T21:46:13.752889] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-22T21:46:13.786977] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T21:46:14.122043] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-22T21:46:14.922067] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-22T21:46:15.466288] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T21:46:15.722053] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-22T21:46:16.522052] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-22T21:46:16.924612] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-22T21:46:16.961523] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T21:46:16.966701] [INFO ] [REMOTE ] TWI: Full fetch complete (53319 records). [2025-09-22T21:46:16.966804] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-22T21:46:17.139960] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T21:46:17.336140] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-22T21:46:17.391551] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-22T21:46:17.391634] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-22T21:46:17.392714] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-22T21:46:17.392778] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-22T21:46:17.393972] [DEBUG] [LOCAL ] TWI: Trimmed 53319 records to 34588 (keeping 200 days of data) [2025-09-22T21:46:17.608934] [DEBUG] [LOCAL ] TWI: Primary data saved (34588 records). [2025-09-22T21:46:17.609168] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-22T21:46:17.609352] [INFO ] [MAIN ] Update Progress: 2153/2372 symbols completed. TWI took 27.4s. Estimated remaining: 29m 7s. Rate: 7.5 symbols/min [2025-09-22T21:46:17.790086] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:46:17.790523] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-22T21:46:17.790580] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-22T21:46:17.790818] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-22T21:46:17.790899] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-22T21:46:17.790954] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-22T21:46:17.791030] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-22T21:46:18.133615] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-22T21:46:18.159767] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:46:18.164992] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T21:46:18.922081] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-22T21:46:19.722037] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-22T21:46:19.808917] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T21:46:19.934051] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:46:19.934462] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-22T21:46:20.451439] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T21:46:20.522081] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-22T21:46:20.732134] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:46:20.732604] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-22T21:46:21.322062] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-22T21:46:21.889076] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-22T21:46:22.122073] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-22T21:46:22.376517] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:46:22.376905] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-22T21:46:22.922060] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-22T21:46:23.722066] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-22T21:46:23.944816] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:46:23.945189] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-22T21:46:24.522102] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-22T21:46:24.801194] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-22T21:46:24.980965] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-22T21:46:25.322021] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-22T21:46:25.783694] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-22T21:46:26.122030] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-22T21:46:26.922088] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-22T21:46:27.478287] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T21:46:27.722078] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-22T21:46:27.801855] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T21:46:27.923371] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:46:27.923740] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-22T21:46:28.522063] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-22T21:46:28.976093] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-22T21:46:29.322061] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-22T21:46:29.769454] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T21:46:29.770543] [INFO ] [REMOTE ] TWN: Full fetch complete (5346 records). [2025-09-22T21:46:29.770618] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-22T21:46:30.135693] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-22T21:46:30.143369] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-22T21:46:30.144296] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-22T21:46:30.144479] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-22T21:46:30.144521] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-22T21:46:30.144964] [DEBUG] [LOCAL ] TWN: Trimmed 5346 records to 3250 (keeping 200 days of data) [2025-09-22T21:46:30.165332] [DEBUG] [LOCAL ] TWN: Primary data saved (3250 records). [2025-09-22T21:46:30.165416] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-22T21:46:30.165516] [INFO ] [MAIN ] Update Progress: 2154/2372 symbols completed. TWN took 20.3s. Estimated remaining: 28m 59s. Rate: 7.5 symbols/min [2025-09-22T21:46:30.337844] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:46:30.363282] [DEBUG] [LOCAL ] TX: Loaded 24231 existing records from primary storage. [2025-09-22T21:46:30.363413] [INFO ] [MAIN ] TX: Loaded 24231 existing records. [2025-09-22T21:46:30.542491] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:46:30.542789] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-22T21:46:30.542841] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-22T21:46:30.543958] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-22T21:46:30.544019] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-22T21:46:30.906268] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:46:30.922004] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-22T21:46:31.722068] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-22T21:46:32.251615] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T21:46:32.310229] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-22T21:46:32.522058] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-22T21:46:33.322081] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-22T21:46:33.388341] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T21:46:33.743894] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T21:46:34.122079] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-22T21:46:34.922093] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-22T21:46:35.321989] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-22T21:46:35.553198] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T21:46:35.644391] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T21:46:35.722063] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-22T21:46:36.280594] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-22T21:46:36.522063] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-22T21:46:37.322073] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-22T21:46:38.122035] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-22T21:46:38.371414] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T21:46:38.379747] [INFO ] [REMOTE ] TWLO: Full fetch complete (76432 records). [2025-09-22T21:46:38.379886] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-22T21:46:38.788797] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T21:46:38.818213] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-22T21:46:38.818302] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-22T21:46:38.819807] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-22T21:46:38.819871] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-22T21:46:38.821227] [DEBUG] [LOCAL ] TWLO: Trimmed 76432 records to 52724 (keeping 200 days of data) [2025-09-22T21:46:38.922227] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-22T21:46:39.151586] [DEBUG] [LOCAL ] TWLO: Primary data saved (52724 records). [2025-09-22T21:46:39.151757] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-22T21:46:39.151858] [INFO ] [MAIN ] Update Progress: 2155/2372 symbols completed. TWLO took 37.1s. Estimated remaining: 28m 52s. Rate: 7.5 symbols/min [2025-09-22T21:46:39.322387] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:46:39.368767] [DEBUG] [LOCAL ] TXNM: Loaded 44698 existing records from primary storage. [2025-09-22T21:46:39.368936] [INFO ] [MAIN ] TXNM: Loaded 44698 existing records. [2025-09-22T21:46:39.556843] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:46:39.557439] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-22T21:46:39.557570] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-22T21:46:39.558630] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-22T21:46:39.558721] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-22T21:46:39.722001] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-22T21:46:39.968427] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:46:39.989077] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T21:46:40.098376] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T21:46:40.310798] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-22T21:46:40.522105] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-22T21:46:41.322097] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-22T21:46:42.122076] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-22T21:46:42.182292] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T21:46:42.876757] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T21:46:42.922048] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-22T21:46:43.153081] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-22T21:46:43.722072] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-22T21:46:44.380567] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-22T21:46:44.522039] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-22T21:46:44.555837] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T21:46:45.322050] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-22T21:46:46.089924] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T21:46:46.122009] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-22T21:46:46.875566] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T21:46:46.922011] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-22T21:46:47.722023] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-22T21:46:47.982430] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T21:46:48.522090] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-22T21:46:48.671559] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T21:46:48.850036] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T21:46:49.322066] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-22T21:46:50.122010] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-22T21:46:50.319376] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-22T21:46:50.484328] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T21:46:50.922060] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-22T21:46:51.722035] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-22T21:46:52.021746] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T21:46:52.522080] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-22T21:46:52.554115] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T21:46:52.562024] [INFO ] [REMOTE ] TWO: Full fetch complete (68697 records). [2025-09-22T21:46:52.562193] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-22T21:46:52.970622] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-22T21:46:52.970791] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-22T21:46:52.972003] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-22T21:46:52.972112] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-22T21:46:52.993960] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-22T21:46:52.994210] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-22T21:46:53.002192] [INFO ] [REMOTE ] TWOD: Full fetch complete (4236 records). [2025-09-22T21:46:53.002498] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-22T21:46:53.015007] [DEBUG] [LOCAL ] TWO: Trimmed 68697 records to 48247 (keeping 200 days of data) [2025-09-22T21:46:53.295234] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 88 unique days, need 200 days [2025-09-22T21:46:53.301118] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:46:53.301431] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:46:53.301819] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-22T21:46:53.302360] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-22T21:46:53.302962] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-22T21:46:53.304596] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-22T21:46:53.304952] [INFO ] [MAIN ] Update Progress: 2156/2372 symbols completed. TWOD took 35.7s. Estimated remaining: 28m 44s. Rate: 7.5 symbols/min [2025-09-22T21:46:53.327217] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-22T21:46:53.493000] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:46:53.606200] [DEBUG] [LOCAL ] TXO: Loaded 18968 existing records from primary storage. [2025-09-22T21:46:53.607154] [INFO ] [MAIN ] TXO: Loaded 18968 existing records. [2025-09-22T21:46:53.794841] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:46:53.795884] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-22T21:46:53.796251] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-22T21:46:53.797606] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-22T21:46:53.798216] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-22T21:46:54.132366] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-22T21:46:54.239390] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:46:54.247633] [DEBUG] [LOCAL ] TWO: Primary data saved (48247 records). [2025-09-22T21:46:54.247794] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-22T21:46:54.247886] [INFO ] [MAIN ] Update Progress: 2157/2372 symbols completed. TWO took 44.0s. Estimated remaining: 28m 35s. Rate: 7.5 symbols/min [2025-09-22T21:46:54.403774] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-22T21:46:54.407616] [INFO ] [REMOTE ] TX: Full fetch complete (35810 records). [2025-09-22T21:46:54.407753] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-22T21:46:54.782092] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-22T21:46:54.782177] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-22T21:46:54.782910] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-22T21:46:54.782972] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-22T21:46:54.783814] [DEBUG] [LOCAL ] TX: Trimmed 35810 records to 23768 (keeping 200 days of data) [2025-09-22T21:46:54.924684] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-22T21:46:54.938285] [DEBUG] [LOCAL ] TX: Primary data saved (23768 records). [2025-09-22T21:46:54.938361] [INFO ] [MAIN ] TX: Full history saved. [2025-09-22T21:46:54.938446] [INFO ] [MAIN ] Update Progress: 2158/2372 symbols completed. TX took 24.8s. Estimated remaining: 28m 27s. Rate: 7.5 symbols/min [2025-09-22T21:46:55.838476] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T21:46:55.856441] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-22T21:46:55.858001] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T21:46:56.522130] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-22T21:46:57.389595] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-22T21:46:57.393021] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-22T21:46:57.484431] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T21:46:58.122089] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-22T21:46:58.353730] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-22T21:46:58.922099] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-22T21:46:59.752931] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T21:46:59.762929] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-22T21:46:59.925286] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-22T21:47:00.522071] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-22T21:47:01.270997] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T21:47:01.328310] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-22T21:47:01.330012] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-22T21:47:02.122157] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-22T21:47:02.811574] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T21:47:02.817840] [INFO ] [REMOTE ] TXNM: Full fetch complete (62757 records). [2025-09-22T21:47:02.817946] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-22T21:47:03.210339] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-22T21:47:03.210431] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-22T21:47:03.211635] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-22T21:47:03.211724] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-22T21:47:03.213103] [DEBUG] [LOCAL ] TXNM: Trimmed 62757 records to 44034 (keeping 200 days of data) [2025-09-22T21:47:03.488749] [DEBUG] [LOCAL ] TXNM: Primary data saved (44034 records). [2025-09-22T21:47:03.488888] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-22T21:47:03.488972] [INFO ] [MAIN ] Update Progress: 2159/2372 symbols completed. TXNM took 24.3s. Estimated remaining: 28m 19s. Rate: 7.5 symbols/min [2025-09-22T21:47:03.529561] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-22T21:47:03.538370] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-22T21:47:04.844762] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T21:47:04.850820] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-22T21:47:06.046550] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-22T21:47:06.051129] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-22T21:47:07.114854] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T21:47:07.120153] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-22T21:47:08.121129] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-22T21:47:08.126372] [INFO ] [REMOTE ] TXO: Full fetch complete (25806 records). [2025-09-22T21:47:08.126584] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-22T21:47:08.518771] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-22T21:47:08.518855] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-22T21:47:08.519451] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-22T21:47:08.519493] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-22T21:47:08.520249] [DEBUG] [LOCAL ] TXO: Trimmed 25806 records to 18741 (keeping 200 days of data) [2025-09-22T21:47:08.639920] [DEBUG] [LOCAL ] TXO: Primary data saved (18741 records). [2025-09-22T21:47:08.640075] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-22T21:47:08.640188] [INFO ] [MAIN ] Update Progress: 2160/2372 symbols completed. TXO took 15.3s. Estimated remaining: 28m 11s. Rate: 7.5 symbols/min [2025-09-22T21:47:09.313406] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:47:09.352133] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:47:09.438894] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:47:09.460988] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:47:09.476425] [DEBUG] [LOCAL ] TYG: Loaded 14677 existing records from primary storage. [2025-09-22T21:47:09.476730] [INFO ] [MAIN ] TYG: Loaded 14677 existing records. [2025-09-22T21:47:09.580548] [DEBUG] [LOCAL ] TY: Loaded 7780 existing records from primary storage. [2025-09-22T21:47:09.628116] [INFO ] [MAIN ] TY: Loaded 7780 existing records. [2025-09-22T21:47:09.601981] [DEBUG] [LOCAL ] TYL: Loaded 22841 existing records from primary storage. [2025-09-22T21:47:09.644837] [INFO ] [MAIN ] TYL: Loaded 22841 existing records. [2025-09-22T21:47:09.947112] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:47:09.937619] [DEBUG] [LOCAL ] TXT: Loaded 50523 existing records from primary storage. [2025-09-22T21:47:10.041841] [INFO ] [MAIN ] TXT: Loaded 50523 existing records. [2025-09-22T21:47:10.058075] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-22T21:47:10.064095] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-22T21:47:10.139014] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:47:10.165071] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-22T21:47:10.164733] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:47:10.195078] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-22T21:47:10.189847] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-22T21:47:10.210797] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-22T21:47:10.165181] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-22T21:47:10.227047] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-22T21:47:10.283634] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-22T21:47:10.296192] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-22T21:47:10.327909] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-22T21:47:10.421944] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-22T21:47:10.648550] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:47:10.752441] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-22T21:47:10.795536] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-22T21:47:10.888103] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-22T21:47:10.988902] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-22T21:47:11.419423] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:47:11.462721] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-22T21:47:11.706432] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:47:11.763368] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-22T21:47:11.814413] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:47:11.821218] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-22T21:47:11.932214] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:47:11.932530] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-22T21:47:12.576889] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T21:47:12.579747] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-22T21:47:12.613862] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T21:47:12.617428] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-22T21:47:12.925281] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T21:47:12.929842] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-22T21:47:13.381229] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T21:47:13.384060] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-22T21:47:13.596626] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T21:47:13.608422] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-22T21:47:13.708267] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T21:47:13.713548] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-22T21:47:13.908457] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-22T21:47:13.952037] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T21:47:14.122089] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-22T21:47:14.627098] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-22T21:47:14.922106] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-22T21:47:15.243091] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T21:47:15.264554] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T21:47:15.722033] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-22T21:47:15.977950] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T21:47:16.522118] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-22T21:47:17.322082] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-22T21:47:17.398726] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T21:47:17.684358] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-22T21:47:17.806222] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-22T21:47:18.122058] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-22T21:47:18.922027] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-22T21:47:19.066632] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T21:47:19.722067] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-22T21:47:20.351178] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T21:47:20.469611] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-22T21:47:20.522004] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-22T21:47:21.311126] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T21:47:21.321999] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-22T21:47:22.122158] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-22T21:47:22.459721] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T21:47:22.922075] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-22T21:47:23.723822] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-22T21:47:23.724761] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-22T21:47:23.963725] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T21:47:24.522083] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-22T21:47:24.815070] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-22T21:47:25.282734] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-22T21:47:25.322019] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-22T21:47:26.122100] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-22T21:47:26.523475] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T21:47:26.791725] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-22T21:47:26.793378] [INFO ] [REMOTE ] TY: Full fetch complete (11771 records). [2025-09-22T21:47:26.793447] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-22T21:47:26.927250] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-22T21:47:27.171484] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-22T21:47:27.171567] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-22T21:47:27.171970] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-22T21:47:27.172031] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-22T21:47:27.172504] [DEBUG] [LOCAL ] TY: Trimmed 11771 records to 7646 (keeping 200 days of data) [2025-09-22T21:47:27.224586] [DEBUG] [LOCAL ] TY: Primary data saved (7646 records). [2025-09-22T21:47:27.224778] [INFO ] [MAIN ] TY: Full history saved. [2025-09-22T21:47:27.224878] [INFO ] [MAIN ] Update Progress: 2161/2372 symbols completed. TY took 18.6s. Estimated remaining: 28m 4s. Rate: 7.5 symbols/min [2025-09-22T21:47:27.395222] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:47:27.451500] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-22T21:47:27.451669] [INFO ] [MAIN ] U: Loaded 54579 existing records. [2025-09-22T21:47:27.643708] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:47:27.644103] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-22T21:47:27.644177] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-22T21:47:27.645467] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-22T21:47:27.645530] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-22T21:47:27.727241] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-22T21:47:28.043848] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:47:28.134360] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-22T21:47:28.522008] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-22T21:47:28.730926] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T21:47:29.322072] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-22T21:47:29.657580] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-22T21:47:29.990761] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-22T21:47:30.122060] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-22T21:47:30.922034] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-22T21:47:31.161217] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T21:47:31.257285] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-22T21:47:31.260857] [INFO ] [REMOTE ] TYL: Full fetch complete (31392 records). [2025-09-22T21:47:31.260933] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-22T21:47:31.636064] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-22T21:47:31.636150] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-22T21:47:31.636920] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-22T21:47:31.636982] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-22T21:47:31.637843] [DEBUG] [LOCAL ] TYL: Trimmed 31392 records to 22481 (keeping 200 days of data) [2025-09-22T21:47:31.731086] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-22T21:47:31.788863] [DEBUG] [LOCAL ] TYL: Primary data saved (22481 records). [2025-09-22T21:47:31.789007] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-22T21:47:31.789096] [INFO ] [MAIN ] Update Progress: 2162/2372 symbols completed. TYL took 23.1s. Estimated remaining: 27m 55s. Rate: 7.5 symbols/min [2025-09-22T21:47:31.983770] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:47:32.040973] [DEBUG] [LOCAL ] UA: Loaded 51145 existing records from primary storage. [2025-09-22T21:47:32.041128] [INFO ] [MAIN ] UA: Loaded 51145 existing records. [2025-09-22T21:47:32.220372] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:47:32.220632] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-22T21:47:32.220720] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-22T21:47:32.221877] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-22T21:47:32.221935] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-22T21:47:32.527271] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-22T21:47:32.592057] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:47:33.322022] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-22T21:47:33.638235] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T21:47:34.122031] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-22T21:47:34.195175] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-22T21:47:34.901704] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-22T21:47:34.904224] [INFO ] [REMOTE ] TYG: Full fetch complete (22487 records). [2025-09-22T21:47:34.904309] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-22T21:47:34.927161] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-22T21:47:35.321857] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-22T21:47:35.343693] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-22T21:47:35.343857] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-22T21:47:35.344355] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-22T21:47:35.344904] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-22T21:47:35.345540] [DEBUG] [LOCAL ] TYG: Trimmed 22487 records to 14298 (keeping 200 days of data) [2025-09-22T21:47:35.434460] [DEBUG] [LOCAL ] TYG: Primary data saved (14298 records). [2025-09-22T21:47:35.434614] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-22T21:47:35.434744] [INFO ] [MAIN ] Update Progress: 2163/2372 symbols completed. TYG took 26.8s. Estimated remaining: 27m 47s. Rate: 7.5 symbols/min [2025-09-22T21:47:35.606834] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:47:35.658918] [DEBUG] [LOCAL ] UAA: Loaded 54290 existing records from primary storage. [2025-09-22T21:47:35.659072] [INFO ] [MAIN ] UAA: Loaded 54290 existing records. [2025-09-22T21:47:35.727134] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-22T21:47:35.838253] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:47:35.838542] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-22T21:47:35.838636] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-22T21:47:35.839881] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-22T21:47:35.839941] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-22T21:47:36.192770] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:47:36.522057] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-22T21:47:36.914391] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T21:47:37.322072] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-22T21:47:37.510699] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T21:47:38.122050] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-22T21:47:38.824705] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T21:47:38.923799] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-22T21:47:38.927802] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-22T21:47:39.475419] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-22T21:47:39.722061] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-22T21:47:40.522106] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-22T21:47:40.664372] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-22T21:47:41.322048] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-22T21:47:41.520374] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T21:47:42.122074] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-22T21:47:42.274754] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T21:47:42.922032] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-22T21:47:43.015204] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T21:47:43.722096] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-22T21:47:43.971022] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T21:47:44.522040] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-22T21:47:44.743771] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T21:47:45.169273] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-22T21:47:45.322015] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-22T21:47:46.122038] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-22T21:47:46.348269] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-22T21:47:46.844534] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-22T21:47:46.922026] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-22T21:47:46.957902] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-22T21:47:47.722068] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-22T21:47:48.342054] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T21:47:48.351629] [INFO ] [REMOTE ] TXT: Full fetch complete (72157 records). [2025-09-22T21:47:48.351769] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-22T21:47:48.527372] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-22T21:47:48.743031] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-22T21:47:48.743170] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-22T21:47:48.744353] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-22T21:47:48.744430] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-22T21:47:48.746376] [DEBUG] [LOCAL ] TXT: Trimmed 72157 records to 49780 (keeping 200 days of data) [2025-09-22T21:47:49.058455] [DEBUG] [LOCAL ] TXT: Primary data saved (49780 records). [2025-09-22T21:47:49.058599] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-22T21:47:49.058712] [INFO ] [MAIN ] Update Progress: 2164/2372 symbols completed. TXT took 40.4s. Estimated remaining: 27m 40s. Rate: 7.5 symbols/min [2025-09-22T21:47:49.236989] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:47:49.244743] [DEBUG] [LOCAL ] UAN: Loaded 5615 existing records from primary storage. [2025-09-22T21:47:49.244854] [INFO ] [MAIN ] UAN: Loaded 5615 existing records. [2025-09-22T21:47:49.326144] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-22T21:47:49.430572] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:47:49.446534] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-22T21:47:49.446629] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-22T21:47:49.457025] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-22T21:47:49.457487] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-22T21:47:49.458484] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T21:47:49.839737] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:47:50.122050] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-22T21:47:50.922068] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-22T21:47:50.972673] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-22T21:47:50.991539] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-22T21:47:51.313486] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-22T21:47:51.722073] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-22T21:47:52.522054] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-22T21:47:52.588164] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T21:47:53.259182] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T21:47:53.322098] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-22T21:47:53.574932] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-22T21:47:53.954413] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T21:47:54.122115] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-22T21:47:54.839393] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-22T21:47:54.922112] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-22T21:47:55.722118] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-22T21:47:56.522062] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-22T21:47:56.629143] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T21:47:57.322039] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-22T21:47:57.374803] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-22T21:47:57.622032] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T21:47:58.122082] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-22T21:47:58.922030] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-22T21:47:59.306882] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T21:47:59.722055] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-22T21:48:00.305502] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-22T21:48:00.387336] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T21:48:00.395699] [INFO ] [REMOTE ] UA: Full fetch complete (72883 records). [2025-09-22T21:48:00.395827] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-22T21:48:00.537271] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-22T21:48:00.796605] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-22T21:48:00.796730] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-22T21:48:00.798241] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-22T21:48:00.798305] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-22T21:48:00.799709] [DEBUG] [LOCAL ] UA: Trimmed 72883 records to 50408 (keeping 200 days of data) [2025-09-22T21:48:01.090957] [DEBUG] [LOCAL ] UA: Primary data saved (50408 records). [2025-09-22T21:48:01.091109] [INFO ] [MAIN ] UA: Full history saved. [2025-09-22T21:48:01.091194] [INFO ] [MAIN ] Update Progress: 2165/2372 symbols completed. UA took 29.3s. Estimated remaining: 27m 32s. Rate: 7.5 symbols/min [2025-09-22T21:48:01.259933] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:48:01.312296] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-22T21:48:01.312447] [INFO ] [MAIN ] UBER: Loaded 54586 existing records. [2025-09-22T21:48:01.343982] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-22T21:48:01.493029] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:48:01.493295] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-22T21:48:01.493354] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-22T21:48:01.495913] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-22T21:48:01.495973] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-22T21:48:01.850720] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:48:02.122033] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-22T21:48:02.217814] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-22T21:48:02.922109] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-22T21:48:03.161552] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T21:48:03.352257] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-22T21:48:03.722079] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-22T21:48:04.522077] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-22T21:48:05.225525] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T21:48:05.322069] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-22T21:48:05.695922] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-22T21:48:05.704289] [INFO ] [REMOTE ] UAA: Full fetch complete (77479 records). [2025-09-22T21:48:05.704443] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-22T21:48:06.000929] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T21:48:06.134310] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-22T21:48:06.134998] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-22T21:48:06.135817] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-22T21:48:06.137304] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-22T21:48:06.137488] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-22T21:48:06.139376] [DEBUG] [LOCAL ] UAA: Trimmed 77479 records to 53509 (keeping 200 days of data) [2025-09-22T21:48:06.383793] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (4.26 seconds). [2025-09-22T21:48:06.501011] [DEBUG] [LOCAL ] UAA: Primary data saved (53509 records). [2025-09-22T21:48:06.501245] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-22T21:48:06.501344] [INFO ] [MAIN ] Update Progress: 2166/2372 symbols completed. UAA took 31.1s. Estimated remaining: 27m 24s. Rate: 7.5 symbols/min [2025-09-22T21:48:06.659327] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-09-22T21:48:06.729724] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:48:06.788189] [DEBUG] [LOCAL ] UBS: Loaded 53254 existing records from primary storage. [2025-09-22T21:48:06.788367] [INFO ] [MAIN ] UBS: Loaded 53254 existing records. [2025-09-22T21:48:06.908378] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-22T21:48:06.925460] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-22T21:48:06.994256] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:48:06.994515] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-22T21:48:06.994567] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-22T21:48:06.995694] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-22T21:48:06.995759] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-22T21:48:07.359082] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:48:07.722080] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-22T21:48:08.522109] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-22T21:48:09.326781] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-22T21:48:09.332690] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-22T21:48:10.022234] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-22T21:48:10.023703] [INFO ] [REMOTE ] UAN: Full fetch complete (8381 records). [2025-09-22T21:48:10.023915] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-22T21:48:10.125738] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-22T21:48:10.150768] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-22T21:48:10.440806] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-22T21:48:10.440909] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-22T21:48:10.441207] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-22T21:48:10.441336] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-22T21:48:10.442062] [DEBUG] [LOCAL ] UAN: Trimmed 8381 records to 5468 (keeping 200 days of data) [2025-09-22T21:48:10.495604] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-22T21:48:10.516107] [DEBUG] [LOCAL ] UAN: Primary data saved (5468 records). [2025-09-22T21:48:10.516206] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-22T21:48:10.516287] [INFO ] [MAIN ] Update Progress: 2167/2372 symbols completed. UAN took 21.5s. Estimated remaining: 27m 15s. Rate: 7.5 symbols/min [2025-09-22T21:48:10.685030] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:48:10.721704] [DEBUG] [LOCAL ] UCB: Loaded 38738 existing records from primary storage. [2025-09-22T21:48:10.721843] [INFO ] [MAIN ] UCB: Loaded 38738 existing records. [2025-09-22T21:48:10.898420] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:48:10.898688] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-22T21:48:10.898745] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-22T21:48:10.899718] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-22T21:48:10.899779] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-22T21:48:10.930901] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-22T21:48:11.260300] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:48:11.722059] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-22T21:48:12.522031] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-22T21:48:12.614711] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-22T21:48:12.862009] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-22T21:48:13.322049] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-22T21:48:14.122041] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-22T21:48:14.344202] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-22T21:48:14.526929] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-22T21:48:14.922056] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-22T21:48:15.722080] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-22T21:48:16.254223] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.93 seconds). [2025-09-22T21:48:16.522045] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-22T21:48:16.558348] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-22T21:48:16.834761] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-22T21:48:17.322063] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-22T21:48:18.107061] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-22T21:48:18.122018] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-22T21:48:18.922015] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-22T21:48:18.972706] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-22T21:48:19.170989] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T21:48:19.722076] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-22T21:48:20.310961] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T21:48:20.383129] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-22T21:48:20.392918] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-09-22T21:48:20.393187] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-22T21:48:20.539391] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-22T21:48:20.840818] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-22T21:48:20.840916] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-22T21:48:20.842168] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-22T21:48:20.842236] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-22T21:48:20.844463] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-09-22T21:48:21.172839] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-09-22T21:48:21.173036] [INFO ] [MAIN ] U: Full history saved. [2025-09-22T21:48:21.173153] [INFO ] [MAIN ] Update Progress: 2168/2372 symbols completed. U took 53.9s. Estimated remaining: 27m 8s. Rate: 7.5 symbols/min [2025-09-22T21:48:21.346945] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-22T21:48:21.350449] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:48:21.395391] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T21:48:21.456549] [DEBUG] [LOCAL ] UDR: Loaded 52563 existing records from primary storage. [2025-09-22T21:48:21.456814] [INFO ] [MAIN ] UDR: Loaded 52563 existing records. [2025-09-22T21:48:21.641976] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:48:21.642226] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-22T21:48:21.642275] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-22T21:48:21.643561] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-22T21:48:21.643628] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-22T21:48:22.006224] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:48:22.122050] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-22T21:48:22.866021] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T21:48:22.922006] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-22T21:48:23.191117] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-22T21:48:23.677170] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-22T21:48:23.722017] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-22T21:48:24.521809] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T21:48:24.530356] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-22T21:48:25.322021] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-22T21:48:25.421477] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T21:48:26.122095] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-22T21:48:26.922069] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-22T21:48:26.955128] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-22T21:48:27.333264] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T21:48:27.722089] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-22T21:48:27.939707] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-22T21:48:28.014914] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-22T21:48:28.522081] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-22T21:48:29.322078] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-22T21:48:29.408929] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T21:48:30.122073] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-22T21:48:30.527319] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-22T21:48:30.795356] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T21:48:30.922010] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-22T21:48:31.722056] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-22T21:48:32.337477] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T21:48:32.522070] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-22T21:48:32.640962] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-22T21:48:33.322162] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-22T21:48:33.414598] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T21:48:33.977438] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T21:48:34.122051] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-22T21:48:34.922099] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-22T21:48:35.511977] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T21:48:35.518027] [INFO ] [REMOTE ] UCB: Full fetch complete (54690 records). [2025-09-22T21:48:35.518161] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-22T21:48:35.723362] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-22T21:48:35.929518] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-22T21:48:35.929621] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-22T21:48:35.930921] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-22T21:48:35.931048] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-22T21:48:35.932336] [DEBUG] [LOCAL ] UCB: Trimmed 54690 records to 38114 (keeping 200 days of data) [2025-09-22T21:48:36.068181] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-22T21:48:36.222136] [DEBUG] [LOCAL ] UCB: Primary data saved (38114 records). [2025-09-22T21:48:36.222342] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-22T21:48:36.222682] [INFO ] [MAIN ] Update Progress: 2169/2372 symbols completed. UCB took 25.7s. Estimated remaining: 27m 0s. Rate: 7.5 symbols/min [2025-09-22T21:48:36.403577] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:48:36.448279] [DEBUG] [LOCAL ] UE: Loaded 43638 existing records from primary storage. [2025-09-22T21:48:36.448430] [INFO ] [MAIN ] UE: Loaded 43638 existing records. [2025-09-22T21:48:36.526479] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-22T21:48:36.636722] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:48:36.637036] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-22T21:48:36.637101] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-22T21:48:36.638541] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-22T21:48:36.638635] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-22T21:48:37.010786] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-22T21:48:37.081823] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:48:37.191269] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T21:48:37.201144] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-09-22T21:48:37.201286] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-22T21:48:37.327152] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-22T21:48:37.610808] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-22T21:48:37.611014] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-22T21:48:37.612254] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-22T21:48:37.612337] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-22T21:48:37.631970] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-09-22T21:48:37.648054] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T21:48:37.979564] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-09-22T21:48:37.979770] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-22T21:48:37.979895] [INFO ] [MAIN ] Update Progress: 2170/2372 symbols completed. UBER took 36.9s. Estimated remaining: 26m 52s. Rate: 7.5 symbols/min [2025-09-22T21:48:38.130401] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-22T21:48:38.162818] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:48:38.176183] [DEBUG] [LOCAL ] UFI: Loaded 8403 existing records from primary storage. [2025-09-22T21:48:38.176313] [INFO ] [MAIN ] UFI: Loaded 8403 existing records. [2025-09-22T21:48:38.354693] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:48:38.354961] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-22T21:48:38.355017] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-22T21:48:38.355306] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-22T21:48:38.355384] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-22T21:48:38.715402] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:48:38.911261] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T21:48:38.922054] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-22T21:48:39.722012] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-22T21:48:39.747554] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-22T21:48:39.975533] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-22T21:48:39.983972] [INFO ] [REMOTE ] UBS: Full fetch complete (75577 records). [2025-09-22T21:48:39.984124] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-22T21:48:40.392272] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-22T21:48:40.392356] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-22T21:48:40.393811] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-22T21:48:40.393905] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-22T21:48:40.395854] [DEBUG] [LOCAL ] UBS: Trimmed 75577 records to 52452 (keeping 200 days of data) [2025-09-22T21:48:40.522299] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-22T21:48:40.728081] [DEBUG] [LOCAL ] UBS: Primary data saved (52452 records). [2025-09-22T21:48:40.728226] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-22T21:48:40.728387] [INFO ] [MAIN ] Update Progress: 2171/2372 symbols completed. UBS took 34.2s. Estimated remaining: 26m 43s. Rate: 7.5 symbols/min [2025-09-22T21:48:40.902597] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:48:40.956682] [DEBUG] [LOCAL ] UGI: Loaded 51298 existing records from primary storage. [2025-09-22T21:48:40.956910] [INFO ] [MAIN ] UGI: Loaded 51298 existing records. [2025-09-22T21:48:41.163772] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-22T21:48:41.166933] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:48:41.176148] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-22T21:48:41.176205] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-22T21:48:41.177610] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-22T21:48:41.177695] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-22T21:48:41.327219] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-22T21:48:41.529631] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:48:42.122029] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-22T21:48:42.144327] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-22T21:48:42.321288] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T21:48:42.922066] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-22T21:48:43.638877] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T21:48:43.722065] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-22T21:48:44.484562] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-22T21:48:44.522027] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-22T21:48:45.253820] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-22T21:48:45.322029] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-22T21:48:46.113443] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T21:48:46.122009] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-22T21:48:46.501517] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-22T21:48:46.922182] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-22T21:48:47.036827] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T21:48:47.605364] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T21:48:47.722199] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-22T21:48:48.522147] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-22T21:48:49.322116] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-22T21:48:49.531350] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-22T21:48:49.574946] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T21:48:50.122083] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-22T21:48:50.873252] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T21:48:50.922069] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-22T21:48:51.390070] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-22T21:48:51.722098] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-22T21:48:51.796052] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T21:48:51.807554] [INFO ] [REMOTE ] UDR: Full fetch complete (74348 records). [2025-09-22T21:48:51.807889] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-22T21:48:52.235225] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-22T21:48:52.235842] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-22T21:48:52.235737] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-22T21:48:52.238026] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-22T21:48:52.240417] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-22T21:48:52.246118] [DEBUG] [LOCAL ] UDR: Trimmed 74348 records to 51790 (keeping 200 days of data) [2025-09-22T21:48:52.522298] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-22T21:48:52.631751] [DEBUG] [LOCAL ] UDR: Primary data saved (51790 records). [2025-09-22T21:48:52.632013] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-22T21:48:52.632245] [INFO ] [MAIN ] Update Progress: 2172/2372 symbols completed. UDR took 31.5s. Estimated remaining: 26m 36s. Rate: 7.5 symbols/min [2025-09-22T21:48:52.812618] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:48:52.854432] [DEBUG] [LOCAL ] UGP: Loaded 43183 existing records from primary storage. [2025-09-22T21:48:52.854580] [INFO ] [MAIN ] UGP: Loaded 43183 existing records. [2025-09-22T21:48:53.042437] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:48:53.042834] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-22T21:48:53.042886] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-22T21:48:53.043897] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-22T21:48:53.043958] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-22T21:48:53.177060] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-22T21:48:53.327222] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-22T21:48:53.434971] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:48:54.122073] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-22T21:48:54.922053] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-22T21:48:54.962694] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T21:48:55.002712] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T21:48:55.722075] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-22T21:48:56.469055] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T21:48:56.522058] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-22T21:48:57.322044] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-22T21:48:57.368715] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T21:48:57.958761] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-22T21:48:57.960502] [INFO ] [REMOTE ] UFI: Full fetch complete (12319 records). [2025-09-22T21:48:57.960572] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-22T21:48:58.125302] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-22T21:48:58.284253] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T21:48:58.385726] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-22T21:48:58.385813] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-22T21:48:58.386107] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-22T21:48:58.386145] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-22T21:48:58.386776] [DEBUG] [LOCAL ] UFI: Trimmed 12319 records to 8192 (keeping 200 days of data) [2025-09-22T21:48:58.434827] [DEBUG] [LOCAL ] UFI: Primary data saved (8192 records). [2025-09-22T21:48:58.434942] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-22T21:48:58.435059] [INFO ] [MAIN ] Update Progress: 2173/2372 symbols completed. UFI took 20.5s. Estimated remaining: 26m 27s. Rate: 7.5 symbols/min [2025-09-22T21:48:58.604665] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:48:58.624575] [DEBUG] [LOCAL ] UHAL: Loaded 16672 existing records from primary storage. [2025-09-22T21:48:58.624724] [INFO ] [MAIN ] UHAL: Loaded 16672 existing records. [2025-09-22T21:48:58.803724] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:48:58.804014] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-22T21:48:58.804073] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-22T21:48:58.804709] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-22T21:48:58.804782] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-22T21:48:58.927238] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-22T21:48:59.175244] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:48:59.722081] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-22T21:49:00.001292] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T21:49:00.299603] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T21:49:00.522067] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-22T21:49:01.323773] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-22T21:49:01.331606] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T21:49:02.122068] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-22T21:49:02.389403] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-22T21:49:02.458782] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T21:49:02.922070] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-22T21:49:03.722094] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-22T21:49:03.771863] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T21:49:04.522042] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-22T21:49:04.639249] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T21:49:05.322055] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-22T21:49:05.346517] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T21:49:05.478319] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T21:49:06.122108] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-22T21:49:06.748999] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T21:49:06.758008] [INFO ] [REMOTE ] UE: Full fetch complete (61489 records). [2025-09-22T21:49:06.758180] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-22T21:49:06.930717] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-22T21:49:07.179332] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-22T21:49:07.180017] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-22T21:49:07.181714] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-22T21:49:07.180518] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T21:49:07.181886] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-22T21:49:07.187305] [DEBUG] [LOCAL ] UE: Trimmed 61489 records to 42958 (keeping 200 days of data) [2025-09-22T21:49:07.453308] [DEBUG] [LOCAL ] UE: Primary data saved (42958 records). [2025-09-22T21:49:07.453443] [INFO ] [MAIN ] UE: Full history saved. [2025-09-22T21:49:07.453526] [INFO ] [MAIN ] Update Progress: 2174/2372 symbols completed. UE took 31.2s. Estimated remaining: 26m 20s. Rate: 7.5 symbols/min [2025-09-22T21:49:07.629573] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:49:07.673969] [DEBUG] [LOCAL ] UHS: Loaded 42032 existing records from primary storage. [2025-09-22T21:49:07.674136] [INFO ] [MAIN ] UHS: Loaded 42032 existing records. [2025-09-22T21:49:07.729584] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-22T21:49:07.862785] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:49:07.863077] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-22T21:49:07.863183] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-22T21:49:07.864493] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-22T21:49:07.864557] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-22T21:49:08.225203] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:49:08.522042] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-22T21:49:08.702358] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T21:49:09.122094] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-22T21:49:09.322088] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-22T21:49:09.400336] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T21:49:10.122107] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-22T21:49:10.296528] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T21:49:10.922100] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-22T21:49:11.704329] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:49:11.722001] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-22T21:49:12.084836] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-22T21:49:12.522124] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-22T21:49:13.324740] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-22T21:49:13.330898] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-22T21:49:13.498244] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-22T21:49:14.122075] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-22T21:49:14.922068] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-22T21:49:15.074163] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-22T21:49:15.155864] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T21:49:15.722050] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-22T21:49:16.522039] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-22T21:49:16.572873] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T21:49:16.740939] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T21:49:17.322047] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-22T21:49:18.122068] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-22T21:49:18.399900] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T21:49:18.855065] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T21:49:18.922015] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-22T21:49:19.722046] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-22T21:49:19.767202] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T21:49:20.160623] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T21:49:20.168567] [INFO ] [REMOTE ] UGI: Full fetch complete (73427 records). [2025-09-22T21:49:20.168743] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-22T21:49:20.528677] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-22T21:49:20.575252] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-22T21:49:20.575386] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-22T21:49:20.576766] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-22T21:49:20.576848] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-22T21:49:20.578542] [DEBUG] [LOCAL ] UGI: Trimmed 73427 records to 50566 (keeping 200 days of data) [2025-09-22T21:49:20.817928] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T21:49:20.917402] [DEBUG] [LOCAL ] UGI: Primary data saved (50566 records). [2025-09-22T21:49:20.917581] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-22T21:49:20.917707] [INFO ] [MAIN ] Update Progress: 2175/2372 symbols completed. UGI took 40.2s. Estimated remaining: 26m 12s. Rate: 7.5 symbols/min [2025-09-22T21:49:21.089835] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:49:21.101590] [DEBUG] [LOCAL ] UHT: Loaded 10206 existing records from primary storage. [2025-09-22T21:49:21.101761] [INFO ] [MAIN ] UHT: Loaded 10206 existing records. [2025-09-22T21:49:21.283880] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:49:21.284133] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-22T21:49:21.284180] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-22T21:49:21.284554] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-22T21:49:21.284612] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-22T21:49:21.327216] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-22T21:49:21.645181] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:49:22.122047] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-22T21:49:22.198564] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T21:49:22.922026] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-22T21:49:23.050985] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T21:49:23.076046] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-22T21:49:23.722088] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-22T21:49:24.484709] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T21:49:24.522083] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-22T21:49:25.322057] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-22T21:49:25.391871] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-22T21:49:25.393978] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T21:49:26.129177] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-22T21:49:26.133539] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T21:49:26.138398] [INFO ] [REMOTE ] UHAL: Full fetch complete (23083 records). [2025-09-22T21:49:26.138545] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-22T21:49:26.575739] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-22T21:49:26.575823] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-22T21:49:26.576324] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-22T21:49:26.576364] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-22T21:49:26.577009] [DEBUG] [LOCAL ] UHAL: Trimmed 23083 records to 16429 (keeping 200 days of data) [2025-09-22T21:49:26.691279] [DEBUG] [LOCAL ] UHAL: Primary data saved (16429 records). [2025-09-22T21:49:26.691479] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-22T21:49:26.691621] [INFO ] [MAIN ] Update Progress: 2176/2372 symbols completed. UHAL took 28.3s. Estimated remaining: 26m 4s. Rate: 7.5 symbols/min [2025-09-22T21:49:26.876626] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:49:26.891489] [DEBUG] [LOCAL ] UI: Loaded 12760 existing records from primary storage. [2025-09-22T21:49:26.891622] [INFO ] [MAIN ] UI: Loaded 12760 existing records. [2025-09-22T21:49:26.927248] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-22T21:49:27.082744] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:49:27.083069] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-22T21:49:27.083118] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-22T21:49:27.083588] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-22T21:49:27.083685] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-22T21:49:27.448554] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:49:27.516825] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T21:49:27.722042] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-22T21:49:28.439104] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-22T21:49:28.445968] [INFO ] [REMOTE ] UGP: Full fetch complete (62066 records). [2025-09-22T21:49:28.446078] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-22T21:49:28.522897] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-22T21:49:28.609401] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T21:49:28.850592] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-22T21:49:28.850712] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-22T21:49:28.851901] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-22T21:49:28.851965] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-22T21:49:28.853311] [DEBUG] [LOCAL ] UGP: Trimmed 62066 records to 42582 (keeping 200 days of data) [2025-09-22T21:49:29.106159] [DEBUG] [LOCAL ] UGP: Primary data saved (42582 records). [2025-09-22T21:49:29.106292] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-22T21:49:29.106453] [INFO ] [MAIN ] Update Progress: 2177/2372 symbols completed. UGP took 36.5s. Estimated remaining: 25m 55s. Rate: 7.5 symbols/min [2025-09-22T21:49:29.280744] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:49:29.316416] [DEBUG] [LOCAL ] UIS: Loaded 37722 existing records from primary storage. [2025-09-22T21:49:29.316547] [INFO ] [MAIN ] UIS: Loaded 37722 existing records. [2025-09-22T21:49:29.327784] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-22T21:49:29.512853] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:49:29.514298] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-22T21:49:29.514032] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-22T21:49:29.517176] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-22T21:49:29.518957] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-22T21:49:29.519018] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-22T21:49:29.878251] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:49:30.122068] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-22T21:49:30.323428] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-22T21:49:30.922057] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-22T21:49:31.637594] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T21:49:31.722008] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-22T21:49:31.927331] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T21:49:32.522076] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-22T21:49:33.322070] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-22T21:49:33.429467] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T21:49:33.448853] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-22T21:49:34.122064] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-22T21:49:34.216910] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T21:49:34.922093] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-22T21:49:35.022993] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-22T21:49:35.722036] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-22T21:49:35.804132] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T21:49:36.399007] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-22T21:49:36.522074] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-22T21:49:37.322063] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-22T21:49:37.882297] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-22T21:49:38.122085] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-22T21:49:38.417352] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-22T21:49:38.423604] [INFO ] [REMOTE ] UHS: Full fetch complete (58286 records). [2025-09-22T21:49:38.423737] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-22T21:49:38.871253] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-22T21:49:38.871360] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-22T21:49:38.872453] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-22T21:49:38.872571] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-22T21:49:38.881204] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T21:49:38.884959] [DEBUG] [LOCAL ] UHS: Trimmed 58286 records to 41289 (keeping 200 days of data) [2025-09-22T21:49:38.941177] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-22T21:49:39.155385] [DEBUG] [LOCAL ] UHS: Primary data saved (41289 records). [2025-09-22T21:49:39.158879] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-22T21:49:39.159008] [INFO ] [MAIN ] Update Progress: 2178/2372 symbols completed. UHS took 31.7s. Estimated remaining: 25m 48s. Rate: 7.5 symbols/min [2025-09-22T21:49:39.331060] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:49:39.382416] [DEBUG] [LOCAL ] UL: Loaded 53844 existing records from primary storage. [2025-09-22T21:49:39.382591] [INFO ] [MAIN ] UL: Loaded 53844 existing records. [2025-09-22T21:49:39.562669] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:49:39.562936] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-22T21:49:39.562984] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-22T21:49:39.564340] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-22T21:49:39.564400] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-22T21:49:39.723908] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-22T21:49:39.890498] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T21:49:39.951957] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:49:40.522122] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-22T21:49:40.616513] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-22T21:49:41.322090] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-22T21:49:41.658023] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-22T21:49:42.122061] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-22T21:49:42.282555] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T21:49:42.922063] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-22T21:49:43.356166] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T21:49:43.722033] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-22T21:49:44.110157] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-22T21:49:44.509062] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T21:49:44.522076] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-22T21:49:45.322581] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-22T21:49:45.326511] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T21:49:46.122077] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-22T21:49:46.281528] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T21:49:46.284386] [INFO ] [REMOTE ] UI: Full fetch complete (17958 records). [2025-09-22T21:49:46.284460] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-22T21:49:46.659767] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-22T21:49:46.659893] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-22T21:49:46.660418] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-22T21:49:46.660469] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-22T21:49:46.661385] [DEBUG] [LOCAL ] UI: Trimmed 17958 records to 12558 (keeping 200 days of data) [2025-09-22T21:49:46.748222] [DEBUG] [LOCAL ] UI: Primary data saved (12558 records). [2025-09-22T21:49:46.748393] [INFO ] [MAIN ] UI: Full history saved. [2025-09-22T21:49:46.748485] [INFO ] [MAIN ] Update Progress: 2179/2372 symbols completed. UI took 20.1s. Estimated remaining: 25m 40s. Rate: 7.5 symbols/min [2025-09-22T21:49:46.924293] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-22T21:49:46.926143] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:49:46.961434] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T21:49:46.978563] [DEBUG] [LOCAL ] ULS: Loaded 39734 existing records from primary storage. [2025-09-22T21:49:46.978741] [INFO ] [MAIN ] ULS: Loaded 39734 existing records. [2025-09-22T21:49:47.171612] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:49:47.171971] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-22T21:49:47.172040] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-22T21:49:47.173017] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-22T21:49:47.173080] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-22T21:49:47.534838] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:49:47.722087] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-22T21:49:48.522039] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-22T21:49:48.539874] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T21:49:48.818866] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-22T21:49:49.322067] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-22T21:49:50.012316] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-22T21:49:50.122118] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-22T21:49:50.922766] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-22T21:49:50.925449] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T21:49:51.579429] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T21:49:51.722067] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-22T21:49:52.426626] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T21:49:52.522054] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-22T21:49:53.322016] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-22T21:49:53.532255] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-22T21:49:53.658751] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T21:49:54.122051] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-22T21:49:54.345440] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T21:49:54.922175] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-22T21:49:55.602265] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-22T21:49:55.716441] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-22T21:49:55.719070] [INFO ] [REMOTE ] UHT: Full fetch complete (15225 records). [2025-09-22T21:49:55.719159] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-22T21:49:55.727130] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-22T21:49:56.097850] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-22T21:49:56.097942] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-22T21:49:56.098312] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-22T21:49:56.098375] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-22T21:49:56.098916] [DEBUG] [LOCAL ] UHT: Trimmed 15225 records to 10029 (keeping 200 days of data) [2025-09-22T21:49:56.159962] [DEBUG] [LOCAL ] UHT: Primary data saved (10029 records). [2025-09-22T21:49:56.160096] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-22T21:49:56.160182] [INFO ] [MAIN ] Update Progress: 2180/2372 symbols completed. UHT took 35.2s. Estimated remaining: 25m 32s. Rate: 7.5 symbols/min [2025-09-22T21:49:56.327743] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:49:56.379575] [DEBUG] [LOCAL ] UMC: Loaded 53507 existing records from primary storage. [2025-09-22T21:49:56.379758] [INFO ] [MAIN ] UMC: Loaded 53507 existing records. [2025-09-22T21:49:56.528972] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-22T21:49:56.561184] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:49:56.561400] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-22T21:49:56.561449] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-22T21:49:56.562549] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-22T21:49:56.562612] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-22T21:49:56.953717] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:49:57.243095] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T21:49:57.322010] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-22T21:49:57.533192] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T21:49:58.122071] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-22T21:49:58.718461] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T21:49:58.922084] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-22T21:49:59.722170] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-22T21:49:59.847265] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T21:50:00.340104] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T21:50:00.522070] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-22T21:50:01.322098] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-22T21:50:01.787985] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-22T21:50:02.109106] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T21:50:02.122006] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-22T21:50:02.922085] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-22T21:50:03.311938] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-22T21:50:03.722036] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-22T21:50:03.758204] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-22T21:50:04.522036] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-22T21:50:04.610400] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T21:50:05.006521] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T21:50:05.012189] [INFO ] [REMOTE ] UIS: Full fetch complete (51910 records). [2025-09-22T21:50:05.012303] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-22T21:50:05.327208] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-22T21:50:05.413730] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-22T21:50:05.413850] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-22T21:50:05.414952] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-22T21:50:05.415019] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-22T21:50:05.417094] [DEBUG] [LOCAL ] UIS: Trimmed 51910 records to 37103 (keeping 200 days of data) [2025-09-22T21:50:05.635362] [DEBUG] [LOCAL ] UIS: Primary data saved (37103 records). [2025-09-22T21:50:05.635570] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-22T21:50:05.635739] [INFO ] [MAIN ] Update Progress: 2181/2372 symbols completed. UIS took 36.5s. Estimated remaining: 25m 24s. Rate: 7.5 symbols/min [2025-09-22T21:50:05.805537] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:50:05.842256] [DEBUG] [LOCAL ] UMH: Loaded 33497 existing records from primary storage. [2025-09-22T21:50:05.842397] [INFO ] [MAIN ] UMH: Loaded 33497 existing records. [2025-09-22T21:50:06.025262] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:50:06.025693] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-22T21:50:06.025781] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-22T21:50:06.027194] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-22T21:50:06.027256] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-22T21:50:06.125682] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-22T21:50:06.396563] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:50:06.423726] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-22T21:50:06.825339] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-22T21:50:06.922064] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-22T21:50:07.722086] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-22T21:50:08.054992] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T21:50:08.522079] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-22T21:50:08.754951] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T21:50:09.166076] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T21:50:09.322084] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-22T21:50:09.827930] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T21:50:10.122070] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-22T21:50:10.922149] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-22T21:50:11.233261] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T21:50:11.722070] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-22T21:50:11.883368] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T21:50:12.265059] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T21:50:12.522115] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-22T21:50:13.322032] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-22T21:50:13.686574] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T21:50:13.811749] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-22T21:50:14.122075] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-22T21:50:14.847618] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T21:50:14.922040] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-22T21:50:15.722129] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-22T21:50:16.051287] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T21:50:16.256345] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-22T21:50:16.522074] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-22T21:50:17.108680] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T21:50:17.116543] [INFO ] [REMOTE ] ULS: Full fetch complete (54381 records). [2025-09-22T21:50:17.116750] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-22T21:50:17.331702] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-22T21:50:17.507934] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-22T21:50:17.508023] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-22T21:50:17.509038] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-22T21:50:17.509101] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-22T21:50:17.510263] [DEBUG] [LOCAL ] ULS: Trimmed 54381 records to 39211 (keeping 200 days of data) [2025-09-22T21:50:17.755805] [DEBUG] [LOCAL ] ULS: Primary data saved (39211 records). [2025-09-22T21:50:17.755949] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-22T21:50:17.756037] [INFO ] [MAIN ] Update Progress: 2182/2372 symbols completed. ULS took 31.0s. Estimated remaining: 25m 16s. Rate: 7.5 symbols/min [2025-09-22T21:50:17.923781] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:50:17.937312] [DEBUG] [LOCAL ] UNF: Loaded 11981 existing records from primary storage. [2025-09-22T21:50:17.937460] [INFO ] [MAIN ] UNF: Loaded 11981 existing records. [2025-09-22T21:50:18.123582] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-22T21:50:18.123436] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:50:18.126544] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-22T21:50:18.126714] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-22T21:50:18.127252] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-22T21:50:18.127317] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-22T21:50:18.497237] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:50:18.562197] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-22T21:50:18.922066] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-22T21:50:19.205790] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T21:50:19.618397] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T21:50:19.722057] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-22T21:50:20.522088] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-22T21:50:20.651942] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T21:50:20.667454] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-22T21:50:20.667604] [INFO ] [REMOTE ] UL: Full fetch complete (76835 records). [2025-09-22T21:50:20.670123] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-22T21:50:21.117796] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-22T21:50:21.117900] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-22T21:50:21.119660] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-22T21:50:21.119737] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-22T21:50:21.121396] [DEBUG] [LOCAL ] UL: Trimmed 76835 records to 53067 (keeping 200 days of data) [2025-09-22T21:50:21.327162] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-22T21:50:21.484540] [DEBUG] [LOCAL ] UL: Primary data saved (53067 records). [2025-09-22T21:50:21.484721] [INFO ] [MAIN ] UL: Full history saved. [2025-09-22T21:50:21.484869] [INFO ] [MAIN ] Update Progress: 2183/2372 symbols completed. UL took 42.3s. Estimated remaining: 25m 8s. Rate: 7.5 symbols/min [2025-09-22T21:50:21.673104] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:50:21.723100] [DEBUG] [LOCAL ] UNFI: Loaded 42573 existing records from primary storage. [2025-09-22T21:50:21.723284] [INFO ] [MAIN ] UNFI: Loaded 42573 existing records. [2025-09-22T21:50:21.908361] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:50:21.908705] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-22T21:50:21.908784] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-22T21:50:21.909875] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-22T21:50:21.909938] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-22T21:50:22.129952] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-22T21:50:22.282591] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:50:22.352365] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-22T21:50:22.404419] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T21:50:22.922076] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-22T21:50:23.172969] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T21:50:23.722066] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-22T21:50:24.520521] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-22T21:50:24.528606] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-22T21:50:24.536392] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T21:50:25.322062] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-22T21:50:25.888889] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T21:50:26.122075] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-22T21:50:26.283096] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T21:50:26.922057] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-22T21:50:27.511797] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T21:50:27.722035] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-22T21:50:28.522069] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-22T21:50:28.752828] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T21:50:29.035102] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T21:50:29.322054] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-22T21:50:29.537336] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T21:50:30.122070] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-22T21:50:30.684410] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T21:50:30.696347] [INFO ] [REMOTE ] UMH: Full fetch complete (46412 records). [2025-09-22T21:50:30.697278] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T21:50:30.697059] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-22T21:50:30.930383] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-22T21:50:31.108373] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-22T21:50:31.108460] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-22T21:50:31.109406] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-22T21:50:31.109510] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-22T21:50:31.110570] [DEBUG] [LOCAL ] UMH: Trimmed 46412 records to 33333 (keeping 200 days of data) [2025-09-22T21:50:31.328125] [DEBUG] [LOCAL ] UMH: Primary data saved (33333 records). [2025-09-22T21:50:31.328300] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-22T21:50:31.328587] [INFO ] [MAIN ] Update Progress: 2184/2372 symbols completed. UMH took 25.7s. Estimated remaining: 25m 0s. Rate: 7.5 symbols/min [2025-09-22T21:50:31.502783] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:50:31.564319] [DEBUG] [LOCAL ] UNH: Loaded 54573 existing records from primary storage. [2025-09-22T21:50:31.564487] [INFO ] [MAIN ] UNH: Loaded 54573 existing records. [2025-09-22T21:50:31.735805] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-22T21:50:31.741471] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:50:31.743112] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-22T21:50:31.743166] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-22T21:50:31.744422] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-22T21:50:31.744521] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-22T21:50:32.125829] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:50:32.402862] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T21:50:32.522074] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-22T21:50:32.687471] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T21:50:33.322051] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-22T21:50:34.122114] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-22T21:50:34.364145] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-22T21:50:34.377712] [INFO ] [REMOTE ] UMC: Full fetch complete (76606 records). [2025-09-22T21:50:34.377996] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-22T21:50:34.926496] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-22T21:50:34.978794] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-22T21:50:34.979200] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-22T21:50:34.981896] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-22T21:50:34.982300] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-22T21:50:34.983674] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T21:50:34.995733] [DEBUG] [LOCAL ] UMC: Trimmed 76606 records to 52731 (keeping 200 days of data) [2025-09-22T21:50:35.325865] [DEBUG] [LOCAL ] UMC: Primary data saved (52731 records). [2025-09-22T21:50:35.326025] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-22T21:50:35.326141] [INFO ] [MAIN ] Update Progress: 2185/2372 symbols completed. UMC took 39.2s. Estimated remaining: 24m 52s. Rate: 7.5 symbols/min [2025-09-22T21:50:35.496437] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:50:35.547661] [DEBUG] [LOCAL ] UNM: Loaded 49543 existing records from primary storage. [2025-09-22T21:50:35.547835] [INFO ] [MAIN ] UNM: Loaded 49543 existing records. [2025-09-22T21:50:35.723155] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-22T21:50:35.727198] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:50:35.728358] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-22T21:50:35.728410] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-22T21:50:35.730147] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-22T21:50:35.730221] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-22T21:50:36.095039] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:50:36.108340] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-22T21:50:36.191954] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-22T21:50:36.522071] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-22T21:50:36.973974] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-22T21:50:37.322024] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-22T21:50:37.399686] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T21:50:38.122042] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-22T21:50:38.664883] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T21:50:38.922070] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-22T21:50:39.517224] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T21:50:39.720998] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-22T21:50:39.723024] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-22T21:50:39.725086] [INFO ] [REMOTE ] UNF: Full fetch complete (17035 records). [2025-09-22T21:50:39.725181] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-22T21:50:40.107965] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-22T21:50:40.108072] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-22T21:50:40.108542] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-22T21:50:40.108612] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-22T21:50:40.109196] [DEBUG] [LOCAL ] UNF: Trimmed 17035 records to 11798 (keeping 200 days of data) [2025-09-22T21:50:40.199363] [DEBUG] [LOCAL ] UNF: Primary data saved (11798 records). [2025-09-22T21:50:40.199674] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-22T21:50:40.199827] [INFO ] [MAIN ] Update Progress: 2186/2372 symbols completed. UNF took 22.4s. Estimated remaining: 24m 44s. Rate: 7.5 symbols/min [2025-09-22T21:50:40.369071] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:50:40.378753] [DEBUG] [LOCAL ] UNMA: Loaded 3790 existing records from primary storage. [2025-09-22T21:50:40.378871] [INFO ] [MAIN ] UNMA: Loaded 3790 existing records. [2025-09-22T21:50:40.527169] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-22T21:50:40.562282] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:50:40.562727] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-22T21:50:40.562804] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-22T21:50:40.563298] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-22T21:50:40.563373] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-22T21:50:40.967304] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:50:41.322068] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-22T21:50:41.388035] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-22T21:50:42.122094] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-22T21:50:42.701105] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-22T21:50:42.912194] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T21:50:42.922092] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-22T21:50:43.574267] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T21:50:43.722056] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-22T21:50:44.522061] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-22T21:50:45.168316] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-22T21:50:45.322117] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-22T21:50:45.512188] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-22T21:50:45.888242] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T21:50:46.122037] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-22T21:50:46.922083] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-22T21:50:47.376817] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-22T21:50:47.443211] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-22T21:50:47.722095] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-22T21:50:48.339220] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-22T21:50:48.522071] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-22T21:50:48.743733] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-22T21:50:49.135534] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T21:50:49.322059] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-22T21:50:50.122068] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-22T21:50:50.922046] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-22T21:50:50.973488] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T21:50:51.336197] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T21:50:51.722110] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-22T21:50:52.306441] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-22T21:50:52.522067] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-22T21:50:53.322058] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-22T21:50:53.380027] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-22T21:50:54.122042] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-22T21:50:54.207494] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T21:50:54.587839] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-22T21:50:54.698017] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-22T21:50:54.704925] [INFO ] [REMOTE ] UNFI: Full fetch complete (58744 records). [2025-09-22T21:50:54.705072] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-22T21:50:54.932195] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-22T21:50:55.111468] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-22T21:50:55.111570] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-22T21:50:55.112689] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-22T21:50:55.112774] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-22T21:50:55.114163] [DEBUG] [LOCAL ] UNFI: Trimmed 58744 records to 41841 (keeping 200 days of data) [2025-09-22T21:50:55.368032] [DEBUG] [LOCAL ] UNFI: Primary data saved (41841 records). [2025-09-22T21:50:55.368193] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-22T21:50:55.368324] [INFO ] [MAIN ] Update Progress: 2187/2372 symbols completed. UNFI took 33.9s. Estimated remaining: 24m 36s. Rate: 7.5 symbols/min [2025-09-22T21:50:55.535112] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:50:55.592160] [DEBUG] [LOCAL ] UNP: Loaded 53996 existing records from primary storage. [2025-09-22T21:50:55.592324] [INFO ] [MAIN ] UNP: Loaded 53996 existing records. [2025-09-22T21:50:55.730423] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-22T21:50:55.771433] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:50:55.771661] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-22T21:50:55.771733] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-22T21:50:55.773063] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-22T21:50:55.773124] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-22T21:50:56.130454] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:50:56.343404] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-22T21:50:56.522031] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-22T21:50:57.322074] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-22T21:50:57.869687] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-22T21:50:57.936818] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-22T21:50:58.122030] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-22T21:50:58.219102] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T21:50:58.768863] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-22T21:50:58.922060] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-22T21:50:59.542939] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T21:50:59.722075] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-22T21:51:00.522059] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-22T21:51:01.322106] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-22T21:51:02.122052] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-22T21:51:02.791285] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-22T21:51:02.922030] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-22T21:51:03.207392] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (3.49 seconds). [2025-09-22T21:51:03.722028] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-22T21:51:03.829472] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T21:51:04.522094] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-22T21:51:05.014932] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (3.69 seconds). [2025-09-22T21:51:05.036090] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-22T21:51:05.037284] [INFO ] [REMOTE ] UNMA: Full fetch complete (5819 records). [2025-09-22T21:51:05.037360] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-22T21:51:05.322409] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-22T21:51:05.441336] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-22T21:51:05.442128] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-22T21:51:05.442467] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-22T21:51:05.442875] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-22T21:51:05.443740] [DEBUG] [LOCAL ] UNMA: Trimmed 5819 records to 3670 (keeping 200 days of data) [2025-09-22T21:51:05.468004] [DEBUG] [LOCAL ] UNMA: Primary data saved (3670 records). [2025-09-22T21:51:05.468173] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-22T21:51:05.468323] [INFO ] [MAIN ] Update Progress: 2188/2372 symbols completed. UNMA took 25.3s. Estimated remaining: 24m 28s. Rate: 7.5 symbols/min [2025-09-22T21:51:05.618548] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-09-22T21:51:05.668630] [INFO ] [REMOTE ] UNM: Full fetch complete (70161 records). [2025-09-22T21:51:05.682845] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-22T21:51:05.702926] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:51:06.046471] [DEBUG] [LOCAL ] UP: Loaded 43694 existing records from primary storage. [2025-09-22T21:51:06.061976] [INFO ] [MAIN ] UP: Loaded 43694 existing records. [2025-09-22T21:51:06.246539] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-22T21:51:06.246925] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-22T21:51:06.253592] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-22T21:51:06.258855] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-22T21:51:06.329865] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:51:06.330123] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-22T21:51:06.329749] [DEBUG] [LOCAL ] UNM: Trimmed 70161 records to 48738 (keeping 200 days of data) [2025-09-22T21:51:06.330485] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-22T21:51:06.331351] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-22T21:51:06.331410] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-22T21:51:06.815209] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:51:06.817039] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-22T21:51:07.007597] [DEBUG] [LOCAL ] UNM: Primary data saved (48738 records). [2025-09-22T21:51:07.007768] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-22T21:51:07.007884] [INFO ] [MAIN ] Update Progress: 2189/2372 symbols completed. UNM took 31.7s. Estimated remaining: 24m 20s. Rate: 7.5 symbols/min [2025-09-22T21:51:07.191570] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:51:07.276805] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-22T21:51:07.280420] [INFO ] [MAIN ] UPS: Loaded 54490 existing records. [2025-09-22T21:51:07.319218] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-22T21:51:07.381906] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-22T21:51:07.484284] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:51:07.484761] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-22T21:51:07.484860] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-22T21:51:07.502771] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-22T21:51:07.508073] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-22T21:51:07.603179] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (3.88 seconds). [2025-09-22T21:51:07.729316] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-22T21:51:07.922189] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:51:08.514794] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T21:51:08.524289] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-22T21:51:08.859692] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-22T21:51:09.322064] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-22T21:51:10.122067] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-22T21:51:10.714418] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-22T21:51:10.922766] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-22T21:51:10.926016] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (3.20 seconds). [2025-09-22T21:51:10.960413] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T21:51:11.722063] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-22T21:51:11.830935] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T21:51:12.522116] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-22T21:51:13.322032] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-22T21:51:13.615049] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T21:51:13.685578] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-22T21:51:14.122041] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-22T21:51:14.922084] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-22T21:51:15.206275] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-22T21:51:15.214553] [INFO ] [REMOTE ] UNH: Full fetch complete (77863 records). [2025-09-22T21:51:15.214721] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-22T21:51:15.612929] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-22T21:51:15.613033] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-22T21:51:15.614252] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-22T21:51:15.614322] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-22T21:51:15.616222] [DEBUG] [LOCAL ] UNH: Trimmed 77863 records to 53794 (keeping 200 days of data) [2025-09-22T21:51:16.004072] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (3.48 seconds). [2025-09-22T21:51:16.017740] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-22T21:51:16.031289] [DEBUG] [LOCAL ] UNH: Primary data saved (53794 records). [2025-09-22T21:51:16.031446] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-22T21:51:16.031568] [INFO ] [MAIN ] Update Progress: 2190/2372 symbols completed. UNH took 44.7s. Estimated remaining: 24m 12s. Rate: 7.5 symbols/min [2025-09-22T21:51:16.215607] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:51:16.254150] [DEBUG] [LOCAL ] URI: Loaded 37373 existing records from primary storage. [2025-09-22T21:51:16.254320] [INFO ] [MAIN ] URI: Loaded 37373 existing records. [2025-09-22T21:51:16.445236] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:51:16.445558] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-22T21:51:16.445613] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-22T21:51:16.446691] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-22T21:51:16.446749] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-22T21:51:16.833214] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:51:16.833589] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-22T21:51:17.372799] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-22T21:51:17.382439] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-22T21:51:17.721866] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (3.60 seconds). [2025-09-22T21:51:17.827444] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-22T21:51:18.122025] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-22T21:51:18.177185] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T21:51:18.928534] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-22T21:51:18.930929] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-22T21:51:19.722080] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-22T21:51:20.077852] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-22T21:51:20.522097] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-22T21:51:21.322029] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-22T21:51:21.393206] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-22T21:51:21.441593] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T21:51:22.122075] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-22T21:51:22.462239] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T21:51:22.922064] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-22T21:51:22.964877] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-22T21:51:23.722103] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-22T21:51:24.327091] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T21:51:24.461978] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-22T21:51:24.522040] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-22T21:51:25.322078] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-22T21:51:25.571730] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-22T21:51:26.122082] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-22T21:51:26.339623] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-22T21:51:26.922056] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-22T21:51:27.448561] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-22T21:51:27.722029] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-22T21:51:27.991378] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-22T21:51:28.000257] [INFO ] [REMOTE ] UNP: Full fetch complete (76896 records). [2025-09-22T21:51:28.000456] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-22T21:51:28.142258] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-22T21:51:28.436378] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-22T21:51:28.436463] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-22T21:51:28.437628] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-22T21:51:28.437714] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-22T21:51:28.439184] [DEBUG] [LOCAL ] UNP: Trimmed 76896 records to 53234 (keeping 200 days of data) [2025-09-22T21:51:28.529852] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-22T21:51:28.781810] [DEBUG] [LOCAL ] UNP: Primary data saved (53234 records). [2025-09-22T21:51:28.781953] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-22T21:51:28.782037] [INFO ] [MAIN ] Update Progress: 2191/2372 symbols completed. UNP took 33.4s. Estimated remaining: 24m 4s. Rate: 7.5 symbols/min [2025-09-22T21:51:28.951544] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:51:28.986359] [DEBUG] [LOCAL ] USA: Loaded 36841 existing records from primary storage. [2025-09-22T21:51:28.986524] [INFO ] [MAIN ] USA: Loaded 36841 existing records. [2025-09-22T21:51:29.219220] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:51:29.219622] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-22T21:51:29.219785] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-22T21:51:29.220778] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-22T21:51:29.220840] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-22T21:51:29.322676] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-22T21:51:29.593024] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:51:29.618694] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T21:51:30.122055] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-22T21:51:30.669840] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-22T21:51:30.922029] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-22T21:51:31.004453] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T21:51:31.318052] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T21:51:31.722055] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-22T21:51:32.060815] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T21:51:32.522064] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-22T21:51:33.322037] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-22T21:51:33.378047] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:51:33.922544] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T21:51:34.122042] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-22T21:51:34.402850] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T21:51:34.922062] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-22T21:51:35.722061] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-22T21:51:36.400964] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-22T21:51:36.461672] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-22T21:51:36.522021] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-22T21:51:37.322063] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-22T21:51:37.723216] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-22T21:51:37.731281] [INFO ] [REMOTE ] UP: Full fetch complete (61959 records). [2025-09-22T21:51:37.731395] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-22T21:51:38.116858] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-22T21:51:38.116937] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-22T21:51:38.118015] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-22T21:51:38.118078] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-22T21:51:38.119316] [DEBUG] [LOCAL ] UP: Trimmed 61959 records to 43023 (keeping 200 days of data) [2025-09-22T21:51:38.122018] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-22T21:51:38.384498] [DEBUG] [LOCAL ] UP: Primary data saved (43023 records). [2025-09-22T21:51:38.384813] [INFO ] [MAIN ] UP: Full history saved. [2025-09-22T21:51:38.384932] [INFO ] [MAIN ] Update Progress: 2192/2372 symbols completed. UP took 32.9s. Estimated remaining: 23m 57s. Rate: 7.5 symbols/min [2025-09-22T21:51:38.558790] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:51:38.597796] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-22T21:51:38.632375] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T21:51:38.647614] [DEBUG] [LOCAL ] USAC: Loaded 23461 existing records from primary storage. [2025-09-22T21:51:38.647801] [INFO ] [MAIN ] USAC: Loaded 23461 existing records. [2025-09-22T21:51:38.823075] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:51:38.823334] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-22T21:51:38.823382] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-22T21:51:38.824137] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-22T21:51:38.824197] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-22T21:51:38.925340] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-22T21:51:39.203450] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:51:39.638323] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-22T21:51:39.722021] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-22T21:51:40.522063] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-22T21:51:40.709460] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T21:51:40.833229] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T21:51:41.108807] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-22T21:51:41.114682] [INFO ] [REMOTE ] URI: Full fetch complete (53734 records). [2025-09-22T21:51:41.114807] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-22T21:51:41.328949] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-22T21:51:41.530982] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-22T21:51:41.531074] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-22T21:51:41.532156] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-22T21:51:41.532220] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-22T21:51:41.533837] [DEBUG] [LOCAL ] URI: Trimmed 53734 records to 36513 (keeping 200 days of data) [2025-09-22T21:51:41.774204] [DEBUG] [LOCAL ] URI: Primary data saved (36513 records). [2025-09-22T21:51:41.774361] [INFO ] [MAIN ] URI: Full history saved. [2025-09-22T21:51:41.774449] [INFO ] [MAIN ] Update Progress: 2193/2372 symbols completed. URI took 25.7s. Estimated remaining: 23m 48s. Rate: 7.5 symbols/min [2025-09-22T21:51:41.945438] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:51:42.001068] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-22T21:51:42.001237] [INFO ] [MAIN ] USB: Loaded 54468 existing records. [2025-09-22T21:51:42.127185] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-22T21:51:42.197662] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:51:42.197907] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-22T21:51:42.197969] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-22T21:51:42.199716] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-22T21:51:42.199778] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-22T21:51:42.576069] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:51:42.896250] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T21:51:42.922012] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-22T21:51:43.468681] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T21:51:43.722111] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-22T21:51:44.316131] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-22T21:51:44.469994] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T21:51:44.478736] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-09-22T21:51:44.478904] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-22T21:51:44.527184] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-22T21:51:44.886066] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-22T21:51:44.886171] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-22T21:51:44.887482] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-22T21:51:44.887549] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-22T21:51:44.889211] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 53710 (keeping 200 days of data) [2025-09-22T21:51:45.239599] [DEBUG] [LOCAL ] UPS: Primary data saved (53710 records). [2025-09-22T21:51:45.239793] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-22T21:51:45.241533] [INFO ] [MAIN ] Update Progress: 2194/2372 symbols completed. UPS took 38.2s. Estimated remaining: 23m 40s. Rate: 7.5 symbols/min [2025-09-22T21:51:45.327172] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-22T21:51:45.420372] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:51:45.479180] [DEBUG] [LOCAL ] USFD: Loaded 52005 existing records from primary storage. [2025-09-22T21:51:45.479352] [INFO ] [MAIN ] USFD: Loaded 52005 existing records. [2025-09-22T21:51:45.657933] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:51:45.658210] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-22T21:51:45.658259] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-22T21:51:45.659288] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-22T21:51:45.659348] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-22T21:51:46.023037] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:51:46.122054] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-22T21:51:46.479775] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T21:51:46.692388] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-22T21:51:46.922116] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-22T21:51:47.452740] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T21:51:47.722124] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-22T21:51:47.992961] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T21:51:48.522062] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-22T21:51:49.184790] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-22T21:51:49.322078] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-22T21:51:49.537271] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-22T21:51:50.122174] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-22T21:51:50.922077] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-22T21:51:51.268205] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-22T21:51:51.404436] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-22T21:51:51.722083] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-22T21:51:52.155274] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T21:51:52.522104] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-22T21:51:53.322102] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-22T21:51:53.383393] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-22T21:51:53.875556] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-22T21:51:54.122108] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-22T21:51:54.412259] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T21:51:54.922154] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-22T21:51:55.367903] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T21:51:55.722075] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-22T21:51:56.522048] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-22T21:51:56.926422] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T21:51:56.990772] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T21:51:57.223046] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-22T21:51:57.322086] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-22T21:51:58.122071] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-22T21:51:58.922083] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-22T21:51:59.224948] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T21:51:59.545671] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T21:51:59.552015] [INFO ] [REMOTE ] USA: Full fetch complete (51599 records). [2025-09-22T21:51:59.552113] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-22T21:51:59.723906] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-22T21:51:59.974540] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-22T21:51:59.974386] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T21:51:59.974782] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-22T21:51:59.980094] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-22T21:51:59.980298] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-22T21:51:59.981664] [DEBUG] [LOCAL ] USA: Trimmed 51599 records to 36159 (keeping 200 days of data) [2025-09-22T21:52:00.195938] [DEBUG] [LOCAL ] USA: Primary data saved (36159 records). [2025-09-22T21:52:00.196085] [INFO ] [MAIN ] USA: Full history saved. [2025-09-22T21:52:00.196173] [INFO ] [MAIN ] Update Progress: 2195/2372 symbols completed. USA took 31.4s. Estimated remaining: 23m 32s. Rate: 7.5 symbols/min [2025-09-22T21:52:00.364277] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:52:00.384785] [DEBUG] [LOCAL ] USNA: Loaded 18648 existing records from primary storage. [2025-09-22T21:52:00.384975] [INFO ] [MAIN ] USNA: Loaded 18648 existing records. [2025-09-22T21:52:00.527141] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-22T21:52:00.566425] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:52:00.566607] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-22T21:52:00.566702] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-22T21:52:00.567304] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-22T21:52:00.567364] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-22T21:52:00.918528] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:52:01.322067] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-22T21:52:01.407626] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T21:52:01.798494] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T21:52:01.803350] [INFO ] [REMOTE ] USAC: Full fetch complete (35661 records). [2025-09-22T21:52:01.803450] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-22T21:52:02.127151] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-22T21:52:02.189995] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-22T21:52:02.190170] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-22T21:52:02.190942] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-22T21:52:02.191005] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-22T21:52:02.191850] [DEBUG] [LOCAL ] USAC: Trimmed 35661 records to 22907 (keeping 200 days of data) [2025-09-22T21:52:02.337510] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T21:52:02.350288] [DEBUG] [LOCAL ] USAC: Primary data saved (22907 records). [2025-09-22T21:52:02.350435] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-22T21:52:02.350537] [INFO ] [MAIN ] Update Progress: 2196/2372 symbols completed. USAC took 24.0s. Estimated remaining: 23m 24s. Rate: 7.5 symbols/min [2025-09-22T21:52:02.530421] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:52:02.548552] [DEBUG] [LOCAL ] USPH: Loaded 16866 existing records from primary storage. [2025-09-22T21:52:02.548711] [INFO ] [MAIN ] USPH: Loaded 16866 existing records. [2025-09-22T21:52:02.735733] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:52:02.736021] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-22T21:52:02.736072] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-22T21:52:02.736852] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-22T21:52:02.736915] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-22T21:52:02.928059] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-22T21:52:03.097863] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:52:03.722092] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-22T21:52:03.948857] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-22T21:52:04.419926] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-22T21:52:04.455530] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T21:52:04.522032] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-22T21:52:05.322068] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-22T21:52:05.382769] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-22T21:52:06.122050] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-22T21:52:06.922074] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-22T21:52:07.212960] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T21:52:07.722107] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-22T21:52:07.794600] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T21:52:08.015572] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-22T21:52:08.522078] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-22T21:52:08.650129] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-22T21:52:09.322067] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-22T21:52:10.122092] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-22T21:52:10.182901] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T21:52:10.922053] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-22T21:52:11.216966] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T21:52:11.253047] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-22T21:52:11.722109] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-22T21:52:12.533884] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-22T21:52:12.537073] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:52:12.595873] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T21:52:12.604315] [INFO ] [REMOTE ] USB: Full fetch complete (77709 records). [2025-09-22T21:52:12.604448] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-22T21:52:13.003811] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-22T21:52:13.003908] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-22T21:52:13.005109] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-22T21:52:13.005177] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-22T21:52:13.007038] [DEBUG] [LOCAL ] USB: Trimmed 77709 records to 53688 (keeping 200 days of data) [2025-09-22T21:52:13.324473] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-22T21:52:13.351127] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-09-22T21:52:13.351239] [INFO ] [MAIN ] USB: Full history saved. [2025-09-22T21:52:13.351334] [INFO ] [MAIN ] Update Progress: 2197/2372 symbols completed. USB took 31.6s. Estimated remaining: 23m 16s. Rate: 7.5 symbols/min [2025-09-22T21:52:13.616048] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T21:52:14.122115] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-22T21:52:14.427549] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-22T21:52:14.922034] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-22T21:52:15.237398] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-22T21:52:15.722073] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-22T21:52:16.522036] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-22T21:52:16.614935] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T21:52:16.705451] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-22T21:52:17.322057] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-22T21:52:17.741321] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-22T21:52:18.122055] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-22T21:52:18.922025] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-22T21:52:19.081045] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T21:52:19.305705] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T21:52:19.722057] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-22T21:52:20.062378] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-22T21:52:20.522055] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-22T21:52:21.322035] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-22T21:52:21.371493] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T21:52:21.379859] [INFO ] [REMOTE ] USFD: Full fetch complete (73916 records). [2025-09-22T21:52:21.380004] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-22T21:52:21.526609] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T21:52:21.808882] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-22T21:52:21.808973] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-22T21:52:21.810134] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-22T21:52:21.810203] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-22T21:52:21.812013] [DEBUG] [LOCAL ] USFD: Trimmed 73916 records to 51236 (keeping 200 days of data) [2025-09-22T21:52:22.123406] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-22T21:52:22.136172] [DEBUG] [LOCAL ] USFD: Primary data saved (51236 records). [2025-09-22T21:52:22.136362] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-22T21:52:22.136668] [INFO ] [MAIN ] Update Progress: 2198/2372 symbols completed. USFD took 36.9s. Estimated remaining: 23m 8s. Rate: 7.5 symbols/min [2025-09-22T21:52:22.307906] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T21:52:22.922030] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-22T21:52:23.126831] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T21:52:23.722049] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-22T21:52:24.030877] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T21:52:24.289067] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T21:52:24.292370] [INFO ] [REMOTE ] USPH: Full fetch complete (22433 records). [2025-09-22T21:52:24.292518] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-22T21:52:24.535528] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-22T21:52:24.706933] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-22T21:52:24.707023] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-22T21:52:24.707748] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-22T21:52:24.707826] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-22T21:52:24.708788] [DEBUG] [LOCAL ] USPH: Trimmed 22433 records to 16607 (keeping 200 days of data) [2025-09-22T21:52:24.814189] [DEBUG] [LOCAL ] USPH: Primary data saved (16607 records). [2025-09-22T21:52:24.814337] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-22T21:52:24.814448] [INFO ] [MAIN ] Update Progress: 2199/2372 symbols completed. USPH took 22.5s. Estimated remaining: 22m 60s. Rate: 7.5 symbols/min [2025-09-22T21:52:25.581752] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T21:52:25.585566] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-22T21:52:26.464018] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-22T21:52:26.466986] [INFO ] [REMOTE ] USNA: Full fetch complete (26463 records). [2025-09-22T21:52:26.467078] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-22T21:52:26.866139] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-22T21:52:26.866294] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-22T21:52:26.866931] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-22T21:52:26.867021] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-22T21:52:26.867929] [DEBUG] [LOCAL ] USNA: Trimmed 26463 records to 18228 (keeping 200 days of data) [2025-09-22T21:52:26.996728] [DEBUG] [LOCAL ] USNA: Primary data saved (18228 records). [2025-09-22T21:52:26.996916] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-22T21:52:26.997121] [INFO ] [MAIN ] Update Progress: 2200/2372 symbols completed. USNA took 26.8s. Estimated remaining: 22m 52s. Rate: 7.5 symbols/min [2025-09-22T21:52:27.595583] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:52:27.747487] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:52:27.812681] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:52:27.818951] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:52:27.837406] [DEBUG] [LOCAL ] UTL: Loaded 11073 existing records from primary storage. [2025-09-22T21:52:27.837780] [INFO ] [MAIN ] UTL: Loaded 11073 existing records. [2025-09-22T21:52:28.106514] [DEBUG] [LOCAL ] UTZ: Loaded 45430 existing records from primary storage. [2025-09-22T21:52:28.118078] [DEBUG] [LOCAL ] UTF: Loaded 28882 existing records from primary storage. [2025-09-22T21:52:28.124198] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:52:28.124357] [INFO ] [MAIN ] UTF: Loaded 28882 existing records. [2025-09-22T21:52:28.119721] [INFO ] [MAIN ] UTZ: Loaded 45430 existing records. [2025-09-22T21:52:28.163019] [DEBUG] [LOCAL ] UTI: Loaded 41259 existing records from primary storage. [2025-09-22T21:52:28.146729] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-22T21:52:28.189264] [INFO ] [MAIN ] UTI: Loaded 41259 existing records. [2025-09-22T21:52:28.189140] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-22T21:52:28.320267] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-22T21:52:28.351887] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-22T21:52:28.751321] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:52:28.827324] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:52:28.845057] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-22T21:52:28.838345] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-22T21:52:28.862595] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-22T21:52:28.910423] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-22T21:52:28.910598] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-22T21:52:28.910800] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-22T21:52:28.916744] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-22T21:52:28.911271] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:52:28.922900] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-22T21:52:28.983690] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-22T21:52:29.050990] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-22T21:52:29.133786] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-22T21:52:29.278043] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-22T21:52:29.534128] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:52:29.570624] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-22T21:52:30.136530] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:52:30.169730] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-22T21:52:30.314146] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:52:30.327845] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-22T21:52:30.509341] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:52:30.509970] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-22T21:52:30.671027] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T21:52:30.673615] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-22T21:52:31.473736] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-22T21:52:31.476235] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-22T21:52:31.766336] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T21:52:31.774517] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-22T21:52:31.793702] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T21:52:31.799535] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-22T21:52:31.987293] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-22T21:52:32.265009] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T21:52:32.522056] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-22T21:52:33.136788] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T21:52:33.273007] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T21:52:33.322017] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-22T21:52:33.807438] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T21:52:34.122106] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-22T21:52:34.857623] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T21:52:34.922011] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-22T21:52:34.948847] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-22T21:52:35.722124] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-22T21:52:36.488921] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T21:52:36.522005] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-22T21:52:36.550003] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-22T21:52:37.322085] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-22T21:52:38.013279] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-22T21:52:38.122046] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-22T21:52:38.809083] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T21:52:38.922025] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-22T21:52:39.279851] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-22T21:52:39.722053] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-22T21:52:40.512067] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T21:52:40.522007] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-22T21:52:41.079296] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T21:52:41.322065] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-22T21:52:42.011458] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T21:52:42.122118] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-22T21:52:42.922110] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-22T21:52:43.088813] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T21:52:43.616377] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-22T21:52:43.722055] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-22T21:52:44.239987] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-22T21:52:44.522065] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-22T21:52:45.322062] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-22T21:52:45.486147] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T21:52:45.831503] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-22T21:52:46.122110] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-22T21:52:46.870696] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T21:52:46.922080] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-22T21:52:47.382965] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-22T21:52:47.389136] [INFO ] [REMOTE ] UTI: Full fetch complete (58109 records). [2025-09-22T21:52:47.389296] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-22T21:52:47.727366] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-22T21:52:47.783277] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-22T21:52:47.783371] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-22T21:52:47.784331] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-22T21:52:47.784393] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-22T21:52:47.785879] [DEBUG] [LOCAL ] UTI: Trimmed 58109 records to 40552 (keeping 200 days of data) [2025-09-22T21:52:48.031200] [DEBUG] [LOCAL ] UTI: Primary data saved (40552 records). [2025-09-22T21:52:48.031345] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-22T21:52:48.031444] [INFO ] [MAIN ] Update Progress: 2201/2372 symbols completed. UTI took 21.0s. Estimated remaining: 22m 45s. Rate: 7.5 symbols/min [2025-09-22T21:52:48.204010] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:52:48.222903] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-22T21:52:48.247709] [DEBUG] [LOCAL ] UVE: Loaded 22135 existing records from primary storage. [2025-09-22T21:52:48.247836] [INFO ] [MAIN ] UVE: Loaded 22135 existing records. [2025-09-22T21:52:48.431879] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:52:48.433420] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-22T21:52:48.433481] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-22T21:52:48.434772] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-22T21:52:48.434837] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-22T21:52:48.527243] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-22T21:52:48.789471] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:52:49.311707] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T21:52:49.321999] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-22T21:52:49.655948] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T21:52:50.122048] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-22T21:52:50.922020] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-22T21:52:50.999298] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T21:52:51.315264] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T21:52:51.679860] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T21:52:51.722037] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-22T21:52:52.522035] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-22T21:52:52.576241] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T21:52:53.282836] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T21:52:53.322001] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-22T21:52:54.122041] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-22T21:52:54.238403] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T21:52:54.922157] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-22T21:52:55.727766] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-22T21:52:55.734830] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-22T21:52:56.351327] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-22T21:52:56.527013] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-22T21:52:56.531544] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-22T21:52:57.322021] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-22T21:52:57.605192] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T21:52:58.122070] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-22T21:52:58.593060] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-22T21:52:58.598905] [INFO ] [REMOTE ] UTF: Full fetch complete (40969 records). [2025-09-22T21:52:58.599002] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-22T21:52:58.932808] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-22T21:52:58.984844] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-22T21:52:58.984928] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-22T21:52:58.985884] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-22T21:52:58.985946] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-22T21:52:58.986972] [DEBUG] [LOCAL ] UTF: Trimmed 40969 records to 28480 (keeping 200 days of data) [2025-09-22T21:52:59.169315] [DEBUG] [LOCAL ] UTF: Primary data saved (28480 records). [2025-09-22T21:52:59.169452] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-22T21:52:59.169540] [INFO ] [MAIN ] Update Progress: 2202/2372 symbols completed. UTF took 32.2s. Estimated remaining: 22m 37s. Rate: 7.5 symbols/min [2025-09-22T21:52:59.341236] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:52:59.364843] [DEBUG] [LOCAL ] UVV: Loaded 22592 existing records from primary storage. [2025-09-22T21:52:59.364974] [INFO ] [MAIN ] UVV: Loaded 22592 existing records. [2025-09-22T21:52:59.563149] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:52:59.566384] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-22T21:52:59.566611] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-22T21:52:59.572958] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-22T21:52:59.573390] [INFO ] [REMOTE ] UTZ: Full fetch complete (63589 records). [2025-09-22T21:52:59.573469] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-22T21:52:59.573750] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-22T21:52:59.573812] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-22T21:52:59.729286] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-22T21:53:00.250856] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T21:53:00.361309] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-22T21:53:00.361098] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:53:00.361463] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-22T21:53:00.363055] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-22T21:53:00.363123] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-22T21:53:00.364439] [DEBUG] [LOCAL ] UTZ: Trimmed 63589 records to 44757 (keeping 200 days of data) [2025-09-22T21:53:00.547466] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-22T21:53:00.652770] [DEBUG] [LOCAL ] UTZ: Primary data saved (44757 records). [2025-09-22T21:53:00.652922] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-22T21:53:00.653016] [INFO ] [MAIN ] Update Progress: 2203/2372 symbols completed. UTZ took 33.7s. Estimated remaining: 22m 28s. Rate: 7.5 symbols/min [2025-09-22T21:53:00.822445] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:53:00.873589] [DEBUG] [LOCAL ] UWMC: Loaded 53493 existing records from primary storage. [2025-09-22T21:53:00.873784] [INFO ] [MAIN ] UWMC: Loaded 53493 existing records. [2025-09-22T21:53:01.055242] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:53:01.055773] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-22T21:53:01.055998] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-22T21:53:01.062484] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-22T21:53:01.072850] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-22T21:53:01.119378] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T21:53:01.322512] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-22T21:53:01.493477] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:53:01.508686] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T21:53:01.511695] [INFO ] [REMOTE ] UTL: Full fetch complete (15106 records). [2025-09-22T21:53:01.511770] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-22T21:53:01.881260] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-22T21:53:01.881362] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-22T21:53:01.881690] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-22T21:53:01.881761] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-22T21:53:01.882280] [DEBUG] [LOCAL ] UTL: Trimmed 15106 records to 11018 (keeping 200 days of data) [2025-09-22T21:53:01.954822] [DEBUG] [LOCAL ] UTL: Primary data saved (11018 records). [2025-09-22T21:53:01.954951] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-22T21:53:01.955073] [INFO ] [MAIN ] Update Progress: 2204/2372 symbols completed. UTL took 35.0s. Estimated remaining: 22m 20s. Rate: 7.5 symbols/min [2025-09-22T21:53:02.129682] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:53:02.126193] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-22T21:53:02.140436] [DEBUG] [LOCAL ] UZD: Loaded 6411 existing records from primary storage. [2025-09-22T21:53:02.140553] [INFO ] [MAIN ] UZD: Loaded 6411 existing records. [2025-09-22T21:53:02.326884] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:53:02.327185] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-22T21:53:02.327335] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-22T21:53:02.328496] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-22T21:53:02.328556] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-22T21:53:02.450469] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T21:53:02.697702] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:53:02.922027] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-22T21:53:03.722058] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-22T21:53:04.522097] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-22T21:53:04.536190] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-22T21:53:04.845093] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-22T21:53:05.311064] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-22T21:53:05.321992] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-22T21:53:05.334293] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-22T21:53:06.122107] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-22T21:53:06.922017] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-22T21:53:07.110543] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-22T21:53:07.298083] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T21:53:07.716799] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-22T21:53:07.721996] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-22T21:53:08.326333] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-22T21:53:08.522074] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-22T21:53:09.322038] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-22T21:53:09.532972] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-22T21:53:10.034537] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-22T21:53:10.122106] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-22T21:53:10.922021] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-22T21:53:11.097283] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T21:53:11.722057] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-22T21:53:12.325140] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T21:53:12.522085] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-22T21:53:12.907097] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-22T21:53:13.322067] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-22T21:53:14.122100] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-22T21:53:14.271295] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T21:53:14.519061] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T21:53:14.885528] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-22T21:53:14.922053] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-22T21:53:15.634429] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-22T21:53:15.722082] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-22T21:53:16.522058] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-22T21:53:17.322064] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-22T21:53:17.536464] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T21:53:17.795962] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-22T21:53:18.122087] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-22T21:53:18.456740] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T21:53:18.922051] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-22T21:53:19.722037] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-22T21:53:20.040760] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-22T21:53:20.065878] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-22T21:53:20.381011] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-22T21:53:20.522131] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-22T21:53:21.322011] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-22T21:53:21.781564] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T21:53:22.122074] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-22T21:53:22.922071] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-22T21:53:23.196750] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T21:53:23.350332] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T21:53:23.722085] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-22T21:53:23.805398] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-22T21:53:24.522060] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-22T21:53:24.766519] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-22T21:53:24.770219] [INFO ] [REMOTE ] UVV: Full fetch complete (29627 records). [2025-09-22T21:53:24.770302] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-22T21:53:25.080005] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T21:53:25.172876] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-22T21:53:25.172967] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-22T21:53:25.173562] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-22T21:53:25.173624] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-22T21:53:25.174479] [DEBUG] [LOCAL ] UVV: Trimmed 29627 records to 22336 (keeping 200 days of data) [2025-09-22T21:53:25.322241] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-22T21:53:25.324223] [DEBUG] [LOCAL ] UVV: Primary data saved (22336 records). [2025-09-22T21:53:25.324306] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-22T21:53:25.324420] [INFO ] [MAIN ] Update Progress: 2205/2372 symbols completed. UVV took 26.2s. Estimated remaining: 22m 13s. Rate: 7.5 symbols/min [2025-09-22T21:53:25.497768] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:53:25.506868] [DEBUG] [LOCAL ] UZE: Loaded 7573 existing records from primary storage. [2025-09-22T21:53:25.506969] [INFO ] [MAIN ] UZE: Loaded 7573 existing records. [2025-09-22T21:53:25.683335] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:53:25.683597] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-22T21:53:25.683667] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-22T21:53:25.684080] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-22T21:53:25.684140] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-22T21:53:26.040511] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:53:26.122069] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-22T21:53:26.922099] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-22T21:53:26.948212] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T21:53:27.203213] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T21:53:27.350205] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-22T21:53:27.722065] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-22T21:53:28.433676] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T21:53:28.522054] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-22T21:53:29.059224] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-22T21:53:29.060387] [INFO ] [REMOTE ] UZD: Full fetch complete (9399 records). [2025-09-22T21:53:29.060456] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-22T21:53:29.327165] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-22T21:53:29.448710] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-22T21:53:29.448793] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-22T21:53:29.449040] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-22T21:53:29.449079] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-22T21:53:29.449534] [DEBUG] [LOCAL ] UZD: Trimmed 9399 records to 6314 (keeping 200 days of data) [2025-09-22T21:53:29.489079] [DEBUG] [LOCAL ] UZD: Primary data saved (6314 records). [2025-09-22T21:53:29.489229] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-22T21:53:29.489318] [INFO ] [MAIN ] Update Progress: 2206/2372 symbols completed. UZD took 27.5s. Estimated remaining: 22m 5s. Rate: 7.5 symbols/min [2025-09-22T21:53:29.666972] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:53:29.676184] [DEBUG] [LOCAL ] UZF: Loaded 6540 existing records from primary storage. [2025-09-22T21:53:29.676290] [INFO ] [MAIN ] UZF: Loaded 6540 existing records. [2025-09-22T21:53:29.858147] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:53:29.858436] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-22T21:53:29.858492] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-22T21:53:29.858837] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-22T21:53:29.858896] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-22T21:53:30.129270] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-22T21:53:30.223741] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:53:30.317574] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-22T21:53:30.320872] [INFO ] [REMOTE ] UVE: Full fetch complete (29511 records). [2025-09-22T21:53:30.320954] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-22T21:53:30.692980] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-22T21:53:30.693172] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-22T21:53:30.693961] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-22T21:53:30.694025] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-22T21:53:30.694857] [DEBUG] [LOCAL ] UVE: Trimmed 29511 records to 21834 (keeping 200 days of data) [2025-09-22T21:53:30.798631] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-22T21:53:30.840787] [DEBUG] [LOCAL ] UVE: Primary data saved (21834 records). [2025-09-22T21:53:30.840940] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-22T21:53:30.841051] [INFO ] [MAIN ] Update Progress: 2207/2372 symbols completed. UVE took 42.8s. Estimated remaining: 21m 56s. Rate: 7.5 symbols/min [2025-09-22T21:53:30.927188] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-22T21:53:31.013410] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:53:31.072962] [DEBUG] [LOCAL ] V: Loaded 54543 existing records from primary storage. [2025-09-22T21:53:31.073161] [INFO ] [MAIN ] V: Loaded 54543 existing records. [2025-09-22T21:53:31.249121] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:53:31.249386] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-22T21:53:31.249433] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-22T21:53:31.250753] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-22T21:53:31.250814] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-22T21:53:31.604660] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:53:31.722070] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-22T21:53:32.522042] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-22T21:53:32.891759] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-22T21:53:33.228304] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-22T21:53:33.322061] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-22T21:53:34.051851] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-22T21:53:34.082599] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-22T21:53:34.122028] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-22T21:53:34.922053] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-22T21:53:35.671961] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-22T21:53:35.722085] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-22T21:53:36.292845] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-22T21:53:36.522143] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-22T21:53:37.034367] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T21:53:37.044218] [INFO ] [REMOTE ] UWMC: Full fetch complete (75408 records). [2025-09-22T21:53:37.044498] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-22T21:53:37.331042] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-22T21:53:37.455815] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-22T21:53:37.455907] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-22T21:53:37.457246] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-22T21:53:37.457316] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-22T21:53:37.458904] [DEBUG] [LOCAL ] UWMC: Trimmed 75408 records to 52726 (keeping 200 days of data) [2025-09-22T21:53:37.773291] [DEBUG] [LOCAL ] UWMC: Primary data saved (52726 records). [2025-09-22T21:53:37.773443] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-22T21:53:37.773551] [INFO ] [MAIN ] Update Progress: 2208/2372 symbols completed. UWMC took 37.1s. Estimated remaining: 21m 48s. Rate: 7.5 symbols/min [2025-09-22T21:53:37.877964] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-22T21:53:37.954724] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:53:37.997084] [DEBUG] [LOCAL ] VAC: Loaded 35334 existing records from primary storage. [2025-09-22T21:53:37.997236] [INFO ] [MAIN ] VAC: Loaded 35334 existing records. [2025-09-22T21:53:38.135095] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-22T21:53:38.176785] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:53:38.177137] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-22T21:53:38.177202] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-22T21:53:38.178041] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-22T21:53:38.178101] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-22T21:53:38.550134] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:53:38.743734] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-22T21:53:38.885351] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-22T21:53:38.922050] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-22T21:53:39.722139] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-22T21:53:40.522113] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-22T21:53:40.863149] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T21:53:41.055308] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-22T21:53:41.250376] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-22T21:53:41.322041] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-22T21:53:42.122049] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-22T21:53:42.503228] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-22T21:53:42.774152] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T21:53:42.922046] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-22T21:53:43.722079] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-22T21:53:44.351463] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-22T21:53:44.436901] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-22T21:53:44.522053] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-22T21:53:45.322056] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-22T21:53:46.002271] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-22T21:53:46.026291] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-22T21:53:46.122000] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-22T21:53:46.922056] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-22T21:53:47.701385] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:53:47.722006] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-22T21:53:48.522077] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-22T21:53:49.239416] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T21:53:49.278068] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T21:53:49.329678] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-22T21:53:49.338215] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-22T21:53:50.122074] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-22T21:53:50.737935] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-22T21:53:50.759588] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-22T21:53:50.922017] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-22T21:53:51.722073] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-22T21:53:52.181863] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T21:53:52.522052] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-22T21:53:53.322056] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-22T21:53:53.818545] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-22T21:53:53.918270] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-22T21:53:53.971954] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-22T21:53:54.122061] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-22T21:53:54.922081] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-22T21:53:55.476039] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-22T21:53:55.481200] [INFO ] [REMOTE ] VAC: Full fetch complete (47593 records). [2025-09-22T21:53:55.481306] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-22T21:53:55.727905] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-22T21:53:55.875039] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-22T21:53:55.875256] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-22T21:53:55.876557] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-22T21:53:55.876663] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-22T21:53:55.877860] [DEBUG] [LOCAL ] VAC: Trimmed 47593 records to 34656 (keeping 200 days of data) [2025-09-22T21:53:55.980312] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-22T21:53:56.123811] [DEBUG] [LOCAL ] VAC: Primary data saved (34656 records). [2025-09-22T21:53:56.123995] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-22T21:53:56.124108] [INFO ] [MAIN ] Update Progress: 2209/2372 symbols completed. VAC took 18.4s. Estimated remaining: 21m 41s. Rate: 7.5 symbols/min [2025-09-22T21:53:56.294201] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:53:56.327199] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-22T21:53:56.347730] [DEBUG] [LOCAL ] VAL: Loaded 51276 existing records from primary storage. [2025-09-22T21:53:56.347915] [INFO ] [MAIN ] VAL: Loaded 51276 existing records. [2025-09-22T21:53:56.547715] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-22T21:53:56.553016] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:53:56.554175] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-22T21:53:56.554226] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-22T21:53:56.555328] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-22T21:53:56.555389] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-22T21:53:56.931737] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:53:57.299187] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T21:53:57.301200] [INFO ] [REMOTE ] UZE: Full fetch complete (10177 records). [2025-09-22T21:53:57.301278] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-22T21:53:57.327240] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-22T21:53:57.688836] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-22T21:53:57.688960] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-22T21:53:57.689313] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-22T21:53:57.689355] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-22T21:53:57.689891] [DEBUG] [LOCAL ] UZE: Trimmed 10177 records to 7454 (keeping 200 days of data) [2025-09-22T21:53:57.738664] [DEBUG] [LOCAL ] UZE: Primary data saved (7454 records). [2025-09-22T21:53:57.738850] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-22T21:53:57.738970] [INFO ] [MAIN ] Update Progress: 2210/2372 symbols completed. UZE took 32.4s. Estimated remaining: 21m 33s. Rate: 7.5 symbols/min [2025-09-22T21:53:57.913576] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:53:57.974434] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-22T21:53:57.974834] [INFO ] [MAIN ] VALE: Loaded 54474 existing records. [2025-09-22T21:53:58.129593] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-22T21:53:58.161864] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:53:58.162123] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-22T21:53:58.162182] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-22T21:53:58.163738] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-22T21:53:58.163799] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-22T21:53:58.297405] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-22T21:53:58.533073] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:53:58.922087] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-22T21:53:59.722108] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-22T21:54:00.382390] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-22T21:54:00.522048] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-22T21:54:01.263370] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-22T21:54:01.322013] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-22T21:54:01.483479] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T21:54:02.122055] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-22T21:54:02.922106] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-22T21:54:03.516966] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-09-22T21:54:03.722068] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-22T21:54:03.924818] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-22T21:54:04.076321] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T21:54:04.077617] [INFO ] [REMOTE ] UZF: Full fetch complete (8784 records). [2025-09-22T21:54:04.077723] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-22T21:54:04.516313] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-22T21:54:04.516456] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-22T21:54:04.516820] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-22T21:54:04.516901] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-22T21:54:04.517708] [DEBUG] [LOCAL ] UZF: Trimmed 8784 records to 6456 (keeping 200 days of data) [2025-09-22T21:54:04.534602] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-22T21:54:04.560585] [DEBUG] [LOCAL ] UZF: Primary data saved (6456 records). [2025-09-22T21:54:04.561052] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-22T21:54:04.561276] [INFO ] [MAIN ] Update Progress: 2211/2372 symbols completed. UZF took 35.1s. Estimated remaining: 21m 25s. Rate: 7.5 symbols/min [2025-09-22T21:54:04.712810] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-22T21:54:04.800688] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:54:04.808488] [DEBUG] [LOCAL ] VATE: Loaded 5992 existing records from primary storage. [2025-09-22T21:54:04.808668] [INFO ] [MAIN ] VATE: Loaded 5992 existing records. [2025-09-22T21:54:05.002855] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:54:05.003185] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-22T21:54:05.003236] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-22T21:54:05.003500] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-22T21:54:05.003559] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-22T21:54:05.331822] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-22T21:54:05.363062] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:54:06.108210] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-22T21:54:06.122002] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-22T21:54:06.531512] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-22T21:54:06.617985] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-22T21:54:06.626980] [INFO ] [REMOTE ] V: Full fetch complete (77829 records). [2025-09-22T21:54:06.627158] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-22T21:54:06.926561] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-22T21:54:07.045356] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-22T21:54:07.045493] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-22T21:54:07.046883] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-22T21:54:07.046974] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-22T21:54:07.076583] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T21:54:07.076765] [DEBUG] [LOCAL ] V: Trimmed 77829 records to 53763 (keeping 200 days of data) [2025-09-22T21:54:07.442033] [DEBUG] [LOCAL ] V: Primary data saved (53763 records). [2025-09-22T21:54:07.442243] [INFO ] [MAIN ] V: Full history saved. [2025-09-22T21:54:07.444392] [INFO ] [MAIN ] Update Progress: 2212/2372 symbols completed. V took 36.6s. Estimated remaining: 21m 16s. Rate: 7.5 symbols/min [2025-09-22T21:54:07.663920] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:54:07.664358] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-22T21:54:07.682116] [DEBUG] [LOCAL ] VBF: Loaded 7212 existing records from primary storage. [2025-09-22T21:54:07.682293] [INFO ] [MAIN ] VBF: Loaded 7212 existing records. [2025-09-22T21:54:07.727341] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-22T21:54:07.879585] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:54:07.879858] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-22T21:54:07.879909] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-22T21:54:07.880295] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-22T21:54:07.880357] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-22T21:54:08.266720] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:54:08.522115] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-22T21:54:09.322053] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-22T21:54:09.597571] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-22T21:54:09.750816] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-22T21:54:10.122085] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-22T21:54:10.922044] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-22T21:54:10.982024] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-22T21:54:11.298627] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-22T21:54:11.722070] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-22T21:54:12.522143] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-22T21:54:12.836220] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T21:54:13.292032] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-22T21:54:13.322087] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-22T21:54:14.122098] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-22T21:54:14.922047] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-22T21:54:15.010897] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (3.29 seconds). [2025-09-22T21:54:15.028785] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T21:54:15.378532] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-22T21:54:15.722121] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-22T21:54:16.156558] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-22T21:54:16.186343] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-22T21:54:16.522103] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-22T21:54:17.322051] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-22T21:54:18.122070] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-22T21:54:18.572122] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-22T21:54:18.616018] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-22T21:54:18.922062] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-22T21:54:19.049767] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T21:54:19.698161] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-22T21:54:19.722024] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-22T21:54:20.522127] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-22T21:54:21.168125] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-22T21:54:21.322029] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-22T21:54:21.414494] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T21:54:22.064563] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-22T21:54:22.122052] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-22T21:54:22.922066] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-22T21:54:23.639635] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T21:54:23.722007] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-22T21:54:24.263356] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-22T21:54:24.324324] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T21:54:24.522060] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-22T21:54:25.322053] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-22T21:54:25.844145] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-22T21:54:26.122052] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-22T21:54:26.654554] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-22T21:54:26.776839] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-22T21:54:26.922045] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-22T21:54:27.722062] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-22T21:54:28.522093] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-22T21:54:28.778778] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T21:54:29.226241] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T21:54:29.322067] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-22T21:54:29.454619] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T21:54:29.469665] [INFO ] [REMOTE ] VALE: Full fetch complete (77764 records). [2025-09-22T21:54:29.470121] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-22T21:54:30.049848] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-22T21:54:30.049987] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-22T21:54:30.052414] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-22T21:54:30.052569] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-22T21:54:30.055384] [DEBUG] [LOCAL ] VALE: Trimmed 77764 records to 53694 (keeping 200 days of data) [2025-09-22T21:54:30.142846] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-22T21:54:30.214952] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-22T21:54:30.578999] [DEBUG] [LOCAL ] VALE: Primary data saved (53694 records). [2025-09-22T21:54:30.579248] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-22T21:54:30.579589] [INFO ] [MAIN ] Update Progress: 2213/2372 symbols completed. VALE took 32.8s. Estimated remaining: 21m 9s. Rate: 7.5 symbols/min [2025-09-22T21:54:30.800315] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:54:30.809035] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-22T21:54:30.814573] [INFO ] [REMOTE ] VATE: Full fetch complete (10550 records). [2025-09-22T21:54:30.814742] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-22T21:54:30.923078] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-22T21:54:30.960461] [DEBUG] [LOCAL ] VCV: Loaded 13645 existing records from primary storage. [2025-09-22T21:54:30.964790] [INFO ] [MAIN ] VCV: Loaded 13645 existing records. [2025-09-22T21:54:31.370071] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:54:31.404638] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-22T21:54:31.428133] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-22T21:54:31.428213] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-22T21:54:31.428295] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-22T21:54:31.428626] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-22T21:54:31.428723] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-22T21:54:31.429096] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-22T21:54:31.429280] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-22T21:54:31.429496] [DEBUG] [LOCAL ] VATE: Trimmed 10550 records to 5717 (keeping 200 days of data) [2025-09-22T21:54:31.722043] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-22T21:54:31.776774] [DEBUG] [LOCAL ] VATE: Primary data saved (5717 records). [2025-09-22T21:54:31.787909] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-22T21:54:31.788189] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-22T21:54:31.825036] [INFO ] [MAIN ] Update Progress: 2214/2372 symbols completed. VATE took 27.3s. Estimated remaining: 21m 1s. Rate: 7.5 symbols/min [2025-09-22T21:54:31.870299] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:54:32.055594] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:54:32.123606] [DEBUG] [LOCAL ] VEEV: Loaded 48195 existing records from primary storage. [2025-09-22T21:54:32.123817] [INFO ] [MAIN ] VEEV: Loaded 48195 existing records. [2025-09-22T21:54:32.323538] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:54:32.323837] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-22T21:54:32.323889] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-22T21:54:32.325165] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-22T21:54:32.325239] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-22T21:54:32.527237] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-22T21:54:32.729977] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:54:33.322026] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-22T21:54:33.382003] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:54:33.631241] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-22T21:54:33.944392] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T21:54:33.946338] [INFO ] [REMOTE ] VBF: Full fetch complete (10341 records). [2025-09-22T21:54:33.946428] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-22T21:54:34.123678] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-22T21:54:34.311244] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-22T21:54:34.311323] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-22T21:54:34.311572] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-22T21:54:34.311633] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-22T21:54:34.312112] [DEBUG] [LOCAL ] VBF: Trimmed 10341 records to 7121 (keeping 200 days of data) [2025-09-22T21:54:34.361861] [DEBUG] [LOCAL ] VBF: Primary data saved (7121 records). [2025-09-22T21:54:34.361989] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-22T21:54:34.362127] [INFO ] [MAIN ] Update Progress: 2215/2372 symbols completed. VBF took 26.9s. Estimated remaining: 20m 52s. Rate: 7.5 symbols/min [2025-09-22T21:54:34.531335] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:54:34.552635] [DEBUG] [LOCAL ] VEL: Loaded 13150 existing records from primary storage. [2025-09-22T21:54:34.552782] [INFO ] [MAIN ] VEL: Loaded 13150 existing records. [2025-09-22T21:54:34.733039] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:54:34.733602] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-22T21:54:34.733684] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-22T21:54:34.734277] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-22T21:54:34.734337] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-22T21:54:34.928558] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-22T21:54:35.089045] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:54:35.722058] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-22T21:54:35.884972] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T21:54:36.285204] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T21:54:36.295714] [INFO ] [REMOTE ] VAL: Full fetch complete (73252 records). [2025-09-22T21:54:36.295856] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-22T21:54:36.528938] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-22T21:54:36.613188] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T21:54:36.713600] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-22T21:54:36.713722] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-22T21:54:36.715138] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-22T21:54:36.715210] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-22T21:54:36.723078] [DEBUG] [LOCAL ] VAL: Trimmed 73252 records to 50453 (keeping 200 days of data) [2025-09-22T21:54:37.037885] [DEBUG] [LOCAL ] VAL: Primary data saved (50453 records). [2025-09-22T21:54:37.038045] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-22T21:54:37.038247] [INFO ] [MAIN ] Update Progress: 2216/2372 symbols completed. VAL took 40.9s. Estimated remaining: 20m 44s. Rate: 7.5 symbols/min [2025-09-22T21:54:37.216518] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:54:37.259473] [DEBUG] [LOCAL ] VET: Loaded 44937 existing records from primary storage. [2025-09-22T21:54:37.259635] [INFO ] [MAIN ] VET: Loaded 44937 existing records. [2025-09-22T21:54:37.327228] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-22T21:54:37.445264] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:54:37.449467] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-22T21:54:37.449603] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-22T21:54:37.450610] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-22T21:54:37.450705] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-22T21:54:37.807937] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:54:38.122044] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-22T21:54:38.140980] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-22T21:54:38.409585] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-22T21:54:38.922046] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-22T21:54:38.940185] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-22T21:54:39.627963] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T21:54:39.722105] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-22T21:54:40.522109] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-22T21:54:40.522206] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-22T21:54:41.322082] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-22T21:54:42.038537] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T21:54:42.085012] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-22T21:54:42.122006] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-22T21:54:42.922039] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-22T21:54:42.989917] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-22T21:54:43.722112] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-22T21:54:44.472345] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-22T21:54:44.522000] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-22T21:54:44.639411] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-22T21:54:45.322098] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-22T21:54:45.490783] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T21:54:46.122048] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-22T21:54:46.828079] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T21:54:46.922065] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-22T21:54:47.722038] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-22T21:54:47.741678] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T21:54:47.809430] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T21:54:48.522039] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-22T21:54:48.711251] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T21:54:49.322058] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-22T21:54:50.122064] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-22T21:54:50.202317] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T21:54:50.240487] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-22T21:54:50.922098] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-22T21:54:50.985358] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T21:54:51.722163] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-22T21:54:52.522050] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-22T21:54:52.593137] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-22T21:54:52.702576] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T21:54:53.322086] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-22T21:54:54.122051] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-22T21:54:54.196954] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-22T21:54:54.254550] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T21:54:54.257521] [INFO ] [REMOTE ] VCV: Full fetch complete (19552 records). [2025-09-22T21:54:54.257617] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-22T21:54:54.708110] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-22T21:54:54.708212] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-22T21:54:54.708722] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-22T21:54:54.708782] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-22T21:54:54.709410] [DEBUG] [LOCAL ] VCV: Trimmed 19552 records to 13355 (keeping 200 days of data) [2025-09-22T21:54:54.802098] [DEBUG] [LOCAL ] VCV: Primary data saved (13355 records). [2025-09-22T21:54:54.802252] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-22T21:54:54.802356] [INFO ] [MAIN ] Update Progress: 2217/2372 symbols completed. VCV took 24.2s. Estimated remaining: 20m 37s. Rate: 7.5 symbols/min [2025-09-22T21:54:54.927289] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-22T21:54:54.978567] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:54:55.036680] [DEBUG] [LOCAL ] VFC: Loaded 54389 existing records from primary storage. [2025-09-22T21:54:55.036912] [INFO ] [MAIN ] VFC: Loaded 54389 existing records. [2025-09-22T21:54:55.217974] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:54:55.218282] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-22T21:54:55.218332] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-22T21:54:55.219791] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-22T21:54:55.219854] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-22T21:54:55.586740] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:54:55.652732] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T21:54:55.722029] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-22T21:54:55.885981] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-22T21:54:56.522080] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-22T21:54:57.322074] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-22T21:54:57.483778] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T21:54:57.858568] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-22T21:54:58.122034] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-22T21:54:58.764084] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T21:54:58.922029] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-22T21:54:59.722083] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-22T21:54:59.959728] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T21:55:00.392610] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T21:55:00.522078] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-22T21:55:01.322104] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-22T21:55:01.409612] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T21:55:02.063098] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-22T21:55:02.122088] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-22T21:55:02.150116] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T21:55:02.922107] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-22T21:55:03.722079] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-22T21:55:03.746743] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-22T21:55:04.135620] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-22T21:55:04.522029] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-22T21:55:05.271878] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T21:55:05.274333] [INFO ] [REMOTE ] VEL: Full fetch complete (16591 records). [2025-09-22T21:55:05.274410] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-22T21:55:05.328441] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-22T21:55:05.655452] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T21:55:05.699548] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-22T21:55:05.699635] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-22T21:55:05.700076] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-22T21:55:05.700449] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-22T21:55:05.701130] [DEBUG] [LOCAL ] VEL: Trimmed 16591 records to 13060 (keeping 200 days of data) [2025-09-22T21:55:05.779369] [DEBUG] [LOCAL ] VEL: Primary data saved (13060 records). [2025-09-22T21:55:05.779503] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-22T21:55:05.779602] [INFO ] [MAIN ] Update Progress: 2218/2372 symbols completed. VEL took 31.4s. Estimated remaining: 20m 29s. Rate: 7.5 symbols/min [2025-09-22T21:55:05.949814] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:55:05.949993] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-22T21:55:05.950032] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-22T21:55:05.950170] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-22T21:55:05.950224] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-22T21:55:05.950318] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-22T21:55:05.950357] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-22T21:55:06.125792] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-22T21:55:06.312240] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:55:06.922028] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-22T21:55:07.080056] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-22T21:55:07.089029] [INFO ] [REMOTE ] VEEV: Full fetch complete (68558 records). [2025-09-22T21:55:07.089182] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-22T21:55:07.181845] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:55:07.192745] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-22T21:55:07.499054] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-22T21:55:07.499155] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-22T21:55:07.500343] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-22T21:55:07.500414] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-22T21:55:07.501872] [DEBUG] [LOCAL ] VEEV: Trimmed 68558 records to 47404 (keeping 200 days of data) [2025-09-22T21:55:07.722034] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-09-22T21:55:07.840915] [DEBUG] [LOCAL ] VEEV: Primary data saved (47404 records). [2025-09-22T21:55:07.841068] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-22T21:55:07.841182] [INFO ] [MAIN ] Update Progress: 2219/2372 symbols completed. VEEV took 36.0s. Estimated remaining: 20m 21s. Rate: 7.5 symbols/min [2025-09-22T21:55:08.044564] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-22T21:55:08.046418] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:55:08.062882] [DEBUG] [LOCAL ] VGI: Loaded 5317 existing records from primary storage. [2025-09-22T21:55:08.063009] [INFO ] [MAIN ] VGI: Loaded 5317 existing records. [2025-09-22T21:55:08.240250] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:55:08.240534] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-22T21:55:08.240607] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-22T21:55:08.241088] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-22T21:55:08.241164] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-22T21:55:08.522559] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-22T21:55:08.612292] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:55:08.738137] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T21:55:09.322062] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-22T21:55:09.987237] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-22T21:55:10.124473] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-22T21:55:10.127755] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-22T21:55:10.922057] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-22T21:55:11.722114] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-22T21:55:12.257699] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-22T21:55:12.522043] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-22T21:55:12.712053] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T21:55:12.969484] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-22T21:55:13.322057] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-22T21:55:14.133326] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-22T21:55:14.139637] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T21:55:14.751958] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T21:55:14.758473] [INFO ] [REMOTE ] VET: Full fetch complete (64300 records). [2025-09-22T21:55:14.758590] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-22T21:55:14.930461] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-22T21:55:15.145455] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-22T21:55:15.145565] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-22T21:55:15.146692] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-22T21:55:15.146754] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-22T21:55:15.148056] [DEBUG] [LOCAL ] VET: Trimmed 64300 records to 44141 (keeping 200 days of data) [2025-09-22T21:55:15.408582] [DEBUG] [LOCAL ] VET: Primary data saved (44141 records). [2025-09-22T21:55:15.408779] [INFO ] [MAIN ] VET: Full history saved. [2025-09-22T21:55:15.408881] [INFO ] [MAIN ] Update Progress: 2220/2372 symbols completed. VET took 38.4s. Estimated remaining: 20m 13s. Rate: 7.5 symbols/min [2025-09-22T21:55:15.583049] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:55:15.601577] [DEBUG] [LOCAL ] VGM: Loaded 18478 existing records from primary storage. [2025-09-22T21:55:15.601765] [INFO ] [MAIN ] VGM: Loaded 18478 existing records. [2025-09-22T21:55:15.726374] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-22T21:55:15.789376] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:55:15.789632] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-22T21:55:15.789717] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-22T21:55:15.790281] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-22T21:55:15.790343] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-22T21:55:16.167288] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:55:16.198748] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-22T21:55:16.476629] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-22T21:55:16.522004] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-22T21:55:16.935938] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-22T21:55:17.085041] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-22T21:55:17.322062] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-22T21:55:18.122054] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-22T21:55:18.922033] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-22T21:55:19.258475] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T21:55:19.586143] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-22T21:55:19.722036] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-22T21:55:20.078630] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T21:55:20.300280] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-22T21:55:20.522057] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-22T21:55:21.322061] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-22T21:55:21.934076] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-22T21:55:22.122055] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-22T21:55:22.494960] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-22T21:55:22.693996] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T21:55:22.922051] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-22T21:55:23.722058] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-22T21:55:24.522026] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-22T21:55:24.933250] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T21:55:25.110021] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T21:55:25.118546] [INFO ] [REMOTE ] VFC: Full fetch complete (77587 records). [2025-09-22T21:55:25.118715] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-22T21:55:25.228844] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T21:55:25.330129] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-22T21:55:25.536683] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-22T21:55:25.536776] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-22T21:55:25.537958] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-22T21:55:25.538030] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-22T21:55:25.539732] [DEBUG] [LOCAL ] VFC: Trimmed 77587 records to 53611 (keeping 200 days of data) [2025-09-22T21:55:25.877742] [DEBUG] [LOCAL ] VFC: Primary data saved (53611 records). [2025-09-22T21:55:25.877881] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-22T21:55:25.877981] [INFO ] [MAIN ] Update Progress: 2221/2372 symbols completed. VFC took 31.1s. Estimated remaining: 20m 5s. Rate: 7.5 symbols/min [2025-09-22T21:55:26.049395] [INFO ] [MAIN ] VHC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:55:26.049583] [DEBUG] [LOCAL ] VHC: No existing data file found in primary storage. [2025-09-22T21:55:26.049628] [WARN ] [MAIN ] VHC: No existing data found, performing full refresh instead. [2025-09-22T21:55:26.049811] [INFO ] [MAIN ] VHC: Wiping existing primary data before full refresh. [2025-09-22T21:55:26.049852] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-22T21:55:26.049892] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-22T21:55:26.049923] [INFO ] [MAIN ] VHC: Starting full primary refresh. [2025-09-22T21:55:26.123535] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-22T21:55:26.402801] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T21:55:26.443388] [INFO ] [REMOTE ] VHC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:55:26.760114] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-22T21:55:26.922042] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-22T21:55:27.722023] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-22T21:55:27.952020] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-22T21:55:28.331139] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T21:55:28.522053] [INFO ] [REMOTE ] VHC: Fetching primary data for 2024-12. [2025-09-22T21:55:29.139295] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-22T21:55:29.322066] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-22T21:55:30.122065] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-22T21:55:30.868003] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T21:55:30.870064] [INFO ] [REMOTE ] VGI: Full fetch complete (7763 records). [2025-09-22T21:55:30.870134] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-22T21:55:30.933033] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-01. [2025-09-22T21:55:31.238945] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-22T21:55:31.239072] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-22T21:55:31.239334] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-22T21:55:31.239409] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-22T21:55:31.239918] [DEBUG] [LOCAL ] VGI: Trimmed 7763 records to 5195 (keeping 200 days of data) [2025-09-22T21:55:31.271274] [DEBUG] [LOCAL ] VGI: Primary data saved (5195 records). [2025-09-22T21:55:31.271374] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-22T21:55:31.271457] [INFO ] [MAIN ] Update Progress: 2222/2372 symbols completed. VGI took 23.4s. Estimated remaining: 19m 57s. Rate: 7.5 symbols/min [2025-09-22T21:55:31.446675] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:55:31.478219] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-22T21:55:31.482202] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-22T21:55:31.497328] [DEBUG] [LOCAL ] VHI: Loaded 3016 existing records from primary storage. [2025-09-22T21:55:31.497739] [INFO ] [MAIN ] VHI: Loaded 3016 existing records. [2025-09-22T21:55:31.678592] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:55:31.679033] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-22T21:55:31.679104] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-22T21:55:31.679403] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-22T21:55:31.679461] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-22T21:55:31.727153] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-02. [2025-09-22T21:55:32.078490] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:55:32.181019] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-22T21:55:32.522131] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-22T21:55:33.081700] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T21:55:33.322055] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-22T21:55:34.122053] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-22T21:55:34.922018] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-22T21:55:35.041416] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-22T21:55:35.478874] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-22T21:55:35.564132] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T21:55:35.722015] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-22T21:55:36.522092] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-22T21:55:37.322032] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-03. [2025-09-22T21:55:37.521072] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T21:55:37.880309] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-22T21:55:37.883344] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-22T21:55:38.122065] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-22T21:55:38.922059] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-22T21:55:39.633259] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T21:55:39.722006] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-04. [2025-09-22T21:55:39.854237] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-22T21:55:39.862384] [INFO ] [REMOTE ] VG: Full fetch complete (64120 records). [2025-09-22T21:55:39.862500] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-22T21:55:40.056930] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-22T21:55:40.057580] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:55:40.057678] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:55:40.057739] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-22T21:55:40.057803] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-22T21:55:40.057839] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-22T21:55:40.057896] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-22T21:55:40.057982] [INFO ] [MAIN ] Update Progress: 2223/2372 symbols completed. VG took 34.3s. Estimated remaining: 19m 49s. Rate: 7.5 symbols/min [2025-09-22T21:55:40.168685] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-22T21:55:40.238771] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:55:40.238915] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-22T21:55:40.238952] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-22T21:55:40.239138] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-22T21:55:40.239190] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-22T21:55:40.239241] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-22T21:55:40.239274] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-22T21:55:40.527170] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-22T21:55:40.600729] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:55:41.063057] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-22T21:55:41.322073] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-05. [2025-09-22T21:55:41.690262] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-22T21:55:42.122095] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-22T21:55:42.722801] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-22T21:55:42.922143] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-06. [2025-09-22T21:55:43.509031] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-22T21:55:43.722168] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-22T21:55:44.522217] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-22T21:55:44.774412] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:55:44.776150] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-22T21:55:44.781280] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-22T21:55:45.322077] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-09-22T21:55:45.543035] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:55:45.543521] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-09-22T21:55:46.122103] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-22T21:55:46.772790] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-22T21:55:46.922077] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-07. [2025-09-22T21:55:47.613755] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T21:55:47.722102] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-22T21:55:48.208903] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-22T21:55:48.522077] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-22T21:55:49.322082] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-22T21:55:49.532245] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-22T21:55:49.675728] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:55:49.676088] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-22T21:55:50.122073] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-08. [2025-09-22T21:55:50.571330] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-22T21:55:50.922083] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-22T21:55:51.722027] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-22T21:55:51.841725] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-22T21:55:52.317968] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-22T21:55:52.522062] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-22T21:55:53.099548] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-22T21:55:53.322116] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-22T21:55:53.815979] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T21:55:54.122063] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-22T21:55:54.922050] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-09. [2025-09-22T21:55:55.234382] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-22T21:55:55.238233] [INFO ] [REMOTE ] VGM: Full fetch complete (26152 records). [2025-09-22T21:55:55.238334] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-22T21:55:55.369198] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-22T21:55:55.386270] [INFO ] [REMOTE ] VHC: Full fetch complete (3732 records). [2025-09-22T21:55:55.417356] [DEBUG] [VALIDATOR ] VHC: Validating primary data. [2025-09-22T21:55:55.727792] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-22T21:55:55.779889] [WARN ] [VALIDATOR ] VHC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-22T21:55:55.792108] [FATAL] [MAIN ] VHC: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:55:55.845224] [WARN ] [MAIN ] VHC: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:55:55.859152] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-22T21:55:55.859264] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-22T21:55:55.859528] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-22T21:55:55.860386] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-22T21:55:55.860487] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-22T21:55:55.859630] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-22T21:55:55.860789] [INFO ] [LOCAL ] VHC: Starting deletion of derivative data. [2025-09-22T21:55:55.861313] [DEBUG] [LOCAL ] VHC: No derivative data file found to delete. [2025-09-22T21:55:55.861615] [INFO ] [MAIN ] Update Progress: 2224/2372 symbols completed. VHC took 30.0s. Estimated remaining: 19m 41s. Rate: 7.5 symbols/min [2025-09-22T21:55:55.862027] [DEBUG] [LOCAL ] VGM: Trimmed 26152 records to 18209 (keeping 200 days of data) [2025-09-22T21:55:56.126782] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:55:56.172568] [DEBUG] [LOCAL ] VGM: Primary data saved (18209 records). [2025-09-22T21:55:56.172756] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-22T21:55:56.172857] [INFO ] [MAIN ] Update Progress: 2225/2372 symbols completed. VGM took 40.8s. Estimated remaining: 19m 33s. Rate: 7.5 symbols/min [2025-09-22T21:55:56.338069] [DEBUG] [LOCAL ] VICI: Loaded 54428 existing records from primary storage. [2025-09-22T21:55:56.324544] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-22T21:55:56.338285] [INFO ] [MAIN ] VICI: Loaded 54428 existing records. [2025-09-22T21:55:56.393170] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:55:56.394397] [INFO ] [REMOTE ] VHI: Full fetch complete (4660 records). [2025-09-22T21:55:56.394534] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-22T21:55:56.526753] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-22T21:55:56.775305] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:55:56.836698] [DEBUG] [LOCAL ] VIK: Loaded 53290 existing records from primary storage. [2025-09-22T21:55:56.824877] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:55:56.835509] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-22T21:55:56.866015] [INFO ] [MAIN ] VIK: Loaded 53290 existing records. [2025-09-22T21:55:56.860764] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-22T21:55:56.871675] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-22T21:55:56.884499] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-22T21:55:56.899472] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-22T21:55:57.232627] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-22T21:55:57.238448] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-22T21:55:57.243861] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-22T21:55:57.279834] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-22T21:55:57.346989] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-22T21:55:57.405466] [DEBUG] [LOCAL ] VHI: Trimmed 4660 records to 2896 (keeping 200 days of data) [2025-09-22T21:55:57.431020] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:55:57.431604] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-22T21:55:57.446249] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-22T21:55:57.468413] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-22T21:55:57.501769] [DEBUG] [LOCAL ] VHI: Primary data saved (2896 records). [2025-09-22T21:55:57.501690] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-22T21:55:57.501914] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-22T21:55:57.552009] [INFO ] [MAIN ] Update Progress: 2226/2372 symbols completed. VHI took 26.3s. Estimated remaining: 19m 24s. Rate: 7.5 symbols/min [2025-09-22T21:55:57.673983] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:55:57.814503] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:55:57.837398] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-22T21:55:58.042207] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:55:58.128875] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-22T21:55:58.167894] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:55:58.215292] [DEBUG] [LOCAL ] VIPS: Loaded 52155 existing records from primary storage. [2025-09-22T21:55:58.215435] [INFO ] [MAIN ] VIPS: Loaded 52155 existing records. [2025-09-22T21:55:58.396137] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:55:58.396404] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-22T21:55:58.396453] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-22T21:55:58.397614] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-22T21:55:58.397707] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-22T21:55:58.755204] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:55:58.922035] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-22T21:55:59.722023] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-22T21:56:00.132843] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:56:00.146883] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-22T21:56:00.149454] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-22T21:56:00.522037] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-22T21:56:00.567530] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T21:56:00.741048] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:56:00.741376] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-22T21:56:01.322053] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-22T21:56:01.532291] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:56:01.532622] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-22T21:56:02.122053] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-22T21:56:02.403395] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:56:02.403745] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-22T21:56:02.922055] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-22T21:56:03.722083] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-22T21:56:04.522042] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-22T21:56:04.568448] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T21:56:05.322077] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-22T21:56:05.786468] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-22T21:56:06.122294] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-22T21:56:06.266008] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-22T21:56:06.922075] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-22T21:56:07.005069] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T21:56:07.722108] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-22T21:56:07.995427] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-22T21:56:08.339254] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T21:56:08.342696] [INFO ] [REMOTE ] VIA: Full fetch complete (2012 records). [2025-09-22T21:56:08.342777] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-22T21:56:08.522240] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-22T21:56:08.566946] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 7 unique days, need 200 days [2025-09-22T21:56:08.567472] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:56:08.567579] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:56:08.567704] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-22T21:56:08.567801] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-22T21:56:08.567860] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-22T21:56:08.567922] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-22T21:56:08.568025] [INFO ] [MAIN ] Update Progress: 2227/2372 symbols completed. VIA took 28.5s. Estimated remaining: 19m 17s. Rate: 7.5 symbols/min [2025-09-22T21:56:08.767127] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:56:08.804189] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-22T21:56:08.871728] [DEBUG] [LOCAL ] VIRT: Loaded 47718 existing records from primary storage. [2025-09-22T21:56:08.871887] [INFO ] [MAIN ] VIRT: Loaded 47718 existing records. [2025-09-22T21:56:09.063930] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:56:09.064223] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-22T21:56:09.064281] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-22T21:56:09.065569] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-22T21:56:09.065681] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-22T21:56:09.327202] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-22T21:56:09.428635] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:56:10.122089] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-22T21:56:10.298173] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T21:56:10.922035] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-22T21:56:11.086172] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T21:56:11.639013] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-22T21:56:11.722046] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-22T21:56:12.522039] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-22T21:56:12.677627] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T21:56:12.944268] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-22T21:56:13.322068] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-22T21:56:14.122085] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-22T21:56:14.522799] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T21:56:14.690234] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T21:56:14.922092] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-22T21:56:15.678793] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T21:56:15.722017] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-22T21:56:16.522105] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-22T21:56:16.956702] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-22T21:56:17.322097] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-22T21:56:17.498844] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T21:56:18.045542] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T21:56:18.122040] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-22T21:56:18.922119] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-22T21:56:19.351699] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-22T21:56:19.707527] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T21:56:19.722014] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-22T21:56:20.522101] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-22T21:56:20.740161] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T21:56:21.322078] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-22T21:56:21.391314] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T21:56:21.992061] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T21:56:22.122046] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-22T21:56:22.922036] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-22T21:56:22.970225] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T21:56:23.633832] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T21:56:23.722095] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-22T21:56:24.522133] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-22T21:56:25.016859] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-22T21:56:25.258493] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T21:56:25.322058] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-22T21:56:26.133699] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-22T21:56:26.140291] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-22T21:56:26.922089] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-22T21:56:27.244131] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T21:56:27.722051] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-22T21:56:27.989848] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T21:56:28.409575] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T21:56:28.418258] [INFO ] [REMOTE ] VICI: Full fetch complete (77653 records). [2025-09-22T21:56:28.418411] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-22T21:56:28.522457] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-22T21:56:28.813777] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T21:56:28.865318] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-22T21:56:28.865461] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-22T21:56:28.866811] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-22T21:56:28.866899] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-22T21:56:28.868600] [DEBUG] [LOCAL ] VICI: Trimmed 77653 records to 53649 (keeping 200 days of data) [2025-09-22T21:56:29.205831] [DEBUG] [LOCAL ] VICI: Primary data saved (53649 records). [2025-09-22T21:56:29.206032] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-22T21:56:29.206239] [INFO ] [MAIN ] Update Progress: 2228/2372 symbols completed. VICI took 33.3s. Estimated remaining: 19m 10s. Rate: 7.5 symbols/min [2025-09-22T21:56:29.327210] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-22T21:56:29.393197] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:56:29.440624] [DEBUG] [LOCAL ] VIST: Loaded 46710 existing records from primary storage. [2025-09-22T21:56:29.440842] [INFO ] [MAIN ] VIST: Loaded 46710 existing records. [2025-09-22T21:56:29.625520] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:56:29.625828] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-22T21:56:29.625888] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-22T21:56:29.626996] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-22T21:56:29.627063] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-22T21:56:30.005282] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:56:30.127135] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-22T21:56:30.147564] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-22T21:56:30.922053] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-22T21:56:31.288557] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-22T21:56:31.727120] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-22T21:56:31.743281] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-22T21:56:32.522322] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-22T21:56:32.585684] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T21:56:33.322047] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-22T21:56:33.487179] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T21:56:34.122062] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-22T21:56:34.269800] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T21:56:34.781901] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T21:56:34.790182] [INFO ] [REMOTE ] VIRT: Full fetch complete (66826 records). [2025-09-22T21:56:34.790380] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-22T21:56:34.931849] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-22T21:56:35.223234] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-22T21:56:35.223382] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-22T21:56:35.224798] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-22T21:56:35.224961] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-22T21:56:35.233536] [DEBUG] [LOCAL ] VIRT: Trimmed 66826 records to 46913 (keeping 200 days of data) [2025-09-22T21:56:35.488033] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T21:56:35.513608] [INFO ] [REMOTE ] VIK: Full fetch complete (75849 records). [2025-09-22T21:56:35.515187] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-22T21:56:35.724365] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-22T21:56:36.042413] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-22T21:56:36.041110] [DEBUG] [LOCAL ] VIRT: Primary data saved (46913 records). [2025-09-22T21:56:36.042573] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-22T21:56:36.042718] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-22T21:56:36.046630] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-22T21:56:36.047120] [INFO ] [MAIN ] Update Progress: 2229/2372 symbols completed. VIRT took 27.5s. Estimated remaining: 19m 1s. Rate: 7.5 symbols/min [2025-09-22T21:56:36.047233] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-22T21:56:36.140634] [DEBUG] [LOCAL ] VIK: Trimmed 75849 records to 52512 (keeping 200 days of data) [2025-09-22T21:56:36.436824] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:56:36.690635] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T21:56:36.708871] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-22T21:56:36.747069] [DEBUG] [LOCAL ] VIV: Loaded 46060 existing records from primary storage. [2025-09-22T21:56:36.747500] [INFO ] [MAIN ] VIV: Loaded 46060 existing records. [2025-09-22T21:56:37.122855] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:56:37.124130] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-22T21:56:37.124202] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-22T21:56:37.125714] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-22T21:56:37.126148] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-22T21:56:37.203409] [DEBUG] [LOCAL ] VIK: Primary data saved (52512 records). [2025-09-22T21:56:37.215038] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-22T21:56:37.232301] [INFO ] [MAIN ] Update Progress: 2230/2372 symbols completed. VIK took 41.1s. Estimated remaining: 18m 53s. Rate: 7.5 symbols/min [2025-09-22T21:56:37.680149] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:56:37.736261] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:56:37.737631] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-22T21:56:37.766065] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-22T21:56:37.787405] [INFO ] [REMOTE ] VIPS: Full fetch complete (74609 records). [2025-09-22T21:56:37.787819] [DEBUG] [LOCAL ] VKQ: Loaded 17758 existing records from primary storage. [2025-09-22T21:56:37.788078] [INFO ] [MAIN ] VKQ: Loaded 17758 existing records. [2025-09-22T21:56:37.788019] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-22T21:56:38.158502] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:56:38.233004] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-22T21:56:38.241948] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-22T21:56:38.259416] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-22T21:56:38.281450] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-22T21:56:38.463316] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-22T21:56:38.468551] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-22T21:56:38.470019] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-22T21:56:38.488041] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-22T21:56:38.630050] [DEBUG] [LOCAL ] VIPS: Trimmed 74609 records to 51368 (keeping 200 days of data) [2025-09-22T21:56:38.699262] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-22T21:56:38.724198] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-22T21:56:38.883760] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:56:38.922038] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-22T21:56:39.046352] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T21:56:39.144893] [DEBUG] [LOCAL ] VIPS: Primary data saved (51368 records). [2025-09-22T21:56:39.145034] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-22T21:56:39.145133] [INFO ] [MAIN ] Update Progress: 2231/2372 symbols completed. VIPS took 41.6s. Estimated remaining: 18m 45s. Rate: 7.5 symbols/min [2025-09-22T21:56:39.314779] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:56:39.347238] [DEBUG] [LOCAL ] VLN: Loaded 28581 existing records from primary storage. [2025-09-22T21:56:39.347380] [INFO ] [MAIN ] VLN: Loaded 28581 existing records. [2025-09-22T21:56:39.535757] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:56:39.536064] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-22T21:56:39.536135] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-22T21:56:39.536793] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-22T21:56:39.536872] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-22T21:56:39.745404] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-22T21:56:39.895066] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:56:39.990536] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-22T21:56:40.301747] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:56:40.522119] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-22T21:56:40.940632] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-22T21:56:41.322087] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-22T21:56:42.047889] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-22T21:56:42.122086] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-22T21:56:42.207320] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T21:56:42.922064] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-22T21:56:43.434508] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-22T21:56:43.543239] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-22T21:56:43.722094] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-22T21:56:44.522068] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-22T21:56:45.238246] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T21:56:45.322012] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-22T21:56:45.506568] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-22T21:56:46.122072] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-22T21:56:46.397226] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T21:56:46.922141] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-22T21:56:47.722050] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-22T21:56:47.799924] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T21:56:47.913423] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-22T21:56:48.522078] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-22T21:56:48.760343] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T21:56:49.322065] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-22T21:56:49.876202] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T21:56:50.122082] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-22T21:56:50.850206] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T21:56:50.922011] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-22T21:56:51.727256] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-22T21:56:51.745781] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T21:56:52.522088] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-22T21:56:52.567027] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T21:56:52.956780] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T21:56:53.322063] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-22T21:56:54.042237] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T21:56:54.122130] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-22T21:56:54.490940] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-22T21:56:54.922092] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-22T21:56:55.291486] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T21:56:55.722067] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-22T21:56:56.527688] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-22T21:56:56.532967] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-22T21:56:56.541825] [INFO ] [REMOTE ] VIST: Full fetch complete (66796 records). [2025-09-22T21:56:56.541955] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-22T21:56:56.716023] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-22T21:56:56.962853] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-22T21:56:56.962967] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-22T21:56:56.964267] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-22T21:56:56.964338] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-22T21:56:56.965945] [DEBUG] [LOCAL ] VIST: Trimmed 66796 records to 45968 (keeping 200 days of data) [2025-09-22T21:56:57.247895] [DEBUG] [LOCAL ] VIST: Primary data saved (45968 records). [2025-09-22T21:56:57.248033] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-22T21:56:57.248120] [INFO ] [MAIN ] Update Progress: 2232/2372 symbols completed. VIST took 28.0s. Estimated remaining: 18m 37s. Rate: 7.5 symbols/min [2025-09-22T21:56:57.327146] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-22T21:56:57.447816] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:56:57.507788] [DEBUG] [LOCAL ] VLO: Loaded 53871 existing records from primary storage. [2025-09-22T21:56:57.507934] [INFO ] [MAIN ] VLO: Loaded 53871 existing records. [2025-09-22T21:56:57.695258] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:56:57.695534] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-22T21:56:57.695588] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-22T21:56:57.696878] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-22T21:56:57.696938] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-22T21:56:58.073527] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:56:58.109213] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T21:56:58.121997] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-22T21:56:58.191512] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T21:56:58.922083] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-22T21:56:59.637485] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T21:56:59.722029] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-22T21:56:59.926478] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T21:57:00.522056] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-22T21:57:01.322049] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-22T21:57:01.510258] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-22T21:57:01.980055] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T21:57:02.122028] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-22T21:57:02.922124] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-22T21:57:03.494572] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-22T21:57:03.722091] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-22T21:57:04.522135] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-22T21:57:05.054741] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-09-22T21:57:05.322086] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-22T21:57:05.767590] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-09-22T21:57:05.774682] [INFO ] [REMOTE ] VIV: Full fetch complete (64812 records). [2025-09-22T21:57:05.774818] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-22T21:57:06.208693] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-22T21:57:06.210513] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T21:57:06.209813] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-22T21:57:06.215666] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-22T21:57:06.216472] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-22T21:57:06.216715] [INFO ] [REMOTE ] VKQ: Full fetch complete (24502 records). [2025-09-22T21:57:06.217179] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-22T21:57:06.303911] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-22T21:57:06.322379] [DEBUG] [LOCAL ] VIV: Trimmed 64812 records to 45285 (keeping 200 days of data) [2025-09-22T21:57:06.364357] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-22T21:57:06.778520] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-22T21:57:06.778973] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-22T21:57:06.768617] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (3.05 seconds). [2025-09-22T21:57:06.779817] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-22T21:57:06.781305] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-22T21:57:06.795605] [DEBUG] [LOCAL ] VKQ: Trimmed 24502 records to 17382 (keeping 200 days of data) [2025-09-22T21:57:06.908937] [DEBUG] [LOCAL ] VKQ: Primary data saved (17382 records). [2025-09-22T21:57:06.909624] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-22T21:57:06.910075] [INFO ] [MAIN ] Update Progress: 2233/2372 symbols completed. VKQ took 29.7s. Estimated remaining: 18m 29s. Rate: 7.5 symbols/min [2025-09-22T21:57:06.932479] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-22T21:57:07.189148] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:57:07.241100] [DEBUG] [LOCAL ] VLRS: Loaded 41690 existing records from primary storage. [2025-09-22T21:57:07.242360] [INFO ] [MAIN ] VLRS: Loaded 41690 existing records. [2025-09-22T21:57:07.436156] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:57:07.459437] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-22T21:57:07.459730] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-22T21:57:07.461759] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-22T21:57:07.462118] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-22T21:57:07.636067] [DEBUG] [LOCAL ] VIV: Primary data saved (45285 records). [2025-09-22T21:57:07.653511] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-22T21:57:07.653745] [INFO ] [MAIN ] Update Progress: 2234/2372 symbols completed. VIV took 31.6s. Estimated remaining: 18m 21s. Rate: 7.5 symbols/min [2025-09-22T21:57:07.989464] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:57:08.021604] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:57:08.036053] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-22T21:57:08.038431] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T21:57:08.045534] [INFO ] [REMOTE ] VLN: Full fetch complete (43504 records). [2025-09-22T21:57:08.045694] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-22T21:57:08.084746] [DEBUG] [LOCAL ] VLT: Loaded 4756 existing records from primary storage. [2025-09-22T21:57:08.113155] [INFO ] [MAIN ] VLT: Loaded 4756 existing records. [2025-09-22T21:57:08.517491] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:57:08.536043] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-22T21:57:08.536168] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-22T21:57:08.547478] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-22T21:57:08.557915] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-22T21:57:08.641908] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-22T21:57:08.668440] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-22T21:57:08.699709] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-22T21:57:08.712171] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-22T21:57:08.743401] [DEBUG] [LOCAL ] VLN: Trimmed 43504 records to 28348 (keeping 200 days of data) [2025-09-22T21:57:09.156750] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:57:09.169360] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-22T21:57:09.220543] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-22T21:57:09.218938] [DEBUG] [LOCAL ] VLN: Primary data saved (28348 records). [2025-09-22T21:57:09.231084] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-22T21:57:09.231700] [INFO ] [MAIN ] Update Progress: 2235/2372 symbols completed. VLN took 30.1s. Estimated remaining: 18m 13s. Rate: 7.5 symbols/min [2025-09-22T21:57:09.327277] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-22T21:57:09.420402] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:57:09.469279] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-22T21:57:09.492444] [DEBUG] [LOCAL ] VLTO: Loaded 46744 existing records from primary storage. [2025-09-22T21:57:09.492601] [INFO ] [MAIN ] VLTO: Loaded 46744 existing records. [2025-09-22T21:57:09.677826] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:57:09.678075] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-22T21:57:09.678123] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-22T21:57:09.679202] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-22T21:57:09.679262] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-22T21:57:09.803851] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-22T21:57:10.050521] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:57:10.122007] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-22T21:57:10.922019] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-22T21:57:11.004575] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T21:57:11.359441] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T21:57:11.420905] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-22T21:57:11.722072] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-22T21:57:12.456806] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-22T21:57:12.522008] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-22T21:57:13.322005] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-22T21:57:13.489582] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T21:57:14.122063] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-22T21:57:14.922068] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-22T21:57:15.278329] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-22T21:57:15.722077] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-22T21:57:16.119567] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-09-22T21:57:16.137348] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-22T21:57:16.522015] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-22T21:57:16.620799] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T21:57:17.322045] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-22T21:57:17.668578] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T21:57:17.897877] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T21:57:18.122076] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-22T21:57:18.922063] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-22T21:57:19.495016] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-22T21:57:19.722066] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-22T21:57:19.914614] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T21:57:20.522075] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-22T21:57:21.120758] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-22T21:57:21.329736] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-22T21:57:21.351988] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T21:57:21.943538] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T21:57:21.945002] [INFO ] [REMOTE ] VLT: Full fetch complete (7512 records). [2025-09-22T21:57:21.945078] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-22T21:57:22.127214] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-22T21:57:22.326015] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-22T21:57:22.326092] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-22T21:57:22.326279] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-22T21:57:22.326317] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-22T21:57:22.326739] [DEBUG] [LOCAL ] VLT: Trimmed 7512 records to 4646 (keeping 200 days of data) [2025-09-22T21:57:22.354927] [DEBUG] [LOCAL ] VLT: Primary data saved (4646 records). [2025-09-22T21:57:22.355054] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-22T21:57:22.355144] [INFO ] [MAIN ] Update Progress: 2236/2372 symbols completed. VLT took 14.7s. Estimated remaining: 18m 5s. Rate: 7.5 symbols/min [2025-09-22T21:57:22.539318] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:57:22.586840] [DEBUG] [LOCAL ] VMC: Loaded 44671 existing records from primary storage. [2025-09-22T21:57:22.587019] [INFO ] [MAIN ] VMC: Loaded 44671 existing records. [2025-09-22T21:57:22.768415] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:57:22.768740] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-22T21:57:22.768812] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-22T21:57:22.769781] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-22T21:57:22.769844] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-22T21:57:22.928563] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-22T21:57:23.135614] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:57:23.689119] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T21:57:23.722005] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-22T21:57:24.522077] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-22T21:57:25.282989] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-22T21:57:25.322098] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-22T21:57:25.489166] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-22T21:57:26.122016] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-22T21:57:26.307859] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T21:57:26.922033] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-22T21:57:27.026002] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T21:57:27.699219] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T21:57:27.722006] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-22T21:57:28.510628] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T21:57:28.522164] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-22T21:57:29.145828] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T21:57:29.322071] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-22T21:57:30.044163] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T21:57:30.122180] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-22T21:57:30.922069] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-22T21:57:31.153613] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T21:57:31.640069] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T21:57:31.722048] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-22T21:57:32.522113] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-22T21:57:32.552183] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T21:57:33.121943] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T21:57:33.322098] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-22T21:57:34.122029] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-22T21:57:34.527572] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-22T21:57:34.922030] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-22T21:57:35.164822] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-22T21:57:35.722081] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-22T21:57:35.867768] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T21:57:36.102566] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T21:57:36.108258] [INFO ] [REMOTE ] VLRS: Full fetch complete (58904 records). [2025-09-22T21:57:36.108364] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-22T21:57:36.492373] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-22T21:57:36.492465] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-22T21:57:36.493520] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-22T21:57:36.493600] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-22T21:57:36.494956] [DEBUG] [LOCAL ] VLRS: Trimmed 58904 records to 40969 (keeping 200 days of data) [2025-09-22T21:57:36.540466] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-22T21:57:36.732605] [DEBUG] [LOCAL ] VLRS: Primary data saved (40969 records). [2025-09-22T21:57:36.732779] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-22T21:57:36.732870] [INFO ] [MAIN ] Update Progress: 2237/2372 symbols completed. VLRS took 29.8s. Estimated remaining: 17m 57s. Rate: 7.5 symbols/min [2025-09-22T21:57:37.322035] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-22T21:57:37.499178] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-22T21:57:38.122075] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-22T21:57:38.445267] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-22T21:57:38.922030] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-22T21:57:39.215699] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-22T21:57:39.722059] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-22T21:57:39.810263] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-22T21:57:40.124325] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T21:57:40.522082] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-22T21:57:40.574182] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-22T21:57:40.582487] [INFO ] [REMOTE ] VLO: Full fetch complete (76926 records). [2025-09-22T21:57:40.582608] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-22T21:57:40.994033] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-22T21:57:40.994113] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-22T21:57:40.995282] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-22T21:57:40.995348] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-22T21:57:40.996934] [DEBUG] [LOCAL ] VLO: Trimmed 76926 records to 53088 (keeping 200 days of data) [2025-09-22T21:57:41.322128] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-22T21:57:41.345084] [DEBUG] [LOCAL ] VLO: Primary data saved (53088 records). [2025-09-22T21:57:41.345236] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-22T21:57:41.345328] [INFO ] [MAIN ] Update Progress: 2238/2372 symbols completed. VLO took 44.1s. Estimated remaining: 17m 49s. Rate: 7.5 symbols/min [2025-09-22T21:57:42.101788] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T21:57:42.122053] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-22T21:57:42.924500] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-22T21:57:42.934984] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-22T21:57:43.799091] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T21:57:43.808764] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-22T21:57:44.515187] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T21:57:44.526497] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-22T21:57:45.215558] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T21:57:45.223870] [INFO ] [REMOTE ] VLTO: Full fetch complete (66711 records). [2025-09-22T21:57:45.224047] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-22T21:57:45.638633] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T21:57:45.699091] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-22T21:57:45.699604] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-22T21:57:45.699786] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-22T21:57:45.703227] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-22T21:57:45.703464] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-22T21:57:45.705735] [DEBUG] [LOCAL ] VLTO: Trimmed 66711 records to 46032 (keeping 200 days of data) [2025-09-22T21:57:46.029987] [DEBUG] [LOCAL ] VLTO: Primary data saved (46032 records). [2025-09-22T21:57:46.030309] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-22T21:57:46.030438] [INFO ] [MAIN ] Update Progress: 2239/2372 symbols completed. VLTO took 36.8s. Estimated remaining: 17m 41s. Rate: 7.5 symbols/min [2025-09-22T21:57:46.359718] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-22T21:57:46.365896] [INFO ] [REMOTE ] VMC: Full fetch complete (62585 records). [2025-09-22T21:57:46.366005] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-22T21:57:46.774574] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-22T21:57:46.774689] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-22T21:57:46.775858] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-22T21:57:46.775922] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-22T21:57:46.777416] [DEBUG] [LOCAL ] VMC: Trimmed 62585 records to 43852 (keeping 200 days of data) [2025-09-22T21:57:47.058124] [DEBUG] [LOCAL ] VMC: Primary data saved (43852 records). [2025-09-22T21:57:47.058292] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-22T21:57:47.059521] [INFO ] [MAIN ] Update Progress: 2240/2372 symbols completed. VMC took 24.7s. Estimated remaining: 17m 33s. Rate: 7.5 symbols/min [2025-09-22T21:57:47.729690] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:57:47.744007] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:57:47.823397] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:57:47.845554] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:57:47.858590] [DEBUG] [LOCAL ] VNCE: Loaded 6697 existing records from primary storage. [2025-09-22T21:57:47.858827] [INFO ] [MAIN ] VNCE: Loaded 6697 existing records. [2025-09-22T21:57:47.947507] [DEBUG] [LOCAL ] VMI: Loaded 15739 existing records from primary storage. [2025-09-22T21:57:47.972755] [DEBUG] [LOCAL ] VMO: Loaded 21300 existing records from primary storage. [2025-09-22T21:57:48.007229] [INFO ] [MAIN ] VMO: Loaded 21300 existing records. [2025-09-22T21:57:47.966844] [INFO ] [MAIN ] VMI: Loaded 15739 existing records. [2025-09-22T21:57:48.311298] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:57:48.342176] [DEBUG] [LOCAL ] VNO: Loaded 49719 existing records from primary storage. [2025-09-22T21:57:48.378115] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-22T21:57:48.378019] [INFO ] [MAIN ] VNO: Loaded 49719 existing records. [2025-09-22T21:57:48.431425] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-22T21:57:48.488269] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-22T21:57:48.510705] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-22T21:57:48.566280] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:57:48.586669] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:57:48.615185] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-22T21:57:48.615572] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-22T21:57:48.615776] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-22T21:57:48.615721] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-22T21:57:48.626180] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-22T21:57:48.639293] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-22T21:57:48.644689] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-22T21:57:48.649929] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-22T21:57:49.117799] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:57:49.353373] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-22T21:57:49.391443] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-22T21:57:49.439450] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-22T21:57:49.491273] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-22T21:57:49.774231] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:57:49.828090] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-22T21:57:49.804741] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:57:49.860818] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-22T21:57:50.120152] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:57:50.130948] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-22T21:57:50.249977] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:57:50.250361] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-22T21:57:50.866180] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-22T21:57:50.870093] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-22T21:57:50.960119] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-22T21:57:50.964589] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-22T21:57:51.021602] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-22T21:57:51.026940] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-22T21:57:51.783421] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-22T21:57:51.786919] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-22T21:57:51.983062] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T21:57:52.029780] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T21:57:52.084211] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-22T21:57:52.522053] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-22T21:57:52.752377] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-22T21:57:53.322052] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-22T21:57:53.460237] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T21:57:54.122073] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-22T21:57:54.926190] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-22T21:57:54.929169] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T21:57:55.241610] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T21:57:55.551529] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T21:57:55.722108] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-22T21:57:56.317783] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-22T21:57:56.522096] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-22T21:57:57.188038] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-22T21:57:57.322037] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-22T21:57:58.093889] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T21:57:58.122099] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-22T21:57:58.922059] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-22T21:57:59.541985] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-22T21:57:59.722165] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-22T21:57:59.773482] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T21:58:00.522076] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-22T21:58:01.020354] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-22T21:58:01.322130] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-22T21:58:02.098947] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-22T21:58:02.122103] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-22T21:58:02.533191] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T21:58:02.922149] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-22T21:58:03.722042] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-22T21:58:03.787699] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-22T21:58:03.808535] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-22T21:58:04.362808] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T21:58:04.522060] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-22T21:58:05.322087] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-22T21:58:06.122078] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-22T21:58:06.177002] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T21:58:06.413679] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-22T21:58:06.922141] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-22T21:58:07.121964] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-22T21:58:07.125975] [INFO ] [REMOTE ] VNCE: Full fetch complete (14822 records). [2025-09-22T21:58:07.126052] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-22T21:58:07.488845] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-22T21:58:07.488932] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-22T21:58:07.489290] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-22T21:58:07.489330] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-22T21:58:07.489912] [DEBUG] [LOCAL ] VNCE: Trimmed 14822 records to 6885 (keeping 200 days of data) [2025-09-22T21:58:07.532528] [DEBUG] [LOCAL ] VNCE: Primary data saved (6885 records). [2025-09-22T21:58:07.532710] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-22T21:58:07.532832] [INFO ] [MAIN ] Update Progress: 2241/2372 symbols completed. VNCE took 20.5s. Estimated remaining: 17m 25s. Rate: 7.5 symbols/min [2025-09-22T21:58:07.709971] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:58:07.722089] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-22T21:58:07.754010] [DEBUG] [LOCAL ] VNT: Loaded 44922 existing records from primary storage. [2025-09-22T21:58:07.754163] [INFO ] [MAIN ] VNT: Loaded 44922 existing records. [2025-09-22T21:58:07.948246] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T21:58:07.953795] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:58:07.959759] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-22T21:58:07.960021] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-22T21:58:07.961168] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-22T21:58:07.961235] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-22T21:58:08.333190] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:58:08.522057] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-22T21:58:08.773239] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T21:58:09.322059] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-22T21:58:10.029900] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-22T21:58:10.122050] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-22T21:58:10.488448] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-22T21:58:10.922090] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-22T21:58:11.722072] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-22T21:58:11.893571] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-22T21:58:11.966926] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-22T21:58:12.522131] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-22T21:58:13.112370] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T21:58:13.322064] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-22T21:58:13.681536] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T21:58:13.686247] [INFO ] [REMOTE ] VMO: Full fetch complete (31499 records). [2025-09-22T21:58:13.686347] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-22T21:58:14.080427] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-22T21:58:14.080504] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-22T21:58:14.081249] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-22T21:58:14.081316] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-22T21:58:14.082104] [DEBUG] [LOCAL ] VMO: Trimmed 31499 records to 21015 (keeping 200 days of data) [2025-09-22T21:58:14.133613] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-22T21:58:14.209429] [DEBUG] [LOCAL ] VMO: Primary data saved (21015 records). [2025-09-22T21:58:14.209554] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-22T21:58:14.209635] [INFO ] [MAIN ] Update Progress: 2242/2372 symbols completed. VMO took 27.1s. Estimated remaining: 17m 17s. Rate: 7.5 symbols/min [2025-09-22T21:58:14.385536] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:58:14.395802] [DEBUG] [LOCAL ] VOC: Loaded 9108 existing records from primary storage. [2025-09-22T21:58:14.395910] [INFO ] [MAIN ] VOC: Loaded 9108 existing records. [2025-09-22T21:58:14.584790] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:58:14.585358] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-22T21:58:14.585419] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-22T21:58:14.585787] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-22T21:58:14.585851] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-22T21:58:14.931026] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-22T21:58:14.963501] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:58:14.987775] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T21:58:15.139297] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T21:58:15.722084] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-22T21:58:16.273938] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-22T21:58:16.522081] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-22T21:58:16.692085] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T21:58:17.322089] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-22T21:58:17.352135] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T21:58:18.122054] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-22T21:58:18.345900] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T21:58:18.922044] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-22T21:58:18.935540] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-22T21:58:19.722123] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-22T21:58:20.525036] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-22T21:58:20.539150] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-22T21:58:20.544176] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-22T21:58:21.322077] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-22T21:58:22.132112] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-22T21:58:22.171380] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-22T21:58:22.176160] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-22T21:58:22.922123] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-22T21:58:23.586263] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T21:58:23.595817] [INFO ] [REMOTE ] VNO: Full fetch complete (70459 records). [2025-09-22T21:58:23.596027] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-22T21:58:23.727502] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-22T21:58:24.207510] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-22T21:58:24.207675] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-22T21:58:24.210092] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-22T21:58:24.210219] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-22T21:58:24.212594] [DEBUG] [LOCAL ] VNO: Trimmed 70459 records to 48973 (keeping 200 days of data) [2025-09-22T21:58:24.500304] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:58:24.522051] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-22T21:58:24.592247] [DEBUG] [LOCAL ] VNO: Primary data saved (48973 records). [2025-09-22T21:58:24.592417] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-22T21:58:24.592512] [INFO ] [MAIN ] Update Progress: 2243/2372 symbols completed. VNO took 37.5s. Estimated remaining: 17m 10s. Rate: 7.5 symbols/min [2025-09-22T21:58:24.796134] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:58:24.809736] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T21:58:24.857130] [DEBUG] [LOCAL ] VOYA: Loaded 43581 existing records from primary storage. [2025-09-22T21:58:24.857321] [INFO ] [MAIN ] VOYA: Loaded 43581 existing records. [2025-09-22T21:58:25.047629] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:58:25.047984] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-22T21:58:25.048055] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-22T21:58:25.049447] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-22T21:58:25.049526] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-22T21:58:25.327727] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-22T21:58:25.422144] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:58:25.978668] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-22T21:58:25.999079] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-22T21:58:26.122064] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-22T21:58:26.922060] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-22T21:58:27.630758] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T21:58:27.722053] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-22T21:58:27.827466] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T21:58:27.830474] [INFO ] [REMOTE ] VMI: Full fetch complete (21125 records). [2025-09-22T21:58:27.830572] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-22T21:58:28.201854] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-22T21:58:28.201939] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-22T21:58:28.202401] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-22T21:58:28.202442] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-22T21:58:28.203692] [DEBUG] [LOCAL ] VMI: Trimmed 21125 records to 15479 (keeping 200 days of data) [2025-09-22T21:58:28.303479] [DEBUG] [LOCAL ] VMI: Primary data saved (15479 records). [2025-09-22T21:58:28.303615] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-22T21:58:28.303727] [INFO ] [MAIN ] Update Progress: 2244/2372 symbols completed. VMI took 41.2s. Estimated remaining: 17m 1s. Rate: 7.5 symbols/min [2025-09-22T21:58:28.473524] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:58:28.473743] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-22T21:58:28.473788] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-22T21:58:28.473927] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-22T21:58:28.473967] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-22T21:58:28.474025] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-22T21:58:28.474086] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-22T21:58:28.528596] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-22T21:58:28.833533] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:58:29.322057] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-22T21:58:29.390442] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-22T21:58:29.674433] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:58:29.674872] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-22T21:58:30.072206] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-22T21:58:30.122027] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-22T21:58:30.922052] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-22T21:58:31.708427] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T21:58:31.722004] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-22T21:58:32.470380] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T21:58:32.522045] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-09-22T21:58:32.781147] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:58:32.781485] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-09-22T21:58:33.168225] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T21:58:33.322066] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-22T21:58:34.122088] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-22T21:58:34.327421] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:58:34.327792] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-22T21:58:34.743525] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T21:58:34.752309] [INFO ] [REMOTE ] VNT: Full fetch complete (63522 records). [2025-09-22T21:58:34.752451] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-22T21:58:34.924536] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-22T21:58:35.169904] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-22T21:58:35.169995] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-22T21:58:35.171249] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-22T21:58:35.171318] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-22T21:58:35.172802] [DEBUG] [LOCAL ] VNT: Trimmed 63522 records to 44081 (keeping 200 days of data) [2025-09-22T21:58:35.239755] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:58:35.267807] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-22T21:58:35.461898] [DEBUG] [LOCAL ] VNT: Primary data saved (44081 records). [2025-09-22T21:58:35.462040] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-22T21:58:35.462129] [INFO ] [MAIN ] Update Progress: 2245/2372 symbols completed. VNT took 27.9s. Estimated remaining: 16m 53s. Rate: 7.5 symbols/min [2025-09-22T21:58:35.667471] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:58:35.688502] [DEBUG] [LOCAL ] VPG: Loaded 17438 existing records from primary storage. [2025-09-22T21:58:35.688637] [INFO ] [MAIN ] VPG: Loaded 17438 existing records. [2025-09-22T21:58:35.727142] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-22T21:58:35.890923] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:58:35.891166] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-22T21:58:35.891214] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-22T21:58:35.891854] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-22T21:58:35.891914] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-22T21:58:36.006974] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:58:36.022739] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-22T21:58:36.247298] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:58:36.522024] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-22T21:58:37.322037] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-22T21:58:37.403522] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T21:58:37.532358] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T21:58:37.532715] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-22T21:58:38.122061] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-22T21:58:38.896233] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-22T21:58:38.922064] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-22T21:58:39.722107] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-22T21:58:39.768719] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-22T21:58:40.522097] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-22T21:58:41.232059] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-22T21:58:41.322027] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-22T21:58:41.402019] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-22T21:58:42.122053] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-22T21:58:42.257725] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-22T21:58:42.922057] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-22T21:58:43.722075] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-22T21:58:43.747767] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-22T21:58:43.923252] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-22T21:58:44.522107] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-22T21:58:45.322026] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-22T21:58:45.392174] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T21:58:45.394074] [INFO ] [REMOTE ] VOC: Full fetch complete (13217 records). [2025-09-22T21:58:45.394147] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-22T21:58:45.642143] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-22T21:58:45.801535] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-22T21:58:45.801612] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-22T21:58:45.801921] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-22T21:58:45.801979] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-22T21:58:45.802483] [DEBUG] [LOCAL ] VOC: Trimmed 13217 records to 8930 (keeping 200 days of data) [2025-09-22T21:58:45.854937] [DEBUG] [LOCAL ] VOC: Primary data saved (8930 records). [2025-09-22T21:58:45.855068] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-22T21:58:45.855166] [INFO ] [MAIN ] Update Progress: 2246/2372 symbols completed. VOC took 31.6s. Estimated remaining: 16m 45s. Rate: 7.5 symbols/min [2025-09-22T21:58:46.029142] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:58:46.037702] [DEBUG] [LOCAL ] VPV: Loaded 5457 existing records from primary storage. [2025-09-22T21:58:46.037900] [INFO ] [MAIN ] VPV: Loaded 5457 existing records. [2025-09-22T21:58:46.129078] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-22T21:58:46.220085] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:58:46.220787] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-22T21:58:46.220854] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-22T21:58:46.221231] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-22T21:58:46.221290] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-22T21:58:46.585321] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:58:46.922032] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-22T21:58:47.024696] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-22T21:58:47.464152] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T21:58:47.722034] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-22T21:58:47.766380] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-22T21:58:48.522077] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-22T21:58:49.221168] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-22T21:58:49.322069] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-22T21:58:49.488978] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-22T21:58:50.053006] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-22T21:58:50.122058] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-22T21:58:50.922082] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-22T21:58:51.303805] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-22T21:58:51.704386] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-22T21:58:51.722013] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-22T21:58:52.510152] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-22T21:58:52.522020] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-22T21:58:53.137502] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T21:58:53.322101] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-22T21:58:54.113838] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-22T21:58:54.121993] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-22T21:58:54.702026] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-22T21:58:54.922223] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-22T21:58:55.722082] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-22T21:58:56.435317] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-22T21:58:56.458732] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T21:58:56.465745] [INFO ] [REMOTE ] VOYG: Full fetch complete (23358 records). [2025-09-22T21:58:56.465863] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-22T21:58:56.529052] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-22T21:58:56.667402] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-22T21:58:56.667798] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T21:58:56.667886] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T21:58:56.668005] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-22T21:58:56.668100] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-22T21:58:56.668159] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-22T21:58:56.668217] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-22T21:58:56.668336] [INFO ] [MAIN ] Update Progress: 2247/2372 symbols completed. VOYG took 28.4s. Estimated remaining: 16m 38s. Rate: 7.5 symbols/min [2025-09-22T21:58:56.839625] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:58:56.890043] [DEBUG] [LOCAL ] VRE: Loaded 35333 existing records from primary storage. [2025-09-22T21:58:56.890191] [INFO ] [MAIN ] VRE: Loaded 35333 existing records. [2025-09-22T21:58:57.072835] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:58:57.073089] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-22T21:58:57.073137] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-22T21:58:57.074366] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-22T21:58:57.074426] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-22T21:58:57.330437] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-22T21:58:57.455308] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:58:58.122032] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-22T21:58:58.131012] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-22T21:58:58.163525] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T21:58:58.922069] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-22T21:58:59.496607] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-22T21:58:59.527061] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-22T21:58:59.722064] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-22T21:59:00.333822] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-22T21:59:00.335435] [INFO ] [REMOTE ] VPV: Full fetch complete (9408 records). [2025-09-22T21:59:00.335564] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-22T21:59:00.527729] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-22T21:59:00.719158] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-22T21:59:00.719241] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-22T21:59:00.719482] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-22T21:59:00.719584] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-22T21:59:00.720981] [DEBUG] [LOCAL ] VPV: Trimmed 9408 records to 5379 (keeping 200 days of data) [2025-09-22T21:59:00.754721] [DEBUG] [LOCAL ] VPV: Primary data saved (5379 records). [2025-09-22T21:59:00.754807] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-22T21:59:00.754968] [INFO ] [MAIN ] Update Progress: 2248/2372 symbols completed. VPV took 14.9s. Estimated remaining: 16m 29s. Rate: 7.5 symbols/min [2025-09-22T21:59:00.927937] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:59:00.999630] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-22T21:59:00.999827] [INFO ] [MAIN ] VRT: Loaded 54533 existing records. [2025-09-22T21:59:01.194309] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:59:01.194636] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-22T21:59:01.194718] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-22T21:59:01.196219] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-22T21:59:01.196357] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-22T21:59:01.327117] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-22T21:59:01.591431] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:59:01.613141] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T21:59:02.122081] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-22T21:59:02.456310] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T21:59:02.922122] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-22T21:59:03.239776] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T21:59:03.722058] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-22T21:59:04.522082] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-22T21:59:05.088921] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T21:59:05.296977] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T21:59:05.322017] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-22T21:59:05.383675] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-22T21:59:06.122100] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-22T21:59:06.293589] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-22T21:59:06.922062] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-22T21:59:07.683478] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T21:59:07.722023] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-22T21:59:07.862766] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-22T21:59:08.522057] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-22T21:59:09.226305] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T21:59:09.243031] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-22T21:59:09.246282] [INFO ] [REMOTE ] VPG: Full fetch complete (23146 records). [2025-09-22T21:59:09.246400] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-22T21:59:09.327157] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-22T21:59:09.644896] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-22T21:59:09.644973] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-22T21:59:09.645442] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-22T21:59:09.645503] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-22T21:59:09.646170] [DEBUG] [LOCAL ] VPG: Trimmed 23146 records to 17204 (keeping 200 days of data) [2025-09-22T21:59:09.757379] [DEBUG] [LOCAL ] VPG: Primary data saved (17204 records). [2025-09-22T21:59:09.757520] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-22T21:59:09.757666] [INFO ] [MAIN ] Update Progress: 2249/2372 symbols completed. VPG took 34.3s. Estimated remaining: 16m 21s. Rate: 7.5 symbols/min [2025-09-22T21:59:09.932617] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:59:09.950381] [DEBUG] [LOCAL ] VRTS: Loaded 9146 existing records from primary storage. [2025-09-22T21:59:09.950500] [INFO ] [MAIN ] VRTS: Loaded 9146 existing records. [2025-09-22T21:59:10.129450] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-22T21:59:10.129387] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:59:10.130105] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-22T21:59:10.130825] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-22T21:59:10.131455] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-22T21:59:10.131546] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-22T21:59:10.503392] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:59:10.922052] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-22T21:59:11.607192] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-22T21:59:11.685061] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T21:59:11.693500] [INFO ] [REMOTE ] VOYA: Full fetch complete (62066 records). [2025-09-22T21:59:11.693680] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-22T21:59:11.726190] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-22T21:59:12.085817] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-22T21:59:12.179852] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-22T21:59:12.179944] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-22T21:59:12.181062] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-22T21:59:12.181126] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-22T21:59:12.184755] [DEBUG] [LOCAL ] VOYA: Trimmed 62066 records to 42881 (keeping 200 days of data) [2025-09-22T21:59:12.475319] [DEBUG] [LOCAL ] VOYA: Primary data saved (42881 records). [2025-09-22T21:59:12.475468] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-22T21:59:12.475629] [INFO ] [MAIN ] Update Progress: 2250/2372 symbols completed. VOYA took 47.9s. Estimated remaining: 16m 13s. Rate: 7.5 symbols/min [2025-09-22T21:59:12.531911] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-22T21:59:12.657414] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:59:12.715310] [DEBUG] [LOCAL ] VSCO: Loaded 53670 existing records from primary storage. [2025-09-22T21:59:12.715508] [INFO ] [MAIN ] VSCO: Loaded 53670 existing records. [2025-09-22T21:59:12.901877] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:59:12.902138] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-22T21:59:12.902186] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-22T21:59:12.903975] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-22T21:59:12.904038] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-22T21:59:13.268930] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:59:13.327485] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-22T21:59:13.344024] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T21:59:14.122061] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-22T21:59:14.922128] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-22T21:59:15.018797] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-22T21:59:15.182099] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-22T21:59:15.285461] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T21:59:15.642860] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-22T21:59:15.722015] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-22T21:59:16.433968] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-22T21:59:16.522100] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-22T21:59:17.322047] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-22T21:59:18.122054] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-22T21:59:18.922025] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-22T21:59:18.999375] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T21:59:19.030371] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-22T21:59:19.450127] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-22T21:59:19.512506] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-22T21:59:19.722058] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-22T21:59:20.522077] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-22T21:59:21.322063] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-22T21:59:22.043241] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T21:59:22.082455] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-22T21:59:22.122038] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-22T21:59:22.177625] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-22T21:59:22.755233] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-22T21:59:22.922068] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-22T21:59:23.722082] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-22T21:59:24.160525] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-22T21:59:24.522065] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-22T21:59:25.322029] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-22T21:59:25.397320] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-22T21:59:25.989866] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T21:59:25.997179] [INFO ] [REMOTE ] VRE: Full fetch complete (47850 records). [2025-09-22T21:59:25.997323] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-22T21:59:26.127186] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-22T21:59:26.378467] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-22T21:59:26.378545] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-22T21:59:26.379501] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-22T21:59:26.379564] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-22T21:59:26.380615] [DEBUG] [LOCAL ] VRE: Trimmed 47850 records to 34931 (keeping 200 days of data) [2025-09-22T21:59:26.599263] [DEBUG] [LOCAL ] VRE: Primary data saved (34931 records). [2025-09-22T21:59:26.599448] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-22T21:59:26.599587] [INFO ] [MAIN ] Update Progress: 2251/2372 symbols completed. VRE took 29.9s. Estimated remaining: 16m 6s. Rate: 7.5 symbols/min [2025-09-22T21:59:26.774894] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:59:26.826338] [DEBUG] [LOCAL ] VSH: Loaded 49479 existing records from primary storage. [2025-09-22T21:59:26.826497] [INFO ] [MAIN ] VSH: Loaded 49479 existing records. [2025-09-22T21:59:26.929036] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-22T21:59:27.014112] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:59:27.014409] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-22T21:59:27.014470] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-22T21:59:27.016192] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-22T21:59:27.016253] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-22T21:59:27.284069] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T21:59:27.398299] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:59:27.722028] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-22T21:59:27.967693] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-22T21:59:28.522042] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-22T21:59:28.894755] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-22T21:59:29.322027] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-22T21:59:29.358234] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T21:59:29.492923] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T21:59:30.122065] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-22T21:59:30.917795] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T21:59:30.921992] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-22T21:59:31.499885] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-22T21:59:31.630513] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T21:59:31.632188] [INFO ] [REMOTE ] VRTS: Full fetch complete (11141 records). [2025-09-22T21:59:31.632257] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-22T21:59:31.727234] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-22T21:59:32.003401] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-22T21:59:32.003485] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-22T21:59:32.003807] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-22T21:59:32.003893] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-22T21:59:32.004490] [DEBUG] [LOCAL ] VRTS: Trimmed 11141 records to 9065 (keeping 200 days of data) [2025-09-22T21:59:32.067229] [DEBUG] [LOCAL ] VRTS: Primary data saved (9065 records). [2025-09-22T21:59:32.067381] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-22T21:59:32.067501] [INFO ] [MAIN ] Update Progress: 2252/2372 symbols completed. VRTS took 22.3s. Estimated remaining: 15m 57s. Rate: 7.5 symbols/min [2025-09-22T21:59:32.240182] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:59:32.307868] [DEBUG] [LOCAL ] VST: Loaded 54500 existing records from primary storage. [2025-09-22T21:59:32.308034] [INFO ] [MAIN ] VST: Loaded 54500 existing records. [2025-09-22T21:59:32.483755] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:59:32.484028] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-22T21:59:32.484075] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-22T21:59:32.485764] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-22T21:59:32.485829] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-22T21:59:32.527952] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-22T21:59:32.847724] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:59:33.322022] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-22T21:59:33.471628] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-22T21:59:34.122111] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-22T21:59:34.931164] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-22T21:59:34.934784] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-22T21:59:35.028107] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T21:59:35.625383] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-22T21:59:35.722055] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-22T21:59:36.522121] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-22T21:59:37.327262] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-22T21:59:37.364624] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-22T21:59:37.549751] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-22T21:59:38.122098] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-22T21:59:38.817410] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-22T21:59:38.931524] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-22T21:59:38.953759] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T21:59:39.722088] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-22T21:59:40.040078] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T21:59:40.522064] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-22T21:59:41.322067] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-22T21:59:41.447893] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-22T21:59:41.542276] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-22T21:59:42.122066] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-22T21:59:42.922024] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-22T21:59:43.083021] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-22T21:59:43.160087] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T21:59:43.722109] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-22T21:59:44.260725] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-22T21:59:44.269958] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-09-22T21:59:44.270176] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-22T21:59:44.523026] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-22T21:59:44.728965] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-22T21:59:44.731993] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-22T21:59:44.733474] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-22T21:59:44.733569] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-22T21:59:44.737940] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T21:59:44.749610] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-09-22T21:59:45.114218] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-09-22T21:59:45.114382] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-22T21:59:45.114490] [INFO ] [MAIN ] Update Progress: 2253/2372 symbols completed. VRT took 44.4s. Estimated remaining: 15m 50s. Rate: 7.5 symbols/min [2025-09-22T21:59:45.290377] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:59:45.322317] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-22T21:59:45.339118] [DEBUG] [LOCAL ] VSTS: Loaded 49735 existing records from primary storage. [2025-09-22T21:59:45.339429] [INFO ] [MAIN ] VSTS: Loaded 49735 existing records. [2025-09-22T21:59:45.529210] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:59:45.529487] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-22T21:59:45.529534] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-22T21:59:45.530635] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-22T21:59:45.530722] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-22T21:59:45.906299] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:59:46.122107] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-22T21:59:46.216573] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-22T21:59:46.391827] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-22T21:59:46.401170] [INFO ] [REMOTE ] VSCO: Full fetch complete (76273 records). [2025-09-22T21:59:46.401380] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-22T21:59:46.792540] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-22T21:59:46.792633] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-22T21:59:46.794044] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-22T21:59:46.794110] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-22T21:59:46.795718] [DEBUG] [LOCAL ] VSCO: Trimmed 76273 records to 52886 (keeping 200 days of data) [2025-09-22T21:59:46.967838] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-22T21:59:47.048092] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T21:59:47.163352] [DEBUG] [LOCAL ] VSCO: Primary data saved (52886 records). [2025-09-22T21:59:47.163526] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-22T21:59:47.163637] [INFO ] [MAIN ] Update Progress: 2254/2372 symbols completed. VSCO took 34.7s. Estimated remaining: 15m 41s. Rate: 7.5 symbols/min [2025-09-22T21:59:47.331703] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:59:47.372246] [DEBUG] [LOCAL ] VTEX: Loaded 44131 existing records from primary storage. [2025-09-22T21:59:47.372422] [INFO ] [MAIN ] VTEX: Loaded 44131 existing records. [2025-09-22T21:59:47.553935] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:59:47.554446] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-22T21:59:47.554525] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-22T21:59:47.555598] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-22T21:59:47.555700] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-22T21:59:47.737957] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-22T21:59:47.867518] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-22T21:59:47.967556] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:59:48.522113] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-22T21:59:49.322025] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-22T21:59:49.391576] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-22T21:59:49.661080] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-22T21:59:49.722698] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-22T21:59:50.122090] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-22T21:59:50.599947] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-22T21:59:50.922076] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-22T21:59:51.088290] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T21:59:51.722107] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-22T21:59:52.364251] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T21:59:52.522091] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-22T21:59:53.322082] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-22T21:59:53.605954] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T21:59:53.869835] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T21:59:54.122047] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-22T21:59:54.793349] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T21:59:54.922042] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-22T21:59:55.494992] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T21:59:55.502355] [INFO ] [REMOTE ] VSH: Full fetch complete (71335 records). [2025-09-22T21:59:55.502499] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-22T21:59:55.727218] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-22T21:59:55.922490] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-22T21:59:55.922574] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-22T21:59:55.923867] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-22T21:59:55.923933] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-22T21:59:55.925445] [DEBUG] [LOCAL ] VSH: Trimmed 71335 records to 48666 (keeping 200 days of data) [2025-09-22T21:59:56.237607] [DEBUG] [LOCAL ] VSH: Primary data saved (48666 records). [2025-09-22T21:59:56.237824] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-22T21:59:56.237952] [INFO ] [MAIN ] Update Progress: 2255/2372 symbols completed. VSH took 29.6s. Estimated remaining: 15m 34s. Rate: 7.5 symbols/min [2025-09-22T21:59:56.413327] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T21:59:56.466006] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T21:59:56.491930] [DEBUG] [LOCAL ] VTLE: Loaded 49395 existing records from primary storage. [2025-09-22T21:59:56.492097] [INFO ] [MAIN ] VTLE: Loaded 49395 existing records. [2025-09-22T21:59:56.527140] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-22T21:59:56.689885] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T21:59:56.690145] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-22T21:59:56.690195] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-22T21:59:56.691403] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-22T21:59:56.691466] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-22T21:59:57.079018] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T21:59:57.322051] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-22T21:59:58.104463] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-22T21:59:58.122001] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-22T21:59:58.541993] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-22T21:59:58.791245] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-22T21:59:58.922037] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-22T21:59:59.683566] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T21:59:59.722005] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-22T22:00:00.463532] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-22T22:00:00.522057] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-22T22:00:01.322089] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-22T22:00:01.369601] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-22T22:00:02.122070] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-22T22:00:02.248681] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T22:00:02.922075] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-22T22:00:03.722050] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-22T22:00:05.582143] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (4.26 seconds). [2025-09-22T22:00:05.593630] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-22T22:00:05.711443] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-09-22T22:00:05.721407] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-22T22:00:05.755378] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (3.63 seconds). [2025-09-22T22:00:06.122106] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-22T22:00:06.304835] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-22T22:00:06.922034] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-22T22:00:07.372523] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-22T22:00:07.722074] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-22T22:00:07.794051] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T22:00:08.166114] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-22T22:00:08.303758] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T22:00:08.522062] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-22T22:00:09.322012] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-22T22:00:09.354815] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T22:00:10.122060] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-22T22:00:10.772187] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-22T22:00:10.780270] [INFO ] [REMOTE ] VTEX: Full fetch complete (60770 records). [2025-09-22T22:00:10.780448] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-22T22:00:10.931674] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-22T22:00:11.252502] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-22T22:00:11.252632] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-22T22:00:11.253880] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-22T22:00:11.253963] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-22T22:00:11.255625] [DEBUG] [LOCAL ] VTEX: Trimmed 60770 records to 43377 (keeping 200 days of data) [2025-09-22T22:00:11.380865] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-22T22:00:11.549136] [DEBUG] [LOCAL ] VTEX: Primary data saved (43377 records). [2025-09-22T22:00:11.549308] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-22T22:00:11.549415] [INFO ] [MAIN ] Update Progress: 2256/2372 symbols completed. VTEX took 24.4s. Estimated remaining: 15m 26s. Rate: 7.5 symbols/min [2025-09-22T22:00:11.749446] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:00:11.728475] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-22T22:00:11.752281] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T22:00:11.761883] [INFO ] [REMOTE ] VSTS: Full fetch complete (69915 records). [2025-09-22T22:00:11.762035] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-22T22:00:11.886012] [DEBUG] [LOCAL ] VTMX: Loaded 17636 existing records from primary storage. [2025-09-22T22:00:11.891940] [INFO ] [MAIN ] VTMX: Loaded 17636 existing records. [2025-09-22T22:00:12.308319] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:00:12.327487] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-22T22:00:12.337486] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-22T22:00:12.363776] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-22T22:00:12.369765] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-22T22:00:12.392114] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-22T22:00:12.425466] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-22T22:00:12.426952] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-22T22:00:12.433257] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-22T22:00:12.486279] [DEBUG] [LOCAL ] VSTS: Trimmed 69915 records to 49035 (keeping 200 days of data) [2025-09-22T22:00:13.002890] [DEBUG] [LOCAL ] VSTS: Primary data saved (49035 records). [2025-09-22T22:00:13.038045] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-22T22:00:13.070822] [INFO ] [MAIN ] Update Progress: 2257/2372 symbols completed. VSTS took 28.0s. Estimated remaining: 15m 18s. Rate: 7.5 symbols/min [2025-09-22T22:00:13.070549] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:00:13.094341] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-22T22:00:13.259105] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:00:13.290456] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-22T22:00:13.307113] [DEBUG] [LOCAL ] VTN: Loaded 7254 existing records from primary storage. [2025-09-22T22:00:13.307249] [INFO ] [MAIN ] VTN: Loaded 7254 existing records. [2025-09-22T22:00:13.338852] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-22T22:00:13.493685] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:00:13.493992] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-22T22:00:13.494043] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-22T22:00:13.494818] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-22T22:00:13.494881] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-22T22:00:13.862414] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:00:14.122069] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-22T22:00:14.792949] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T22:00:14.922030] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-22T22:00:14.989783] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-09-22T22:00:15.722100] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-22T22:00:15.816626] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T22:00:15.888183] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T22:00:16.063896] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-22T22:00:16.144559] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-22T22:00:16.153299] [INFO ] [REMOTE ] VST: Full fetch complete (77806 records). [2025-09-22T22:00:16.153494] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-22T22:00:16.527185] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-22T22:00:16.586503] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-22T22:00:16.586588] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-22T22:00:16.587883] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-22T22:00:16.587963] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-22T22:00:16.589934] [DEBUG] [LOCAL ] VST: Trimmed 77806 records to 53720 (keeping 200 days of data) [2025-09-22T22:00:16.951212] [DEBUG] [LOCAL ] VST: Primary data saved (53720 records). [2025-09-22T22:00:16.951469] [INFO ] [MAIN ] VST: Full history saved. [2025-09-22T22:00:16.951566] [INFO ] [MAIN ] Update Progress: 2258/2372 symbols completed. VST took 44.9s. Estimated remaining: 15m 9s. Rate: 7.5 symbols/min [2025-09-22T22:00:17.121252] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:00:17.141279] [DEBUG] [LOCAL ] VTOL: Loaded 20110 existing records from primary storage. [2025-09-22T22:00:17.141408] [INFO ] [MAIN ] VTOL: Loaded 20110 existing records. [2025-09-22T22:00:17.320005] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:00:17.320428] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-22T22:00:17.320518] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-22T22:00:17.321286] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-22T22:00:17.321350] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-22T22:00:17.332989] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-22T22:00:17.706013] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:00:17.719249] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-22T22:00:18.122055] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-22T22:00:18.922035] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-22T22:00:19.092258] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-22T22:00:19.133242] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T22:00:19.722069] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-22T22:00:19.751209] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-22T22:00:20.522067] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-22T22:00:21.237634] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T22:00:21.290368] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T22:00:21.322023] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-22T22:00:22.122075] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-22T22:00:22.922077] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-22T22:00:23.162549] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-22T22:00:23.183598] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-22T22:00:23.716861] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-22T22:00:23.721994] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-22T22:00:24.464463] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-22T22:00:24.522061] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-22T22:00:25.279757] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T22:00:25.322014] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-22T22:00:26.117621] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-22T22:00:26.121991] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-22T22:00:26.851070] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-22T22:00:26.922030] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-22T22:00:27.074410] [DEBUG] [REMOTE ] VTN: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-22T22:00:27.074772] [WARN ] [REMOTE ] VTN: No data returned for month 2025-08 [2025-09-22T22:00:27.722057] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-22T22:00:28.522060] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-22T22:00:28.828142] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-22T22:00:29.322056] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-22T22:00:30.122077] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-22T22:00:30.250188] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-22T22:00:30.318546] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T22:00:30.729100] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-22T22:00:30.922132] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-22T22:00:31.722113] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-22T22:00:32.468839] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T22:00:32.483832] [INFO ] [REMOTE ] VTLE: Full fetch complete (68640 records). [2025-09-22T22:00:32.484158] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T22:00:32.487455] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-22T22:00:32.487547] [INFO ] [REMOTE ] VTN: Full fetch complete (10462 records). [2025-09-22T22:00:32.487833] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-22T22:00:32.536923] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-22T22:00:32.880778] [WARN ] [VALIDATOR ] VTN: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-22T22:00:32.901592] [FATAL] [MAIN ] VTN: Fetched primary data is invalid. Refusing to save it. [2025-09-22T22:00:32.948200] [WARN ] [MAIN ] VTN: Deleting existing primary and derivative data due to validation failure. [2025-09-22T22:00:32.987089] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-22T22:00:33.009912] [DEBUG] [LOCAL ] VTN: No primary data file found to delete. [2025-09-22T22:00:33.010085] [INFO ] [LOCAL ] VTN: Starting deletion of derivative data. [2025-09-22T22:00:33.026831] [DEBUG] [LOCAL ] VTN: Deleted derivative data file. [2025-09-22T22:00:33.037191] [INFO ] [MAIN ] Update Progress: 2259/2372 symbols completed. VTN took 20.0s. Estimated remaining: 15m 2s. Rate: 7.5 symbols/min [2025-09-22T22:00:33.219556] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-22T22:00:33.220082] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-22T22:00:33.231883] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-22T22:00:33.242192] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-22T22:00:33.296164] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:00:33.296533] [DEBUG] [LOCAL ] VTR: No existing data file found in primary storage. [2025-09-22T22:00:33.296591] [WARN ] [MAIN ] VTR: No existing data found, performing full refresh instead. [2025-09-22T22:00:33.296918] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-22T22:00:33.296992] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-22T22:00:33.297083] [DEBUG] [LOCAL ] VTR: No primary data file found to delete. [2025-09-22T22:00:33.296816] [DEBUG] [LOCAL ] VTLE: Trimmed 68640 records to 48615 (keeping 200 days of data) [2025-09-22T22:00:33.297133] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-22T22:00:33.325281] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-22T22:00:33.822240] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:00:33.845209] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-22T22:00:34.031560] [DEBUG] [LOCAL ] VTLE: Primary data saved (48615 records). [2025-09-22T22:00:34.031747] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-22T22:00:34.031875] [INFO ] [MAIN ] Update Progress: 2260/2372 symbols completed. VTLE took 37.8s. Estimated remaining: 14m 54s. Rate: 7.5 symbols/min [2025-09-22T22:00:34.109977] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T22:00:34.127079] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-22T22:00:34.229201] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:00:34.261842] [DEBUG] [LOCAL ] VTS: Loaded 30856 existing records from primary storage. [2025-09-22T22:00:34.262013] [INFO ] [MAIN ] VTS: Loaded 30856 existing records. [2025-09-22T22:00:34.445166] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:00:34.445675] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-22T22:00:34.445743] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-22T22:00:34.446592] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-22T22:00:34.446684] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-22T22:00:34.811405] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:00:34.922012] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-22T22:00:35.227147] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-22T22:00:35.722076] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-22T22:00:36.030379] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-22T22:00:36.522686] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-22T22:00:36.525815] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-22T22:00:37.322034] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-22T22:00:37.778172] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-22T22:00:38.122087] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-22T22:00:38.495824] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-22T22:00:38.922149] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-22T22:00:39.722081] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-22T22:00:39.813723] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-22T22:00:39.840973] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-22T22:00:40.522123] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-22T22:00:40.665118] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-22T22:00:41.322058] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-22T22:00:41.896055] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T22:00:42.106347] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-22T22:00:42.109152] [INFO ] [REMOTE ] VTMX: Full fetch complete (26072 records). [2025-09-22T22:00:42.109227] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-22T22:00:42.130067] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-22T22:00:42.478545] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-22T22:00:42.478627] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-22T22:00:42.479199] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-22T22:00:42.479248] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-22T22:00:42.479921] [DEBUG] [LOCAL ] VTMX: Trimmed 26072 records to 17377 (keeping 200 days of data) [2025-09-22T22:00:42.586058] [DEBUG] [LOCAL ] VTMX: Primary data saved (17377 records). [2025-09-22T22:00:42.586214] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-22T22:00:42.586303] [INFO ] [MAIN ] Update Progress: 2261/2372 symbols completed. VTMX took 31.0s. Estimated remaining: 14m 46s. Rate: 7.5 symbols/min [2025-09-22T22:00:42.754512] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:00:42.787664] [DEBUG] [LOCAL ] VVR: Loaded 30653 existing records from primary storage. [2025-09-22T22:00:42.787829] [INFO ] [MAIN ] VVR: Loaded 30653 existing records. [2025-09-22T22:00:42.927219] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-22T22:00:42.968448] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:00:42.968757] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-22T22:00:42.968814] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-22T22:00:42.969584] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-22T22:00:42.969674] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-22T22:00:43.327983] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:00:43.722018] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-22T22:00:44.004217] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T22:00:44.028406] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-22T22:00:44.522109] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-22T22:00:45.112684] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-22T22:00:45.322091] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-22T22:00:45.516741] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T22:00:46.122111] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-22T22:00:46.881997] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-22T22:00:46.922036] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-22T22:00:47.502506] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T22:00:47.722056] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-22T22:00:48.190044] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T22:00:48.522066] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-22T22:00:49.127305] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T22:00:49.322057] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-22T22:00:49.556143] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-22T22:00:50.122118] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-22T22:00:50.922036] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-22T22:00:51.149363] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-22T22:00:51.174383] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T22:00:51.722069] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-22T22:00:52.337097] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-22T22:00:52.352315] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-22T22:00:52.355348] [INFO ] [REMOTE ] VTOL: Full fetch complete (26191 records). [2025-09-22T22:00:52.355429] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-22T22:00:52.526929] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-22T22:00:52.725918] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-22T22:00:52.725992] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-22T22:00:52.726486] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-22T22:00:52.726524] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-22T22:00:52.727196] [DEBUG] [LOCAL ] VTOL: Trimmed 26191 records to 19716 (keeping 200 days of data) [2025-09-22T22:00:52.842276] [DEBUG] [LOCAL ] VTOL: Primary data saved (19716 records). [2025-09-22T22:00:52.842425] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-22T22:00:52.842533] [INFO ] [MAIN ] Update Progress: 2262/2372 symbols completed. VTOL took 35.9s. Estimated remaining: 14m 38s. Rate: 7.5 symbols/min [2025-09-22T22:00:53.013795] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:00:53.062550] [DEBUG] [LOCAL ] VVV: Loaded 50881 existing records from primary storage. [2025-09-22T22:00:53.062748] [INFO ] [MAIN ] VVV: Loaded 50881 existing records. [2025-09-22T22:00:53.238062] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:00:53.238347] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-22T22:00:53.238453] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-22T22:00:53.239787] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-22T22:00:53.239864] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-22T22:00:53.332318] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-22T22:00:53.614735] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:00:53.892262] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-22T22:00:54.122067] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-22T22:00:54.444907] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T22:00:54.922066] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-22T22:00:55.668611] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T22:00:55.722008] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-22T22:00:56.462387] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T22:00:56.522002] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-22T22:00:57.333851] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-22T22:00:57.341832] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-22T22:00:58.122017] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-22T22:00:58.228030] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T22:00:58.705946] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T22:00:58.922064] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-22T22:00:59.729869] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-22T22:00:59.749109] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T22:01:00.458006] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T22:01:00.522082] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-22T22:01:01.322034] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-22T22:01:01.593942] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-22T22:01:01.759118] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-22T22:01:02.122079] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-22T22:01:02.614101] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T22:01:02.922065] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-22T22:01:03.395214] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-22T22:01:03.722060] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-22T22:01:04.522087] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-22T22:01:04.728636] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T22:01:04.858914] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-22T22:01:05.322069] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-22T22:01:05.807548] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-22T22:01:05.812967] [INFO ] [REMOTE ] VTS: Full fetch complete (40631 records). [2025-09-22T22:01:05.813081] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-22T22:01:06.127339] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-22T22:01:06.207760] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-22T22:01:06.207853] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-22T22:01:06.209097] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-22T22:01:06.209197] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-22T22:01:06.210298] [DEBUG] [LOCAL ] VTS: Trimmed 40631 records to 30465 (keeping 200 days of data) [2025-09-22T22:01:06.411169] [DEBUG] [LOCAL ] VTS: Primary data saved (30465 records). [2025-09-22T22:01:06.411319] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-22T22:01:06.411512] [INFO ] [MAIN ] Update Progress: 2263/2372 symbols completed. VTS took 32.4s. Estimated remaining: 14m 30s. Rate: 7.5 symbols/min [2025-09-22T22:01:06.590370] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:01:06.616599] [DEBUG] [LOCAL ] VVX: Loaded 23754 existing records from primary storage. [2025-09-22T22:01:06.616786] [INFO ] [MAIN ] VVX: Loaded 23754 existing records. [2025-09-22T22:01:06.801737] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:01:06.802156] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-22T22:01:06.802355] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-22T22:01:06.803210] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-22T22:01:06.803282] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-22T22:01:06.930276] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-22T22:01:07.218209] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T22:01:07.223876] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:01:07.722113] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-22T22:01:07.898979] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T22:01:08.402116] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-22T22:01:08.522071] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-22T22:01:08.863059] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-22T22:01:09.322069] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-22T22:01:09.800538] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-22T22:01:09.807055] [INFO ] [REMOTE ] VVR: Full fetch complete (45628 records). [2025-09-22T22:01:09.807164] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-22T22:01:10.127218] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-22T22:01:10.251348] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-22T22:01:10.251429] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-22T22:01:10.253339] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-22T22:01:10.253429] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-22T22:01:10.254533] [DEBUG] [LOCAL ] VVR: Trimmed 45628 records to 30316 (keeping 200 days of data) [2025-09-22T22:01:10.452788] [DEBUG] [LOCAL ] VVR: Primary data saved (30316 records). [2025-09-22T22:01:10.452920] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-22T22:01:10.453031] [INFO ] [MAIN ] Update Progress: 2264/2372 symbols completed. VVR took 27.9s. Estimated remaining: 14m 22s. Rate: 7.5 symbols/min [2025-09-22T22:01:10.660303] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:01:10.715829] [DEBUG] [LOCAL ] VYX: Loaded 49925 existing records from primary storage. [2025-09-22T22:01:10.715983] [INFO ] [MAIN ] VYX: Loaded 49925 existing records. [2025-09-22T22:01:10.925086] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-22T22:01:10.925308] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:01:10.928034] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-22T22:01:10.928154] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-22T22:01:10.929169] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-22T22:01:10.929263] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-22T22:01:11.227514] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-22T22:01:11.375757] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:01:11.378019] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T22:01:11.685134] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T22:01:11.700460] [INFO ] [REMOTE ] VTR: Full fetch complete (76321 records). [2025-09-22T22:01:11.700862] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-22T22:01:11.727285] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-22T22:01:12.178892] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-22T22:01:12.179077] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-22T22:01:12.181259] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-22T22:01:12.181331] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-22T22:01:12.183541] [DEBUG] [LOCAL ] VTR: Trimmed 76321 records to 52838 (keeping 200 days of data) [2025-09-22T22:01:12.525841] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-22T22:01:12.574606] [DEBUG] [LOCAL ] VTR: Primary data saved (52838 records). [2025-09-22T22:01:12.574854] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-22T22:01:12.575083] [INFO ] [MAIN ] Update Progress: 2265/2372 symbols completed. VTR took 39.5s. Estimated remaining: 14m 14s. Rate: 7.5 symbols/min [2025-09-22T22:01:12.763410] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:01:12.831937] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-22T22:01:12.832263] [INFO ] [MAIN ] VZ: Loaded 54571 existing records. [2025-09-22T22:01:13.058626] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-22T22:01:13.149238] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:01:13.149634] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-22T22:01:13.149726] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-22T22:01:13.151180] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-22T22:01:13.151245] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-22T22:01:13.322938] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-22T22:01:13.554458] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:01:14.122059] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-22T22:01:14.256321] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T22:01:14.643625] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-22T22:01:14.922062] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-22T22:01:15.722091] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-22T22:01:16.522018] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-22T22:01:16.659336] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T22:01:16.717299] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-22T22:01:16.794127] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-22T22:01:17.322074] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-22T22:01:18.122042] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-22T22:01:18.177676] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T22:01:18.922074] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-22T22:01:19.713673] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-22T22:01:19.724102] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-22T22:01:19.804284] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-22T22:01:19.857943] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T22:01:20.522048] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-22T22:01:21.238526] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-22T22:01:21.322058] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-22T22:01:22.095943] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T22:01:22.122053] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-22T22:01:22.922081] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-22T22:01:23.548464] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-22T22:01:23.708198] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T22:01:23.719883] [INFO ] [REMOTE ] VVV: Full fetch complete (72268 records). [2025-09-22T22:01:23.720099] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-22T22:01:23.734051] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-22T22:01:24.125039] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T22:01:24.354298] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-22T22:01:24.354429] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-22T22:01:24.356210] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-22T22:01:24.356284] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-22T22:01:24.358077] [DEBUG] [LOCAL ] VVV: Trimmed 72268 records to 50212 (keeping 200 days of data) [2025-09-22T22:01:24.522408] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-22T22:01:24.826351] [DEBUG] [LOCAL ] VVV: Primary data saved (50212 records). [2025-09-22T22:01:24.826555] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-22T22:01:24.826704] [INFO ] [MAIN ] Update Progress: 2266/2372 symbols completed. VVV took 32.0s. Estimated remaining: 14m 6s. Rate: 7.5 symbols/min [2025-09-22T22:01:25.014493] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:01:25.084272] [DEBUG] [LOCAL ] W: Loaded 54290 existing records from primary storage. [2025-09-22T22:01:25.084482] [INFO ] [MAIN ] W: Loaded 54290 existing records. [2025-09-22T22:01:25.311850] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:01:25.312455] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-22T22:01:25.312565] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-22T22:01:25.327625] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-22T22:01:25.327776] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-22T22:01:25.343900] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-22T22:01:25.420426] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-22T22:01:25.771272] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:01:25.784596] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-22T22:01:26.122062] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-22T22:01:26.922055] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-22T22:01:27.627807] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-22T22:01:27.722071] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-22T22:01:27.815364] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T22:01:28.522094] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-22T22:01:28.993890] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-22T22:01:29.321990] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-22T22:01:29.400964] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-22T22:01:30.122092] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-22T22:01:30.922065] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-22T22:01:31.097355] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T22:01:31.123029] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-22T22:01:31.722083] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-22T22:01:31.833546] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T22:01:31.838712] [INFO ] [REMOTE ] VVX: Full fetch complete (33458 records). [2025-09-22T22:01:31.838814] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-22T22:01:31.973046] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-22T22:01:32.265917] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-22T22:01:32.266006] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-22T22:01:32.266809] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-22T22:01:32.266871] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-22T22:01:32.267620] [DEBUG] [LOCAL ] VVX: Trimmed 33458 records to 23361 (keeping 200 days of data) [2025-09-22T22:01:32.407666] [DEBUG] [LOCAL ] VVX: Primary data saved (23361 records). [2025-09-22T22:01:32.407802] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-22T22:01:32.407907] [INFO ] [MAIN ] Update Progress: 2267/2372 symbols completed. VVX took 26.0s. Estimated remaining: 13m 58s. Rate: 7.5 symbols/min [2025-09-22T22:01:32.527167] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-22T22:01:32.585638] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:01:32.635748] [DEBUG] [LOCAL ] WAB: Loaded 45019 existing records from primary storage. [2025-09-22T22:01:32.635890] [INFO ] [MAIN ] WAB: Loaded 45019 existing records. [2025-09-22T22:01:32.819705] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:01:32.820052] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-22T22:01:32.820132] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-22T22:01:32.821293] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-22T22:01:32.821356] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-22T22:01:33.187704] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:01:33.322051] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-22T22:01:34.100580] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-22T22:01:34.122008] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-22T22:01:34.369114] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-22T22:01:34.922126] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-22T22:01:35.025855] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T22:01:35.722064] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-22T22:01:36.067889] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-22T22:01:36.400530] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-22T22:01:36.522071] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-22T22:01:37.322024] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-22T22:01:37.426613] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T22:01:38.122070] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-22T22:01:38.922041] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-22T22:01:39.013199] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-22T22:01:39.722098] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-22T22:01:40.014511] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-22T22:01:40.195239] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-22T22:01:40.522065] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-22T22:01:40.809955] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-22T22:01:41.322066] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-22T22:01:41.863030] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-22T22:01:42.122084] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-22T22:01:42.245861] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T22:01:42.839235] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T22:01:42.871077] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T22:01:42.879359] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-09-22T22:01:42.879486] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-22T22:01:42.927169] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-22T22:01:43.285298] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-22T22:01:43.285398] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-22T22:01:43.286633] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-22T22:01:43.286731] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-22T22:01:43.288334] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-09-22T22:01:43.655079] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-09-22T22:01:43.655327] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-22T22:01:43.655469] [INFO ] [MAIN ] Update Progress: 2268/2372 symbols completed. VZ took 31.1s. Estimated remaining: 13m 50s. Rate: 7.5 symbols/min [2025-09-22T22:01:43.727155] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-22T22:01:43.840925] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:01:43.886616] [DEBUG] [LOCAL ] WAL: Loaded 46225 existing records from primary storage. [2025-09-22T22:01:43.886802] [INFO ] [MAIN ] WAL: Loaded 46225 existing records. [2025-09-22T22:01:44.067750] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:01:44.067987] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-22T22:01:44.068037] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-22T22:01:44.069100] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-22T22:01:44.069160] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-22T22:01:44.468086] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:01:44.522481] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-22T22:01:44.522687] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-22T22:01:45.322060] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-22T22:01:45.535298] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T22:01:46.122026] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-22T22:01:46.299573] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T22:01:46.922030] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-22T22:01:47.033960] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T22:01:47.673755] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-22T22:01:47.722047] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-22T22:01:48.522075] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-22T22:01:48.820856] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-22T22:01:49.325434] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-22T22:01:49.327485] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T22:01:50.101190] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-22T22:01:50.122070] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-22T22:01:50.922033] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-22T22:01:50.982885] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T22:01:51.722034] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-22T22:01:51.828208] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T22:01:52.522059] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-22T22:01:52.680628] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T22:01:53.322086] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-22T22:01:53.769367] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T22:01:54.118861] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T22:01:54.127427] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-22T22:01:54.922037] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-22T22:01:54.975065] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T22:01:55.538881] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-22T22:01:55.548015] [INFO ] [REMOTE ] W: Full fetch complete (77439 records). [2025-09-22T22:01:55.548190] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-22T22:01:55.735556] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-22T22:01:55.929901] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-22T22:01:55.998048] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-22T22:01:55.997763] [INFO ] [REMOTE ] WAB: Full fetch complete (64492 records). [2025-09-22T22:01:55.998276] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-22T22:01:55.998459] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-22T22:01:55.999877] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-22T22:01:56.000299] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-22T22:01:56.111076] [DEBUG] [LOCAL ] W: Trimmed 77439 records to 53505 (keeping 200 days of data) [2025-09-22T22:01:56.520934] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-22T22:01:56.521364] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-22T22:01:56.522863] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-22T22:01:56.523362] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-22T22:01:56.523639] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-22T22:01:56.531258] [DEBUG] [LOCAL ] WAB: Trimmed 64492 records to 44293 (keeping 200 days of data) [2025-09-22T22:01:57.012919] [DEBUG] [LOCAL ] W: Primary data saved (53505 records). [2025-09-22T22:01:57.013938] [INFO ] [MAIN ] W: Full history saved. [2025-09-22T22:01:57.014321] [INFO ] [MAIN ] Update Progress: 2269/2372 symbols completed. W took 32.2s. Estimated remaining: 13m 42s. Rate: 7.5 symbols/min [2025-09-22T22:01:57.221504] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:01:57.229368] [DEBUG] [LOCAL ] WAB: Primary data saved (44293 records). [2025-09-22T22:01:57.229527] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-22T22:01:57.229622] [INFO ] [MAIN ] Update Progress: 2270/2372 symbols completed. WAB took 24.8s. Estimated remaining: 13m 34s. Rate: 7.5 symbols/min [2025-09-22T22:01:57.431174] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:01:57.432276] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-22T22:01:57.432167] [DEBUG] [LOCAL ] WAT: Loaded 35678 existing records from primary storage. [2025-09-22T22:01:57.432493] [INFO ] [MAIN ] WAT: Loaded 35678 existing records. [2025-09-22T22:01:57.432700] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-22T22:01:57.464086] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-22T22:01:57.469499] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-22T22:01:57.512096] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-22T22:01:57.528479] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-22T22:01:57.742001] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:01:57.772355] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-22T22:01:57.772515] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-22T22:01:57.778435] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-22T22:01:57.794032] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-22T22:01:58.108165] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-22T22:01:58.260033] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-22T22:01:58.409745] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-22T22:01:58.445269] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:01:58.464510] [INFO ] [REMOTE ] VYX: Full fetch complete (70246 records). [2025-09-22T22:01:58.465295] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-22T22:01:58.465171] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-22T22:01:58.644830] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:01:58.823183] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:01:58.845894] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-22T22:01:58.924520] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-09-22T22:01:58.956464] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-22T22:01:58.956550] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-22T22:01:58.958408] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-22T22:01:58.958480] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-22T22:01:58.960041] [DEBUG] [LOCAL ] VYX: Trimmed 70246 records to 49112 (keeping 200 days of data) [2025-09-22T22:01:59.227826] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:01:59.244480] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-09-22T22:01:59.261307] [DEBUG] [LOCAL ] VYX: Primary data saved (49112 records). [2025-09-22T22:01:59.261519] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-22T22:01:59.261639] [INFO ] [MAIN ] Update Progress: 2271/2372 symbols completed. VYX took 48.8s. Estimated remaining: 13m 26s. Rate: 7.5 symbols/min [2025-09-22T22:01:59.430997] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:01:59.479143] [DEBUG] [LOCAL ] WBS: Loaded 49586 existing records from primary storage. [2025-09-22T22:01:59.479293] [INFO ] [MAIN ] WBS: Loaded 49586 existing records. [2025-09-22T22:01:59.658330] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:01:59.658564] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-22T22:01:59.658612] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-22T22:01:59.660696] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-22T22:01:59.660761] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-22T22:01:59.723964] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-22T22:02:00.031870] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:02:00.157991] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T22:02:00.522072] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-02. [2025-09-22T22:02:00.816126] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:02:00.816534] [WARN ] [REMOTE ] WBI: No data returned for month 2025-02 [2025-09-22T22:02:01.322048] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-22T22:02:01.433072] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T22:02:02.122081] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-22T22:02:02.930442] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-03. [2025-09-22T22:02:02.933665] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-22T22:02:03.144209] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:02:03.144561] [WARN ] [REMOTE ] WBI: No data returned for month 2025-03 [2025-09-22T22:02:03.723914] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-04. [2025-09-22T22:02:03.729120] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-22T22:02:03.991775] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:02:03.992143] [WARN ] [REMOTE ] WBI: No data returned for month 2025-04 [2025-09-22T22:02:04.522058] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-22T22:02:05.322059] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-05. [2025-09-22T22:02:05.527540] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:02:05.527938] [WARN ] [REMOTE ] WBI: No data returned for month 2025-05 [2025-09-22T22:02:06.015354] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-22T22:02:06.122044] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-22T22:02:06.922053] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-22T22:02:07.538994] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-22T22:02:07.722048] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-22T22:02:08.526179] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-06. [2025-09-22T22:02:08.531777] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-22T22:02:08.910131] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-22T22:02:08.910447] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:02:08.920158] [WARN ] [REMOTE ] WBI: No data returned for month 2025-06 [2025-09-22T22:02:09.322084] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-22T22:02:10.122104] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-22T22:02:10.768214] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T22:02:10.922067] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-22T22:02:11.225439] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-22T22:02:11.722124] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-07. [2025-09-22T22:02:12.001478] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:02:12.001820] [WARN ] [REMOTE ] WBI: No data returned for month 2025-07 [2025-09-22T22:02:12.522029] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-22T22:02:12.556710] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-22T22:02:13.322061] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-08. [2025-09-22T22:02:13.527270] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:02:13.527630] [WARN ] [REMOTE ] WBI: No data returned for month 2025-08 [2025-09-22T22:02:14.122043] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-22T22:02:14.207611] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T22:02:14.922060] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-22T22:02:15.722047] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-09. [2025-09-22T22:02:15.859939] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T22:02:16.470991] [INFO ] [REMOTE ] WBI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-22T22:02:16.474607] [INFO ] [REMOTE ] WBI: Full fetch complete (1301 records). [2025-09-22T22:02:16.474723] [DEBUG] [VALIDATOR ] WBI: Validating primary data. [2025-09-22T22:02:16.527395] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-22T22:02:16.675986] [WARN ] [VALIDATOR ] WBI: Validation failed - insufficient historical data. Have 4 unique days, need 200 days [2025-09-22T22:02:16.676305] [FATAL] [MAIN ] WBI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T22:02:16.676466] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T22:02:16.676542] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-22T22:02:16.676630] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-22T22:02:16.676719] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-22T22:02:16.676770] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-22T22:02:16.676830] [INFO ] [MAIN ] Update Progress: 2272/2372 symbols completed. WBI took 19.4s. Estimated remaining: 13m 18s. Rate: 7.5 symbols/min [2025-09-22T22:02:16.854371] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:02:16.886119] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-22T22:02:16.906374] [DEBUG] [LOCAL ] WBX: Loaded 13473 existing records from primary storage. [2025-09-22T22:02:16.906517] [INFO ] [MAIN ] WBX: Loaded 13473 existing records. [2025-09-22T22:02:17.091069] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:02:17.091391] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-22T22:02:17.091459] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-22T22:02:17.091902] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-22T22:02:17.091961] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-22T22:02:17.331091] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-22T22:02:17.523794] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:02:18.122128] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-22T22:02:18.239495] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T22:02:18.781405] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-22T22:02:18.922064] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-22T22:02:19.582017] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T22:02:19.722068] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-22T22:02:20.500085] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T22:02:20.522010] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-22T22:02:20.978811] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T22:02:21.322072] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-22T22:02:22.122056] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-22T22:02:22.392053] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-22T22:02:22.738679] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-22T22:02:22.922065] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-22T22:02:23.358285] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T22:02:23.722071] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-22T22:02:24.157511] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-22T22:02:24.165223] [INFO ] [REMOTE ] WAL: Full fetch complete (66312 records). [2025-09-22T22:02:24.165382] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-22T22:02:24.530430] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-22T22:02:24.578699] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-22T22:02:24.578826] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-22T22:02:24.581433] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-22T22:02:24.581688] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-22T22:02:24.583075] [DEBUG] [LOCAL ] WAL: Trimmed 66312 records to 45453 (keeping 200 days of data) [2025-09-22T22:02:24.738587] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-22T22:02:24.915143] [DEBUG] [LOCAL ] WAL: Primary data saved (45453 records). [2025-09-22T22:02:24.915309] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-22T22:02:24.915416] [INFO ] [MAIN ] Update Progress: 2273/2372 symbols completed. WAL took 41.3s. Estimated remaining: 13m 10s. Rate: 7.5 symbols/min [2025-09-22T22:02:25.121850] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:02:25.162749] [DEBUG] [LOCAL ] WCC: Loaded 40867 existing records from primary storage. [2025-09-22T22:02:25.162904] [INFO ] [MAIN ] WCC: Loaded 40867 existing records. [2025-09-22T22:02:25.322232] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-22T22:02:25.345546] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:02:25.346407] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-22T22:02:25.346458] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-22T22:02:25.347446] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-22T22:02:25.347507] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-22T22:02:25.709991] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:02:26.005895] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-22T22:02:26.122045] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-22T22:02:26.922048] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-22T22:02:27.023500] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T22:02:27.520775] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-22T22:02:27.722087] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-22T22:02:28.522099] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-22T22:02:28.561491] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-22T22:02:28.569376] [INFO ] [REMOTE ] WBS: Full fetch complete (69347 records). [2025-09-22T22:02:28.569501] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-22T22:02:28.980519] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-22T22:02:28.980692] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-22T22:02:28.982162] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-22T22:02:28.982234] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-22T22:02:28.983908] [DEBUG] [LOCAL ] WBS: Trimmed 69347 records to 48833 (keeping 200 days of data) [2025-09-22T22:02:29.007022] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-22T22:02:29.324106] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-22T22:02:29.351625] [DEBUG] [LOCAL ] WBS: Primary data saved (48833 records). [2025-09-22T22:02:29.351742] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-22T22:02:29.351826] [INFO ] [MAIN ] Update Progress: 2274/2372 symbols completed. WBS took 30.1s. Estimated remaining: 13m 2s. Rate: 7.5 symbols/min [2025-09-22T22:02:29.531044] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:02:29.582406] [DEBUG] [LOCAL ] WCN: Loaded 48820 existing records from primary storage. [2025-09-22T22:02:29.582574] [INFO ] [MAIN ] WCN: Loaded 48820 existing records. [2025-09-22T22:02:29.771089] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:02:29.771599] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-22T22:02:29.771721] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-22T22:02:29.772957] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-22T22:02:29.773020] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-22T22:02:30.132075] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-22T22:02:30.162463] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:02:30.210612] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T22:02:30.336320] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-22T22:02:30.822144] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T22:02:30.828192] [INFO ] [REMOTE ] WAT: Full fetch complete (49909 records). [2025-09-22T22:02:30.828292] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-22T22:02:30.927285] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-22T22:02:31.216726] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-22T22:02:31.216807] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-22T22:02:31.217808] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-22T22:02:31.217869] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-22T22:02:31.218913] [DEBUG] [LOCAL ] WAT: Trimmed 49909 records to 35108 (keeping 200 days of data) [2025-09-22T22:02:31.433134] [DEBUG] [LOCAL ] WAT: Primary data saved (35108 records). [2025-09-22T22:02:31.433272] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-22T22:02:31.433361] [INFO ] [MAIN ] Update Progress: 2275/2372 symbols completed. WAT took 34.4s. Estimated remaining: 12m 54s. Rate: 7.5 symbols/min [2025-09-22T22:02:31.605526] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:02:31.629403] [DEBUG] [LOCAL ] WD: Loaded 23877 existing records from primary storage. [2025-09-22T22:02:31.629548] [INFO ] [MAIN ] WD: Loaded 23877 existing records. [2025-09-22T22:02:31.727182] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-22T22:02:31.839173] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:02:31.839771] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-22T22:02:31.839835] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-22T22:02:31.840554] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-22T22:02:31.840616] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-22T22:02:32.232085] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:02:32.522114] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-22T22:02:32.579153] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-22T22:02:32.624273] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-22T22:02:33.322049] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-22T22:02:33.486784] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-22T22:02:34.122107] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-22T22:02:34.331189] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-22T22:02:34.922090] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-22T22:02:35.039787] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T22:02:35.722065] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-22T22:02:36.311967] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-22T22:02:36.522076] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-22T22:02:36.813966] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-22T22:02:37.322065] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-22T22:02:38.122045] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-22T22:02:38.200580] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-22T22:02:38.537799] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-22T22:02:38.922061] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-22T22:02:39.722071] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-22T22:02:39.756222] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T22:02:40.522117] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-22T22:02:40.680403] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T22:02:41.184111] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-22T22:02:41.322075] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-22T22:02:42.122024] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-22T22:02:42.166730] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-22T22:02:42.517475] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-22T22:02:42.922057] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-22T22:02:43.682064] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T22:02:43.722016] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-22T22:02:44.077785] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-22T22:02:44.522068] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-22T22:02:45.300637] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-22T22:02:45.322010] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-22T22:02:45.621388] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T22:02:46.122068] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-22T22:02:46.797955] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T22:02:46.825166] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-22T22:02:46.922057] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-22T22:02:47.722098] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-22T22:02:48.486872] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T22:02:48.522044] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-22T22:02:48.971203] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T22:02:49.322054] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-22T22:02:49.939694] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-22T22:02:50.122111] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-22T22:02:50.317812] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-22T22:02:50.922077] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-22T22:02:51.318295] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-22T22:02:51.722114] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-22T22:02:52.291243] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-22T22:02:52.297533] [INFO ] [REMOTE ] WCC: Full fetch complete (57725 records). [2025-09-22T22:02:52.297716] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-22T22:02:52.528078] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-22T22:02:52.731292] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-22T22:02:52.731466] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-22T22:02:52.732722] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-22T22:02:52.732808] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-22T22:02:52.737141] [DEBUG] [LOCAL ] WCC: Trimmed 57725 records to 40146 (keeping 200 days of data) [2025-09-22T22:02:52.853102] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T22:02:52.865701] [INFO ] [REMOTE ] WD: Full fetch complete (32697 records). [2025-09-22T22:02:52.883858] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-22T22:02:53.335924] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-22T22:02:53.388317] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-22T22:02:53.388417] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-22T22:02:53.389116] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-22T22:02:53.389197] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-22T22:02:53.398213] [DEBUG] [LOCAL ] WD: Trimmed 32697 records to 23499 (keeping 200 days of data) [2025-09-22T22:02:53.506620] [DEBUG] [LOCAL ] WCC: Primary data saved (40146 records). [2025-09-22T22:02:53.507636] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-22T22:02:53.508028] [INFO ] [MAIN ] Update Progress: 2276/2372 symbols completed. WCC took 28.6s. Estimated remaining: 12m 46s. Rate: 7.5 symbols/min [2025-09-22T22:02:53.701914] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:02:53.726263] [DEBUG] [LOCAL ] WDH: Loaded 16817 existing records from primary storage. [2025-09-22T22:02:53.727674] [INFO ] [MAIN ] WDH: Loaded 16817 existing records. [2025-09-22T22:02:53.925777] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:02:53.927364] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-22T22:02:53.927719] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-22T22:02:53.928830] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-22T22:02:53.929182] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-22T22:02:53.954491] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-22T22:02:53.991269] [INFO ] [REMOTE ] WBX: Full fetch complete (26204 records). [2025-09-22T22:02:54.012334] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-22T22:02:54.262312] [DEBUG] [LOCAL ] WD: Primary data saved (23499 records). [2025-09-22T22:02:54.316169] [INFO ] [MAIN ] WD: Full history saved. [2025-09-22T22:02:54.330445] [INFO ] [MAIN ] Update Progress: 2277/2372 symbols completed. WD took 22.9s. Estimated remaining: 12m 38s. Rate: 7.5 symbols/min [2025-09-22T22:02:54.683246] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:02:54.689559] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-22T22:02:54.803139] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-22T22:02:54.803260] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-22T22:02:54.803923] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-22T22:02:54.804008] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-22T22:02:54.805177] [DEBUG] [LOCAL ] WBX: Trimmed 26204 records to 12761 (keeping 200 days of data) [2025-09-22T22:02:54.889354] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-22T22:02:54.922185] [DEBUG] [LOCAL ] WBX: Primary data saved (12761 records). [2025-09-22T22:02:54.922499] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-22T22:02:54.922692] [INFO ] [MAIN ] Update Progress: 2278/2372 symbols completed. WBX took 38.2s. Estimated remaining: 12m 30s. Rate: 7.5 symbols/min [2025-09-22T22:02:54.924331] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-22T22:02:55.770923] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-22T22:02:55.774756] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-22T22:02:56.510450] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T22:02:56.521993] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-22T22:02:56.687379] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-22T22:02:57.322045] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-22T22:02:57.352530] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T22:02:58.122055] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-22T22:02:59.034296] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-22T22:02:59.034671] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T22:02:59.047916] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-22T22:02:59.722068] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-22T22:03:00.012264] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-22T22:03:00.522057] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-22T22:03:01.681473] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T22:03:01.685283] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-22T22:03:01.722025] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-22T22:03:02.122174] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-22T22:03:04.056509] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-22T22:03:04.059874] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-22T22:03:05.190674] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-22T22:03:05.196836] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-22T22:03:05.295923] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (3.17 seconds). [2025-09-22T22:03:05.307632] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-22T22:03:06.192851] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-22T22:03:06.197246] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-22T22:03:06.931938] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-22T22:03:06.940557] [INFO ] [REMOTE ] WCN: Full fetch complete (69299 records). [2025-09-22T22:03:06.940819] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-22T22:03:07.377097] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-22T22:03:07.377252] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-22T22:03:07.379626] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-22T22:03:07.379750] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-22T22:03:07.384892] [DEBUG] [LOCAL ] WCN: Trimmed 69299 records to 48072 (keeping 200 days of data) [2025-09-22T22:03:07.508623] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T22:03:07.516114] [INFO ] [REMOTE ] WDH: Full fetch complete (22497 records). [2025-09-22T22:03:07.516449] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-22T22:03:07.923749] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-22T22:03:07.925931] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-22T22:03:07.930551] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-22T22:03:07.930729] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-22T22:03:07.988834] [DEBUG] [LOCAL ] WDH: Trimmed 22497 records to 16899 (keeping 200 days of data) [2025-09-22T22:03:08.218286] [DEBUG] [LOCAL ] WCN: Primary data saved (48072 records). [2025-09-22T22:03:08.219003] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-22T22:03:08.221662] [INFO ] [MAIN ] Update Progress: 2279/2372 symbols completed. WCN took 38.9s. Estimated remaining: 12m 22s. Rate: 7.5 symbols/min [2025-09-22T22:03:08.224201] [DEBUG] [LOCAL ] WDH: Primary data saved (16899 records). [2025-09-22T22:03:08.224438] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-22T22:03:08.224543] [INFO ] [MAIN ] Update Progress: 2280/2372 symbols completed. WDH took 14.7s. Estimated remaining: 12m 14s. Rate: 7.5 symbols/min [2025-09-22T22:03:08.853349] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:03:08.900590] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:03:08.915473] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:03:09.011605] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:03:09.015362] [DEBUG] [LOCAL ] WEA: Loaded 7581 existing records from primary storage. [2025-09-22T22:03:09.015857] [INFO ] [MAIN ] WEA: Loaded 7581 existing records. [2025-09-22T22:03:09.149761] [DEBUG] [LOCAL ] WDI: Loaded 21570 existing records from primary storage. [2025-09-22T22:03:09.171353] [INFO ] [MAIN ] WDI: Loaded 21570 existing records. [2025-09-22T22:03:09.278941] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:03:09.301617] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-22T22:03:09.296015] [DEBUG] [LOCAL ] WEAV: Loaded 42702 existing records from primary storage. [2025-09-22T22:03:09.308347] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-22T22:03:09.319055] [INFO ] [MAIN ] WEAV: Loaded 42702 existing records. [2025-09-22T22:03:09.374984] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-22T22:03:09.420202] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-22T22:03:09.460197] [DEBUG] [LOCAL ] WDS: Loaded 44456 existing records from primary storage. [2025-09-22T22:03:09.515892] [INFO ] [MAIN ] WDS: Loaded 44456 existing records. [2025-09-22T22:03:09.737542] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:03:09.861231] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-22T22:03:09.884023] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-22T22:03:09.948814] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:03:09.983923] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-22T22:03:10.008540] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-22T22:03:10.008784] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-22T22:03:10.025179] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-22T22:03:10.064536] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:03:10.075371] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-22T22:03:10.100698] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-22T22:03:10.136244] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-22T22:03:10.249518] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-22T22:03:10.374594] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-22T22:03:10.412978] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-22T22:03:10.928918] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:03:11.015096] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-22T22:03:11.307106] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:03:11.347105] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-22T22:03:11.442769] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:03:11.449737] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-22T22:03:11.560249] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:03:11.560540] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-22T22:03:11.801347] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-22T22:03:11.803806] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-22T22:03:12.495589] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-22T22:03:12.497898] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-22T22:03:12.617493] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-22T22:03:12.623890] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-22T22:03:12.912021] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T22:03:12.922274] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-22T22:03:13.066705] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-22T22:03:13.068368] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-22T22:03:13.320750] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T22:03:13.330984] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-22T22:03:13.724072] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-22T22:03:13.766500] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-22T22:03:14.122072] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-22T22:03:14.922086] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-22T22:03:15.052335] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-22T22:03:15.558044] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T22:03:15.722027] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-22T22:03:15.753224] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-22T22:03:15.998115] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-22T22:03:16.522018] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-22T22:03:16.677239] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-22T22:03:17.322076] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-22T22:03:17.571468] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T22:03:18.122058] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-22T22:03:18.897885] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-22T22:03:18.922051] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-22T22:03:19.615861] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-22T22:03:19.722065] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-22T22:03:20.522071] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-22T22:03:20.649551] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T22:03:21.282818] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T22:03:21.322002] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-22T22:03:21.347463] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-22T22:03:22.122053] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-22T22:03:22.922619] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-22T22:03:22.927771] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T22:03:22.994973] [DEBUG] [REMOTE ] WDI: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-22T22:03:22.995108] [WARN ] [REMOTE ] WDI: No data returned for month 2025-05 [2025-09-22T22:03:23.351584] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-22T22:03:23.722062] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-22T22:03:24.522060] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-22T22:03:25.236393] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-22T22:03:25.322111] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-22T22:03:25.577169] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-22T22:03:26.122066] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-22T22:03:26.609586] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T22:03:26.815897] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-22T22:03:26.922060] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-22T22:03:27.722023] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-22T22:03:27.731420] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-22T22:03:28.522057] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-22T22:03:29.322064] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-22T22:03:29.400684] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-22T22:03:29.420250] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-22T22:03:30.122064] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-22T22:03:30.778529] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-22T22:03:30.922135] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-22T22:03:31.619172] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-22T22:03:31.622872] [INFO ] [REMOTE ] WEA: Full fetch complete (9950 records). [2025-09-22T22:03:31.623134] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-22T22:03:31.724745] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-22T22:03:31.962507] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-22T22:03:32.091196] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-22T22:03:32.091285] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-22T22:03:32.091556] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-22T22:03:32.091613] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-22T22:03:32.092098] [DEBUG] [LOCAL ] WEA: Trimmed 9950 records to 7369 (keeping 200 days of data) [2025-09-22T22:03:32.139231] [DEBUG] [LOCAL ] WEA: Primary data saved (7369 records). [2025-09-22T22:03:32.139342] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-22T22:03:32.139445] [INFO ] [MAIN ] Update Progress: 2281/2372 symbols completed. WEA took 23.9s. Estimated remaining: 12m 6s. Rate: 7.5 symbols/min [2025-09-22T22:03:32.307510] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:03:32.375014] [DEBUG] [LOCAL ] WEC: Loaded 52982 existing records from primary storage. [2025-09-22T22:03:32.375164] [INFO ] [MAIN ] WEC: Loaded 52982 existing records. [2025-09-22T22:03:32.524150] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-22T22:03:32.561576] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:03:32.561805] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-22T22:03:32.561853] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-22T22:03:32.563269] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-22T22:03:32.563345] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-22T22:03:32.920679] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:03:33.292741] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-22T22:03:33.322007] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-22T22:03:33.894796] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-22T22:03:34.122092] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-22T22:03:34.922029] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-22T22:03:35.177383] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T22:03:35.233226] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T22:03:35.722126] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-22T22:03:36.404458] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T22:03:36.411526] [INFO ] [REMOTE ] WEAV: Full fetch complete (61632 records). [2025-09-22T22:03:36.411717] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-22T22:03:36.522919] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-22T22:03:36.626734] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-22T22:03:36.715224] [INFO ] [REMOTE ] WDI: Full fetch complete (27622 records). [2025-09-22T22:03:36.741963] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-22T22:03:37.051785] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-22T22:03:37.064076] [WARN ] [VALIDATOR ] WDI: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-22T22:03:37.064502] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-22T22:03:37.065797] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-22T22:03:37.065878] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-22T22:03:37.066292] [FATAL] [MAIN ] WDI: Fetched primary data is invalid. Refusing to save it. [2025-09-22T22:03:37.066667] [WARN ] [MAIN ] WDI: Deleting existing primary and derivative data due to validation failure. [2025-09-22T22:03:37.066848] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-22T22:03:37.067022] [DEBUG] [LOCAL ] WDI: No primary data file found to delete. [2025-09-22T22:03:37.067142] [INFO ] [LOCAL ] WDI: Starting deletion of derivative data. [2025-09-22T22:03:37.067566] [DEBUG] [LOCAL ] WEAV: Trimmed 61632 records to 42103 (keeping 200 days of data) [2025-09-22T22:03:37.068218] [DEBUG] [LOCAL ] WDI: Deleted derivative data file. [2025-09-22T22:03:37.068676] [INFO ] [MAIN ] Update Progress: 2282/2372 symbols completed. WDI took 28.8s. Estimated remaining: 11m 58s. Rate: 7.5 symbols/min [2025-09-22T22:03:37.328405] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-22T22:03:37.354903] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:03:37.502275] [DEBUG] [LOCAL ] WEAV: Primary data saved (42103 records). [2025-09-22T22:03:37.516826] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-22T22:03:37.517036] [INFO ] [MAIN ] Update Progress: 2283/2372 symbols completed. WEAV took 29.3s. Estimated remaining: 11m 50s. Rate: 7.5 symbols/min [2025-09-22T22:03:37.674965] [DEBUG] [LOCAL ] WELL: Loaded 53136 existing records from primary storage. [2025-09-22T22:03:37.688769] [INFO ] [MAIN ] WELL: Loaded 53136 existing records. [2025-09-22T22:03:37.774412] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:03:37.894747] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:03:37.894984] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-22T22:03:37.895032] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-22T22:03:37.897077] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-22T22:03:37.897201] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-22T22:03:38.182939] [DEBUG] [LOCAL ] WES: Loaded 48807 existing records from primary storage. [2025-09-22T22:03:38.200419] [INFO ] [MAIN ] WES: Loaded 48807 existing records. [2025-09-22T22:03:38.372400] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:03:38.405828] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-22T22:03:38.530763] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-22T22:03:38.530894] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:03:38.539990] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-22T22:03:38.540063] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-22T22:03:38.541879] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-22T22:03:38.541942] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-22T22:03:38.901767] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:03:38.922002] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-22T22:03:39.032666] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-22T22:03:39.722075] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-22T22:03:40.227308] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-22T22:03:40.459561] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T22:03:40.522037] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-22T22:03:41.322088] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-22T22:03:41.392200] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-22T22:03:42.000922] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-22T22:03:42.007625] [INFO ] [REMOTE ] WDS: Full fetch complete (64865 records). [2025-09-22T22:03:42.007749] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-22T22:03:42.127222] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-22T22:03:42.407560] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-22T22:03:42.407662] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-22T22:03:42.408912] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-22T22:03:42.408975] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-22T22:03:42.410321] [DEBUG] [LOCAL ] WDS: Trimmed 64865 records to 43685 (keeping 200 days of data) [2025-09-22T22:03:42.689708] [DEBUG] [LOCAL ] WDS: Primary data saved (43685 records). [2025-09-22T22:03:42.689843] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-22T22:03:42.689927] [INFO ] [MAIN ] Update Progress: 2284/2372 symbols completed. WDS took 34.5s. Estimated remaining: 11m 42s. Rate: 7.5 symbols/min [2025-09-22T22:03:42.869428] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:03:42.913612] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T22:03:42.923897] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-22T22:03:42.957140] [DEBUG] [LOCAL ] WEX: Loaded 36192 existing records from primary storage. [2025-09-22T22:03:42.957301] [INFO ] [MAIN ] WEX: Loaded 36192 existing records. [2025-09-22T22:03:43.136698] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:03:43.137016] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-22T22:03:43.137087] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-22T22:03:43.138032] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-22T22:03:43.138094] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-22T22:03:43.497454] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:03:43.722144] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-22T22:03:44.002348] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-22T22:03:44.522054] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-22T22:03:44.557409] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-22T22:03:45.054682] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-22T22:03:45.322076] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-22T22:03:46.122072] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-22T22:03:46.433624] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T22:03:46.922042] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-22T22:03:47.114770] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T22:03:47.573069] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T22:03:47.722059] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-22T22:03:48.522069] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-22T22:03:48.735371] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T22:03:49.009628] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T22:03:49.322083] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-22T22:03:50.122027] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-22T22:03:50.449723] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T22:03:50.922039] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-22T22:03:50.979515] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-22T22:03:51.722032] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-22T22:03:51.893550] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-22T22:03:52.432180] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-22T22:03:52.522014] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-22T22:03:53.202613] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T22:03:53.322022] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-22T22:03:53.729994] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-22T22:03:54.122067] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-22T22:03:54.922032] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-22T22:03:55.115573] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T22:03:55.727183] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-22T22:03:55.746771] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-22T22:03:56.491583] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-22T22:03:56.522033] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-22T22:03:57.322027] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-22T22:03:57.474137] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-22T22:03:57.989086] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T22:03:58.122096] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-22T22:03:58.922063] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-22T22:03:59.057375] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-22T22:03:59.722035] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-22T22:04:00.127143] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-22T22:04:00.186056] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T22:04:00.522059] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-22T22:04:01.322021] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-22T22:04:01.771914] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-22T22:04:01.820977] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-22T22:04:02.122062] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-22T22:04:02.486196] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-22T22:04:02.922076] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-22T22:04:03.722080] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-22T22:04:03.994292] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-22T22:04:04.527126] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-22T22:04:04.544611] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-22T22:04:04.583632] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-22T22:04:04.591837] [INFO ] [REMOTE ] WEC: Full fetch complete (75450 records). [2025-09-22T22:04:04.591992] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-22T22:04:04.984951] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-22T22:04:04.985044] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-22T22:04:04.986271] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-22T22:04:04.986349] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-22T22:04:04.987877] [DEBUG] [LOCAL ] WEC: Trimmed 75450 records to 52216 (keeping 200 days of data) [2025-09-22T22:04:05.322158] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-22T22:04:05.328012] [DEBUG] [LOCAL ] WEC: Primary data saved (52216 records). [2025-09-22T22:04:05.328309] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-22T22:04:05.329274] [INFO ] [MAIN ] Update Progress: 2285/2372 symbols completed. WEC took 33.2s. Estimated remaining: 11m 35s. Rate: 7.5 symbols/min [2025-09-22T22:04:05.500187] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:04:05.515083] [DEBUG] [LOCAL ] WF: Loaded 11233 existing records from primary storage. [2025-09-22T22:04:05.515212] [INFO ] [MAIN ] WF: Loaded 11233 existing records. [2025-09-22T22:04:05.699938] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:04:05.700199] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-22T22:04:05.700248] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-22T22:04:05.700728] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-22T22:04:05.700788] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-22T22:04:06.106389] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:04:06.124276] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-22T22:04:06.130319] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-22T22:04:06.922031] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-22T22:04:07.153587] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-22T22:04:07.176004] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T22:04:07.722103] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-22T22:04:08.522019] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-22T22:04:08.562531] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-22T22:04:08.712375] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T22:04:09.322018] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-22T22:04:09.690015] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T22:04:09.695239] [INFO ] [REMOTE ] WEX: Full fetch complete (50811 records). [2025-09-22T22:04:09.695362] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-22T22:04:10.085254] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-22T22:04:10.085379] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-22T22:04:10.086525] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-22T22:04:10.086589] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-22T22:04:10.087786] [DEBUG] [LOCAL ] WEX: Trimmed 50811 records to 35529 (keeping 200 days of data) [2025-09-22T22:04:10.139439] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-22T22:04:10.310306] [DEBUG] [LOCAL ] WEX: Primary data saved (35529 records). [2025-09-22T22:04:10.310455] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-22T22:04:10.310541] [INFO ] [MAIN ] Update Progress: 2286/2372 symbols completed. WEX took 27.6s. Estimated remaining: 11m 26s. Rate: 7.5 symbols/min [2025-09-22T22:04:10.496887] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:04:10.552021] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-22T22:04:10.552180] [INFO ] [MAIN ] WFC: Loaded 54528 existing records. [2025-09-22T22:04:10.732363] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:04:10.733025] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-22T22:04:10.733140] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-22T22:04:10.734688] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-22T22:04:10.734752] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-22T22:04:10.943706] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-22T22:04:11.079981] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-22T22:04:11.137575] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:04:11.186462] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-22T22:04:11.722063] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-22T22:04:12.306731] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-22T22:04:12.315166] [INFO ] [REMOTE ] WELL: Full fetch complete (75722 records). [2025-09-22T22:04:12.315287] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-22T22:04:12.527107] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-22T22:04:12.744822] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-22T22:04:12.775135] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-22T22:04:12.775309] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-22T22:04:12.776620] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-22T22:04:12.776730] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-22T22:04:12.776971] [INFO ] [REMOTE ] WES: Full fetch complete (69674 records). [2025-09-22T22:04:12.777061] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-22T22:04:12.842560] [DEBUG] [LOCAL ] WELL: Trimmed 75722 records to 52364 (keeping 200 days of data) [2025-09-22T22:04:13.301208] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-22T22:04:13.308513] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-22T22:04:13.314459] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-22T22:04:13.314578] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-22T22:04:13.370215] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-22T22:04:13.413177] [DEBUG] [LOCAL ] WES: Trimmed 69674 records to 48034 (keeping 200 days of data) [2025-09-22T22:04:13.745457] [DEBUG] [LOCAL ] WELL: Primary data saved (52364 records). [2025-09-22T22:04:13.748162] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-22T22:04:13.748573] [INFO ] [MAIN ] Update Progress: 2287/2372 symbols completed. WELL took 36.7s. Estimated remaining: 11m 18s. Rate: 7.5 symbols/min [2025-09-22T22:04:13.935276] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:04:14.008048] [DEBUG] [LOCAL ] WFG: Loaded 25529 existing records from primary storage. [2025-09-22T22:04:14.009056] [INFO ] [MAIN ] WFG: Loaded 25529 existing records. [2025-09-22T22:04:14.221027] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:04:14.223180] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-22T22:04:14.223865] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-22T22:04:14.225923] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-22T22:04:14.226017] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-22T22:04:14.256357] [DEBUG] [LOCAL ] WES: Primary data saved (48034 records). [2025-09-22T22:04:14.257052] [INFO ] [MAIN ] WES: Full history saved. [2025-09-22T22:04:14.266905] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-22T22:04:14.277746] [INFO ] [MAIN ] Update Progress: 2288/2372 symbols completed. WES took 36.8s. Estimated remaining: 11m 10s. Rate: 7.5 symbols/min [2025-09-22T22:04:14.312217] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-22T22:04:14.730119] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:04:14.813441] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:04:14.848935] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-22T22:04:14.887016] [DEBUG] [LOCAL ] WGO: Loaded 40204 existing records from primary storage. [2025-09-22T22:04:14.887176] [INFO ] [MAIN ] WGO: Loaded 40204 existing records. [2025-09-22T22:04:14.930621] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-22T22:04:15.077776] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:04:15.078224] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-22T22:04:15.078336] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-22T22:04:15.087258] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-22T22:04:15.087410] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-22T22:04:15.093482] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-22T22:04:15.454262] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:04:15.722061] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-22T22:04:16.522061] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-22T22:04:17.043737] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-22T22:04:17.178386] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-22T22:04:17.313330] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-22T22:04:17.321997] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-22T22:04:18.069109] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-22T22:04:18.122003] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-22T22:04:18.806999] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-22T22:04:18.922107] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-22T22:04:19.572841] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-22T22:04:19.722063] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-22T22:04:20.522052] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-22T22:04:21.265322] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-22T22:04:21.322013] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-22T22:04:22.094552] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-22T22:04:22.122100] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-22T22:04:22.302535] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-22T22:04:22.922071] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-22T22:04:23.722026] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-22T22:04:23.799843] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-22T22:04:23.997806] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-22T22:04:24.235338] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-22T22:04:24.238469] [INFO ] [REMOTE ] WF: Full fetch complete (16826 records). [2025-09-22T22:04:24.238608] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-22T22:04:24.527324] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-22T22:04:24.723512] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-22T22:04:24.723674] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-22T22:04:24.724445] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-22T22:04:24.724537] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-22T22:04:24.725711] [DEBUG] [LOCAL ] WF: Trimmed 16826 records to 10918 (keeping 200 days of data) [2025-09-22T22:04:24.813095] [DEBUG] [LOCAL ] WF: Primary data saved (10918 records). [2025-09-22T22:04:24.813265] [INFO ] [MAIN ] WF: Full history saved. [2025-09-22T22:04:24.813361] [INFO ] [MAIN ] Update Progress: 2289/2372 symbols completed. WF took 19.5s. Estimated remaining: 11m 2s. Rate: 7.5 symbols/min [2025-09-22T22:04:25.039912] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:04:25.110894] [DEBUG] [LOCAL ] WH: Loaded 46601 existing records from primary storage. [2025-09-22T22:04:25.111087] [INFO ] [MAIN ] WH: Loaded 46601 existing records. [2025-09-22T22:04:25.302287] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:04:25.302566] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-22T22:04:25.302616] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-22T22:04:25.303754] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-22T22:04:25.303813] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-22T22:04:25.327347] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-22T22:04:25.671011] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:04:26.122048] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-22T22:04:26.515103] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-22T22:04:26.776081] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-22T22:04:26.922063] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-22T22:04:27.382433] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-22T22:04:27.722072] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-22T22:04:28.522043] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-22T22:04:28.679494] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T22:04:28.789355] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T22:04:29.322049] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-22T22:04:30.108154] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T22:04:30.122003] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-22T22:04:30.877318] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T22:04:30.922022] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-22T22:04:31.318120] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T22:04:31.722051] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-22T22:04:32.076869] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-22T22:04:32.522069] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-22T22:04:33.322080] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-22T22:04:33.599679] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-22T22:04:34.095779] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T22:04:34.122175] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-22T22:04:34.207861] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-22T22:04:34.922061] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-22T22:04:35.722053] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-22T22:04:35.755192] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-22T22:04:36.522118] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-22T22:04:36.903770] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-22T22:04:37.193238] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-22T22:04:37.322065] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-22T22:04:37.970895] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-22T22:04:38.122045] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-22T22:04:38.884127] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T22:04:38.922012] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-22T22:04:39.722070] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-22T22:04:40.281181] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-22T22:04:40.507081] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-22T22:04:40.522016] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-22T22:04:40.968310] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-22T22:04:40.974375] [INFO ] [REMOTE ] WGO: Full fetch complete (57284 records). [2025-09-22T22:04:40.974488] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-22T22:04:41.327184] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-22T22:04:41.381806] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-22T22:04:41.381938] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-22T22:04:41.383180] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-22T22:04:41.383247] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-22T22:04:41.384557] [DEBUG] [LOCAL ] WGO: Trimmed 57284 records to 39435 (keeping 200 days of data) [2025-09-22T22:04:41.631978] [DEBUG] [LOCAL ] WGO: Primary data saved (39435 records). [2025-09-22T22:04:41.632136] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-22T22:04:41.632243] [INFO ] [MAIN ] Update Progress: 2290/2372 symbols completed. WGO took 27.3s. Estimated remaining: 10m 54s. Rate: 7.5 symbols/min [2025-09-22T22:04:41.801331] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:04:41.840610] [DEBUG] [LOCAL ] WHD: Loaded 41385 existing records from primary storage. [2025-09-22T22:04:41.840792] [INFO ] [MAIN ] WHD: Loaded 41385 existing records. [2025-09-22T22:04:42.019391] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:04:42.019687] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-22T22:04:42.019745] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-22T22:04:42.020590] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-22T22:04:42.020685] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-22T22:04:42.126418] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-22T22:04:42.399091] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:04:42.539695] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-22T22:04:42.669519] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-22T22:04:42.922061] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-22T22:04:43.403701] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-22T22:04:43.656796] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-22T22:04:43.722061] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-22T22:04:44.522037] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-22T22:04:44.722827] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-22T22:04:45.322041] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-22T22:04:46.122055] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-22T22:04:46.218497] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-22T22:04:46.554092] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-22T22:04:46.922042] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-22T22:04:47.492793] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T22:04:47.501562] [INFO ] [REMOTE ] WFC: Full fetch complete (77790 records). [2025-09-22T22:04:47.501735] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-22T22:04:47.690458] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-22T22:04:47.733108] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-22T22:04:47.945477] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-22T22:04:47.945588] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-22T22:04:47.946850] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-22T22:04:47.946917] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-22T22:04:47.948435] [DEBUG] [LOCAL ] WFC: Trimmed 77790 records to 53748 (keeping 200 days of data) [2025-09-22T22:04:48.288010] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-09-22T22:04:48.288154] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-22T22:04:48.288241] [INFO ] [MAIN ] Update Progress: 2291/2372 symbols completed. WFC took 38.0s. Estimated remaining: 10m 46s. Rate: 7.5 symbols/min [2025-09-22T22:04:48.458678] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:04:48.466109] [DEBUG] [LOCAL ] WHG: Loaded 3455 existing records from primary storage. [2025-09-22T22:04:48.466208] [INFO ] [MAIN ] WHG: Loaded 3455 existing records. [2025-09-22T22:04:48.532600] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-22T22:04:48.653698] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:04:48.654039] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-22T22:04:48.654107] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-22T22:04:48.654483] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-22T22:04:48.654553] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-22T22:04:49.036726] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:04:49.038158] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T22:04:49.322026] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-22T22:04:49.697290] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T22:04:49.965250] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-22T22:04:50.122060] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-22T22:04:50.922071] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-22T22:04:51.598350] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-22T22:04:51.631200] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T22:04:51.722009] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-22T22:04:52.522064] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-22T22:04:53.238497] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-22T22:04:53.245959] [INFO ] [REMOTE ] WH: Full fetch complete (65012 records). [2025-09-22T22:04:53.246138] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-22T22:04:53.327262] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-22T22:04:53.645578] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-22T22:04:53.645759] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-22T22:04:53.646949] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-22T22:04:53.647018] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-22T22:04:53.648502] [DEBUG] [LOCAL ] WH: Trimmed 65012 records to 45898 (keeping 200 days of data) [2025-09-22T22:04:53.907021] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-22T22:04:53.980338] [DEBUG] [LOCAL ] WH: Primary data saved (45898 records). [2025-09-22T22:04:53.980512] [INFO ] [MAIN ] WH: Full history saved. [2025-09-22T22:04:53.980613] [INFO ] [MAIN ] Update Progress: 2292/2372 symbols completed. WH took 29.2s. Estimated remaining: 10m 38s. Rate: 7.5 symbols/min [2025-09-22T22:04:54.129960] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-22T22:04:54.158290] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:04:54.206756] [DEBUG] [LOCAL ] WHR: Loaded 48879 existing records from primary storage. [2025-09-22T22:04:54.206999] [INFO ] [MAIN ] WHR: Loaded 48879 existing records. [2025-09-22T22:04:54.388594] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:04:54.388894] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-22T22:04:54.389107] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-22T22:04:54.390343] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-22T22:04:54.390404] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-22T22:04:54.542218] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-22T22:04:54.582149] [INFO ] [REMOTE ] WFG: Full fetch complete (35598 records). [2025-09-22T22:04:54.631211] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-22T22:04:54.945209] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-22T22:04:54.957771] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:04:55.152743] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-22T22:04:55.152827] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-22T22:04:55.153586] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-22T22:04:55.153627] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-22T22:04:55.154425] [DEBUG] [LOCAL ] WFG: Trimmed 35598 records to 24971 (keeping 200 days of data) [2025-09-22T22:04:55.304121] [DEBUG] [LOCAL ] WFG: Primary data saved (24971 records). [2025-09-22T22:04:55.304257] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-22T22:04:55.304341] [INFO ] [MAIN ] Update Progress: 2293/2372 symbols completed. WFG took 41.6s. Estimated remaining: 10m 30s. Rate: 7.5 symbols/min [2025-09-22T22:04:55.473504] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:04:55.480479] [DEBUG] [LOCAL ] WIA: Loaded 4942 existing records from primary storage. [2025-09-22T22:04:55.480584] [INFO ] [MAIN ] WIA: Loaded 4942 existing records. [2025-09-22T22:04:55.663235] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:04:55.667048] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-22T22:04:55.666925] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-22T22:04:55.668581] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-22T22:04:55.668879] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-22T22:04:55.668938] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-22T22:04:55.735390] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-22T22:04:56.036426] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:04:56.061227] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-22T22:04:56.522074] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-22T22:04:57.091246] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-22T22:04:57.322064] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-22T22:04:57.519468] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-22T22:04:57.948143] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-22T22:04:58.122091] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-22T22:04:58.922155] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-22T22:04:59.490861] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-22T22:04:59.722031] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-22T22:04:59.894995] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-22T22:05:00.359361] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-22T22:05:00.522090] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-22T22:05:01.322067] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-22T22:05:02.127371] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-22T22:05:02.143780] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T22:05:02.740736] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-22T22:05:02.922038] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-22T22:05:03.017424] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T22:05:03.669930] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-22T22:05:03.722003] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-22T22:05:04.332131] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-22T22:05:04.522065] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-22T22:05:05.120552] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-22T22:05:05.322058] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-22T22:05:05.911415] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-22T22:05:06.122056] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-22T22:05:06.823917] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-22T22:05:06.922076] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-22T22:05:07.722062] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-22T22:05:08.207367] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-22T22:05:08.500236] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-22T22:05:08.522059] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-22T22:05:09.322067] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-22T22:05:09.879504] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T22:05:10.122091] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-22T22:05:10.767997] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-22T22:05:10.922028] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-22T22:05:11.189132] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-22T22:05:11.506440] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T22:05:11.722078] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-22T22:05:12.522071] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-22T22:05:13.253260] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T22:05:13.322016] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-22T22:05:13.879866] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-22T22:05:14.122036] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-22T22:05:14.459041] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T22:05:14.922085] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-22T22:05:15.347195] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T22:05:15.377609] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-22T22:05:15.378573] [INFO ] [REMOTE ] WHG: Full fetch complete (4702 records). [2025-09-22T22:05:15.378698] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-22T22:05:15.723542] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-22T22:05:15.751171] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-22T22:05:15.751235] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-22T22:05:15.751387] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-22T22:05:15.751466] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-22T22:05:15.751991] [DEBUG] [LOCAL ] WHG: Trimmed 4702 records to 3418 (keeping 200 days of data) [2025-09-22T22:05:15.778112] [DEBUG] [LOCAL ] WHG: Primary data saved (3418 records). [2025-09-22T22:05:15.778233] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-22T22:05:15.778377] [INFO ] [MAIN ] Update Progress: 2294/2372 symbols completed. WHG took 27.5s. Estimated remaining: 10m 23s. Rate: 7.5 symbols/min [2025-09-22T22:05:15.947907] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:05:15.962783] [DEBUG] [LOCAL ] WINN: Loaded 12083 existing records from primary storage. [2025-09-22T22:05:15.962913] [INFO ] [MAIN ] WINN: Loaded 12083 existing records. [2025-09-22T22:05:16.154741] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:05:16.155347] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-22T22:05:16.155436] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-22T22:05:16.155902] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-22T22:05:16.155975] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-22T22:05:16.459390] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-22T22:05:16.526167] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-22T22:05:16.530055] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:05:17.322082] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-22T22:05:18.122144] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-22T22:05:18.311242] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T22:05:18.338819] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-22T22:05:18.922093] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-22T22:05:19.453792] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-22T22:05:19.461879] [INFO ] [REMOTE ] WHD: Full fetch complete (57083 records). [2025-09-22T22:05:19.462059] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-22T22:05:19.727142] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-22T22:05:19.840706] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-22T22:05:19.881835] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-22T22:05:19.881926] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-22T22:05:19.883056] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-22T22:05:19.883123] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-22T22:05:19.885784] [DEBUG] [LOCAL ] WHD: Trimmed 57083 records to 40594 (keeping 200 days of data) [2025-09-22T22:05:20.142629] [DEBUG] [LOCAL ] WHD: Primary data saved (40594 records). [2025-09-22T22:05:20.142790] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-22T22:05:20.142898] [INFO ] [MAIN ] Update Progress: 2295/2372 symbols completed. WHD took 38.5s. Estimated remaining: 10m 15s. Rate: 7.5 symbols/min [2025-09-22T22:05:20.362938] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:05:20.418820] [DEBUG] [LOCAL ] WIT: Loaded 53032 existing records from primary storage. [2025-09-22T22:05:20.418983] [INFO ] [MAIN ] WIT: Loaded 53032 existing records. [2025-09-22T22:05:20.523520] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-22T22:05:20.613954] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:05:20.614192] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-22T22:05:20.614241] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-22T22:05:20.615447] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-22T22:05:20.615527] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-22T22:05:20.999038] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:05:21.322034] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-22T22:05:21.499006] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-22T22:05:21.574696] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-22T22:05:21.813380] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-22T22:05:21.816039] [INFO ] [REMOTE ] WIA: Full fetch complete (7320 records). [2025-09-22T22:05:21.816134] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-22T22:05:22.127165] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-22T22:05:22.199824] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-22T22:05:22.199900] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-22T22:05:22.200108] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-22T22:05:22.200176] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-22T22:05:22.200624] [DEBUG] [LOCAL ] WIA: Trimmed 7320 records to 4864 (keeping 200 days of data) [2025-09-22T22:05:22.235658] [DEBUG] [LOCAL ] WIA: Primary data saved (4864 records). [2025-09-22T22:05:22.235789] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-22T22:05:22.236045] [INFO ] [MAIN ] Update Progress: 2296/2372 symbols completed. WIA took 26.9s. Estimated remaining: 10m 6s. Rate: 7.5 symbols/min [2025-09-22T22:05:22.408269] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:05:22.438682] [DEBUG] [LOCAL ] WIW: Loaded 21115 existing records from primary storage. [2025-09-22T22:05:22.438843] [INFO ] [MAIN ] WIW: Loaded 21115 existing records. [2025-09-22T22:05:22.615420] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:05:22.615717] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-22T22:05:22.615804] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-22T22:05:22.616445] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-22T22:05:22.616515] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-22T22:05:22.926315] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-22T22:05:23.022461] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:05:23.034406] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T22:05:23.722055] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-22T22:05:24.522045] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-22T22:05:24.651468] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T22:05:24.812441] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T22:05:25.322070] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-22T22:05:26.122028] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-22T22:05:26.311257] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T22:05:26.922073] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-22T22:05:27.139040] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-22T22:05:27.173931] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T22:05:27.722072] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-22T22:05:28.306084] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-22T22:05:28.324589] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-22T22:05:28.522059] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-22T22:05:29.322071] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-22T22:05:29.609162] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-22T22:05:30.122071] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-22T22:05:30.930720] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-22T22:05:30.953162] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-22T22:05:31.711936] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-22T22:05:31.719531] [INFO ] [REMOTE ] WHR: Full fetch complete (68278 records). [2025-09-22T22:05:31.719724] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-22T22:05:31.731906] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-22T22:05:31.846260] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-22T22:05:32.138045] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-22T22:05:32.138122] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-22T22:05:32.139252] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-22T22:05:32.139357] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-22T22:05:32.142578] [DEBUG] [LOCAL ] WHR: Trimmed 68278 records to 48111 (keeping 200 days of data) [2025-09-22T22:05:32.461936] [DEBUG] [LOCAL ] WHR: Primary data saved (48111 records). [2025-09-22T22:05:32.462204] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-22T22:05:32.462353] [INFO ] [MAIN ] Update Progress: 2297/2372 symbols completed. WHR took 38.5s. Estimated remaining: 9m 58s. Rate: 7.5 symbols/min [2025-09-22T22:05:32.527185] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-22T22:05:32.639420] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:05:32.681067] [DEBUG] [LOCAL ] WK: Loaded 37113 existing records from primary storage. [2025-09-22T22:05:32.681209] [INFO ] [MAIN ] WK: Loaded 37113 existing records. [2025-09-22T22:05:32.810998] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-22T22:05:32.877323] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:05:32.877585] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-22T22:05:32.877633] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-22T22:05:32.878633] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-22T22:05:32.878728] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-22T22:05:33.240130] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:05:33.322063] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-22T22:05:33.338827] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-22T22:05:34.122064] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-22T22:05:34.922023] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-22T22:05:35.022808] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T22:05:35.358819] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T22:05:35.400477] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-22T22:05:35.722077] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-22T22:05:36.522097] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-22T22:05:37.322023] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-22T22:05:37.430717] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-22T22:05:37.479799] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T22:05:37.809420] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-22T22:05:37.811580] [INFO ] [REMOTE ] WINN: Full fetch complete (17703 records). [2025-09-22T22:05:37.811689] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-22T22:05:38.127204] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-22T22:05:38.212229] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-22T22:05:38.212320] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-22T22:05:38.212806] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-22T22:05:38.212873] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-22T22:05:38.213507] [DEBUG] [LOCAL ] WINN: Trimmed 17703 records to 11839 (keeping 200 days of data) [2025-09-22T22:05:38.286604] [DEBUG] [LOCAL ] WINN: Primary data saved (11839 records). [2025-09-22T22:05:38.286829] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-22T22:05:38.286939] [INFO ] [MAIN ] Update Progress: 2298/2372 symbols completed. WINN took 22.5s. Estimated remaining: 9m 50s. Rate: 7.5 symbols/min [2025-09-22T22:05:38.473874] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:05:38.521235] [DEBUG] [LOCAL ] WKC: Loaded 35885 existing records from primary storage. [2025-09-22T22:05:38.521383] [INFO ] [MAIN ] WKC: Loaded 35885 existing records. [2025-09-22T22:05:38.703160] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:05:38.703437] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-22T22:05:38.703487] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-22T22:05:38.704479] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-22T22:05:38.704541] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-22T22:05:38.927286] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-22T22:05:39.077339] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:05:39.263671] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-22T22:05:39.722071] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-22T22:05:40.522133] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-22T22:05:40.570304] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-22T22:05:41.267400] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T22:05:41.322030] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-22T22:05:42.122069] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-22T22:05:42.204769] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-22T22:05:42.284488] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-22T22:05:42.922059] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-22T22:05:43.596448] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-22T22:05:43.722070] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-22T22:05:44.181913] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-22T22:05:44.522051] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-22T22:05:44.847015] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-22T22:05:45.322070] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-22T22:05:45.924832] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-22T22:05:46.122051] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-22T22:05:46.491696] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-22T22:05:46.922165] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-22T22:05:47.682056] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-22T22:05:47.722103] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-22T22:05:48.460780] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-22T22:05:48.522074] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-22T22:05:49.198586] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-22T22:05:49.322002] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-22T22:05:50.122026] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-22T22:05:50.454207] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-22T22:05:50.695264] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-22T22:05:50.922136] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-22T22:05:51.678626] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-22T22:05:51.722070] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-22T22:05:52.522082] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-22T22:05:52.658094] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T22:05:53.189903] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T22:05:53.322043] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-22T22:05:53.558800] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-22T22:05:54.122054] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-22T22:05:54.922021] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-22T22:05:54.976571] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T22:05:54.985323] [INFO ] [REMOTE ] WIT: Full fetch complete (75547 records). [2025-09-22T22:05:54.985585] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-22T22:05:55.352388] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-22T22:05:55.416484] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-22T22:05:55.416598] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-22T22:05:55.418199] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-22T22:05:55.418266] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-22T22:05:55.419676] [DEBUG] [LOCAL ] WIT: Trimmed 75547 records to 52271 (keeping 200 days of data) [2025-09-22T22:05:55.722224] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-22T22:05:55.744892] [DEBUG] [LOCAL ] WIT: Primary data saved (52271 records). [2025-09-22T22:05:55.745106] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-22T22:05:55.745215] [INFO ] [MAIN ] Update Progress: 2299/2372 symbols completed. WIT took 35.6s. Estimated remaining: 9m 43s. Rate: 7.5 symbols/min [2025-09-22T22:05:55.918829] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:05:55.963850] [DEBUG] [LOCAL ] WLK: Loaded 45890 existing records from primary storage. [2025-09-22T22:05:55.963993] [INFO ] [MAIN ] WLK: Loaded 45890 existing records. [2025-09-22T22:05:56.169145] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T22:05:56.173861] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:05:56.181113] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-22T22:05:56.181226] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-22T22:05:56.182612] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-22T22:05:56.182705] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-22T22:05:56.535193] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:05:56.529285] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-22T22:05:56.768813] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-22T22:05:56.772888] [INFO ] [REMOTE ] WIW: Full fetch complete (30583 records). [2025-09-22T22:05:56.773000] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-22T22:05:57.141498] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-22T22:05:57.141582] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-22T22:05:57.142209] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-22T22:05:57.142283] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-22T22:05:57.143055] [DEBUG] [LOCAL ] WIW: Trimmed 30583 records to 20844 (keeping 200 days of data) [2025-09-22T22:05:57.277303] [DEBUG] [LOCAL ] WIW: Primary data saved (20844 records). [2025-09-22T22:05:57.277426] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-22T22:05:57.277527] [INFO ] [MAIN ] Update Progress: 2300/2372 symbols completed. WIW took 35.0s. Estimated remaining: 9m 35s. Rate: 7.5 symbols/min [2025-09-22T22:05:57.332571] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-22T22:05:57.450125] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:05:57.458609] [DEBUG] [LOCAL ] WLKP: Loaded 6645 existing records from primary storage. [2025-09-22T22:05:57.458745] [INFO ] [MAIN ] WLKP: Loaded 6645 existing records. [2025-09-22T22:05:57.637285] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:05:57.637545] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-22T22:05:57.637594] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-22T22:05:57.637924] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-22T22:05:57.637989] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-22T22:05:57.998767] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:05:58.021624] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T22:05:58.122015] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-22T22:05:58.722554] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-22T22:05:58.922041] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-22T22:05:59.525391] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-22T22:05:59.722138] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-22T22:05:59.790224] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-22T22:06:00.522063] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-22T22:06:01.182701] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T22:06:01.322125] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-22T22:06:02.122101] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-22T22:06:02.385284] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T22:06:02.906995] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T22:06:02.922014] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-22T22:06:03.722101] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-22T22:06:04.522042] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-22T22:06:04.544932] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-22T22:06:04.953430] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-22T22:06:05.322029] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-22T22:06:05.640092] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T22:06:05.695323] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-22T22:06:05.701507] [INFO ] [REMOTE ] WKC: Full fetch complete (51416 records). [2025-09-22T22:06:05.701633] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-22T22:06:06.078965] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-22T22:06:06.079045] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-22T22:06:06.080053] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-22T22:06:06.080117] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-22T22:06:06.081200] [DEBUG] [LOCAL ] WKC: Trimmed 51416 records to 35178 (keeping 200 days of data) [2025-09-22T22:06:06.149387] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-22T22:06:06.319705] [DEBUG] [LOCAL ] WKC: Primary data saved (35178 records). [2025-09-22T22:06:06.319882] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-22T22:06:06.319995] [INFO ] [MAIN ] Update Progress: 2301/2372 symbols completed. WKC took 28.0s. Estimated remaining: 9m 27s. Rate: 7.5 symbols/min [2025-09-22T22:06:06.511226] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:06:06.511402] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-22T22:06:06.511441] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-22T22:06:06.511594] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-22T22:06:06.511686] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-22T22:06:06.511759] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-22T22:06:06.511794] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-22T22:06:06.885819] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:06:06.922044] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-22T22:06:06.975431] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T22:06:07.549091] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T22:06:07.722155] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-22T22:06:07.818498] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-22T22:06:07.825097] [INFO ] [REMOTE ] WK: Full fetch complete (51916 records). [2025-09-22T22:06:07.825246] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-22T22:06:08.206071] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-22T22:06:08.206160] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-22T22:06:08.207189] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-22T22:06:08.207256] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-22T22:06:08.208446] [DEBUG] [LOCAL ] WK: Trimmed 51916 records to 36586 (keeping 200 days of data) [2025-09-22T22:06:08.432683] [DEBUG] [LOCAL ] WK: Primary data saved (36586 records). [2025-09-22T22:06:08.432840] [INFO ] [MAIN ] WK: Full history saved. [2025-09-22T22:06:08.432927] [INFO ] [MAIN ] Update Progress: 2302/2372 symbols completed. WK took 36.0s. Estimated remaining: 9m 18s. Rate: 7.5 symbols/min [2025-09-22T22:06:08.523849] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-22T22:06:08.546230] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-22T22:06:08.626046] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:06:08.659181] [DEBUG] [LOCAL ] WLY: Loaded 31011 existing records from primary storage. [2025-09-22T22:06:08.659329] [INFO ] [MAIN ] WLY: Loaded 31011 existing records. [2025-09-22T22:06:08.845815] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:06:08.846077] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-22T22:06:08.846124] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-22T22:06:08.846954] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-22T22:06:08.847013] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-22T22:06:09.213912] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:06:09.322078] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-22T22:06:10.039874] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T22:06:10.122091] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-22T22:06:10.195233] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T22:06:10.922087] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-22T22:06:11.530982] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-22T22:06:11.690637] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-22T22:06:11.722093] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-22T22:06:12.522116] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-22T22:06:12.919279] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-22T22:06:12.968703] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T22:06:13.322119] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-22T22:06:14.058400] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-22T22:06:14.122051] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-22T22:06:14.922064] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-22T22:06:15.333092] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T22:06:15.722061] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-22T22:06:16.331493] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-22T22:06:16.522047] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-22T22:06:16.561153] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-22T22:06:17.322064] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-22T22:06:17.520203] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-22T22:06:18.122096] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-22T22:06:18.922049] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-22T22:06:18.981677] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-22T22:06:19.546708] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-22T22:06:19.560416] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-22T22:06:19.722068] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-22T22:06:20.427698] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T22:06:20.430190] [INFO ] [REMOTE ] WLKP: Full fetch complete (10190 records). [2025-09-22T22:06:20.430268] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-22T22:06:20.527171] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-22T22:06:20.814123] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-22T22:06:20.814201] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-22T22:06:20.814446] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-22T22:06:20.814483] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-22T22:06:20.814940] [DEBUG] [LOCAL ] WLKP: Trimmed 10190 records to 6638 (keeping 200 days of data) [2025-09-22T22:06:20.854320] [DEBUG] [LOCAL ] WLKP: Primary data saved (6638 records). [2025-09-22T22:06:20.854408] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-22T22:06:20.854484] [INFO ] [MAIN ] Update Progress: 2303/2372 symbols completed. WLKP took 23.6s. Estimated remaining: 9m 11s. Rate: 7.5 symbols/min [2025-09-22T22:06:21.026440] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:06:21.089419] [DEBUG] [LOCAL ] WM: Loaded 51728 existing records from primary storage. [2025-09-22T22:06:21.089582] [INFO ] [MAIN ] WM: Loaded 51728 existing records. [2025-09-22T22:06:21.266838] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:06:21.267088] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-22T22:06:21.267135] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-22T22:06:21.268571] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-22T22:06:21.268630] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-22T22:06:21.331378] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-22T22:06:21.622364] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:06:22.122023] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-22T22:06:22.154907] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-22T22:06:22.484046] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-22T22:06:22.682166] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T22:06:22.922103] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-22T22:06:23.722063] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-22T22:06:24.175109] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-22T22:06:24.522030] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-22T22:06:24.685164] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-22T22:06:25.005745] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-22T22:06:25.322047] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-22T22:06:26.122055] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-22T22:06:26.462228] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-22T22:06:26.921992] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-22T22:06:27.083220] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T22:06:27.426371] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-22T22:06:27.722075] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-22T22:06:28.171466] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-22T22:06:28.522070] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-22T22:06:29.322068] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-22T22:06:30.122045] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-22T22:06:30.376552] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T22:06:30.678857] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-22T22:06:30.922108] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-22T22:06:31.296160] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-22T22:06:31.297255] [INFO ] [REMOTE ] WLTG: Full fetch complete (1667 records). [2025-09-22T22:06:31.297507] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-22T22:06:31.496040] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T22:06:31.496438] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-22T22:06:31.496602] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-22T22:06:31.496781] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-22T22:06:31.496884] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-22T22:06:31.496941] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-22T22:06:31.496984] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-22T22:06:31.497045] [INFO ] [MAIN ] Update Progress: 2304/2372 symbols completed. WLTG took 25.2s. Estimated remaining: 9m 3s. Rate: 7.5 symbols/min [2025-09-22T22:06:31.666423] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:06:31.720882] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-22T22:06:31.721030] [INFO ] [MAIN ] WMB: Loaded 54451 existing records. [2025-09-22T22:06:31.732352] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-22T22:06:31.905924] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:06:31.955260] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-22T22:06:31.960513] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-22T22:06:31.973400] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-22T22:06:31.973544] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-22T22:06:32.041096] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T22:06:32.339827] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:06:32.522097] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-22T22:06:33.322077] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-22T22:06:33.747571] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-22T22:06:33.842488] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T22:06:34.122078] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-22T22:06:34.922024] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-22T22:06:35.029467] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T22:06:35.588576] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-22T22:06:35.722071] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-22T22:06:36.522034] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-22T22:06:36.872960] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T22:06:37.081635] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T22:06:37.089468] [INFO ] [REMOTE ] WLK: Full fetch complete (62658 records). [2025-09-22T22:06:37.089636] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-22T22:06:37.327222] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-22T22:06:37.505544] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-22T22:06:37.537562] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-22T22:06:37.538108] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-22T22:06:37.539300] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-22T22:06:37.539365] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-22T22:06:37.540710] [DEBUG] [LOCAL ] WLK: Trimmed 62658 records to 45372 (keeping 200 days of data) [2025-09-22T22:06:37.825450] [DEBUG] [LOCAL ] WLK: Primary data saved (45372 records). [2025-09-22T22:06:37.825639] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-22T22:06:37.825782] [INFO ] [MAIN ] Update Progress: 2305/2372 symbols completed. WLK took 42.1s. Estimated remaining: 8m 55s. Rate: 7.5 symbols/min [2025-09-22T22:06:38.002361] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:06:38.018137] [DEBUG] [LOCAL ] WMK: Loaded 14783 existing records from primary storage. [2025-09-22T22:06:38.018262] [INFO ] [MAIN ] WMK: Loaded 14783 existing records. [2025-09-22T22:06:38.123859] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-22T22:06:38.205338] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:06:38.205606] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-22T22:06:38.205694] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-22T22:06:38.206176] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-22T22:06:38.206236] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-22T22:06:38.574891] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:06:38.922078] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-22T22:06:39.284605] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-22T22:06:39.722043] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-22T22:06:39.771171] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-22T22:06:40.070666] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-22T22:06:40.522070] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-22T22:06:41.322018] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-22T22:06:41.611785] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-22T22:06:42.122080] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-22T22:06:42.214675] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T22:06:42.451730] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-22T22:06:42.456848] [INFO ] [REMOTE ] WLY: Full fetch complete (43273 records). [2025-09-22T22:06:42.456980] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-22T22:06:42.844464] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-22T22:06:42.844545] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-22T22:06:42.845403] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-22T22:06:42.845465] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-22T22:06:42.846569] [DEBUG] [LOCAL ] WLY: Trimmed 43273 records to 30318 (keeping 200 days of data) [2025-09-22T22:06:42.935082] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-22T22:06:43.033400] [DEBUG] [LOCAL ] WLY: Primary data saved (30318 records). [2025-09-22T22:06:43.033581] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-22T22:06:43.033696] [INFO ] [MAIN ] Update Progress: 2306/2372 symbols completed. WLY took 34.6s. Estimated remaining: 8m 47s. Rate: 7.5 symbols/min [2025-09-22T22:06:43.146233] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-22T22:06:43.218681] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:06:43.259295] [DEBUG] [LOCAL ] WMS: Loaded 40206 existing records from primary storage. [2025-09-22T22:06:43.259458] [INFO ] [MAIN ] WMS: Loaded 40206 existing records. [2025-09-22T22:06:43.435662] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:06:43.435898] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-22T22:06:43.435945] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-22T22:06:43.437009] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-22T22:06:43.437068] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-22T22:06:43.727218] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-22T22:06:43.796738] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:06:44.522037] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-22T22:06:44.618682] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-22T22:06:44.812748] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-22T22:06:45.322065] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-22T22:06:46.122048] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-22T22:06:46.673754] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-22T22:06:46.922048] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-22T22:06:46.965811] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T22:06:47.561913] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T22:06:47.722066] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-22T22:06:48.007121] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-22T22:06:48.522101] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-22T22:06:49.013232] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-22T22:06:49.322076] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-22T22:06:49.585584] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T22:06:50.122135] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-22T22:06:50.922055] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-22T22:06:51.344395] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T22:06:51.722427] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T22:06:51.722548] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-22T22:06:51.999997] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-22T22:06:52.522066] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-22T22:06:53.322177] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-22T22:06:53.726292] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-22T22:06:54.010952] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T22:06:54.122102] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-22T22:06:54.518675] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-22T22:06:54.824639] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-22T22:06:54.833421] [INFO ] [REMOTE ] WM: Full fetch complete (73662 records). [2025-09-22T22:06:54.833588] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-22T22:06:54.927371] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-22T22:06:55.256760] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-22T22:06:55.256943] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-22T22:06:55.258728] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-22T22:06:55.258810] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-22T22:06:55.261161] [DEBUG] [LOCAL ] WM: Trimmed 73662 records to 50960 (keeping 200 days of data) [2025-09-22T22:06:55.613215] [DEBUG] [LOCAL ] WM: Primary data saved (50960 records). [2025-09-22T22:06:55.613435] [INFO ] [MAIN ] WM: Full history saved. [2025-09-22T22:06:55.613562] [INFO ] [MAIN ] Update Progress: 2307/2372 symbols completed. WM took 34.8s. Estimated remaining: 8m 39s. Rate: 7.5 symbols/min [2025-09-22T22:06:55.722020] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-22T22:06:55.795496] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:06:55.851012] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-22T22:06:55.851163] [INFO ] [MAIN ] WMT: Loaded 54580 existing records. [2025-09-22T22:06:56.054139] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-22T22:06:56.054284] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:06:56.057849] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-22T22:06:56.058605] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-22T22:06:56.061194] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-22T22:06:56.061281] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-22T22:06:56.444971] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:06:56.522065] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-22T22:06:57.322044] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-22T22:06:57.380231] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-22T22:06:57.500557] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-22T22:06:58.122069] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-22T22:06:58.845997] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T22:06:58.922092] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-22T22:06:59.722124] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-22T22:07:00.070195] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-22T22:07:00.464983] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-22T22:07:00.522051] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-22T22:07:00.574283] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-22T22:07:01.322042] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-22T22:07:02.122109] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-22T22:07:02.626247] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-22T22:07:02.699449] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T22:07:02.922115] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-22T22:07:02.988074] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-22T22:07:02.991428] [INFO ] [REMOTE ] WMK: Full fetch complete (19297 records). [2025-09-22T22:07:02.991538] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-22T22:07:03.410193] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-22T22:07:03.410312] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-22T22:07:03.411180] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-22T22:07:03.411248] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-22T22:07:03.411999] [DEBUG] [LOCAL ] WMK: Trimmed 19297 records to 14547 (keeping 200 days of data) [2025-09-22T22:07:03.507788] [DEBUG] [LOCAL ] WMK: Primary data saved (14547 records). [2025-09-22T22:07:03.508003] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-22T22:07:03.508113] [INFO ] [MAIN ] Update Progress: 2308/2372 symbols completed. WMK took 25.7s. Estimated remaining: 8m 31s. Rate: 7.5 symbols/min [2025-09-22T22:07:03.682872] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:07:03.723424] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-22T22:07:03.725237] [DEBUG] [LOCAL ] WNC: Loaded 41029 existing records from primary storage. [2025-09-22T22:07:03.725386] [INFO ] [MAIN ] WNC: Loaded 41029 existing records. [2025-09-22T22:07:03.908394] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:07:03.908729] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-22T22:07:03.908784] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-22T22:07:03.909950] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-22T22:07:03.910013] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-22T22:07:04.308020] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:07:04.363231] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-22T22:07:04.480157] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T22:07:04.489889] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-09-22T22:07:04.490027] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-22T22:07:04.527197] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-22T22:07:04.884714] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-22T22:07:04.884799] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-22T22:07:04.886051] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-22T22:07:04.886115] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-22T22:07:04.887576] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 53671 (keeping 200 days of data) [2025-09-22T22:07:05.226034] [DEBUG] [LOCAL ] WMB: Primary data saved (53671 records). [2025-09-22T22:07:05.226176] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-22T22:07:05.226276] [INFO ] [MAIN ] Update Progress: 2309/2372 symbols completed. WMB took 33.7s. Estimated remaining: 8m 23s. Rate: 7.5 symbols/min [2025-09-22T22:07:05.326128] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-22T22:07:05.397315] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:07:05.438177] [DEBUG] [LOCAL ] WNS: Loaded 40320 existing records from primary storage. [2025-09-22T22:07:05.438325] [INFO ] [MAIN ] WNS: Loaded 40320 existing records. [2025-09-22T22:07:05.616809] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:07:05.617242] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-22T22:07:05.617388] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-22T22:07:05.618375] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-22T22:07:05.618436] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-22T22:07:06.005124] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:07:05.999474] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T22:07:06.122008] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-22T22:07:06.781958] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-22T22:07:06.922004] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-22T22:07:07.608973] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T22:07:07.722040] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-22T22:07:08.456272] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T22:07:08.463026] [INFO ] [REMOTE ] WMS: Full fetch complete (57351 records). [2025-09-22T22:07:08.463139] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-22T22:07:08.527177] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-22T22:07:08.845840] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-22T22:07:08.845917] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-22T22:07:08.846915] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-22T22:07:08.846981] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-22T22:07:08.848138] [DEBUG] [LOCAL ] WMS: Trimmed 57351 records to 39626 (keeping 200 days of data) [2025-09-22T22:07:09.096472] [DEBUG] [LOCAL ] WMS: Primary data saved (39626 records). [2025-09-22T22:07:09.096612] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-22T22:07:09.096735] [INFO ] [MAIN ] Update Progress: 2310/2372 symbols completed. WMS took 26.1s. Estimated remaining: 8m 15s. Rate: 7.5 symbols/min [2025-09-22T22:07:09.301794] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:07:09.298558] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-22T22:07:09.322021] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-22T22:07:09.368346] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-22T22:07:09.368496] [INFO ] [MAIN ] WOLF: Loaded 54312 existing records. [2025-09-22T22:07:09.551768] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:07:09.552016] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-22T22:07:09.552065] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-22T22:07:09.553149] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-22T22:07:09.553210] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-22T22:07:09.925003] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:07:09.947683] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T22:07:10.122053] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-22T22:07:10.436335] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-22T22:07:10.922087] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-22T22:07:11.722061] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-22T22:07:12.464670] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-22T22:07:12.526721] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-22T22:07:12.531868] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-22T22:07:13.322042] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-22T22:07:13.864623] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-22T22:07:14.000948] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-22T22:07:14.122051] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-22T22:07:14.590172] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T22:07:14.922112] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-22T22:07:15.722103] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-22T22:07:16.195054] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-22T22:07:16.438928] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-22T22:07:16.522047] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-22T22:07:17.322048] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-22T22:07:17.809659] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-22T22:07:18.122069] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-22T22:07:18.653816] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-22T22:07:18.712277] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-22T22:07:18.922066] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-22T22:07:19.722069] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-22T22:07:20.090948] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-22T22:07:20.407704] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T22:07:20.522019] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-22T22:07:21.261018] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-22T22:07:21.322016] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-22T22:07:22.122058] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-22T22:07:22.875161] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-22T22:07:22.922002] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-22T22:07:23.540622] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-22T22:07:23.722034] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-22T22:07:23.886388] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-22T22:07:24.522094] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-22T22:07:25.198624] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-22T22:07:25.327352] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-22T22:07:25.349823] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-22T22:07:26.122096] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-22T22:07:26.637687] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-22T22:07:26.743882] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-22T22:07:26.922122] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-22T22:07:27.722110] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-22T22:07:28.326261] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T22:07:28.522103] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-22T22:07:28.716586] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-22T22:07:29.322082] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-22T22:07:30.130256] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-22T22:07:30.153543] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-22T22:07:30.275606] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-22T22:07:30.922244] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-22T22:07:31.365210] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T22:07:31.391824] [INFO ] [REMOTE ] WNC: Full fetch complete (57436 records). [2025-09-22T22:07:31.403470] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-22T22:07:31.448723] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-22T22:07:31.727955] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-22T22:07:31.859306] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-22T22:07:31.859452] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-22T22:07:31.861431] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-22T22:07:31.861577] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-22T22:07:31.865472] [DEBUG] [LOCAL ] WNC: Trimmed 57436 records to 40252 (keeping 200 days of data) [2025-09-22T22:07:32.154088] [DEBUG] [LOCAL ] WNC: Primary data saved (40252 records). [2025-09-22T22:07:32.154230] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-22T22:07:32.154478] [INFO ] [MAIN ] Update Progress: 2311/2372 symbols completed. WNC took 28.6s. Estimated remaining: 8m 7s. Rate: 7.5 symbols/min [2025-09-22T22:07:32.335710] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:07:32.368257] [DEBUG] [LOCAL ] WOR: Loaded 25115 existing records from primary storage. [2025-09-22T22:07:32.368409] [INFO ] [MAIN ] WOR: Loaded 25115 existing records. [2025-09-22T22:07:32.554301] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-22T22:07:32.561493] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:07:32.562886] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-22T22:07:32.562940] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-22T22:07:32.563545] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-22T22:07:32.563623] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-22T22:07:32.925890] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:07:33.300023] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-22T22:07:33.322009] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-22T22:07:33.733226] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-22T22:07:34.122041] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-22T22:07:34.527848] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-22T22:07:34.922171] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-22T22:07:35.356875] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T22:07:35.362829] [INFO ] [REMOTE ] WNS: Full fetch complete (54747 records). [2025-09-22T22:07:35.362931] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-22T22:07:35.727239] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-22T22:07:35.766579] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-22T22:07:35.766768] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-22T22:07:35.768263] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-22T22:07:35.768710] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-22T22:07:35.770946] [DEBUG] [LOCAL ] WNS: Trimmed 54747 records to 39866 (keeping 200 days of data) [2025-09-22T22:07:35.918043] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-22T22:07:36.074992] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T22:07:36.110389] [DEBUG] [LOCAL ] WNS: Primary data saved (39866 records). [2025-09-22T22:07:36.110584] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-22T22:07:36.110762] [INFO ] [MAIN ] Update Progress: 2312/2372 symbols completed. WNS took 30.9s. Estimated remaining: 7m 59s. Rate: 7.5 symbols/min [2025-09-22T22:07:36.284623] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:07:36.320778] [DEBUG] [LOCAL ] WOW: Loaded 30308 existing records from primary storage. [2025-09-22T22:07:36.320920] [INFO ] [MAIN ] WOW: Loaded 30308 existing records. [2025-09-22T22:07:36.499927] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:07:36.500192] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-22T22:07:36.500239] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-22T22:07:36.500912] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-22T22:07:36.500987] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-22T22:07:36.532245] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-22T22:07:36.865168] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:07:37.322054] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-22T22:07:38.078560] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-22T22:07:38.122038] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-22T22:07:38.510399] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T22:07:38.922093] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-22T22:07:39.151841] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-22T22:07:39.722042] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-22T22:07:39.852592] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-22T22:07:40.328867] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-22T22:07:40.338255] [INFO ] [REMOTE ] WOLF: Full fetch complete (77599 records). [2025-09-22T22:07:40.338444] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-22T22:07:40.581437] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-22T22:07:40.821430] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-22T22:07:40.821619] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-22T22:07:40.823101] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-22T22:07:40.823189] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-22T22:07:40.841295] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-22T22:07:40.847681] [DEBUG] [LOCAL ] WOLF: Trimmed 77599 records to 53532 (keeping 200 days of data) [2025-09-22T22:07:41.183088] [DEBUG] [LOCAL ] WOLF: Primary data saved (53532 records). [2025-09-22T22:07:41.183249] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-22T22:07:41.183358] [INFO ] [MAIN ] Update Progress: 2313/2372 symbols completed. WOLF took 32.1s. Estimated remaining: 7m 51s. Rate: 7.5 symbols/min [2025-09-22T22:07:41.330639] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-22T22:07:41.365753] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:07:41.391579] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-22T22:07:41.401102] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-09-22T22:07:41.401250] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-22T22:07:41.777482] [DEBUG] [LOCAL ] WPC: Loaded 49468 existing records from primary storage. [2025-09-22T22:07:41.810774] [INFO ] [MAIN ] WPC: Loaded 49468 existing records. [2025-09-22T22:07:41.971759] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-22T22:07:41.972274] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-22T22:07:41.979734] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-22T22:07:41.990167] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-22T22:07:42.066945] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 53800 (keeping 200 days of data) [2025-09-22T22:07:42.073419] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:07:42.074412] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-22T22:07:42.074933] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-22T22:07:42.076442] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-22T22:07:42.076522] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-22T22:07:42.178762] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-22T22:07:42.475563] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-22T22:07:42.864729] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:07:42.871676] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-09-22T22:07:42.871856] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-22T22:07:42.871955] [INFO ] [MAIN ] Update Progress: 2314/2372 symbols completed. WMT took 47.3s. Estimated remaining: 7m 43s. Rate: 7.5 symbols/min [2025-09-22T22:07:42.932369] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-22T22:07:43.055480] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:07:43.118747] [DEBUG] [LOCAL ] WPM: Loaded 53489 existing records from primary storage. [2025-09-22T22:07:43.118921] [INFO ] [MAIN ] WPM: Loaded 53489 existing records. [2025-09-22T22:07:43.301904] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:07:43.302226] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-22T22:07:43.302285] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-22T22:07:43.303943] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-22T22:07:43.304041] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-22T22:07:43.702581] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T22:07:43.732627] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-22T22:07:43.732497] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:07:44.522024] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-22T22:07:44.562813] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-22T22:07:44.812052] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-22T22:07:45.322085] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-22T22:07:46.122048] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-22T22:07:46.251916] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T22:07:46.571361] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T22:07:46.922050] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-22T22:07:47.165332] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-22T22:07:47.722060] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-22T22:07:48.522054] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-22T22:07:48.732439] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-22T22:07:49.322046] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-22T22:07:49.467892] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T22:07:49.523039] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-22T22:07:50.122055] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-22T22:07:50.922034] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-22T22:07:51.020271] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-22T22:07:51.485074] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-22T22:07:51.722033] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-22T22:07:52.077633] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-22T22:07:52.522107] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-22T22:07:52.851056] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-22T22:07:53.322060] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-22T22:07:53.621693] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-22T22:07:54.122059] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-22T22:07:54.896971] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T22:07:54.921997] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-22T22:07:55.316027] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T22:07:55.722121] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-22T22:07:56.522019] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-22T22:07:56.802925] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-22T22:07:56.945430] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-22T22:07:57.322043] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-22T22:07:58.127758] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-22T22:07:58.153869] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T22:07:58.468913] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T22:07:58.922066] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-22T22:07:59.651516] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-22T22:07:59.722004] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-22T22:08:00.522082] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-22T22:08:00.616688] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-22T22:08:01.322071] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-22T22:08:01.671622] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T22:08:01.677254] [INFO ] [REMOTE ] WOR: Full fetch complete (35600 records). [2025-09-22T22:08:01.677385] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-22T22:08:02.002529] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-22T22:08:02.119453] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-22T22:08:02.119526] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-22T22:08:02.120244] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-22T22:08:02.120306] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-22T22:08:02.121117] [DEBUG] [LOCAL ] WOR: Trimmed 35600 records to 24577 (keeping 200 days of data) [2025-09-22T22:08:02.122011] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-22T22:08:02.285416] [DEBUG] [LOCAL ] WOR: Primary data saved (24577 records). [2025-09-22T22:08:02.285851] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-22T22:08:02.286047] [INFO ] [MAIN ] Update Progress: 2315/2372 symbols completed. WOR took 30.1s. Estimated remaining: 7m 35s. Rate: 7.5 symbols/min [2025-09-22T22:08:02.459259] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:08:02.498392] [DEBUG] [LOCAL ] WPP: Loaded 34181 existing records from primary storage. [2025-09-22T22:08:02.498695] [INFO ] [MAIN ] WPP: Loaded 34181 existing records. [2025-09-22T22:08:02.627177] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-22T22:08:02.705032] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:08:02.705355] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-22T22:08:02.705425] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-22T22:08:02.706259] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-22T22:08:02.706320] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-22T22:08:02.927212] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-22T22:08:03.059885] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:08:03.722023] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-22T22:08:03.851160] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-22T22:08:04.522055] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-22T22:08:04.842205] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-22T22:08:04.951453] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-22T22:08:05.322046] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-22T22:08:06.122050] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-22T22:08:06.391538] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-22T22:08:06.922074] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-22T22:08:07.049174] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-22T22:08:07.378107] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-22T22:08:07.722080] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-22T22:08:08.415236] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T22:08:08.522044] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-22T22:08:08.788046] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-22T22:08:09.322072] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-22T22:08:09.753829] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-22T22:08:09.760115] [INFO ] [REMOTE ] WOW: Full fetch complete (41430 records). [2025-09-22T22:08:09.760221] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-22T22:08:10.129979] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-22T22:08:10.146051] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-22T22:08:10.146283] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-22T22:08:10.147762] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-22T22:08:10.147959] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-22T22:08:10.149013] [DEBUG] [LOCAL ] WOW: Trimmed 41430 records to 29992 (keeping 200 days of data) [2025-09-22T22:08:10.317349] [DEBUG] [LOCAL ] WOW: Primary data saved (29992 records). [2025-09-22T22:08:10.317485] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-22T22:08:10.317566] [INFO ] [MAIN ] Update Progress: 2316/2372 symbols completed. WOW took 34.2s. Estimated remaining: 7m 27s. Rate: 7.5 symbols/min [2025-09-22T22:08:10.488696] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:08:10.537633] [DEBUG] [LOCAL ] WRB: Loaded 51351 existing records from primary storage. [2025-09-22T22:08:10.537822] [INFO ] [MAIN ] WRB: Loaded 51351 existing records. [2025-09-22T22:08:10.716180] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:08:10.716449] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-22T22:08:10.716498] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-22T22:08:10.717520] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-22T22:08:10.717581] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-22T22:08:10.927164] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-22T22:08:11.080015] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:08:11.340102] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-22T22:08:11.722031] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-22T22:08:12.048239] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-22T22:08:12.056633] [INFO ] [REMOTE ] WPM: Full fetch complete (75793 records). [2025-09-22T22:08:12.056847] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-22T22:08:12.474560] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-22T22:08:12.474904] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-22T22:08:12.495243] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-22T22:08:12.496113] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-22T22:08:12.497247] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-22T22:08:12.506130] [DEBUG] [LOCAL ] WPM: Trimmed 75793 records to 52724 (keeping 200 days of data) [2025-09-22T22:08:12.567373] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-22T22:08:12.846902] [DEBUG] [LOCAL ] WPM: Primary data saved (52724 records). [2025-09-22T22:08:12.847057] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-22T22:08:12.847147] [INFO ] [MAIN ] Update Progress: 2317/2372 symbols completed. WPM took 30.0s. Estimated remaining: 7m 19s. Rate: 7.5 symbols/min [2025-09-22T22:08:13.236423] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-22T22:08:13.322024] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-22T22:08:14.095099] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-22T22:08:14.122062] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-22T22:08:14.704477] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-22T22:08:14.922128] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-22T22:08:15.373525] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-22T22:08:15.722056] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-22T22:08:16.522043] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-22T22:08:16.751708] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T22:08:17.163803] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T22:08:17.322076] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-22T22:08:18.080673] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-22T22:08:18.090577] [INFO ] [REMOTE ] WPC: Full fetch complete (70990 records). [2025-09-22T22:08:18.090811] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-22T22:08:18.134767] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-22T22:08:18.561679] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-22T22:08:18.561876] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-22T22:08:18.565826] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-22T22:08:18.565986] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-22T22:08:18.568830] [DEBUG] [LOCAL ] WPC: Trimmed 70990 records to 48670 (keeping 200 days of data) [2025-09-22T22:08:18.998143] [DEBUG] [LOCAL ] WPC: Primary data saved (48670 records). [2025-09-22T22:08:18.998441] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-22T22:08:18.998610] [INFO ] [MAIN ] Update Progress: 2318/2372 symbols completed. WPC took 37.8s. Estimated remaining: 7m 11s. Rate: 7.5 symbols/min [2025-09-22T22:08:19.084690] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T22:08:19.095571] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-22T22:08:19.891440] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-22T22:08:19.901208] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-22T22:08:20.858170] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-22T22:08:20.868863] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-22T22:08:21.449491] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-22T22:08:21.458676] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-22T22:08:22.790861] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-22T22:08:22.802490] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-22T22:08:22.819800] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-22T22:08:22.825867] [INFO ] [REMOTE ] WPP: Full fetch complete (44857 records). [2025-09-22T22:08:22.825994] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-22T22:08:23.219894] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-22T22:08:23.219978] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-22T22:08:23.220873] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-22T22:08:23.220936] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-22T22:08:23.222040] [DEBUG] [LOCAL ] WPP: Trimmed 44857 records to 33716 (keeping 200 days of data) [2025-09-22T22:08:23.424514] [DEBUG] [LOCAL ] WPP: Primary data saved (33716 records). [2025-09-22T22:08:23.424687] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-22T22:08:23.424823] [INFO ] [MAIN ] Update Progress: 2319/2372 symbols completed. WPP took 21.1s. Estimated remaining: 7m 3s. Rate: 7.5 symbols/min [2025-09-22T22:08:24.578824] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-22T22:08:24.589870] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-22T22:08:26.283206] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-22T22:08:26.293383] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-22T22:08:28.229744] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-22T22:08:28.241173] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-22T22:08:29.907344] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-22T22:08:29.918359] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-22T22:08:30.631393] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-22T22:08:30.639686] [INFO ] [REMOTE ] WRB: Full fetch complete (73084 records). [2025-09-22T22:08:30.639821] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-22T22:08:31.039935] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-22T22:08:31.040017] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-22T22:08:31.041274] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-22T22:08:31.041338] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-22T22:08:31.042788] [DEBUG] [LOCAL ] WRB: Trimmed 73084 records to 50615 (keeping 200 days of data) [2025-09-22T22:08:31.358482] [DEBUG] [LOCAL ] WRB: Primary data saved (50615 records). [2025-09-22T22:08:31.358629] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-22T22:08:31.358768] [INFO ] [MAIN ] Update Progress: 2320/2372 symbols completed. WRB took 21.0s. Estimated remaining: 6m 55s. Rate: 7.5 symbols/min [2025-09-22T22:08:31.873994] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:08:32.011257] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:08:32.058854] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:08:32.086943] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:08:32.121672] [DEBUG] [LOCAL ] WSO: Loaded 25021 existing records from primary storage. [2025-09-22T22:08:32.134531] [INFO ] [MAIN ] WSO: Loaded 25021 existing records. [2025-09-22T22:08:32.237739] [DEBUG] [LOCAL ] WS: Loaded 24295 existing records from primary storage. [2025-09-22T22:08:32.266239] [INFO ] [MAIN ] WS: Loaded 24295 existing records. [2025-09-22T22:08:32.291859] [DEBUG] [LOCAL ] WRBY: Loaded 51650 existing records from primary storage. [2025-09-22T22:08:32.319016] [INFO ] [MAIN ] WRBY: Loaded 51650 existing records. [2025-09-22T22:08:32.500550] [DEBUG] [LOCAL ] WSM: Loaded 50753 existing records from primary storage. [2025-09-22T22:08:32.552774] [INFO ] [MAIN ] WSM: Loaded 50753 existing records. [2025-09-22T22:08:32.552697] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:08:32.727355] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-22T22:08:32.766736] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-22T22:08:32.823838] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-22T22:08:32.843701] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:08:32.868208] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-22T22:08:32.879024] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:08:32.929237] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-22T22:08:32.929803] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-22T22:08:32.935155] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-22T22:08:32.935208] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-22T22:08:32.981593] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-22T22:08:33.008693] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-22T22:08:33.003395] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-22T22:08:33.040939] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-22T22:08:33.200573] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:08:33.281105] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-22T22:08:33.355583] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-22T22:08:33.453478] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-22T22:08:33.555510] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-22T22:08:34.030903] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:08:34.070839] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-22T22:08:34.208982] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:08:34.213295] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-22T22:08:34.256626] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:08:34.262199] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-22T22:08:34.513932] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:08:34.514360] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-22T22:08:35.366879] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-22T22:08:35.371812] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-22T22:08:35.449989] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-22T22:08:35.459340] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-22T22:08:36.048771] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-22T22:08:36.059975] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-22T22:08:36.418205] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-22T22:08:36.429207] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-22T22:08:36.446491] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-22T22:08:36.450964] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-22T22:08:36.473717] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-22T22:08:36.479454] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-22T22:08:37.662484] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-22T22:08:37.672868] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-22T22:08:37.697301] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-22T22:08:37.702622] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-22T22:08:37.719363] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-22T22:08:37.725417] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-22T22:08:37.979044] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-22T22:08:37.989845] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-22T22:08:38.997373] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-22T22:08:39.005268] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-22T22:08:39.021865] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-22T22:08:39.027722] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-22T22:08:39.108482] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T22:08:39.122889] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-22T22:08:39.730195] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-22T22:08:39.740010] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-22T22:08:40.070127] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T22:08:40.178211] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-22T22:08:40.481192] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-22T22:08:40.522008] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-22T22:08:41.322016] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-22T22:08:41.828822] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-22T22:08:41.873837] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-22T22:08:42.077689] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-22T22:08:42.122016] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-22T22:08:42.922112] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-22T22:08:43.294811] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-22T22:08:43.722114] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-22T22:08:44.522034] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-22T22:08:44.823548] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T22:08:44.930323] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-22T22:08:45.322017] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-22T22:08:45.347585] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-22T22:08:46.122061] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-22T22:08:46.922065] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-22T22:08:47.122853] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-22T22:08:47.722161] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-22T22:08:47.937554] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-22T22:08:48.090297] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-22T22:08:48.522059] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-22T22:08:49.331401] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-22T22:08:49.336749] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T22:08:49.609310] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-22T22:08:50.122058] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-22T22:08:50.922027] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-22T22:08:51.081075] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-22T22:08:51.174793] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T22:08:51.722080] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-22T22:08:52.522066] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-22T22:08:52.692975] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-22T22:08:52.701087] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-22T22:08:52.712082] [INFO ] [REMOTE ] WS: Full fetch complete (36122 records). [2025-09-22T22:08:52.712288] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-22T22:08:53.092389] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-22T22:08:53.092480] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-22T22:08:53.093397] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-22T22:08:53.093464] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-22T22:08:53.094370] [DEBUG] [LOCAL ] WS: Trimmed 36122 records to 23847 (keeping 200 days of data) [2025-09-22T22:08:53.246493] [DEBUG] [LOCAL ] WS: Primary data saved (23847 records). [2025-09-22T22:08:53.246702] [INFO ] [MAIN ] WS: Full history saved. [2025-09-22T22:08:53.248271] [INFO ] [MAIN ] Update Progress: 2321/2372 symbols completed. WS took 21.9s. Estimated remaining: 6m 47s. Rate: 7.5 symbols/min [2025-09-22T22:08:53.325300] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-22T22:08:53.440194] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:08:53.456626] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-22T22:08:53.491475] [DEBUG] [LOCAL ] WSR: Loaded 23914 existing records from primary storage. [2025-09-22T22:08:53.491669] [INFO ] [MAIN ] WSR: Loaded 23914 existing records. [2025-09-22T22:08:53.683913] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:08:53.684206] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-22T22:08:53.684261] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-22T22:08:53.685005] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-22T22:08:53.685069] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-22T22:08:54.062044] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:08:54.122063] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-22T22:08:54.922099] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-22T22:08:55.133516] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-22T22:08:55.158045] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-22T22:08:55.722115] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-22T22:08:56.387317] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-22T22:08:56.395298] [INFO ] [REMOTE ] WSM: Full fetch complete (72247 records). [2025-09-22T22:08:56.395788] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-22T22:08:56.543267] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-22T22:08:56.813423] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T22:08:56.846259] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-22T22:08:56.846585] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-22T22:08:56.847947] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-22T22:08:56.848404] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-22T22:08:56.849826] [DEBUG] [LOCAL ] WSM: Trimmed 72247 records to 49931 (keeping 200 days of data) [2025-09-22T22:08:57.163689] [DEBUG] [LOCAL ] WSM: Primary data saved (49931 records). [2025-09-22T22:08:57.163835] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-22T22:08:57.163935] [INFO ] [MAIN ] Update Progress: 2322/2372 symbols completed. WSM took 25.8s. Estimated remaining: 6m 39s. Rate: 7.5 symbols/min [2025-09-22T22:08:57.330005] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-22T22:08:57.333895] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:08:57.381042] [DEBUG] [LOCAL ] WST: Loaded 38506 existing records from primary storage. [2025-09-22T22:08:57.381185] [INFO ] [MAIN ] WST: Loaded 38506 existing records. [2025-09-22T22:08:57.572414] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:08:57.572933] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-22T22:08:57.573003] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-22T22:08:57.574159] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-22T22:08:57.574222] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-22T22:08:57.944366] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:08:57.964006] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-22T22:08:57.970072] [INFO ] [REMOTE ] WSO: Full fetch complete (33777 records). [2025-09-22T22:08:57.970188] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-22T22:08:58.127377] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-22T22:08:58.369719] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-22T22:08:58.369842] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-22T22:08:58.370724] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-22T22:08:58.370906] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-22T22:08:58.373375] [DEBUG] [LOCAL ] WSO: Trimmed 33777 records to 24683 (keeping 200 days of data) [2025-09-22T22:08:58.492066] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-22T22:08:58.547967] [DEBUG] [LOCAL ] WSO: Primary data saved (24683 records). [2025-09-22T22:08:58.548095] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-22T22:08:58.548176] [INFO ] [MAIN ] Update Progress: 2323/2372 symbols completed. WSO took 27.2s. Estimated remaining: 6m 31s. Rate: 7.5 symbols/min [2025-09-22T22:08:58.716829] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:08:58.763074] [DEBUG] [LOCAL ] WT: Loaded 48283 existing records from primary storage. [2025-09-22T22:08:58.763261] [INFO ] [MAIN ] WT: Loaded 48283 existing records. [2025-09-22T22:08:58.922058] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-22T22:08:58.945157] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:08:58.945434] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-22T22:08:58.945513] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-22T22:08:58.947184] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-22T22:08:58.947250] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-22T22:08:59.312455] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:08:59.567669] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-22T22:08:59.697088] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-22T22:08:59.722006] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-22T22:09:00.522050] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-22T22:09:01.322027] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-22T22:09:01.456217] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-22T22:09:02.045264] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-22T22:09:02.122009] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-22T22:09:02.696331] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-22T22:09:02.922069] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-22T22:09:03.722088] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-22T22:09:04.522077] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-22T22:09:04.724893] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-22T22:09:04.994761] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-22T22:09:05.143372] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T22:09:05.322038] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-22T22:09:06.052139] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-22T22:09:06.059819] [INFO ] [REMOTE ] WRBY: Full fetch complete (73323 records). [2025-09-22T22:09:06.059938] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-22T22:09:06.128598] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-22T22:09:06.385328] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-22T22:09:06.486060] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-22T22:09:06.486164] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-22T22:09:06.487422] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-22T22:09:06.487540] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-22T22:09:06.489206] [DEBUG] [LOCAL ] WRBY: Trimmed 73323 records to 50873 (keeping 200 days of data) [2025-09-22T22:09:06.786339] [DEBUG] [LOCAL ] WRBY: Primary data saved (50873 records). [2025-09-22T22:09:06.786480] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-22T22:09:06.786566] [INFO ] [MAIN ] Update Progress: 2324/2372 symbols completed. WRBY took 35.4s. Estimated remaining: 6m 23s. Rate: 7.5 symbols/min [2025-09-22T22:09:06.930660] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-22T22:09:06.957935] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:09:07.001604] [DEBUG] [LOCAL ] WTI: Loaded 44421 existing records from primary storage. [2025-09-22T22:09:07.001777] [INFO ] [MAIN ] WTI: Loaded 44421 existing records. [2025-09-22T22:09:07.187808] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:09:07.188084] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-22T22:09:07.188133] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-22T22:09:07.189254] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-22T22:09:07.189316] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-22T22:09:07.569150] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:09:07.632427] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-22T22:09:07.722035] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-22T22:09:08.522030] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-22T22:09:08.662482] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T22:09:08.758811] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-22T22:09:09.322059] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-22T22:09:10.109245] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-22T22:09:10.121999] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-22T22:09:10.163009] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-22T22:09:10.922056] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-22T22:09:11.722118] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-22T22:09:11.792000] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T22:09:12.529772] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-22T22:09:12.544145] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-22T22:09:12.770446] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-22T22:09:13.322071] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-22T22:09:14.122032] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-22T22:09:14.294519] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-22T22:09:14.315984] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-22T22:09:14.319828] [INFO ] [REMOTE ] WSR: Full fetch complete (32813 records). [2025-09-22T22:09:14.319924] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-22T22:09:14.738285] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-22T22:09:14.738385] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-22T22:09:14.739180] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-22T22:09:14.739245] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-22T22:09:14.740192] [DEBUG] [LOCAL ] WSR: Trimmed 32813 records to 23388 (keeping 200 days of data) [2025-09-22T22:09:14.893428] [DEBUG] [LOCAL ] WSR: Primary data saved (23388 records). [2025-09-22T22:09:14.893568] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-22T22:09:14.893700] [INFO ] [MAIN ] Update Progress: 2325/2372 symbols completed. WSR took 21.6s. Estimated remaining: 6m 15s. Rate: 7.5 symbols/min [2025-09-22T22:09:14.927187] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-22T22:09:15.070067] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:09:15.070235] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-22T22:09:15.070273] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-22T22:09:15.070414] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-22T22:09:15.070456] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-22T22:09:15.070497] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-22T22:09:15.070530] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-22T22:09:15.450127] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:09:15.722074] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-22T22:09:16.522066] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-22T22:09:16.593041] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-22T22:09:16.905484] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-22T22:09:17.322030] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-22T22:09:17.497705] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-22T22:09:17.699141] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-22T22:09:18.122068] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-22T22:09:18.911551] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-22T22:09:18.922002] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-22T22:09:19.715690] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-22T22:09:19.723579] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-22T22:09:20.365749] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-22T22:09:20.522087] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-22T22:09:21.030617] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-22T22:09:21.322076] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-22T22:09:21.360272] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-22T22:09:21.753282] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-22T22:09:22.122054] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-22T22:09:22.922055] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-22T22:09:23.722112] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-22T22:09:23.828954] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T22:09:24.464548] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T22:09:24.522041] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-22T22:09:24.975933] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T22:09:25.322025] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-22T22:09:26.122102] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-22T22:09:26.171538] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-22T22:09:26.746940] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-22T22:09:26.922028] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-22T22:09:27.183844] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T22:09:27.722096] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-22T22:09:28.323999] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T22:09:28.331948] [INFO ] [REMOTE ] WT: Full fetch complete (69055 records). [2025-09-22T22:09:28.332106] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-22T22:09:28.533681] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-22T22:09:28.734689] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-22T22:09:28.734789] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-22T22:09:28.736076] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-22T22:09:28.736179] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-22T22:09:28.737560] [DEBUG] [LOCAL ] WT: Trimmed 69055 records to 47585 (keeping 200 days of data) [2025-09-22T22:09:29.015049] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-22T22:09:29.080050] [DEBUG] [LOCAL ] WT: Primary data saved (47585 records). [2025-09-22T22:09:29.080194] [INFO ] [MAIN ] WT: Full history saved. [2025-09-22T22:09:29.080380] [INFO ] [MAIN ] Update Progress: 2326/2372 symbols completed. WT took 30.5s. Estimated remaining: 6m 7s. Rate: 7.5 symbols/min [2025-09-22T22:09:29.250862] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:09:29.307054] [DEBUG] [LOCAL ] WTRG: Loaded 51709 existing records from primary storage. [2025-09-22T22:09:29.307202] [INFO ] [MAIN ] WTRG: Loaded 51709 existing records. [2025-09-22T22:09:29.328087] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-22T22:09:29.491995] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:09:29.492293] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-22T22:09:29.492344] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-22T22:09:29.494447] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-22T22:09:29.494518] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-22T22:09:29.966807] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:09:29.970422] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T22:09:30.122027] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-22T22:09:30.253394] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T22:09:30.922115] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-22T22:09:31.459680] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-22T22:09:31.722052] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-22T22:09:32.522039] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-22T22:09:32.714636] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T22:09:33.093304] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-22T22:09:33.115151] [INFO ] [REMOTE ] WST: Full fetch complete (53396 records). [2025-09-22T22:09:33.125921] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-22T22:09:33.127429] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-22T22:09:33.334239] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-22T22:09:33.554001] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-22T22:09:33.554097] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-22T22:09:33.555287] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-22T22:09:33.555378] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-22T22:09:33.557354] [DEBUG] [LOCAL ] WST: Trimmed 53396 records to 37728 (keeping 200 days of data) [2025-09-22T22:09:33.812276] [DEBUG] [LOCAL ] WST: Primary data saved (37728 records). [2025-09-22T22:09:33.812411] [INFO ] [MAIN ] WST: Full history saved. [2025-09-22T22:09:33.814388] [INFO ] [MAIN ] Update Progress: 2327/2372 symbols completed. WST took 36.7s. Estimated remaining: 5m 59s. Rate: 7.5 symbols/min [2025-09-22T22:09:33.899431] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-22T22:09:33.991585] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:09:34.021237] [DEBUG] [LOCAL ] WTS: Loaded 18952 existing records from primary storage. [2025-09-22T22:09:34.021398] [INFO ] [MAIN ] WTS: Loaded 18952 existing records. [2025-09-22T22:09:34.127132] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-22T22:09:34.204762] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:09:34.205016] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-22T22:09:34.205067] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-22T22:09:34.205762] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-22T22:09:34.205825] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-22T22:09:34.606596] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:09:34.922082] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-22T22:09:35.247675] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-22T22:09:35.722049] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-22T22:09:35.798072] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-22T22:09:36.522115] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-22T22:09:37.322027] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-22T22:09:37.437440] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-22T22:09:37.505626] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-22T22:09:38.122129] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-22T22:09:38.832018] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-22T22:09:38.922061] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-22T22:09:39.049166] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-22T22:09:39.722116] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-22T22:09:40.051473] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-22T22:09:40.221856] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-22T22:09:40.522070] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-22T22:09:41.018336] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-22T22:09:41.322077] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-22T22:09:42.122066] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-22T22:09:42.852511] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T22:09:42.922069] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-22T22:09:43.191883] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-22T22:09:43.722108] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-22T22:09:44.098622] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-22T22:09:44.100085] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T22:09:44.107498] [INFO ] [REMOTE ] WTM: Full fetch complete (2168 records). [2025-09-22T22:09:44.107993] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-22T22:09:44.151624] [INFO ] [REMOTE ] WTI: Full fetch complete (64090 records). [2025-09-22T22:09:44.189787] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-22T22:09:44.464577] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-22T22:09:44.470196] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-22T22:09:44.470726] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-22T22:09:44.478960] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-22T22:09:44.486613] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-22T22:09:44.488143] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-22T22:09:44.506639] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-22T22:09:44.506897] [INFO ] [MAIN ] Update Progress: 2328/2372 symbols completed. WTM took 29.6s. Estimated remaining: 5m 51s. Rate: 7.5 symbols/min [2025-09-22T22:09:44.524457] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-22T22:09:44.894827] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:09:44.913695] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-22T22:09:44.913776] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-22T22:09:44.914956] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-22T22:09:44.915035] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-22T22:09:44.917633] [DEBUG] [LOCAL ] WTI: Trimmed 64090 records to 43694 (keeping 200 days of data) [2025-09-22T22:09:45.155166] [DEBUG] [LOCAL ] WTTR: Loaded 45823 existing records from primary storage. [2025-09-22T22:09:45.162418] [INFO ] [MAIN ] WTTR: Loaded 45823 existing records. [2025-09-22T22:09:45.352543] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-22T22:09:45.388367] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:09:45.403953] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-22T22:09:45.409293] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-22T22:09:45.409385] [DEBUG] [LOCAL ] WTI: Primary data saved (43694 records). [2025-09-22T22:09:45.409532] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-22T22:09:45.409673] [INFO ] [MAIN ] Update Progress: 2329/2372 symbols completed. WTI took 38.6s. Estimated remaining: 5m 43s. Rate: 7.5 symbols/min [2025-09-22T22:09:45.441454] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-22T22:09:45.474199] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-22T22:09:45.745551] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:09:45.958460] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:09:45.998293] [DEBUG] [LOCAL ] WU: Loaded 54225 existing records from primary storage. [2025-09-22T22:09:45.998470] [INFO ] [MAIN ] WU: Loaded 54225 existing records. [2025-09-22T22:09:46.123148] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-22T22:09:46.184437] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:09:46.184815] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-22T22:09:46.184923] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-22T22:09:46.186264] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-22T22:09:46.186384] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-22T22:09:46.468300] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T22:09:46.609067] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:09:46.621243] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T22:09:46.922053] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-22T22:09:47.444209] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-22T22:09:47.722093] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-22T22:09:48.522048] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-22T22:09:48.601732] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-22T22:09:48.662502] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-22T22:09:49.322077] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-22T22:09:50.020974] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-22T22:09:50.122025] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-22T22:09:50.268506] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-22T22:09:50.922022] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-22T22:09:51.206581] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-22T22:09:51.722053] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-22T22:09:52.488613] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-22T22:09:52.522026] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-22T22:09:53.322036] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-22T22:09:53.480623] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-22T22:09:54.033935] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-22T22:09:54.126946] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-22T22:09:54.132024] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-22T22:09:54.922019] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-22T22:09:55.156754] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-22T22:09:55.159582] [INFO ] [REMOTE ] WTS: Full fetch complete (26331 records). [2025-09-22T22:09:55.159701] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-22T22:09:55.533791] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-22T22:09:55.534097] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-22T22:09:55.534851] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-22T22:09:55.534914] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-22T22:09:55.535726] [DEBUG] [LOCAL ] WTS: Trimmed 26331 records to 18557 (keeping 200 days of data) [2025-09-22T22:09:55.657693] [DEBUG] [LOCAL ] WTS: Primary data saved (18557 records). [2025-09-22T22:09:55.657855] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-22T22:09:55.657966] [INFO ] [MAIN ] Update Progress: 2330/2372 symbols completed. WTS took 21.8s. Estimated remaining: 5m 35s. Rate: 7.5 symbols/min [2025-09-22T22:09:55.727249] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-22T22:09:55.832939] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:09:55.897240] [DEBUG] [LOCAL ] WWW: Loaded 49891 existing records from primary storage. [2025-09-22T22:09:55.897393] [INFO ] [MAIN ] WWW: Loaded 49891 existing records. [2025-09-22T22:09:56.079145] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:09:56.079442] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-22T22:09:56.079491] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-22T22:09:56.080743] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-22T22:09:56.080803] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-22T22:09:56.438758] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:09:56.471699] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T22:09:56.522093] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-22T22:09:57.322033] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-22T22:09:57.356090] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T22:09:57.833302] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-22T22:09:58.122083] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-22T22:09:58.912355] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-22T22:09:58.922460] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-22T22:09:59.544522] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-22T22:09:59.722059] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-22T22:10:00.511940] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T22:10:00.522250] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-22T22:10:01.322037] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-22T22:10:01.376198] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T22:10:01.875879] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-22T22:10:02.122061] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-22T22:10:02.799569] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-22T22:10:02.922033] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-22T22:10:03.722102] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-22T22:10:03.755012] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-22T22:10:03.763502] [INFO ] [REMOTE ] WTRG: Full fetch complete (73184 records). [2025-09-22T22:10:03.763619] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-22T22:10:04.159120] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-22T22:10:04.159212] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-22T22:10:04.160421] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-22T22:10:04.160493] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-22T22:10:04.162012] [DEBUG] [LOCAL ] WTRG: Trimmed 73184 records to 50932 (keeping 200 days of data) [2025-09-22T22:10:04.486763] [DEBUG] [LOCAL ] WTRG: Primary data saved (50932 records). [2025-09-22T22:10:04.486928] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-22T22:10:04.487014] [INFO ] [MAIN ] Update Progress: 2331/2372 symbols completed. WTRG took 35.4s. Estimated remaining: 5m 27s. Rate: 7.5 symbols/min [2025-09-22T22:10:04.533038] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-22T22:10:04.709531] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:10:04.711792] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T22:10:04.777220] [DEBUG] [LOCAL ] WY: Loaded 53892 existing records from primary storage. [2025-09-22T22:10:04.777539] [INFO ] [MAIN ] WY: Loaded 53892 existing records. [2025-09-22T22:10:04.979763] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:10:05.002082] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-22T22:10:05.012228] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-22T22:10:05.014895] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-22T22:10:05.014976] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-22T22:10:05.015155] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-22T22:10:05.327285] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-22T22:10:05.562920] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:10:06.122123] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-22T22:10:06.447191] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-22T22:10:06.922013] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-22T22:10:07.018106] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T22:10:07.722081] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-22T22:10:07.765834] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T22:10:08.522025] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-22T22:10:08.728315] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-22T22:10:09.048507] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-22T22:10:09.322050] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-22T22:10:10.122080] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-22T22:10:10.351541] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-22T22:10:10.633105] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-22T22:10:10.922125] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-22T22:10:11.210164] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-22T22:10:11.219185] [INFO ] [REMOTE ] WTTR: Full fetch complete (65551 records). [2025-09-22T22:10:11.219321] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-22T22:10:11.608854] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-22T22:10:11.608973] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-22T22:10:11.610098] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-22T22:10:11.610177] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-22T22:10:11.611526] [DEBUG] [LOCAL ] WTTR: Trimmed 65551 records to 45079 (keeping 200 days of data) [2025-09-22T22:10:11.725285] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-22T22:10:11.888885] [DEBUG] [LOCAL ] WTTR: Primary data saved (45079 records). [2025-09-22T22:10:11.889055] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-22T22:10:11.889189] [INFO ] [MAIN ] Update Progress: 2332/2372 symbols completed. WTTR took 27.4s. Estimated remaining: 5m 19s. Rate: 7.5 symbols/min [2025-09-22T22:10:12.071625] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:10:12.105340] [DEBUG] [LOCAL ] XFLT: Loaded 30468 existing records from primary storage. [2025-09-22T22:10:12.105477] [INFO ] [MAIN ] XFLT: Loaded 30468 existing records. [2025-09-22T22:10:12.305336] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:10:12.305597] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-22T22:10:12.305697] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-22T22:10:12.306453] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-22T22:10:12.306513] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-22T22:10:12.526583] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-22T22:10:12.682989] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:10:12.721900] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-22T22:10:13.322013] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-22T22:10:13.871196] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-22T22:10:14.058143] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T22:10:14.122070] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-22T22:10:14.369321] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-22T22:10:14.922060] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-22T22:10:15.722077] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-22T22:10:15.788552] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T22:10:16.522090] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-22T22:10:16.798793] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-22T22:10:17.322096] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-22T22:10:17.408510] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-22T22:10:17.667311] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T22:10:18.122120] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-22T22:10:18.913092] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-22T22:10:18.924562] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-22T22:10:19.722057] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-22T22:10:19.846533] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T22:10:19.873670] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T22:10:20.522077] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-22T22:10:21.322090] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-22T22:10:21.632630] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-22T22:10:21.671955] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-22T22:10:21.680297] [INFO ] [REMOTE ] WWW: Full fetch complete (69839 records). [2025-09-22T22:10:21.680488] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-22T22:10:22.103962] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-22T22:10:22.104066] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-22T22:10:22.105258] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-22T22:10:22.105324] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-22T22:10:22.107717] [DEBUG] [LOCAL ] WWW: Trimmed 69839 records to 49168 (keeping 200 days of data) [2025-09-22T22:10:22.162042] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-22T22:10:22.408207] [DEBUG] [LOCAL ] WWW: Primary data saved (49168 records). [2025-09-22T22:10:22.408348] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-22T22:10:22.408431] [INFO ] [MAIN ] Update Progress: 2333/2372 symbols completed. WWW took 26.8s. Estimated remaining: 5m 11s. Rate: 7.5 symbols/min [2025-09-22T22:10:22.607603] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:10:22.651495] [DEBUG] [LOCAL ] XHR: Loaded 45098 existing records from primary storage. [2025-09-22T22:10:22.651690] [INFO ] [MAIN ] XHR: Loaded 45098 existing records. [2025-09-22T22:10:22.835667] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:10:22.836172] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-22T22:10:22.836248] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-22T22:10:22.837474] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-22T22:10:22.837539] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-22T22:10:22.927517] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-22T22:10:22.991456] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-22T22:10:23.239724] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:10:23.515025] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-22T22:10:23.722010] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-22T22:10:24.460289] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-22T22:10:24.522093] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-22T22:10:25.327328] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-22T22:10:25.332115] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T22:10:25.616027] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-22T22:10:26.122064] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-22T22:10:26.572534] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-22T22:10:26.922092] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-22T22:10:27.722124] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-22T22:10:27.779340] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T22:10:28.297768] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-22T22:10:28.522105] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-22T22:10:29.081172] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-22T22:10:29.322039] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-22T22:10:30.122040] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-22T22:10:30.405496] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-22T22:10:30.552757] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-22T22:10:30.922079] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-22T22:10:31.100465] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-22T22:10:31.722108] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-22T22:10:32.522026] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-22T22:10:32.678003] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-22T22:10:33.322084] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-22T22:10:33.387200] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-22T22:10:33.906973] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-22T22:10:34.122058] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-22T22:10:34.718865] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-22T22:10:34.727161] [INFO ] [REMOTE ] WU: Full fetch complete (77315 records). [2025-09-22T22:10:34.727288] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-22T22:10:34.929787] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-22T22:10:35.134841] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-22T22:10:35.134920] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-22T22:10:35.136147] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-22T22:10:35.136212] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-22T22:10:35.137817] [DEBUG] [LOCAL ] WU: Trimmed 77315 records to 53451 (keeping 200 days of data) [2025-09-22T22:10:35.486555] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-22T22:10:35.498557] [DEBUG] [LOCAL ] WU: Primary data saved (53451 records). [2025-09-22T22:10:35.498696] [INFO ] [MAIN ] WU: Full history saved. [2025-09-22T22:10:35.498785] [INFO ] [MAIN ] Update Progress: 2334/2372 symbols completed. WU took 50.1s. Estimated remaining: 5m 3s. Rate: 7.5 symbols/min [2025-09-22T22:10:35.667931] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:10:35.668117] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-22T22:10:35.668155] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-22T22:10:35.668322] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-22T22:10:35.668365] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-22T22:10:35.668407] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-22T22:10:35.668440] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-22T22:10:35.735003] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-22T22:10:36.029927] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:10:36.348741] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-22T22:10:36.522018] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-22T22:10:36.640292] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-22T22:10:36.646101] [INFO ] [REMOTE ] XFLT: Full fetch complete (44703 records). [2025-09-22T22:10:36.646219] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-22T22:10:37.034576] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-22T22:10:37.034702] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-22T22:10:37.035760] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-22T22:10:37.035847] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-22T22:10:37.036983] [DEBUG] [LOCAL ] XFLT: Trimmed 44703 records to 30093 (keeping 200 days of data) [2025-09-22T22:10:37.222222] [DEBUG] [LOCAL ] XFLT: Primary data saved (30093 records). [2025-09-22T22:10:37.222503] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-22T22:10:37.222639] [INFO ] [MAIN ] Update Progress: 2335/2372 symbols completed. XFLT took 25.3s. Estimated remaining: 4m 55s. Rate: 7.5 symbols/min [2025-09-22T22:10:37.328681] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-22T22:10:37.413321] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:10:37.474383] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-09-22T22:10:37.474570] [INFO ] [MAIN ] XOM: Loaded 54573 existing records. [2025-09-22T22:10:37.678816] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:10:37.679061] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-22T22:10:37.679114] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-22T22:10:37.680487] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-22T22:10:37.680549] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-22T22:10:38.056714] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:10:38.084147] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T22:10:38.122019] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-22T22:10:38.922026] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-22T22:10:38.985117] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-22T22:10:39.125687] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:10:39.126036] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-22T22:10:39.274475] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-22T22:10:39.722079] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-09-22T22:10:39.933605] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:10:39.933951] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-09-22T22:10:40.522066] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-22T22:10:41.322048] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-22T22:10:42.053636] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T22:10:42.122001] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-22T22:10:42.922083] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-22T22:10:43.112541] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-22T22:10:43.641896] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-22T22:10:43.650541] [INFO ] [REMOTE ] WY: Full fetch complete (76816 records). [2025-09-22T22:10:43.650704] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-22T22:10:43.723304] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-22T22:10:43.838950] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-22T22:10:44.091180] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-22T22:10:44.091273] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-22T22:10:44.092571] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-22T22:10:44.092638] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-22T22:10:44.094161] [DEBUG] [LOCAL ] WY: Trimmed 76816 records to 53118 (keeping 200 days of data) [2025-09-22T22:10:44.419432] [DEBUG] [LOCAL ] WY: Primary data saved (53118 records). [2025-09-22T22:10:44.419580] [INFO ] [MAIN ] WY: Full history saved. [2025-09-22T22:10:44.419709] [INFO ] [MAIN ] Update Progress: 2336/2372 symbols completed. WY took 39.9s. Estimated remaining: 4m 47s. Rate: 7.5 symbols/min [2025-09-22T22:10:44.525070] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-22T22:10:44.597555] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:10:44.629638] [DEBUG] [LOCAL ] XPER: Loaded 30079 existing records from primary storage. [2025-09-22T22:10:44.629805] [INFO ] [MAIN ] XPER: Loaded 30079 existing records. [2025-09-22T22:10:44.805320] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:10:44.805610] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-22T22:10:44.805690] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-22T22:10:44.806389] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-22T22:10:44.806448] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-22T22:10:45.160833] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:10:45.240114] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T22:10:45.322023] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-22T22:10:46.122113] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-22T22:10:46.251715] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-22T22:10:46.931067] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-22T22:10:46.954443] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-22T22:10:47.389051] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T22:10:47.722048] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-22T22:10:48.185110] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-22T22:10:48.522101] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-22T22:10:48.861100] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-22T22:10:48.868109] [INFO ] [REMOTE ] XHR: Full fetch complete (61598 records). [2025-09-22T22:10:48.868254] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-22T22:10:49.265075] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-22T22:10:49.265153] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-22T22:10:49.266253] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-22T22:10:49.266315] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-22T22:10:49.267555] [DEBUG] [LOCAL ] XHR: Trimmed 61598 records to 44300 (keeping 200 days of data) [2025-09-22T22:10:49.330272] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-22T22:10:49.539326] [DEBUG] [LOCAL ] XHR: Primary data saved (44300 records). [2025-09-22T22:10:49.539459] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-22T22:10:49.539539] [INFO ] [MAIN ] Update Progress: 2337/2372 symbols completed. XHR took 27.1s. Estimated remaining: 4m 39s. Rate: 7.5 symbols/min [2025-09-22T22:10:49.714457] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:10:49.731296] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-22T22:10:49.786437] [DEBUG] [LOCAL ] XPEV: Loaded 54422 existing records from primary storage. [2025-09-22T22:10:49.786577] [INFO ] [MAIN ] XPEV: Loaded 54422 existing records. [2025-09-22T22:10:49.969662] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:10:49.970135] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-22T22:10:49.970204] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-22T22:10:49.971552] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-22T22:10:49.971613] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-22T22:10:50.124267] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-22T22:10:50.335817] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:10:50.922093] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-22T22:10:51.722024] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-22T22:10:51.799401] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-22T22:10:51.838476] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-22T22:10:52.522107] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-22T22:10:52.606420] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-22T22:10:52.777742] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-22T22:10:53.322059] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-22T22:10:54.041523] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-22T22:10:54.122147] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-22T22:10:54.922057] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-22T22:10:55.481938] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-22T22:10:55.589224] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-22T22:10:55.722060] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-22T22:10:56.277026] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-22T22:10:56.522137] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-22T22:10:56.583466] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T22:10:57.322051] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-22T22:10:58.122170] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-22T22:10:58.705679] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-22T22:10:58.855479] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-22T22:10:58.922007] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-22T22:10:59.722114] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-22T22:11:00.316827] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-22T22:11:00.323961] [INFO ] [REMOTE ] XIFR: Full fetch complete (53900 records). [2025-09-22T22:11:00.324132] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-22T22:11:00.458365] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-22T22:11:00.526844] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-22T22:11:00.562731] [WARN ] [VALIDATOR ] XIFR: Validation failed - insufficient historical data. Have 160 unique days, need 200 days [2025-09-22T22:11:00.563281] [FATAL] [MAIN ] XIFR: Fetched primary data is invalid. Refusing to save it. [2025-09-22T22:11:00.563413] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to validation failure. [2025-09-22T22:11:00.563487] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-22T22:11:00.563550] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-22T22:11:00.563586] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-22T22:11:00.563638] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-22T22:11:00.563745] [INFO ] [MAIN ] Update Progress: 2338/2372 symbols completed. XIFR took 25.1s. Estimated remaining: 4m 31s. Rate: 7.5 symbols/min [2025-09-22T22:11:00.733274] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:11:00.783110] [DEBUG] [LOCAL ] XPO: Loaded 48980 existing records from primary storage. [2025-09-22T22:11:00.783311] [INFO ] [MAIN ] XPO: Loaded 48980 existing records. [2025-09-22T22:11:00.960258] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:11:00.960518] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-22T22:11:00.960574] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-22T22:11:00.962164] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-22T22:11:00.962225] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-22T22:11:01.312907] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:11:01.322003] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-22T22:11:02.132706] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-22T22:11:02.139436] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-22T22:11:02.817195] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T22:11:02.859045] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-22T22:11:02.922048] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-22T22:11:03.067128] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-22T22:11:03.722074] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-22T22:11:04.522044] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-22T22:11:04.612174] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-22T22:11:05.322074] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-22T22:11:06.073528] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-22T22:11:06.122011] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-22T22:11:06.922062] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-22T22:11:06.967457] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-22T22:11:07.009812] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-22T22:11:07.722064] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-22T22:11:08.074554] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-22T22:11:08.242105] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-22T22:11:08.522073] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-22T22:11:09.322055] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-22T22:11:10.122032] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-22T22:11:10.169086] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-22T22:11:10.922133] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-22T22:11:10.977260] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-22T22:11:11.024063] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T22:11:11.206600] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-22T22:11:11.722074] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-22T22:11:12.522022] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-22T22:11:12.900230] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-22T22:11:12.906111] [INFO ] [REMOTE ] XPER: Full fetch complete (43231 records). [2025-09-22T22:11:12.906233] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-22T22:11:13.328752] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-22T22:11:13.331473] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-22T22:11:13.346579] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-22T22:11:13.348609] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-22T22:11:13.349246] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-22T22:11:13.352887] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-22T22:11:13.366368] [DEBUG] [LOCAL ] XPER: Trimmed 43231 records to 29634 (keeping 200 days of data) [2025-09-22T22:11:13.540997] [DEBUG] [LOCAL ] XPER: Primary data saved (29634 records). [2025-09-22T22:11:13.541148] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-22T22:11:13.541236] [INFO ] [MAIN ] Update Progress: 2339/2372 symbols completed. XPER took 29.1s. Estimated remaining: 4m 23s. Rate: 7.5 symbols/min [2025-09-22T22:11:13.709940] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:11:13.748435] [DEBUG] [LOCAL ] XPOF: Loaded 39424 existing records from primary storage. [2025-09-22T22:11:13.748610] [INFO ] [MAIN ] XPOF: Loaded 39424 existing records. [2025-09-22T22:11:13.938236] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:11:13.938550] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-22T22:11:13.938603] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-22T22:11:13.939608] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-22T22:11:13.939716] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-22T22:11:14.155588] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-22T22:11:14.313360] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:11:14.364085] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-22T22:11:14.922055] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-22T22:11:15.727675] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-22T22:11:15.729736] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-22T22:11:15.922484] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-22T22:11:16.020210] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-22T22:11:16.522056] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-22T22:11:17.322032] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-22T22:11:17.422787] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-22T22:11:18.122073] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-22T22:11:18.922096] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-22T22:11:18.955570] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-22T22:11:19.260098] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-22T22:11:19.454764] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-22T22:11:19.722077] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-22T22:11:20.097128] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-22T22:11:20.113522] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-09-22T22:11:20.113896] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-22T22:11:20.528848] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-22T22:11:20.856070] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-22T22:11:20.881019] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-22T22:11:20.888533] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-22T22:11:20.894009] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-22T22:11:20.890318] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-22T22:11:20.914044] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-09-22T22:11:21.325919] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-22T22:11:21.350861] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-09-22T22:11:21.351131] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-22T22:11:21.353018] [INFO ] [MAIN ] Update Progress: 2340/2372 symbols completed. XOM took 44.1s. Estimated remaining: 4m 15s. Rate: 7.5 symbols/min [2025-09-22T22:11:21.555513] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:11:21.608872] [DEBUG] [LOCAL ] XPRO: Loaded 46874 existing records from primary storage. [2025-09-22T22:11:21.609026] [INFO ] [MAIN ] XPRO: Loaded 46874 existing records. [2025-09-22T22:11:21.793204] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:11:21.793461] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-22T22:11:21.793510] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-22T22:11:21.794472] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-22T22:11:21.794532] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-22T22:11:22.127213] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-22T22:11:22.196912] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:11:22.909344] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-22T22:11:22.918001] [INFO ] [REMOTE ] XPEV: Full fetch complete (77682 records). [2025-09-22T22:11:22.918179] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-22T22:11:22.930233] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-22T22:11:23.243090] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-22T22:11:23.323395] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-22T22:11:23.412694] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-22T22:11:23.412789] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-22T22:11:23.414047] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-22T22:11:23.414113] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-22T22:11:23.418286] [DEBUG] [LOCAL ] XPEV: Trimmed 77682 records to 53642 (keeping 200 days of data) [2025-09-22T22:11:23.731467] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-22T22:11:23.768017] [DEBUG] [LOCAL ] XPEV: Primary data saved (53642 records). [2025-09-22T22:11:23.768268] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-22T22:11:23.768593] [INFO ] [MAIN ] Update Progress: 2341/2372 symbols completed. XPEV took 34.2s. Estimated remaining: 4m 7s. Rate: 7.5 symbols/min [2025-09-22T22:11:23.966488] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:11:24.000805] [DEBUG] [LOCAL ] XYF: Loaded 28022 existing records from primary storage. [2025-09-22T22:11:24.000957] [INFO ] [MAIN ] XYF: Loaded 28022 existing records. [2025-09-22T22:11:24.180875] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:11:24.181166] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-22T22:11:24.181216] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-22T22:11:24.182204] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-22T22:11:24.182283] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-22T22:11:24.523395] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-22T22:11:24.569189] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:11:24.643103] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T22:11:24.918072] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-22T22:11:25.322051] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-22T22:11:26.058347] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-22T22:11:26.122120] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-22T22:11:26.264205] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-22T22:11:26.922063] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-22T22:11:27.436947] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-22T22:11:27.525133] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-22T22:11:27.722080] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-22T22:11:28.522043] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-22T22:11:28.554005] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-22T22:11:29.322061] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-22T22:11:29.695069] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T22:11:30.122110] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-22T22:11:30.300035] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-22T22:11:30.922058] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-22T22:11:31.305556] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-22T22:11:31.722106] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-22T22:11:32.153039] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-22T22:11:32.522107] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-22T22:11:33.322086] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-22T22:11:33.381833] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-22T22:11:33.390154] [INFO ] [REMOTE ] XPO: Full fetch complete (70202 records). [2025-09-22T22:11:33.390414] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-22T22:11:33.828180] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-22T22:11:33.828352] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-22T22:11:33.831247] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-22T22:11:33.831609] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-22T22:11:33.851635] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-22T22:11:33.851843] [DEBUG] [LOCAL ] XPO: Trimmed 70202 records to 48220 (keeping 200 days of data) [2025-09-22T22:11:34.141471] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-22T22:11:34.172347] [DEBUG] [LOCAL ] XPO: Primary data saved (48220 records). [2025-09-22T22:11:34.172496] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-22T22:11:34.172691] [INFO ] [MAIN ] Update Progress: 2342/2372 symbols completed. XPO took 33.6s. Estimated remaining: 3m 59s. Rate: 7.5 symbols/min [2025-09-22T22:11:34.359957] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:11:34.427932] [DEBUG] [LOCAL ] XYL: Loaded 48923 existing records from primary storage. [2025-09-22T22:11:34.428093] [INFO ] [MAIN ] XYL: Loaded 48923 existing records. [2025-09-22T22:11:34.616915] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:11:34.617228] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-22T22:11:34.617306] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-22T22:11:34.618828] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-22T22:11:34.618919] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-22T22:11:34.925242] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-22T22:11:34.985722] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:11:35.019505] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T22:11:35.311684] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T22:11:35.722113] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-22T22:11:36.491341] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-22T22:11:36.522004] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-22T22:11:36.891761] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-22T22:11:37.322050] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-22T22:11:37.474248] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-22T22:11:38.122074] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-22T22:11:38.585290] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-22T22:11:38.922077] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-22T22:11:39.526512] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-22T22:11:39.722067] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-22T22:11:40.418181] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T22:11:40.522025] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-22T22:11:41.322026] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-22T22:11:41.384460] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-22T22:11:42.122083] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-22T22:11:42.198841] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-22T22:11:42.433045] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-22T22:11:42.922153] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-22T22:11:43.667540] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-22T22:11:43.722020] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-22T22:11:44.374334] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-22T22:11:44.522095] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-22T22:11:45.218067] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-22T22:11:45.322085] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-22T22:11:45.857302] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T22:11:46.122085] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-22T22:11:46.922123] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-22T22:11:47.014042] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T22:11:47.055766] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-22T22:11:47.061703] [INFO ] [REMOTE ] XPOF: Full fetch complete (52217 records). [2025-09-22T22:11:47.061831] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-22T22:11:47.452055] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-22T22:11:47.452237] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-22T22:11:47.453339] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-22T22:11:47.453407] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-22T22:11:47.454719] [DEBUG] [LOCAL ] XPOF: Trimmed 52217 records to 38863 (keeping 200 days of data) [2025-09-22T22:11:47.681419] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-22T22:11:47.690177] [INFO ] [REMOTE ] XYF: Full fetch complete (31272 records). [2025-09-22T22:11:47.690980] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-22T22:11:47.726187] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-22T22:11:48.028389] [DEBUG] [LOCAL ] XPOF: Primary data saved (38863 records). [2025-09-22T22:11:48.034373] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-22T22:11:48.039698] [INFO ] [MAIN ] Update Progress: 2343/2372 symbols completed. XPOF took 34.5s. Estimated remaining: 3m 52s. Rate: 7.5 symbols/min [2025-09-22T22:11:48.281564] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-22T22:11:48.288723] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-22T22:11:48.298737] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-22T22:11:48.298835] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-22T22:11:48.321826] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:11:48.322687] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-22T22:11:48.322491] [DEBUG] [LOCAL ] XYF: Trimmed 31272 records to 27974 (keeping 200 days of data) [2025-09-22T22:11:48.322833] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-22T22:11:48.323836] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-22T22:11:48.323955] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-22T22:11:48.324016] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-22T22:11:48.324054] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-22T22:11:48.526592] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-22T22:11:48.828394] [DEBUG] [LOCAL ] XYF: Primary data saved (27974 records). [2025-09-22T22:11:48.848138] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-22T22:11:48.864437] [INFO ] [MAIN ] Update Progress: 2344/2372 symbols completed. XYF took 25.1s. Estimated remaining: 3m 43s. Rate: 7.5 symbols/min [2025-09-22T22:11:48.870323] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:11:49.068475] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:11:49.117765] [DEBUG] [LOCAL ] YALA: Loaded 37704 existing records from primary storage. [2025-09-22T22:11:49.118032] [INFO ] [MAIN ] YALA: Loaded 37704 existing records. [2025-09-22T22:11:49.323974] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-22T22:11:49.332392] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:11:49.332850] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-22T22:11:49.333055] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-22T22:11:49.343445] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-22T22:11:49.359066] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-22T22:11:49.433755] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-22T22:11:49.602490] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-22T22:11:49.636694] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-22T22:11:49.746013] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:11:50.122070] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-22T22:11:50.469795] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T22:11:50.922084] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-22T22:11:51.553364] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-22T22:11:51.560536] [INFO ] [REMOTE ] XPRO: Full fetch complete (66713 records). [2025-09-22T22:11:51.560723] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-22T22:11:51.735546] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-22T22:11:51.992492] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-22T22:11:51.992864] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-22T22:11:51.994086] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-22T22:11:51.994153] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-22T22:11:51.998089] [DEBUG] [LOCAL ] XPRO: Trimmed 66713 records to 46119 (keeping 200 days of data) [2025-09-22T22:11:52.108301] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-22T22:11:52.305296] [DEBUG] [LOCAL ] XPRO: Primary data saved (46119 records). [2025-09-22T22:11:52.305452] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-22T22:11:52.305579] [INFO ] [MAIN ] Update Progress: 2345/2372 symbols completed. XPRO took 31.0s. Estimated remaining: 3m 35s. Rate: 7.5 symbols/min [2025-09-22T22:11:52.481639] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:11:52.524038] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-09-22T22:11:52.526560] [DEBUG] [LOCAL ] YELP: Loaded 46049 existing records from primary storage. [2025-09-22T22:11:52.526756] [INFO ] [MAIN ] YELP: Loaded 46049 existing records. [2025-09-22T22:11:52.715623] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:11:52.715941] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-22T22:11:52.715991] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-22T22:11:52.717246] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-22T22:11:52.717309] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-22T22:11:53.079665] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:11:53.322033] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-22T22:11:53.520730] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T22:11:53.866614] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-22T22:11:54.122036] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-22T22:11:54.288698] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-22T22:11:54.922119] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-22T22:11:55.722026] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-22T22:11:55.803033] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-22T22:11:55.867533] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-22T22:11:56.522057] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-22T22:11:57.322052] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-22T22:11:57.854336] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-22T22:11:57.912882] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-22T22:11:58.122060] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-22T22:11:58.374098] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-22T22:11:58.922080] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-22T22:11:59.609726] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-22T22:11:59.722064] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-22T22:12:00.460970] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-22T22:12:00.522057] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-22T22:12:01.322039] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-22T22:12:01.351603] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-22T22:12:01.360726] [INFO ] [REMOTE ] XYL: Full fetch complete (69932 records). [2025-09-22T22:12:01.360861] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-22T22:12:01.665378] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-22T22:12:01.823094] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-22T22:12:01.823308] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-22T22:12:01.825401] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-22T22:12:01.825503] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-22T22:12:01.828383] [DEBUG] [LOCAL ] XYL: Trimmed 69932 records to 48198 (keeping 200 days of data) [2025-09-22T22:12:02.122368] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-22T22:12:02.178841] [DEBUG] [LOCAL ] XYL: Primary data saved (48198 records). [2025-09-22T22:12:02.178991] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-22T22:12:02.179092] [INFO ] [MAIN ] Update Progress: 2346/2372 symbols completed. XYL took 28.0s. Estimated remaining: 3m 27s. Rate: 7.5 symbols/min [2025-09-22T22:12:02.355387] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:12:02.409337] [DEBUG] [LOCAL ] YETI: Loaded 53251 existing records from primary storage. [2025-09-22T22:12:02.409485] [INFO ] [MAIN ] YETI: Loaded 53251 existing records. [2025-09-22T22:12:02.595820] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:12:02.596113] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-22T22:12:02.596216] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-22T22:12:02.597306] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-22T22:12:02.597368] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-22T22:12:02.931623] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-22T22:12:02.967285] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:12:03.722096] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-22T22:12:05.082904] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (3.76 seconds). [2025-09-22T22:12:05.094415] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-22T22:12:05.242778] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-22T22:12:05.322074] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-22T22:12:05.672970] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-22T22:12:06.098452] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-22T22:12:06.122003] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-22T22:12:06.788113] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T22:12:06.922024] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-22T22:12:07.471024] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-22T22:12:07.722025] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-22T22:12:07.881048] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-22T22:12:07.919219] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-22T22:12:08.522057] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-22T22:12:09.322071] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-22T22:12:09.891028] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-22T22:12:10.114851] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-22T22:12:10.125331] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-22T22:12:10.837685] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-22T22:12:10.922070] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-22T22:12:11.722042] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-22T22:12:11.858453] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-22T22:12:12.522156] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-22T22:12:12.741432] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-22T22:12:12.897456] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-22T22:12:13.322093] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-22T22:12:13.684081] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-22T22:12:13.692616] [INFO ] [REMOTE ] YALA: Full fetch complete (46684 records). [2025-09-22T22:12:13.692938] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-22T22:12:14.127396] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-22T22:12:14.413254] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-22T22:12:14.413397] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-22T22:12:14.415764] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-22T22:12:14.416029] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-22T22:12:14.417798] [DEBUG] [LOCAL ] YALA: Trimmed 46684 records to 37363 (keeping 200 days of data) [2025-09-22T22:12:14.657828] [DEBUG] [LOCAL ] YALA: Primary data saved (37363 records). [2025-09-22T22:12:14.658003] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-22T22:12:14.658101] [INFO ] [MAIN ] Update Progress: 2347/2372 symbols completed. YALA took 25.8s. Estimated remaining: 3m 20s. Rate: 7.5 symbols/min [2025-09-22T22:12:14.839509] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:12:14.880479] [DEBUG] [LOCAL ] YEXT: Loaded 44073 existing records from primary storage. [2025-09-22T22:12:14.880681] [INFO ] [MAIN ] YEXT: Loaded 44073 existing records. [2025-09-22T22:12:14.924702] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-22T22:12:15.031812] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-22T22:12:15.113289] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:12:15.113563] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-22T22:12:15.113612] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-22T22:12:15.114528] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-22T22:12:15.114590] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-22T22:12:15.474891] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:12:15.722029] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-22T22:12:15.925623] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-22T22:12:16.522053] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-22T22:12:17.322060] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-22T22:12:17.819295] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-22T22:12:17.950363] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-22T22:12:18.122019] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-22T22:12:18.697474] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-22T22:12:18.922071] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-22T22:12:19.271294] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-22T22:12:19.722064] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-22T22:12:19.844099] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T22:12:20.119632] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-22T22:12:20.522054] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-22T22:12:21.322066] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-22T22:12:21.851417] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-22T22:12:21.970028] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-22T22:12:22.122072] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-22T22:12:22.819887] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-22T22:12:22.828283] [INFO ] [REMOTE ] XYZ: Full fetch complete (65837 records). [2025-09-22T22:12:22.828422] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-22T22:12:22.926761] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-22T22:12:23.038176] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-22T22:12:23.039023] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-22T22:12:23.039222] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-22T22:12:23.039422] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-22T22:12:23.039702] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-22T22:12:23.039840] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-22T22:12:23.040000] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-22T22:12:23.040100] [INFO ] [MAIN ] Update Progress: 2348/2372 symbols completed. XYZ took 35.0s. Estimated remaining: 3m 12s. Rate: 7.5 symbols/min [2025-09-22T22:12:23.218406] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:12:23.251587] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-22T22:12:23.315226] [DEBUG] [LOCAL ] YMM: Loaded 53484 existing records from primary storage. [2025-09-22T22:12:23.315383] [INFO ] [MAIN ] YMM: Loaded 53484 existing records. [2025-09-22T22:12:23.491591] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:12:23.491897] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-22T22:12:23.491946] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-22T22:12:23.493280] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-22T22:12:23.493340] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-22T22:12:23.733890] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-22T22:12:23.851916] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:12:24.476197] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T22:12:24.522092] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-22T22:12:25.058116] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-22T22:12:25.322079] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-22T22:12:26.122042] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-22T22:12:26.211167] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-22T22:12:26.837319] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-22T22:12:26.922054] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-22T22:12:27.722057] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-22T22:12:27.813347] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-22T22:12:28.522124] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-22T22:12:28.763521] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-22T22:12:29.322031] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-22T22:12:29.384221] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-22T22:12:30.122020] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-22T22:12:30.217679] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-22T22:12:30.224854] [INFO ] [REMOTE ] YELP: Full fetch complete (64142 records). [2025-09-22T22:12:30.224975] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-22T22:12:30.612682] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-22T22:12:30.612971] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-22T22:12:30.614215] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-22T22:12:30.614327] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-22T22:12:30.616218] [DEBUG] [LOCAL ] YELP: Trimmed 64142 records to 45342 (keeping 200 days of data) [2025-09-22T22:12:30.735623] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-22T22:12:30.924974] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-22T22:12:30.924849] [DEBUG] [LOCAL ] YELP: Primary data saved (45342 records). [2025-09-22T22:12:30.925326] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-22T22:12:30.926402] [INFO ] [MAIN ] Update Progress: 2349/2372 symbols completed. YELP took 38.6s. Estimated remaining: 3m 4s. Rate: 7.5 symbols/min [2025-09-22T22:12:31.102466] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:12:31.153034] [DEBUG] [LOCAL ] YOU: Loaded 50675 existing records from primary storage. [2025-09-22T22:12:31.153220] [INFO ] [MAIN ] YOU: Loaded 50675 existing records. [2025-09-22T22:12:31.332615] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:12:31.332886] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-22T22:12:31.332934] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-22T22:12:31.334179] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-22T22:12:31.334239] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-22T22:12:31.696664] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:12:31.718115] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-22T22:12:31.725471] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-22T22:12:31.727222] [INFO ] [REMOTE ] YETI: Full fetch complete (75423 records). [2025-09-22T22:12:31.727314] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-22T22:12:32.119992] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-22T22:12:32.120073] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-22T22:12:32.121300] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-22T22:12:32.121369] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-22T22:12:32.122847] [DEBUG] [LOCAL ] YETI: Trimmed 75423 records to 52486 (keeping 200 days of data) [2025-09-22T22:12:32.439413] [DEBUG] [LOCAL ] YETI: Primary data saved (52486 records). [2025-09-22T22:12:32.439594] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-22T22:12:32.439737] [INFO ] [MAIN ] Update Progress: 2350/2372 symbols completed. YETI took 30.3s. Estimated remaining: 2m 56s. Rate: 7.5 symbols/min [2025-09-22T22:12:32.528340] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-22T22:12:32.640989] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:12:32.643434] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T22:12:32.700053] [DEBUG] [LOCAL ] YPF: Loaded 51232 existing records from primary storage. [2025-09-22T22:12:32.700223] [INFO ] [MAIN ] YPF: Loaded 51232 existing records. [2025-09-22T22:12:32.880873] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:12:32.881104] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-22T22:12:32.881170] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-22T22:12:32.882225] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-22T22:12:32.882285] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-22T22:12:33.247256] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:12:33.322004] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-22T22:12:33.446689] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-22T22:12:34.122052] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-22T22:12:34.297164] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-22T22:12:34.567290] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-22T22:12:34.922066] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-22T22:12:35.722082] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-22T22:12:35.948479] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-22T22:12:36.522151] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-22T22:12:36.668024] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T22:12:37.322050] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-22T22:12:37.430351] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T22:12:38.092181] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-22T22:12:38.122055] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-22T22:12:38.922027] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-22T22:12:39.028503] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-22T22:12:39.615018] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T22:12:39.722070] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-22T22:12:40.522073] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-22T22:12:40.767732] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-22T22:12:41.186997] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T22:12:41.322077] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-22T22:12:42.122133] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-22T22:12:42.226290] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-22T22:12:42.861955] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-22T22:12:42.869623] [INFO ] [REMOTE ] YEXT: Full fetch complete (63492 records). [2025-09-22T22:12:42.869810] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-22T22:12:42.927573] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-22T22:12:43.279665] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-22T22:12:43.279788] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-22T22:12:43.281086] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-22T22:12:43.281249] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-22T22:12:43.282791] [DEBUG] [LOCAL ] YEXT: Trimmed 63492 records to 43344 (keeping 200 days of data) [2025-09-22T22:12:43.520196] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-22T22:12:43.567541] [DEBUG] [LOCAL ] YEXT: Primary data saved (43344 records). [2025-09-22T22:12:43.567706] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-22T22:12:43.567811] [INFO ] [MAIN ] Update Progress: 2351/2372 symbols completed. YEXT took 28.9s. Estimated remaining: 2m 48s. Rate: 7.5 symbols/min [2025-09-22T22:12:43.729946] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-22T22:12:43.752074] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:12:43.766479] [DEBUG] [LOCAL ] YRD: Loaded 12830 existing records from primary storage. [2025-09-22T22:12:43.766630] [INFO ] [MAIN ] YRD: Loaded 12830 existing records. [2025-09-22T22:12:43.946491] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:12:43.946822] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-22T22:12:43.946889] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-22T22:12:43.947347] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-22T22:12:43.947409] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-22T22:12:44.302750] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:12:44.522059] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-22T22:12:44.822703] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-22T22:12:45.322028] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-22T22:12:45.510355] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-22T22:12:46.005987] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-22T22:12:46.040107] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-22T22:12:46.122010] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-22T22:12:46.922072] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-22T22:12:47.722084] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-22T22:12:47.811375] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-22T22:12:48.060766] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-22T22:12:48.522068] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-22T22:12:49.277317] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-22T22:12:49.322025] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-22T22:12:50.122055] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-22T22:12:50.348857] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-22T22:12:50.505220] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-22T22:12:50.809198] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-22T22:12:50.922063] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-22T22:12:51.722089] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-22T22:12:52.528717] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-22T22:12:52.532114] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-22T22:12:53.284397] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-22T22:12:53.322022] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-22T22:12:54.060354] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-22T22:12:54.122082] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-22T22:12:54.922067] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-22T22:12:55.233932] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-22T22:12:55.309502] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-22T22:12:55.722087] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-22T22:12:56.318905] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-22T22:12:56.522063] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-22T22:12:56.752273] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-22T22:12:57.322063] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-22T22:12:57.905860] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-22T22:12:58.122073] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-22T22:12:58.181102] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-22T22:12:58.922077] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-22T22:12:59.711976] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-22T22:12:59.721998] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-22T22:13:00.010226] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-22T22:13:00.219609] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-22T22:13:00.522094] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-22T22:13:01.322075] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-22T22:13:02.122145] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-22T22:13:02.236585] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-22T22:13:02.245054] [INFO ] [REMOTE ] YMM: Full fetch complete (76447 records). [2025-09-22T22:13:02.245196] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-22T22:13:02.644830] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-22T22:13:02.644918] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-22T22:13:02.646361] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-22T22:13:02.646431] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-22T22:13:02.648038] [DEBUG] [LOCAL ] YMM: Trimmed 76447 records to 52698 (keeping 200 days of data) [2025-09-22T22:13:02.936274] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-22T22:13:02.988627] [DEBUG] [LOCAL ] YMM: Primary data saved (52698 records). [2025-09-22T22:13:02.988807] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-22T22:13:02.988926] [INFO ] [MAIN ] Update Progress: 2352/2372 symbols completed. YMM took 39.9s. Estimated remaining: 2m 40s. Rate: 7.5 symbols/min [2025-09-22T22:13:03.162946] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:13:03.204373] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-22T22:13:03.236002] [DEBUG] [LOCAL ] YSG: Loaded 24955 existing records from primary storage. [2025-09-22T22:13:03.236151] [INFO ] [MAIN ] YSG: Loaded 24955 existing records. [2025-09-22T22:13:03.411841] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:13:03.412131] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-22T22:13:03.412194] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-22T22:13:03.412903] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-22T22:13:03.412962] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-22T22:13:03.725295] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-22T22:13:03.789589] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:13:03.799358] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-22T22:13:03.852731] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-22T22:13:04.522063] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-22T22:13:05.322021] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-22T22:13:05.411612] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-22T22:13:05.416174] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-22T22:13:05.423276] [INFO ] [REMOTE ] YRD: Full fetch complete (19334 records). [2025-09-22T22:13:05.423519] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-22T22:13:05.468898] [INFO ] [REMOTE ] YOU: Full fetch complete (72186 records). [2025-09-22T22:13:05.509799] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-22T22:13:06.143326] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-22T22:13:06.127428] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-22T22:13:06.143661] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-22T22:13:06.144952] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-22T22:13:06.150191] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-22T22:13:06.236001] [DEBUG] [LOCAL ] YRD: Trimmed 19334 records to 12606 (keeping 200 days of data) [2025-09-22T22:13:06.239917] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-22T22:13:06.240353] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-22T22:13:06.241414] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-22T22:13:06.241522] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-22T22:13:06.295800] [DEBUG] [LOCAL ] YOU: Trimmed 72186 records to 49873 (keeping 200 days of data) [2025-09-22T22:13:06.577226] [DEBUG] [LOCAL ] YRD: Primary data saved (12606 records). [2025-09-22T22:13:06.580885] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-22T22:13:06.611167] [INFO ] [MAIN ] Update Progress: 2353/2372 symbols completed. YRD took 23.0s. Estimated remaining: 2m 32s. Rate: 7.5 symbols/min [2025-09-22T22:13:06.866796] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:13:06.870185] [DEBUG] [LOCAL ] YOU: Primary data saved (49873 records). [2025-09-22T22:13:06.872405] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-22T22:13:06.872840] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-22T22:13:06.884747] [INFO ] [MAIN ] Update Progress: 2354/2372 symbols completed. YOU took 36.0s. Estimated remaining: 2m 24s. Rate: 7.5 symbols/min [2025-09-22T22:13:06.901862] [INFO ] [REMOTE ] YPF: Full fetch complete (73520 records). [2025-09-22T22:13:06.928605] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-22T22:13:07.281927] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:13:07.392325] [DEBUG] [LOCAL ] YUM: Loaded 52076 existing records from primary storage. [2025-09-22T22:13:07.419107] [INFO ] [MAIN ] YUM: Loaded 52076 existing records. [2025-09-22T22:13:07.767020] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-22T22:13:07.838199] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-22T22:13:07.993129] [DEBUG] [LOCAL ] YUMC: Loaded 53504 existing records from primary storage. [2025-09-22T22:13:07.991807] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:13:08.010609] [INFO ] [MAIN ] YUMC: Loaded 53504 existing records. [2025-09-22T22:13:08.096239] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-22T22:13:08.107331] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-22T22:13:08.137482] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-22T22:13:08.162854] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-22T22:13:08.301713] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-22T22:13:08.356065] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-22T22:13:08.404721] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-22T22:13:08.451477] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:13:08.451581] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-22T22:13:08.455781] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-22T22:13:08.456164] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-22T22:13:08.495880] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-22T22:13:08.531602] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-22T22:13:08.553024] [DEBUG] [LOCAL ] YPF: Trimmed 73520 records to 50483 (keeping 200 days of data) [2025-09-22T22:13:09.036181] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:13:09.043289] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-22T22:13:09.048914] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-22T22:13:09.104063] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-22T22:13:09.244871] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:13:09.333498] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-22T22:13:09.430272] [DEBUG] [LOCAL ] YPF: Primary data saved (50483 records). [2025-09-22T22:13:09.430409] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-22T22:13:09.430492] [INFO ] [MAIN ] Update Progress: 2355/2372 symbols completed. YPF took 37.0s. Estimated remaining: 2m 16s. Rate: 7.5 symbols/min [2025-09-22T22:13:09.605677] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:13:09.659487] [DEBUG] [LOCAL ] ZBH: Loaded 51968 existing records from primary storage. [2025-09-22T22:13:09.659707] [INFO ] [MAIN ] ZBH: Loaded 51968 existing records. [2025-09-22T22:13:09.847945] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:13:09.848193] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-22T22:13:09.848242] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-22T22:13:09.849370] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-22T22:13:09.849431] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-22T22:13:09.977754] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-22T22:13:10.127192] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-22T22:13:10.232079] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:13:10.600570] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-22T22:13:10.881969] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-22T22:13:10.922091] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-22T22:13:11.245275] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-22T22:13:11.722072] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-22T22:13:11.967437] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-22T22:13:12.522097] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-22T22:13:13.080246] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-22T22:13:13.322105] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-22T22:13:13.589844] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-22T22:13:14.122075] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-22T22:13:14.922030] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-22T22:13:15.032902] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-22T22:13:15.722022] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-22T22:13:15.972566] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-22T22:13:16.384789] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-22T22:13:16.522043] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-22T22:13:17.322047] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-22T22:13:17.435395] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-22T22:13:18.122068] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-22T22:13:18.286131] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-22T22:13:18.685028] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-22T22:13:18.922122] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-22T22:13:19.722073] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-22T22:13:20.047637] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-22T22:13:20.522048] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-22T22:13:20.918720] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-22T22:13:21.322034] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-22T22:13:21.487938] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-22T22:13:21.954058] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-22T22:13:22.122041] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-22T22:13:22.860297] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-22T22:13:22.922005] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-22T22:13:23.722031] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-22T22:13:24.271043] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-22T22:13:24.522121] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-22T22:13:24.786584] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-22T22:13:25.322040] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-22T22:13:25.704540] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-22T22:13:26.007330] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-22T22:13:26.122007] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-22T22:13:26.922028] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-22T22:13:27.054152] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-22T22:13:27.722029] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-22T22:13:27.838597] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-22T22:13:28.522055] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-22T22:13:28.711466] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-22T22:13:28.936314] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-22T22:13:29.322053] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-22T22:13:29.995225] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-22T22:13:30.122020] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-22T22:13:30.284635] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T22:13:30.289265] [INFO ] [REMOTE ] YSG: Full fetch complete (32860 records). [2025-09-22T22:13:30.289405] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-22T22:13:30.681474] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-22T22:13:30.681618] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-22T22:13:30.682331] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-22T22:13:30.682409] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-22T22:13:30.683524] [DEBUG] [LOCAL ] YSG: Trimmed 32860 records to 24933 (keeping 200 days of data) [2025-09-22T22:13:30.838819] [DEBUG] [LOCAL ] YSG: Primary data saved (24933 records). [2025-09-22T22:13:30.838958] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-22T22:13:30.839093] [INFO ] [MAIN ] Update Progress: 2356/2372 symbols completed. YSG took 27.9s. Estimated remaining: 2m 8s. Rate: 7.5 symbols/min [2025-09-22T22:13:30.927229] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-22T22:13:31.017061] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:13:31.035758] [DEBUG] [LOCAL ] ZEPP: Loaded 16473 existing records from primary storage. [2025-09-22T22:13:31.035914] [INFO ] [MAIN ] ZEPP: Loaded 16473 existing records. [2025-09-22T22:13:31.214284] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:13:31.214553] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-22T22:13:31.214603] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-22T22:13:31.215091] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-22T22:13:31.215150] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-22T22:13:31.587698] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:13:31.722054] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-22T22:13:31.911928] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-22T22:13:32.522058] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-22T22:13:32.841669] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-22T22:13:32.883349] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-22T22:13:33.214156] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T22:13:33.322022] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-22T22:13:34.122063] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-22T22:13:34.922083] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-22T22:13:35.128547] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-22T22:13:35.722030] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-22T22:13:35.758563] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-22T22:13:36.261479] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-22T22:13:36.522066] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-22T22:13:37.212876] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-22T22:13:37.221953] [INFO ] [REMOTE ] YUM: Full fetch complete (74356 records). [2025-09-22T22:13:37.222203] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-22T22:13:37.327197] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-22T22:13:37.715938] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-22T22:13:37.758546] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-22T22:13:37.758978] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-22T22:13:37.761123] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-22T22:13:37.761760] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-22T22:13:37.764624] [DEBUG] [LOCAL ] YUM: Trimmed 74356 records to 51289 (keeping 200 days of data) [2025-09-22T22:13:37.898095] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-22T22:13:38.122238] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-22T22:13:38.128805] [DEBUG] [LOCAL ] YUM: Primary data saved (51289 records). [2025-09-22T22:13:38.129156] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-22T22:13:38.130963] [INFO ] [MAIN ] Update Progress: 2357/2372 symbols completed. YUM took 31.5s. Estimated remaining: 1m 60s. Rate: 7.5 symbols/min [2025-09-22T22:13:38.922075] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-22T22:13:39.722105] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-22T22:13:39.776114] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-22T22:13:39.789444] [INFO ] [REMOTE ] ZBH: Full fetch complete (73792 records). [2025-09-22T22:13:39.789686] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-22T22:13:40.204695] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-22T22:13:40.204817] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-22T22:13:40.207468] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-22T22:13:40.207843] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-22T22:13:40.235450] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-22T22:13:40.244337] [DEBUG] [LOCAL ] ZBH: Trimmed 73792 records to 51226 (keeping 200 days of data) [2025-09-22T22:13:40.245181] [INFO ] [REMOTE ] YUMC: Full fetch complete (76107 records). [2025-09-22T22:13:40.245360] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-22T22:13:40.355849] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-22T22:13:40.539001] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-22T22:13:40.789484] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-22T22:13:40.790470] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-22T22:13:40.792342] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-22T22:13:40.792776] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-22T22:13:40.800741] [DEBUG] [LOCAL ] YUMC: Trimmed 76107 records to 52724 (keeping 200 days of data) [2025-09-22T22:13:41.172335] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-22T22:13:41.280767] [DEBUG] [LOCAL ] ZBH: Primary data saved (51226 records). [2025-09-22T22:13:41.281691] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-22T22:13:41.282004] [INFO ] [MAIN ] Update Progress: 2358/2372 symbols completed. ZBH took 31.9s. Estimated remaining: 1m 52s. Rate: 7.5 symbols/min [2025-09-22T22:13:41.327243] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-22T22:13:41.375423] [DEBUG] [LOCAL ] YUMC: Primary data saved (52724 records). [2025-09-22T22:13:41.375623] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-22T22:13:41.375790] [INFO ] [MAIN ] Update Progress: 2359/2372 symbols completed. YUMC took 34.5s. Estimated remaining: 1m 44s. Rate: 7.5 symbols/min [2025-09-22T22:13:41.912122] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-22T22:13:42.122063] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-22T22:13:42.520435] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-22T22:13:42.922122] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-22T22:13:43.492971] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-22T22:13:43.722074] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-22T22:13:44.913935] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T22:13:44.920503] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-22T22:13:46.497717] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T22:13:46.505839] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-22T22:13:47.979957] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-22T22:13:47.985400] [INFO ] [REMOTE ] ZEPP: Full fetch complete (17996 records). [2025-09-22T22:13:47.989355] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-22T22:13:48.360496] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-22T22:13:48.360572] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-22T22:13:48.361103] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-22T22:13:48.361166] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-22T22:13:48.361763] [DEBUG] [LOCAL ] ZEPP: Trimmed 17996 records to 16667 (keeping 200 days of data) [2025-09-22T22:13:48.461263] [DEBUG] [LOCAL ] ZEPP: Primary data saved (16667 records). [2025-09-22T22:13:48.461412] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-22T22:13:48.461500] [INFO ] [MAIN ] Update Progress: 2360/2372 symbols completed. ZEPP took 17.6s. Estimated remaining: 1m 36s. Rate: 7.5 symbols/min [2025-09-22T22:13:48.995486] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:13:49.136174] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:13:49.144489] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:13:49.196073] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:13:49.285419] [DEBUG] [LOCAL ] ZH: Loaded 27557 existing records from primary storage. [2025-09-22T22:13:49.286962] [INFO ] [MAIN ] ZH: Loaded 27557 existing records. [2025-09-22T22:13:49.293107] [DEBUG] [LOCAL ] ZGN: Loaded 41448 existing records from primary storage. [2025-09-22T22:13:49.346323] [INFO ] [MAIN ] ZGN: Loaded 41448 existing records. [2025-09-22T22:13:49.409613] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-22T22:13:49.464239] [INFO ] [MAIN ] ZETA: Loaded 54375 existing records. [2025-09-22T22:13:49.523478] [DEBUG] [LOCAL ] ZIM: Loaded 54331 existing records from primary storage. [2025-09-22T22:13:49.555061] [INFO ] [MAIN ] ZIM: Loaded 54331 existing records. [2025-09-22T22:13:49.942022] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:13:49.904539] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:13:49.990246] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-22T22:13:50.027428] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-22T22:13:50.043691] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-22T22:13:50.043565] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:13:50.074419] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-22T22:13:50.081723] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-22T22:13:50.068952] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-22T22:13:50.104193] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-22T22:13:50.113405] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-22T22:13:50.119902] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:13:50.144125] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-22T22:13:50.163209] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-22T22:13:50.177161] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-22T22:13:50.155986] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-22T22:13:50.187718] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-22T22:13:50.192966] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-22T22:13:50.311985] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-22T22:13:50.327579] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-22T22:13:51.520135] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:13:51.514974] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:13:51.550826] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-22T22:13:51.550421] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:13:51.551075] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-22T22:13:51.594087] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-22T22:13:51.641617] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:13:51.643428] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-22T22:13:52.704866] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-22T22:13:52.710217] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-22T22:13:53.064828] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-22T22:13:53.073111] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-22T22:13:53.752300] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-22T22:13:53.787438] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-22T22:13:53.795230] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-22T22:13:53.807359] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-22T22:13:53.886491] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-22T22:13:53.897684] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-22T22:13:54.506126] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-22T22:13:54.514442] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-22T22:13:55.060062] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-22T22:13:55.068786] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-22T22:13:55.914118] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-22T22:13:55.928628] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-22T22:13:55.929879] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-22T22:13:55.938320] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-22T22:13:56.011326] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-22T22:13:56.520218] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-22T22:13:56.528077] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-22T22:13:57.322081] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-22T22:13:57.381770] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-22T22:13:58.122033] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-22T22:13:58.188346] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-22T22:13:58.530805] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-22T22:13:58.590065] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-22T22:13:58.922113] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-22T22:13:59.334374] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-22T22:13:59.722070] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-22T22:14:00.522152] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-22T22:14:00.725065] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-22T22:14:01.060367] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-22T22:14:01.322107] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-22T22:14:02.122083] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-22T22:14:02.922111] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-22T22:14:03.346782] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-22T22:14:03.416620] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-22T22:14:03.722061] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-22T22:14:04.233983] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (3.71 seconds). [2025-09-22T22:14:04.522070] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-22T22:14:05.219083] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-22T22:14:05.322077] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-22T22:14:05.924303] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-22T22:14:06.122035] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-22T22:14:06.569891] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-22T22:14:06.686623] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-22T22:14:06.922094] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-22T22:14:07.722030] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-22T22:14:08.030589] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-22T22:14:08.130519] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-22T22:14:08.522055] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-22T22:14:09.293342] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-22T22:14:09.322060] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-22T22:14:09.579028] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T22:14:09.583864] [INFO ] [REMOTE ] ZH: Full fetch complete (39842 records). [2025-09-22T22:14:09.584024] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-22T22:14:10.010997] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-22T22:14:10.011103] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-22T22:14:10.012030] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-22T22:14:10.012097] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-22T22:14:10.013211] [DEBUG] [LOCAL ] ZH: Trimmed 39842 records to 26895 (keeping 200 days of data) [2025-09-22T22:14:10.122719] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-22T22:14:10.174712] [DEBUG] [LOCAL ] ZH: Primary data saved (26895 records). [2025-09-22T22:14:10.174851] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-22T22:14:10.176520] [INFO ] [MAIN ] Update Progress: 2361/2372 symbols completed. ZH took 21.7s. Estimated remaining: 1m 28s. Rate: 7.5 symbols/min [2025-09-22T22:14:10.344080] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:14:10.391772] [DEBUG] [LOCAL ] ZIP: Loaded 45168 existing records from primary storage. [2025-09-22T22:14:10.391919] [INFO ] [MAIN ] ZIP: Loaded 45168 existing records. [2025-09-22T22:14:10.591427] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:14:10.591777] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-22T22:14:10.591882] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-22T22:14:10.593120] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-22T22:14:10.593183] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-22T22:14:10.927206] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-22T22:14:10.966218] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:14:11.722061] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-22T22:14:11.947694] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-22T22:14:12.115613] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-22T22:14:12.457933] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-22T22:14:12.522004] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-22T22:14:12.707471] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-22T22:14:13.322060] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-22T22:14:14.122069] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-22T22:14:14.514490] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-22T22:14:14.710508] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T22:14:14.922086] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-22T22:14:15.722057] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-22T22:14:16.522033] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-22T22:14:16.593188] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-22T22:14:16.924584] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-22T22:14:17.114280] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-22T22:14:17.322050] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-22T22:14:17.580032] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-22T22:14:17.586416] [INFO ] [REMOTE ] ZGN: Full fetch complete (58370 records). [2025-09-22T22:14:17.586550] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-22T22:14:17.988088] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-22T22:14:17.988171] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-22T22:14:17.989256] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-22T22:14:17.989319] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-22T22:14:17.990585] [DEBUG] [LOCAL ] ZGN: Trimmed 58370 records to 40907 (keeping 200 days of data) [2025-09-22T22:14:18.163888] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-22T22:14:18.241798] [DEBUG] [LOCAL ] ZGN: Primary data saved (40907 records). [2025-09-22T22:14:18.241929] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-22T22:14:18.242033] [INFO ] [MAIN ] Update Progress: 2362/2372 symbols completed. ZGN took 29.8s. Estimated remaining: 1m 20s. Rate: 7.5 symbols/min [2025-09-22T22:14:18.422764] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:14:18.442240] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-22T22:14:18.483109] [DEBUG] [LOCAL ] ZK: Loaded 40821 existing records from primary storage. [2025-09-22T22:14:18.483246] [INFO ] [MAIN ] ZK: Loaded 40821 existing records. [2025-09-22T22:14:18.661062] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:14:18.661316] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-22T22:14:18.661373] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-22T22:14:18.662306] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-22T22:14:18.662367] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-22T22:14:18.930331] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-22T22:14:19.023072] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:14:19.722058] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-22T22:14:20.067827] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-22T22:14:20.449607] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-22T22:14:20.522020] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-22T22:14:21.322071] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-22T22:14:21.678046] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-22T22:14:21.686720] [INFO ] [REMOTE ] ZETA: Full fetch complete (77677 records). [2025-09-22T22:14:21.686876] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-22T22:14:22.099058] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-22T22:14:22.099251] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-22T22:14:22.100587] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-22T22:14:22.100697] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-22T22:14:22.111618] [DEBUG] [LOCAL ] ZETA: Trimmed 77677 records to 53595 (keeping 200 days of data) [2025-09-22T22:14:22.125630] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-22T22:14:22.132956] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-22T22:14:22.464615] [DEBUG] [LOCAL ] ZETA: Primary data saved (53595 records). [2025-09-22T22:14:22.464775] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-22T22:14:22.464863] [INFO ] [MAIN ] Update Progress: 2363/2372 symbols completed. ZETA took 34.0s. Estimated remaining: 1m 12s. Rate: 7.5 symbols/min [2025-09-22T22:14:22.642797] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:14:22.653213] [DEBUG] [LOCAL ] ZKH: Loaded 8186 existing records from primary storage. [2025-09-22T22:14:22.653342] [INFO ] [MAIN ] ZKH: Loaded 8186 existing records. [2025-09-22T22:14:22.840668] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:14:22.841080] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-22T22:14:22.841187] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-22T22:14:22.841697] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-22T22:14:22.841757] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-22T22:14:22.925996] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-22T22:14:23.044479] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-22T22:14:23.281966] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:14:23.722050] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-22T22:14:24.181325] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-22T22:14:24.189779] [INFO ] [REMOTE ] ZIM: Full fetch complete (77531 records). [2025-09-22T22:14:24.189925] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-22T22:14:24.523791] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-22T22:14:24.607665] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-22T22:14:24.607885] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-22T22:14:24.609379] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-22T22:14:24.609670] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-22T22:14:24.622738] [DEBUG] [LOCAL ] ZIM: Trimmed 77531 records to 53550 (keeping 200 days of data) [2025-09-22T22:14:24.642905] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-22T22:14:24.994603] [DEBUG] [LOCAL ] ZIM: Primary data saved (53550 records). [2025-09-22T22:14:24.994817] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-22T22:14:24.994941] [INFO ] [MAIN ] Update Progress: 2364/2372 symbols completed. ZIM took 36.5s. Estimated remaining: 1m 4s. Rate: 7.5 symbols/min [2025-09-22T22:14:25.177160] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:14:25.196513] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-22T22:14:25.252259] [DEBUG] [LOCAL ] ZTO: Loaded 50870 existing records from primary storage. [2025-09-22T22:14:25.252404] [INFO ] [MAIN ] ZTO: Loaded 50870 existing records. [2025-09-22T22:14:25.325177] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-22T22:14:25.365942] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-22T22:14:25.447346] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:14:25.447693] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-22T22:14:25.447775] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-22T22:14:25.448971] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-22T22:14:25.449033] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-22T22:14:25.811973] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:14:26.122069] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-22T22:14:26.923816] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-22T22:14:26.929157] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-22T22:14:27.722038] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-22T22:14:27.820147] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-22T22:14:28.388155] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-22T22:14:28.522091] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-22T22:14:28.660869] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-22T22:14:29.322079] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-22T22:14:30.122040] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-22T22:14:30.154746] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-22T22:14:30.853310] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-22T22:14:30.873395] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-22T22:14:30.921998] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-22T22:14:31.722102] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-22T22:14:32.502268] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-22T22:14:32.522002] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-22T22:14:33.322086] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-22T22:14:33.475871] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-22T22:14:33.535104] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-22T22:14:33.541441] [INFO ] [REMOTE ] ZIP: Full fetch complete (59146 records). [2025-09-22T22:14:33.541546] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-22T22:14:33.928094] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-22T22:14:33.928174] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-22T22:14:33.929259] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-22T22:14:33.929323] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-22T22:14:33.930593] [DEBUG] [LOCAL ] ZIP: Trimmed 59146 records to 44431 (keeping 200 days of data) [2025-09-22T22:14:34.127355] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-22T22:14:34.188064] [DEBUG] [LOCAL ] ZIP: Primary data saved (44431 records). [2025-09-22T22:14:34.188180] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-22T22:14:34.188292] [INFO ] [MAIN ] Update Progress: 2365/2372 symbols completed. ZIP took 24.0s. Estimated remaining: 55.9s. Rate: 7.5 symbols/min [2025-09-22T22:14:34.364928] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:14:34.382692] [DEBUG] [LOCAL ] ZTR: Loaded 17033 existing records from primary storage. [2025-09-22T22:14:34.382838] [INFO ] [MAIN ] ZTR: Loaded 17033 existing records. [2025-09-22T22:14:34.563757] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:14:34.563994] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-22T22:14:34.564041] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-22T22:14:34.564535] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-22T22:14:34.564595] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-22T22:14:34.924320] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-22T22:14:34.932076] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:14:35.043359] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-22T22:14:35.659892] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-22T22:14:35.677810] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-22T22:14:35.722018] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-22T22:14:36.361452] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-22T22:14:36.522136] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-22T22:14:36.628967] [DEBUG] [REMOTE ] ZKH: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-22T22:14:36.629373] [WARN ] [REMOTE ] ZKH: No data returned for month 2025-05 [2025-09-22T22:14:37.322058] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-22T22:14:37.900876] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-22T22:14:38.122066] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-22T22:14:38.883117] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-22T22:14:38.922020] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-22T22:14:39.722031] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-22T22:14:40.067112] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-22T22:14:40.522036] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-22T22:14:40.589940] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-22T22:14:41.322018] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-22T22:14:41.574139] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-22T22:14:42.122059] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-22T22:14:42.922049] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-22T22:14:43.068466] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-22T22:14:43.085143] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-22T22:14:43.723161] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-22T22:14:43.728267] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-22T22:14:44.522054] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-22T22:14:45.126858] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-22T22:14:45.128630] [INFO ] [REMOTE ] ZKH: Full fetch complete (11267 records). [2025-09-22T22:14:45.128725] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-22T22:14:45.324555] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-22T22:14:45.324415] [WARN ] [VALIDATOR ] ZKH: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-22T22:14:45.325033] [FATAL] [MAIN ] ZKH: Fetched primary data is invalid. Refusing to save it. [2025-09-22T22:14:45.326106] [WARN ] [MAIN ] ZKH: Deleting existing primary and derivative data due to validation failure. [2025-09-22T22:14:45.326216] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-22T22:14:45.326499] [DEBUG] [LOCAL ] ZKH: No primary data file found to delete. [2025-09-22T22:14:45.326571] [INFO ] [LOCAL ] ZKH: Starting deletion of derivative data. [2025-09-22T22:14:45.327544] [DEBUG] [LOCAL ] ZKH: Deleted derivative data file. [2025-09-22T22:14:45.328226] [INFO ] [MAIN ] Update Progress: 2366/2372 symbols completed. ZKH took 22.9s. Estimated remaining: 47.9s. Rate: 7.5 symbols/min [2025-09-22T22:14:45.462564] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-22T22:14:45.550997] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:14:45.615734] [DEBUG] [LOCAL ] ZTS: Loaded 53760 existing records from primary storage. [2025-09-22T22:14:45.615951] [INFO ] [MAIN ] ZTS: Loaded 53760 existing records. [2025-09-22T22:14:45.806241] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:14:45.806763] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-22T22:14:45.806845] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-22T22:14:45.808249] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-22T22:14:45.808314] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-22T22:14:46.127309] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-22T22:14:46.198791] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:14:46.922057] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-22T22:14:47.028952] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-22T22:14:47.187919] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-22T22:14:47.722088] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-22T22:14:47.910168] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-22T22:14:48.522065] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-22T22:14:49.322025] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-22T22:14:49.483926] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-22T22:14:49.579488] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-22T22:14:50.122084] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-22T22:14:50.820901] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-22T22:14:50.922111] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-22T22:14:51.442376] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-22T22:14:51.722073] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-22T22:14:52.445574] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-22T22:14:52.522033] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-22T22:14:52.700187] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-22T22:14:53.322025] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-22T22:14:53.378420] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-22T22:14:54.122122] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-22T22:14:54.807934] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-22T22:14:54.922036] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-22T22:14:55.171403] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-22T22:14:55.722133] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-22T22:14:56.522024] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-22T22:14:56.636698] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-22T22:14:56.682816] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-22T22:14:57.322054] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-22T22:14:57.977799] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T22:14:57.985004] [INFO ] [REMOTE ] ZK: Full fetch complete (57478 records). [2025-09-22T22:14:57.985131] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-22T22:14:58.133387] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-22T22:14:58.406632] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-22T22:14:58.406773] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-22T22:14:58.408011] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-22T22:14:58.408077] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-22T22:14:58.409414] [DEBUG] [LOCAL ] ZK: Trimmed 57478 records to 40228 (keeping 200 days of data) [2025-09-22T22:14:58.652923] [DEBUG] [LOCAL ] ZK: Primary data saved (40228 records). [2025-09-22T22:14:58.653267] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-22T22:14:58.653475] [INFO ] [MAIN ] Update Progress: 2367/2372 symbols completed. ZK took 40.4s. Estimated remaining: 39.9s. Rate: 7.5 symbols/min [2025-09-22T22:14:58.837337] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:14:58.869988] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-22T22:14:58.909598] [DEBUG] [LOCAL ] ZVIA: Loaded 35851 existing records from primary storage. [2025-09-22T22:14:58.909813] [INFO ] [MAIN ] ZVIA: Loaded 35851 existing records. [2025-09-22T22:14:58.930698] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-22T22:14:59.105135] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:14:59.105399] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-22T22:14:59.105461] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-22T22:14:59.106273] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-22T22:14:59.106334] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-22T22:14:59.467751] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:14:59.519688] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-22T22:14:59.722037] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-22T22:14:59.947817] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-22T22:14:59.950910] [INFO ] [REMOTE ] ZTR: Full fetch complete (26894 records). [2025-09-22T22:14:59.950992] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-22T22:15:00.332664] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-22T22:15:00.332762] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-22T22:15:00.333376] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-22T22:15:00.333419] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-22T22:15:00.334267] [DEBUG] [LOCAL ] ZTR: Trimmed 26894 records to 16743 (keeping 200 days of data) [2025-09-22T22:15:00.439394] [DEBUG] [LOCAL ] ZTR: Primary data saved (16743 records). [2025-09-22T22:15:00.439546] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-22T22:15:00.439678] [INFO ] [MAIN ] Update Progress: 2368/2372 symbols completed. ZTR took 26.3s. Estimated remaining: 31.9s. Rate: 7.5 symbols/min [2025-09-22T22:15:00.531238] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-22T22:15:00.613775] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-12 to 2025-09-22. [2025-09-22T22:15:00.655155] [DEBUG] [LOCAL ] ZWS: Loaded 43136 existing records from primary storage. [2025-09-22T22:15:00.655299] [INFO ] [MAIN ] ZWS: Loaded 43136 existing records. [2025-09-22T22:15:00.840170] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-03 for 200 day retention. Performing full refresh. [2025-09-22T22:15:00.840395] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-22T22:15:00.840442] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-22T22:15:00.841409] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-22T22:15:00.841471] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-22T22:15:01.177227] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-22T22:15:01.238520] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-03 to 2025-09-22 (requires 10 months of data pull). [2025-09-22T22:15:01.233018] [INFO ] [REMOTE ] ZTO: Full fetch complete (73177 records). [2025-09-22T22:15:01.238728] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-22T22:15:01.331332] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-22T22:15:01.663264] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-22T22:15:01.663406] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-22T22:15:01.666025] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-22T22:15:01.666203] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-22T22:15:01.668423] [DEBUG] [LOCAL ] ZTO: Trimmed 73177 records to 50073 (keeping 200 days of data) [2025-09-22T22:15:02.028257] [DEBUG] [LOCAL ] ZTO: Primary data saved (50073 records). [2025-09-22T22:15:02.028430] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-22T22:15:02.028542] [INFO ] [MAIN ] Update Progress: 2369/2372 symbols completed. ZTO took 37.0s. Estimated remaining: 23.9s. Rate: 7.5 symbols/min [2025-09-22T22:15:02.122087] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-22T22:15:02.265842] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-22T22:15:02.922080] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-22T22:15:04.357392] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-09-22T22:15:04.366268] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-22T22:15:05.109752] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-09-22T22:15:05.121196] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-22T22:15:05.321262] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-22T22:15:05.329901] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-22T22:15:06.376994] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-22T22:15:06.386462] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-22T22:15:06.504124] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-22T22:15:06.724001] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-22T22:15:06.922059] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-22T22:15:07.702365] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-22T22:15:07.722025] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-22T22:15:08.522098] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-22T22:15:08.817151] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-22T22:15:09.308756] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-22T22:15:09.322007] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-22T22:15:09.470252] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-22T22:15:10.122073] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-22T22:15:10.750126] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-22T22:15:10.922074] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-22T22:15:11.352288] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-22T22:15:11.722082] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-22T22:15:12.362841] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-22T22:15:12.522088] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-22T22:15:13.194980] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-22T22:15:13.322263] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-22T22:15:13.964242] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-22T22:15:14.122120] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-22T22:15:14.922065] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-22T22:15:15.112364] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-22T22:15:15.722084] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-22T22:15:16.664272] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-22T22:15:16.674496] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-22T22:15:17.457230] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-22T22:15:17.468718] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-22T22:15:17.491838] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-22T22:15:18.122044] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-22T22:15:18.164392] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-22T22:15:18.922036] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-22T22:15:19.109116] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-22T22:15:19.685303] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-22T22:15:19.722008] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-22T22:15:19.902671] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-22T22:15:19.909840] [INFO ] [REMOTE ] ZWS: Full fetch complete (61910 records). [2025-09-22T22:15:19.909982] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-22T22:15:20.308698] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-22T22:15:20.308806] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-22T22:15:20.309894] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-22T22:15:20.309956] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-22T22:15:20.311202] [DEBUG] [LOCAL ] ZWS: Trimmed 61910 records to 42492 (keeping 200 days of data) [2025-09-22T22:15:20.525528] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-22T22:15:20.576667] [DEBUG] [LOCAL ] ZWS: Primary data saved (42492 records). [2025-09-22T22:15:20.576826] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-22T22:15:20.576913] [INFO ] [MAIN ] Update Progress: 2370/2372 symbols completed. ZWS took 20.1s. Estimated remaining: 16.0s. Rate: 7.5 symbols/min [2025-09-22T22:15:20.686166] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-22T22:15:20.692129] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52473 records). [2025-09-22T22:15:20.692235] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-22T22:15:21.081771] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-22T22:15:21.081849] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-22T22:15:21.082869] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-22T22:15:21.082931] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-22T22:15:21.084026] [DEBUG] [LOCAL ] ZVIA: Trimmed 52473 records to 35427 (keeping 200 days of data) [2025-09-22T22:15:21.287740] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35427 records). [2025-09-22T22:15:21.287881] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-22T22:15:21.287964] [INFO ] [MAIN ] Update Progress: 2371/2372 symbols completed. ZVIA took 22.6s. Estimated remaining: 8.0s. Rate: 7.5 symbols/min [2025-09-22T22:15:22.441172] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-22T22:15:22.452587] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-22T22:15:22.780243] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-22T22:15:22.788900] [INFO ] [REMOTE ] ZTS: Full fetch complete (76689 records). [2025-09-22T22:15:22.789035] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-22T22:15:23.189683] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-22T22:15:23.189781] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-22T22:15:23.191026] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-22T22:15:23.191091] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-22T22:15:23.192637] [DEBUG] [LOCAL ] ZTS: Trimmed 76689 records to 53006 (keeping 200 days of data) [2025-09-22T22:15:23.542525] [DEBUG] [LOCAL ] ZTS: Primary data saved (53006 records). [2025-09-22T22:15:23.542702] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-22T22:15:23.542823] [INFO ] [MAIN ] Update Progress: 2372/2372 symbols completed. ZTS took 38.2s. Estimated remaining: 0.0s. Rate: 7.5 symbols/min [2025-09-22T22:15:23.545411] [INFO ] [MAIN ] Parallel update completed in 5h 15m 20s [2025-09-22T22:15:23.545518] [WARN ] [MAIN ] Failed symbols (281): AAM, AACT, AAMI, AAUC, ACCO, ACHR, ACN, ACRE, AD, ADC... [2025-09-22T22:15:23.545621] [INFO ] [MAIN ] Update success rate: 88.2% (2091/2372 symbols) [2025-09-22T22:15:24.360929] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2091/2372 @ 88.15%)' [2025-09-22T22:15:24.361921] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-22T22:15:24.362258] [INFO ] [STATE ] Last completion updated: 2025-09-22T22:15:24.362010 [2025-09-22T22:15:24.362542] [WARN ] [STATE ] State set to: RUNNING [2025-09-22T22:15:24.362635] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-22T22:15:24.362817] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-22T22:15:24.362927] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-22T22:15:24.364894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-22T22:15:24.365260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-22T22:15:24.365670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-22T22:15:24.366045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-22T22:15:24.366323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-22T22:15:24.366619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-22T22:15:24.366926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-22T22:15:24.367416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-22T22:15:24.367783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-22T22:15:24.368063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-22T22:15:24.368370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-22T22:15:24.368707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-22T22:15:24.369044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-22T22:15:24.369287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-22T22:15:24.369578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-22T22:15:24.369934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-22T22:15:24.370248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-22T22:15:24.370746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-22T22:15:24.371203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-22T22:15:24.371497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-22T22:15:24.371801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-22T22:15:24.372152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-22T22:15:24.373020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-22T22:15:24.373465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-22T22:15:24.373727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-22T22:15:24.374095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-22T22:15:24.374452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-22T22:15:24.374958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-22T22:15:24.375295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-22T22:15:24.375519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-22T22:15:24.375859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-22T22:15:24.376116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-22T22:15:24.376389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-22T22:15:24.376638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-22T22:15:24.377039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-22T22:15:24.377300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-22T22:15:24.377560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-22T22:15:24.377802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-22T22:15:24.378017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-22T22:15:24.378294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-22T22:15:24.378500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-22T22:15:24.378784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-22T22:15:24.379059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-22T22:15:24.379342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-22T22:15:24.379618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-22T22:15:24.380273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-22T22:15:24.380555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-22T22:15:24.381635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-22T22:15:24.382023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-22T22:15:24.382345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-22T22:15:24.382598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-22T22:15:24.382931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-22T22:15:24.383198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-22T22:15:24.383438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-22T22:15:24.383690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-22T22:15:24.383934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-22T22:15:24.384190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-22T22:15:24.384437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-22T22:15:24.384674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-22T22:15:24.384972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-22T22:15:24.385163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-22T22:15:24.385510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-22T22:15:24.385834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-22T22:15:24.386069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-22T22:15:24.386367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-22T22:15:24.386716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-22T22:15:24.387013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-22T22:15:24.387368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-22T22:15:24.387842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-22T22:15:24.388161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-22T22:15:24.388413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-22T22:15:24.388606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-22T22:15:24.388863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-22T22:15:24.389214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-22T22:15:24.389449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-22T22:15:24.389892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-22T22:15:24.390165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-22T22:15:24.390443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-22T22:15:24.390791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-22T22:15:24.391080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-22T22:15:24.391326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-22T22:15:24.391714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-22T22:15:24.392014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-22T22:15:24.392261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-22T22:15:24.392494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-22T22:15:24.392801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-22T22:15:24.393142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-22T22:15:24.393402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-22T22:15:24.393603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-22T22:15:24.393886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-22T22:15:24.394089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-22T22:15:24.394338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-22T22:15:24.394678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-22T22:15:24.394912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-22T22:15:24.395148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-22T22:15:24.395441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-22T22:15:24.395901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-22T22:15:24.396181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-22T22:15:24.396475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-22T22:15:24.396740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-22T22:15:24.396996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-22T22:15:24.397253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-22T22:15:24.397549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-22T22:15:24.397798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-22T22:15:24.397963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-22T22:15:24.398518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-22T22:15:24.398853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-22T22:15:24.399042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-22T22:15:24.399229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-22T22:15:24.399480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-22T22:15:24.399757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-22T22:15:24.400052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-22T22:15:24.400423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-22T22:15:24.400892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-22T22:15:24.401185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-22T22:15:24.401495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-22T22:15:24.401802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-22T22:15:24.402200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-22T22:15:24.402461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-22T22:15:24.402795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-22T22:15:24.403172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-22T22:15:24.403403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-22T22:15:24.404058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-22T22:15:24.404297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-22T22:15:24.404519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-22T22:15:24.404724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-22T22:15:24.404957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-22T22:15:24.405255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-22T22:15:24.405456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-22T22:15:24.405760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-22T22:15:24.405971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-22T22:15:24.406186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-22T22:15:24.406385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-22T22:15:24.406610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-22T22:15:24.406910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-22T22:15:24.407172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-22T22:15:24.407462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-22T22:15:24.407741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-22T22:15:24.408032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-22T22:15:24.408347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-22T22:15:24.408635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-22T22:15:24.408879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-22T22:15:24.409103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-22T22:15:24.409315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-22T22:15:24.409550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-22T22:15:24.409778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-22T22:15:24.410038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-22T22:15:24.410255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-22T22:15:24.410449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-22T22:15:24.410672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-22T22:15:24.410866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-22T22:15:24.411084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-22T22:15:24.411374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-22T22:15:24.411872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-22T22:15:24.412110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-22T22:15:24.412342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-22T22:15:24.412508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-22T22:15:24.412806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-22T22:15:24.413048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-22T22:15:24.413265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-22T22:15:24.413569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-22T22:15:24.413786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-22T22:15:24.414177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-22T22:15:24.414495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-22T22:15:24.414739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-22T22:15:24.414936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-22T22:15:24.415193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-22T22:15:24.415417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-22T22:15:24.415716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-22T22:15:24.416053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-22T22:15:24.416273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-22T22:15:24.416531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-22T22:15:24.416757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-22T22:15:24.416993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-22T22:15:24.417265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-22T22:15:24.417455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-22T22:15:24.417740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-22T22:15:24.417949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEA.csv [2025-09-22T22:15:24.418147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-22T22:15:24.418378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-22T22:15:24.418567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-22T22:15:24.418901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-22T22:15:24.419261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-22T22:15:24.419481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-22T22:15:24.419913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-22T22:15:24.420116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-22T22:15:24.420341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-22T22:15:24.420595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-22T22:15:24.420852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-22T22:15:24.421096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-22T22:15:24.421291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-22T22:15:24.421602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-22T22:15:24.421790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-22T22:15:24.422024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-09-22T22:15:24.422230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-22T22:15:24.422467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-22T22:15:24.422709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-22T22:15:24.422984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-22T22:15:24.423225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-22T22:15:24.423522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-22T22:15:24.423744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-22T22:15:24.423995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-22T22:15:24.424225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-22T22:15:24.424463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-22T22:15:24.424722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-22T22:15:24.424938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-22T22:15:24.425262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-22T22:15:24.425666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-22T22:15:24.425927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-22T22:15:24.426112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-22T22:15:24.426332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-22T22:15:24.426589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-22T22:15:24.427068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-22T22:15:24.427269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-22T22:15:24.427495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-22T22:15:24.427857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-22T22:15:24.428084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-22T22:15:24.428298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-22T22:15:24.428484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-22T22:15:24.428711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-22T22:15:24.428942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-22T22:15:24.429197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-22T22:15:24.429373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-22T22:15:24.429569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-22T22:15:24.429811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-22T22:15:24.430008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-22T22:15:24.430411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-22T22:15:24.430713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-22T22:15:24.430944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-22T22:15:24.431159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-22T22:15:24.431376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-22T22:15:24.431686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-22T22:15:24.431907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-22T22:15:24.432097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-22T22:15:24.432311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-22T22:15:24.432513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-22T22:15:24.432746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-22T22:15:24.432931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-22T22:15:24.433156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-22T22:15:24.433575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-22T22:15:24.433872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-22T22:15:24.434074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-22T22:15:24.434267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-22T22:15:24.434517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-22T22:15:24.434713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-22T22:15:24.434906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-22T22:15:24.435130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-22T22:15:24.435340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-22T22:15:24.435562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-22T22:15:24.435944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-22T22:15:24.436129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-22T22:15:24.436341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-22T22:15:24.436537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-22T22:15:24.436725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-22T22:15:24.436950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-22T22:15:24.437214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-22T22:15:24.437400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-22T22:15:24.437614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-22T22:15:24.437848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-22T22:15:24.438040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-22T22:15:24.438227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-22T22:15:24.438400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-22T22:15:24.438579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-22T22:15:24.438818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-22T22:15:24.439096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-09-22T22:15:24.439294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-22T22:15:24.439539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-22T22:15:24.439818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-22T22:15:24.440010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-22T22:15:24.440254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-22T22:15:24.440503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-22T22:15:24.440732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-22T22:15:24.440970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-22T22:15:24.441169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-09-22T22:15:24.441398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-22T22:15:24.441562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-22T22:15:24.441766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-22T22:15:24.441994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-22T22:15:24.442177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-22T22:15:24.442375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-22T22:15:24.442583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-22T22:15:24.442847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-22T22:15:24.443042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-22T22:15:24.443214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-22T22:15:24.443416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-22T22:15:24.443733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-22T22:15:24.443986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-22T22:15:24.444168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-22T22:15:24.444353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-22T22:15:24.444575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-22T22:15:24.444789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-22T22:15:24.444951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-22T22:15:24.445129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-22T22:15:24.445417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-22T22:15:24.445632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-22T22:15:24.445876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-22T22:15:24.446112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-22T22:15:24.446285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-22T22:15:24.446531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-22T22:15:24.446778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-22T22:15:24.447026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-22T22:15:24.447255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-22T22:15:24.447568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-22T22:15:24.447847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-22T22:15:24.448059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-22T22:15:24.448362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-22T22:15:24.448621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-22T22:15:24.448846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-22T22:15:24.449053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-22T22:15:24.449267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-22T22:15:24.449485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-22T22:15:24.449701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-22T22:15:24.449914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-22T22:15:24.450110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-22T22:15:24.450288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-22T22:15:24.450525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-22T22:15:24.450723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-22T22:15:24.450949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-22T22:15:24.451201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-22T22:15:24.451378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-22T22:15:24.451636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-22T22:15:24.452020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-22T22:15:24.452229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-22T22:15:24.452511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-22T22:15:24.452767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-22T22:15:24.452989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-22T22:15:24.453169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-22T22:15:24.453391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-22T22:15:24.453583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-22T22:15:24.453777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-22T22:15:24.453960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-22T22:15:24.454131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-22T22:15:24.454385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-22T22:15:24.454570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-22T22:15:24.454805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-22T22:15:24.454996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-22T22:15:24.455209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-22T22:15:24.455393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-22T22:15:24.455751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-22T22:15:24.455953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-22T22:15:24.456155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-22T22:15:24.456374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-22T22:15:24.456560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-22T22:15:24.457211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-22T22:15:24.457377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-22T22:15:24.457569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-22T22:15:24.457785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-22T22:15:24.457966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-22T22:15:24.458165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-22T22:15:24.458322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-22T22:15:24.458505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-22T22:15:24.458756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-22T22:15:24.458956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-22T22:15:24.459131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-22T22:15:24.459358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-22T22:15:24.459569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-22T22:15:24.459858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-22T22:15:24.460075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-22T22:15:24.460297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-22T22:15:24.460487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-22T22:15:24.460682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-22T22:15:24.460883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-22T22:15:24.461168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-22T22:15:24.461390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-22T22:15:24.461607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-22T22:15:24.461820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-22T22:15:24.462077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-22T22:15:24.462280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-22T22:15:24.462471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-22T22:15:24.462676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-22T22:15:24.462877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-22T22:15:24.463050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-22T22:15:24.463371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-22T22:15:24.463553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-22T22:15:24.463779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-22T22:15:24.463980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-09-22T22:15:24.464154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-22T22:15:24.464317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-22T22:15:24.464496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-22T22:15:24.464698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-22T22:15:24.464872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-22T22:15:24.465026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-22T22:15:24.465268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-22T22:15:24.465454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-22T22:15:24.465887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-22T22:15:24.466060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-22T22:15:24.466350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-22T22:15:24.466553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-09-22T22:15:24.466770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-22T22:15:24.467046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-22T22:15:24.467248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-22T22:15:24.467445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-22T22:15:24.467602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-22T22:15:24.467902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-22T22:15:24.468104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-22T22:15:24.468279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-22T22:15:24.468494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-22T22:15:24.468734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-22T22:15:24.468911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-22T22:15:24.469122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-22T22:15:24.469276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-22T22:15:24.469606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-22T22:15:24.469842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-22T22:15:24.470007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-22T22:15:24.470204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-22T22:15:24.470390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-22T22:15:24.470555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-22T22:15:24.470743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-22T22:15:24.470969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-22T22:15:24.471118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-22T22:15:24.471334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-22T22:15:24.471543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-22T22:15:24.471777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-22T22:15:24.472011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-22T22:15:24.472217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-22T22:15:24.472393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-22T22:15:24.472557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-22T22:15:24.472780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-22T22:15:24.472938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-22T22:15:24.473139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-22T22:15:24.473278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-22T22:15:24.473481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-22T22:15:24.473684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-22T22:15:24.473854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-22T22:15:24.474050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-22T22:15:24.474243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-22T22:15:24.474425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-22T22:15:24.474591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-22T22:15:24.474833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-22T22:15:24.475030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-22T22:15:24.475236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-22T22:15:24.475430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-22T22:15:24.475758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-22T22:15:24.475955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-22T22:15:24.476172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-22T22:15:24.476388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-22T22:15:24.476573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-22T22:15:24.476761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-22T22:15:24.476964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-22T22:15:24.477448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-22T22:15:24.477725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-22T22:15:24.477979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-22T22:15:24.478180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-22T22:15:24.478398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-22T22:15:24.478593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-22T22:15:24.478895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-22T22:15:24.479120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-22T22:15:24.479273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-22T22:15:24.479460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-22T22:15:24.479734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-22T22:15:24.479934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-22T22:15:24.480106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-22T22:15:24.480268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-22T22:15:24.480474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-22T22:15:24.480628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-22T22:15:24.480900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-22T22:15:24.481087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-22T22:15:24.481284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-22T22:15:24.481464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-22T22:15:24.481633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-22T22:15:24.481851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-22T22:15:24.482042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-22T22:15:24.482242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-22T22:15:24.482432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-22T22:15:24.482708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-22T22:15:24.482917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-22T22:15:24.483076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-22T22:15:24.483285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-22T22:15:24.483448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-22T22:15:24.483630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-22T22:15:24.483954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-22T22:15:24.484127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-22T22:15:24.484334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-22T22:15:24.484519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-22T22:15:24.484717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-22T22:15:24.484908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-22T22:15:24.485112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-22T22:15:24.485310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-22T22:15:24.485511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-22T22:15:24.485789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-22T22:15:24.486014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-22T22:15:24.486221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-22T22:15:24.486387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-22T22:15:24.486569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-22T22:15:24.486823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-22T22:15:24.486987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-22T22:15:24.487169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-22T22:15:24.487365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-22T22:15:24.487568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-22T22:15:24.487749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-22T22:15:24.487972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-22T22:15:24.488168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-22T22:15:24.488345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-22T22:15:24.488534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-22T22:15:24.488784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-22T22:15:24.488937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-22T22:15:24.489125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-22T22:15:24.489278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-22T22:15:24.489475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-22T22:15:24.489683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-22T22:15:24.489856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-22T22:15:24.490055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-22T22:15:24.490217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-22T22:15:24.490397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-22T22:15:24.490585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-22T22:15:24.490845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-22T22:15:24.491068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-22T22:15:24.491248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-22T22:15:24.491867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-22T22:15:24.492005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-22T22:15:24.492146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-22T22:15:24.492339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-22T22:15:24.492554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-22T22:15:24.492847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-22T22:15:24.493014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-22T22:15:24.493193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-22T22:15:24.493350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-22T22:15:24.493528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-22T22:15:24.493755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-22T22:15:24.493942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-22T22:15:24.494171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-22T22:15:24.494325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-22T22:15:24.494482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-22T22:15:24.494731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-22T22:15:24.494976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-22T22:15:24.495156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-22T22:15:24.495361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-22T22:15:24.495520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-22T22:15:24.495736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-22T22:15:24.495945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-22T22:15:24.496145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-22T22:15:24.496334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-22T22:15:24.496575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-22T22:15:24.496760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-22T22:15:24.496927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-22T22:15:24.497135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-22T22:15:24.497324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-22T22:15:24.497506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-22T22:15:24.497733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-22T22:15:24.497899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-22T22:15:24.498062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-22T22:15:24.498259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-22T22:15:24.498470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-22T22:15:24.498683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-22T22:15:24.498942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-22T22:15:24.499099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-22T22:15:24.499268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-22T22:15:24.499433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-22T22:15:24.499612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-22T22:15:24.499884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-22T22:15:24.500121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-22T22:15:24.500296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-22T22:15:24.500471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-22T22:15:24.500666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-22T22:15:24.500850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-22T22:15:24.501025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-22T22:15:24.501173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-22T22:15:24.501345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-22T22:15:24.501501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-22T22:15:24.501854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-22T22:15:24.502040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-22T22:15:24.502217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-22T22:15:24.502403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-22T22:15:24.502569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-22T22:15:24.502770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-22T22:15:24.502908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-22T22:15:24.503098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-22T22:15:24.503290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-22T22:15:24.503452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-22T22:15:24.503627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-22T22:15:24.503948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-22T22:15:24.504093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-22T22:15:24.504257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-22T22:15:24.504426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-22T22:15:24.504556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-22T22:15:24.504725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-22T22:15:24.504888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-22T22:15:24.505049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-22T22:15:24.505224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-22T22:15:24.505405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-22T22:15:24.505574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-22T22:15:24.505789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-22T22:15:24.505953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-22T22:15:24.506129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-22T22:15:24.506276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-22T22:15:24.506447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-22T22:15:24.506672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-22T22:15:24.506854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-22T22:15:24.507013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-22T22:15:24.507157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-22T22:15:24.507335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-22T22:15:24.507502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-22T22:15:24.507784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-22T22:15:24.507931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-22T22:15:24.508103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-22T22:15:24.508301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-22T22:15:24.508450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-22T22:15:24.508634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-22T22:15:24.508840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-22T22:15:24.509022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-22T22:15:24.509179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-22T22:15:24.509403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-22T22:15:24.509573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-22T22:15:24.509770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-22T22:15:24.509971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-22T22:15:24.510168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-22T22:15:24.510351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-22T22:15:24.510508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-22T22:15:24.510703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-22T22:15:24.510870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-22T22:15:24.511040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-22T22:15:24.511243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-22T22:15:24.511409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-22T22:15:24.511625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-22T22:15:24.511809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-22T22:15:24.511979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-22T22:15:24.512182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-22T22:15:24.512422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-22T22:15:24.512577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-22T22:15:24.512767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-22T22:15:24.512929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-22T22:15:24.513181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-22T22:15:24.513334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-22T22:15:24.513571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-22T22:15:24.513741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-22T22:15:24.513892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-22T22:15:24.514064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-22T22:15:24.514249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-22T22:15:24.514423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-22T22:15:24.514608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-22T22:15:24.514789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-22T22:15:24.514974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-22T22:15:24.515125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-22T22:15:24.515282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-22T22:15:24.515442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-22T22:15:24.515602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-22T22:15:24.515869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-22T22:15:24.516066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-22T22:15:24.516238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-22T22:15:24.516409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-22T22:15:24.516601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-22T22:15:24.516819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-22T22:15:24.516967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-22T22:15:24.517146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-22T22:15:24.517358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-22T22:15:24.517487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-22T22:15:24.517631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-22T22:15:24.517827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-22T22:15:24.517963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-22T22:15:24.518156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-22T22:15:24.518320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-22T22:15:24.518482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-22T22:15:24.518760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-22T22:15:24.518905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-22T22:15:24.519078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-22T22:15:24.519282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-22T22:15:24.519428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-22T22:15:24.519628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-22T22:15:24.519811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-22T22:15:24.519960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-22T22:15:24.520110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-22T22:15:24.520280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-22T22:15:24.520431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-22T22:15:24.520608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-22T22:15:24.520790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-22T22:15:24.520980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-22T22:15:24.521182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-22T22:15:24.521332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-22T22:15:24.521511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-22T22:15:24.521690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-22T22:15:24.521851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-22T22:15:24.521998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-22T22:15:24.522163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-22T22:15:24.522340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-22T22:15:24.522507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-22T22:15:24.522731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-22T22:15:24.522970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-22T22:15:24.523124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-22T22:15:24.523320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-22T22:15:24.523517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-22T22:15:24.523811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-22T22:15:24.523982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-22T22:15:24.524132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-22T22:15:24.524291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-22T22:15:24.524442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-22T22:15:24.524608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-22T22:15:24.524775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-22T22:15:24.524934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-22T22:15:24.525115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-22T22:15:24.525290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-22T22:15:24.525462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-09-22T22:15:24.525683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-22T22:15:24.525974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-22T22:15:24.526126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-22T22:15:24.526282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-22T22:15:24.526436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-22T22:15:24.526608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-22T22:15:24.526818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-22T22:15:24.526982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-22T22:15:24.527107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-22T22:15:24.527242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-22T22:15:24.527458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-22T22:15:24.527621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-22T22:15:24.527808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-22T22:15:24.528040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-09-22T22:15:24.528177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-22T22:15:24.528345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-22T22:15:24.528482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-22T22:15:24.528698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-22T22:15:24.528855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-22T22:15:24.529011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-22T22:15:24.529181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-22T22:15:24.529338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-22T22:15:24.529502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-22T22:15:24.529679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-22T22:15:24.529835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-22T22:15:24.529963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-22T22:15:24.530137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-22T22:15:24.530285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-22T22:15:24.530443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-22T22:15:24.530618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-22T22:15:24.530803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-22T22:15:24.530936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-22T22:15:24.531105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-22T22:15:24.531279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-22T22:15:24.531439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-22T22:15:24.531586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-22T22:15:24.531874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-22T22:15:24.532022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-22T22:15:24.532321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-22T22:15:24.532486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-22T22:15:24.532662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-22T22:15:24.532800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-22T22:15:24.532954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-22T22:15:24.533123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-22T22:15:24.533280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-22T22:15:24.533449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-22T22:15:24.533624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-22T22:15:24.533824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-22T22:15:24.533974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-22T22:15:24.534171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-22T22:15:24.534316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-22T22:15:24.534499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-22T22:15:24.534914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-22T22:15:24.535085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-22T22:15:24.535260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-22T22:15:24.535408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-22T22:15:24.535573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-22T22:15:24.535750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-22T22:15:24.535914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-22T22:15:24.536064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-22T22:15:24.536226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-22T22:15:24.536403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-22T22:15:24.536582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-22T22:15:24.536757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-22T22:15:24.536937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-22T22:15:24.537103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-22T22:15:24.537260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-22T22:15:24.537409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-22T22:15:24.537533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-09-22T22:15:24.537679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-22T22:15:24.537831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-22T22:15:24.537984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-22T22:15:24.538146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-22T22:15:24.538292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-22T22:15:24.538463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-22T22:15:24.538690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-22T22:15:24.538848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-22T22:15:24.539004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-22T22:15:24.539174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-22T22:15:24.539365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-22T22:15:24.539661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-22T22:15:24.539825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-22T22:15:24.539959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-22T22:15:24.540115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-22T22:15:24.540312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-22T22:15:24.540463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-22T22:15:24.540635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-22T22:15:24.540819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-22T22:15:24.540977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-22T22:15:24.541130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-22T22:15:24.541296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-22T22:15:24.541465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-22T22:15:24.541618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-22T22:15:24.541817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-22T22:15:24.541970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-22T22:15:24.542128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-22T22:15:24.542294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-22T22:15:24.542453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-22T22:15:24.542626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-22T22:15:24.542899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-22T22:15:24.543094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-22T22:15:24.543249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-22T22:15:24.543397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-22T22:15:24.543550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-22T22:15:24.543814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-22T22:15:24.543997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-22T22:15:24.544137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-22T22:15:24.544309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-22T22:15:24.544465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-22T22:15:24.544601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-22T22:15:24.544777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-22T22:15:24.544938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-22T22:15:24.545083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-22T22:15:24.545245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-22T22:15:24.545387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-22T22:15:24.545597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-22T22:15:24.545806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-22T22:15:24.546064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-22T22:15:24.546229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-22T22:15:24.546408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-22T22:15:24.546703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-22T22:15:24.546897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-22T22:15:24.547070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-22T22:15:24.547225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-22T22:15:24.547485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-22T22:15:24.547671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-22T22:15:24.547867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-22T22:15:24.548025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-22T22:15:24.548201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-22T22:15:24.548345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-22T22:15:24.548524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-22T22:15:24.548669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-22T22:15:24.548871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-22T22:15:24.549074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-22T22:15:24.549246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-22T22:15:24.549390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-22T22:15:24.549547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-22T22:15:24.549739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-22T22:15:24.549881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-22T22:15:24.550078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-22T22:15:24.550247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-22T22:15:24.550415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-09-22T22:15:24.550609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-22T22:15:24.550795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-22T22:15:24.550942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-22T22:15:24.551096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-22T22:15:24.551239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-22T22:15:24.551413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-22T22:15:24.551550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-22T22:15:24.551797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-22T22:15:24.551972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-22T22:15:24.552120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-22T22:15:24.552255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-22T22:15:24.552415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-22T22:15:24.552569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-22T22:15:24.552752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-22T22:15:24.552925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-22T22:15:24.553101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-22T22:15:24.553264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-22T22:15:24.553423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-09-22T22:15:24.553566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-22T22:15:24.553884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-22T22:15:24.554051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-22T22:15:24.554202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-22T22:15:24.554385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-22T22:15:24.554517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-22T22:15:24.554696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-22T22:15:24.554885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-22T22:15:24.555029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-22T22:15:24.555196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-22T22:15:24.555526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-22T22:15:24.555728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-22T22:15:24.556017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-22T22:15:24.556192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-22T22:15:24.556352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-22T22:15:24.556521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-22T22:15:24.556696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-22T22:15:24.556844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-22T22:15:24.557001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-22T22:15:24.557170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-22T22:15:24.557319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-22T22:15:24.557471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-22T22:15:24.557684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-22T22:15:24.557872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-22T22:15:24.558041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-22T22:15:24.558164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-22T22:15:24.558280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-22T22:15:24.558417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-22T22:15:24.558594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-22T22:15:24.558778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-22T22:15:24.558945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-22T22:15:24.559122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-22T22:15:24.559285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-22T22:15:24.559432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-22T22:15:24.559595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-22T22:15:24.559879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-22T22:15:24.560104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-22T22:15:24.560284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-22T22:15:24.560444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-22T22:15:24.560596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-22T22:15:24.560795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-22T22:15:24.560954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-22T22:15:24.561098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-22T22:15:24.561233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-22T22:15:24.561361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-22T22:15:24.561509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-22T22:15:24.561700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-22T22:15:24.561859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-22T22:15:24.562032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-22T22:15:24.562190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-22T22:15:24.562357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-22T22:15:24.562501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-22T22:15:24.562673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-22T22:15:24.562837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-22T22:15:24.563008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-22T22:15:24.563144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-22T22:15:24.563281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-22T22:15:24.563430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-22T22:15:24.563605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-09-22T22:15:24.563772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-22T22:15:24.563979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-22T22:15:24.564141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-22T22:15:24.564287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-22T22:15:24.564429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-22T22:15:24.564569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-22T22:15:24.564723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-22T22:15:24.564959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-22T22:15:24.565154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-22T22:15:24.565288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-22T22:15:24.565433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-22T22:15:24.565606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-22T22:15:24.565791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-22T22:15:24.565934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-22T22:15:24.566102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-22T22:15:24.566261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-22T22:15:24.566444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-22T22:15:24.566593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-22T22:15:24.566779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-22T22:15:24.566932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-22T22:15:24.567051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-22T22:15:24.567184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-22T22:15:24.567335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-22T22:15:24.567476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-22T22:15:24.567627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-22T22:15:24.567888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-22T22:15:24.568069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-22T22:15:24.568226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-22T22:15:24.568387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-22T22:15:24.568538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-22T22:15:24.568709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-22T22:15:24.568878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-22T22:15:24.569032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-22T22:15:24.569216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-22T22:15:24.569397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-22T22:15:24.569560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-22T22:15:24.569837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-22T22:15:24.569997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-22T22:15:24.570139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-22T22:15:24.570308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-22T22:15:24.570487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-22T22:15:24.570634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-22T22:15:24.570789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-22T22:15:24.570901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-22T22:15:24.571066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-22T22:15:24.571208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-22T22:15:24.571389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-22T22:15:24.571529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-22T22:15:24.571696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-22T22:15:24.571871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-22T22:15:24.572006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-22T22:15:24.572146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-22T22:15:24.572343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-22T22:15:24.572481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-22T22:15:24.572625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-22T22:15:24.572812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-22T22:15:24.572957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-22T22:15:24.573105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-22T22:15:24.573238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-22T22:15:24.573374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-22T22:15:24.573527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-22T22:15:24.573716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-22T22:15:24.573862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-22T22:15:24.574051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-22T22:15:24.574193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-22T22:15:24.574332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-22T22:15:24.574479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-22T22:15:24.574635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-22T22:15:24.574819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-22T22:15:24.574983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-22T22:15:24.575126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-22T22:15:24.575288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-22T22:15:24.575452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-22T22:15:24.575610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-22T22:15:24.575864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-22T22:15:24.576123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-22T22:15:24.576302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-22T22:15:24.576449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-22T22:15:24.576611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-22T22:15:24.576779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-22T22:15:24.576943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-22T22:15:24.577101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-22T22:15:24.577271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-22T22:15:24.577418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-22T22:15:24.577576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-22T22:15:24.577749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-22T22:15:24.577910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-22T22:15:24.578064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-22T22:15:24.578216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-22T22:15:24.578378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-22T22:15:24.578537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-22T22:15:24.578918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-22T22:15:24.579099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-22T22:15:24.579246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-22T22:15:24.579414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-22T22:15:24.579537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-22T22:15:24.579688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-22T22:15:24.579828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-22T22:15:24.580169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-22T22:15:24.580315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-22T22:15:24.580476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-22T22:15:24.580662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-22T22:15:24.580825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-22T22:15:24.581010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-22T22:15:24.581164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-22T22:15:24.581316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-22T22:15:24.581455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-22T22:15:24.581619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-22T22:15:24.581787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-22T22:15:24.581964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-22T22:15:24.582117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-22T22:15:24.582310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-22T22:15:24.582476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-22T22:15:24.582685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-22T22:15:24.582819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-22T22:15:24.582974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-22T22:15:24.583127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-22T22:15:24.583270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-22T22:15:24.583433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-22T22:15:24.583563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-22T22:15:24.583820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-22T22:15:24.584001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-22T22:15:24.584185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-22T22:15:24.584351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-22T22:15:24.584551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-22T22:15:24.584709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-22T22:15:24.584860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-22T22:15:24.585066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-22T22:15:24.585225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-22T22:15:24.585391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-22T22:15:24.585519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-22T22:15:24.585712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-22T22:15:24.585846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-22T22:15:24.585987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-22T22:15:24.586134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-22T22:15:24.586307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-22T22:15:24.586489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-22T22:15:24.586683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-22T22:15:24.586811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-22T22:15:24.586979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-22T22:15:24.587130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-22T22:15:24.587272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-22T22:15:24.587422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-22T22:15:24.587604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-22T22:15:24.587778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-22T22:15:24.587921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-22T22:15:24.588078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-22T22:15:24.588256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-22T22:15:24.588414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-22T22:15:24.588552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-22T22:15:24.588734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-22T22:15:24.588878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-22T22:15:24.589015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-22T22:15:24.589174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-22T22:15:24.589330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-22T22:15:24.589474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-22T22:15:24.589677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-22T22:15:24.589821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-22T22:15:24.589988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-22T22:15:24.590286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-22T22:15:24.590438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-22T22:15:24.590589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-22T22:15:24.590780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-22T22:15:24.590940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-22T22:15:24.591075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-22T22:15:24.591237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-22T22:15:24.591380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-22T22:15:24.591535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-22T22:15:24.591841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-22T22:15:24.592022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-22T22:15:24.592198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-22T22:15:24.592356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-22T22:15:24.592515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-22T22:15:24.592671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-22T22:15:24.592826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-22T22:15:24.592967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-22T22:15:24.593156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-22T22:15:24.593315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-22T22:15:24.593471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-22T22:15:24.593624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-22T22:15:24.593815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-22T22:15:24.593959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-22T22:15:24.594157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-22T22:15:24.594353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-22T22:15:24.594504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-22T22:15:24.594681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-22T22:15:24.594850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-22T22:15:24.595019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-22T22:15:24.595267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-22T22:15:24.595474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-22T22:15:24.595689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-22T22:15:24.595835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-22T22:15:24.595995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-22T22:15:24.596131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-22T22:15:24.596306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-22T22:15:24.596461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-22T22:15:24.596658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-22T22:15:24.596832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-22T22:15:24.596984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-22T22:15:24.597145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-22T22:15:24.597317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-22T22:15:24.597472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-22T22:15:24.597666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-22T22:15:24.597835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-22T22:15:24.597989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-22T22:15:24.598151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-22T22:15:24.598306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-22T22:15:24.598493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-22T22:15:24.598700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-22T22:15:24.598869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-22T22:15:24.599012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-22T22:15:24.599292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-22T22:15:24.599471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-22T22:15:24.599632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-22T22:15:24.599944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-22T22:15:24.600084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-22T22:15:24.600225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-22T22:15:24.600399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-22T22:15:24.600573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-22T22:15:24.600789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-22T22:15:24.600943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-22T22:15:24.601081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-22T22:15:24.601221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-22T22:15:24.601385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-22T22:15:24.601582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-22T22:15:24.601780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-22T22:15:24.601910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-22T22:15:24.602028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-22T22:15:24.602153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-22T22:15:24.602293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-22T22:15:24.602450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-22T22:15:24.602619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-22T22:15:24.602800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-22T22:15:24.603227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-22T22:15:24.603403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-22T22:15:24.603549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-22T22:15:24.603709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-22T22:15:24.603860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-22T22:15:24.604008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-22T22:15:24.604267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-22T22:15:24.604432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-22T22:15:24.604586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-22T22:15:24.604760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-22T22:15:24.604927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-22T22:15:24.605077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-22T22:15:24.605242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-22T22:15:24.605389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-22T22:15:24.605536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-22T22:15:24.605733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-22T22:15:24.605874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-22T22:15:24.606004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-22T22:15:24.606163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-22T22:15:24.606306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-22T22:15:24.606475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-22T22:15:24.606630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-22T22:15:24.606812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-22T22:15:24.606972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-22T22:15:24.607128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-22T22:15:24.607283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-22T22:15:24.607445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-22T22:15:24.607585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-22T22:15:24.607858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-22T22:15:24.608038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-22T22:15:24.608179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-22T22:15:24.608374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-22T22:15:24.608524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-22T22:15:24.608743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-22T22:15:24.608886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-22T22:15:24.609031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-22T22:15:24.609202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-22T22:15:24.609356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-22T22:15:24.609500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-22T22:15:24.609661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-22T22:15:24.609820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-22T22:15:24.609962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-22T22:15:24.610126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-22T22:15:24.610271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-22T22:15:24.610562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-22T22:15:24.610765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-22T22:15:24.610928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-22T22:15:24.611091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-22T22:15:24.611231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-22T22:15:24.611401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-22T22:15:24.611552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-22T22:15:24.611730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-22T22:15:24.611878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-22T22:15:24.611995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-22T22:15:24.612100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-22T22:15:24.612225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-22T22:15:24.612353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-22T22:15:24.612481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-22T22:15:24.612622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-22T22:15:24.612796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-22T22:15:24.612937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-22T22:15:24.613074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-22T22:15:24.613255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-22T22:15:24.613407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-22T22:15:24.613555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-22T22:15:24.613711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-22T22:15:24.613875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-22T22:15:24.614034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-22T22:15:24.614177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-22T22:15:24.614339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-22T22:15:24.614483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-22T22:15:24.614628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-22T22:15:24.614799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-22T22:15:24.614973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-22T22:15:24.615112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-22T22:15:24.615397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-22T22:15:24.615594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-22T22:15:24.615882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-22T22:15:24.616036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-22T22:15:24.616176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-22T22:15:24.616314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-22T22:15:24.616467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-22T22:15:24.616658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-22T22:15:24.616802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-22T22:15:24.616970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-22T22:15:24.617124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-22T22:15:24.617252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-22T22:15:24.617401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-22T22:15:24.617565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-22T22:15:24.617725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-22T22:15:24.617877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-22T22:15:24.618062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-22T22:15:24.618212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-22T22:15:24.618355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-22T22:15:24.618501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-22T22:15:24.618685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-22T22:15:24.618859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-22T22:15:24.619013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-22T22:15:24.619155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-22T22:15:24.619309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-09-22T22:15:24.619467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-09-22T22:15:24.619587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-22T22:15:24.619742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-22T22:15:24.619897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-22T22:15:24.620228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-22T22:15:24.620398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-22T22:15:24.620556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-22T22:15:24.620744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-22T22:15:24.620891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-22T22:15:24.621034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-22T22:15:24.621179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-22T22:15:24.621316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-22T22:15:24.621477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-22T22:15:24.621626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-22T22:15:24.621805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-22T22:15:24.621961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-22T22:15:24.622107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-22T22:15:24.622295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-22T22:15:24.622419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-22T22:15:24.622522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-22T22:15:24.622698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-22T22:15:24.622848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-22T22:15:24.623005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-22T22:15:24.623158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-22T22:15:24.623302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-22T22:15:24.623447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-22T22:15:24.623586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-22T22:15:24.623834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-22T22:15:24.623979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-22T22:15:24.624122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-22T22:15:24.624258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-22T22:15:24.624400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-22T22:15:24.624552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-22T22:15:24.624723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-22T22:15:24.624868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-22T22:15:24.625008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-22T22:15:24.625154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-22T22:15:24.625316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-22T22:15:24.625464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-22T22:15:24.625634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-22T22:15:24.625809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-22T22:15:24.625954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-22T22:15:24.626091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-09-22T22:15:24.626236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-22T22:15:24.626407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-22T22:15:24.626593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-22T22:15:24.626761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-22T22:15:24.627008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-22T22:15:24.627153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-22T22:15:24.627269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-22T22:15:24.627564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-22T22:15:24.627733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-22T22:15:24.627868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-22T22:15:24.628028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-22T22:15:24.628206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-22T22:15:24.628326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-22T22:15:24.628454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-22T22:15:24.628598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-22T22:15:24.628790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-22T22:15:24.628946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-22T22:15:24.629108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-22T22:15:24.629265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-22T22:15:24.629429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-22T22:15:24.629569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-22T22:15:24.629750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-22T22:15:24.629886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-22T22:15:24.630023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-22T22:15:24.630163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-22T22:15:24.630354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-22T22:15:24.630496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-22T22:15:24.630694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-22T22:15:24.630840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-22T22:15:24.630988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-22T22:15:24.631175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-22T22:15:24.631326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-22T22:15:24.631456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-22T22:15:24.631599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-22T22:15:24.631847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-22T22:15:24.631977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-22T22:15:24.632106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-22T22:15:24.632252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-22T22:15:24.632398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-22T22:15:24.632574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-22T22:15:24.632727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-22T22:15:24.632944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-22T22:15:24.633090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-22T22:15:24.633275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-22T22:15:24.633397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-22T22:15:24.633521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-22T22:15:24.633683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-22T22:15:24.633850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-22T22:15:24.634022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-22T22:15:24.634157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-22T22:15:24.634306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-22T22:15:24.634439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-22T22:15:24.634569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-22T22:15:24.634777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-22T22:15:24.634919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-22T22:15:24.635062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-22T22:15:24.635200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-22T22:15:24.635332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-22T22:15:24.635460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-22T22:15:24.635599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-22T22:15:24.635758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-22T22:15:24.635898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-22T22:15:24.636020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-22T22:15:24.636127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-22T22:15:24.636404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-22T22:15:24.636523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-22T22:15:24.636657] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-22T22:15:24.636816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-22T22:15:24.636947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-22T22:15:24.637081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-22T22:15:24.637220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-22T22:15:24.637340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-22T22:15:24.637458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-22T22:15:24.637608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-22T22:15:24.637767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-22T22:15:24.637932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-22T22:15:24.638075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-22T22:15:24.638226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-22T22:15:24.638353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-22T22:15:24.638483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-22T22:15:24.638604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-22T22:15:24.638771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-22T22:15:24.638891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-22T22:15:24.639017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-22T22:15:24.639162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-22T22:15:24.639303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-22T22:15:24.639427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-22T22:15:24.639580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-22T22:15:24.639846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-22T22:15:24.640013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-22T22:15:24.640191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-22T22:15:24.640364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-22T22:15:24.640517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-22T22:15:24.640700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-22T22:15:24.640853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-22T22:15:24.641001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-22T22:15:24.641148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-22T22:15:24.641297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-22T22:15:24.641423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-22T22:15:24.641557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-22T22:15:24.641746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-22T22:15:24.641902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-22T22:15:24.642041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-22T22:15:24.642199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-22T22:15:24.642356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-22T22:15:24.642503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-22T22:15:24.642687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-22T22:15:24.642832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-22T22:15:24.642990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-22T22:15:24.643142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-22T22:15:24.643269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-22T22:15:24.643394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-22T22:15:24.643553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-22T22:15:24.643741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-22T22:15:24.643929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-22T22:15:24.644074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-22T22:15:24.644284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-22T22:15:24.644428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-22T22:15:24.644575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-22T22:15:24.644745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-22T22:15:24.644920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-22T22:15:24.645069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-22T22:15:24.645261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-22T22:15:24.645410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-22T22:15:24.645584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-22T22:15:24.645758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-22T22:15:24.645896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-22T22:15:24.646048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-22T22:15:24.646203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-22T22:15:24.646348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-22T22:15:24.646510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-22T22:15:24.646684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-22T22:15:24.646836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-22T22:15:24.646982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-22T22:15:24.647123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-22T22:15:24.647260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-22T22:15:24.647563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-22T22:15:24.647834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-22T22:15:24.647999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-22T22:15:24.648129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-22T22:15:24.648254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-22T22:15:24.648379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-22T22:15:24.648514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-22T22:15:24.648686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-22T22:15:24.648843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-22T22:15:24.648980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-22T22:15:24.649126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-22T22:15:24.649296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-22T22:15:24.649461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-22T22:15:24.649612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-22T22:15:24.650017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-22T22:15:24.650173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-22T22:15:24.650330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-22T22:15:24.650507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-22T22:15:24.650637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-22T22:15:24.650802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-22T22:15:24.650925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-22T22:15:24.651061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-22T22:15:24.651197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-22T22:15:24.651345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-22T22:15:24.651501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-22T22:15:24.651685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-22T22:15:24.651838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-22T22:15:24.651986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-22T22:15:24.652144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-22T22:15:24.652290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-22T22:15:24.652468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-22T22:15:24.652623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-22T22:15:24.652796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-22T22:15:24.652944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-22T22:15:24.653083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-22T22:15:24.653257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-22T22:15:24.653404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-22T22:15:24.653570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-22T22:15:24.653736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-22T22:15:24.653881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-22T22:15:24.654016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-22T22:15:24.654163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-22T22:15:24.654285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-22T22:15:24.654433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-22T22:15:24.654743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-22T22:15:24.654906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-22T22:15:24.655045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-22T22:15:24.655198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-22T22:15:24.655317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-22T22:15:24.655429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-22T22:15:24.655587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-22T22:15:24.655829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-22T22:15:24.655986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-22T22:15:24.656148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-22T22:15:24.656267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-22T22:15:24.656377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-22T22:15:24.656547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-22T22:15:24.656747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-22T22:15:24.656894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-22T22:15:24.657028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-22T22:15:24.657195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-22T22:15:24.657345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-22T22:15:24.657482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-22T22:15:24.657685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-22T22:15:24.657808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-22T22:15:24.657922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-22T22:15:24.658077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-22T22:15:24.658225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-22T22:15:24.658383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-22T22:15:24.658520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-22T22:15:24.658700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-22T22:15:24.658842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-22T22:15:24.658985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-22T22:15:24.659122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-22T22:15:24.659287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-22T22:15:24.659413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-22T22:15:24.659533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-22T22:15:24.659715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-22T22:15:24.659880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-22T22:15:24.660036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-22T22:15:24.660176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-22T22:15:24.660317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-22T22:15:24.660463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-22T22:15:24.660789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-22T22:15:24.660926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-22T22:15:24.661090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-22T22:15:24.661218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-22T22:15:24.661346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-22T22:15:24.661489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-22T22:15:24.661629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-22T22:15:24.661835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-22T22:15:24.662085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-22T22:15:24.662217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-22T22:15:24.662360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-22T22:15:24.662567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-22T22:15:24.662736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-22T22:15:24.662945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-22T22:15:24.663078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-22T22:15:24.663219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-22T22:15:24.663343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-22T22:15:24.663458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-22T22:15:24.663608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-22T22:15:24.663863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-22T22:15:24.664032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-22T22:15:24.664168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-22T22:15:24.664302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-22T22:15:24.664448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-22T22:15:24.664587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-22T22:15:24.664890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-22T22:15:24.665034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-22T22:15:24.665187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-22T22:15:24.665333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-22T22:15:24.665462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-22T22:15:24.665601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-22T22:15:24.665769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-22T22:15:24.665918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-22T22:15:24.666054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-22T22:15:24.666238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-22T22:15:24.666370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-22T22:15:24.666541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-22T22:15:24.666719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-22T22:15:24.666849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-22T22:15:24.666991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-22T22:15:24.667144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-09-22T22:15:24.667289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-22T22:15:24.667432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-22T22:15:24.667560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-22T22:15:24.667897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-22T22:15:24.668046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-22T22:15:24.668201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-22T22:15:24.668345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-22T22:15:24.668488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-22T22:15:24.668633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-22T22:15:24.668780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-22T22:15:24.668914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-22T22:15:24.669058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-22T22:15:24.669213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-22T22:15:24.669344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-22T22:15:24.669456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-22T22:15:24.669585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-22T22:15:24.669741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-22T22:15:24.669951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-22T22:15:24.670074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-22T22:15:24.670213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-22T22:15:24.670353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-22T22:15:24.670509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-22T22:15:24.670673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-22T22:15:24.670827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-22T22:15:24.670975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-22T22:15:24.671098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-22T22:15:24.671205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-22T22:15:24.671320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-22T22:15:24.671478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-22T22:15:24.671620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-22T22:15:24.671867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-22T22:15:24.672026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-22T22:15:24.672175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-22T22:15:24.672315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-22T22:15:24.672466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-22T22:15:24.672602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-22T22:15:24.672841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-22T22:15:24.672993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-22T22:15:24.673135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-22T22:15:24.673267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-22T22:15:24.673422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-22T22:15:24.673565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-22T22:15:24.673717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-22T22:15:24.673879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-22T22:15:24.674022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-22T22:15:24.674160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-22T22:15:24.674315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-22T22:15:24.674449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-22T22:15:24.674609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-22T22:15:24.674777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-22T22:15:24.674916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-22T22:15:24.675043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-22T22:15:24.675182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-22T22:15:24.675320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-22T22:15:24.675562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-22T22:15:24.675733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-22T22:15:24.675893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-22T22:15:24.676055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-22T22:15:24.676169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-22T22:15:24.676306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-22T22:15:24.676466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-22T22:15:24.676603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-22T22:15:24.676769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-22T22:15:24.676983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-22T22:15:24.677137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-22T22:15:24.677268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-22T22:15:24.677405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-22T22:15:24.677556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-22T22:15:24.677730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-22T22:15:24.677874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-22T22:15:24.678011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-22T22:15:24.678152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-22T22:15:24.678289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-22T22:15:24.678463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-22T22:15:24.678619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-22T22:15:24.678792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-22T22:15:24.678928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-22T22:15:24.679100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-22T22:15:24.679257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-22T22:15:24.679397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-22T22:15:24.679535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-22T22:15:24.679947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-22T22:15:24.680106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-22T22:15:24.680257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-22T22:15:24.680414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-22T22:15:24.680585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-22T22:15:24.680735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-22T22:15:24.680871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-22T22:15:24.681033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-22T22:15:24.681174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-22T22:15:24.681324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-22T22:15:24.681468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-22T22:15:24.681628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-22T22:15:24.681789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-22T22:15:24.681954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-09-22T22:15:24.682096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-22T22:15:24.682235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-22T22:15:24.682418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-22T22:15:24.682556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-22T22:15:24.682712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-22T22:15:24.682852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-22T22:15:24.682987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-22T22:15:24.683136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-22T22:15:24.683263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-22T22:15:24.683408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-22T22:15:24.683534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-22T22:15:24.683634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-22T22:15:24.683809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-22T22:15:24.683955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-22T22:15:24.684087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-22T22:15:24.684214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-22T22:15:24.684332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-22T22:15:24.684479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-22T22:15:24.684608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-22T22:15:24.684796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-22T22:15:24.684937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-22T22:15:24.685080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-22T22:15:24.685221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-22T22:15:24.685376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-22T22:15:24.685517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-22T22:15:24.685710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-22T22:15:24.686004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-22T22:15:24.686198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-22T22:15:24.686364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-22T22:15:24.686520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-22T22:15:24.686711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-22T22:15:24.686847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-22T22:15:24.687000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-22T22:15:24.687121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-22T22:15:24.687265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-22T22:15:24.687405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-22T22:15:24.687593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-22T22:15:24.687854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-22T22:15:24.688131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-22T22:15:24.688281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-09-22T22:15:24.688422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-22T22:15:24.688559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-22T22:15:24.688735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-22T22:15:24.688860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-22T22:15:24.688947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-22T22:15:24.689074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-22T22:15:24.689229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-22T22:15:24.689381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-22T22:15:24.689526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-22T22:15:24.689680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-22T22:15:24.689809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-22T22:15:24.689930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-22T22:15:24.690084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-22T22:15:24.690221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-22T22:15:24.690376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-22T22:15:24.690511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-22T22:15:24.690638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-22T22:15:24.690818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-22T22:15:24.690960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-22T22:15:24.691103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-22T22:15:24.691258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-22T22:15:24.691398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-22T22:15:24.691519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-22T22:15:24.691678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-22T22:15:24.691813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-22T22:15:24.691949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-22T22:15:24.692272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-22T22:15:24.692403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-22T22:15:24.692505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-22T22:15:24.692622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-22T22:15:24.692775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-22T22:15:24.692935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-22T22:15:24.693062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-22T22:15:24.693182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-22T22:15:24.693319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-22T22:15:24.693439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-22T22:15:24.693536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-22T22:15:24.693632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-22T22:15:24.693788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-22T22:15:24.693922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-22T22:15:24.694044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-22T22:15:24.694164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-22T22:15:24.694298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-22T22:15:24.694451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-22T22:15:24.694601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-22T22:15:24.694774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-22T22:15:24.694906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-22T22:15:24.695008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-22T22:15:24.695124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-22T22:15:24.695296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-22T22:15:24.695481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-22T22:15:24.695628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-22T22:15:24.695916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-22T22:15:24.696037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-22T22:15:24.696160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-22T22:15:24.696299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-22T22:15:24.696465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-22T22:15:24.696806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-22T22:15:24.696933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-09-22T22:15:24.697075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-22T22:15:24.697214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-22T22:15:24.697379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-22T22:15:24.697512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-22T22:15:24.697715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-22T22:15:24.697884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-22T22:15:24.698035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-22T22:15:24.698185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-22T22:15:24.698328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-22T22:15:24.698462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-22T22:15:24.698613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-22T22:15:24.698784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-22T22:15:24.698920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-22T22:15:24.699043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-22T22:15:24.699207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-22T22:15:24.699371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-22T22:15:24.699530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-22T22:15:24.699702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-22T22:15:24.699830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-22T22:15:24.699953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-22T22:15:24.700107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-22T22:15:24.700255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-22T22:15:24.700414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-22T22:15:24.700550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-22T22:15:24.700757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-22T22:15:24.700896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-22T22:15:24.701042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-22T22:15:24.701211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-22T22:15:24.701346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-22T22:15:24.701487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-22T22:15:24.701629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-22T22:15:24.701780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-22T22:15:24.701887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-22T22:15:24.702013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-22T22:15:24.702156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-22T22:15:24.702314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-22T22:15:24.702482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-22T22:15:24.702896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-22T22:15:24.703053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-22T22:15:24.703181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-22T22:15:24.703281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-22T22:15:24.703404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-22T22:15:24.703550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-22T22:15:24.703857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-22T22:15:24.703984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-22T22:15:24.704138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-22T22:15:24.704276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-22T22:15:24.704423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-22T22:15:24.704546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-22T22:15:24.704675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-22T22:15:24.704848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-22T22:15:24.704961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-22T22:15:24.705145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-22T22:15:24.705287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-22T22:15:24.705457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-22T22:15:24.705620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-22T22:15:24.705774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-22T22:15:24.705922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-22T22:15:24.706066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-22T22:15:24.706209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-22T22:15:24.706362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-22T22:15:24.706512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-22T22:15:24.706973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-22T22:15:24.707100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-22T22:15:24.707233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-22T22:15:24.707363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-22T22:15:24.707489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-22T22:15:24.707626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-22T22:15:24.707801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-22T22:15:24.707927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-22T22:15:24.708024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-22T22:15:24.708139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-22T22:15:24.708288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-22T22:15:24.708430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-22T22:15:24.708554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRFS.csv [2025-09-22T22:15:24.708701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-09-22T22:15:24.708848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-22T22:15:24.708999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-22T22:15:24.709155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-22T22:15:24.709311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-22T22:15:24.709454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-22T22:15:24.709804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-22T22:15:24.709956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-22T22:15:24.710091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-22T22:15:24.710216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-22T22:15:24.710323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-22T22:15:24.710461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-22T22:15:24.710581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-22T22:15:24.710716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-22T22:15:24.710908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-22T22:15:24.711045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-22T22:15:24.711195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-22T22:15:24.711339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-22T22:15:24.711494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-22T22:15:24.711620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-22T22:15:24.711882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-22T22:15:24.712018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-22T22:15:24.712173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-22T22:15:24.712294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-22T22:15:24.712418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-22T22:15:24.712549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-22T22:15:24.712710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-22T22:15:24.712840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-22T22:15:24.712967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-22T22:15:24.713091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-22T22:15:24.713228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-22T22:15:24.713360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-22T22:15:24.713478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-22T22:15:24.713575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-22T22:15:24.713713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-22T22:15:24.713855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-22T22:15:24.714039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-22T22:15:24.714184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-22T22:15:24.714339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-22T22:15:24.714491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-22T22:15:24.714628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-22T22:15:24.714823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-22T22:15:24.714953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-22T22:15:24.715090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-22T22:15:24.715228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-22T22:15:24.715386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-22T22:15:24.715504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-22T22:15:24.715628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-22T22:15:24.715775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-22T22:15:24.715875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-22T22:15:24.716000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-22T22:15:24.716142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-22T22:15:24.716268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-22T22:15:24.716532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-22T22:15:24.716687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-22T22:15:24.716824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-22T22:15:24.716952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-22T22:15:24.717077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-22T22:15:24.717238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-22T22:15:24.717343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-22T22:15:24.717455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-22T22:15:24.717576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-22T22:15:24.717728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-22T22:15:24.717884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-22T22:15:24.718045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-22T22:15:24.718181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-09-22T22:15:24.718333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-22T22:15:24.718495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-22T22:15:24.718635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-22T22:15:24.718804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-22T22:15:24.718932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-22T22:15:24.719034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-22T22:15:24.719139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-22T22:15:24.719264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-22T22:15:24.719386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-22T22:15:24.719519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-22T22:15:24.719759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-22T22:15:24.719910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-22T22:15:24.720056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-22T22:15:24.720177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-22T22:15:24.720278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-22T22:15:24.720377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-22T22:15:24.720477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-22T22:15:24.720596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-22T22:15:24.720770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-22T22:15:24.720899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-22T22:15:24.721047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-22T22:15:24.721192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-22T22:15:24.721332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-22T22:15:24.721660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-22T22:15:24.721811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-22T22:15:24.721946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-22T22:15:24.722091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-22T22:15:24.722418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-22T22:15:24.722571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-22T22:15:24.722765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-22T22:15:24.722903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-22T22:15:24.723062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-22T22:15:24.723228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-22T22:15:24.723364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-22T22:15:24.723511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-22T22:15:24.723684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-22T22:15:24.723813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-22T22:15:24.723941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-22T22:15:24.724059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-22T22:15:24.724184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-22T22:15:24.724302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-22T22:15:24.724402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-22T22:15:24.724493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-22T22:15:24.724613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-22T22:15:24.724774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-22T22:15:24.724944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-22T22:15:24.725081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-22T22:15:24.725227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-22T22:15:24.725360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-22T22:15:24.725506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-22T22:15:24.725696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-22T22:15:24.725847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-22T22:15:24.725999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-22T22:15:24.726165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-22T22:15:24.726304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-22T22:15:24.726459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-22T22:15:24.726582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-22T22:15:24.726869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-22T22:15:24.727016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-22T22:15:24.727136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-22T22:15:24.727252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-22T22:15:24.727386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-22T22:15:24.727553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-22T22:15:24.727827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-22T22:15:24.727950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-22T22:15:24.728053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-22T22:15:24.728204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-22T22:15:24.728343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-22T22:15:24.728479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-22T22:15:24.728615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-22T22:15:24.728788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-22T22:15:24.728934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-22T22:15:24.729063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-22T22:15:24.729193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-22T22:15:24.729313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-22T22:15:24.729429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-22T22:15:24.729559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-22T22:15:24.729717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-22T22:15:24.729861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-22T22:15:24.730002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-22T22:15:24.730128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-22T22:15:24.730241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-22T22:15:24.730362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-22T22:15:24.730486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-22T22:15:24.730684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-22T22:15:24.730829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-22T22:15:24.730987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-22T22:15:24.731129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-22T22:15:24.731261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-22T22:15:24.731402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-22T22:15:24.731536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-22T22:15:24.731869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-22T22:15:24.731998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-22T22:15:24.732150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-22T22:15:24.732291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-22T22:15:24.732426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-22T22:15:24.732554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-22T22:15:24.732717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-22T22:15:24.732838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-22T22:15:24.732963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-22T22:15:24.733097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-22T22:15:24.733242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-22T22:15:24.733377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-22T22:15:24.733495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-22T22:15:24.733592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-22T22:15:24.733733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-22T22:15:24.733855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-22T22:15:24.733982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-22T22:15:24.734120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-22T22:15:24.734263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-22T22:15:24.734400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-22T22:15:24.734533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-22T22:15:24.734712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-22T22:15:24.734847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-22T22:15:24.734979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-22T22:15:24.735120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-22T22:15:24.735265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-22T22:15:24.735592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-22T22:15:24.735876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-22T22:15:24.736011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-22T22:15:24.736131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-22T22:15:24.736223] [INFO ] [LOCAL ] Deleted 2002 derivative data files. [2025-09-22T22:15:24.736260] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-22T22:15:24.738342] [INFO ] [LOCAL ] Found 2091 symbols with primary data. [2025-09-22T22:15:24.738610] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2091 symbols [2025-09-22T22:15:24.739834] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:24.740534] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:24.739441] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:24.853024] [DEBUG] [LOCAL ] AA: Loaded 53614 existing records from primary storage. [2025-09-22T22:15:24.839255] [DEBUG] [LOCAL ] A: Loaded 50829 existing records from primary storage. [2025-09-22T22:15:24.854582] [INFO ] [MAIN ] A: Loaded 50829 primary data records. [2025-09-22T22:15:24.854716] [INFO ] [MAIN ] AA: Loaded 53614 primary data records. [2025-09-22T22:15:24.871588] [DEBUG] [LOCAL ] AAP: Loaded 52149 existing records from primary storage. [2025-09-22T22:15:24.928362] [INFO ] [MAIN ] AAP: Loaded 52149 primary data records. [2025-09-22T22:15:25.907030] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:25.911813] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50829 primary records. [2025-09-22T22:15:25.912037] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-22T22:15:25.949298] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:25.953767] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:25.953331] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 52149 primary records. [2025-09-22T22:15:25.955816] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53614 primary records. [2025-09-22T22:15:25.954929] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-22T22:15:25.957397] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-22T22:15:25.986514] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-09-22T22:15:25.987517] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-22T22:15:25.990432] [INFO ] [MAIN ] Derivative Progress: 1/2091 symbols completed. A took 1.3s. Estimated remaining: 43m 37s. Rate: 47.9 symbols/min [2025-09-22T22:15:25.991316] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:25.998283] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-09-22T22:15:25.999141] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-22T22:15:25.999030] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-09-22T22:15:25.999302] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-22T22:15:26.001777] [INFO ] [MAIN ] Derivative Progress: 2/2091 symbols completed. AA took 1.3s. Estimated remaining: 21m 60s. Rate: 95.0 symbols/min [2025-09-22T22:15:26.004791] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:26.004960] [INFO ] [MAIN ] Derivative Progress: 3/2091 symbols completed. AAP took 1.3s. Estimated remaining: 14m 42s. Rate: 142.1 symbols/min [2025-09-22T22:15:26.005757] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:26.051836] [DEBUG] [LOCAL ] AAT: Loaded 30600 existing records from primary storage. [2025-09-22T22:15:26.051984] [INFO ] [MAIN ] AAT: Loaded 30600 primary data records. [2025-09-22T22:15:26.189715] [DEBUG] [LOCAL ] AB: Loaded 28542 existing records from primary storage. [2025-09-22T22:15:26.190001] [INFO ] [MAIN ] AB: Loaded 28542 primary data records. [2025-09-22T22:15:26.384055] [DEBUG] [LOCAL ] ABBV: Loaded 53687 existing records from primary storage. [2025-09-22T22:15:26.408260] [INFO ] [MAIN ] ABBV: Loaded 53687 primary data records. [2025-09-22T22:15:27.134493] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:27.135969] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30600 primary records. [2025-09-22T22:15:27.136154] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-22T22:15:27.166502] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:27.168075] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 28542 primary records. [2025-09-22T22:15:27.168347] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-22T22:15:27.186750] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-09-22T22:15:27.187205] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-09-22T22:15:27.187561] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-22T22:15:27.187710] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-22T22:15:27.189511] [INFO ] [MAIN ] Derivative Progress: 4/2091 symbols completed. AAT took 1.2s. Estimated remaining: 21m 19s. Rate: 97.9 symbols/min [2025-09-22T22:15:27.192169] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:27.192688] [INFO ] [MAIN ] Derivative Progress: 5/2091 symbols completed. AB took 1.2s. Estimated remaining: 17m 4s. Rate: 122.2 symbols/min [2025-09-22T22:15:27.192909] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:27.209614] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:27.210444] [INFO ] [MAIN ] ABBV: Generated 1794 derivative records from 53687 primary records. [2025-09-22T22:15:27.210579] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-22T22:15:27.227179] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1794 records). [2025-09-22T22:15:27.227247] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-22T22:15:27.229898] [INFO ] [MAIN ] Derivative Progress: 6/2091 symbols completed. ABBV took 1.2s. Estimated remaining: 14m 26s. Rate: 144.5 symbols/min [2025-09-22T22:15:27.230305] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:27.257443] [DEBUG] [LOCAL ] ABG: Loaded 18829 existing records from primary storage. [2025-09-22T22:15:27.257567] [INFO ] [MAIN ] ABG: Loaded 18829 primary data records. [2025-09-22T22:15:27.353328] [DEBUG] [LOCAL ] ABCB: Loaded 30792 existing records from primary storage. [2025-09-22T22:15:27.371561] [INFO ] [MAIN ] ABCB: Loaded 30792 primary data records. [2025-09-22T22:15:27.545852] [DEBUG] [LOCAL ] ABEV: Loaded 53275 existing records from primary storage. [2025-09-22T22:15:27.588056] [INFO ] [MAIN ] ABEV: Loaded 53275 primary data records. [2025-09-22T22:15:28.298422] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:28.299686] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18829 primary records. [2025-09-22T22:15:28.299792] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-22T22:15:28.324751] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-09-22T22:15:28.325268] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-22T22:15:28.327310] [INFO ] [MAIN ] Derivative Progress: 7/2091 symbols completed. ABG took 1.1s. Estimated remaining: 17m 48s. Rate: 117.0 symbols/min [2025-09-22T22:15:28.340200] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:28.341273] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:28.342112] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30792 primary records. [2025-09-22T22:15:28.342679] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-22T22:15:28.361793] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-09-22T22:15:28.362763] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-22T22:15:28.364722] [INFO ] [MAIN ] Derivative Progress: 8/2091 symbols completed. ABCB took 1.2s. Estimated remaining: 15m 44s. Rate: 132.4 symbols/min [2025-09-22T22:15:28.365171] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:28.378396] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:28.379341] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53275 primary records. [2025-09-22T22:15:28.379565] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-22T22:15:28.404939] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-09-22T22:15:28.405172] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-22T22:15:28.408761] [INFO ] [MAIN ] Derivative Progress: 9/2091 symbols completed. ABEV took 1.2s. Estimated remaining: 14m 9s. Rate: 147.1 symbols/min [2025-09-22T22:15:28.409177] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:28.423627] [DEBUG] [LOCAL ] ABM: Loaded 32357 existing records from primary storage. [2025-09-22T22:15:28.423891] [INFO ] [MAIN ] ABM: Loaded 32357 primary data records. [2025-09-22T22:15:28.824270] [DEBUG] [LOCAL ] ABR: Loaded 52125 existing records from primary storage. [2025-09-22T22:15:28.825568] [INFO ] [MAIN ] ABR: Loaded 52125 primary data records. [2025-09-22T22:15:28.848272] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-09-22T22:15:28.886541] [INFO ] [MAIN ] ABT: Loaded 53620 primary data records. [2025-09-22T22:15:29.509424] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:29.510706] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32357 primary records. [2025-09-22T22:15:29.511151] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-22T22:15:29.529127] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-09-22T22:15:29.529594] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-22T22:15:29.531806] [INFO ] [MAIN ] Derivative Progress: 10/2091 symbols completed. ABM took 1.2s. Estimated remaining: 16m 38s. Rate: 125.2 symbols/min [2025-09-22T22:15:29.532844] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:29.553196] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:29.553930] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 52125 primary records. [2025-09-22T22:15:29.554054] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-22T22:15:29.592956] [DEBUG] [LOCAL ] ACA: Loaded 23948 existing records from primary storage. [2025-09-22T22:15:29.593778] [INFO ] [MAIN ] ACA: Loaded 23948 primary data records. [2025-09-22T22:15:29.626448] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-09-22T22:15:29.626604] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-22T22:15:29.646290] [INFO ] [MAIN ] Derivative Progress: 11/2091 symbols completed. ABR took 1.3s. Estimated remaining: 15m 28s. Rate: 134.5 symbols/min [2025-09-22T22:15:29.672450] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:15:29.687518] [INFO ] [MAIN ] ABT: Generated 1793 derivative records from 53620 primary records. [2025-09-22T22:15:29.694248] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-22T22:15:29.672072] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:29.755082] [DEBUG] [LOCAL ] ABT: Derivative data saved (1793 records). [2025-09-22T22:15:29.779485] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-22T22:15:29.817045] [INFO ] [MAIN ] Derivative Progress: 12/2091 symbols completed. ABT took 1.4s. Estimated remaining: 14m 40s. Rate: 141.8 symbols/min [2025-09-22T22:15:29.946353] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:29.962681] [DEBUG] [LOCAL ] ACEL: Loaded 27250 existing records from primary storage. [2025-09-22T22:15:29.963114] [INFO ] [MAIN ] ACEL: Loaded 27250 primary data records. [2025-09-22T22:15:30.190728] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:30.191756] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 23948 primary records. [2025-09-22T22:15:30.191841] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-22T22:15:30.352176] [DEBUG] [LOCAL ] ACI: Loaded 53272 existing records from primary storage. [2025-09-22T22:15:30.353344] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-09-22T22:15:30.352903] [INFO ] [MAIN ] ACI: Loaded 53272 primary data records. [2025-09-22T22:15:30.353891] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-22T22:15:30.356839] [INFO ] [MAIN ] Derivative Progress: 13/2091 symbols completed. ACA took 0.8s. Estimated remaining: 14m 58s. Rate: 138.8 symbols/min [2025-09-22T22:15:30.561211] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:30.562201] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 27250 primary records. [2025-09-22T22:15:30.562317] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-22T22:15:30.746177] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-09-22T22:15:30.746392] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-22T22:15:30.748248] [INFO ] [MAIN ] Derivative Progress: 14/2091 symbols completed. ACEL took 1.1s. Estimated remaining: 14m 52s. Rate: 139.8 symbols/min [2025-09-22T22:15:30.767673] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:30.768262] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53272 primary records. [2025-09-22T22:15:30.768322] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-22T22:15:30.783727] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-09-22T22:15:30.783787] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-22T22:15:30.785956] [INFO ] [MAIN ] Derivative Progress: 15/2091 symbols completed. ACI took 0.8s. Estimated remaining: 13m 57s. Rate: 148.8 symbols/min [2025-09-22T22:15:30.786824] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:30.786516] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:30.786682] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:30.798697] [DEBUG] [LOCAL ] ACR: Loaded 6375 existing records from primary storage. [2025-09-22T22:15:30.798911] [INFO ] [MAIN ] ACR: Loaded 6375 primary data records. [2025-09-22T22:15:31.035018] [DEBUG] [LOCAL ] ACP: Loaded 31322 existing records from primary storage. [2025-09-22T22:15:31.035222] [INFO ] [MAIN ] ACP: Loaded 31322 primary data records. [2025-09-22T22:15:31.155007] [DEBUG] [LOCAL ] ACM: Loaded 43137 existing records from primary storage. [2025-09-22T22:15:31.155305] [INFO ] [MAIN ] ACM: Loaded 43137 primary data records. [2025-09-22T22:15:31.805005] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:15:31.806746] [INFO ] [MAIN ] ACR: Generated 1793 derivative records from 6375 primary records. [2025-09-22T22:15:31.807110] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-22T22:15:31.825781] [DEBUG] [LOCAL ] ACR: Derivative data saved (1793 records). [2025-09-22T22:15:31.826059] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-22T22:15:31.828331] [INFO ] [MAIN ] Derivative Progress: 16/2091 symbols completed. ACR took 1.0s. Estimated remaining: 15m 19s. Rate: 135.4 symbols/min [2025-09-22T22:15:31.830875] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:31.851107] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:31.852131] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43137 primary records. [2025-09-22T22:15:31.859567] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-22T22:15:31.865223] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:31.866221] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 31322 primary records. [2025-09-22T22:15:31.880180] [DEBUG] [LOCAL ] ACV: Loaded 6905 existing records from primary storage. [2025-09-22T22:15:31.877418] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-22T22:15:31.880736] [INFO ] [MAIN ] ACV: Loaded 6905 primary data records. [2025-09-22T22:15:31.884475] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-09-22T22:15:31.896363] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-22T22:15:31.898602] [INFO ] [MAIN ] Derivative Progress: 17/2091 symbols completed. ACM took 1.1s. Estimated remaining: 14m 34s. Rate: 142.5 symbols/min [2025-09-22T22:15:31.954322] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:32.096782] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-09-22T22:15:32.103795] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-22T22:15:32.227593] [INFO ] [MAIN ] Derivative Progress: 18/2091 symbols completed. ACP took 1.4s. Estimated remaining: 14m 23s. Rate: 144.2 symbols/min [2025-09-22T22:15:32.228345] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:32.271892] [DEBUG] [LOCAL ] ACVA: Loaded 49361 existing records from primary storage. [2025-09-22T22:15:32.272988] [INFO ] [MAIN ] ACVA: Loaded 49361 primary data records. [2025-09-22T22:15:32.335375] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:32.336984] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 6905 primary records. [2025-09-22T22:15:32.344056] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-22T22:15:32.415086] [DEBUG] [LOCAL ] ADCT: Loaded 33810 existing records from primary storage. [2025-09-22T22:15:32.434602] [INFO ] [MAIN ] ADCT: Loaded 33810 primary data records. [2025-09-22T22:15:32.463512] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-09-22T22:15:32.572685] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-22T22:15:32.640182] [INFO ] [MAIN ] Derivative Progress: 19/2091 symbols completed. ACV took 0.8s. Estimated remaining: 14m 22s. Rate: 144.3 symbols/min [2025-09-22T22:15:32.794870] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:33.073854] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:33.074837] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49361 primary records. [2025-09-22T22:15:33.075124] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-22T22:15:33.094497] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-09-22T22:15:33.107776] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-22T22:15:33.111940] [INFO ] [MAIN ] Derivative Progress: 20/2091 symbols completed. ACVA took 1.2s. Estimated remaining: 14m 27s. Rate: 143.3 symbols/min [2025-09-22T22:15:33.113387] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:33.116419] [DEBUG] [LOCAL ] ADM: Loaded 53397 existing records from primary storage. [2025-09-22T22:15:33.117106] [INFO ] [MAIN ] ADM: Loaded 53397 primary data records. [2025-09-22T22:15:33.173581] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:33.212074] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 33810 primary records. [2025-09-22T22:15:33.230512] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-22T22:15:33.431327] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-09-22T22:15:33.447946] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-22T22:15:33.458528] [INFO ] [MAIN ] Derivative Progress: 21/2091 symbols completed. ADCT took 1.2s. Estimated remaining: 14m 20s. Rate: 144.5 symbols/min [2025-09-22T22:15:33.458926] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:33.480450] [DEBUG] [LOCAL ] ADNT: Loaded 47567 existing records from primary storage. [2025-09-22T22:15:33.481063] [INFO ] [MAIN ] ADNT: Loaded 47567 primary data records. [2025-09-22T22:15:33.621508] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:33.660070] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53397 primary records. [2025-09-22T22:15:33.675846] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-22T22:15:33.849539] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-09-22T22:15:33.850368] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-22T22:15:33.840533] [DEBUG] [LOCAL ] ADT: Loaded 53479 existing records from primary storage. [2025-09-22T22:15:33.852844] [INFO ] [MAIN ] ADT: Loaded 53479 primary data records. [2025-09-22T22:15:33.852698] [INFO ] [MAIN ] Derivative Progress: 22/2091 symbols completed. ADM took 1.1s. Estimated remaining: 14m 17s. Rate: 144.8 symbols/min [2025-09-22T22:15:33.865807] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:34.179020] [DEBUG] [LOCAL ] ADX: Loaded 27927 existing records from primary storage. [2025-09-22T22:15:34.179933] [INFO ] [MAIN ] ADX: Loaded 27927 primary data records. [2025-09-22T22:15:34.310665] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:34.327455] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 47567 primary records. [2025-09-22T22:15:34.333061] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-22T22:15:34.524129] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-09-22T22:15:34.533979] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-22T22:15:34.536681] [INFO ] [MAIN ] Derivative Progress: 23/2091 symbols completed. ADNT took 1.4s. Estimated remaining: 14m 41s. Rate: 140.8 symbols/min [2025-09-22T22:15:34.537206] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:34.557357] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:34.558383] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53479 primary records. [2025-09-22T22:15:34.558582] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-22T22:15:34.575938] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-09-22T22:15:34.576138] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-22T22:15:34.578230] [INFO ] [MAIN ] Derivative Progress: 24/2091 symbols completed. ADT took 1.1s. Estimated remaining: 14m 7s. Rate: 146.3 symbols/min [2025-09-22T22:15:34.578859] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:34.592271] [DEBUG] [LOCAL ] AEFC: Loaded 8633 existing records from primary storage. [2025-09-22T22:15:34.592784] [INFO ] [MAIN ] AEFC: Loaded 8633 primary data records. [2025-09-22T22:15:34.662034] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:34.693825] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27927 primary records. [2025-09-22T22:15:34.719027] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-22T22:15:34.994171] [DEBUG] [LOCAL ] AEE: Loaded 50205 existing records from primary storage. [2025-09-22T22:15:34.995733] [INFO ] [MAIN ] AEE: Loaded 50205 primary data records. [2025-09-22T22:15:34.996286] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-09-22T22:15:35.010916] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-22T22:15:35.024143] [INFO ] [MAIN ] Derivative Progress: 25/2091 symbols completed. ADX took 1.2s. Estimated remaining: 14m 10s. Rate: 145.8 symbols/min [2025-09-22T22:15:35.048177] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:35.384295] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:35.385383] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8633 primary records. [2025-09-22T22:15:35.385592] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-22T22:15:35.414608] [DEBUG] [LOCAL ] AEG: Loaded 49596 existing records from primary storage. [2025-09-22T22:15:35.417827] [INFO ] [MAIN ] AEG: Loaded 49596 primary data records. [2025-09-22T22:15:35.419149] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-09-22T22:15:35.430757] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-22T22:15:35.453810] [INFO ] [MAIN ] Derivative Progress: 26/2091 symbols completed. AEFC took 0.9s. Estimated remaining: 14m 11s. Rate: 145.6 symbols/min [2025-09-22T22:15:35.461221] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:35.740610] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:35.741430] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50205 primary records. [2025-09-22T22:15:35.741494] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-22T22:15:35.759228] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-09-22T22:15:35.773550] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-22T22:15:35.776079] [INFO ] [MAIN ] Derivative Progress: 27/2091 symbols completed. AEE took 1.2s. Estimated remaining: 14m 4s. Rate: 146.8 symbols/min [2025-09-22T22:15:35.777206] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:35.800458] [DEBUG] [LOCAL ] AEM: Loaded 53465 existing records from primary storage. [2025-09-22T22:15:35.800904] [INFO ] [MAIN ] AEM: Loaded 53465 primary data records. [2025-09-22T22:15:35.930590] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:35.947076] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49596 primary records. [2025-09-22T22:15:36.143854] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-22T22:15:36.190018] [DEBUG] [LOCAL ] AEO: Loaded 53558 existing records from primary storage. [2025-09-22T22:15:36.191411] [INFO ] [MAIN ] AEO: Loaded 53558 primary data records. [2025-09-22T22:15:36.230518] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-09-22T22:15:36.237834] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-22T22:15:36.253801] [INFO ] [MAIN ] Derivative Progress: 28/2091 symbols completed. AEG took 1.2s. Estimated remaining: 14m 8s. Rate: 145.9 symbols/min [2025-09-22T22:15:36.527856] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:36.529343] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53465 primary records. [2025-09-22T22:15:36.529676] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-22T22:15:36.548997] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-09-22T22:15:36.549172] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-22T22:15:36.551234] [INFO ] [MAIN ] Derivative Progress: 29/2091 symbols completed. AEM took 1.1s. Estimated remaining: 13m 60s. Rate: 147.3 symbols/min [2025-09-22T22:15:36.569109] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:36.569732] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53558 primary records. [2025-09-22T22:15:36.569799] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-22T22:15:36.585287] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-09-22T22:15:36.585358] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-22T22:15:36.587800] [INFO ] [MAIN ] Derivative Progress: 30/2091 symbols completed. AEO took 0.8s. Estimated remaining: 13m 34s. Rate: 151.9 symbols/min [2025-09-22T22:15:36.588491] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:36.588742] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:36.589352] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:36.608485] [DEBUG] [LOCAL ] AFB: Loaded 11445 existing records from primary storage. [2025-09-22T22:15:36.608757] [INFO ] [MAIN ] AFB: Loaded 11445 primary data records. [2025-09-22T22:15:37.023592] [DEBUG] [LOCAL ] AESI: Loaded 49488 existing records from primary storage. [2025-09-22T22:15:37.023895] [INFO ] [MAIN ] AESI: Loaded 49488 primary data records. [2025-09-22T22:15:37.036087] [DEBUG] [LOCAL ] AES: Loaded 53672 existing records from primary storage. [2025-09-22T22:15:37.061712] [INFO ] [MAIN ] AES: Loaded 53672 primary data records. [2025-09-22T22:15:37.671635] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:37.673926] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11445 primary records. [2025-09-22T22:15:37.675099] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-22T22:15:37.693302] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-09-22T22:15:37.693928] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-22T22:15:37.696486] [INFO ] [MAIN ] Derivative Progress: 31/2091 symbols completed. AFB took 1.1s. Estimated remaining: 14m 21s. Rate: 143.5 symbols/min [2025-09-22T22:15:37.697196] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:37.707071] [DEBUG] [LOCAL ] AFGB: Loaded 2450 existing records from primary storage. [2025-09-22T22:15:37.708498] [INFO ] [MAIN ] AFGB: Loaded 2450 primary data records. [2025-09-22T22:15:37.800031] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:37.818301] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49488 primary records. [2025-09-22T22:15:37.830342] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:37.831322] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53672 primary records. [2025-09-22T22:15:37.842498] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-22T22:15:37.842557] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-22T22:15:37.921457] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-09-22T22:15:37.924470] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-22T22:15:37.938259] [INFO ] [MAIN ] Derivative Progress: 32/2091 symbols completed. AES took 1.3s. Estimated remaining: 14m 9s. Rate: 145.5 symbols/min [2025-09-22T22:15:37.952985] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:37.959581] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-09-22T22:15:37.959751] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-22T22:15:37.961921] [INFO ] [MAIN ] Derivative Progress: 33/2091 symbols completed. AESI took 1.4s. Estimated remaining: 13m 45s. Rate: 149.7 symbols/min [2025-09-22T22:15:37.962431] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:38.087244] [DEBUG] [LOCAL ] AFGC: Loaded 2558 existing records from primary storage. [2025-09-22T22:15:38.087531] [INFO ] [MAIN ] AFGC: Loaded 2558 primary data records. [2025-09-22T22:15:38.121324] [DEBUG] [LOCAL ] AFGD: Loaded 1879 existing records from primary storage. [2025-09-22T22:15:38.126588] [INFO ] [MAIN ] AFGD: Loaded 1879 primary data records. [2025-09-22T22:15:38.763016] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:38.764055] [INFO ] [MAIN ] AFGB: Generated 1794 derivative records from 2450 primary records. [2025-09-22T22:15:38.764325] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-22T22:15:38.785141] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-09-22T22:15:38.785378] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-22T22:15:38.787433] [INFO ] [MAIN ] Derivative Progress: 34/2091 symbols completed. AFGB took 1.1s. Estimated remaining: 14m 10s. Rate: 145.2 symbols/min [2025-09-22T22:15:38.795270] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:38.800884] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:38.801806] [INFO ] [MAIN ] AFGC: Generated 1794 derivative records from 2558 primary records. [2025-09-22T22:15:38.801946] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-22T22:15:38.821781] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1794 records). [2025-09-22T22:15:38.821911] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-22T22:15:38.821341] [DEBUG] [LOCAL ] AFGE: Loaded 2534 existing records from primary storage. [2025-09-22T22:15:38.824306] [INFO ] [MAIN ] AFGE: Loaded 2534 primary data records. [2025-09-22T22:15:38.824219] [INFO ] [MAIN ] Derivative Progress: 35/2091 symbols completed. AFGC took 0.9s. Estimated remaining: 13m 47s. Rate: 149.1 symbols/min [2025-09-22T22:15:38.889928] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:38.890091] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:38.925419] [INFO ] [MAIN ] AFGD: Generated 1794 derivative records from 1879 primary records. [2025-09-22T22:15:38.925572] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-22T22:15:39.161205] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1794 records). [2025-09-22T22:15:39.161571] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-22T22:15:39.163746] [INFO ] [MAIN ] Derivative Progress: 36/2091 symbols completed. AFGD took 1.2s. Estimated remaining: 13m 43s. Rate: 149.7 symbols/min [2025-09-22T22:15:39.172517] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:39.213183] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:39.213928] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2534 primary records. [2025-09-22T22:15:39.214092] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-22T22:15:39.256693] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-09-22T22:15:39.258141] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-22T22:15:39.260487] [INFO ] [MAIN ] Derivative Progress: 37/2091 symbols completed. AFGE took 0.5s. Estimated remaining: 13m 26s. Rate: 152.9 symbols/min [2025-09-22T22:15:39.257995] [DEBUG] [LOCAL ] AFL: Loaded 53151 existing records from primary storage. [2025-09-22T22:15:39.260943] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:39.261136] [INFO ] [MAIN ] AFL: Loaded 53151 primary data records. [2025-09-22T22:15:39.381250] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-09-22T22:15:39.397449] [INFO ] [MAIN ] AG: Loaded 53643 primary data records. [2025-09-22T22:15:39.769133] [DEBUG] [LOCAL ] AGCO: Loaded 42600 existing records from primary storage. [2025-09-22T22:15:39.788330] [INFO ] [MAIN ] AGCO: Loaded 42600 primary data records. [2025-09-22T22:15:40.236523] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:40.237823] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53151 primary records. [2025-09-22T22:15:40.238143] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-22T22:15:40.271170] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:40.272370] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-09-22T22:15:40.273282] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53643 primary records. [2025-09-22T22:15:40.273492] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-22T22:15:40.273732] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-22T22:15:40.276252] [INFO ] [MAIN ] Derivative Progress: 38/2091 symbols completed. AFL took 1.4s. Estimated remaining: 13m 59s. Rate: 146.7 symbols/min [2025-09-22T22:15:40.277616] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:40.294488] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-09-22T22:15:40.297095] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-22T22:15:40.299105] [INFO ] [MAIN ] Derivative Progress: 39/2091 symbols completed. AG took 1.1s. Estimated remaining: 13m 39s. Rate: 150.4 symbols/min [2025-09-22T22:15:40.299551] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:40.313272] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:40.314085] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42600 primary records. [2025-09-22T22:15:40.314232] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-22T22:15:40.332132] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-09-22T22:15:40.332356] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-22T22:15:40.334293] [INFO ] [MAIN ] Derivative Progress: 40/2091 symbols completed. AGCO took 1.1s. Estimated remaining: 13m 20s. Rate: 153.9 symbols/min [2025-09-22T22:15:40.334718] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:40.348736] [DEBUG] [LOCAL ] AGM: Loaded 9877 existing records from primary storage. [2025-09-22T22:15:40.348866] [INFO ] [MAIN ] AGM: Loaded 9877 primary data records. [2025-09-22T22:15:40.545043] [DEBUG] [LOCAL ] AGI: Loaded 53418 existing records from primary storage. [2025-09-22T22:15:40.559913] [INFO ] [MAIN ] AGI: Loaded 53418 primary data records. [2025-09-22T22:15:40.751277] [DEBUG] [LOCAL ] AGL: Loaded 52417 existing records from primary storage. [2025-09-22T22:15:40.781697] [INFO ] [MAIN ] AGL: Loaded 52417 primary data records. [2025-09-22T22:15:41.395104] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:41.396339] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 9877 primary records. [2025-09-22T22:15:41.396497] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-22T22:15:41.416790] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-09-22T22:15:41.417023] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-22T22:15:41.419003] [INFO ] [MAIN ] Derivative Progress: 41/2091 symbols completed. AGM took 1.1s. Estimated remaining: 13m 54s. Rate: 147.5 symbols/min [2025-09-22T22:15:41.419358] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:41.443856] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:41.444632] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53418 primary records. [2025-09-22T22:15:41.444827] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-22T22:15:41.458079] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:41.458808] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52417 primary records. [2025-09-22T22:15:41.459043] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-22T22:15:41.482233] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-09-22T22:15:41.495956] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-22T22:15:41.499153] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-09-22T22:15:41.499325] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-22T22:15:41.498452] [INFO ] [MAIN ] Derivative Progress: 42/2091 symbols completed. AGI took 1.2s. Estimated remaining: 13m 38s. Rate: 150.4 symbols/min [2025-09-22T22:15:41.502228] [INFO ] [MAIN ] Derivative Progress: 43/2091 symbols completed. AGL took 1.2s. Estimated remaining: 13m 18s. Rate: 153.9 symbols/min [2025-09-22T22:15:41.502163] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:41.514121] [DEBUG] [LOCAL ] AGO: Loaded 28128 existing records from primary storage. [2025-09-22T22:15:41.514267] [INFO ] [MAIN ] AGO: Loaded 28128 primary data records. [2025-09-22T22:15:41.746948] [DEBUG] [LOCAL ] AGRO: Loaded 33821 existing records from primary storage. [2025-09-22T22:15:41.760065] [INFO ] [MAIN ] AGRO: Loaded 33821 primary data records. [2025-09-22T22:15:42.160965] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:42.161974] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 28128 primary records. [2025-09-22T22:15:42.162152] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-22T22:15:42.179619] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-09-22T22:15:42.179737] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-22T22:15:42.181666] [INFO ] [MAIN ] Derivative Progress: 44/2091 symbols completed. AGO took 0.8s. Estimated remaining: 13m 32s. Rate: 151.3 symbols/min [2025-09-22T22:15:42.197459] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:42.198131] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33821 primary records. [2025-09-22T22:15:42.198193] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-22T22:15:42.213237] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-09-22T22:15:42.213334] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-22T22:15:42.215401] [INFO ] [MAIN ] Derivative Progress: 45/2091 symbols completed. AGRO took 0.7s. Estimated remaining: 13m 15s. Rate: 154.5 symbols/min [2025-09-22T22:15:42.216277] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:42.216191] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:42.216390] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:42.299495] [DEBUG] [LOCAL ] AHH: Loaded 41463 existing records from primary storage. [2025-09-22T22:15:42.300599] [INFO ] [MAIN ] AHH: Loaded 41463 primary data records. [2025-09-22T22:15:42.357387] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-22T22:15:42.419939] [INFO ] [MAIN ] AI: Loaded 53749 primary data records. [2025-09-22T22:15:42.426067] [DEBUG] [LOCAL ] AHR: Loaded 49322 existing records from primary storage. [2025-09-22T22:15:42.448770] [INFO ] [MAIN ] AHR: Loaded 49322 primary data records. [2025-09-22T22:15:43.437256] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:43.438593] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 41463 primary records. [2025-09-22T22:15:43.439013] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-22T22:15:43.473993] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-09-22T22:15:43.474396] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:43.482298] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-22T22:15:43.488894] [INFO ] [MAIN ] Derivative Progress: 46/2091 symbols completed. AHH took 1.3s. Estimated remaining: 13m 54s. Rate: 147.2 symbols/min [2025-09-22T22:15:43.490462] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53749 primary records. [2025-09-22T22:15:43.490918] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:43.491219] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:43.492276] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49322 primary records. [2025-09-22T22:15:43.491508] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-22T22:15:43.492823] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-22T22:15:43.521891] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-09-22T22:15:43.525787] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-22T22:15:43.526595] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-09-22T22:15:43.530069] [INFO ] [MAIN ] Derivative Progress: 47/2091 symbols completed. AI took 1.3s. Estimated remaining: 13m 37s. Rate: 150.1 symbols/min [2025-09-22T22:15:43.530587] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:43.530386] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-22T22:15:43.533291] [INFO ] [MAIN ] Derivative Progress: 48/2091 symbols completed. AHR took 1.3s. Estimated remaining: 13m 20s. Rate: 153.2 symbols/min [2025-09-22T22:15:43.534102] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:43.555719] [DEBUG] [LOCAL ] AIO: Loaded 13283 existing records from primary storage. [2025-09-22T22:15:43.555835] [INFO ] [MAIN ] AIO: Loaded 13283 primary data records. [2025-09-22T22:15:43.654130] [DEBUG] [LOCAL ] AIN: Loaded 24581 existing records from primary storage. [2025-09-22T22:15:43.665825] [INFO ] [MAIN ] AIN: Loaded 24581 primary data records. [2025-09-22T22:15:43.799384] [DEBUG] [LOCAL ] AIG: Loaded 53478 existing records from primary storage. [2025-09-22T22:15:43.845124] [INFO ] [MAIN ] AIG: Loaded 53478 primary data records. [2025-09-22T22:15:44.564382] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:44.565675] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13283 primary records. [2025-09-22T22:15:44.566867] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-22T22:15:44.597740] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:44.598546] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-09-22T22:15:44.599489] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24581 primary records. [2025-09-22T22:15:44.600422] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-22T22:15:44.600818] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-22T22:15:44.603026] [INFO ] [MAIN ] Derivative Progress: 49/2091 symbols completed. AIO took 1.1s. Estimated remaining: 13m 48s. Rate: 148.0 symbols/min [2025-09-22T22:15:44.616255] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:44.637928] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-09-22T22:15:44.635111] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:44.638505] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-22T22:15:44.639352] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53478 primary records. [2025-09-22T22:15:44.641622] [INFO ] [MAIN ] Derivative Progress: 50/2091 symbols completed. AIN took 1.1s. Estimated remaining: 13m 32s. Rate: 150.7 symbols/min [2025-09-22T22:15:44.642111] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:44.642208] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-22T22:15:44.660082] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-09-22T22:15:44.660266] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-22T22:15:44.662467] [INFO ] [MAIN ] Derivative Progress: 51/2091 symbols completed. AIG took 1.2s. Estimated remaining: 13m 17s. Rate: 153.6 symbols/min [2025-09-22T22:15:44.662932] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:44.683731] [DEBUG] [LOCAL ] AIR: Loaded 27260 existing records from primary storage. [2025-09-22T22:15:44.684254] [INFO ] [MAIN ] AIR: Loaded 27260 primary data records. [2025-09-22T22:15:44.870278] [DEBUG] [LOCAL ] AIV: Loaded 40199 existing records from primary storage. [2025-09-22T22:15:44.894400] [DEBUG] [LOCAL ] AIZ: Loaded 30228 existing records from primary storage. [2025-09-22T22:15:44.927401] [INFO ] [MAIN ] AIZ: Loaded 30228 primary data records. [2025-09-22T22:15:44.927193] [INFO ] [MAIN ] AIV: Loaded 40199 primary data records. [2025-09-22T22:15:45.753349] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:45.754370] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 27260 primary records. [2025-09-22T22:15:45.754666] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-22T22:15:45.793384] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-09-22T22:15:45.793806] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-22T22:15:45.794125] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:45.794958] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 30228 primary records. [2025-09-22T22:15:45.797076] [INFO ] [MAIN ] Derivative Progress: 52/2091 symbols completed. AIR took 1.2s. Estimated remaining: 13m 46s. Rate: 148.2 symbols/min [2025-09-22T22:15:45.795055] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-22T22:15:45.817794] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:45.822052] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40199 primary records. [2025-09-22T22:15:45.823668] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:45.824662] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-22T22:15:45.827389] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-09-22T22:15:45.835280] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-22T22:15:45.840792] [INFO ] [MAIN ] Derivative Progress: 53/2091 symbols completed. AIZ took 1.2s. Estimated remaining: 13m 31s. Rate: 150.7 symbols/min [2025-09-22T22:15:45.842717] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:45.845230] [DEBUG] [LOCAL ] AIZN: Loaded 3925 existing records from primary storage. [2025-09-22T22:15:45.845838] [INFO ] [MAIN ] AIZN: Loaded 3925 primary data records. [2025-09-22T22:15:45.869215] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-09-22T22:15:45.869416] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-22T22:15:45.894440] [INFO ] [MAIN ] Derivative Progress: 54/2091 symbols completed. AIV took 1.3s. Estimated remaining: 13m 18s. Rate: 153.1 symbols/min [2025-09-22T22:15:45.927764] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:46.197205] [DEBUG] [LOCAL ] AJG: Loaded 47141 existing records from primary storage. [2025-09-22T22:15:46.197913] [INFO ] [MAIN ] AJG: Loaded 47141 primary data records. [2025-09-22T22:15:46.307507] [DEBUG] [LOCAL ] AKR: Loaded 45691 existing records from primary storage. [2025-09-22T22:15:46.315794] [INFO ] [MAIN ] AKR: Loaded 45691 primary data records. [2025-09-22T22:15:46.538841] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:46.550274] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 3925 primary records. [2025-09-22T22:15:46.707222] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-22T22:15:46.867047] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-09-22T22:15:46.869137] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-22T22:15:46.871442] [INFO ] [MAIN ] Derivative Progress: 55/2091 symbols completed. AIZN took 1.1s. Estimated remaining: 13m 39s. Rate: 149.1 symbols/min [2025-09-22T22:15:46.873062] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:46.907345] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:15:46.913436] [INFO ] [MAIN ] AJG: Generated 1793 derivative records from 47141 primary records. [2025-09-22T22:15:46.913607] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-22T22:15:46.912579] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:46.915182] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 45691 primary records. [2025-09-22T22:15:46.915526] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-22T22:15:46.949184] [DEBUG] [LOCAL ] AJG: Derivative data saved (1793 records). [2025-09-22T22:15:46.950830] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-22T22:15:46.952792] [INFO ] [MAIN ] Derivative Progress: 56/2091 symbols completed. AJG took 1.1s. Estimated remaining: 13m 27s. Rate: 151.3 symbols/min [2025-09-22T22:15:46.953213] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:46.961922] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-09-22T22:15:46.974004] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-22T22:15:46.976522] [INFO ] [MAIN ] Derivative Progress: 57/2091 symbols completed. AKR took 1.1s. Estimated remaining: 13m 14s. Rate: 153.8 symbols/min [2025-09-22T22:15:46.976912] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:46.978294] [DEBUG] [LOCAL ] AL: Loaded 44012 existing records from primary storage. [2025-09-22T22:15:46.978777] [INFO ] [MAIN ] AL: Loaded 44012 primary data records. [2025-09-22T22:15:47.384205] [DEBUG] [LOCAL ] ALC: Loaded 50771 existing records from primary storage. [2025-09-22T22:15:47.385517] [DEBUG] [LOCAL ] ALB: Loaded 53228 existing records from primary storage. [2025-09-22T22:15:47.386896] [INFO ] [MAIN ] ALB: Loaded 53228 primary data records. [2025-09-22T22:15:47.386809] [INFO ] [MAIN ] ALC: Loaded 50771 primary data records. [2025-09-22T22:15:48.022035] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:48.023466] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44012 primary records. [2025-09-22T22:15:48.024505] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-22T22:15:48.043168] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-09-22T22:15:48.043371] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-22T22:15:48.045489] [INFO ] [MAIN ] Derivative Progress: 58/2091 symbols completed. AL took 1.2s. Estimated remaining: 13m 37s. Rate: 149.3 symbols/min [2025-09-22T22:15:48.063545] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:48.065529] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53228 primary records. [2025-09-22T22:15:48.065741] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-22T22:15:48.078689] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:48.079458] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 50771 primary records. [2025-09-22T22:15:48.086555] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-22T22:15:48.107143] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-09-22T22:15:48.108009] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-22T22:15:48.110674] [INFO ] [MAIN ] Derivative Progress: 59/2091 symbols completed. ALB took 1.2s. Estimated remaining: 13m 25s. Rate: 151.5 symbols/min [2025-09-22T22:15:48.112039] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-09-22T22:15:48.112102] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-22T22:15:48.114264] [INFO ] [MAIN ] Derivative Progress: 60/2091 symbols completed. ALC took 1.1s. Estimated remaining: 13m 11s. Rate: 154.0 symbols/min [2025-09-22T22:15:48.114758] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:48.115078] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:48.115219] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:48.129314] [DEBUG] [LOCAL ] ALG: Loaded 10523 existing records from primary storage. [2025-09-22T22:15:48.129581] [INFO ] [MAIN ] ALG: Loaded 10523 primary data records. [2025-09-22T22:15:48.315426] [DEBUG] [LOCAL ] ALEX: Loaded 31417 existing records from primary storage. [2025-09-22T22:15:48.326425] [INFO ] [MAIN ] ALEX: Loaded 31417 primary data records. [2025-09-22T22:15:48.326228] [DEBUG] [LOCAL ] ALE: Loaded 30184 existing records from primary storage. [2025-09-22T22:15:48.339437] [INFO ] [MAIN ] ALE: Loaded 30184 primary data records. [2025-09-22T22:15:49.207348] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:49.208995] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 10523 primary records. [2025-09-22T22:15:49.209091] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-22T22:15:49.230898] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-09-22T22:15:49.231837] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-22T22:15:49.234144] [INFO ] [MAIN ] Derivative Progress: 61/2091 symbols completed. ALG took 1.1s. Estimated remaining: 13m 35s. Rate: 149.4 symbols/min [2025-09-22T22:15:49.234582] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:49.248938] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:49.249765] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31417 primary records. [2025-09-22T22:15:49.250068] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-22T22:15:49.282736] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-09-22T22:15:49.283148] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:49.283301] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-22T22:15:49.284111] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 30184 primary records. [2025-09-22T22:15:49.284239] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-22T22:15:49.286352] [INFO ] [MAIN ] Derivative Progress: 62/2091 symbols completed. ALEX took 1.2s. Estimated remaining: 13m 23s. Rate: 151.5 symbols/min [2025-09-22T22:15:49.287430] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:49.303210] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-09-22T22:15:49.316471] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-22T22:15:49.319321] [INFO ] [MAIN ] Derivative Progress: 63/2091 symbols completed. ALE took 1.2s. Estimated remaining: 13m 11s. Rate: 153.8 symbols/min [2025-09-22T22:15:49.319844] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:49.340993] [DEBUG] [LOCAL ] ALIT: Loaded 52759 existing records from primary storage. [2025-09-22T22:15:49.341829] [INFO ] [MAIN ] ALIT: Loaded 52759 primary data records. [2025-09-22T22:15:49.571239] [DEBUG] [LOCAL ] ALK: Loaded 53078 existing records from primary storage. [2025-09-22T22:15:49.680539] [INFO ] [MAIN ] ALK: Loaded 53078 primary data records. [2025-09-22T22:15:49.736148] [DEBUG] [LOCAL ] ALL: Loaded 50217 existing records from primary storage. [2025-09-22T22:15:49.754006] [INFO ] [MAIN ] ALL: Loaded 50217 primary data records. [2025-09-22T22:15:50.373256] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:50.375189] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52759 primary records. [2025-09-22T22:15:50.376084] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-22T22:15:50.394183] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-09-22T22:15:50.394290] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-22T22:15:50.397865] [INFO ] [MAIN ] Derivative Progress: 64/2091 symbols completed. ALIT took 1.2s. Estimated remaining: 13m 33s. Rate: 149.7 symbols/min [2025-09-22T22:15:50.399058] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:50.421382] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:50.434958] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 50217 primary records. [2025-09-22T22:15:50.435182] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:50.435306] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-22T22:15:50.435967] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53078 primary records. [2025-09-22T22:15:50.436061] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-22T22:15:50.478932] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-09-22T22:15:50.480425] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-22T22:15:50.480300] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-09-22T22:15:50.480597] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-22T22:15:50.482972] [INFO ] [MAIN ] Derivative Progress: 65/2091 symbols completed. ALL took 1.2s. Estimated remaining: 13m 22s. Rate: 151.5 symbols/min [2025-09-22T22:15:50.485515] [INFO ] [MAIN ] Derivative Progress: 66/2091 symbols completed. ALK took 1.2s. Estimated remaining: 13m 10s. Rate: 153.8 symbols/min [2025-09-22T22:15:50.485829] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:50.485905] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:50.502919] [DEBUG] [LOCAL ] ALLE: Loaded 45317 existing records from primary storage. [2025-09-22T22:15:50.503154] [INFO ] [MAIN ] ALLE: Loaded 45317 primary data records. [2025-09-22T22:15:50.857199] [DEBUG] [LOCAL ] ALSN: Loaded 43348 existing records from primary storage. [2025-09-22T22:15:50.858844] [INFO ] [MAIN ] ALSN: Loaded 43348 primary data records. [2025-09-22T22:15:50.940849] [DEBUG] [LOCAL ] ALLY: Loaded 53218 existing records from primary storage. [2025-09-22T22:15:50.964427] [INFO ] [MAIN ] ALLY: Loaded 53218 primary data records. [2025-09-22T22:15:51.583757] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:51.584867] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 45317 primary records. [2025-09-22T22:15:51.584960] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-22T22:15:51.602118] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-09-22T22:15:51.602312] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-22T22:15:51.604481] [INFO ] [MAIN ] Derivative Progress: 67/2091 symbols completed. ALLE took 1.2s. Estimated remaining: 13m 32s. Rate: 149.6 symbols/min [2025-09-22T22:15:51.604962] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:51.624426] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:51.625309] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43348 primary records. [2025-09-22T22:15:51.625620] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-22T22:15:51.669164] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:51.670698] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53218 primary records. [2025-09-22T22:15:51.670829] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-09-22T22:15:51.670882] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-22T22:15:51.671670] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-22T22:15:51.674305] [DEBUG] [LOCAL ] ALTG: Loaded 24033 existing records from primary storage. [2025-09-22T22:15:51.674657] [INFO ] [MAIN ] ALTG: Loaded 24033 primary data records. [2025-09-22T22:15:51.673610] [INFO ] [MAIN ] Derivative Progress: 68/2091 symbols completed. ALSN took 1.2s. Estimated remaining: 13m 21s. Rate: 151.5 symbols/min [2025-09-22T22:15:51.696990] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:51.831461] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-09-22T22:15:51.868310] [DEBUG] [LOCAL ] ALUR: Loaded 10934 existing records from primary storage. [2025-09-22T22:15:51.900006] [INFO ] [MAIN ] ALUR: Loaded 10934 primary data records. [2025-09-22T22:15:51.899907] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-22T22:15:51.903752] [INFO ] [MAIN ] Derivative Progress: 69/2091 symbols completed. ALLY took 1.4s. Estimated remaining: 13m 16s. Rate: 152.4 symbols/min [2025-09-22T22:15:52.067982] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:52.361787] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:52.374166] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 24033 primary records. [2025-09-22T22:15:52.375458] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-22T22:15:52.377455] [DEBUG] [LOCAL ] ALV: Loaded 42725 existing records from primary storage. [2025-09-22T22:15:52.384216] [INFO ] [MAIN ] ALV: Loaded 42725 primary data records. [2025-09-22T22:15:52.393253] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-09-22T22:15:52.393354] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-22T22:15:52.466281] [INFO ] [MAIN ] Derivative Progress: 70/2091 symbols completed. ALTG took 0.9s. Estimated remaining: 13m 21s. Rate: 151.5 symbols/min [2025-09-22T22:15:52.513366] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:52.513736] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:52.519971] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 10934 primary records. [2025-09-22T22:15:52.525340] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-22T22:15:52.726244] [DEBUG] [LOCAL ] ALX: Loaded 5896 existing records from primary storage. [2025-09-22T22:15:52.726357] [INFO ] [MAIN ] ALX: Loaded 5896 primary data records. [2025-09-22T22:15:52.722938] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-09-22T22:15:52.747462] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-22T22:15:52.766044] [INFO ] [MAIN ] Derivative Progress: 71/2091 symbols completed. ALUR took 1.1s. Estimated remaining: 13m 17s. Rate: 152.0 symbols/min [2025-09-22T22:15:52.793318] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:53.080424] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:53.081324] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42725 primary records. [2025-09-22T22:15:53.081548] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-22T22:15:53.099872] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-09-22T22:15:53.100101] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-22T22:15:53.102272] [INFO ] [MAIN ] Derivative Progress: 72/2091 symbols completed. ALV took 1.0s. Estimated remaining: 13m 15s. Rate: 152.3 symbols/min [2025-09-22T22:15:53.116001] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:53.118255] [DEBUG] [LOCAL ] AM: Loaded 52159 existing records from primary storage. [2025-09-22T22:15:53.118473] [INFO ] [MAIN ] AM: Loaded 52159 primary data records. [2025-09-22T22:15:53.290007] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:53.306791] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 5896 primary records. [2025-09-22T22:15:53.330236] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-22T22:15:53.502462] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-09-22T22:15:53.503561] [DEBUG] [LOCAL ] AMBC: Loaded 37269 existing records from primary storage. [2025-09-22T22:15:53.502633] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-22T22:15:53.503708] [INFO ] [MAIN ] AMBC: Loaded 37269 primary data records. [2025-09-22T22:15:53.505977] [INFO ] [MAIN ] Derivative Progress: 73/2091 symbols completed. ALX took 1.0s. Estimated remaining: 13m 15s. Rate: 152.3 symbols/min [2025-09-22T22:15:53.826268] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:53.827373] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 52159 primary records. [2025-09-22T22:15:53.827455] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-22T22:15:53.844845] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-09-22T22:15:53.845053] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-22T22:15:53.847427] [INFO ] [MAIN ] Derivative Progress: 74/2091 symbols completed. AM took 1.1s. Estimated remaining: 13m 13s. Rate: 152.5 symbols/min [2025-09-22T22:15:53.863506] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:53.864141] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 37269 primary records. [2025-09-22T22:15:53.864203] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-22T22:15:53.879211] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-09-22T22:15:53.879331] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-22T22:15:53.881356] [INFO ] [MAIN ] Derivative Progress: 75/2091 symbols completed. AMBC took 0.8s. Estimated remaining: 13m 3s. Rate: 154.4 symbols/min [2025-09-22T22:15:53.882012] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:53.882226] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:53.882322] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:53.956141] [DEBUG] [LOCAL ] AMBP: Loaded 45371 existing records from primary storage. [2025-09-22T22:15:53.969529] [INFO ] [MAIN ] AMBP: Loaded 45371 primary data records. [2025-09-22T22:15:53.984471] [DEBUG] [LOCAL ] AMCR: Loaded 53668 existing records from primary storage. [2025-09-22T22:15:54.032964] [INFO ] [MAIN ] AMCR: Loaded 53668 primary data records. [2025-09-22T22:15:54.047025] [DEBUG] [LOCAL ] AMC: Loaded 53758 existing records from primary storage. [2025-09-22T22:15:54.119636] [INFO ] [MAIN ] AMC: Loaded 53758 primary data records. [2025-09-22T22:15:54.940137] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:54.943205] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 45371 primary records. [2025-09-22T22:15:54.943419] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-22T22:15:54.969286] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:54.972856] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53668 primary records. [2025-09-22T22:15:54.973478] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-22T22:15:54.984504] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-09-22T22:15:54.984618] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-22T22:15:54.998358] [INFO ] [MAIN ] Derivative Progress: 76/2091 symbols completed. AMBP took 1.1s. Estimated remaining: 13m 22s. Rate: 150.7 symbols/min [2025-09-22T22:15:54.999030] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:54.998788] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:55.003726] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53758 primary records. [2025-09-22T22:15:55.007480] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-22T22:15:55.009772] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-09-22T22:15:55.010043] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-22T22:15:55.012544] [INFO ] [MAIN ] Derivative Progress: 77/2091 symbols completed. AMCR took 1.1s. Estimated remaining: 13m 12s. Rate: 152.6 symbols/min [2025-09-22T22:15:55.019967] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:55.029498] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-09-22T22:15:55.029712] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-22T22:15:55.032173] [INFO ] [MAIN ] Derivative Progress: 78/2091 symbols completed. AMC took 1.1s. Estimated remaining: 13m 2s. Rate: 154.5 symbols/min [2025-09-22T22:15:55.032460] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:55.050085] [DEBUG] [LOCAL ] AMG: Loaded 20789 existing records from primary storage. [2025-09-22T22:15:55.050222] [INFO ] [MAIN ] AMG: Loaded 20789 primary data records. [2025-09-22T22:15:55.232988] [DEBUG] [LOCAL ] AME: Loaded 48548 existing records from primary storage. [2025-09-22T22:15:55.276703] [INFO ] [MAIN ] AME: Loaded 48548 primary data records. [2025-09-22T22:15:55.571782] [DEBUG] [LOCAL ] AMH: Loaded 51691 existing records from primary storage. [2025-09-22T22:15:55.591346] [INFO ] [MAIN ] AMH: Loaded 51691 primary data records. [2025-09-22T22:15:56.077055] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:56.078196] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20789 primary records. [2025-09-22T22:15:56.078568] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-22T22:15:56.100626] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-09-22T22:15:56.101028] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-22T22:15:56.103171] [INFO ] [MAIN ] Derivative Progress: 79/2091 symbols completed. AMG took 1.1s. Estimated remaining: 13m 19s. Rate: 151.1 symbols/min [2025-09-22T22:15:56.103861] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:56.118686] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:56.119942] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48548 primary records. [2025-09-22T22:15:56.120342] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-22T22:15:56.142907] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-09-22T22:15:56.143301] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-22T22:15:56.154148] [INFO ] [MAIN ] Derivative Progress: 80/2091 symbols completed. AME took 1.2s. Estimated remaining: 13m 10s. Rate: 152.8 symbols/min [2025-09-22T22:15:56.159929] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:56.161237] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51691 primary records. [2025-09-22T22:15:56.160297] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:56.161710] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-22T22:15:56.188547] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-09-22T22:15:56.188883] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-22T22:15:56.192048] [INFO ] [MAIN ] Derivative Progress: 81/2091 symbols completed. AMH took 1.2s. Estimated remaining: 13m 1s. Rate: 154.5 symbols/min [2025-09-22T22:15:56.192534] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:56.208697] [DEBUG] [LOCAL ] AMN: Loaded 42032 existing records from primary storage. [2025-09-22T22:15:56.209049] [INFO ] [MAIN ] AMN: Loaded 42032 primary data records. [2025-09-22T22:15:56.433146] [DEBUG] [LOCAL ] AMP: Loaded 32634 existing records from primary storage. [2025-09-22T22:15:56.543516] [INFO ] [MAIN ] AMP: Loaded 32634 primary data records. [2025-09-22T22:15:56.678453] [DEBUG] [LOCAL ] AMPX: Loaded 52158 existing records from primary storage. [2025-09-22T22:15:56.679082] [INFO ] [MAIN ] AMPX: Loaded 52158 primary data records. [2025-09-22T22:15:57.260849] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:57.262017] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 42032 primary records. [2025-09-22T22:15:57.262332] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-22T22:15:57.283861] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-09-22T22:15:57.284731] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-22T22:15:57.286773] [INFO ] [MAIN ] Derivative Progress: 82/2091 symbols completed. AMN took 1.2s. Estimated remaining: 13m 17s. Rate: 151.2 symbols/min [2025-09-22T22:15:57.287550] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:57.306013] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:57.307130] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32634 primary records. [2025-09-22T22:15:57.307427] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-22T22:15:57.339962] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:57.341883] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52158 primary records. [2025-09-22T22:15:57.343523] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-09-22T22:15:57.353129] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-22T22:15:57.352999] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-22T22:15:57.355989] [INFO ] [MAIN ] Derivative Progress: 83/2091 symbols completed. AMP took 1.2s. Estimated remaining: 13m 9s. Rate: 152.7 symbols/min [2025-09-22T22:15:57.356698] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:57.386540] [DEBUG] [LOCAL ] AMPY: Loaded 37411 existing records from primary storage. [2025-09-22T22:15:57.387202] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-09-22T22:15:57.387314] [INFO ] [MAIN ] AMPY: Loaded 37411 primary data records. [2025-09-22T22:15:57.387489] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-22T22:15:57.414096] [INFO ] [MAIN ] Derivative Progress: 84/2091 symbols completed. AMPX took 1.2s. Estimated remaining: 13m 1s. Rate: 154.2 symbols/min [2025-09-22T22:15:57.434377] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:57.699714] [DEBUG] [LOCAL ] AMR: Loaded 29089 existing records from primary storage. [2025-09-22T22:15:57.713247] [INFO ] [MAIN ] AMR: Loaded 29089 primary data records. [2025-09-22T22:15:57.932227] [DEBUG] [LOCAL ] AMRC: Loaded 38463 existing records from primary storage. [2025-09-22T22:15:58.044688] [INFO ] [MAIN ] AMRC: Loaded 38463 primary data records. [2025-09-22T22:15:58.381123] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:58.383902] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 37411 primary records. [2025-09-22T22:15:58.384240] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-22T22:15:58.403546] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-09-22T22:15:58.403828] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-22T22:15:58.406191] [INFO ] [MAIN ] Derivative Progress: 85/2091 symbols completed. AMPY took 1.1s. Estimated remaining: 13m 15s. Rate: 151.5 symbols/min [2025-09-22T22:15:58.407098] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:58.425243] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:58.426131] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 29089 primary records. [2025-09-22T22:15:58.426371] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-22T22:15:58.443797] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-09-22T22:15:58.443885] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-22T22:15:58.446123] [INFO ] [MAIN ] Derivative Progress: 86/2091 symbols completed. AMR took 1.1s. Estimated remaining: 13m 6s. Rate: 153.1 symbols/min [2025-09-22T22:15:58.448308] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:58.462971] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:58.463680] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38463 primary records. [2025-09-22T22:15:58.463843] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-22T22:15:58.493576] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-09-22T22:15:58.498491] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-22T22:15:58.500771] [INFO ] [MAIN ] Derivative Progress: 87/2091 symbols completed. AMRC took 1.1s. Estimated remaining: 12m 58s. Rate: 154.6 symbols/min [2025-09-22T22:15:58.501143] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:58.511691] [DEBUG] [LOCAL ] AMTB: Loaded 20461 existing records from primary storage. [2025-09-22T22:15:58.512752] [INFO ] [MAIN ] AMTB: Loaded 20461 primary data records. [2025-09-22T22:15:58.515354] [DEBUG] [LOCAL ] AMTD: Loaded 3554 existing records from primary storage. [2025-09-22T22:15:58.515627] [INFO ] [MAIN ] AMTD: Loaded 3554 primary data records. [2025-09-22T22:15:58.634792] [DEBUG] [LOCAL ] AMT: Loaded 52455 existing records from primary storage. [2025-09-22T22:15:58.672258] [INFO ] [MAIN ] AMT: Loaded 52455 primary data records. [2025-09-22T22:15:59.557381] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:59.558262] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:59.559383] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20461 primary records. [2025-09-22T22:15:59.559532] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-22T22:15:59.560458] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3554 primary records. [2025-09-22T22:15:59.563357] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-22T22:15:59.588277] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-09-22T22:15:59.604388] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-22T22:15:59.606942] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:15:59.610716] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52455 primary records. [2025-09-22T22:15:59.611143] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-22T22:15:59.611249] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-09-22T22:15:59.609210] [INFO ] [MAIN ] Derivative Progress: 88/2091 symbols completed. AMTB took 1.2s. Estimated remaining: 13m 14s. Rate: 151.4 symbols/min [2025-09-22T22:15:59.611667] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-22T22:15:59.614276] [INFO ] [MAIN ] Derivative Progress: 89/2091 symbols completed. AMTD took 1.1s. Estimated remaining: 13m 5s. Rate: 153.1 symbols/min [2025-09-22T22:15:59.629972] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-09-22T22:15:59.630034] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-22T22:15:59.633594] [INFO ] [MAIN ] Derivative Progress: 90/2091 symbols completed. AMT took 1.2s. Estimated remaining: 12m 56s. Rate: 154.7 symbols/min [2025-09-22T22:15:59.634976] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:59.634803] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:59.634637] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:15:59.647203] [DEBUG] [LOCAL ] AMWL: Loaded 8612 existing records from primary storage. [2025-09-22T22:15:59.647428] [INFO ] [MAIN ] AMWL: Loaded 8612 primary data records. [2025-09-22T22:15:59.993251] [DEBUG] [LOCAL ] AMX: Loaded 49133 existing records from primary storage. [2025-09-22T22:15:59.994595] [INFO ] [MAIN ] AMX: Loaded 49133 primary data records. [2025-09-22T22:16:00.065206] [DEBUG] [LOCAL ] AMTM: Loaded 50777 existing records from primary storage. [2025-09-22T22:16:00.079539] [INFO ] [MAIN ] AMTM: Loaded 50777 primary data records. [2025-09-22T22:16:00.643049] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:00.644153] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 8612 primary records. [2025-09-22T22:16:00.644334] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-22T22:16:00.663151] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-09-22T22:16:00.663557] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-22T22:16:00.666119] [INFO ] [MAIN ] Derivative Progress: 91/2091 symbols completed. AMWL took 1.0s. Estimated remaining: 13m 10s. Rate: 152.0 symbols/min [2025-09-22T22:16:00.666373] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:00.684666] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:00.685406] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49133 primary records. [2025-09-22T22:16:00.685790] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-22T22:16:00.713113] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-09-22T22:16:00.718853] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-22T22:16:00.719083] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:00.728258] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50777 primary records. [2025-09-22T22:16:00.730395] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-22T22:16:00.730281] [INFO ] [MAIN ] Derivative Progress: 92/2091 symbols completed. AMX took 1.1s. Estimated remaining: 13m 2s. Rate: 153.4 symbols/min [2025-09-22T22:16:00.738897] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:00.751066] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-09-22T22:16:00.760061] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-22T22:16:00.763663] [INFO ] [MAIN ] Derivative Progress: 93/2091 symbols completed. AMTM took 1.1s. Estimated remaining: 12m 54s. Rate: 154.9 symbols/min [2025-09-22T22:16:00.764138] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:00.765167] [DEBUG] [LOCAL ] AN: Loaded 32596 existing records from primary storage. [2025-09-22T22:16:00.765438] [INFO ] [MAIN ] AN: Loaded 32596 primary data records. [2025-09-22T22:16:01.130123] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-22T22:16:01.130880] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-09-22T22:16:01.202699] [DEBUG] [LOCAL ] ANF: Loaded 52264 existing records from primary storage. [2025-09-22T22:16:01.224764] [INFO ] [MAIN ] ANF: Loaded 52264 primary data records. [2025-09-22T22:16:01.871157] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:01.872159] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 32596 primary records. [2025-09-22T22:16:01.872466] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-22T22:16:01.893733] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-09-22T22:16:01.894225] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-22T22:16:01.896250] [INFO ] [MAIN ] Derivative Progress: 94/2091 symbols completed. AN took 1.2s. Estimated remaining: 13m 9s. Rate: 151.8 symbols/min [2025-09-22T22:16:01.901253] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:01.916447] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:01.917602] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-09-22T22:16:01.917905] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-22T22:16:01.950920] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-09-22T22:16:01.951106] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-22T22:16:01.953750] [INFO ] [MAIN ] Derivative Progress: 95/2091 symbols completed. ANET took 1.2s. Estimated remaining: 13m 2s. Rate: 153.2 symbols/min [2025-09-22T22:16:01.954445] [DEBUG] [LOCAL ] ANRO: Loaded 19673 existing records from primary storage. [2025-09-22T22:16:01.967843] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:01.967759] [INFO ] [MAIN ] ANRO: Loaded 19673 primary data records. [2025-09-22T22:16:01.980541] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:01.995738] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52264 primary records. [2025-09-22T22:16:02.008732] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-22T22:16:02.168885] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-09-22T22:16:02.169739] [DEBUG] [LOCAL ] ANVS: Loaded 23209 existing records from primary storage. [2025-09-22T22:16:02.170027] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-22T22:16:02.192467] [INFO ] [MAIN ] Derivative Progress: 96/2091 symbols completed. ANF took 1.4s. Estimated remaining: 12m 58s. Rate: 153.8 symbols/min [2025-09-22T22:16:02.192748] [INFO ] [MAIN ] ANVS: Loaded 23209 primary data records. [2025-09-22T22:16:02.313454] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:02.662412] [DEBUG] [LOCAL ] AOD: Loaded 30300 existing records from primary storage. [2025-09-22T22:16:02.662924] [INFO ] [MAIN ] AOD: Loaded 30300 primary data records. [2025-09-22T22:16:02.793783] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:16:02.795865] [INFO ] [MAIN ] ANRO: Generated 1793 derivative records from 19673 primary records. [2025-09-22T22:16:02.806485] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-22T22:16:03.015756] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1793 records). [2025-09-22T22:16:03.017040] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-22T22:16:03.020484] [INFO ] [MAIN ] Derivative Progress: 97/2091 symbols completed. ANRO took 1.1s. Estimated remaining: 13m 7s. Rate: 152.0 symbols/min [2025-09-22T22:16:03.022950] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:03.039701] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:03.040822] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23209 primary records. [2025-09-22T22:16:03.041075] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-22T22:16:03.072268] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-09-22T22:16:03.072920] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-22T22:16:03.074985] [INFO ] [MAIN ] Derivative Progress: 98/2091 symbols completed. ANVS took 1.1s. Estimated remaining: 12m 60s. Rate: 153.4 symbols/min [2025-09-22T22:16:03.072764] [DEBUG] [LOCAL ] AOMR: Loaded 16786 existing records from primary storage. [2025-09-22T22:16:03.075716] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:03.076907] [INFO ] [MAIN ] AOMR: Loaded 16786 primary data records. [2025-09-22T22:16:03.187827] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:03.216869] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30300 primary records. [2025-09-22T22:16:03.217194] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-22T22:16:03.494301] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-09-22T22:16:03.494815] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-22T22:16:03.497913] [INFO ] [MAIN ] Derivative Progress: 99/2091 symbols completed. AOD took 1.2s. Estimated remaining: 12m 60s. Rate: 153.3 symbols/min [2025-09-22T22:16:03.511349] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:03.515457] [DEBUG] [LOCAL ] AON: Loaded 45635 existing records from primary storage. [2025-09-22T22:16:03.515906] [INFO ] [MAIN ] AON: Loaded 45635 primary data records. [2025-09-22T22:16:03.852478] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:03.854456] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16786 primary records. [2025-09-22T22:16:03.854720] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-22T22:16:03.887779] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-09-22T22:16:03.888698] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-22T22:16:03.886417] [DEBUG] [LOCAL ] AOS: Loaded 49320 existing records from primary storage. [2025-09-22T22:16:03.891319] [INFO ] [MAIN ] Derivative Progress: 100/2091 symbols completed. AOMR took 0.9s. Estimated remaining: 12m 60s. Rate: 153.2 symbols/min [2025-09-22T22:16:03.891789] [INFO ] [MAIN ] AOS: Loaded 49320 primary data records. [2025-09-22T22:16:03.892343] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:04.011448] [DEBUG] [LOCAL ] AP: Loaded 6931 existing records from primary storage. [2025-09-22T22:16:04.017836] [INFO ] [MAIN ] AP: Loaded 6931 primary data records. [2025-09-22T22:16:04.278566] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:04.301871] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45635 primary records. [2025-09-22T22:16:04.316151] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-22T22:16:04.419848] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-09-22T22:16:04.420038] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-22T22:16:04.445737] [INFO ] [MAIN ] Derivative Progress: 101/2091 symbols completed. AON took 1.4s. Estimated remaining: 13m 2s. Rate: 152.6 symbols/min [2025-09-22T22:16:04.563505] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:04.594127] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:04.595428] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 49320 primary records. [2025-09-22T22:16:04.595881] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-22T22:16:04.623874] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-09-22T22:16:04.624008] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-22T22:16:04.626240] [INFO ] [MAIN ] Derivative Progress: 102/2091 symbols completed. AOS took 1.1s. Estimated remaining: 12m 58s. Rate: 153.4 symbols/min [2025-09-22T22:16:04.628114] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:04.645038] [DEBUG] [LOCAL ] APAM: Loaded 36619 existing records from primary storage. [2025-09-22T22:16:04.645460] [INFO ] [MAIN ] APAM: Loaded 36619 primary data records. [2025-09-22T22:16:04.670085] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:04.671004] [INFO ] [MAIN ] AP: Generated 1794 derivative records from 6931 primary records. [2025-09-22T22:16:04.691983] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-22T22:16:04.868914] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-09-22T22:16:04.869119] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-22T22:16:04.971849] [INFO ] [MAIN ] Derivative Progress: 103/2091 symbols completed. AP took 1.1s. Estimated remaining: 12m 57s. Rate: 153.6 symbols/min [2025-09-22T22:16:04.999555] [DEBUG] [LOCAL ] APD: Loaded 45375 existing records from primary storage. [2025-09-22T22:16:04.999731] [INFO ] [MAIN ] APD: Loaded 45375 primary data records. [2025-09-22T22:16:05.328456] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:05.329605] [INFO ] [MAIN ] APAM: Generated 1794 derivative records from 36619 primary records. [2025-09-22T22:16:05.329713] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-22T22:16:05.347199] [DEBUG] [LOCAL ] APAM: Derivative data saved (1794 records). [2025-09-22T22:16:05.347500] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-22T22:16:05.349773] [INFO ] [MAIN ] Derivative Progress: 104/2091 symbols completed. APAM took 0.8s. Estimated remaining: 12m 56s. Rate: 153.7 symbols/min [2025-09-22T22:16:05.365800] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:05.366332] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45375 primary records. [2025-09-22T22:16:05.366392] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-22T22:16:05.381576] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-09-22T22:16:05.381634] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-22T22:16:05.383839] [INFO ] [MAIN ] Derivative Progress: 105/2091 symbols completed. APD took 0.8s. Estimated remaining: 12m 49s. Rate: 155.0 symbols/min [2025-09-22T22:16:05.384605] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:05.384931] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:05.385176] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:05.476433] [DEBUG] [LOCAL ] APG: Loaded 50234 existing records from primary storage. [2025-09-22T22:16:05.478528] [INFO ] [MAIN ] APG: Loaded 50234 primary data records. [2025-09-22T22:16:05.479943] [DEBUG] [LOCAL ] APLE: Loaded 52036 existing records from primary storage. [2025-09-22T22:16:05.571466] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-22T22:16:05.550367] [INFO ] [MAIN ] APLE: Loaded 52036 primary data records. [2025-09-22T22:16:05.581929] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-09-22T22:16:06.480367] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:06.481549] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50234 primary records. [2025-09-22T22:16:06.482574] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-22T22:16:06.499530] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:06.509040] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-09-22T22:16:06.511968] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-22T22:16:06.537376] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:16:06.543220] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-09-22T22:16:06.548470] [INFO ] [MAIN ] APLE: Generated 1793 derivative records from 52036 primary records. [2025-09-22T22:16:06.547839] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-09-22T22:16:06.548850] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-22T22:16:06.548700] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-22T22:16:06.550830] [INFO ] [MAIN ] Derivative Progress: 106/2091 symbols completed. APG took 1.2s. Estimated remaining: 13m 3s. Rate: 152.1 symbols/min [2025-09-22T22:16:06.551191] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-22T22:16:06.551108] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:06.554329] [INFO ] [MAIN ] Derivative Progress: 107/2091 symbols completed. APH took 1.2s. Estimated remaining: 12m 55s. Rate: 153.5 symbols/min [2025-09-22T22:16:06.562857] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:06.575604] [DEBUG] [LOCAL ] APLE: Derivative data saved (1793 records). [2025-09-22T22:16:06.575754] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-22T22:16:06.578319] [INFO ] [MAIN ] Derivative Progress: 108/2091 symbols completed. APLE took 1.2s. Estimated remaining: 12m 48s. Rate: 154.9 symbols/min [2025-09-22T22:16:06.582908] [DEBUG] [LOCAL ] APOS: Loaded 7486 existing records from primary storage. [2025-09-22T22:16:06.583239] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:06.583586] [INFO ] [MAIN ] APOS: Loaded 7486 primary data records. [2025-09-22T22:16:06.957015] [DEBUG] [LOCAL ] APO: Loaded 53386 existing records from primary storage. [2025-09-22T22:16:06.957821] [INFO ] [MAIN ] APO: Loaded 53386 primary data records. [2025-09-22T22:16:07.081137] [DEBUG] [LOCAL ] APTV: Loaded 52232 existing records from primary storage. [2025-09-22T22:16:07.081486] [INFO ] [MAIN ] APTV: Loaded 52232 primary data records. [2025-09-22T22:16:07.797094] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:07.798329] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7486 primary records. [2025-09-22T22:16:07.798556] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-22T22:16:07.826607] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-09-22T22:16:07.827743] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-22T22:16:07.829854] [INFO ] [MAIN ] Derivative Progress: 109/2091 symbols completed. APOS took 1.3s. Estimated remaining: 13m 4s. Rate: 151.8 symbols/min [2025-09-22T22:16:07.830412] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:07.859486] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:07.860603] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53386 primary records. [2025-09-22T22:16:07.862383] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-22T22:16:07.901474] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:07.905289] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52232 primary records. [2025-09-22T22:16:07.906804] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-09-22T22:16:07.906921] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-22T22:16:07.907180] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-22T22:16:07.911141] [INFO ] [MAIN ] Derivative Progress: 110/2091 symbols completed. APO took 1.4s. Estimated remaining: 12m 58s. Rate: 152.9 symbols/min [2025-09-22T22:16:07.944124] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:07.959590] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-09-22T22:16:07.959994] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-22T22:16:07.963836] [INFO ] [MAIN ] Derivative Progress: 111/2091 symbols completed. APTV took 1.4s. Estimated remaining: 12m 51s. Rate: 154.1 symbols/min [2025-09-22T22:16:07.964460] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:07.987990] [DEBUG] [LOCAL ] AQN: Loaded 51958 existing records from primary storage. [2025-09-22T22:16:07.988450] [INFO ] [MAIN ] AQN: Loaded 51958 primary data records. [2025-09-22T22:16:08.290439] [DEBUG] [LOCAL ] AR: Loaded 53585 existing records from primary storage. [2025-09-22T22:16:08.302270] [INFO ] [MAIN ] AR: Loaded 53585 primary data records. [2025-09-22T22:16:08.390325] [DEBUG] [LOCAL ] ARCO: Loaded 44673 existing records from primary storage. [2025-09-22T22:16:08.582337] [INFO ] [MAIN ] ARCO: Loaded 44673 primary data records. [2025-09-22T22:16:09.223005] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:09.224618] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51958 primary records. [2025-09-22T22:16:09.224938] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-22T22:16:09.243894] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-09-22T22:16:09.244411] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-22T22:16:09.246500] [INFO ] [MAIN ] Derivative Progress: 112/2091 symbols completed. AQN took 1.4s. Estimated remaining: 13m 6s. Rate: 151.0 symbols/min [2025-09-22T22:16:09.246940] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:09.266784] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:09.268523] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53585 primary records. [2025-09-22T22:16:09.268729] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-22T22:16:09.298146] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:09.300160] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44673 primary records. [2025-09-22T22:16:09.306268] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-22T22:16:09.308409] [DEBUG] [LOCAL ] ARDC: Loaded 14387 existing records from primary storage. [2025-09-22T22:16:09.309242] [INFO ] [MAIN ] ARDC: Loaded 14387 primary data records. [2025-09-22T22:16:09.366260] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-09-22T22:16:09.379749] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-22T22:16:09.403213] [INFO ] [MAIN ] Derivative Progress: 113/2091 symbols completed. AR took 1.5s. Estimated remaining: 13m 2s. Rate: 151.8 symbols/min [2025-09-22T22:16:09.414271] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:09.423190] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-09-22T22:16:09.431235] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-22T22:16:09.437314] [INFO ] [MAIN ] Derivative Progress: 114/2091 symbols completed. ARCO took 1.5s. Estimated remaining: 12m 55s. Rate: 153.0 symbols/min [2025-09-22T22:16:09.438024] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:09.660369] [DEBUG] [LOCAL ] ARDT: Loaded 28318 existing records from primary storage. [2025-09-22T22:16:09.660761] [INFO ] [MAIN ] ARDT: Loaded 28318 primary data records. [2025-09-22T22:16:10.040296] [DEBUG] [LOCAL ] ARES: Loaded 49656 existing records from primary storage. [2025-09-22T22:16:10.040762] [INFO ] [MAIN ] ARES: Loaded 49656 primary data records. [2025-09-22T22:16:10.135071] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:10.162231] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 14387 primary records. [2025-09-22T22:16:10.162346] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-22T22:16:10.276062] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-09-22T22:16:10.276379] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-22T22:16:10.278461] [INFO ] [MAIN ] Derivative Progress: 115/2091 symbols completed. ARDC took 1.0s. Estimated remaining: 13m 2s. Rate: 151.5 symbols/min [2025-09-22T22:16:10.389473] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:10.422499] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:10.423979] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 28318 primary records. [2025-09-22T22:16:10.424738] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-22T22:16:10.443996] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-09-22T22:16:10.444290] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-22T22:16:10.456764] [INFO ] [MAIN ] Derivative Progress: 116/2091 symbols completed. ARDT took 1.0s. Estimated remaining: 12m 58s. Rate: 152.2 symbols/min [2025-09-22T22:16:10.457543] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:10.476579] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:10.477557] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49656 primary records. [2025-09-22T22:16:10.488685] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-22T22:16:10.491810] [DEBUG] [LOCAL ] ARI: Loaded 43335 existing records from primary storage. [2025-09-22T22:16:10.492163] [INFO ] [MAIN ] ARI: Loaded 43335 primary data records. [2025-09-22T22:16:10.586826] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-09-22T22:16:10.628554] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-22T22:16:10.634906] [INFO ] [MAIN ] Derivative Progress: 117/2091 symbols completed. ARES took 1.2s. Estimated remaining: 12m 54s. Rate: 153.0 symbols/min [2025-09-22T22:16:10.646303] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:10.838238] [DEBUG] [LOCAL ] ARIS: Loaded 41970 existing records from primary storage. [2025-09-22T22:16:10.848468] [INFO ] [MAIN ] ARIS: Loaded 41970 primary data records. [2025-09-22T22:16:11.197913] [DEBUG] [LOCAL ] ARLO: Loaded 43987 existing records from primary storage. [2025-09-22T22:16:11.213501] [INFO ] [MAIN ] ARLO: Loaded 43987 primary data records. [2025-09-22T22:16:11.423293] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:11.425394] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43335 primary records. [2025-09-22T22:16:11.425617] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-22T22:16:11.565351] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-09-22T22:16:11.566183] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-22T22:16:11.568612] [INFO ] [MAIN ] Derivative Progress: 118/2091 symbols completed. ARI took 1.3s. Estimated remaining: 13m 3s. Rate: 151.2 symbols/min [2025-09-22T22:16:11.588120] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:11.589254] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 41970 primary records. [2025-09-22T22:16:11.589361] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-22T22:16:11.609602] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-09-22T22:16:11.622230] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-22T22:16:11.624544] [INFO ] [MAIN ] Derivative Progress: 119/2091 symbols completed. ARIS took 1.2s. Estimated remaining: 12m 57s. Rate: 152.3 symbols/min [2025-09-22T22:16:11.622459] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:11.625528] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43987 primary records. [2025-09-22T22:16:11.625635] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-22T22:16:11.641568] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-09-22T22:16:11.641748] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-22T22:16:11.643912] [INFO ] [MAIN ] Derivative Progress: 120/2091 symbols completed. ARLO took 1.0s. Estimated remaining: 12m 50s. Rate: 153.5 symbols/min [2025-09-22T22:16:11.644850] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:11.644775] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:11.645022] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:11.706405] [DEBUG] [LOCAL ] ARW: Loaded 33224 existing records from primary storage. [2025-09-22T22:16:11.706624] [INFO ] [MAIN ] ARW: Loaded 33224 primary data records. [2025-09-22T22:16:11.836143] [DEBUG] [LOCAL ] AROC: Loaded 48989 existing records from primary storage. [2025-09-22T22:16:11.866300] [INFO ] [MAIN ] AROC: Loaded 48989 primary data records. [2025-09-22T22:16:11.932999] [DEBUG] [LOCAL ] ARR: Loaded 52064 existing records from primary storage. [2025-09-22T22:16:12.092843] [INFO ] [MAIN ] ARR: Loaded 52064 primary data records. [2025-09-22T22:16:12.744131] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:12.746239] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33224 primary records. [2025-09-22T22:16:12.746430] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-22T22:16:12.769295] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-09-22T22:16:12.770345] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-22T22:16:12.772149] [INFO ] [MAIN ] Derivative Progress: 121/2091 symbols completed. ARW took 1.1s. Estimated remaining: 13m 2s. Rate: 151.1 symbols/min [2025-09-22T22:16:12.772809] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:12.787813] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:12.789818] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 48989 primary records. [2025-09-22T22:16:12.789996] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-22T22:16:12.818961] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:12.820202] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52064 primary records. [2025-09-22T22:16:12.820520] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-22T22:16:12.827299] [DEBUG] [LOCAL ] ASA: Loaded 13639 existing records from primary storage. [2025-09-22T22:16:12.827403] [INFO ] [MAIN ] ASA: Loaded 13639 primary data records. [2025-09-22T22:16:12.924315] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-09-22T22:16:12.943264] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-22T22:16:12.955738] [INFO ] [MAIN ] Derivative Progress: 122/2091 symbols completed. ARR took 1.3s. Estimated remaining: 12m 58s. Rate: 151.8 symbols/min [2025-09-22T22:16:12.957064] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:12.956630] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-09-22T22:16:12.972823] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-22T22:16:12.976147] [INFO ] [MAIN ] Derivative Progress: 123/2091 symbols completed. AROC took 1.3s. Estimated remaining: 12m 52s. Rate: 153.0 symbols/min [2025-09-22T22:16:13.000126] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:13.196689] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:13.197498] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 13639 primary records. [2025-09-22T22:16:13.197869] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-22T22:16:13.224499] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-09-22T22:16:13.238662] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-22T22:16:13.241193] [INFO ] [MAIN ] Derivative Progress: 124/2091 symbols completed. ASA took 0.5s. Estimated remaining: 12m 49s. Rate: 153.4 symbols/min [2025-09-22T22:16:13.241696] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:13.242741] [DEBUG] [LOCAL ] ASAN: Loaded 52755 existing records from primary storage. [2025-09-22T22:16:13.242912] [INFO ] [MAIN ] ASAN: Loaded 52755 primary data records. [2025-09-22T22:16:13.302122] [DEBUG] [LOCAL ] ASB: Loaded 49584 existing records from primary storage. [2025-09-22T22:16:13.328987] [INFO ] [MAIN ] ASB: Loaded 49584 primary data records. [2025-09-22T22:16:13.365386] [DEBUG] [LOCAL ] ASBA: Loaded 3446 existing records from primary storage. [2025-09-22T22:16:13.376279] [INFO ] [MAIN ] ASBA: Loaded 3446 primary data records. [2025-09-22T22:16:14.268460] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:14.269865] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52755 primary records. [2025-09-22T22:16:14.270307] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-22T22:16:14.307784] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:14.310200] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3446 primary records. [2025-09-22T22:16:14.319181] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-09-22T22:16:14.324610] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-22T22:16:14.325917] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:14.325205] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-22T22:16:14.326942] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49584 primary records. [2025-09-22T22:16:14.327963] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-22T22:16:14.330064] [INFO ] [MAIN ] Derivative Progress: 125/2091 symbols completed. ASAN took 1.4s. Estimated remaining: 12m 60s. Rate: 151.2 symbols/min [2025-09-22T22:16:14.349465] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:14.361776] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-09-22T22:16:14.362501] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-22T22:16:14.365199] [INFO ] [MAIN ] Derivative Progress: 126/2091 symbols completed. ASBA took 1.1s. Estimated remaining: 12m 54s. Rate: 152.3 symbols/min [2025-09-22T22:16:14.366420] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:14.367561] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-09-22T22:16:14.367691] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-22T22:16:14.369714] [INFO ] [MAIN ] Derivative Progress: 127/2091 symbols completed. ASB took 1.4s. Estimated remaining: 12m 48s. Rate: 153.5 symbols/min [2025-09-22T22:16:14.370054] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:14.402213] [DEBUG] [LOCAL ] ASG: Loaded 20751 existing records from primary storage. [2025-09-22T22:16:14.406898] [INFO ] [MAIN ] ASG: Loaded 20751 primary data records. [2025-09-22T22:16:14.476857] [DEBUG] [LOCAL ] ASC: Loaded 37878 existing records from primary storage. [2025-09-22T22:16:14.486057] [INFO ] [MAIN ] ASC: Loaded 37878 primary data records. [2025-09-22T22:16:14.518047] [DEBUG] [LOCAL ] ASGI: Loaded 22400 existing records from primary storage. [2025-09-22T22:16:14.603574] [INFO ] [MAIN ] ASGI: Loaded 22400 primary data records. [2025-09-22T22:16:15.422540] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:15.436709] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 20751 primary records. [2025-09-22T22:16:15.435735] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:15.436850] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-22T22:16:15.437972] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37878 primary records. [2025-09-22T22:16:15.438149] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-22T22:16:15.480528] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:15.483059] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22400 primary records. [2025-09-22T22:16:15.483539] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-22T22:16:15.501115] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-09-22T22:16:15.502257] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-22T22:16:15.504611] [INFO ] [MAIN ] Derivative Progress: 128/2091 symbols completed. ASC took 1.2s. Estimated remaining: 12m 59s. Rate: 151.3 symbols/min [2025-09-22T22:16:15.501016] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-09-22T22:16:15.505872] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:15.509830] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-09-22T22:16:15.509065] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-22T22:16:15.510111] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-22T22:16:15.512836] [INFO ] [MAIN ] Derivative Progress: 129/2091 symbols completed. ASG took 1.1s. Estimated remaining: 12m 52s. Rate: 152.4 symbols/min [2025-09-22T22:16:15.515701] [INFO ] [MAIN ] Derivative Progress: 130/2091 symbols completed. ASGI took 1.1s. Estimated remaining: 12m 46s. Rate: 153.6 symbols/min [2025-09-22T22:16:15.516105] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:15.516210] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:15.563386] [DEBUG] [LOCAL ] ASIX: Loaded 22422 existing records from primary storage. [2025-09-22T22:16:15.563725] [INFO ] [MAIN ] ASIX: Loaded 22422 primary data records. [2025-09-22T22:16:15.700493] [DEBUG] [LOCAL ] ASGN: Loaded 35998 existing records from primary storage. [2025-09-22T22:16:15.699473] [DEBUG] [LOCAL ] ASH: Loaded 37815 existing records from primary storage. [2025-09-22T22:16:15.711067] [INFO ] [MAIN ] ASGN: Loaded 35998 primary data records. [2025-09-22T22:16:15.716392] [INFO ] [MAIN ] ASH: Loaded 37815 primary data records. [2025-09-22T22:16:16.620048] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:16.621598] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22422 primary records. [2025-09-22T22:16:16.622072] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-22T22:16:16.659469] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:16.666997] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37815 primary records. [2025-09-22T22:16:16.666088] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:16.668222] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 35998 primary records. [2025-09-22T22:16:16.668590] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-22T22:16:16.668927] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-22T22:16:16.701162] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-09-22T22:16:16.702095] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-22T22:16:16.704179] [INFO ] [MAIN ] Derivative Progress: 131/2091 symbols completed. ASIX took 1.2s. Estimated remaining: 12m 58s. Rate: 151.3 symbols/min [2025-09-22T22:16:16.706226] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:16.706291] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-09-22T22:16:16.707884] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-22T22:16:16.710301] [INFO ] [MAIN ] Derivative Progress: 132/2091 symbols completed. ASGN took 1.2s. Estimated remaining: 12m 51s. Rate: 152.4 symbols/min [2025-09-22T22:16:16.711905] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:16.712424] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-09-22T22:16:16.712513] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-22T22:16:16.714504] [INFO ] [MAIN ] Derivative Progress: 133/2091 symbols completed. ASH took 1.2s. Estimated remaining: 12m 45s. Rate: 153.5 symbols/min [2025-09-22T22:16:16.790155] [DEBUG] [LOCAL ] ASPN: Loaded 49599 existing records from primary storage. [2025-09-22T22:16:16.791613] [INFO ] [MAIN ] ASPN: Loaded 49599 primary data records. [2025-09-22T22:16:16.797637] [DEBUG] [LOCAL ] ASX: Loaded 52907 existing records from primary storage. [2025-09-22T22:16:16.858374] [INFO ] [MAIN ] ASX: Loaded 52907 primary data records. [2025-09-22T22:16:17.431681] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:17.432780] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49599 primary records. [2025-09-22T22:16:17.433026] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-22T22:16:17.460117] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:17.461668] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52907 primary records. [2025-09-22T22:16:17.462147] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-22T22:16:17.476817] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-09-22T22:16:17.477528] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-22T22:16:17.479472] [INFO ] [MAIN ] Derivative Progress: 134/2091 symbols completed. ASPN took 0.8s. Estimated remaining: 12m 50s. Rate: 152.4 symbols/min [2025-09-22T22:16:17.482677] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-09-22T22:16:17.482743] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-22T22:16:17.485157] [INFO ] [MAIN ] Derivative Progress: 135/2091 symbols completed. ASX took 0.8s. Estimated remaining: 12m 44s. Rate: 153.6 symbols/min [2025-09-22T22:16:17.486297] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:17.486233] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:17.486008] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:17.535816] [DEBUG] [LOCAL ] ATHM: Loaded 32743 existing records from primary storage. [2025-09-22T22:16:17.545110] [INFO ] [MAIN ] ATHM: Loaded 32743 primary data records. [2025-09-22T22:16:17.583162] [DEBUG] [LOCAL ] ATGE: Loaded 32042 existing records from primary storage. [2025-09-22T22:16:17.602963] [INFO ] [MAIN ] ATGE: Loaded 32042 primary data records. [2025-09-22T22:16:17.695235] [DEBUG] [LOCAL ] ATEN: Loaded 39993 existing records from primary storage. [2025-09-22T22:16:17.708861] [INFO ] [MAIN ] ATEN: Loaded 39993 primary data records. [2025-09-22T22:16:18.584746] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:18.585586] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 32743 primary records. [2025-09-22T22:16:18.585789] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-22T22:16:18.620620] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-09-22T22:16:18.621249] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:18.621357] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-22T22:16:18.624219] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 32042 primary records. [2025-09-22T22:16:18.623348] [INFO ] [MAIN ] Derivative Progress: 136/2091 symbols completed. ATHM took 1.1s. Estimated remaining: 12m 55s. Rate: 151.4 symbols/min [2025-09-22T22:16:18.632061] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-22T22:16:18.631999] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:18.637285] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:18.638623] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 39993 primary records. [2025-09-22T22:16:18.638945] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-22T22:16:18.672929] [DEBUG] [LOCAL ] ATHS: Loaded 7074 existing records from primary storage. [2025-09-22T22:16:18.674828] [INFO ] [MAIN ] ATHS: Loaded 7074 primary data records. [2025-09-22T22:16:18.687065] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-09-22T22:16:18.687172] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-22T22:16:18.689552] [INFO ] [MAIN ] Derivative Progress: 137/2091 symbols completed. ATEN took 1.2s. Estimated remaining: 12m 49s. Rate: 152.4 symbols/min [2025-09-22T22:16:18.690078] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:18.724010] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-09-22T22:16:18.746067] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-22T22:16:18.766015] [INFO ] [MAIN ] Derivative Progress: 138/2091 symbols completed. ATGE took 1.3s. Estimated remaining: 12m 45s. Rate: 153.3 symbols/min [2025-09-22T22:16:18.789669] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:19.046918] [DEBUG] [LOCAL ] ATI: Loaded 51595 existing records from primary storage. [2025-09-22T22:16:19.047359] [INFO ] [MAIN ] ATI: Loaded 51595 primary data records. [2025-09-22T22:16:19.174322] [DEBUG] [LOCAL ] ATKR: Loaded 35746 existing records from primary storage. [2025-09-22T22:16:19.174783] [INFO ] [MAIN ] ATKR: Loaded 35746 primary data records. [2025-09-22T22:16:19.198401] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:19.220357] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 7074 primary records. [2025-09-22T22:16:19.325286] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-22T22:16:19.596034] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-09-22T22:16:19.601516] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-22T22:16:19.603856] [INFO ] [MAIN ] Derivative Progress: 139/2091 symbols completed. ATHS took 1.0s. Estimated remaining: 12m 50s. Rate: 152.0 symbols/min [2025-09-22T22:16:19.727400] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:19.751554] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:19.752413] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51595 primary records. [2025-09-22T22:16:19.752717] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-22T22:16:19.782928] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-09-22T22:16:19.783166] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-22T22:16:19.785132] [INFO ] [MAIN ] Derivative Progress: 140/2091 symbols completed. ATI took 1.1s. Estimated remaining: 12m 47s. Rate: 152.6 symbols/min [2025-09-22T22:16:19.793447] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:19.810096] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:19.812343] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35746 primary records. [2025-09-22T22:16:19.812485] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-22T22:16:19.814250] [DEBUG] [LOCAL ] ATMU: Loaded 39666 existing records from primary storage. [2025-09-22T22:16:19.821957] [INFO ] [MAIN ] ATMU: Loaded 39666 primary data records. [2025-09-22T22:16:19.836312] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-09-22T22:16:19.855435] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-22T22:16:19.883314] [INFO ] [MAIN ] Derivative Progress: 141/2091 symbols completed. ATKR took 1.1s. Estimated remaining: 12m 43s. Rate: 153.4 symbols/min [2025-09-22T22:16:19.906034] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:20.210151] [DEBUG] [LOCAL ] ATO: Loaded 42015 existing records from primary storage. [2025-09-22T22:16:20.210793] [INFO ] [MAIN ] ATO: Loaded 42015 primary data records. [2025-09-22T22:16:20.297536] [DEBUG] [LOCAL ] ATR: Loaded 30532 existing records from primary storage. [2025-09-22T22:16:20.323098] [INFO ] [MAIN ] ATR: Loaded 30532 primary data records. [2025-09-22T22:16:20.919343] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:20.921914] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 39666 primary records. [2025-09-22T22:16:20.922171] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-22T22:16:20.941143] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-09-22T22:16:20.941402] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-22T22:16:20.943719] [INFO ] [MAIN ] Derivative Progress: 142/2091 symbols completed. ATMU took 1.2s. Estimated remaining: 12m 51s. Rate: 151.6 symbols/min [2025-09-22T22:16:20.944130] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:20.981982] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:20.983448] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30532 primary records. [2025-09-22T22:16:20.983595] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-22T22:16:20.982664] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:20.985211] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 42015 primary records. [2025-09-22T22:16:20.985361] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-22T22:16:21.011055] [DEBUG] [LOCAL ] ATS: Loaded 18112 existing records from primary storage. [2025-09-22T22:16:21.011454] [INFO ] [MAIN ] ATS: Loaded 18112 primary data records. [2025-09-22T22:16:21.117285] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-09-22T22:16:21.129737] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-22T22:16:21.132414] [INFO ] [MAIN ] Derivative Progress: 143/2091 symbols completed. ATO took 1.3s. Estimated remaining: 12m 48s. Rate: 152.1 symbols/min [2025-09-22T22:16:21.133904] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-09-22T22:16:21.132712] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:21.134053] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-22T22:16:21.141663] [INFO ] [MAIN ] Derivative Progress: 144/2091 symbols completed. ATR took 1.3s. Estimated remaining: 12m 43s. Rate: 153.2 symbols/min [2025-09-22T22:16:21.157941] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:21.409541] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:21.411545] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 18112 primary records. [2025-09-22T22:16:21.411685] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-22T22:16:21.413004] [DEBUG] [LOCAL ] ATUS: Loaded 49259 existing records from primary storage. [2025-09-22T22:16:21.413600] [INFO ] [MAIN ] ATUS: Loaded 49259 primary data records. [2025-09-22T22:16:21.485428] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-09-22T22:16:21.494391] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-22T22:16:21.516032] [INFO ] [MAIN ] Derivative Progress: 145/2091 symbols completed. ATS took 0.6s. Estimated remaining: 12m 42s. Rate: 153.2 symbols/min [2025-09-22T22:16:21.524508] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:21.542339] [DEBUG] [LOCAL ] AU: Loaded 52931 existing records from primary storage. [2025-09-22T22:16:21.554882] [INFO ] [MAIN ] AU: Loaded 52931 primary data records. [2025-09-22T22:16:22.084113] [DEBUG] [LOCAL ] AUB: Loaded 46477 existing records from primary storage. [2025-09-22T22:16:22.086097] [INFO ] [MAIN ] AUB: Loaded 46477 primary data records. [2025-09-22T22:16:22.460765] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:22.462100] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49259 primary records. [2025-09-22T22:16:22.462279] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-22T22:16:22.499470] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:22.500331] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-09-22T22:16:22.500637] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-22T22:16:22.503792] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52931 primary records. [2025-09-22T22:16:22.502709] [INFO ] [MAIN ] Derivative Progress: 146/2091 symbols completed. ATUS took 1.4s. Estimated remaining: 12m 50s. Rate: 151.7 symbols/min [2025-09-22T22:16:22.504097] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-22T22:16:22.504967] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:22.524329] [DEBUG] [LOCAL ] AUNA: Loaded 4683 existing records from primary storage. [2025-09-22T22:16:22.525821] [INFO ] [MAIN ] AUNA: Loaded 4683 primary data records. [2025-09-22T22:16:22.540779] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-09-22T22:16:22.553897] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-22T22:16:22.580292] [INFO ] [MAIN ] Derivative Progress: 147/2091 symbols completed. AU took 1.4s. Estimated remaining: 12m 45s. Rate: 152.5 symbols/min [2025-09-22T22:16:22.604696] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:22.630705] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:22.649430] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46477 primary records. [2025-09-22T22:16:22.649682] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-22T22:16:22.887694] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-09-22T22:16:22.887942] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-22T22:16:22.890080] [INFO ] [MAIN ] Derivative Progress: 148/2091 symbols completed. AUB took 1.4s. Estimated remaining: 12m 43s. Rate: 152.7 symbols/min [2025-09-22T22:16:22.907970] [DEBUG] [LOCAL ] AVA: Loaded 39610 existing records from primary storage. [2025-09-22T22:16:22.908329] [INFO ] [MAIN ] AVA: Loaded 39610 primary data records. [2025-09-22T22:16:23.072581] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:23.091193] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 4683 primary records. [2025-09-22T22:16:23.106480] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-22T22:16:23.243616] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-09-22T22:16:23.244124] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-22T22:16:23.246447] [INFO ] [MAIN ] Derivative Progress: 149/2091 symbols completed. AUNA took 0.7s. Estimated remaining: 12m 43s. Rate: 152.8 symbols/min [2025-09-22T22:16:23.266789] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:23.267427] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39610 primary records. [2025-09-22T22:16:23.267490] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-22T22:16:23.283009] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-09-22T22:16:23.283081] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-22T22:16:23.285255] [INFO ] [MAIN ] Derivative Progress: 150/2091 symbols completed. AVA took 0.7s. Estimated remaining: 12m 38s. Rate: 153.7 symbols/min [2025-09-22T22:16:23.286346] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:23.285966] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:23.286193] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:23.298502] [DEBUG] [LOCAL ] AVAL: Loaded 9095 existing records from primary storage. [2025-09-22T22:16:23.298635] [INFO ] [MAIN ] AVAL: Loaded 9095 primary data records. [2025-09-22T22:16:23.428436] [DEBUG] [LOCAL ] AVD: Loaded 23038 existing records from primary storage. [2025-09-22T22:16:23.428581] [INFO ] [MAIN ] AVD: Loaded 23038 primary data records. [2025-09-22T22:16:23.801251] [DEBUG] [LOCAL ] AVB: Loaded 41705 existing records from primary storage. [2025-09-22T22:16:23.812638] [INFO ] [MAIN ] AVB: Loaded 41705 primary data records. [2025-09-22T22:16:24.446156] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:24.447232] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 9095 primary records. [2025-09-22T22:16:24.447442] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-22T22:16:24.479409] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:24.481014] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 23038 primary records. [2025-09-22T22:16:24.481606] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-09-22T22:16:24.481410] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-22T22:16:24.481715] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-22T22:16:24.483848] [INFO ] [MAIN ] Derivative Progress: 151/2091 symbols completed. AVAL took 1.2s. Estimated remaining: 12m 48s. Rate: 151.6 symbols/min [2025-09-22T22:16:24.484129] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:24.502809] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-09-22T22:16:24.502977] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-22T22:16:24.505085] [INFO ] [MAIN ] Derivative Progress: 152/2091 symbols completed. AVD took 1.2s. Estimated remaining: 12m 42s. Rate: 152.6 symbols/min [2025-09-22T22:16:24.517945] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:24.518506] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:24.524151] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 41705 primary records. [2025-09-22T22:16:24.524381] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-22T22:16:24.544087] [DEBUG] [LOCAL ] AVK: Loaded 18073 existing records from primary storage. [2025-09-22T22:16:24.544902] [INFO ] [MAIN ] AVK: Loaded 18073 primary data records. [2025-09-22T22:16:24.648627] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-09-22T22:16:24.659774] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-22T22:16:24.662033] [INFO ] [MAIN ] Derivative Progress: 153/2091 symbols completed. AVB took 1.4s. Estimated remaining: 12m 39s. Rate: 153.2 symbols/min [2025-09-22T22:16:24.667550] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:24.749827] [DEBUG] [LOCAL ] AVNS: Loaded 33592 existing records from primary storage. [2025-09-22T22:16:24.750105] [INFO ] [MAIN ] AVNS: Loaded 33592 primary data records. [2025-09-22T22:16:25.191366] [DEBUG] [LOCAL ] AVNT: Loaded 39407 existing records from primary storage. [2025-09-22T22:16:25.192481] [INFO ] [MAIN ] AVNT: Loaded 39407 primary data records. [2025-09-22T22:16:25.382844] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:25.418599] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18073 primary records. [2025-09-22T22:16:25.418897] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-22T22:16:25.581762] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:25.576173] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-09-22T22:16:25.582013] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-22T22:16:25.584527] [INFO ] [MAIN ] Derivative Progress: 154/2091 symbols completed. AVK took 1.1s. Estimated remaining: 12m 45s. Rate: 151.9 symbols/min [2025-09-22T22:16:25.585890] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33592 primary records. [2025-09-22T22:16:25.586035] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-22T22:16:25.586967] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:25.607395] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-09-22T22:16:25.607580] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-22T22:16:25.609913] [INFO ] [MAIN ] Derivative Progress: 155/2091 symbols completed. AVNS took 1.1s. Estimated remaining: 12m 40s. Rate: 152.8 symbols/min [2025-09-22T22:16:25.610217] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:25.629603] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:25.630632] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 39407 primary records. [2025-09-22T22:16:25.630825] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-22T22:16:25.651588] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-09-22T22:16:25.651818] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-22T22:16:25.653943] [INFO ] [MAIN ] Derivative Progress: 156/2091 symbols completed. AVNT took 1.0s. Estimated remaining: 12m 36s. Rate: 153.7 symbols/min [2025-09-22T22:16:25.654280] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:25.710137] [DEBUG] [LOCAL ] AVY: Loaded 37716 existing records from primary storage. [2025-09-22T22:16:25.711602] [DEBUG] [LOCAL ] AWF: Loaded 24294 existing records from primary storage. [2025-09-22T22:16:25.711895] [INFO ] [MAIN ] AWF: Loaded 24294 primary data records. [2025-09-22T22:16:25.711833] [INFO ] [MAIN ] AVY: Loaded 37716 primary data records. [2025-09-22T22:16:25.879930] [DEBUG] [LOCAL ] AVTR: Loaded 53567 existing records from primary storage. [2025-09-22T22:16:25.902762] [INFO ] [MAIN ] AVTR: Loaded 53567 primary data records. [2025-09-22T22:16:26.737970] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:26.753133] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37716 primary records. [2025-09-22T22:16:26.753577] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:26.754237] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24294 primary records. [2025-09-22T22:16:26.754311] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-22T22:16:26.754489] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-22T22:16:26.783924] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:26.794624] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53567 primary records. [2025-09-22T22:16:26.796212] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-22T22:16:26.816841] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-09-22T22:16:26.817755] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-22T22:16:26.821832] [INFO ] [MAIN ] Derivative Progress: 157/2091 symbols completed. AVY took 1.2s. Estimated remaining: 12m 45s. Rate: 151.7 symbols/min [2025-09-22T22:16:26.823236] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:26.828363] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-09-22T22:16:26.829384] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-22T22:16:26.831332] [INFO ] [MAIN ] Derivative Progress: 158/2091 symbols completed. AWF took 1.2s. Estimated remaining: 12m 40s. Rate: 152.7 symbols/min [2025-09-22T22:16:26.832313] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:26.833080] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-09-22T22:16:26.833244] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-22T22:16:26.836823] [INFO ] [MAIN ] Derivative Progress: 159/2091 symbols completed. AVTR took 1.3s. Estimated remaining: 12m 35s. Rate: 153.6 symbols/min [2025-09-22T22:16:26.837697] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:26.879036] [DEBUG] [LOCAL ] AWI: Loaded 26066 existing records from primary storage. [2025-09-22T22:16:26.880722] [INFO ] [MAIN ] AWI: Loaded 26066 primary data records. [2025-09-22T22:16:26.881175] [DEBUG] [LOCAL ] AWP: Loaded 21999 existing records from primary storage. [2025-09-22T22:16:26.881394] [INFO ] [MAIN ] AWP: Loaded 21999 primary data records. [2025-09-22T22:16:27.417973] [DEBUG] [LOCAL ] AWK: Loaded 48853 existing records from primary storage. [2025-09-22T22:16:27.541049] [INFO ] [MAIN ] AWK: Loaded 48853 primary data records. [2025-09-22T22:16:27.928200] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:27.930556] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 26066 primary records. [2025-09-22T22:16:27.930941] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:27.931322] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-22T22:16:27.932191] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21999 primary records. [2025-09-22T22:16:27.933234] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-22T22:16:27.966164] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-09-22T22:16:27.967440] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-22T22:16:27.969836] [INFO ] [MAIN ] Derivative Progress: 160/2091 symbols completed. AWP took 1.1s. Estimated remaining: 12m 43s. Rate: 151.8 symbols/min [2025-09-22T22:16:27.970010] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-09-22T22:16:27.970953] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:27.971789] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-22T22:16:27.974308] [INFO ] [MAIN ] Derivative Progress: 161/2091 symbols completed. AWI took 1.2s. Estimated remaining: 12m 38s. Rate: 152.8 symbols/min [2025-09-22T22:16:27.974785] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:27.994620] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:27.995458] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48853 primary records. [2025-09-22T22:16:27.995590] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-22T22:16:28.012923] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-09-22T22:16:28.013133] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-22T22:16:28.021342] [INFO ] [MAIN ] Derivative Progress: 162/2091 symbols completed. AWK took 1.2s. Estimated remaining: 12m 34s. Rate: 153.6 symbols/min [2025-09-22T22:16:28.021843] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:28.039224] [DEBUG] [LOCAL ] AWR: Loaded 22541 existing records from primary storage. [2025-09-22T22:16:28.039361] [INFO ] [MAIN ] AWR: Loaded 22541 primary data records. [2025-09-22T22:16:28.104897] [DEBUG] [LOCAL ] AX: Loaded 28679 existing records from primary storage. [2025-09-22T22:16:28.130542] [INFO ] [MAIN ] AX: Loaded 28679 primary data records. [2025-09-22T22:16:28.818957] [DEBUG] [LOCAL ] AXP: Loaded 53264 existing records from primary storage. [2025-09-22T22:16:28.819991] [INFO ] [MAIN ] AXP: Loaded 53264 primary data records. [2025-09-22T22:16:29.148244] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:29.149796] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22541 primary records. [2025-09-22T22:16:29.149984] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-22T22:16:29.177367] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-09-22T22:16:29.183673] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-22T22:16:29.183607] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:29.184503] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28679 primary records. [2025-09-22T22:16:29.186864] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-22T22:16:29.186784] [INFO ] [MAIN ] Derivative Progress: 163/2091 symbols completed. AWR took 1.2s. Estimated remaining: 12m 42s. Rate: 151.7 symbols/min [2025-09-22T22:16:29.205206] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-09-22T22:16:29.205324] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-22T22:16:29.207726] [INFO ] [MAIN ] Derivative Progress: 164/2091 symbols completed. AX took 1.2s. Estimated remaining: 12m 38s. Rate: 152.6 symbols/min [2025-09-22T22:16:29.222361] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:29.223121] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53264 primary records. [2025-09-22T22:16:29.223185] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-22T22:16:29.239221] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-09-22T22:16:29.239286] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-22T22:16:29.241446] [INFO ] [MAIN ] Derivative Progress: 165/2091 symbols completed. AXP took 1.2s. Estimated remaining: 12m 33s. Rate: 153.5 symbols/min [2025-09-22T22:16:29.242279] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:29.242493] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:29.242772] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:29.249823] [DEBUG] [LOCAL ] AXR: Loaded 3148 existing records from primary storage. [2025-09-22T22:16:29.250084] [INFO ] [MAIN ] AXR: Loaded 3148 primary data records. [2025-09-22T22:16:29.604000] [DEBUG] [LOCAL ] AXS: Loaded 38244 existing records from primary storage. [2025-09-22T22:16:29.605687] [INFO ] [MAIN ] AXS: Loaded 38244 primary data records. [2025-09-22T22:16:29.679862] [DEBUG] [LOCAL ] AXTA: Loaded 52052 existing records from primary storage. [2025-09-22T22:16:29.689313] [INFO ] [MAIN ] AXTA: Loaded 52052 primary data records. [2025-09-22T22:16:30.290328] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:30.291931] [INFO ] [MAIN ] AXR: Generated 1794 derivative records from 3148 primary records. [2025-09-22T22:16:30.292171] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-22T22:16:30.308816] [DEBUG] [LOCAL ] AXR: Derivative data saved (1794 records). [2025-09-22T22:16:30.309259] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-22T22:16:30.311521] [INFO ] [MAIN ] Derivative Progress: 166/2091 symbols completed. AXR took 1.1s. Estimated remaining: 12m 40s. Rate: 151.9 symbols/min [2025-09-22T22:16:30.312215] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:30.336315] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:30.337182] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38244 primary records. [2025-09-22T22:16:30.337288] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-22T22:16:30.343083] [DEBUG] [LOCAL ] AZO: Loaded 11466 existing records from primary storage. [2025-09-22T22:16:30.343478] [INFO ] [MAIN ] AZO: Loaded 11466 primary data records. [2025-09-22T22:16:30.459055] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:30.477532] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-09-22T22:16:30.478251] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52052 primary records. [2025-09-22T22:16:30.478334] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-22T22:16:30.480295] [INFO ] [MAIN ] Derivative Progress: 167/2091 symbols completed. AXS took 1.2s. Estimated remaining: 12m 37s. Rate: 152.4 symbols/min [2025-09-22T22:16:30.480414] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-22T22:16:30.497624] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:30.745098] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-09-22T22:16:30.745290] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-22T22:16:30.747738] [INFO ] [MAIN ] Derivative Progress: 168/2091 symbols completed. AXTA took 1.5s. Estimated remaining: 12m 36s. Rate: 152.7 symbols/min [2025-09-22T22:16:30.748213] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:30.795158] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:30.810245] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11466 primary records. [2025-09-22T22:16:30.810467] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-22T22:16:30.826713] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-09-22T22:16:30.827694] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-22T22:16:30.829823] [INFO ] [MAIN ] Derivative Progress: 169/2091 symbols completed. AZO took 0.5s. Estimated remaining: 12m 32s. Rate: 153.4 symbols/min [2025-09-22T22:16:30.830271] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:30.861843] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-22T22:16:30.862040] [INFO ] [MAIN ] BA: Loaded 53791 primary data records. [2025-09-22T22:16:30.989216] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-22T22:16:31.001190] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-09-22T22:16:31.368355] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-22T22:16:31.378444] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-09-22T22:16:31.896896] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:31.899026] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53791 primary records. [2025-09-22T22:16:31.899393] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-22T22:16:31.937248] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-09-22T22:16:31.937598] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-22T22:16:31.937158] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:31.938580] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-09-22T22:16:31.941615] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-22T22:16:31.941274] [INFO ] [MAIN ] Derivative Progress: 170/2091 symbols completed. BA took 1.4s. Estimated remaining: 12m 39s. Rate: 151.8 symbols/min [2025-09-22T22:16:31.943297] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:31.978373] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-09-22T22:16:31.978810] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-22T22:16:31.978638] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:31.980979] [INFO ] [MAIN ] Derivative Progress: 171/2091 symbols completed. BABA took 1.2s. Estimated remaining: 12m 35s. Rate: 152.6 symbols/min [2025-09-22T22:16:31.982124] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:31.982014] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-09-22T22:16:31.982345] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-22T22:16:32.001386] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-09-22T22:16:32.001686] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-22T22:16:32.003924] [INFO ] [MAIN ] Derivative Progress: 172/2091 symbols completed. BAC took 1.2s. Estimated remaining: 12m 30s. Rate: 153.4 symbols/min [2025-09-22T22:16:32.004253] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:32.067130] [DEBUG] [LOCAL ] BAK: Loaded 38789 existing records from primary storage. [2025-09-22T22:16:32.067292] [INFO ] [MAIN ] BAK: Loaded 38789 primary data records. [2025-09-22T22:16:32.080316] [DEBUG] [LOCAL ] BAH: Loaded 51749 existing records from primary storage. [2025-09-22T22:16:32.128298] [INFO ] [MAIN ] BAH: Loaded 51749 primary data records. [2025-09-22T22:16:32.352519] [DEBUG] [LOCAL ] BALL: Loaded 51825 existing records from primary storage. [2025-09-22T22:16:32.371690] [INFO ] [MAIN ] BALL: Loaded 51825 primary data records. [2025-09-22T22:16:33.114129] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:33.114987] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 38789 primary records. [2025-09-22T22:16:33.115280] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-22T22:16:33.153130] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-09-22T22:16:33.153789] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:33.154760] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51749 primary records. [2025-09-22T22:16:33.154882] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-22T22:16:33.167379] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-22T22:16:33.169983] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:33.169276] [INFO ] [MAIN ] Derivative Progress: 173/2091 symbols completed. BAK took 1.2s. Estimated remaining: 12m 39s. Rate: 151.7 symbols/min [2025-09-22T22:16:33.171742] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51825 primary records. [2025-09-22T22:16:33.179474] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-22T22:16:33.179749] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:33.204988] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-09-22T22:16:33.205715] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-22T22:16:33.209364] [INFO ] [MAIN ] Derivative Progress: 174/2091 symbols completed. BALL took 1.2s. Estimated remaining: 12m 34s. Rate: 152.5 symbols/min [2025-09-22T22:16:33.210183] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:33.211599] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-09-22T22:16:33.211711] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-22T22:16:33.214350] [INFO ] [MAIN ] Derivative Progress: 175/2091 symbols completed. BAH took 1.3s. Estimated remaining: 12m 30s. Rate: 153.3 symbols/min [2025-09-22T22:16:33.214863] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:33.261526] [DEBUG] [LOCAL ] BAP: Loaded 26391 existing records from primary storage. [2025-09-22T22:16:33.274586] [INFO ] [MAIN ] BAP: Loaded 26391 primary data records. [2025-09-22T22:16:33.335007] [DEBUG] [LOCAL ] BAM: Loaded 52009 existing records from primary storage. [2025-09-22T22:16:33.385683] [INFO ] [MAIN ] BAM: Loaded 52009 primary data records. [2025-09-22T22:16:33.574519] [DEBUG] [LOCAL ] BANC: Loaded 51261 existing records from primary storage. [2025-09-22T22:16:33.593526] [INFO ] [MAIN ] BANC: Loaded 51261 primary data records. [2025-09-22T22:16:34.293595] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:34.294946] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 26391 primary records. [2025-09-22T22:16:34.296738] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-22T22:16:34.334160] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-09-22T22:16:34.334845] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-22T22:16:34.334508] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:34.338093] [INFO ] [MAIN ] Derivative Progress: 176/2091 symbols completed. BAP took 1.1s. Estimated remaining: 12m 37s. Rate: 151.7 symbols/min [2025-09-22T22:16:34.335859] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52009 primary records. [2025-09-22T22:16:34.338743] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-22T22:16:34.338858] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:34.373403] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:34.376616] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51261 primary records. [2025-09-22T22:16:34.377822] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-22T22:16:34.378582] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-09-22T22:16:34.379086] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-22T22:16:34.381201] [INFO ] [MAIN ] Derivative Progress: 177/2091 symbols completed. BAM took 1.2s. Estimated remaining: 12m 33s. Rate: 152.5 symbols/min [2025-09-22T22:16:34.381821] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:34.412525] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-09-22T22:16:34.424172] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-22T22:16:34.426809] [INFO ] [MAIN ] Derivative Progress: 178/2091 symbols completed. BANC took 1.2s. Estimated remaining: 12m 29s. Rate: 153.3 symbols/min [2025-09-22T22:16:34.428044] [DEBUG] [LOCAL ] BARK: Loaded 38462 existing records from primary storage. [2025-09-22T22:16:34.428215] [INFO ] [MAIN ] BARK: Loaded 38462 primary data records. [2025-09-22T22:16:34.761039] [DEBUG] [LOCAL ] BAX: Loaded 53491 existing records from primary storage. [2025-09-22T22:16:34.761972] [INFO ] [MAIN ] BAX: Loaded 53491 primary data records. [2025-09-22T22:16:35.152702] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:35.154092] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38462 primary records. [2025-09-22T22:16:35.154429] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-22T22:16:35.174220] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-09-22T22:16:35.174357] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-22T22:16:35.176406] [INFO ] [MAIN ] Derivative Progress: 179/2091 symbols completed. BARK took 0.8s. Estimated remaining: 12m 32s. Rate: 152.5 symbols/min [2025-09-22T22:16:35.192719] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:35.193389] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53491 primary records. [2025-09-22T22:16:35.193452] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-22T22:16:35.209821] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-09-22T22:16:35.209888] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-22T22:16:35.212107] [INFO ] [MAIN ] Derivative Progress: 180/2091 symbols completed. BAX took 0.8s. Estimated remaining: 12m 28s. Rate: 153.2 symbols/min [2025-09-22T22:16:35.213314] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:35.213519] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:35.213711] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:35.284618] [DEBUG] [LOCAL ] BBAR: Loaded 41183 existing records from primary storage. [2025-09-22T22:16:35.284832] [INFO ] [MAIN ] BBAR: Loaded 41183 primary data records. [2025-09-22T22:16:35.421143] [DEBUG] [LOCAL ] BB: Loaded 52923 existing records from primary storage. [2025-09-22T22:16:35.432764] [INFO ] [MAIN ] BB: Loaded 52923 primary data records. [2025-09-22T22:16:35.427441] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-22T22:16:35.476180] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-09-22T22:16:36.262954] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:36.264527] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 41183 primary records. [2025-09-22T22:16:36.264763] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-22T22:16:36.284491] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-09-22T22:16:36.284815] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-22T22:16:36.286987] [INFO ] [MAIN ] Derivative Progress: 181/2091 symbols completed. BBAR took 1.1s. Estimated remaining: 12m 35s. Rate: 151.8 symbols/min [2025-09-22T22:16:36.287355] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:36.308562] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:36.321604] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52923 primary records. [2025-09-22T22:16:36.321786] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-22T22:16:36.322701] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:36.323762] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-09-22T22:16:36.324123] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-22T22:16:36.368676] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-09-22T22:16:36.368858] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-22T22:16:36.368577] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-09-22T22:16:36.371888] [INFO ] [MAIN ] Derivative Progress: 182/2091 symbols completed. BBAI took 1.2s. Estimated remaining: 12m 31s. Rate: 152.4 symbols/min [2025-09-22T22:16:36.372165] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-22T22:16:36.372351] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:36.374631] [INFO ] [MAIN ] Derivative Progress: 183/2091 symbols completed. BB took 1.2s. Estimated remaining: 12m 27s. Rate: 153.3 symbols/min [2025-09-22T22:16:36.375310] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:36.398115] [DEBUG] [LOCAL ] BBD: Loaded 53179 existing records from primary storage. [2025-09-22T22:16:36.398471] [INFO ] [MAIN ] BBD: Loaded 53179 primary data records. [2025-09-22T22:16:36.401927] [DEBUG] [LOCAL ] BBDO: Loaded 5039 existing records from primary storage. [2025-09-22T22:16:36.440694] [INFO ] [MAIN ] BBDO: Loaded 5039 primary data records. [2025-09-22T22:16:36.650835] [DEBUG] [LOCAL ] BBDC: Loaded 33253 existing records from primary storage. [2025-09-22T22:16:36.683610] [INFO ] [MAIN ] BBDC: Loaded 33253 primary data records. [2025-09-22T22:16:37.448214] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:37.450162] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53179 primary records. [2025-09-22T22:16:37.454006] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-22T22:16:37.483993] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:37.488062] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 5039 primary records. [2025-09-22T22:16:37.488327] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-22T22:16:37.487202] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-09-22T22:16:37.489462] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-22T22:16:37.492054] [INFO ] [MAIN ] Derivative Progress: 184/2091 symbols completed. BBD took 1.2s. Estimated remaining: 12m 34s. Rate: 151.7 symbols/min [2025-09-22T22:16:37.500250] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:37.510406] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-09-22T22:16:37.510767] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-22T22:16:37.513096] [INFO ] [MAIN ] Derivative Progress: 185/2091 symbols completed. BBDO took 1.1s. Estimated remaining: 12m 30s. Rate: 152.5 symbols/min [2025-09-22T22:16:37.513535] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:37.526803] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:37.527526] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33253 primary records. [2025-09-22T22:16:37.527780] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-22T22:16:37.552429] [DEBUG] [LOCAL ] BBU: Loaded 4091 existing records from primary storage. [2025-09-22T22:16:37.559639] [INFO ] [MAIN ] BBU: Loaded 4091 primary data records. [2025-09-22T22:16:37.571821] [DEBUG] [LOCAL ] BBN: Loaded 18017 existing records from primary storage. [2025-09-22T22:16:37.592691] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-09-22T22:16:37.605151] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-22T22:16:37.598084] [INFO ] [MAIN ] BBN: Loaded 18017 primary data records. [2025-09-22T22:16:37.621590] [INFO ] [MAIN ] Derivative Progress: 186/2091 symbols completed. BBDC took 1.2s. Estimated remaining: 12m 26s. Rate: 153.1 symbols/min [2025-09-22T22:16:37.630946] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:37.854635] [DEBUG] [LOCAL ] BBUC: Loaded 13152 existing records from primary storage. [2025-09-22T22:16:37.866234] [INFO ] [MAIN ] BBUC: Loaded 13152 primary data records. [2025-09-22T22:16:38.561547] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:38.577168] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:38.576045] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 4091 primary records. [2025-09-22T22:16:38.577971] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18017 primary records. [2025-09-22T22:16:38.578077] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-22T22:16:38.579232] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-22T22:16:38.607801] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-09-22T22:16:38.608355] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-22T22:16:38.610756] [INFO ] [MAIN ] Derivative Progress: 187/2091 symbols completed. BBU took 1.1s. Estimated remaining: 12m 32s. Rate: 151.9 symbols/min [2025-09-22T22:16:38.612600] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:38.619000] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-09-22T22:16:38.632486] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:38.632110] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-22T22:16:38.636092] [INFO ] [MAIN ] Derivative Progress: 188/2091 symbols completed. BBN took 1.1s. Estimated remaining: 12m 28s. Rate: 152.6 symbols/min [2025-09-22T22:16:38.636245] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13152 primary records. [2025-09-22T22:16:38.636745] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-22T22:16:38.636601] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:38.658125] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-09-22T22:16:38.658332] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-22T22:16:38.661000] [INFO ] [MAIN ] Derivative Progress: 189/2091 symbols completed. BBUC took 1.0s. Estimated remaining: 12m 24s. Rate: 153.4 symbols/min [2025-09-22T22:16:38.661553] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:38.698686] [DEBUG] [LOCAL ] BBW: Loaded 26617 existing records from primary storage. [2025-09-22T22:16:38.714517] [INFO ] [MAIN ] BBW: Loaded 26617 primary data records. [2025-09-22T22:16:38.727940] [DEBUG] [LOCAL ] BBVA: Loaded 49550 existing records from primary storage. [2025-09-22T22:16:38.749138] [INFO ] [MAIN ] BBVA: Loaded 49550 primary data records. [2025-09-22T22:16:39.089347] [DEBUG] [LOCAL ] BBWI: Loaded 53576 existing records from primary storage. [2025-09-22T22:16:39.134224] [INFO ] [MAIN ] BBWI: Loaded 53576 primary data records. [2025-09-22T22:16:39.772409] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:39.773220] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 26617 primary records. [2025-09-22T22:16:39.773404] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-22T22:16:39.795734] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:39.800519] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49550 primary records. [2025-09-22T22:16:39.800974] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-22T22:16:39.820544] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-09-22T22:16:39.821103] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-22T22:16:39.823260] [INFO ] [MAIN ] Derivative Progress: 190/2091 symbols completed. BBW took 1.2s. Estimated remaining: 12m 31s. Rate: 151.8 symbols/min [2025-09-22T22:16:39.823954] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:39.826927] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-09-22T22:16:39.827497] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-22T22:16:39.830492] [INFO ] [MAIN ] Derivative Progress: 191/2091 symbols completed. BBVA took 1.2s. Estimated remaining: 12m 27s. Rate: 152.6 symbols/min [2025-09-22T22:16:39.831729] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:39.845031] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:39.845806] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53576 primary records. [2025-09-22T22:16:39.846031] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-22T22:16:39.863768] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-09-22T22:16:39.863961] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-22T22:16:39.866534] [INFO ] [MAIN ] Derivative Progress: 192/2091 symbols completed. BBWI took 1.2s. Estimated remaining: 12m 23s. Rate: 153.3 symbols/min [2025-09-22T22:16:39.869404] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:39.939523] [DEBUG] [LOCAL ] BC: Loaded 44536 existing records from primary storage. [2025-09-22T22:16:39.939722] [INFO ] [MAIN ] BC: Loaded 44536 primary data records. [2025-09-22T22:16:39.940903] [DEBUG] [LOCAL ] BBY: Loaded 53482 existing records from primary storage. [2025-09-22T22:16:39.964379] [INFO ] [MAIN ] BBY: Loaded 53482 primary data records. [2025-09-22T22:16:40.071730] [DEBUG] [LOCAL ] BCAT: Loaded 34509 existing records from primary storage. [2025-09-22T22:16:40.102589] [INFO ] [MAIN ] BCAT: Loaded 34509 primary data records. [2025-09-22T22:16:40.921911] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:40.923156] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44536 primary records. [2025-09-22T22:16:40.923326] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-22T22:16:40.923984] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:40.925326] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53482 primary records. [2025-09-22T22:16:40.925612] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-22T22:16:40.954574] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-09-22T22:16:40.954720] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-22T22:16:40.956973] [INFO ] [MAIN ] Derivative Progress: 193/2091 symbols completed. BC took 1.1s. Estimated remaining: 12m 30s. Rate: 151.9 symbols/min [2025-09-22T22:16:40.962329] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-09-22T22:16:40.974566] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-22T22:16:40.976939] [INFO ] [MAIN ] Derivative Progress: 194/2091 symbols completed. BBY took 1.2s. Estimated remaining: 12m 25s. Rate: 152.7 symbols/min [2025-09-22T22:16:40.977277] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:40.978069] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34509 primary records. [2025-09-22T22:16:40.978133] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-22T22:16:40.993470] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-09-22T22:16:40.993531] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-22T22:16:40.996120] [INFO ] [MAIN ] Derivative Progress: 195/2091 symbols completed. BCAT took 1.1s. Estimated remaining: 12m 21s. Rate: 153.4 symbols/min [2025-09-22T22:16:40.996893] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:40.997261] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:40.996748] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:41.039141] [DEBUG] [LOCAL ] BCH: Loaded 29570 existing records from primary storage. [2025-09-22T22:16:41.039589] [INFO ] [MAIN ] BCH: Loaded 29570 primary data records. [2025-09-22T22:16:41.084794] [DEBUG] [LOCAL ] BCC: Loaded 28411 existing records from primary storage. [2025-09-22T22:16:41.112081] [INFO ] [MAIN ] BCC: Loaded 28411 primary data records. [2025-09-22T22:16:41.590688] [DEBUG] [LOCAL ] BCE: Loaded 52370 existing records from primary storage. [2025-09-22T22:16:41.591625] [INFO ] [MAIN ] BCE: Loaded 52370 primary data records. [2025-09-22T22:16:42.071205] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:42.072860] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 29570 primary records. [2025-09-22T22:16:42.073063] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-22T22:16:42.092908] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-09-22T22:16:42.093022] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-22T22:16:42.096432] [INFO ] [MAIN ] Derivative Progress: 196/2091 symbols completed. BCH took 1.1s. Estimated remaining: 12m 28s. Rate: 152.0 symbols/min [2025-09-22T22:16:42.098433] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:42.113547] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:42.114737] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28411 primary records. [2025-09-22T22:16:42.115214] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-22T22:16:42.161334] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-09-22T22:16:42.162143] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-22T22:16:42.162053] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:42.164702] [INFO ] [MAIN ] Derivative Progress: 197/2091 symbols completed. BCC took 1.2s. Estimated remaining: 12m 24s. Rate: 152.7 symbols/min [2025-09-22T22:16:42.173137] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52370 primary records. [2025-09-22T22:16:42.174455] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-22T22:16:42.174737] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:42.176680] [DEBUG] [LOCAL ] BCO: Loaded 26483 existing records from primary storage. [2025-09-22T22:16:42.176897] [INFO ] [MAIN ] BCO: Loaded 26483 primary data records. [2025-09-22T22:16:42.256875] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-09-22T22:16:42.268896] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-22T22:16:42.277020] [INFO ] [MAIN ] Derivative Progress: 198/2091 symbols completed. BCE took 1.3s. Estimated remaining: 12m 21s. Rate: 153.2 symbols/min [2025-09-22T22:16:42.282391] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:42.546881] [DEBUG] [LOCAL ] BCSF: Loaded 27741 existing records from primary storage. [2025-09-22T22:16:42.547729] [INFO ] [MAIN ] BCSF: Loaded 27741 primary data records. [2025-09-22T22:16:42.554207] [DEBUG] [LOCAL ] BCS: Loaded 53472 existing records from primary storage. [2025-09-22T22:16:42.591533] [INFO ] [MAIN ] BCS: Loaded 53472 primary data records. [2025-09-22T22:16:43.159059] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:43.228570] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 26483 primary records. [2025-09-22T22:16:43.229798] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-22T22:16:43.250036] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-09-22T22:16:43.250521] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-22T22:16:43.252740] [INFO ] [MAIN ] Derivative Progress: 199/2091 symbols completed. BCO took 1.2s. Estimated remaining: 12m 26s. Rate: 152.1 symbols/min [2025-09-22T22:16:43.253576] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:43.275780] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:43.283264] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27741 primary records. [2025-09-22T22:16:43.284110] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-22T22:16:43.313415] [DEBUG] [LOCAL ] BCX: Loaded 21767 existing records from primary storage. [2025-09-22T22:16:43.311968] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:43.317980] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53472 primary records. [2025-09-22T22:16:43.316058] [INFO ] [MAIN ] BCX: Loaded 21767 primary data records. [2025-09-22T22:16:43.320257] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-22T22:16:43.332665] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-09-22T22:16:43.357997] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-22T22:16:43.360357] [INFO ] [MAIN ] Derivative Progress: 200/2091 symbols completed. BCSF took 1.1s. Estimated remaining: 12m 23s. Rate: 152.6 symbols/min [2025-09-22T22:16:43.375681] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:43.506306] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-09-22T22:16:43.509134] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-22T22:16:43.531626] [INFO ] [MAIN ] Derivative Progress: 201/2091 symbols completed. BCS took 1.4s. Estimated remaining: 12m 21s. Rate: 153.1 symbols/min [2025-09-22T22:16:43.655710] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:43.657567] [DEBUG] [LOCAL ] BDC: Loaded 24906 existing records from primary storage. [2025-09-22T22:16:43.657678] [INFO ] [MAIN ] BDC: Loaded 24906 primary data records. [2025-09-22T22:16:43.984178] [DEBUG] [LOCAL ] BDJ: Loaded 28984 existing records from primary storage. [2025-09-22T22:16:43.984903] [INFO ] [MAIN ] BDJ: Loaded 28984 primary data records. [2025-09-22T22:16:44.160081] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:44.191274] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 21767 primary records. [2025-09-22T22:16:44.302194] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-22T22:16:44.332457] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-09-22T22:16:44.332899] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-22T22:16:44.335483] [INFO ] [MAIN ] Derivative Progress: 202/2091 symbols completed. BCX took 1.1s. Estimated remaining: 12m 24s. Rate: 152.3 symbols/min [2025-09-22T22:16:44.336905] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:44.356430] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:44.357208] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24906 primary records. [2025-09-22T22:16:44.357394] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-22T22:16:44.374226] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-09-22T22:16:44.374617] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-22T22:16:44.376901] [INFO ] [MAIN ] Derivative Progress: 203/2091 symbols completed. BDC took 1.0s. Estimated remaining: 12m 21s. Rate: 152.9 symbols/min [2025-09-22T22:16:44.377955] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:44.394819] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:44.395664] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 28984 primary records. [2025-09-22T22:16:44.395816] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-22T22:16:44.425686] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-09-22T22:16:44.438748] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-22T22:16:44.441239] [INFO ] [MAIN ] Derivative Progress: 204/2091 symbols completed. BDJ took 0.8s. Estimated remaining: 12m 17s. Rate: 153.6 symbols/min [2025-09-22T22:16:44.441707] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:44.442889] [DEBUG] [LOCAL ] BDN: Loaded 47620 existing records from primary storage. [2025-09-22T22:16:44.443327] [INFO ] [MAIN ] BDN: Loaded 47620 primary data records. [2025-09-22T22:16:44.752919] [DEBUG] [LOCAL ] BDX: Loaded 52497 existing records from primary storage. [2025-09-22T22:16:44.798180] [INFO ] [MAIN ] BDX: Loaded 52497 primary data records. [2025-09-22T22:16:44.924567] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-22T22:16:44.930794] [INFO ] [MAIN ] BE: Loaded 53653 primary data records. [2025-09-22T22:16:45.489929] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:45.491080] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47620 primary records. [2025-09-22T22:16:45.492095] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-22T22:16:45.510412] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-09-22T22:16:45.511260] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-22T22:16:45.513477] [INFO ] [MAIN ] Derivative Progress: 205/2091 symbols completed. BDN took 1.2s. Estimated remaining: 12m 23s. Rate: 152.3 symbols/min [2025-09-22T22:16:45.513987] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:45.535403] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:45.536384] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52497 primary records. [2025-09-22T22:16:45.536638] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-22T22:16:45.570272] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:45.570767] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-09-22T22:16:45.571542] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53653 primary records. [2025-09-22T22:16:45.571675] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-22T22:16:45.574397] [INFO ] [MAIN ] Derivative Progress: 206/2091 symbols completed. BDX took 1.2s. Estimated remaining: 12m 20s. Rate: 152.9 symbols/min [2025-09-22T22:16:45.571852] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-22T22:16:45.575598] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:45.605340] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-09-22T22:16:45.605471] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-22T22:16:45.608028] [INFO ] [MAIN ] Derivative Progress: 207/2091 symbols completed. BE took 1.2s. Estimated remaining: 12m 16s. Rate: 153.6 symbols/min [2025-09-22T22:16:45.608470] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:45.630923] [DEBUG] [LOCAL ] BEKE: Loaded 53261 existing records from primary storage. [2025-09-22T22:16:45.631325] [INFO ] [MAIN ] BEKE: Loaded 53261 primary data records. [2025-09-22T22:16:45.960762] [DEBUG] [LOCAL ] BEP: Loaded 38703 existing records from primary storage. [2025-09-22T22:16:45.981509] [INFO ] [MAIN ] BEP: Loaded 38703 primary data records. [2025-09-22T22:16:45.990400] [DEBUG] [LOCAL ] BEN: Loaded 53067 existing records from primary storage. [2025-09-22T22:16:46.002752] [INFO ] [MAIN ] BEN: Loaded 53067 primary data records. [2025-09-22T22:16:46.635369] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:46.636249] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53261 primary records. [2025-09-22T22:16:46.636534] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-22T22:16:46.657130] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-09-22T22:16:46.658892] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-22T22:16:46.661453] [INFO ] [MAIN ] Derivative Progress: 208/2091 symbols completed. BEKE took 1.1s. Estimated remaining: 12m 22s. Rate: 152.3 symbols/min [2025-09-22T22:16:46.676716] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:46.677428] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38703 primary records. [2025-09-22T22:16:46.677542] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-22T22:16:46.690330] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:46.691080] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53067 primary records. [2025-09-22T22:16:46.698233] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-22T22:16:46.720781] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-09-22T22:16:46.721276] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-09-22T22:16:46.721408] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-22T22:16:46.721350] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-22T22:16:46.723363] [INFO ] [MAIN ] Derivative Progress: 209/2091 symbols completed. BEP took 1.1s. Estimated remaining: 12m 18s. Rate: 153.0 symbols/min [2025-09-22T22:16:46.725999] [INFO ] [MAIN ] Derivative Progress: 210/2091 symbols completed. BEN took 1.2s. Estimated remaining: 12m 14s. Rate: 153.7 symbols/min [2025-09-22T22:16:46.726562] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:46.727089] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:46.727150] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:46.733577] [DEBUG] [LOCAL ] BEPI: Loaded 3415 existing records from primary storage. [2025-09-22T22:16:46.733810] [INFO ] [MAIN ] BEPI: Loaded 3415 primary data records. [2025-09-22T22:16:46.793453] [DEBUG] [LOCAL ] BEPJ: Loaded 3285 existing records from primary storage. [2025-09-22T22:16:46.810138] [INFO ] [MAIN ] BEPJ: Loaded 3285 primary data records. [2025-09-22T22:16:46.817183] [DEBUG] [LOCAL ] BEPH: Loaded 5153 existing records from primary storage. [2025-09-22T22:16:46.828361] [INFO ] [MAIN ] BEPH: Loaded 5153 primary data records. [2025-09-22T22:16:47.705758] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:47.707112] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3415 primary records. [2025-09-22T22:16:47.707402] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-22T22:16:47.731433] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:47.733575] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3285 primary records. [2025-09-22T22:16:47.736621] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-09-22T22:16:47.734912] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-22T22:16:47.737794] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-22T22:16:47.739883] [INFO ] [MAIN ] Derivative Progress: 211/2091 symbols completed. BEPI took 1.0s. Estimated remaining: 12m 20s. Rate: 152.5 symbols/min [2025-09-22T22:16:47.740664] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:47.763865] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:47.767162] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5153 primary records. [2025-09-22T22:16:47.767678] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-22T22:16:47.767490] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-09-22T22:16:47.767793] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-22T22:16:47.770812] [INFO ] [MAIN ] Derivative Progress: 212/2091 symbols completed. BEPJ took 1.0s. Estimated remaining: 12m 16s. Rate: 153.2 symbols/min [2025-09-22T22:16:47.771305] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:47.786744] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-09-22T22:16:47.786934] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-22T22:16:47.789522] [INFO ] [MAIN ] Derivative Progress: 213/2091 symbols completed. BEPH took 1.1s. Estimated remaining: 12m 12s. Rate: 153.9 symbols/min [2025-09-22T22:16:47.789888] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:47.813990] [DEBUG] [LOCAL ] BFK: Loaded 14045 existing records from primary storage. [2025-09-22T22:16:47.814142] [INFO ] [MAIN ] BFK: Loaded 14045 primary data records. [2025-09-22T22:16:47.938106] [DEBUG] [LOCAL ] BFAM: Loaded 33000 existing records from primary storage. [2025-09-22T22:16:47.996721] [DEBUG] [LOCAL ] BFH: Loaded 41822 existing records from primary storage. [2025-09-22T22:16:48.002698] [INFO ] [MAIN ] BFH: Loaded 41822 primary data records. [2025-09-22T22:16:47.996175] [INFO ] [MAIN ] BFAM: Loaded 33000 primary data records. [2025-09-22T22:16:48.772896] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:48.774236] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 14045 primary records. [2025-09-22T22:16:48.774943] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-22T22:16:48.796214] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-09-22T22:16:48.796559] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-22T22:16:48.800846] [INFO ] [MAIN ] Derivative Progress: 214/2091 symbols completed. BFK took 1.0s. Estimated remaining: 12m 17s. Rate: 152.7 symbols/min [2025-09-22T22:16:48.813297] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:48.814634] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:48.815535] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41822 primary records. [2025-09-22T22:16:48.815900] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-22T22:16:48.834057] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:48.842112] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33000 primary records. [2025-09-22T22:16:48.846429] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-22T22:16:48.865957] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-09-22T22:16:48.867506] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-22T22:16:48.870382] [INFO ] [MAIN ] Derivative Progress: 215/2091 symbols completed. BFH took 1.1s. Estimated remaining: 12m 14s. Rate: 153.3 symbols/min [2025-09-22T22:16:48.871026] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:48.874256] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-09-22T22:16:48.874357] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-22T22:16:48.877625] [INFO ] [MAIN ] Derivative Progress: 216/2091 symbols completed. BFAM took 1.1s. Estimated remaining: 12m 10s. Rate: 154.0 symbols/min [2025-09-22T22:16:48.878131] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:48.900239] [DEBUG] [LOCAL ] BFS: Loaded 8996 existing records from primary storage. [2025-09-22T22:16:48.900431] [INFO ] [MAIN ] BFS: Loaded 8996 primary data records. [2025-09-22T22:16:49.000452] [DEBUG] [LOCAL ] BFZ: Loaded 11524 existing records from primary storage. [2025-09-22T22:16:49.029872] [DEBUG] [LOCAL ] BFLY: Loaded 51829 existing records from primary storage. [2025-09-22T22:16:49.045582] [INFO ] [MAIN ] BFLY: Loaded 51829 primary data records. [2025-09-22T22:16:49.028734] [INFO ] [MAIN ] BFZ: Loaded 11524 primary data records. [2025-09-22T22:16:49.860844] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:49.861848] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 8996 primary records. [2025-09-22T22:16:49.862051] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-22T22:16:49.883928] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-09-22T22:16:49.884200] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-22T22:16:49.886301] [INFO ] [MAIN ] Derivative Progress: 217/2091 symbols completed. BFS took 1.0s. Estimated remaining: 12m 15s. Rate: 152.9 symbols/min [2025-09-22T22:16:49.886692] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:49.907176] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:49.913108] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11524 primary records. [2025-09-22T22:16:49.912371] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:49.913258] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-22T22:16:49.914580] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51829 primary records. [2025-09-22T22:16:49.914704] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-22T22:16:49.940749] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-09-22T22:16:49.941287] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-22T22:16:49.944398] [INFO ] [MAIN ] Derivative Progress: 218/2091 symbols completed. BFZ took 1.1s. Estimated remaining: 12m 12s. Rate: 153.5 symbols/min [2025-09-22T22:16:49.945185] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:49.950146] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-09-22T22:16:49.950912] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-22T22:16:49.953487] [INFO ] [MAIN ] Derivative Progress: 219/2091 symbols completed. BFLY took 1.2s. Estimated remaining: 12m 8s. Rate: 154.2 symbols/min [2025-09-22T22:16:49.953900] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:49.990433] [DEBUG] [LOCAL ] BGB: Loaded 17407 existing records from primary storage. [2025-09-22T22:16:49.990734] [INFO ] [MAIN ] BGB: Loaded 17407 primary data records. [2025-09-22T22:16:50.085291] [DEBUG] [LOCAL ] BGH: Loaded 16404 existing records from primary storage. [2025-09-22T22:16:50.110813] [DEBUG] [LOCAL ] BG: Loaded 50380 existing records from primary storage. [2025-09-22T22:16:50.110065] [INFO ] [MAIN ] BGH: Loaded 16404 primary data records. [2025-09-22T22:16:50.122804] [INFO ] [MAIN ] BG: Loaded 50380 primary data records. [2025-09-22T22:16:51.038378] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:51.039800] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17407 primary records. [2025-09-22T22:16:51.039994] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-22T22:16:51.074535] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:51.078080] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-09-22T22:16:51.078279] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-22T22:16:51.094228] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50380 primary records. [2025-09-22T22:16:51.093135] [INFO ] [MAIN ] Derivative Progress: 220/2091 symbols completed. BGB took 1.1s. Estimated remaining: 12m 14s. Rate: 152.9 symbols/min [2025-09-22T22:16:51.094444] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-22T22:16:51.100765] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:51.099870] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:51.102228] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 16404 primary records. [2025-09-22T22:16:51.102427] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-22T22:16:51.141941] [DEBUG] [LOCAL ] BGR: Loaded 13484 existing records from primary storage. [2025-09-22T22:16:51.143101] [INFO ] [MAIN ] BGR: Loaded 13484 primary data records. [2025-09-22T22:16:51.156442] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-09-22T22:16:51.156373] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-09-22T22:16:51.183945] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-22T22:16:51.183868] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-22T22:16:51.201158] [INFO ] [MAIN ] Derivative Progress: 221/2091 symbols completed. BGH took 1.2s. Estimated remaining: 12m 12s. Rate: 153.4 symbols/min [2025-09-22T22:16:51.232352] [INFO ] [MAIN ] Derivative Progress: 222/2091 symbols completed. BG took 1.3s. Estimated remaining: 12m 8s. Rate: 154.0 symbols/min [2025-09-22T22:16:51.232281] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:51.261191] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:51.511320] [DEBUG] [LOCAL ] BGSF: Loaded 6537 existing records from primary storage. [2025-09-22T22:16:51.524825] [INFO ] [MAIN ] BGSF: Loaded 6537 primary data records. [2025-09-22T22:16:51.868982] [DEBUG] [LOCAL ] BGS: Loaded 50448 existing records from primary storage. [2025-09-22T22:16:51.869601] [INFO ] [MAIN ] BGS: Loaded 50448 primary data records. [2025-09-22T22:16:52.078988] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:52.103433] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13484 primary records. [2025-09-22T22:16:52.219420] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-22T22:16:52.246396] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-09-22T22:16:52.246817] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-22T22:16:52.250687] [INFO ] [MAIN ] Derivative Progress: 223/2091 symbols completed. BGR took 1.2s. Estimated remaining: 12m 13s. Rate: 152.9 symbols/min [2025-09-22T22:16:52.264867] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:16:52.265616] [INFO ] [MAIN ] BGSF: Generated 1793 derivative records from 6537 primary records. [2025-09-22T22:16:52.265717] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-22T22:16:52.281063] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1793 records). [2025-09-22T22:16:52.281271] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-22T22:16:52.283966] [INFO ] [MAIN ] Derivative Progress: 224/2091 symbols completed. BGSF took 1.0s. Estimated remaining: 12m 10s. Rate: 153.5 symbols/min [2025-09-22T22:16:52.300456] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:52.301112] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50448 primary records. [2025-09-22T22:16:52.301175] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-22T22:16:52.315808] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-09-22T22:16:52.315885] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-22T22:16:52.318296] [INFO ] [MAIN ] Derivative Progress: 225/2091 symbols completed. BGS took 1.1s. Estimated remaining: 12m 6s. Rate: 154.1 symbols/min [2025-09-22T22:16:52.319000] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:52.319074] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:52.319448] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:52.342913] [DEBUG] [LOCAL ] BGX: Loaded 10738 existing records from primary storage. [2025-09-22T22:16:52.343087] [INFO ] [MAIN ] BGX: Loaded 10738 primary data records. [2025-09-22T22:16:52.444709] [DEBUG] [LOCAL ] BGT: Loaded 16570 existing records from primary storage. [2025-09-22T22:16:52.462304] [DEBUG] [LOCAL ] BGY: Loaded 22663 existing records from primary storage. [2025-09-22T22:16:52.462499] [INFO ] [MAIN ] BGY: Loaded 22663 primary data records. [2025-09-22T22:16:52.462602] [INFO ] [MAIN ] BGT: Loaded 16570 primary data records. [2025-09-22T22:16:53.376318] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:53.377558] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 10738 primary records. [2025-09-22T22:16:53.378664] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-22T22:16:53.406790] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:53.409587] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 22663 primary records. [2025-09-22T22:16:53.409712] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-22T22:16:53.413755] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-09-22T22:16:53.413923] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-22T22:16:53.424082] [INFO ] [MAIN ] Derivative Progress: 226/2091 symbols completed. BGX took 1.1s. Estimated remaining: 12m 12s. Rate: 152.9 symbols/min [2025-09-22T22:16:53.430055] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:53.449821] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:53.450918] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-09-22T22:16:53.451114] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-22T22:16:53.452018] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16570 primary records. [2025-09-22T22:16:53.454750] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-22T22:16:53.454686] [INFO ] [MAIN ] Derivative Progress: 227/2091 symbols completed. BGY took 1.1s. Estimated remaining: 12m 8s. Rate: 153.5 symbols/min [2025-09-22T22:16:53.456068] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:53.483618] [DEBUG] [LOCAL ] BH: Loaded 15425 existing records from primary storage. [2025-09-22T22:16:53.483819] [INFO ] [MAIN ] BH: Loaded 15425 primary data records. [2025-09-22T22:16:53.483136] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-09-22T22:16:53.483941] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-22T22:16:53.498469] [INFO ] [MAIN ] Derivative Progress: 228/2091 symbols completed. BGT took 1.2s. Estimated remaining: 12m 5s. Rate: 154.1 symbols/min [2025-09-22T22:16:53.541845] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:53.826170] [DEBUG] [LOCAL ] BHC: Loaded 46804 existing records from primary storage. [2025-09-22T22:16:53.834945] [DEBUG] [LOCAL ] BHE: Loaded 25215 existing records from primary storage. [2025-09-22T22:16:53.834433] [INFO ] [MAIN ] BHC: Loaded 46804 primary data records. [2025-09-22T22:16:53.835094] [INFO ] [MAIN ] BHE: Loaded 25215 primary data records. [2025-09-22T22:16:54.489219] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:54.490402] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 15425 primary records. [2025-09-22T22:16:54.491695] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-22T22:16:54.512572] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-09-22T22:16:54.513023] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-22T22:16:54.515388] [INFO ] [MAIN ] Derivative Progress: 229/2091 symbols completed. BH took 1.1s. Estimated remaining: 12m 10s. Rate: 153.0 symbols/min [2025-09-22T22:16:54.516334] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:54.550781] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:54.551700] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:54.552711] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 25215 primary records. [2025-09-22T22:16:54.553436] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46804 primary records. [2025-09-22T22:16:54.553559] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-22T22:16:54.560320] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-22T22:16:54.597721] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-09-22T22:16:54.596544] [DEBUG] [LOCAL ] BHK: Loaded 22486 existing records from primary storage. [2025-09-22T22:16:54.598112] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-22T22:16:54.600561] [INFO ] [MAIN ] Derivative Progress: 230/2091 symbols completed. BHC took 1.1s. Estimated remaining: 12m 7s. Rate: 153.6 symbols/min [2025-09-22T22:16:54.601437] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:54.600978] [INFO ] [MAIN ] BHK: Loaded 22486 primary data records. [2025-09-22T22:16:54.602635] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-09-22T22:16:54.602809] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-22T22:16:54.637044] [INFO ] [MAIN ] Derivative Progress: 231/2091 symbols completed. BHE took 1.1s. Estimated remaining: 12m 4s. Rate: 154.2 symbols/min [2025-09-22T22:16:54.642670] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:54.808493] [DEBUG] [LOCAL ] BHR: Loaded 21413 existing records from primary storage. [2025-09-22T22:16:54.841047] [INFO ] [MAIN ] BHR: Loaded 21413 primary data records. [2025-09-22T22:16:55.331201] [DEBUG] [LOCAL ] BHP: Loaded 53385 existing records from primary storage. [2025-09-22T22:16:55.331404] [INFO ] [MAIN ] BHP: Loaded 53385 primary data records. [2025-09-22T22:16:55.666219] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:55.668102] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 22486 primary records. [2025-09-22T22:16:55.668309] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-22T22:16:55.702879] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:55.704572] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21413 primary records. [2025-09-22T22:16:55.703894] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-09-22T22:16:55.704999] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-22T22:16:55.705095] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-22T22:16:55.707454] [INFO ] [MAIN ] Derivative Progress: 232/2091 symbols completed. BHK took 1.2s. Estimated remaining: 12m 9s. Rate: 153.0 symbols/min [2025-09-22T22:16:55.708529] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:55.725295] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-09-22T22:16:55.725710] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-22T22:16:55.728522] [INFO ] [MAIN ] Derivative Progress: 233/2091 symbols completed. BHR took 1.1s. Estimated remaining: 12m 6s. Rate: 153.6 symbols/min [2025-09-22T22:16:55.728937] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:55.747714] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:55.749392] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53385 primary records. [2025-09-22T22:16:55.749721] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-22T22:16:55.775846] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-09-22T22:16:55.776058] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-22T22:16:55.778673] [INFO ] [MAIN ] Derivative Progress: 234/2091 symbols completed. BHP took 1.2s. Estimated remaining: 12m 2s. Rate: 154.2 symbols/min [2025-09-22T22:16:55.779066] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:55.799272] [DEBUG] [LOCAL ] BIO: Loaded 25556 existing records from primary storage. [2025-09-22T22:16:55.799539] [INFO ] [MAIN ] BIO: Loaded 25556 primary data records. [2025-09-22T22:16:55.976041] [DEBUG] [LOCAL ] BHVN: Loaded 49586 existing records from primary storage. [2025-09-22T22:16:55.986852] [INFO ] [MAIN ] BHVN: Loaded 49586 primary data records. [2025-09-22T22:16:56.233334] [DEBUG] [LOCAL ] BIP: Loaded 39680 existing records from primary storage. [2025-09-22T22:16:56.245073] [INFO ] [MAIN ] BIP: Loaded 39680 primary data records. [2025-09-22T22:16:56.778591] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:56.780808] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 25556 primary records. [2025-09-22T22:16:56.781021] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-22T22:16:56.801528] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-09-22T22:16:56.802043] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-22T22:16:56.804329] [INFO ] [MAIN ] Derivative Progress: 235/2091 symbols completed. BIO took 1.1s. Estimated remaining: 12m 7s. Rate: 153.2 symbols/min [2025-09-22T22:16:56.806455] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:56.824182] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:56.825040] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 49586 primary records. [2025-09-22T22:16:56.825209] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-22T22:16:56.857382] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:56.859412] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39680 primary records. [2025-09-22T22:16:56.859806] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-22T22:16:56.861357] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-09-22T22:16:56.861508] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-22T22:16:56.863732] [INFO ] [MAIN ] Derivative Progress: 236/2091 symbols completed. BHVN took 1.2s. Estimated remaining: 12m 4s. Rate: 153.7 symbols/min [2025-09-22T22:16:56.874245] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:56.891405] [DEBUG] [LOCAL ] BIPH: Loaded 2646 existing records from primary storage. [2025-09-22T22:16:56.892296] [INFO ] [MAIN ] BIPH: Loaded 2646 primary data records. [2025-09-22T22:16:56.943894] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-09-22T22:16:56.964449] [DEBUG] [LOCAL ] BIPC: Loaded 41711 existing records from primary storage. [2025-09-22T22:16:56.978757] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-22T22:16:56.978682] [INFO ] [MAIN ] BIPC: Loaded 41711 primary data records. [2025-09-22T22:16:56.982227] [INFO ] [MAIN ] Derivative Progress: 237/2091 symbols completed. BIP took 1.2s. Estimated remaining: 12m 2s. Rate: 154.2 symbols/min [2025-09-22T22:16:57.035333] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:57.168752] [DEBUG] [LOCAL ] BIPI: Loaded 3354 existing records from primary storage. [2025-09-22T22:16:57.224957] [INFO ] [MAIN ] BIPI: Loaded 3354 primary data records. [2025-09-22T22:16:57.943094] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:16:57.944351] [INFO ] [MAIN ] BIPH: Generated 1793 derivative records from 2646 primary records. [2025-09-22T22:16:57.944576] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-22T22:16:57.977247] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:57.980109] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41711 primary records. [2025-09-22T22:16:57.978239] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1793 records). [2025-09-22T22:16:57.981118] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-22T22:16:57.981274] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-22T22:16:57.983607] [INFO ] [MAIN ] Derivative Progress: 238/2091 symbols completed. BIPH took 1.1s. Estimated remaining: 12m 6s. Rate: 153.1 symbols/min [2025-09-22T22:16:58.005714] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:58.012446] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3354 primary records. [2025-09-22T22:16:58.013170] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-22T22:16:58.015133] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-09-22T22:16:58.015586] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-22T22:16:58.018068] [INFO ] [MAIN ] Derivative Progress: 239/2091 symbols completed. BIPC took 1.2s. Estimated remaining: 12m 3s. Rate: 153.7 symbols/min [2025-09-22T22:16:58.032544] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-09-22T22:16:58.032629] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-22T22:16:58.035395] [INFO ] [MAIN ] Derivative Progress: 240/2091 symbols completed. BIPI took 1.0s. Estimated remaining: 11m 60s. Rate: 154.3 symbols/min [2025-09-22T22:16:58.036410] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:58.036627] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:58.036540] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:58.043046] [DEBUG] [LOCAL ] BIPJ: Loaded 2937 existing records from primary storage. [2025-09-22T22:16:58.043178] [INFO ] [MAIN ] BIPJ: Loaded 2937 primary data records. [2025-09-22T22:16:58.218320] [DEBUG] [LOCAL ] BIT: Loaded 22270 existing records from primary storage. [2025-09-22T22:16:58.218911] [INFO ] [MAIN ] BIT: Loaded 22270 primary data records. [2025-09-22T22:16:58.524897] [DEBUG] [LOCAL ] BIRK: Loaded 50882 existing records from primary storage. [2025-09-22T22:16:58.535397] [INFO ] [MAIN ] BIRK: Loaded 50882 primary data records. [2025-09-22T22:16:59.156031] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:59.157394] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 2937 primary records. [2025-09-22T22:16:59.157674] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-22T22:16:59.174527] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-09-22T22:16:59.175666] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-22T22:16:59.177815] [INFO ] [MAIN ] Derivative Progress: 241/2091 symbols completed. BIPJ took 1.1s. Estimated remaining: 12m 5s. Rate: 153.1 symbols/min [2025-09-22T22:16:59.179055] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:59.196299] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:59.197202] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 22270 primary records. [2025-09-22T22:16:59.197598] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-22T22:16:59.228579] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-09-22T22:16:59.233783] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-22T22:16:59.234112] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:16:59.236765] [INFO ] [MAIN ] Derivative Progress: 242/2091 symbols completed. BIT took 1.2s. Estimated remaining: 12m 2s. Rate: 153.7 symbols/min [2025-09-22T22:16:59.238069] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50882 primary records. [2025-09-22T22:16:59.238172] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-22T22:16:59.237176] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:59.268920] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-09-22T22:16:59.269101] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-22T22:16:59.271592] [INFO ] [MAIN ] Derivative Progress: 243/2091 symbols completed. BIRK took 1.2s. Estimated remaining: 11m 59s. Rate: 154.2 symbols/min [2025-09-22T22:16:59.272009] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:16:59.291791] [DEBUG] [LOCAL ] BJ: Loaded 51426 existing records from primary storage. [2025-09-22T22:16:59.292066] [INFO ] [MAIN ] BJ: Loaded 51426 primary data records. [2025-09-22T22:16:59.647785] [DEBUG] [LOCAL ] BK: Loaded 53562 existing records from primary storage. [2025-09-22T22:16:59.648426] [DEBUG] [LOCAL ] BKD: Loaded 50100 existing records from primary storage. [2025-09-22T22:16:59.648734] [INFO ] [MAIN ] BKD: Loaded 50100 primary data records. [2025-09-22T22:16:59.648917] [INFO ] [MAIN ] BK: Loaded 53562 primary data records. [2025-09-22T22:17:00.299782] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:00.301009] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51426 primary records. [2025-09-22T22:17:00.301520] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-22T22:17:00.323927] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-09-22T22:17:00.325196] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-22T22:17:00.336914] [INFO ] [MAIN ] Derivative Progress: 244/2091 symbols completed. BJ took 1.2s. Estimated remaining: 12m 4s. Rate: 153.1 symbols/min [2025-09-22T22:17:00.342740] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:00.342545] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:00.355825] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53562 primary records. [2025-09-22T22:17:00.356355] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-22T22:17:00.357081] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:00.358200] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50100 primary records. [2025-09-22T22:17:00.358511] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-22T22:17:00.390292] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-09-22T22:17:00.390994] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-22T22:17:00.395280] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-09-22T22:17:00.394387] [INFO ] [MAIN ] Derivative Progress: 245/2091 symbols completed. BKD took 1.1s. Estimated remaining: 12m 1s. Rate: 153.7 symbols/min [2025-09-22T22:17:00.395836] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-22T22:17:00.400402] [INFO ] [MAIN ] Derivative Progress: 246/2091 symbols completed. BK took 1.2s. Estimated remaining: 11m 57s. Rate: 154.3 symbols/min [2025-09-22T22:17:00.395932] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:00.400943] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:00.426976] [DEBUG] [LOCAL ] BKE: Loaded 34839 existing records from primary storage. [2025-09-22T22:17:00.427244] [INFO ] [MAIN ] BKE: Loaded 34839 primary data records. [2025-09-22T22:17:00.637887] [DEBUG] [LOCAL ] BKKT: Loaded 34157 existing records from primary storage. [2025-09-22T22:17:00.676246] [INFO ] [MAIN ] BKKT: Loaded 34157 primary data records. [2025-09-22T22:17:00.794965] [DEBUG] [LOCAL ] BKH: Loaded 36644 existing records from primary storage. [2025-09-22T22:17:00.809770] [INFO ] [MAIN ] BKH: Loaded 36644 primary data records. [2025-09-22T22:17:01.784875] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:01.786686] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 34839 primary records. [2025-09-22T22:17:01.787523] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-22T22:17:01.819429] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-09-22T22:17:01.819579] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-22T22:17:01.822254] [INFO ] [MAIN ] Derivative Progress: 247/2091 symbols completed. BKE took 1.5s. Estimated remaining: 12m 5s. Rate: 152.7 symbols/min [2025-09-22T22:17:01.823732] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:01.850209] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:01.855685] [DEBUG] [LOCAL ] BKN: Loaded 7678 existing records from primary storage. [2025-09-22T22:17:01.856182] [INFO ] [MAIN ] BKN: Loaded 7678 primary data records. [2025-09-22T22:17:01.858554] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 34157 primary records. [2025-09-22T22:17:01.890702] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-22T22:17:01.993174] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:02.008618] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36644 primary records. [2025-09-22T22:17:02.028034] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-22T22:17:02.057909] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-09-22T22:17:02.086608] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-22T22:17:02.150322] [INFO ] [MAIN ] Derivative Progress: 248/2091 symbols completed. BKKT took 1.7s. Estimated remaining: 12m 4s. Rate: 152.8 symbols/min [2025-09-22T22:17:02.284884] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:02.275631] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-09-22T22:17:02.286311] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-22T22:17:02.290313] [INFO ] [MAIN ] Derivative Progress: 249/2091 symbols completed. BKH took 1.9s. Estimated remaining: 12m 2s. Rate: 153.1 symbols/min [2025-09-22T22:17:02.291368] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:02.307289] [DEBUG] [LOCAL ] BKT: Loaded 10780 existing records from primary storage. [2025-09-22T22:17:02.307734] [INFO ] [MAIN ] BKT: Loaded 10780 primary data records. [2025-09-22T22:17:02.537809] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:02.659861] [DEBUG] [LOCAL ] BKSY: Loaded 48277 existing records from primary storage. [2025-09-22T22:17:02.661322] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7678 primary records. [2025-09-22T22:17:02.661530] [INFO ] [MAIN ] BKSY: Loaded 48277 primary data records. [2025-09-22T22:17:02.661767] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-22T22:17:02.841005] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-09-22T22:17:02.852371] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-22T22:17:02.969633] [INFO ] [MAIN ] Derivative Progress: 250/2091 symbols completed. BKN took 1.1s. Estimated remaining: 12m 3s. Rate: 152.7 symbols/min [2025-09-22T22:17:03.014892] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:03.038714] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:03.039782] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 10780 primary records. [2025-09-22T22:17:03.040124] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-22T22:17:03.060852] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-09-22T22:17:03.061169] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-22T22:17:03.063910] [INFO ] [MAIN ] Derivative Progress: 251/2091 symbols completed. BKT took 0.8s. Estimated remaining: 12m 1s. Rate: 153.2 symbols/min [2025-09-22T22:17:03.073667] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:03.090868] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:03.091575] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48277 primary records. [2025-09-22T22:17:03.091662] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-22T22:17:03.117460] [DEBUG] [LOCAL ] BKU: Loaded 42017 existing records from primary storage. [2025-09-22T22:17:03.118601] [INFO ] [MAIN ] BKU: Loaded 42017 primary data records. [2025-09-22T22:17:03.219682] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-09-22T22:17:03.246234] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-22T22:17:03.255299] [DEBUG] [LOCAL ] BKV: Loaded 29866 existing records from primary storage. [2025-09-22T22:17:03.265691] [INFO ] [MAIN ] BKV: Loaded 29866 primary data records. [2025-09-22T22:17:03.249169] [INFO ] [MAIN ] Derivative Progress: 252/2091 symbols completed. BKSY took 1.0s. Estimated remaining: 11m 59s. Rate: 153.5 symbols/min [2025-09-22T22:17:03.271190] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:03.817491] [DEBUG] [LOCAL ] BLCO: Loaded 35903 existing records from primary storage. [2025-09-22T22:17:03.817743] [INFO ] [MAIN ] BLCO: Loaded 35903 primary data records. [2025-09-22T22:17:04.144304] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:04.145368] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 42017 primary records. [2025-09-22T22:17:04.145468] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-22T22:17:04.175105] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:04.177594] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29866 primary records. [2025-09-22T22:17:04.178814] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-22T22:17:04.181053] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-09-22T22:17:04.192272] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-22T22:17:04.195724] [INFO ] [MAIN ] Derivative Progress: 253/2091 symbols completed. BKU took 1.2s. Estimated remaining: 12m 3s. Rate: 152.6 symbols/min [2025-09-22T22:17:04.199188] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-09-22T22:17:04.199352] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-22T22:17:04.201791] [INFO ] [MAIN ] Derivative Progress: 254/2091 symbols completed. BKV took 1.1s. Estimated remaining: 11m 59s. Rate: 153.2 symbols/min [2025-09-22T22:17:04.217134] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:04.217671] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35903 primary records. [2025-09-22T22:17:04.217736] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-22T22:17:04.233431] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-09-22T22:17:04.233492] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-22T22:17:04.236223] [INFO ] [MAIN ] Derivative Progress: 255/2091 symbols completed. BLCO took 1.0s. Estimated remaining: 11m 56s. Rate: 153.8 symbols/min [2025-09-22T22:17:04.236940] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:04.237020] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:04.236831] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:04.267935] [DEBUG] [LOCAL ] BLD: Loaded 28136 existing records from primary storage. [2025-09-22T22:17:04.275503] [INFO ] [MAIN ] BLD: Loaded 28136 primary data records. [2025-09-22T22:17:04.412785] [DEBUG] [LOCAL ] BLK: Loaded 35027 existing records from primary storage. [2025-09-22T22:17:04.413118] [INFO ] [MAIN ] BLK: Loaded 35027 primary data records. [2025-09-22T22:17:04.470066] [DEBUG] [LOCAL ] BLDR: Loaded 51653 existing records from primary storage. [2025-09-22T22:17:04.505323] [INFO ] [MAIN ] BLDR: Loaded 51653 primary data records. [2025-09-22T22:17:05.320728] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:05.322078] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 28136 primary records. [2025-09-22T22:17:05.322195] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-22T22:17:05.357594] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:05.359142] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 35027 primary records. [2025-09-22T22:17:05.359459] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-09-22T22:17:05.359562] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-22T22:17:05.359801] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-22T22:17:05.361958] [INFO ] [MAIN ] Derivative Progress: 256/2091 symbols completed. BLD took 1.1s. Estimated remaining: 12m 1s. Rate: 152.6 symbols/min [2025-09-22T22:17:05.376011] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:05.384226] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:05.389069] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51653 primary records. [2025-09-22T22:17:05.389616] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-22T22:17:05.410076] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-09-22T22:17:05.410807] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-22T22:17:05.413375] [INFO ] [MAIN ] Derivative Progress: 257/2091 symbols completed. BLK took 1.2s. Estimated remaining: 11m 58s. Rate: 153.2 symbols/min [2025-09-22T22:17:05.414111] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:05.415838] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-09-22T22:17:05.416175] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-22T22:17:05.419066] [INFO ] [MAIN ] Derivative Progress: 258/2091 symbols completed. BLDR took 1.2s. Estimated remaining: 11m 55s. Rate: 153.8 symbols/min [2025-09-22T22:17:05.419438] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:05.448779] [DEBUG] [LOCAL ] BLW: Loaded 12732 existing records from primary storage. [2025-09-22T22:17:05.448975] [INFO ] [MAIN ] BLW: Loaded 12732 primary data records. [2025-09-22T22:17:05.508778] [DEBUG] [LOCAL ] BLX: Loaded 15777 existing records from primary storage. [2025-09-22T22:17:05.544864] [INFO ] [MAIN ] BLX: Loaded 15777 primary data records. [2025-09-22T22:17:05.683243] [DEBUG] [LOCAL ] BLND: Loaded 49488 existing records from primary storage. [2025-09-22T22:17:05.733963] [INFO ] [MAIN ] BLND: Loaded 49488 primary data records. [2025-09-22T22:17:06.517484] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:06.518388] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:06.519601] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 12732 primary records. [2025-09-22T22:17:06.521050] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-22T22:17:06.520722] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15777 primary records. [2025-09-22T22:17:06.522451] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-22T22:17:06.569403] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:06.571392] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49488 primary records. [2025-09-22T22:17:06.572144] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-22T22:17:06.574668] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-09-22T22:17:06.586394] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-09-22T22:17:06.588743] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-22T22:17:06.592235] [INFO ] [MAIN ] Derivative Progress: 259/2091 symbols completed. BLX took 1.2s. Estimated remaining: 12m 0s. Rate: 152.6 symbols/min [2025-09-22T22:17:06.592927] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:06.596392] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-09-22T22:17:06.596716] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-22T22:17:06.594472] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-22T22:17:06.599749] [INFO ] [MAIN ] Derivative Progress: 260/2091 symbols completed. BLND took 1.2s. Estimated remaining: 11m 57s. Rate: 153.1 symbols/min [2025-09-22T22:17:06.602506] [INFO ] [MAIN ] Derivative Progress: 261/2091 symbols completed. BLW took 1.2s. Estimated remaining: 11m 54s. Rate: 153.7 symbols/min [2025-09-22T22:17:06.602608] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:06.603147] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:06.618365] [DEBUG] [LOCAL ] BME: Loaded 10829 existing records from primary storage. [2025-09-22T22:17:06.618507] [INFO ] [MAIN ] BME: Loaded 10829 primary data records. [2025-09-22T22:17:06.760326] [DEBUG] [LOCAL ] BMEZ: Loaded 26103 existing records from primary storage. [2025-09-22T22:17:06.767088] [INFO ] [MAIN ] BMEZ: Loaded 26103 primary data records. [2025-09-22T22:17:06.783268] [DEBUG] [LOCAL ] BMA: Loaded 34783 existing records from primary storage. [2025-09-22T22:17:06.821770] [INFO ] [MAIN ] BMA: Loaded 34783 primary data records. [2025-09-22T22:17:07.621429] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:07.622767] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 10829 primary records. [2025-09-22T22:17:07.623312] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-22T22:17:07.660635] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:07.675869] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26103 primary records. [2025-09-22T22:17:07.677506] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:07.677153] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-22T22:17:07.680112] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 34783 primary records. [2025-09-22T22:17:07.680522] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-22T22:17:07.689121] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-09-22T22:17:07.694524] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-22T22:17:07.697397] [INFO ] [MAIN ] Derivative Progress: 262/2091 symbols completed. BME took 1.1s. Estimated remaining: 11m 59s. Rate: 152.7 symbols/min [2025-09-22T22:17:07.704993] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:07.716200] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-09-22T22:17:07.716940] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-22T22:17:07.720359] [INFO ] [MAIN ] Derivative Progress: 263/2091 symbols completed. BMA took 1.1s. Estimated remaining: 11m 56s. Rate: 153.2 symbols/min [2025-09-22T22:17:07.721466] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:07.722468] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-09-22T22:17:07.722951] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-22T22:17:07.725745] [INFO ] [MAIN ] Derivative Progress: 264/2091 symbols completed. BMEZ took 1.1s. Estimated remaining: 11m 53s. Rate: 153.8 symbols/min [2025-09-22T22:17:07.726306] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:07.730507] [DEBUG] [LOCAL ] BMN: Loaded 2561 existing records from primary storage. [2025-09-22T22:17:07.730698] [INFO ] [MAIN ] BMN: Loaded 2561 primary data records. [2025-09-22T22:17:07.852358] [DEBUG] [LOCAL ] BMI: Loaded 24070 existing records from primary storage. [2025-09-22T22:17:07.867112] [INFO ] [MAIN ] BMI: Loaded 24070 primary data records. [2025-09-22T22:17:08.323745] [DEBUG] [LOCAL ] BMO: Loaded 41319 existing records from primary storage. [2025-09-22T22:17:08.324870] [INFO ] [MAIN ] BMO: Loaded 41319 primary data records. [2025-09-22T22:17:08.807719] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:08.809370] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2561 primary records. [2025-09-22T22:17:08.809629] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-22T22:17:08.824423] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:08.831636] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24070 primary records. [2025-09-22T22:17:08.836265] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-22T22:17:08.853849] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-09-22T22:17:08.855084] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-22T22:17:08.857968] [INFO ] [MAIN ] Derivative Progress: 265/2091 symbols completed. BMN took 1.1s. Estimated remaining: 11m 57s. Rate: 152.7 symbols/min [2025-09-22T22:17:08.858827] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:08.866825] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-09-22T22:17:08.867045] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-22T22:17:08.869940] [INFO ] [MAIN ] Derivative Progress: 266/2091 symbols completed. BMI took 1.2s. Estimated remaining: 11m 54s. Rate: 153.3 symbols/min [2025-09-22T22:17:08.870500] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:08.884881] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:08.886055] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41319 primary records. [2025-09-22T22:17:08.886172] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-22T22:17:08.906144] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-09-22T22:17:08.906384] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-22T22:17:08.908999] [INFO ] [MAIN ] Derivative Progress: 267/2091 symbols completed. BMO took 1.2s. Estimated remaining: 11m 52s. Rate: 153.8 symbols/min [2025-09-22T22:17:08.909487] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:08.991121] [DEBUG] [LOCAL ] BN: Loaded 52995 existing records from primary storage. [2025-09-22T22:17:08.992212] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-22T22:17:08.992334] [INFO ] [MAIN ] BN: Loaded 52995 primary data records. [2025-09-22T22:17:08.992709] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-09-22T22:17:09.045567] [DEBUG] [LOCAL ] BNED: Loaded 30016 existing records from primary storage. [2025-09-22T22:17:09.088901] [INFO ] [MAIN ] BNED: Loaded 30016 primary data records. [2025-09-22T22:17:09.995884] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:09.998369] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52995 primary records. [2025-09-22T22:17:09.998488] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-22T22:17:10.039832] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:10.040757] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-09-22T22:17:10.041067] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-22T22:17:10.042302] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:10.043392] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 30016 primary records. [2025-09-22T22:17:10.043706] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-22T22:17:10.069575] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-09-22T22:17:10.065574] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-09-22T22:17:10.069739] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-22T22:17:10.072319] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-22T22:17:10.075926] [INFO ] [MAIN ] Derivative Progress: 268/2091 symbols completed. BNED took 1.2s. Estimated remaining: 11m 57s. Rate: 152.7 symbols/min [2025-09-22T22:17:10.078349] [INFO ] [MAIN ] Derivative Progress: 269/2091 symbols completed. BN took 1.2s. Estimated remaining: 11m 53s. Rate: 153.2 symbols/min [2025-09-22T22:17:10.084472] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-09-22T22:17:10.084552] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-22T22:17:10.087442] [INFO ] [MAIN ] Derivative Progress: 270/2091 symbols completed. BMY took 1.2s. Estimated remaining: 11m 51s. Rate: 153.8 symbols/min [2025-09-22T22:17:10.087937] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:10.088144] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:10.088093] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:10.093771] [DEBUG] [LOCAL ] BNJ: Loaded 2577 existing records from primary storage. [2025-09-22T22:17:10.095105] [INFO ] [MAIN ] BNJ: Loaded 2577 primary data records. [2025-09-22T22:17:10.206931] [DEBUG] [LOCAL ] BNH: Loaded 4822 existing records from primary storage. [2025-09-22T22:17:10.221432] [INFO ] [MAIN ] BNH: Loaded 4822 primary data records. [2025-09-22T22:17:10.613764] [DEBUG] [LOCAL ] BNL: Loaded 46906 existing records from primary storage. [2025-09-22T22:17:10.646051] [INFO ] [MAIN ] BNL: Loaded 46906 primary data records. [2025-09-22T22:17:11.094484] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:11.095957] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2577 primary records. [2025-09-22T22:17:11.096186] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-22T22:17:11.114938] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-09-22T22:17:11.123121] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-22T22:17:11.129943] [INFO ] [MAIN ] Derivative Progress: 271/2091 symbols completed. BNJ took 1.0s. Estimated remaining: 11m 55s. Rate: 152.8 symbols/min [2025-09-22T22:17:11.130850] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:11.130603] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:11.131836] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 4822 primary records. [2025-09-22T22:17:11.132235] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-22T22:17:11.149463] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-09-22T22:17:11.149919] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-22T22:17:11.152382] [INFO ] [MAIN ] Derivative Progress: 272/2091 symbols completed. BNH took 1.1s. Estimated remaining: 11m 52s. Rate: 153.4 symbols/min [2025-09-22T22:17:11.153015] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:11.161608] [DEBUG] [LOCAL ] BNT: Loaded 3407 existing records from primary storage. [2025-09-22T22:17:11.174465] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:11.174196] [INFO ] [MAIN ] BNT: Loaded 3407 primary data records. [2025-09-22T22:17:11.180418] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 46906 primary records. [2025-09-22T22:17:11.213352] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-22T22:17:11.366430] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-09-22T22:17:11.420017] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-22T22:17:11.421345] [DEBUG] [LOCAL ] BNS: Loaded 51466 existing records from primary storage. [2025-09-22T22:17:11.539820] [INFO ] [MAIN ] BNS: Loaded 51466 primary data records. [2025-09-22T22:17:11.542723] [INFO ] [MAIN ] Derivative Progress: 273/2091 symbols completed. BNL took 1.5s. Estimated remaining: 11m 51s. Rate: 153.4 symbols/min [2025-09-22T22:17:11.543417] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:11.648133] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-22T22:17:11.669949] [INFO ] [MAIN ] BNY: Loaded 7446 primary data records. [2025-09-22T22:17:12.248478] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:12.249810] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3407 primary records. [2025-09-22T22:17:12.249997] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-22T22:17:12.269113] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-09-22T22:17:12.269555] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-22T22:17:12.271899] [INFO ] [MAIN ] Derivative Progress: 274/2091 symbols completed. BNT took 1.1s. Estimated remaining: 11m 53s. Rate: 152.9 symbols/min [2025-09-22T22:17:12.272488] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:12.290189] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:12.290969] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51466 primary records. [2025-09-22T22:17:12.291193] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-22T22:17:12.312235] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-09-22T22:17:12.312437] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-22T22:17:12.317038] [INFO ] [MAIN ] Derivative Progress: 275/2091 symbols completed. BNS took 1.2s. Estimated remaining: 11m 50s. Rate: 153.4 symbols/min [2025-09-22T22:17:12.325473] [DEBUG] [LOCAL ] BOC: Loaded 18367 existing records from primary storage. [2025-09-22T22:17:12.324518] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:12.325777] [INFO ] [MAIN ] BOC: Loaded 18367 primary data records. [2025-09-22T22:17:12.384330] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:12.430909] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7446 primary records. [2025-09-22T22:17:12.456246] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-22T22:17:12.544395] [DEBUG] [LOCAL ] BOE: Loaded 17665 existing records from primary storage. [2025-09-22T22:17:12.538494] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-09-22T22:17:12.566589] [INFO ] [MAIN ] BOE: Loaded 17665 primary data records. [2025-09-22T22:17:12.676095] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-22T22:17:12.699937] [INFO ] [MAIN ] Derivative Progress: 276/2091 symbols completed. BNY took 1.2s. Estimated remaining: 11m 50s. Rate: 153.4 symbols/min [2025-09-22T22:17:12.726357] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:13.027519] [DEBUG] [LOCAL ] BOH: Loaded 31418 existing records from primary storage. [2025-09-22T22:17:13.028338] [INFO ] [MAIN ] BOH: Loaded 31418 primary data records. [2025-09-22T22:17:13.041062] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:13.041879] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18367 primary records. [2025-09-22T22:17:13.054459] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-22T22:17:13.146847] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-09-22T22:17:13.163533] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-22T22:17:13.165828] [INFO ] [MAIN ] Derivative Progress: 277/2091 symbols completed. BOC took 0.9s. Estimated remaining: 11m 50s. Rate: 153.3 symbols/min [2025-09-22T22:17:13.166234] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:13.389091] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:13.390258] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 17665 primary records. [2025-09-22T22:17:13.391397] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-22T22:17:13.418014] [DEBUG] [LOCAL ] BOND: Loaded 32096 existing records from primary storage. [2025-09-22T22:17:13.420518] [INFO ] [MAIN ] BOND: Loaded 32096 primary data records. [2025-09-22T22:17:13.465850] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-09-22T22:17:13.500154] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-22T22:17:13.527619] [INFO ] [MAIN ] Derivative Progress: 278/2091 symbols completed. BOE took 1.2s. Estimated remaining: 11m 49s. Rate: 153.3 symbols/min [2025-09-22T22:17:13.537614] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:13.738522] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:13.749443] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 31418 primary records. [2025-09-22T22:17:13.749903] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-22T22:17:13.777967] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-09-22T22:17:13.779199] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-22T22:17:13.782444] [INFO ] [MAIN ] Derivative Progress: 279/2091 symbols completed. BOH took 1.1s. Estimated remaining: 11m 48s. Rate: 153.5 symbols/min [2025-09-22T22:17:13.794457] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:13.816406] [DEBUG] [LOCAL ] BOOT: Loaded 41054 existing records from primary storage. [2025-09-22T22:17:13.816841] [INFO ] [MAIN ] BOOT: Loaded 41054 primary data records. [2025-09-22T22:17:13.842321] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:17:13.866512] [INFO ] [MAIN ] BOND: Generated 1793 derivative records from 32096 primary records. [2025-09-22T22:17:13.879774] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-22T22:17:13.966294] [DEBUG] [LOCAL ] BOND: Derivative data saved (1793 records). [2025-09-22T22:17:13.979993] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-22T22:17:13.998704] [INFO ] [MAIN ] Derivative Progress: 280/2091 symbols completed. BOND took 0.8s. Estimated remaining: 11m 47s. Rate: 153.8 symbols/min [2025-09-22T22:17:14.025459] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:14.255342] [DEBUG] [LOCAL ] BORR: Loaded 51168 existing records from primary storage. [2025-09-22T22:17:14.256184] [INFO ] [MAIN ] BORR: Loaded 51168 primary data records. [2025-09-22T22:17:14.419122] [DEBUG] [LOCAL ] BOW: Loaded 23622 existing records from primary storage. [2025-09-22T22:17:14.428523] [INFO ] [MAIN ] BOW: Loaded 23622 primary data records. [2025-09-22T22:17:14.916672] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:14.918479] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 41054 primary records. [2025-09-22T22:17:14.920523] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-22T22:17:14.941490] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-09-22T22:17:14.942985] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-22T22:17:14.945437] [INFO ] [MAIN ] Derivative Progress: 281/2091 symbols completed. BOOT took 1.4s. Estimated remaining: 11m 50s. Rate: 153.0 symbols/min [2025-09-22T22:17:14.948307] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:14.963421] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:14.964388] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51168 primary records. [2025-09-22T22:17:14.964596] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-22T22:17:14.987055] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-09-22T22:17:14.987999] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-22T22:17:14.990389] [INFO ] [MAIN ] Derivative Progress: 282/2091 symbols completed. BORR took 1.2s. Estimated remaining: 11m 47s. Rate: 153.5 symbols/min [2025-09-22T22:17:14.991063] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:15.006442] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:15.007424] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23622 primary records. [2025-09-22T22:17:15.007513] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-22T22:17:15.035200] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-09-22T22:17:15.035433] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-22T22:17:15.038149] [INFO ] [MAIN ] Derivative Progress: 283/2091 symbols completed. BOW took 1.0s. Estimated remaining: 11m 45s. Rate: 153.9 symbols/min [2025-09-22T22:17:15.059591] [DEBUG] [LOCAL ] BOX: Loaded 50341 existing records from primary storage. [2025-09-22T22:17:15.059838] [INFO ] [MAIN ] BOX: Loaded 50341 primary data records. [2025-09-22T22:17:15.400764] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-22T22:17:15.401541] [INFO ] [MAIN ] BP: Loaded 53711 primary data records. [2025-09-22T22:17:15.716562] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:15.717733] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50341 primary records. [2025-09-22T22:17:15.718410] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-22T22:17:15.735126] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-09-22T22:17:15.735215] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-22T22:17:15.737485] [INFO ] [MAIN ] Derivative Progress: 284/2091 symbols completed. BOX took 0.8s. Estimated remaining: 11m 46s. Rate: 153.5 symbols/min [2025-09-22T22:17:15.753838] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:15.754359] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53711 primary records. [2025-09-22T22:17:15.754418] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-22T22:17:15.770058] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-09-22T22:17:15.770142] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-22T22:17:15.773324] [INFO ] [MAIN ] Derivative Progress: 285/2091 symbols completed. BP took 0.8s. Estimated remaining: 11m 44s. Rate: 154.0 symbols/min [2025-09-22T22:17:15.773947] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:15.774220] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:15.774422] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:15.799742] [DEBUG] [LOCAL ] BRC: Loaded 19492 existing records from primary storage. [2025-09-22T22:17:15.799912] [INFO ] [MAIN ] BRC: Loaded 19492 primary data records. [2025-09-22T22:17:16.028049] [DEBUG] [LOCAL ] BR: Loaded 34832 existing records from primary storage. [2025-09-22T22:17:16.052020] [DEBUG] [LOCAL ] BRBR: Loaded 51236 existing records from primary storage. [2025-09-22T22:17:16.050858] [INFO ] [MAIN ] BR: Loaded 34832 primary data records. [2025-09-22T22:17:16.159135] [INFO ] [MAIN ] BRBR: Loaded 51236 primary data records. [2025-09-22T22:17:16.843077] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:16.846064] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 19492 primary records. [2025-09-22T22:17:16.846397] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-22T22:17:16.872443] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-09-22T22:17:16.872957] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-22T22:17:16.876299] [INFO ] [MAIN ] Derivative Progress: 286/2091 symbols completed. BRC took 1.1s. Estimated remaining: 11m 48s. Rate: 153.0 symbols/min [2025-09-22T22:17:16.877244] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:16.893282] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:16.894820] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51236 primary records. [2025-09-22T22:17:16.895148] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-22T22:17:16.917868] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:16.921972] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34832 primary records. [2025-09-22T22:17:16.924961] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-22T22:17:16.927072] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-09-22T22:17:16.934410] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-22T22:17:16.937181] [INFO ] [MAIN ] Derivative Progress: 287/2091 symbols completed. BRBR took 1.2s. Estimated remaining: 11m 45s. Rate: 153.5 symbols/min [2025-09-22T22:17:16.944826] [INFO ] [MAIN ] BRFS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:16.945973] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-09-22T22:17:16.946324] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-22T22:17:16.949800] [INFO ] [MAIN ] Derivative Progress: 288/2091 symbols completed. BR took 1.2s. Estimated remaining: 11m 42s. Rate: 154.0 symbols/min [2025-09-22T22:17:16.950362] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:16.998259] [DEBUG] [LOCAL ] BRCC: Loaded 40430 existing records from primary storage. [2025-09-22T22:17:16.998476] [INFO ] [MAIN ] BRCC: Loaded 40430 primary data records. [2025-09-22T22:17:17.108830] [DEBUG] [LOCAL ] BRFS: Loaded 41050 existing records from primary storage. [2025-09-22T22:17:17.119386] [INFO ] [MAIN ] BRFS: Loaded 41050 primary data records. [2025-09-22T22:17:17.270499] [DEBUG] [LOCAL ] BRO: Loaded 51919 existing records from primary storage. [2025-09-22T22:17:17.305335] [INFO ] [MAIN ] BRO: Loaded 51919 primary data records. [2025-09-22T22:17:18.085898] [DEBUG] [MAIN ] BRFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:18.086513] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:18.087331] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40430 primary records. [2025-09-22T22:17:18.087552] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-22T22:17:18.088234] [INFO ] [MAIN ] BRFS: Generated 1794 derivative records from 41050 primary records. [2025-09-22T22:17:18.088609] [DEBUG] [LOCAL ] BRFS: Saving derivative data. [2025-09-22T22:17:18.117115] [DEBUG] [LOCAL ] BRFS: Derivative data saved (1794 records). [2025-09-22T22:17:18.117452] [INFO ] [MAIN ] BRFS: Successfully saved derivative data. [2025-09-22T22:17:18.120515] [INFO ] [MAIN ] Derivative Progress: 289/2091 symbols completed. BRFS took 1.2s. Estimated remaining: 11m 47s. Rate: 152.9 symbols/min [2025-09-22T22:17:18.121088] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:18.126077] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-09-22T22:17:18.126874] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-22T22:17:18.130213] [INFO ] [MAIN ] Derivative Progress: 290/2091 symbols completed. BRCC took 1.3s. Estimated remaining: 11m 44s. Rate: 153.5 symbols/min [2025-09-22T22:17:18.131166] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:18.145085] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:18.145854] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 51919 primary records. [2025-09-22T22:17:18.145989] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-22T22:17:18.163256] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-09-22T22:17:18.163362] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-22T22:17:18.166137] [INFO ] [MAIN ] Derivative Progress: 291/2091 symbols completed. BRO took 1.2s. Estimated remaining: 11m 42s. Rate: 153.9 symbols/min [2025-09-22T22:17:18.166524] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:18.182781] [DEBUG] [LOCAL ] BRT: Loaded 4876 existing records from primary storage. [2025-09-22T22:17:18.182986] [INFO ] [MAIN ] BRT: Loaded 4876 primary data records. [2025-09-22T22:17:18.311091] [DEBUG] [LOCAL ] BRSP: Loaded 36916 existing records from primary storage. [2025-09-22T22:17:18.315163] [INFO ] [MAIN ] BRSP: Loaded 36916 primary data records. [2025-09-22T22:17:18.515583] [DEBUG] [LOCAL ] BROS: Loaded 53287 existing records from primary storage. [2025-09-22T22:17:18.645069] [INFO ] [MAIN ] BROS: Loaded 53287 primary data records. [2025-09-22T22:17:19.171034] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:19.173759] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 4876 primary records. [2025-09-22T22:17:19.175512] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-22T22:17:19.204898] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:19.206135] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-09-22T22:17:19.207271] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-22T22:17:19.211369] [INFO ] [MAIN ] Derivative Progress: 292/2091 symbols completed. BRT took 1.0s. Estimated remaining: 11m 45s. Rate: 153.0 symbols/min [2025-09-22T22:17:19.213434] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36916 primary records. [2025-09-22T22:17:19.214156] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-22T22:17:19.214628] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:19.239660] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:19.240609] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53287 primary records. [2025-09-22T22:17:19.243772] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-22T22:17:19.244840] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-09-22T22:17:19.245707] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-22T22:17:19.250029] [INFO ] [MAIN ] Derivative Progress: 293/2091 symbols completed. BRSP took 1.1s. Estimated remaining: 11m 43s. Rate: 153.5 symbols/min [2025-09-22T22:17:19.265379] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-09-22T22:17:19.265483] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:19.265636] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-22T22:17:19.275211] [INFO ] [MAIN ] Derivative Progress: 294/2091 symbols completed. BROS took 1.2s. Estimated remaining: 11m 40s. Rate: 154.0 symbols/min [2025-09-22T22:17:19.275675] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:19.285266] [DEBUG] [LOCAL ] BRW: Loaded 19139 existing records from primary storage. [2025-09-22T22:17:19.287941] [INFO ] [MAIN ] BRW: Loaded 19139 primary data records. [2025-09-22T22:17:19.338206] [DEBUG] [LOCAL ] BSL: Loaded 7898 existing records from primary storage. [2025-09-22T22:17:19.372616] [INFO ] [MAIN ] BSL: Loaded 7898 primary data records. [2025-09-22T22:17:19.826489] [DEBUG] [LOCAL ] BRX: Loaded 51826 existing records from primary storage. [2025-09-22T22:17:19.833523] [INFO ] [MAIN ] BRX: Loaded 51826 primary data records. [2025-09-22T22:17:20.373985] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:20.384273] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 19139 primary records. [2025-09-22T22:17:20.384464] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-22T22:17:20.404729] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-09-22T22:17:20.405305] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-22T22:17:20.408129] [INFO ] [MAIN ] Derivative Progress: 295/2091 symbols completed. BRW took 1.2s. Estimated remaining: 11m 44s. Rate: 153.0 symbols/min [2025-09-22T22:17:20.421677] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:20.422600] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:20.423488] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 7898 primary records. [2025-09-22T22:17:20.423961] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-22T22:17:20.441905] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-09-22T22:17:20.442208] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-22T22:17:20.444583] [INFO ] [MAIN ] Derivative Progress: 296/2091 symbols completed. BSL took 1.2s. Estimated remaining: 11m 42s. Rate: 153.5 symbols/min [2025-09-22T22:17:20.445196] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:20.462459] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:20.473137] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51826 primary records. [2025-09-22T22:17:20.473406] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-22T22:17:20.494811] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-09-22T22:17:20.509311] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-22T22:17:20.515030] [INFO ] [MAIN ] Derivative Progress: 297/2091 symbols completed. BRX took 1.3s. Estimated remaining: 11m 39s. Rate: 153.9 symbols/min [2025-09-22T22:17:20.511843] [DEBUG] [LOCAL ] BST: Loaded 19306 existing records from primary storage. [2025-09-22T22:17:20.515512] [INFO ] [MAIN ] BST: Loaded 19306 primary data records. [2025-09-22T22:17:20.516632] [DEBUG] [LOCAL ] BSM: Loaded 32330 existing records from primary storage. [2025-09-22T22:17:20.521909] [INFO ] [MAIN ] BSM: Loaded 32330 primary data records. [2025-09-22T22:17:20.515421] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:20.869636] [DEBUG] [LOCAL ] BSTZ: Loaded 24927 existing records from primary storage. [2025-09-22T22:17:21.043678] [INFO ] [MAIN ] BSTZ: Loaded 24927 primary data records. [2025-09-22T22:17:21.506397] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:21.509201] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32330 primary records. [2025-09-22T22:17:21.509497] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-22T22:17:21.538312] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:21.539243] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 19306 primary records. [2025-09-22T22:17:21.539562] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-22T22:17:21.554766] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-09-22T22:17:21.558913] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-09-22T22:17:21.559192] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-22T22:17:21.559132] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-22T22:17:21.561962] [INFO ] [MAIN ] Derivative Progress: 298/2091 symbols completed. BSM took 1.2s. Estimated remaining: 11m 43s. Rate: 153.1 symbols/min [2025-09-22T22:17:21.565237] [INFO ] [MAIN ] Derivative Progress: 299/2091 symbols completed. BST took 1.1s. Estimated remaining: 11m 40s. Rate: 153.6 symbols/min [2025-09-22T22:17:21.580117] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:21.580779] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 24927 primary records. [2025-09-22T22:17:21.580843] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-22T22:17:21.596420] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-09-22T22:17:21.596488] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-22T22:17:21.599159] [INFO ] [MAIN ] Derivative Progress: 300/2091 symbols completed. BSTZ took 1.1s. Estimated remaining: 11m 38s. Rate: 154.0 symbols/min [2025-09-22T22:17:21.600103] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:21.600017] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:21.599812] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:21.608856] [DEBUG] [LOCAL ] BTA: Loaded 5290 existing records from primary storage. [2025-09-22T22:17:21.608991] [INFO ] [MAIN ] BTA: Loaded 5290 primary data records. [2025-09-22T22:17:21.699692] [DEBUG] [LOCAL ] BTCM: Loaded 14601 existing records from primary storage. [2025-09-22T22:17:21.706554] [INFO ] [MAIN ] BTCM: Loaded 14601 primary data records. [2025-09-22T22:17:22.091057] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-22T22:17:22.113305] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-09-22T22:17:22.667774] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:22.669576] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5290 primary records. [2025-09-22T22:17:22.669990] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-22T22:17:22.703100] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-09-22T22:17:22.708037] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-22T22:17:22.715818] [INFO ] [MAIN ] Derivative Progress: 301/2091 symbols completed. BTA took 1.1s. Estimated remaining: 11m 42s. Rate: 153.1 symbols/min [2025-09-22T22:17:22.717066] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:22.716525] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:22.718261] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 14601 primary records. [2025-09-22T22:17:22.718473] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-22T22:17:22.752039] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-09-22T22:17:22.752432] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-22T22:17:22.752768] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:22.753757] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-09-22T22:17:22.760350] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-22T22:17:22.760220] [INFO ] [MAIN ] Derivative Progress: 302/2091 symbols completed. BTCM took 1.2s. Estimated remaining: 11m 39s. Rate: 153.5 symbols/min [2025-09-22T22:17:22.761336] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:22.778931] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-09-22T22:17:22.779201] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-22T22:17:22.787610] [INFO ] [MAIN ] Derivative Progress: 303/2091 symbols completed. BSX took 1.2s. Estimated remaining: 11m 37s. Rate: 154.0 symbols/min [2025-09-22T22:17:22.788051] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:22.794360] [DEBUG] [LOCAL ] BTO: Loaded 8965 existing records from primary storage. [2025-09-22T22:17:22.794587] [INFO ] [MAIN ] BTO: Loaded 8965 primary data records. [2025-09-22T22:17:22.946445] [DEBUG] [LOCAL ] BTT: Loaded 16021 existing records from primary storage. [2025-09-22T22:17:22.966483] [INFO ] [MAIN ] BTT: Loaded 16021 primary data records. [2025-09-22T22:17:22.999270] [DEBUG] [LOCAL ] BTE: Loaded 52748 existing records from primary storage. [2025-09-22T22:17:23.023247] [INFO ] [MAIN ] BTE: Loaded 52748 primary data records. [2025-09-22T22:17:23.852376] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:23.853184] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8965 primary records. [2025-09-22T22:17:23.853529] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-22T22:17:23.887254] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:23.903004] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-09-22T22:17:23.903575] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:23.903749] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-22T22:17:23.905986] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52748 primary records. [2025-09-22T22:17:23.906083] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-22T22:17:23.905003] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 16021 primary records. [2025-09-22T22:17:23.908736] [INFO ] [MAIN ] Derivative Progress: 304/2091 symbols completed. BTO took 1.1s. Estimated remaining: 11m 41s. Rate: 153.1 symbols/min [2025-09-22T22:17:23.909822] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:23.909633] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-22T22:17:23.935768] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-09-22T22:17:23.940913] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-22T22:17:23.943910] [INFO ] [MAIN ] Derivative Progress: 305/2091 symbols completed. BTE took 1.2s. Estimated remaining: 11m 38s. Rate: 153.5 symbols/min [2025-09-22T22:17:23.946079] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:23.951165] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-09-22T22:17:23.951415] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-22T22:17:23.954339] [INFO ] [MAIN ] Derivative Progress: 306/2091 symbols completed. BTT took 1.2s. Estimated remaining: 11m 35s. Rate: 154.0 symbols/min [2025-09-22T22:17:23.954844] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:23.987056] [DEBUG] [LOCAL ] BTZ: Loaded 22906 existing records from primary storage. [2025-09-22T22:17:23.987205] [INFO ] [MAIN ] BTZ: Loaded 22906 primary data records. [2025-09-22T22:17:24.156424] [DEBUG] [LOCAL ] BTU: Loaded 53303 existing records from primary storage. [2025-09-22T22:17:24.200380] [INFO ] [MAIN ] BTU: Loaded 53303 primary data records. [2025-09-22T22:17:24.424740] [DEBUG] [LOCAL ] BUD: Loaded 52752 existing records from primary storage. [2025-09-22T22:17:24.433455] [INFO ] [MAIN ] BUD: Loaded 52752 primary data records. [2025-09-22T22:17:25.104802] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:25.106528] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22906 primary records. [2025-09-22T22:17:25.106804] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-22T22:17:25.126071] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-09-22T22:17:25.126158] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-22T22:17:25.129514] [INFO ] [MAIN ] Derivative Progress: 307/2091 symbols completed. BTZ took 1.2s. Estimated remaining: 11m 40s. Rate: 153.0 symbols/min [2025-09-22T22:17:25.129931] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:25.149746] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:25.150569] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53303 primary records. [2025-09-22T22:17:25.150847] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-22T22:17:25.176026] [DEBUG] [LOCAL ] BUI: Loaded 11478 existing records from primary storage. [2025-09-22T22:17:25.177329] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-09-22T22:17:25.177577] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-22T22:17:25.177679] [INFO ] [MAIN ] BUI: Loaded 11478 primary data records. [2025-09-22T22:17:25.179971] [INFO ] [MAIN ] Derivative Progress: 308/2091 symbols completed. BTU took 1.3s. Estimated remaining: 11m 37s. Rate: 153.4 symbols/min [2025-09-22T22:17:25.193282] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:25.294464] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:25.307636] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52752 primary records. [2025-09-22T22:17:25.308194] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-22T22:17:25.536605] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-09-22T22:17:25.537563] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-22T22:17:25.541127] [INFO ] [MAIN ] Derivative Progress: 309/2091 symbols completed. BUD took 1.6s. Estimated remaining: 11m 37s. Rate: 153.5 symbols/min [2025-09-22T22:17:25.555340] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:25.557148] [DEBUG] [LOCAL ] BUR: Loaded 45095 existing records from primary storage. [2025-09-22T22:17:25.557608] [INFO ] [MAIN ] BUR: Loaded 45095 primary data records. [2025-09-22T22:17:25.900137] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:25.902746] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11478 primary records. [2025-09-22T22:17:25.903866] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-22T22:17:25.903786] [DEBUG] [LOCAL ] BURL: Loaded 46416 existing records from primary storage. [2025-09-22T22:17:25.905278] [INFO ] [MAIN ] BURL: Loaded 46416 primary data records. [2025-09-22T22:17:25.991678] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-09-22T22:17:26.003340] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-22T22:17:26.024134] [INFO ] [MAIN ] Derivative Progress: 310/2091 symbols completed. BUI took 0.9s. Estimated remaining: 11m 37s. Rate: 153.4 symbols/min [2025-09-22T22:17:26.029673] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:26.244776] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:26.246129] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45095 primary records. [2025-09-22T22:17:26.246328] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-22T22:17:26.252686] [DEBUG] [LOCAL ] BUXX: Loaded 15166 existing records from primary storage. [2025-09-22T22:17:26.253451] [INFO ] [MAIN ] BUXX: Loaded 15166 primary data records. [2025-09-22T22:17:26.348771] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-09-22T22:17:26.365704] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-22T22:17:26.379523] [INFO ] [MAIN ] Derivative Progress: 311/2091 symbols completed. BUR took 1.2s. Estimated remaining: 11m 36s. Rate: 153.4 symbols/min [2025-09-22T22:17:26.380041] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:26.644769] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:26.645749] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 46416 primary records. [2025-09-22T22:17:26.646120] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-22T22:17:26.675304] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-09-22T22:17:26.676256] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-22T22:17:26.681051] [INFO ] [MAIN ] Derivative Progress: 312/2091 symbols completed. BURL took 1.1s. Estimated remaining: 11m 35s. Rate: 153.5 symbols/min [2025-09-22T22:17:26.682077] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:26.707945] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:17:26.707773] [DEBUG] [LOCAL ] BV: Loaded 38631 existing records from primary storage. [2025-09-22T22:17:26.708086] [INFO ] [MAIN ] BV: Loaded 38631 primary data records. [2025-09-22T22:17:26.708856] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15166 primary records. [2025-09-22T22:17:26.720100] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-22T22:17:26.856625] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-09-22T22:17:26.871132] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-22T22:17:26.900201] [INFO ] [MAIN ] Derivative Progress: 313/2091 symbols completed. BUXX took 0.9s. Estimated remaining: 11m 34s. Rate: 153.7 symbols/min [2025-09-22T22:17:27.061947] [DEBUG] [LOCAL ] BVN: Loaded 43798 existing records from primary storage. [2025-09-22T22:17:27.062117] [INFO ] [MAIN ] BVN: Loaded 43798 primary data records. [2025-09-22T22:17:27.379010] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:27.380043] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38631 primary records. [2025-09-22T22:17:27.380119] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-22T22:17:27.397884] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-09-22T22:17:27.397967] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-22T22:17:27.400118] [INFO ] [MAIN ] Derivative Progress: 314/2091 symbols completed. BV took 1.0s. Estimated remaining: 11m 34s. Rate: 153.6 symbols/min [2025-09-22T22:17:27.416322] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:27.416896] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 43798 primary records. [2025-09-22T22:17:27.416957] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-22T22:17:27.432245] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-09-22T22:17:27.432307] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-22T22:17:27.435108] [INFO ] [MAIN ] Derivative Progress: 315/2091 symbols completed. BVN took 0.8s. Estimated remaining: 11m 32s. Rate: 154.0 symbols/min [2025-09-22T22:17:27.435887] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:27.436040] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:27.436549] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:27.450762] [DEBUG] [LOCAL ] BWG: Loaded 12327 existing records from primary storage. [2025-09-22T22:17:27.450893] [INFO ] [MAIN ] BWG: Loaded 12327 primary data records. [2025-09-22T22:17:27.683462] [DEBUG] [LOCAL ] BW: Loaded 39509 existing records from primary storage. [2025-09-22T22:17:27.791355] [INFO ] [MAIN ] BW: Loaded 39509 primary data records. [2025-09-22T22:17:27.916350] [DEBUG] [LOCAL ] BWA: Loaded 52257 existing records from primary storage. [2025-09-22T22:17:27.929384] [INFO ] [MAIN ] BWA: Loaded 52257 primary data records. [2025-09-22T22:17:28.489586] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:28.492058] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12327 primary records. [2025-09-22T22:17:28.492475] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-22T22:17:28.509941] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-09-22T22:17:28.510217] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-22T22:17:28.512926] [INFO ] [MAIN ] Derivative Progress: 316/2091 symbols completed. BWG took 1.1s. Estimated remaining: 11m 35s. Rate: 153.2 symbols/min [2025-09-22T22:17:28.513468] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:28.532972] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:28.533823] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 39509 primary records. [2025-09-22T22:17:28.533916] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-22T22:17:28.552516] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-09-22T22:17:28.560270] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-22T22:17:28.574952] [INFO ] [MAIN ] Derivative Progress: 317/2091 symbols completed. BW took 1.1s. Estimated remaining: 11m 33s. Rate: 153.6 symbols/min [2025-09-22T22:17:28.573023] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:28.576170] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52257 primary records. [2025-09-22T22:17:28.576310] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-22T22:17:28.575212] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:28.601894] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-09-22T22:17:28.603714] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-22T22:17:28.609086] [DEBUG] [LOCAL ] BWLP: Loaded 32842 existing records from primary storage. [2025-09-22T22:17:28.607941] [INFO ] [MAIN ] Derivative Progress: 318/2091 symbols completed. BWA took 1.2s. Estimated remaining: 11m 31s. Rate: 154.0 symbols/min [2025-09-22T22:17:28.609307] [INFO ] [MAIN ] BWLP: Loaded 32842 primary data records. [2025-09-22T22:17:28.609527] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:28.650069] [DEBUG] [LOCAL ] BWMX: Loaded 7613 existing records from primary storage. [2025-09-22T22:17:28.657214] [INFO ] [MAIN ] BWMX: Loaded 7613 primary data records. [2025-09-22T22:17:28.802708] [DEBUG] [LOCAL ] BWNB: Loaded 4485 existing records from primary storage. [2025-09-22T22:17:28.815262] [INFO ] [MAIN ] BWNB: Loaded 4485 primary data records. [2025-09-22T22:17:29.568805] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:29.570257] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32842 primary records. [2025-09-22T22:17:29.570559] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-22T22:17:29.592351] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-09-22T22:17:29.596763] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-22T22:17:29.619966] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:29.619556] [INFO ] [MAIN ] Derivative Progress: 319/2091 symbols completed. BWLP took 1.1s. Estimated remaining: 11m 34s. Rate: 153.3 symbols/min [2025-09-22T22:17:29.620578] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:29.622238] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4485 primary records. [2025-09-22T22:17:29.620287] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:29.621336] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7613 primary records. [2025-09-22T22:17:29.622453] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-22T22:17:29.622793] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-22T22:17:29.650998] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-09-22T22:17:29.651570] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-22T22:17:29.655270] [INFO ] [MAIN ] Derivative Progress: 320/2091 symbols completed. BWMX took 1.1s. Estimated remaining: 11m 31s. Rate: 153.7 symbols/min [2025-09-22T22:17:29.657926] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:29.659969] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-09-22T22:17:29.660082] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-22T22:17:29.662958] [INFO ] [MAIN ] Derivative Progress: 321/2091 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 29s. Rate: 154.2 symbols/min [2025-09-22T22:17:29.663525] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:29.744399] [DEBUG] [LOCAL ] BXMT: Loaded 47231 existing records from primary storage. [2025-09-22T22:17:29.745751] [INFO ] [MAIN ] BXMT: Loaded 47231 primary data records. [2025-09-22T22:17:29.823023] [DEBUG] [LOCAL ] BX: Loaded 53501 existing records from primary storage. [2025-09-22T22:17:29.855960] [INFO ] [MAIN ] BX: Loaded 53501 primary data records. [2025-09-22T22:17:29.861859] [DEBUG] [LOCAL ] BXP: Loaded 49824 existing records from primary storage. [2025-09-22T22:17:29.887500] [INFO ] [MAIN ] BXP: Loaded 49824 primary data records. [2025-09-22T22:17:30.740132] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:30.741720] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47231 primary records. [2025-09-22T22:17:30.742032] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-22T22:17:30.773460] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-09-22T22:17:30.773394] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:30.774224] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53501 primary records. [2025-09-22T22:17:30.774390] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-22T22:17:30.774327] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-22T22:17:30.776239] [INFO ] [MAIN ] Derivative Progress: 322/2091 symbols completed. BXMT took 1.1s. Estimated remaining: 11m 32s. Rate: 153.3 symbols/min [2025-09-22T22:17:30.783905] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:30.789032] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:30.790810] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49824 primary records. [2025-09-22T22:17:30.791094] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-22T22:17:30.807009] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-09-22T22:17:30.807114] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-22T22:17:30.809604] [INFO ] [MAIN ] Derivative Progress: 323/2091 symbols completed. BX took 1.2s. Estimated remaining: 11m 30s. Rate: 153.7 symbols/min [2025-09-22T22:17:30.820817] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:30.825229] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-09-22T22:17:30.825301] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-22T22:17:30.828191] [INFO ] [MAIN ] Derivative Progress: 324/2091 symbols completed. BXP took 1.2s. Estimated remaining: 11m 28s. Rate: 154.2 symbols/min [2025-09-22T22:17:30.828604] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:30.849730] [DEBUG] [LOCAL ] BY: Loaded 21511 existing records from primary storage. [2025-09-22T22:17:30.849870] [INFO ] [MAIN ] BY: Loaded 21511 primary data records. [2025-09-22T22:17:31.014168] [DEBUG] [LOCAL ] BXSL: Loaded 47462 existing records from primary storage. [2025-09-22T22:17:31.065904] [INFO ] [MAIN ] BXSL: Loaded 47462 primary data records. [2025-09-22T22:17:31.294852] [DEBUG] [LOCAL ] BYD: Loaded 45355 existing records from primary storage. [2025-09-22T22:17:31.298471] [INFO ] [MAIN ] BYD: Loaded 45355 primary data records. [2025-09-22T22:17:31.813061] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:31.813918] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21511 primary records. [2025-09-22T22:17:31.814379] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-22T22:17:31.836392] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-09-22T22:17:31.836749] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-22T22:17:31.839360] [INFO ] [MAIN ] Derivative Progress: 325/2091 symbols completed. BY took 1.0s. Estimated remaining: 11m 31s. Rate: 153.4 symbols/min [2025-09-22T22:17:31.840015] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:31.859017] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:31.859951] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47462 primary records. [2025-09-22T22:17:31.863054] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-22T22:17:31.881214] [DEBUG] [LOCAL ] BYM: Loaded 12167 existing records from primary storage. [2025-09-22T22:17:31.882199] [INFO ] [MAIN ] BYM: Loaded 12167 primary data records. [2025-09-22T22:17:31.940667] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-09-22T22:17:31.950415] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-22T22:17:31.998157] [INFO ] [MAIN ] Derivative Progress: 326/2091 symbols completed. BXSL took 1.2s. Estimated remaining: 11m 29s. Rate: 153.7 symbols/min [2025-09-22T22:17:32.003895] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:32.011272] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:32.023550] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 45355 primary records. [2025-09-22T22:17:32.023719] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-22T22:17:32.251786] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-09-22T22:17:32.252789] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-22T22:17:32.255764] [INFO ] [MAIN ] Derivative Progress: 327/2091 symbols completed. BYD took 1.4s. Estimated remaining: 11m 28s. Rate: 153.9 symbols/min [2025-09-22T22:17:32.256407] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:32.284156] [DEBUG] [LOCAL ] BZH: Loaded 32788 existing records from primary storage. [2025-09-22T22:17:32.284665] [INFO ] [MAIN ] BZH: Loaded 32788 primary data records. [2025-09-22T22:17:32.440491] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:32.497768] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 12167 primary records. [2025-09-22T22:17:32.638437] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-22T22:17:32.666543] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-22T22:17:32.666727] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-09-22T22:17:32.750967] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-09-22T22:17:32.768271] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-22T22:17:32.775402] [INFO ] [MAIN ] Derivative Progress: 328/2091 symbols completed. BYM took 0.9s. Estimated remaining: 11m 28s. Rate: 153.7 symbols/min [2025-09-22T22:17:33.006365] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:33.007391] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32788 primary records. [2025-09-22T22:17:33.007581] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-22T22:17:33.025719] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-09-22T22:17:33.025941] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-22T22:17:33.028245] [INFO ] [MAIN ] Derivative Progress: 329/2091 symbols completed. BZH took 1.0s. Estimated remaining: 11m 27s. Rate: 153.9 symbols/min [2025-09-22T22:17:33.043298] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:33.043908] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53741 primary records. [2025-09-22T22:17:33.043971] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-22T22:17:33.059038] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-09-22T22:17:33.059096] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-22T22:17:33.061062] [INFO ] [MAIN ] Derivative Progress: 330/2091 symbols completed. C took 0.8s. Estimated remaining: 11m 25s. Rate: 154.3 symbols/min [2025-09-22T22:17:33.061875] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:33.061700] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:33.061765] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:33.092893] [DEBUG] [LOCAL ] CAAP: Loaded 19303 existing records from primary storage. [2025-09-22T22:17:33.092419] [DEBUG] [LOCAL ] CABO: Loaded 17506 existing records from primary storage. [2025-09-22T22:17:33.093186] [INFO ] [MAIN ] CAAP: Loaded 19303 primary data records. [2025-09-22T22:17:33.093124] [INFO ] [MAIN ] CABO: Loaded 17506 primary data records. [2025-09-22T22:17:33.613934] [DEBUG] [LOCAL ] CADE: Loaded 48797 existing records from primary storage. [2025-09-22T22:17:33.721132] [INFO ] [MAIN ] CADE: Loaded 48797 primary data records. [2025-09-22T22:17:34.062734] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:34.064091] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19303 primary records. [2025-09-22T22:17:34.064608] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-22T22:17:34.083914] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-09-22T22:17:34.084078] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-22T22:17:34.098465] [INFO ] [MAIN ] Derivative Progress: 331/2091 symbols completed. CAAP took 1.0s. Estimated remaining: 11m 28s. Rate: 153.5 symbols/min [2025-09-22T22:17:34.100197] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:34.100527] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:34.101330] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 17506 primary records. [2025-09-22T22:17:34.101544] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-22T22:17:34.121835] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-09-22T22:17:34.122086] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-22T22:17:34.124297] [INFO ] [MAIN ] Derivative Progress: 332/2091 symbols completed. CABO took 1.1s. Estimated remaining: 11m 26s. Rate: 154.0 symbols/min [2025-09-22T22:17:34.124800] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:34.138056] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:34.139008] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 48797 primary records. [2025-09-22T22:17:34.139233] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-22T22:17:34.163845] [DEBUG] [LOCAL ] CAF: Loaded 3423 existing records from primary storage. [2025-09-22T22:17:34.166478] [INFO ] [MAIN ] CAF: Loaded 3423 primary data records. [2025-09-22T22:17:34.204107] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-09-22T22:17:34.224854] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-22T22:17:34.249217] [INFO ] [MAIN ] Derivative Progress: 333/2091 symbols completed. CADE took 1.2s. Estimated remaining: 11m 24s. Rate: 154.3 symbols/min [2025-09-22T22:17:34.299456] [DEBUG] [LOCAL ] CAE: Loaded 38913 existing records from primary storage. [2025-09-22T22:17:34.320243] [INFO ] [MAIN ] CAE: Loaded 38913 primary data records. [2025-09-22T22:17:34.299542] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:34.869092] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:34.870230] [DEBUG] [LOCAL ] CAG: Loaded 53659 existing records from primary storage. [2025-09-22T22:17:34.871070] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3423 primary records. [2025-09-22T22:17:34.871314] [INFO ] [MAIN ] CAG: Loaded 53659 primary data records. [2025-09-22T22:17:34.871261] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-22T22:17:35.019218] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-09-22T22:17:35.033514] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-22T22:17:35.080408] [INFO ] [MAIN ] Derivative Progress: 334/2091 symbols completed. CAF took 1.0s. Estimated remaining: 11m 26s. Rate: 153.7 symbols/min [2025-09-22T22:17:35.085806] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:35.087299] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:35.087025] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 38913 primary records. [2025-09-22T22:17:35.087472] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-22T22:17:35.223206] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-09-22T22:17:35.223691] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-22T22:17:35.226200] [INFO ] [MAIN ] Derivative Progress: 335/2091 symbols completed. CAE took 1.1s. Estimated remaining: 11m 24s. Rate: 154.0 symbols/min [2025-09-22T22:17:35.227228] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:35.252434] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:35.253505] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53659 primary records. [2025-09-22T22:17:35.253725] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-22T22:17:35.286037] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-09-22T22:17:35.295613] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-22T22:17:35.297895] [INFO ] [MAIN ] Derivative Progress: 336/2091 symbols completed. CAG took 1.0s. Estimated remaining: 11m 22s. Rate: 154.4 symbols/min [2025-09-22T22:17:35.298359] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:35.314625] [DEBUG] [LOCAL ] CAH: Loaded 51466 existing records from primary storage. [2025-09-22T22:17:35.314802] [INFO ] [MAIN ] CAH: Loaded 51466 primary data records. [2025-09-22T22:17:35.432230] [DEBUG] [LOCAL ] CAL: Loaded 43280 existing records from primary storage. [2025-09-22T22:17:35.432474] [INFO ] [MAIN ] CAL: Loaded 43280 primary data records. [2025-09-22T22:17:35.781362] [DEBUG] [LOCAL ] CALX: Loaded 38657 existing records from primary storage. [2025-09-22T22:17:35.798395] [INFO ] [MAIN ] CALX: Loaded 38657 primary data records. [2025-09-22T22:17:36.347301] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:36.349384] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51466 primary records. [2025-09-22T22:17:36.349557] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-22T22:17:36.378808] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-09-22T22:17:36.379152] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-22T22:17:36.379425] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:36.381889] [INFO ] [MAIN ] Derivative Progress: 337/2091 symbols completed. CAH took 1.3s. Estimated remaining: 11m 25s. Rate: 153.6 symbols/min [2025-09-22T22:17:36.382885] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43280 primary records. [2025-09-22T22:17:36.383332] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:36.383086] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-22T22:17:36.401194] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-09-22T22:17:36.401314] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-22T22:17:36.403274] [INFO ] [MAIN ] Derivative Progress: 338/2091 symbols completed. CAL took 1.2s. Estimated remaining: 11m 23s. Rate: 154.0 symbols/min [2025-09-22T22:17:36.403699] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:36.429063] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:36.429920] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 38657 primary records. [2025-09-22T22:17:36.430045] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-22T22:17:36.433801] [DEBUG] [LOCAL ] CAPL: Loaded 5880 existing records from primary storage. [2025-09-22T22:17:36.434099] [INFO ] [MAIN ] CAPL: Loaded 5880 primary data records. [2025-09-22T22:17:36.512487] [DEBUG] [LOCAL ] CANG: Loaded 26659 existing records from primary storage. [2025-09-22T22:17:36.499752] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-09-22T22:17:36.521408] [INFO ] [MAIN ] CANG: Loaded 26659 primary data records. [2025-09-22T22:17:36.526719] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-22T22:17:36.556293] [INFO ] [MAIN ] Derivative Progress: 339/2091 symbols completed. CALX took 1.3s. Estimated remaining: 11m 21s. Rate: 154.3 symbols/min [2025-09-22T22:17:36.587524] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:37.094027] [DEBUG] [LOCAL ] CARR: Loaded 53596 existing records from primary storage. [2025-09-22T22:17:37.094735] [INFO ] [MAIN ] CARR: Loaded 53596 primary data records. [2025-09-22T22:17:37.237583] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:37.293914] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5880 primary records. [2025-09-22T22:17:37.421458] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-22T22:17:37.421372] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:37.422974] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26659 primary records. [2025-09-22T22:17:37.423149] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-22T22:17:37.453153] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-09-22T22:17:37.454497] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-22T22:17:37.456685] [INFO ] [MAIN ] Derivative Progress: 340/2091 symbols completed. CAPL took 1.1s. Estimated remaining: 11m 23s. Rate: 153.7 symbols/min [2025-09-22T22:17:37.457216] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:37.458376] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-09-22T22:17:37.458479] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-22T22:17:37.460695] [INFO ] [MAIN ] Derivative Progress: 341/2091 symbols completed. CANG took 1.1s. Estimated remaining: 11m 21s. Rate: 154.2 symbols/min [2025-09-22T22:17:37.460995] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:37.482726] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:37.483568] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53596 primary records. [2025-09-22T22:17:37.483721] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-22T22:17:37.510100] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-09-22T22:17:37.510335] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-22T22:17:37.512882] [INFO ] [MAIN ] Derivative Progress: 342/2091 symbols completed. CARR took 0.9s. Estimated remaining: 11m 19s. Rate: 154.5 symbols/min [2025-09-22T22:17:37.513793] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:37.526577] [DEBUG] [LOCAL ] CARS: Loaded 40297 existing records from primary storage. [2025-09-22T22:17:37.526807] [INFO ] [MAIN ] CARS: Loaded 40297 primary data records. [2025-09-22T22:17:37.625815] [DEBUG] [LOCAL ] CATO: Loaded 7350 existing records from primary storage. [2025-09-22T22:17:37.636984] [INFO ] [MAIN ] CATO: Loaded 7350 primary data records. [2025-09-22T22:17:37.976498] [DEBUG] [LOCAL ] CAT: Loaded 52926 existing records from primary storage. [2025-09-22T22:17:37.983339] [INFO ] [MAIN ] CAT: Loaded 52926 primary data records. [2025-09-22T22:17:38.532407] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:38.533410] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 40297 primary records. [2025-09-22T22:17:38.533690] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-22T22:17:38.566779] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-09-22T22:17:38.567013] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-22T22:17:38.567289] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:38.569522] [INFO ] [MAIN ] Derivative Progress: 343/2091 symbols completed. CARS took 1.1s. Estimated remaining: 11m 22s. Rate: 153.8 symbols/min [2025-09-22T22:17:38.570607] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 7350 primary records. [2025-09-22T22:17:38.570845] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-22T22:17:38.587582] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-09-22T22:17:38.587829] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-22T22:17:38.601699] [INFO ] [MAIN ] Derivative Progress: 344/2091 symbols completed. CATO took 1.1s. Estimated remaining: 11m 20s. Rate: 154.2 symbols/min [2025-09-22T22:17:38.602019] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:38.602865] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52926 primary records. [2025-09-22T22:17:38.602936] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-22T22:17:38.618422] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-09-22T22:17:38.618484] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-22T22:17:38.621195] [INFO ] [MAIN ] Derivative Progress: 345/2091 symbols completed. CAT took 1.2s. Estimated remaining: 11m 18s. Rate: 154.6 symbols/min [2025-09-22T22:17:38.622220] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:38.622168] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:38.622107] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:38.635881] [DEBUG] [LOCAL ] CBAN: Loaded 11144 existing records from primary storage. [2025-09-22T22:17:38.636008] [INFO ] [MAIN ] CBAN: Loaded 11144 primary data records. [2025-09-22T22:17:38.979600] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-09-22T22:17:38.980378] [INFO ] [MAIN ] CAVA: Loaded 53552 primary data records. [2025-09-22T22:17:39.032849] [DEBUG] [LOCAL ] CB: Loaded 50103 existing records from primary storage. [2025-09-22T22:17:39.052945] [INFO ] [MAIN ] CB: Loaded 50103 primary data records. [2025-09-22T22:17:39.625331] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:39.627068] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 11144 primary records. [2025-09-22T22:17:39.627369] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-22T22:17:39.645246] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-09-22T22:17:39.645970] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-22T22:17:39.648466] [INFO ] [MAIN ] Derivative Progress: 346/2091 symbols completed. CBAN took 1.0s. Estimated remaining: 11m 20s. Rate: 153.9 symbols/min [2025-09-22T22:17:39.648921] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:39.667995] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:39.668991] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53552 primary records. [2025-09-22T22:17:39.669231] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-22T22:17:39.700368] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-09-22T22:17:39.712585] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-22T22:17:39.715878] [DEBUG] [LOCAL ] CBL: Loaded 16762 existing records from primary storage. [2025-09-22T22:17:39.716290] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:39.714829] [INFO ] [MAIN ] Derivative Progress: 347/2091 symbols completed. CAVA took 1.1s. Estimated remaining: 11m 18s. Rate: 154.2 symbols/min [2025-09-22T22:17:39.716607] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:39.717474] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 50103 primary records. [2025-09-22T22:17:39.717624] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-22T22:17:39.718955] [INFO ] [MAIN ] CBL: Loaded 16762 primary data records. [2025-09-22T22:17:39.821951] [DEBUG] [LOCAL ] CBNA: Loaded 2901 existing records from primary storage. [2025-09-22T22:17:39.829388] [INFO ] [MAIN ] CBNA: Loaded 2901 primary data records. [2025-09-22T22:17:39.925800] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-09-22T22:17:39.948242] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-22T22:17:39.974401] [INFO ] [MAIN ] Derivative Progress: 348/2091 symbols completed. CB took 1.4s. Estimated remaining: 11m 17s. Rate: 154.4 symbols/min [2025-09-22T22:17:40.037770] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:40.445635] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:40.445919] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:40.446798] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2901 primary records. [2025-09-22T22:17:40.447430] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16762 primary records. [2025-09-22T22:17:40.447564] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-22T22:17:40.447509] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-22T22:17:40.489112] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-09-22T22:17:40.491165] [DEBUG] [LOCAL ] CBRE: Loaded 50664 existing records from primary storage. [2025-09-22T22:17:40.491601] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-22T22:17:40.494355] [INFO ] [MAIN ] Derivative Progress: 349/2091 symbols completed. CBNA took 0.8s. Estimated remaining: 11m 18s. Rate: 154.2 symbols/min [2025-09-22T22:17:40.494499] [INFO ] [MAIN ] CBRE: Loaded 50664 primary data records. [2025-09-22T22:17:40.495130] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:40.543380] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-09-22T22:17:40.566413] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-22T22:17:40.573884] [INFO ] [MAIN ] Derivative Progress: 350/2091 symbols completed. CBL took 0.9s. Estimated remaining: 11m 16s. Rate: 154.6 symbols/min [2025-09-22T22:17:40.586413] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:40.851744] [DEBUG] [LOCAL ] CBU: Loaded 22859 existing records from primary storage. [2025-09-22T22:17:40.851210] [DEBUG] [LOCAL ] CBT: Loaded 31131 existing records from primary storage. [2025-09-22T22:17:40.852048] [INFO ] [MAIN ] CBU: Loaded 22859 primary data records. [2025-09-22T22:17:40.852605] [INFO ] [MAIN ] CBT: Loaded 31131 primary data records. [2025-09-22T22:17:41.508589] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:41.511607] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50664 primary records. [2025-09-22T22:17:41.511790] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-22T22:17:41.531776] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-09-22T22:17:41.532095] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-22T22:17:41.534266] [INFO ] [MAIN ] Derivative Progress: 351/2091 symbols completed. CBRE took 1.5s. Estimated remaining: 11m 18s. Rate: 154.0 symbols/min [2025-09-22T22:17:41.536667] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:41.564174] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:41.587420] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:41.587056] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22859 primary records. [2025-09-22T22:17:41.587553] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-22T22:17:41.588717] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 31131 primary records. [2025-09-22T22:17:41.589052] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-22T22:17:41.629500] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-09-22T22:17:41.630700] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-22T22:17:41.633730] [INFO ] [MAIN ] Derivative Progress: 352/2091 symbols completed. CBT took 1.1s. Estimated remaining: 11m 16s. Rate: 154.3 symbols/min [2025-09-22T22:17:41.634693] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:41.634360] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-09-22T22:17:41.635982] [DEBUG] [LOCAL ] CBZ: Loaded 33453 existing records from primary storage. [2025-09-22T22:17:41.636078] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-22T22:17:41.638981] [INFO ] [MAIN ] Derivative Progress: 353/2091 symbols completed. CBU took 1.1s. Estimated remaining: 11m 14s. Rate: 154.7 symbols/min [2025-09-22T22:17:41.639349] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:41.636478] [INFO ] [MAIN ] CBZ: Loaded 33453 primary data records. [2025-09-22T22:17:42.024283] [DEBUG] [LOCAL ] CCI: Loaded 53161 existing records from primary storage. [2025-09-22T22:17:42.027636] [DEBUG] [LOCAL ] CC: Loaded 53028 existing records from primary storage. [2025-09-22T22:17:42.027843] [INFO ] [MAIN ] CCI: Loaded 53161 primary data records. [2025-09-22T22:17:42.028698] [INFO ] [MAIN ] CC: Loaded 53028 primary data records. [2025-09-22T22:17:42.172347] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:42.194731] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33453 primary records. [2025-09-22T22:17:42.217513] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-22T22:17:42.432233] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-09-22T22:17:42.578716] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-22T22:17:42.719497] [INFO ] [MAIN ] Derivative Progress: 354/2091 symbols completed. CBZ took 1.2s. Estimated remaining: 11m 17s. Rate: 153.9 symbols/min [2025-09-22T22:17:42.720958] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:42.742142] [DEBUG] [LOCAL ] CCIF: Loaded 15367 existing records from primary storage. [2025-09-22T22:17:42.742830] [INFO ] [MAIN ] CCIF: Loaded 15367 primary data records. [2025-09-22T22:17:43.050223] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:43.059612] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53161 primary records. [2025-09-22T22:17:43.072333] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-22T22:17:43.072266] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:43.073744] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53028 primary records. [2025-09-22T22:17:43.074264] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-22T22:17:43.105310] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-09-22T22:17:43.106602] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-22T22:17:43.109049] [INFO ] [MAIN ] Derivative Progress: 355/2091 symbols completed. CC took 1.5s. Estimated remaining: 11m 17s. Rate: 153.9 symbols/min [2025-09-22T22:17:43.111436] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-09-22T22:17:43.111922] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:43.111666] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-22T22:17:43.114118] [INFO ] [MAIN ] Derivative Progress: 356/2091 symbols completed. CCI took 1.5s. Estimated remaining: 11m 14s. Rate: 154.4 symbols/min [2025-09-22T22:17:43.114671] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:43.134826] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:43.135727] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15367 primary records. [2025-09-22T22:17:43.135809] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-22T22:17:43.152920] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-09-22T22:17:43.153047] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-22T22:17:43.155266] [INFO ] [MAIN ] Derivative Progress: 357/2091 symbols completed. CCIF took 0.4s. Estimated remaining: 11m 12s. Rate: 154.7 symbols/min [2025-09-22T22:17:43.155700] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:43.199608] [DEBUG] [LOCAL ] CCK: Loaded 46503 existing records from primary storage. [2025-09-22T22:17:43.213980] [INFO ] [MAIN ] CCK: Loaded 46503 primary data records. [2025-09-22T22:17:43.236676] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-22T22:17:43.247278] [INFO ] [MAIN ] CCJ: Loaded 53675 primary data records. [2025-09-22T22:17:43.591548] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-22T22:17:43.620400] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-09-22T22:17:44.193749] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:44.195883] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46503 primary records. [2025-09-22T22:17:44.194880] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:44.196230] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-22T22:17:44.196857] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53675 primary records. [2025-09-22T22:17:44.198070] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-22T22:17:44.228074] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-09-22T22:17:44.228381] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-22T22:17:44.230857] [INFO ] [MAIN ] Derivative Progress: 358/2091 symbols completed. CCJ took 1.1s. Estimated remaining: 11m 15s. Rate: 154.0 symbols/min [2025-09-22T22:17:44.236116] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-09-22T22:17:44.236306] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-22T22:17:44.238188] [INFO ] [MAIN ] Derivative Progress: 359/2091 symbols completed. CCK took 1.1s. Estimated remaining: 11m 13s. Rate: 154.4 symbols/min [2025-09-22T22:17:44.250775] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:44.251314] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-09-22T22:17:44.251372] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-22T22:17:44.267223] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-09-22T22:17:44.267287] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-22T22:17:44.269590] [INFO ] [MAIN ] Derivative Progress: 360/2091 symbols completed. CCL took 1.1s. Estimated remaining: 11m 11s. Rate: 154.8 symbols/min [2025-09-22T22:17:44.270354] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:44.270407] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:44.270754] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:44.282103] [DEBUG] [LOCAL ] CCRD: Loaded 8988 existing records from primary storage. [2025-09-22T22:17:44.282255] [INFO ] [MAIN ] CCRD: Loaded 8988 primary data records. [2025-09-22T22:17:44.653763] [DEBUG] [LOCAL ] CCS: Loaded 30741 existing records from primary storage. [2025-09-22T22:17:44.655510] [INFO ] [MAIN ] CCS: Loaded 30741 primary data records. [2025-09-22T22:17:44.678301] [DEBUG] [LOCAL ] CCO: Loaded 47602 existing records from primary storage. [2025-09-22T22:17:44.715395] [INFO ] [MAIN ] CCO: Loaded 47602 primary data records. [2025-09-22T22:17:45.306911] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-22T22:17:45.307763] [INFO ] [MAIN ] CCRD: Generated 1791 derivative records from 8988 primary records. [2025-09-22T22:17:45.308011] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-22T22:17:45.325585] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1791 records). [2025-09-22T22:17:45.325746] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-22T22:17:45.327941] [INFO ] [MAIN ] Derivative Progress: 361/2091 symbols completed. CCRD took 1.1s. Estimated remaining: 11m 14s. Rate: 154.1 symbols/min [2025-09-22T22:17:45.328263] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:45.350392] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:45.351270] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30741 primary records. [2025-09-22T22:17:45.357090] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-22T22:17:45.392580] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-09-22T22:17:45.382221] [DEBUG] [LOCAL ] CCU: Loaded 23817 existing records from primary storage. [2025-09-22T22:17:45.392771] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-22T22:17:45.399483] [INFO ] [MAIN ] Derivative Progress: 362/2091 symbols completed. CCS took 1.1s. Estimated remaining: 11m 12s. Rate: 154.4 symbols/min [2025-09-22T22:17:45.397675] [INFO ] [MAIN ] CCU: Loaded 23817 primary data records. [2025-09-22T22:17:45.400549] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:45.400408] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:45.432486] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 47602 primary records. [2025-09-22T22:17:45.444670] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-22T22:17:45.598979] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-09-22T22:17:45.705027] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-22T22:17:45.716076] [INFO ] [MAIN ] Derivative Progress: 363/2091 symbols completed. CCO took 1.4s. Estimated remaining: 11m 11s. Rate: 154.5 symbols/min [2025-09-22T22:17:45.716502] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:45.742403] [DEBUG] [LOCAL ] CDLR: Loaded 9845 existing records from primary storage. [2025-09-22T22:17:45.742626] [INFO ] [MAIN ] CDLR: Loaded 9845 primary data records. [2025-09-22T22:17:45.880406] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-22T22:17:45.903410] [INFO ] [MAIN ] CDE: Loaded 53641 primary data records. [2025-09-22T22:17:46.185987] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:46.225004] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 23817 primary records. [2025-09-22T22:17:46.263880] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-22T22:17:46.441800] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-09-22T22:17:46.442854] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-22T22:17:46.445012] [INFO ] [MAIN ] Derivative Progress: 364/2091 symbols completed. CCU took 1.1s. Estimated remaining: 11m 12s. Rate: 154.1 symbols/min [2025-09-22T22:17:46.445715] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:46.464735] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:46.465880] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 9845 primary records. [2025-09-22T22:17:46.466138] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-22T22:17:46.488511] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-09-22T22:17:46.488925] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-22T22:17:46.503110] [INFO ] [MAIN ] Derivative Progress: 365/2091 symbols completed. CDLR took 0.8s. Estimated remaining: 11m 10s. Rate: 154.5 symbols/min [2025-09-22T22:17:46.503816] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:46.504136] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:46.504916] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53641 primary records. [2025-09-22T22:17:46.505157] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-22T22:17:46.532086] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-09-22T22:17:46.532218] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-22T22:17:46.534494] [INFO ] [MAIN ] Derivative Progress: 366/2091 symbols completed. CDE took 1.1s. Estimated remaining: 11m 8s. Rate: 154.9 symbols/min [2025-09-22T22:17:46.534977] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:46.553818] [DEBUG] [LOCAL ] CDP: Loaded 42674 existing records from primary storage. [2025-09-22T22:17:46.554049] [INFO ] [MAIN ] CDP: Loaded 42674 primary data records. [2025-09-22T22:17:46.595173] [DEBUG] [LOCAL ] CEE: Loaded 6839 existing records from primary storage. [2025-09-22T22:17:46.624325] [INFO ] [MAIN ] CEE: Loaded 6839 primary data records. [2025-09-22T22:17:47.202625] [DEBUG] [LOCAL ] CE: Loaded 51561 existing records from primary storage. [2025-09-22T22:17:47.203828] [INFO ] [MAIN ] CE: Loaded 51561 primary data records. [2025-09-22T22:17:47.544917] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:47.546492] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42674 primary records. [2025-09-22T22:17:47.547449] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-22T22:17:47.577901] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:47.579481] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 6839 primary records. [2025-09-22T22:17:47.579598] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-22T22:17:47.597466] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-09-22T22:17:47.599721] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-22T22:17:47.602490] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-09-22T22:17:47.602110] [INFO ] [MAIN ] Derivative Progress: 367/2091 symbols completed. CDP took 1.2s. Estimated remaining: 11m 11s. Rate: 154.1 symbols/min [2025-09-22T22:17:47.603152] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:47.603303] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-22T22:17:47.605359] [INFO ] [MAIN ] Derivative Progress: 368/2091 symbols completed. CEE took 1.1s. Estimated remaining: 11m 9s. Rate: 154.5 symbols/min [2025-09-22T22:17:47.606062] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:47.625462] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:47.626341] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51561 primary records. [2025-09-22T22:17:47.626504] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-22T22:17:47.652743] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-09-22T22:17:47.653373] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-22T22:17:47.662512] [INFO ] [MAIN ] Derivative Progress: 369/2091 symbols completed. CE took 1.2s. Estimated remaining: 11m 7s. Rate: 154.9 symbols/min [2025-09-22T22:17:47.663960] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:47.664712] [DEBUG] [LOCAL ] CEPU: Loaded 25921 existing records from primary storage. [2025-09-22T22:17:47.664783] [INFO ] [MAIN ] CEPU: Loaded 25921 primary data records. [2025-09-22T22:17:47.873168] [DEBUG] [LOCAL ] CF: Loaded 52233 existing records from primary storage. [2025-09-22T22:17:47.896162] [INFO ] [MAIN ] CF: Loaded 52233 primary data records. [2025-09-22T22:17:48.117412] [DEBUG] [LOCAL ] CFR: Loaded 33601 existing records from primary storage. [2025-09-22T22:17:48.134534] [INFO ] [MAIN ] CFR: Loaded 33601 primary data records. [2025-09-22T22:17:48.739739] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:48.741399] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 25921 primary records. [2025-09-22T22:17:48.742138] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-22T22:17:48.767422] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-09-22T22:17:48.767716] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-22T22:17:48.777764] [INFO ] [MAIN ] Derivative Progress: 370/2091 symbols completed. CEPU took 1.2s. Estimated remaining: 11m 10s. Rate: 154.1 symbols/min [2025-09-22T22:17:48.783963] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:48.785543] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:48.786816] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52233 primary records. [2025-09-22T22:17:48.787116] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-22T22:17:48.812661] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:48.814960] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 33601 primary records. [2025-09-22T22:17:48.815250] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-22T22:17:48.829348] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-09-22T22:17:48.829890] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-22T22:17:48.831913] [INFO ] [MAIN ] Derivative Progress: 371/2091 symbols completed. CF took 1.2s. Estimated remaining: 11m 8s. Rate: 154.5 symbols/min [2025-09-22T22:17:48.833364] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:48.839477] [DEBUG] [LOCAL ] CGV: Loaded 1425 existing records from primary storage. [2025-09-22T22:17:48.839711] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-09-22T22:17:48.839762] [INFO ] [MAIN ] CGV: Loaded 1425 primary data records. [2025-09-22T22:17:48.851140] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-22T22:17:48.873985] [INFO ] [MAIN ] Derivative Progress: 372/2091 symbols completed. CFR took 1.2s. Estimated remaining: 11m 6s. Rate: 154.9 symbols/min [2025-09-22T22:17:48.884681] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:49.059577] [DEBUG] [LOCAL ] CGAU: Loaded 42655 existing records from primary storage. [2025-09-22T22:17:49.182478] [INFO ] [MAIN ] CGAU: Loaded 42655 primary data records. [2025-09-22T22:17:49.183291] [DEBUG] [LOCAL ] CHCT: Loaded 24051 existing records from primary storage. [2025-09-22T22:17:49.188486] [INFO ] [MAIN ] CHCT: Loaded 24051 primary data records. [2025-09-22T22:17:49.853036] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:17:49.854017] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1425 primary records. [2025-09-22T22:17:49.855664] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-22T22:17:49.873925] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-09-22T22:17:49.874614] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-22T22:17:49.877125] [INFO ] [MAIN ] Derivative Progress: 373/2091 symbols completed. CGV took 1.0s. Estimated remaining: 11m 8s. Rate: 154.2 symbols/min [2025-09-22T22:17:49.908830] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:49.909979] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 42655 primary records. [2025-09-22T22:17:49.910164] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:49.910249] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-22T22:17:49.910872] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 24051 primary records. [2025-09-22T22:17:49.911401] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-22T22:17:49.941979] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-09-22T22:17:49.942690] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-22T22:17:49.945363] [INFO ] [MAIN ] Derivative Progress: 374/2091 symbols completed. CHCT took 1.1s. Estimated remaining: 11m 7s. Rate: 154.5 symbols/min [2025-09-22T22:17:49.949275] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-09-22T22:17:49.949348] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-22T22:17:49.951715] [INFO ] [MAIN ] Derivative Progress: 375/2091 symbols completed. CGAU took 1.2s. Estimated remaining: 11m 4s. Rate: 154.9 symbols/min [2025-09-22T22:17:49.952555] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:49.952270] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:49.952758] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:49.971532] [DEBUG] [LOCAL ] CHE: Loaded 14666 existing records from primary storage. [2025-09-22T22:17:49.972152] [INFO ] [MAIN ] CHE: Loaded 14666 primary data records. [2025-09-22T22:17:50.398912] [DEBUG] [LOCAL ] CHD: Loaded 52034 existing records from primary storage. [2025-09-22T22:17:50.400358] [INFO ] [MAIN ] CHD: Loaded 52034 primary data records. [2025-09-22T22:17:50.400189] [DEBUG] [LOCAL ] CHGG: Loaded 47754 existing records from primary storage. [2025-09-22T22:17:50.400724] [INFO ] [MAIN ] CHGG: Loaded 47754 primary data records. [2025-09-22T22:17:51.063616] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:51.065198] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 14666 primary records. [2025-09-22T22:17:51.065523] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-22T22:17:51.088760] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-09-22T22:17:51.089113] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-22T22:17:51.091487] [INFO ] [MAIN ] Derivative Progress: 376/2091 symbols completed. CHE took 1.1s. Estimated remaining: 11m 8s. Rate: 154.1 symbols/min [2025-09-22T22:17:51.092149] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:51.110667] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:51.113216] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52034 primary records. [2025-09-22T22:17:51.113454] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-22T22:17:51.137812] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:51.138626] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47754 primary records. [2025-09-22T22:17:51.141849] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-22T22:17:51.144199] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-09-22T22:17:51.144313] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-22T22:17:51.146374] [INFO ] [MAIN ] Derivative Progress: 377/2091 symbols completed. CHD took 1.2s. Estimated remaining: 11m 6s. Rate: 154.5 symbols/min [2025-09-22T22:17:51.146770] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:51.173157] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-09-22T22:17:51.173407] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-22T22:17:51.176062] [INFO ] [MAIN ] Derivative Progress: 378/2091 symbols completed. CHGG took 1.2s. Estimated remaining: 11m 4s. Rate: 154.9 symbols/min [2025-09-22T22:17:51.176326] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:51.195545] [DEBUG] [LOCAL ] CHH: Loaded 32240 existing records from primary storage. [2025-09-22T22:17:51.196127] [INFO ] [MAIN ] CHH: Loaded 32240 primary data records. [2025-09-22T22:17:51.252797] [DEBUG] [LOCAL ] CHMI: Loaded 22078 existing records from primary storage. [2025-09-22T22:17:51.255908] [DEBUG] [LOCAL ] CHN: Loaded 4800 existing records from primary storage. [2025-09-22T22:17:51.261304] [INFO ] [MAIN ] CHMI: Loaded 22078 primary data records. [2025-09-22T22:17:51.261234] [INFO ] [MAIN ] CHN: Loaded 4800 primary data records. [2025-09-22T22:17:52.222546] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:52.223620] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32240 primary records. [2025-09-22T22:17:52.224790] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-22T22:17:52.256431] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:52.257580] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 22078 primary records. [2025-09-22T22:17:52.259613] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-22T22:17:52.277955] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:52.277610] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-09-22T22:17:52.290318] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-22T22:17:52.286261] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4800 primary records. [2025-09-22T22:17:52.292633] [INFO ] [MAIN ] Derivative Progress: 379/2091 symbols completed. CHH took 1.2s. Estimated remaining: 11m 7s. Rate: 154.1 symbols/min [2025-09-22T22:17:52.292844] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-22T22:17:52.298014] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:52.310046] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-09-22T22:17:52.311085] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-22T22:17:52.313700] [INFO ] [MAIN ] Derivative Progress: 380/2091 symbols completed. CHMI took 1.2s. Estimated remaining: 11m 4s. Rate: 154.5 symbols/min [2025-09-22T22:17:52.314410] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:52.318322] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-09-22T22:17:52.318512] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-22T22:17:52.321070] [INFO ] [MAIN ] Derivative Progress: 381/2091 symbols completed. CHN took 1.1s. Estimated remaining: 11m 2s. Rate: 154.9 symbols/min [2025-09-22T22:17:52.321419] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:52.399913] [DEBUG] [LOCAL ] CHPT: Loaded 49427 existing records from primary storage. [2025-09-22T22:17:52.415135] [INFO ] [MAIN ] CHPT: Loaded 49427 primary data records. [2025-09-22T22:17:52.416150] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-22T22:17:52.437603] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-09-22T22:17:52.566921] [DEBUG] [LOCAL ] CI: Loaded 49924 existing records from primary storage. [2025-09-22T22:17:52.623228] [INFO ] [MAIN ] CI: Loaded 49924 primary data records. [2025-09-22T22:17:53.477095] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:53.490460] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 49427 primary records. [2025-09-22T22:17:53.490808] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:53.491891] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53654 primary records. [2025-09-22T22:17:53.490987] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-22T22:17:53.492978] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-22T22:17:53.540036] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:53.541736] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49924 primary records. [2025-09-22T22:17:53.537873] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-09-22T22:17:53.542181] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-22T22:17:53.544669] [INFO ] [MAIN ] Derivative Progress: 382/2091 symbols completed. CHPT took 1.2s. Estimated remaining: 11m 6s. Rate: 154.0 symbols/min [2025-09-22T22:17:53.542118] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-22T22:17:53.547120] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:53.547580] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-09-22T22:17:53.555203] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-22T22:17:53.558865] [INFO ] [MAIN ] Derivative Progress: 383/2091 symbols completed. CHWY took 1.2s. Estimated remaining: 11m 4s. Rate: 154.4 symbols/min [2025-09-22T22:17:53.559289] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:53.574081] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-09-22T22:17:53.574223] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-22T22:17:53.576956] [INFO ] [MAIN ] Derivative Progress: 384/2091 symbols completed. CI took 1.3s. Estimated remaining: 11m 2s. Rate: 154.8 symbols/min [2025-09-22T22:17:53.577301] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:53.586859] [DEBUG] [LOCAL ] CIA: Loaded 16947 existing records from primary storage. [2025-09-22T22:17:53.595054] [INFO ] [MAIN ] CIA: Loaded 16947 primary data records. [2025-09-22T22:17:53.727993] [DEBUG] [LOCAL ] CIB: Loaded 31043 existing records from primary storage. [2025-09-22T22:17:53.734206] [INFO ] [MAIN ] CIB: Loaded 31043 primary data records. [2025-09-22T22:17:54.098618] [DEBUG] [LOCAL ] CIEN: Loaded 52090 existing records from primary storage. [2025-09-22T22:17:54.110098] [INFO ] [MAIN ] CIEN: Loaded 52090 primary data records. [2025-09-22T22:17:54.812517] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:54.814492] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16947 primary records. [2025-09-22T22:17:54.816195] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-22T22:17:54.844693] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-09-22T22:17:54.854468] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-22T22:17:54.860693] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:54.861872] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 31043 primary records. [2025-09-22T22:17:54.864109] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-22T22:17:54.863916] [INFO ] [MAIN ] Derivative Progress: 385/2091 symbols completed. CIA took 1.3s. Estimated remaining: 11m 5s. Rate: 153.9 symbols/min [2025-09-22T22:17:54.865315] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:54.891985] [DEBUG] [LOCAL ] CIF: Loaded 4421 existing records from primary storage. [2025-09-22T22:17:54.892150] [INFO ] [MAIN ] CIF: Loaded 4421 primary data records. [2025-09-22T22:17:54.936818] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-09-22T22:17:54.975002] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-22T22:17:55.005734] [INFO ] [MAIN ] Derivative Progress: 386/2091 symbols completed. CIB took 1.4s. Estimated remaining: 11m 4s. Rate: 154.1 symbols/min [2025-09-22T22:17:55.022175] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:55.080054] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:55.104346] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52090 primary records. [2025-09-22T22:17:55.115109] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-22T22:17:55.386560] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-09-22T22:17:55.387073] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-22T22:17:55.389580] [INFO ] [MAIN ] Derivative Progress: 387/2091 symbols completed. CIEN took 1.8s. Estimated remaining: 11m 3s. Rate: 154.1 symbols/min [2025-09-22T22:17:55.391199] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:55.437804] [DEBUG] [LOCAL ] CIG: Loaded 43600 existing records from primary storage. [2025-09-22T22:17:55.438369] [INFO ] [MAIN ] CIG: Loaded 43600 primary data records. [2025-09-22T22:17:55.463599] [DEBUG] [LOCAL ] CII: Loaded 15615 existing records from primary storage. [2025-09-22T22:17:55.480717] [INFO ] [MAIN ] CII: Loaded 15615 primary data records. [2025-09-22T22:17:55.612204] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:55.623788] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4421 primary records. [2025-09-22T22:17:55.649330] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-22T22:17:56.176169] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-09-22T22:17:56.176485] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-22T22:17:56.179145] [INFO ] [MAIN ] Derivative Progress: 388/2091 symbols completed. CIF took 1.3s. Estimated remaining: 11m 5s. Rate: 153.7 symbols/min [2025-09-22T22:17:56.206639] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:56.207396] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43600 primary records. [2025-09-22T22:17:56.207550] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-22T22:17:56.221715] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:56.233191] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15615 primary records. [2025-09-22T22:17:56.235824] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-22T22:17:56.238512] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-09-22T22:17:56.239170] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-22T22:17:56.241694] [INFO ] [MAIN ] Derivative Progress: 389/2091 symbols completed. CIG took 1.2s. Estimated remaining: 11m 3s. Rate: 154.1 symbols/min [2025-09-22T22:17:56.256391] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-09-22T22:17:56.256457] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-22T22:17:56.258236] [INFO ] [MAIN ] Derivative Progress: 390/2091 symbols completed. CII took 0.9s. Estimated remaining: 11m 1s. Rate: 154.4 symbols/min [2025-09-22T22:17:56.258830] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:56.259313] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:56.259195] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:56.268864] [DEBUG] [LOCAL ] CIMN: Loaded 2667 existing records from primary storage. [2025-09-22T22:17:56.269009] [INFO ] [MAIN ] CIMN: Loaded 2667 primary data records. [2025-09-22T22:17:56.389078] [DEBUG] [LOCAL ] CINT: Loaded 18299 existing records from primary storage. [2025-09-22T22:17:56.395033] [INFO ] [MAIN ] CINT: Loaded 18299 primary data records. [2025-09-22T22:17:56.741453] [DEBUG] [LOCAL ] CIM: Loaded 37152 existing records from primary storage. [2025-09-22T22:17:56.758306] [INFO ] [MAIN ] CIM: Loaded 37152 primary data records. [2025-09-22T22:17:57.349320] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:57.352461] [INFO ] [MAIN ] CIMN: Generated 1794 derivative records from 2667 primary records. [2025-09-22T22:17:57.352665] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-22T22:17:57.378518] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:57.382797] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 18299 primary records. [2025-09-22T22:17:57.382879] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-22T22:17:57.382055] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-09-22T22:17:57.383814] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-22T22:17:57.386057] [INFO ] [MAIN ] Derivative Progress: 391/2091 symbols completed. CIMN took 1.1s. Estimated remaining: 11m 4s. Rate: 153.7 symbols/min [2025-09-22T22:17:57.395095] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:57.404030] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-09-22T22:17:57.404862] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-22T22:17:57.408593] [INFO ] [MAIN ] Derivative Progress: 392/2091 symbols completed. CINT took 1.1s. Estimated remaining: 11m 2s. Rate: 154.1 symbols/min [2025-09-22T22:17:57.409847] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:57.424983] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:57.425788] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37152 primary records. [2025-09-22T22:17:57.426073] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-22T22:17:57.450491] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-09-22T22:17:57.457793] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-22T22:17:57.461442] [DEBUG] [LOCAL ] CIO: Loaded 20042 existing records from primary storage. [2025-09-22T22:17:57.460494] [INFO ] [MAIN ] Derivative Progress: 393/2091 symbols completed. CIM took 1.2s. Estimated remaining: 10m 60s. Rate: 154.4 symbols/min [2025-09-22T22:17:57.469208] [INFO ] [MAIN ] CIO: Loaded 20042 primary data records. [2025-09-22T22:17:57.475093] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:57.601294] [DEBUG] [LOCAL ] CION: Loaded 29391 existing records from primary storage. [2025-09-22T22:17:57.601545] [INFO ] [MAIN ] CION: Loaded 29391 primary data records. [2025-09-22T22:17:58.168766] [DEBUG] [LOCAL ] CIVI: Loaded 52582 existing records from primary storage. [2025-09-22T22:17:58.172358] [INFO ] [MAIN ] CIVI: Loaded 52582 primary data records. [2025-09-22T22:17:58.513850] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:58.514932] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20042 primary records. [2025-09-22T22:17:58.515038] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-22T22:17:58.543053] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:58.544841] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 29391 primary records. [2025-09-22T22:17:58.545265] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-22T22:17:58.566972] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-09-22T22:17:58.567488] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-22T22:17:58.570195] [INFO ] [MAIN ] Derivative Progress: 394/2091 symbols completed. CION took 1.2s. Estimated remaining: 11m 3s. Rate: 153.7 symbols/min [2025-09-22T22:17:58.571065] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:58.567412] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-09-22T22:17:58.571243] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-22T22:17:58.573394] [INFO ] [MAIN ] Derivative Progress: 395/2091 symbols completed. CIO took 1.2s. Estimated remaining: 11m 1s. Rate: 154.1 symbols/min [2025-09-22T22:17:58.574091] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:58.593767] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:58.594733] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52582 primary records. [2025-09-22T22:17:58.594898] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-22T22:17:58.625120] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-09-22T22:17:58.625310] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-22T22:17:58.627488] [INFO ] [MAIN ] Derivative Progress: 396/2091 symbols completed. CIVI took 1.2s. Estimated remaining: 10m 59s. Rate: 154.4 symbols/min [2025-09-22T22:17:58.628181] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:58.642918] [DEBUG] [LOCAL ] CLB: Loaded 33100 existing records from primary storage. [2025-09-22T22:17:58.643256] [INFO ] [MAIN ] CLB: Loaded 33100 primary data records. [2025-09-22T22:17:58.782492] [DEBUG] [LOCAL ] CLCO: Loaded 12942 existing records from primary storage. [2025-09-22T22:17:58.799634] [INFO ] [MAIN ] CLCO: Loaded 12942 primary data records. [2025-09-22T22:17:58.942748] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-22T22:17:58.993756] [INFO ] [MAIN ] CL: Loaded 53644 primary data records. [2025-09-22T22:17:59.719154] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:59.720144] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33100 primary records. [2025-09-22T22:17:59.720239] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-22T22:17:59.738406] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-09-22T22:17:59.738686] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-22T22:17:59.741064] [INFO ] [MAIN ] Derivative Progress: 397/2091 symbols completed. CLB took 1.2s. Estimated remaining: 11m 1s. Rate: 153.7 symbols/min [2025-09-22T22:17:59.741716] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:59.763297] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:59.764260] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53644 primary records. [2025-09-22T22:17:59.778809] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-22T22:17:59.778710] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:17:59.788884] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12942 primary records. [2025-09-22T22:17:59.788973] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-22T22:17:59.823679] [DEBUG] [LOCAL ] CLDT: Loaded 25898 existing records from primary storage. [2025-09-22T22:17:59.824497] [INFO ] [MAIN ] CLDT: Loaded 25898 primary data records. [2025-09-22T22:17:59.896689] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-09-22T22:17:59.902818] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-22T22:17:59.905490] [INFO ] [MAIN ] Derivative Progress: 398/2091 symbols completed. CL took 1.3s. Estimated remaining: 11m 0s. Rate: 153.9 symbols/min [2025-09-22T22:17:59.912827] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:17:59.902687] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-09-22T22:17:59.918393] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-22T22:17:59.926438] [INFO ] [MAIN ] Derivative Progress: 399/2091 symbols completed. CLCO took 1.3s. Estimated remaining: 10m 58s. Rate: 154.3 symbols/min [2025-09-22T22:17:59.941701] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:00.193390] [DEBUG] [LOCAL ] CLH: Loaded 28259 existing records from primary storage. [2025-09-22T22:18:00.193687] [INFO ] [MAIN ] CLH: Loaded 28259 primary data records. [2025-09-22T22:18:00.323293] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-22T22:18:00.323532] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-09-22T22:18:00.680494] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:00.719053] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25898 primary records. [2025-09-22T22:18:00.754808] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-22T22:18:00.898975] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-09-22T22:18:00.899755] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-22T22:18:00.901831] [INFO ] [MAIN ] Derivative Progress: 400/2091 symbols completed. CLDT took 1.2s. Estimated remaining: 11m 0s. Rate: 153.7 symbols/min [2025-09-22T22:18:00.902130] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:00.918627] [DEBUG] [LOCAL ] CLPR: Loaded 11586 existing records from primary storage. [2025-09-22T22:18:00.919290] [INFO ] [MAIN ] CLPR: Loaded 11586 primary data records. [2025-09-22T22:18:01.061750] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:01.090274] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 28259 primary records. [2025-09-22T22:18:01.100665] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-22T22:18:01.229508] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:01.315602] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-09-22T22:18:01.316210] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-22T22:18:01.332919] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-09-22T22:18:01.334153] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-22T22:18:01.336369] [INFO ] [MAIN ] Derivative Progress: 401/2091 symbols completed. CLH took 1.4s. Estimated remaining: 10m 60s. Rate: 153.6 symbols/min [2025-09-22T22:18:01.336911] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:01.343596] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-09-22T22:18:01.343926] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-22T22:18:01.346492] [INFO ] [MAIN ] Derivative Progress: 402/2091 symbols completed. CLF took 1.4s. Estimated remaining: 10m 58s. Rate: 154.0 symbols/min [2025-09-22T22:18:01.347050] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:01.371575] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:01.380209] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 11586 primary records. [2025-09-22T22:18:01.380369] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-22T22:18:01.380879] [DEBUG] [LOCAL ] CLW: Loaded 21949 existing records from primary storage. [2025-09-22T22:18:01.381084] [INFO ] [MAIN ] CLW: Loaded 21949 primary data records. [2025-09-22T22:18:01.481566] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-09-22T22:18:01.502956] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-22T22:18:01.519550] [INFO ] [MAIN ] Derivative Progress: 403/2091 symbols completed. CLPR took 0.6s. Estimated remaining: 10m 57s. Rate: 154.2 symbols/min [2025-09-22T22:18:01.759996] [DEBUG] [LOCAL ] CLX: Loaded 51429 existing records from primary storage. [2025-09-22T22:18:01.761021] [INFO ] [MAIN ] CLX: Loaded 51429 primary data records. [2025-09-22T22:18:02.108947] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:02.109931] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21949 primary records. [2025-09-22T22:18:02.110019] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-22T22:18:02.129993] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-09-22T22:18:02.130364] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-22T22:18:02.132711] [INFO ] [MAIN ] Derivative Progress: 404/2091 symbols completed. CLW took 0.8s. Estimated remaining: 10m 57s. Rate: 154.0 symbols/min [2025-09-22T22:18:02.150705] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:02.151514] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51429 primary records. [2025-09-22T22:18:02.151582] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-22T22:18:02.169345] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-09-22T22:18:02.169531] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-22T22:18:02.171815] [INFO ] [MAIN ] Derivative Progress: 405/2091 symbols completed. CLX took 0.8s. Estimated remaining: 10m 55s. Rate: 154.4 symbols/min [2025-09-22T22:18:02.172805] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:02.173072] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:02.172697] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:02.204596] [DEBUG] [LOCAL ] CMBT: Loaded 21739 existing records from primary storage. [2025-09-22T22:18:02.204855] [INFO ] [MAIN ] CMBT: Loaded 21739 primary data records. [2025-09-22T22:18:02.401798] [DEBUG] [LOCAL ] CMA: Loaded 50210 existing records from primary storage. [2025-09-22T22:18:02.429802] [INFO ] [MAIN ] CMA: Loaded 50210 primary data records. [2025-09-22T22:18:02.430539] [DEBUG] [LOCAL ] CMC: Loaded 45757 existing records from primary storage. [2025-09-22T22:18:02.474171] [INFO ] [MAIN ] CMC: Loaded 45757 primary data records. [2025-09-22T22:18:03.393091] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:03.394871] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 21739 primary records. [2025-09-22T22:18:03.395754] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-22T22:18:03.420311] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-09-22T22:18:03.420551] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-22T22:18:03.423059] [INFO ] [MAIN ] Derivative Progress: 406/2091 symbols completed. CMBT took 1.3s. Estimated remaining: 10m 59s. Rate: 153.5 symbols/min [2025-09-22T22:18:03.423927] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:03.434044] [DEBUG] [LOCAL ] CMCM: Loaded 4698 existing records from primary storage. [2025-09-22T22:18:03.442304] [INFO ] [MAIN ] CMCM: Loaded 4698 primary data records. [2025-09-22T22:18:03.488250] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:03.508888] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 50210 primary records. [2025-09-22T22:18:03.523325] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-22T22:18:03.561516] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:03.573822] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45757 primary records. [2025-09-22T22:18:03.583358] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-22T22:18:03.606728] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-09-22T22:18:03.612214] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-22T22:18:03.614391] [INFO ] [MAIN ] Derivative Progress: 407/2091 symbols completed. CMA took 1.4s. Estimated remaining: 10m 57s. Rate: 153.7 symbols/min [2025-09-22T22:18:03.651153] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:03.804915] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-09-22T22:18:03.805217] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-22T22:18:03.807796] [INFO ] [MAIN ] Derivative Progress: 408/2091 symbols completed. CMC took 1.6s. Estimated remaining: 10m 56s. Rate: 153.9 symbols/min [2025-09-22T22:18:03.808338] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:03.864600] [DEBUG] [LOCAL ] CMRE: Loaded 35472 existing records from primary storage. [2025-09-22T22:18:03.863964] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:03.865692] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4698 primary records. [2025-09-22T22:18:03.865879] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-22T22:18:03.865818] [INFO ] [MAIN ] CMRE: Loaded 35472 primary data records. [2025-09-22T22:18:04.003029] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-09-22T22:18:04.008908] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-22T22:18:04.026629] [INFO ] [MAIN ] Derivative Progress: 409/2091 symbols completed. CMCM took 0.6s. Estimated remaining: 10m 55s. Rate: 154.1 symbols/min [2025-09-22T22:18:04.065190] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:04.236954] [DEBUG] [LOCAL ] CMS: Loaded 52636 existing records from primary storage. [2025-09-22T22:18:04.238995] [INFO ] [MAIN ] CMS: Loaded 52636 primary data records. [2025-09-22T22:18:04.274814] [DEBUG] [LOCAL ] CMSA: Loaded 3375 existing records from primary storage. [2025-09-22T22:18:04.280559] [INFO ] [MAIN ] CMSA: Loaded 3375 primary data records. [2025-09-22T22:18:04.908604] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:04.910330] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35472 primary records. [2025-09-22T22:18:04.911621] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-22T22:18:04.930937] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-09-22T22:18:04.932482] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-22T22:18:04.934639] [INFO ] [MAIN ] Derivative Progress: 410/2091 symbols completed. CMRE took 1.3s. Estimated remaining: 10m 57s. Rate: 153.6 symbols/min [2025-09-22T22:18:04.937363] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:04.951921] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:04.954202] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52636 primary records. [2025-09-22T22:18:04.954378] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-22T22:18:04.969589] [DEBUG] [LOCAL ] CMSC: Loaded 5089 existing records from primary storage. [2025-09-22T22:18:04.973096] [INFO ] [MAIN ] CMSC: Loaded 5089 primary data records. [2025-09-22T22:18:05.060991] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:18:05.070998] [INFO ] [MAIN ] CMSA: Generated 1793 derivative records from 3375 primary records. [2025-09-22T22:18:05.070101] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-09-22T22:18:05.087559] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-22T22:18:05.097868] [INFO ] [MAIN ] Derivative Progress: 411/2091 symbols completed. CMS took 1.3s. Estimated remaining: 10m 55s. Rate: 153.8 symbols/min [2025-09-22T22:18:05.087480] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-22T22:18:05.102930] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:05.200907] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1793 records). [2025-09-22T22:18:05.318279] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-22T22:18:05.321459] [INFO ] [MAIN ] Derivative Progress: 412/2091 symbols completed. CMSA took 1.3s. Estimated remaining: 10m 54s. Rate: 153.9 symbols/min [2025-09-22T22:18:05.331173] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:05.343981] [DEBUG] [LOCAL ] CMU: Loaded 7353 existing records from primary storage. [2025-09-22T22:18:05.354130] [INFO ] [MAIN ] CMU: Loaded 7353 primary data records. [2025-09-22T22:18:05.376047] [DEBUG] [LOCAL ] CMTG: Loaded 37558 existing records from primary storage. [2025-09-22T22:18:05.422213] [INFO ] [MAIN ] CMTG: Loaded 37558 primary data records. [2025-09-22T22:18:05.940195] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:06.061299] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 5089 primary records. [2025-09-22T22:18:06.062285] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-22T22:18:06.081865] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-09-22T22:18:06.083713] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-22T22:18:06.086476] [INFO ] [MAIN ] Derivative Progress: 413/2091 symbols completed. CMSC took 1.1s. Estimated remaining: 10m 56s. Rate: 153.6 symbols/min [2025-09-22T22:18:06.087144] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:06.115092] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:06.129041] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 7353 primary records. [2025-09-22T22:18:06.129434] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:06.130452] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-22T22:18:06.130358] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 37558 primary records. [2025-09-22T22:18:06.140058] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-22T22:18:06.172905] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-09-22T22:18:06.172440] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-09-22T22:18:06.182772] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-22T22:18:06.184990] [INFO ] [MAIN ] Derivative Progress: 414/2091 symbols completed. CMU took 0.9s. Estimated remaining: 10m 54s. Rate: 153.9 symbols/min [2025-09-22T22:18:06.182702] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-22T22:18:06.185307] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:06.187901] [INFO ] [MAIN ] Derivative Progress: 415/2091 symbols completed. CMTG took 1.1s. Estimated remaining: 10m 52s. Rate: 154.2 symbols/min [2025-09-22T22:18:06.188236] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:06.189417] [DEBUG] [LOCAL ] CNA: Loaded 32761 existing records from primary storage. [2025-09-22T22:18:06.189597] [INFO ] [MAIN ] CNA: Loaded 32761 primary data records. [2025-09-22T22:18:06.305314] [DEBUG] [LOCAL ] CNF: Loaded 10809 existing records from primary storage. [2025-09-22T22:18:06.305619] [INFO ] [MAIN ] CNF: Loaded 10809 primary data records. [2025-09-22T22:18:06.707976] [DEBUG] [LOCAL ] CNC: Loaded 53733 existing records from primary storage. [2025-09-22T22:18:06.729804] [INFO ] [MAIN ] CNC: Loaded 53733 primary data records. [2025-09-22T22:18:07.182813] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:07.184137] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32761 primary records. [2025-09-22T22:18:07.186250] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-22T22:18:07.203804] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-09-22T22:18:07.218023] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-22T22:18:07.220305] [INFO ] [MAIN ] Derivative Progress: 416/2091 symbols completed. CNA took 1.1s. Estimated remaining: 10m 54s. Rate: 153.6 symbols/min [2025-09-22T22:18:07.217950] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:18:07.220810] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:07.221705] [INFO ] [MAIN ] CNF: Generated 1793 derivative records from 10809 primary records. [2025-09-22T22:18:07.222229] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-22T22:18:07.239118] [DEBUG] [LOCAL ] CNF: Derivative data saved (1793 records). [2025-09-22T22:18:07.239465] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-22T22:18:07.241671] [INFO ] [MAIN ] Derivative Progress: 417/2091 symbols completed. CNF took 1.1s. Estimated remaining: 10m 52s. Rate: 154.0 symbols/min [2025-09-22T22:18:07.242221] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:07.259306] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:07.260148] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53733 primary records. [2025-09-22T22:18:07.260434] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-22T22:18:07.279623] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-09-22T22:18:07.279817] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-22T22:18:07.282143] [INFO ] [MAIN ] Derivative Progress: 418/2091 symbols completed. CNC took 1.1s. Estimated remaining: 10m 51s. Rate: 154.3 symbols/min [2025-09-22T22:18:07.333020] [DEBUG] [LOCAL ] CNH: Loaded 53562 existing records from primary storage. [2025-09-22T22:18:07.333247] [INFO ] [MAIN ] CNH: Loaded 53562 primary data records. [2025-09-22T22:18:07.462400] [DEBUG] [LOCAL ] CNI: Loaded 51660 existing records from primary storage. [2025-09-22T22:18:07.472855] [INFO ] [MAIN ] CNI: Loaded 51660 primary data records. [2025-09-22T22:18:08.013179] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:08.014006] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53562 primary records. [2025-09-22T22:18:08.014229] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-22T22:18:08.031903] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-09-22T22:18:08.032038] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-22T22:18:08.034005] [INFO ] [MAIN ] Derivative Progress: 419/2091 symbols completed. CNH took 0.8s. Estimated remaining: 10m 52s. Rate: 154.0 symbols/min [2025-09-22T22:18:08.050194] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:08.050934] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51660 primary records. [2025-09-22T22:18:08.050998] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-22T22:18:08.067248] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-09-22T22:18:08.067404] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-22T22:18:08.069959] [INFO ] [MAIN ] Derivative Progress: 420/2091 symbols completed. CNI took 0.8s. Estimated remaining: 10m 50s. Rate: 154.3 symbols/min [2025-09-22T22:18:08.070957] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:08.071062] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:08.071317] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:08.120913] [DEBUG] [LOCAL ] CNMD: Loaded 32447 existing records from primary storage. [2025-09-22T22:18:08.146113] [INFO ] [MAIN ] CNMD: Loaded 32447 primary data records. [2025-09-22T22:18:08.299603] [DEBUG] [LOCAL ] CNM: Loaded 50963 existing records from primary storage. [2025-09-22T22:18:08.334014] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-09-22T22:18:08.334208] [INFO ] [MAIN ] CNM: Loaded 50963 primary data records. [2025-09-22T22:18:08.334152] [INFO ] [MAIN ] CNK: Loaded 52908 primary data records. [2025-09-22T22:18:09.134426] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:09.135765] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32447 primary records. [2025-09-22T22:18:09.136057] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-22T22:18:09.159242] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-09-22T22:18:09.172286] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-22T22:18:09.172569] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:09.174558] [INFO ] [MAIN ] Derivative Progress: 421/2091 symbols completed. CNMD took 1.1s. Estimated remaining: 10m 52s. Rate: 153.6 symbols/min [2025-09-22T22:18:09.174845] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:09.175916] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 50963 primary records. [2025-09-22T22:18:09.176205] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-22T22:18:09.196107] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-09-22T22:18:09.203818] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-22T22:18:09.211403] [INFO ] [MAIN ] Derivative Progress: 422/2091 symbols completed. CNM took 1.1s. Estimated remaining: 10m 50s. Rate: 153.9 symbols/min [2025-09-22T22:18:09.212559] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:09.212180] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:09.213696] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52908 primary records. [2025-09-22T22:18:09.214005] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-22T22:18:09.233903] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-09-22T22:18:09.234063] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-22T22:18:09.236903] [INFO ] [MAIN ] Derivative Progress: 423/2091 symbols completed. CNK took 1.2s. Estimated remaining: 10m 49s. Rate: 154.3 symbols/min [2025-09-22T22:18:09.237201] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:09.286422] [DEBUG] [LOCAL ] CNO: Loaded 41486 existing records from primary storage. [2025-09-22T22:18:09.286827] [INFO ] [MAIN ] CNO: Loaded 41486 primary data records. [2025-09-22T22:18:09.387747] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-22T22:18:09.412518] [INFO ] [MAIN ] CNP: Loaded 53469 primary data records. [2025-09-22T22:18:09.778066] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-09-22T22:18:09.789583] [INFO ] [MAIN ] CNQ: Loaded 53582 primary data records. [2025-09-22T22:18:10.310740] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:10.312575] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 41486 primary records. [2025-09-22T22:18:10.312838] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-22T22:18:10.335248] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-09-22T22:18:10.335456] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-22T22:18:10.337954] [INFO ] [MAIN ] Derivative Progress: 424/2091 symbols completed. CNO took 1.2s. Estimated remaining: 10m 51s. Rate: 153.6 symbols/min [2025-09-22T22:18:10.351151] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:10.351267] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:10.352041] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53469 primary records. [2025-09-22T22:18:10.352778] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-22T22:18:10.370240] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-09-22T22:18:10.371843] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-22T22:18:10.375290] [INFO ] [MAIN ] Derivative Progress: 425/2091 symbols completed. CNP took 1.2s. Estimated remaining: 10m 49s. Rate: 154.0 symbols/min [2025-09-22T22:18:10.375891] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:10.389002] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:10.389720] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53582 primary records. [2025-09-22T22:18:10.394743] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-22T22:18:10.417901] [DEBUG] [LOCAL ] CNS: Loaded 20981 existing records from primary storage. [2025-09-22T22:18:10.418286] [INFO ] [MAIN ] CNS: Loaded 20981 primary data records. [2025-09-22T22:18:10.418637] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-09-22T22:18:10.418917] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-22T22:18:10.442818] [INFO ] [MAIN ] Derivative Progress: 426/2091 symbols completed. CNQ took 1.2s. Estimated remaining: 10m 48s. Rate: 154.3 symbols/min [2025-09-22T22:18:10.494333] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:10.758256] [DEBUG] [LOCAL ] CNX: Loaded 51393 existing records from primary storage. [2025-09-22T22:18:10.759211] [INFO ] [MAIN ] CNX: Loaded 51393 primary data records. [2025-09-22T22:18:11.102302] [DEBUG] [LOCAL ] COF: Loaded 53611 existing records from primary storage. [2025-09-22T22:18:11.103716] [INFO ] [MAIN ] COF: Loaded 53611 primary data records. [2025-09-22T22:18:11.205692] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:11.226614] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 20981 primary records. [2025-09-22T22:18:11.242129] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-22T22:18:11.448119] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-09-22T22:18:11.449252] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-22T22:18:11.452316] [INFO ] [MAIN ] Derivative Progress: 427/2091 symbols completed. CNS took 1.1s. Estimated remaining: 10m 50s. Rate: 153.7 symbols/min [2025-09-22T22:18:11.453677] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:11.471251] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:11.472288] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51393 primary records. [2025-09-22T22:18:11.472499] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-22T22:18:11.490709] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-09-22T22:18:11.490809] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-22T22:18:11.493014] [INFO ] [MAIN ] Derivative Progress: 428/2091 symbols completed. CNX took 1.1s. Estimated remaining: 10m 48s. Rate: 154.0 symbols/min [2025-09-22T22:18:11.493629] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:11.511969] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:11.512690] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53611 primary records. [2025-09-22T22:18:11.512792] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-22T22:18:11.528927] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-09-22T22:18:11.529197] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-22T22:18:11.531564] [INFO ] [MAIN ] Derivative Progress: 429/2091 symbols completed. COF took 1.0s. Estimated remaining: 10m 46s. Rate: 154.3 symbols/min [2025-09-22T22:18:11.545593] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:11.567701] [DEBUG] [LOCAL ] COHR: Loaded 53366 existing records from primary storage. [2025-09-22T22:18:11.580219] [INFO ] [MAIN ] COHR: Loaded 53366 primary data records. [2025-09-22T22:18:11.718110] [DEBUG] [LOCAL ] COLD: Loaded 51973 existing records from primary storage. [2025-09-22T22:18:11.770164] [INFO ] [MAIN ] COLD: Loaded 51973 primary data records. [2025-09-22T22:18:12.061836] [DEBUG] [LOCAL ] COMP: Loaded 53384 existing records from primary storage. [2025-09-22T22:18:12.064047] [INFO ] [MAIN ] COMP: Loaded 53384 primary data records. [2025-09-22T22:18:12.612758] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:12.613586] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53366 primary records. [2025-09-22T22:18:12.613854] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-22T22:18:12.631491] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-09-22T22:18:12.631730] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-22T22:18:12.634121] [INFO ] [MAIN ] Derivative Progress: 430/2091 symbols completed. COHR took 1.2s. Estimated remaining: 10m 49s. Rate: 153.7 symbols/min [2025-09-22T22:18:12.635790] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:12.652016] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:12.652843] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 51973 primary records. [2025-09-22T22:18:12.653091] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-22T22:18:12.673068] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-09-22T22:18:12.674780] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-22T22:18:12.677262] [INFO ] [MAIN ] Derivative Progress: 431/2091 symbols completed. COLD took 1.2s. Estimated remaining: 10m 47s. Rate: 154.0 symbols/min [2025-09-22T22:18:12.677746] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:12.691622] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:12.692607] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53384 primary records. [2025-09-22T22:18:12.702037] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-22T22:18:12.725789] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-09-22T22:18:12.737755] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-22T22:18:12.742266] [DEBUG] [LOCAL ] CON: Loaded 38793 existing records from primary storage. [2025-09-22T22:18:12.741056] [INFO ] [MAIN ] Derivative Progress: 432/2091 symbols completed. COMP took 1.2s. Estimated remaining: 10m 45s. Rate: 154.3 symbols/min [2025-09-22T22:18:12.749473] [INFO ] [MAIN ] CON: Loaded 38793 primary data records. [2025-09-22T22:18:12.749692] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:12.783575] [DEBUG] [LOCAL ] COOK: Loaded 24380 existing records from primary storage. [2025-09-22T22:18:12.811147] [INFO ] [MAIN ] COOK: Loaded 24380 primary data records. [2025-09-22T22:18:13.418966] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-22T22:18:13.420047] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-09-22T22:18:13.804400] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:13.805299] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38793 primary records. [2025-09-22T22:18:13.805662] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-22T22:18:13.826608] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-09-22T22:18:13.827001] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-22T22:18:13.829236] [INFO ] [MAIN ] Derivative Progress: 433/2091 symbols completed. CON took 1.2s. Estimated remaining: 10m 47s. Rate: 153.6 symbols/min [2025-09-22T22:18:13.842798] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:13.843512] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24380 primary records. [2025-09-22T22:18:13.843587] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-22T22:18:13.861546] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-09-22T22:18:13.861617] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-22T22:18:13.863953] [INFO ] [MAIN ] Derivative Progress: 434/2091 symbols completed. COOK took 1.2s. Estimated remaining: 10m 46s. Rate: 154.0 symbols/min [2025-09-22T22:18:13.879673] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:13.880319] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-09-22T22:18:13.880381] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-22T22:18:13.895854] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-09-22T22:18:13.895942] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-22T22:18:13.898316] [INFO ] [MAIN ] Derivative Progress: 435/2091 symbols completed. COP took 1.2s. Estimated remaining: 10m 44s. Rate: 154.3 symbols/min [2025-09-22T22:18:13.898961] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:13.899491] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:13.899100] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:13.960364] [DEBUG] [LOCAL ] COTY: Loaded 53252 existing records from primary storage. [2025-09-22T22:18:13.960532] [INFO ] [MAIN ] COTY: Loaded 53252 primary data records. [2025-09-22T22:18:14.090823] [DEBUG] [LOCAL ] COUR: Loaded 48918 existing records from primary storage. [2025-09-22T22:18:14.091097] [INFO ] [MAIN ] COUR: Loaded 48918 primary data records. [2025-09-22T22:18:14.140053] [DEBUG] [LOCAL ] COR: Loaded 47281 existing records from primary storage. [2025-09-22T22:18:14.180103] [INFO ] [MAIN ] COR: Loaded 47281 primary data records. [2025-09-22T22:18:14.944957] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:14.946106] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53252 primary records. [2025-09-22T22:18:14.946508] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-22T22:18:14.992418] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-09-22T22:18:14.991822] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:14.992538] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-22T22:18:14.993669] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 47281 primary records. [2025-09-22T22:18:14.995768] [INFO ] [MAIN ] Derivative Progress: 436/2091 symbols completed. COTY took 1.1s. Estimated remaining: 10m 46s. Rate: 153.6 symbols/min [2025-09-22T22:18:14.996030] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:14.992817] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:14.996254] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-22T22:18:14.997159] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 48918 primary records. [2025-09-22T22:18:14.997279] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-22T22:18:15.029446] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-09-22T22:18:15.031083] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-09-22T22:18:15.031280] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-22T22:18:15.031392] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-22T22:18:15.033872] [INFO ] [MAIN ] Derivative Progress: 437/2091 symbols completed. COR took 1.1s. Estimated remaining: 10m 45s. Rate: 154.0 symbols/min [2025-09-22T22:18:15.034226] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:15.036858] [INFO ] [MAIN ] Derivative Progress: 438/2091 symbols completed. COUR took 1.1s. Estimated remaining: 10m 43s. Rate: 154.3 symbols/min [2025-09-22T22:18:15.037417] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:15.096533] [DEBUG] [LOCAL ] CP: Loaded 53286 existing records from primary storage. [2025-09-22T22:18:15.096819] [INFO ] [MAIN ] CP: Loaded 53286 primary data records. [2025-09-22T22:18:15.215687] [DEBUG] [LOCAL ] CPA: Loaded 28894 existing records from primary storage. [2025-09-22T22:18:15.219143] [INFO ] [MAIN ] CPA: Loaded 28894 primary data records. [2025-09-22T22:18:15.241095] [DEBUG] [LOCAL ] CPAY: Loaded 31224 existing records from primary storage. [2025-09-22T22:18:15.274688] [INFO ] [MAIN ] CPAY: Loaded 31224 primary data records. [2025-09-22T22:18:16.089620] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:16.090365] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53286 primary records. [2025-09-22T22:18:16.090462] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-22T22:18:16.108216] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-09-22T22:18:16.108337] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-22T22:18:16.110522] [INFO ] [MAIN ] Derivative Progress: 439/2091 symbols completed. CP took 1.1s. Estimated remaining: 10m 45s. Rate: 153.7 symbols/min [2025-09-22T22:18:16.111169] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:16.130980] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:16.132095] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 31224 primary records. [2025-09-22T22:18:16.132567] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-22T22:18:16.150457] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:16.159748] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28894 primary records. [2025-09-22T22:18:16.163255] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-22T22:18:16.167836] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-09-22T22:18:16.173091] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-22T22:18:16.175669] [INFO ] [MAIN ] Derivative Progress: 440/2091 symbols completed. CPAY took 1.1s. Estimated remaining: 10m 43s. Rate: 154.0 symbols/min [2025-09-22T22:18:16.175957] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:16.176926] [DEBUG] [LOCAL ] CPF: Loaded 15454 existing records from primary storage. [2025-09-22T22:18:16.188271] [INFO ] [MAIN ] CPF: Loaded 15454 primary data records. [2025-09-22T22:18:16.193319] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-09-22T22:18:16.236807] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-22T22:18:16.269689] [INFO ] [MAIN ] Derivative Progress: 441/2091 symbols completed. CPA took 1.2s. Estimated remaining: 10m 42s. Rate: 154.3 symbols/min [2025-09-22T22:18:16.281728] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:16.310164] [DEBUG] [LOCAL ] CPK: Loaded 13280 existing records from primary storage. [2025-09-22T22:18:16.315948] [INFO ] [MAIN ] CPK: Loaded 13280 primary data records. [2025-09-22T22:18:16.887484] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-09-22T22:18:16.887378] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:16.887863] [INFO ] [MAIN ] CPNG: Loaded 53671 primary data records. [2025-09-22T22:18:16.888962] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15454 primary records. [2025-09-22T22:18:16.889212] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-22T22:18:17.027793] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-09-22T22:18:17.043821] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-22T22:18:17.046044] [INFO ] [MAIN ] Derivative Progress: 442/2091 symbols completed. CPF took 0.9s. Estimated remaining: 10m 43s. Rate: 153.9 symbols/min [2025-09-22T22:18:17.119772] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:17.119436] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:17.245106] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13280 primary records. [2025-09-22T22:18:17.245694] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-22T22:18:17.268498] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-09-22T22:18:17.268686] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-22T22:18:17.271322] [INFO ] [MAIN ] Derivative Progress: 443/2091 symbols completed. CPK took 1.1s. Estimated remaining: 10m 42s. Rate: 154.1 symbols/min [2025-09-22T22:18:17.271709] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:17.298245] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:17.299019] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53671 primary records. [2025-09-22T22:18:17.299082] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-22T22:18:17.335954] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-09-22T22:18:17.344079] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-22T22:18:17.346961] [DEBUG] [LOCAL ] CPS: Loaded 26249 existing records from primary storage. [2025-09-22T22:18:17.346144] [INFO ] [MAIN ] Derivative Progress: 444/2091 symbols completed. CPNG took 1.1s. Estimated remaining: 10m 40s. Rate: 154.3 symbols/min [2025-09-22T22:18:17.347473] [INFO ] [MAIN ] CPS: Loaded 26249 primary data records. [2025-09-22T22:18:17.347403] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:17.473453] [DEBUG] [LOCAL ] CPRI: Loaded 52583 existing records from primary storage. [2025-09-22T22:18:17.484784] [INFO ] [MAIN ] CPRI: Loaded 52583 primary data records. [2025-09-22T22:18:17.812097] [DEBUG] [LOCAL ] CPT: Loaded 44347 existing records from primary storage. [2025-09-22T22:18:17.812694] [INFO ] [MAIN ] CPT: Loaded 44347 primary data records. [2025-09-22T22:18:18.410282] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:18.411307] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 26249 primary records. [2025-09-22T22:18:18.411409] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-22T22:18:18.432866] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-09-22T22:18:18.445453] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-22T22:18:18.448343] [INFO ] [MAIN ] Derivative Progress: 445/2091 symbols completed. CPS took 1.2s. Estimated remaining: 10m 43s. Rate: 153.7 symbols/min [2025-09-22T22:18:18.449485] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:18.451011] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:18.451755] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52583 primary records. [2025-09-22T22:18:18.451999] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-22T22:18:18.477115] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:18.481815] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-09-22T22:18:18.481762] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44347 primary records. [2025-09-22T22:18:18.481931] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-22T22:18:18.481993] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-22T22:18:18.483995] [INFO ] [MAIN ] Derivative Progress: 446/2091 symbols completed. CPRI took 1.4s. Estimated remaining: 10m 41s. Rate: 154.0 symbols/min [2025-09-22T22:18:18.484780] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:18.512670] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-09-22T22:18:18.512576] [DEBUG] [LOCAL ] CQP: Loaded 19936 existing records from primary storage. [2025-09-22T22:18:18.512864] [INFO ] [MAIN ] CQP: Loaded 19936 primary data records. [2025-09-22T22:18:18.512801] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-22T22:18:18.514982] [INFO ] [MAIN ] Derivative Progress: 447/2091 symbols completed. CPT took 1.2s. Estimated remaining: 10m 39s. Rate: 154.3 symbols/min [2025-09-22T22:18:18.515225] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:18.717844] [DEBUG] [LOCAL ] CR: Loaded 24776 existing records from primary storage. [2025-09-22T22:18:18.724108] [INFO ] [MAIN ] CR: Loaded 24776 primary data records. [2025-09-22T22:18:19.024930] [DEBUG] [LOCAL ] CRC: Loaded 44421 existing records from primary storage. [2025-09-22T22:18:19.035312] [INFO ] [MAIN ] CRC: Loaded 44421 primary data records. [2025-09-22T22:18:19.535326] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:19.536700] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 19936 primary records. [2025-09-22T22:18:19.537208] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-22T22:18:19.557781] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-09-22T22:18:19.558546] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-22T22:18:19.560810] [INFO ] [MAIN ] Derivative Progress: 448/2091 symbols completed. CQP took 1.1s. Estimated remaining: 10m 41s. Rate: 153.8 symbols/min [2025-09-22T22:18:19.577782] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:19.578555] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24776 primary records. [2025-09-22T22:18:19.578740] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-22T22:18:19.597670] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-09-22T22:18:19.599323] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-22T22:18:19.601447] [INFO ] [MAIN ] Derivative Progress: 449/2091 symbols completed. CR took 1.1s. Estimated remaining: 10m 39s. Rate: 154.1 symbols/min [2025-09-22T22:18:19.614084] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:19.614759] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44421 primary records. [2025-09-22T22:18:19.614824] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-22T22:18:19.630786] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-09-22T22:18:19.630846] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-22T22:18:19.633317] [INFO ] [MAIN ] Derivative Progress: 450/2091 symbols completed. CRC took 1.1s. Estimated remaining: 10m 38s. Rate: 154.4 symbols/min [2025-09-22T22:18:19.634050] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:19.633942] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:19.634513] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:19.744053] [DEBUG] [LOCAL ] CRH: Loaded 53472 existing records from primary storage. [2025-09-22T22:18:19.746236] [DEBUG] [LOCAL ] CRI: Loaded 49968 existing records from primary storage. [2025-09-22T22:18:19.745380] [DEBUG] [LOCAL ] CRGY: Loaded 52511 existing records from primary storage. [2025-09-22T22:18:19.746464] [INFO ] [MAIN ] CRH: Loaded 53472 primary data records. [2025-09-22T22:18:19.746578] [INFO ] [MAIN ] CRI: Loaded 49968 primary data records. [2025-09-22T22:18:19.746719] [INFO ] [MAIN ] CRGY: Loaded 52511 primary data records. [2025-09-22T22:18:20.735740] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:20.738818] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49968 primary records. [2025-09-22T22:18:20.738945] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-22T22:18:20.765345] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:20.767329] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52511 primary records. [2025-09-22T22:18:20.768461] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-22T22:18:20.770842] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-09-22T22:18:20.773086] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-22T22:18:20.782063] [INFO ] [MAIN ] Derivative Progress: 451/2091 symbols completed. CRI took 1.1s. Estimated remaining: 10m 40s. Rate: 153.7 symbols/min [2025-09-22T22:18:20.790036] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:20.790607] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-09-22T22:18:20.798532] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-22T22:18:20.810182] [INFO ] [MAIN ] Derivative Progress: 452/2091 symbols completed. CRGY took 1.2s. Estimated remaining: 10m 38s. Rate: 154.0 symbols/min [2025-09-22T22:18:20.810507] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:20.811921] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:20.811864] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53472 primary records. [2025-09-22T22:18:20.812521] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-22T22:18:20.832824] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-09-22T22:18:20.833042] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-22T22:18:20.835387] [INFO ] [MAIN ] Derivative Progress: 453/2091 symbols completed. CRH took 1.2s. Estimated remaining: 10m 37s. Rate: 154.3 symbols/min [2025-09-22T22:18:20.835862] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:20.889025] [DEBUG] [LOCAL ] CRL: Loaded 43362 existing records from primary storage. [2025-09-22T22:18:20.889309] [INFO ] [MAIN ] CRL: Loaded 43362 primary data records. [2025-09-22T22:18:21.030688] [DEBUG] [LOCAL ] CRK: Loaded 52118 existing records from primary storage. [2025-09-22T22:18:21.036478] [INFO ] [MAIN ] CRK: Loaded 52118 primary data records. [2025-09-22T22:18:21.339061] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-22T22:18:21.350753] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-09-22T22:18:21.957226] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:21.958482] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 43362 primary records. [2025-09-22T22:18:21.958585] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-22T22:18:21.977177] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-09-22T22:18:21.977805] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-22T22:18:21.980760] [INFO ] [MAIN ] Derivative Progress: 454/2091 symbols completed. CRL took 1.2s. Estimated remaining: 10m 39s. Rate: 153.7 symbols/min [2025-09-22T22:18:21.983241] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:21.998785] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:21.999994] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52118 primary records. [2025-09-22T22:18:22.000205] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-22T22:18:22.020719] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-09-22T22:18:22.021035] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-22T22:18:22.030982] [INFO ] [MAIN ] Derivative Progress: 455/2091 symbols completed. CRK took 1.2s. Estimated remaining: 10m 37s. Rate: 154.0 symbols/min [2025-09-22T22:18:22.036187] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:22.037006] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:22.037850] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-09-22T22:18:22.037929] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-22T22:18:22.057848] [DEBUG] [LOCAL ] CRT: Loaded 4932 existing records from primary storage. [2025-09-22T22:18:22.068911] [INFO ] [MAIN ] CRT: Loaded 4932 primary data records. [2025-09-22T22:18:22.069510] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-09-22T22:18:22.069611] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-22T22:18:22.084248] [INFO ] [MAIN ] Derivative Progress: 456/2091 symbols completed. CRM took 1.2s. Estimated remaining: 10m 36s. Rate: 154.3 symbols/min [2025-09-22T22:18:22.104870] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:22.220441] [DEBUG] [LOCAL ] CRS: Loaded 43444 existing records from primary storage. [2025-09-22T22:18:22.254563] [INFO ] [MAIN ] CRS: Loaded 43444 primary data records. [2025-09-22T22:18:22.535402] [DEBUG] [LOCAL ] CSAN: Loaded 42137 existing records from primary storage. [2025-09-22T22:18:22.540927] [INFO ] [MAIN ] CSAN: Loaded 42137 primary data records. [2025-09-22T22:18:23.054162] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:23.055146] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4932 primary records. [2025-09-22T22:18:23.056352] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-22T22:18:23.074024] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-09-22T22:18:23.074366] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-22T22:18:23.076335] [INFO ] [MAIN ] Derivative Progress: 457/2091 symbols completed. CRT took 1.0s. Estimated remaining: 10m 38s. Rate: 153.8 symbols/min [2025-09-22T22:18:23.076684] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:23.096395] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:23.097157] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43444 primary records. [2025-09-22T22:18:23.097355] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-22T22:18:23.118615] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-09-22T22:18:23.118893] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-22T22:18:23.121103] [INFO ] [MAIN ] Derivative Progress: 458/2091 symbols completed. CRS took 1.1s. Estimated remaining: 10m 36s. Rate: 154.1 symbols/min [2025-09-22T22:18:23.142705] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:23.143002] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:23.143920] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42137 primary records. [2025-09-22T22:18:23.144064] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-22T22:18:23.170086] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-09-22T22:18:23.172779] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-22T22:18:23.175174] [INFO ] [MAIN ] Derivative Progress: 459/2091 symbols completed. CSAN took 1.1s. Estimated remaining: 10m 34s. Rate: 154.3 symbols/min [2025-09-22T22:18:23.175500] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:23.176424] [DEBUG] [LOCAL ] CSL: Loaded 31486 existing records from primary storage. [2025-09-22T22:18:23.176912] [INFO ] [MAIN ] CSL: Loaded 31486 primary data records. [2025-09-22T22:18:23.229248] [DEBUG] [LOCAL ] CSR: Loaded 12483 existing records from primary storage. [2025-09-22T22:18:23.274053] [INFO ] [MAIN ] CSR: Loaded 12483 primary data records. [2025-09-22T22:18:23.710694] [DEBUG] [LOCAL ] CSTM: Loaded 47773 existing records from primary storage. [2025-09-22T22:18:23.722041] [INFO ] [MAIN ] CSTM: Loaded 47773 primary data records. [2025-09-22T22:18:24.313595] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:24.315703] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31486 primary records. [2025-09-22T22:18:24.316084] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-22T22:18:24.335174] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-09-22T22:18:24.336306] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-22T22:18:24.338223] [INFO ] [MAIN ] Derivative Progress: 460/2091 symbols completed. CSL took 1.3s. Estimated remaining: 10m 37s. Rate: 153.7 symbols/min [2025-09-22T22:18:24.338497] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:24.360478] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:24.361479] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12483 primary records. [2025-09-22T22:18:24.362453] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-22T22:18:24.369550] [DEBUG] [LOCAL ] CSV: Loaded 13038 existing records from primary storage. [2025-09-22T22:18:24.370118] [INFO ] [MAIN ] CSV: Loaded 13038 primary data records. [2025-09-22T22:18:24.446382] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-09-22T22:18:24.429173] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:24.474863] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-22T22:18:24.477029] [INFO ] [MAIN ] Derivative Progress: 461/2091 symbols completed. CSR took 1.4s. Estimated remaining: 10m 36s. Rate: 153.9 symbols/min [2025-09-22T22:18:24.462476] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47773 primary records. [2025-09-22T22:18:24.494698] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-22T22:18:24.500115] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:24.739573] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-09-22T22:18:24.736809] [DEBUG] [LOCAL ] CTBB: Loaded 7179 existing records from primary storage. [2025-09-22T22:18:24.739905] [INFO ] [MAIN ] CTBB: Loaded 7179 primary data records. [2025-09-22T22:18:24.739825] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-22T22:18:24.763536] [INFO ] [MAIN ] Derivative Progress: 462/2091 symbols completed. CSTM took 1.6s. Estimated remaining: 10m 35s. Rate: 154.0 symbols/min [2025-09-22T22:18:24.775107] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:24.940497] [DEBUG] [LOCAL ] CTDD: Loaded 5837 existing records from primary storage. [2025-09-22T22:18:24.941072] [INFO ] [MAIN ] CTDD: Loaded 5837 primary data records. [2025-09-22T22:18:25.379845] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:25.381192] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 13038 primary records. [2025-09-22T22:18:25.381376] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-22T22:18:25.398820] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-09-22T22:18:25.399457] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-22T22:18:25.401634] [INFO ] [MAIN ] Derivative Progress: 463/2091 symbols completed. CSV took 1.1s. Estimated remaining: 10m 35s. Rate: 153.8 symbols/min [2025-09-22T22:18:25.419201] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:25.419896] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7179 primary records. [2025-09-22T22:18:25.420061] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-22T22:18:25.435678] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-09-22T22:18:25.435783] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-22T22:18:25.437773] [INFO ] [MAIN ] Derivative Progress: 464/2091 symbols completed. CTBB took 0.9s. Estimated remaining: 10m 34s. Rate: 154.1 symbols/min [2025-09-22T22:18:25.453372] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:25.453980] [INFO ] [MAIN ] CTDD: Generated 1794 derivative records from 5837 primary records. [2025-09-22T22:18:25.454045] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-22T22:18:25.468556] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1794 records). [2025-09-22T22:18:25.468615] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-22T22:18:25.471013] [INFO ] [MAIN ] Derivative Progress: 465/2091 symbols completed. CTDD took 0.7s. Estimated remaining: 10m 32s. Rate: 154.4 symbols/min [2025-09-22T22:18:25.471590] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:25.471781] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:25.471534] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:25.518355] [DEBUG] [LOCAL ] CTOS: Loaded 36886 existing records from primary storage. [2025-09-22T22:18:25.518674] [INFO ] [MAIN ] CTOS: Loaded 36886 primary data records. [2025-09-22T22:18:25.696160] [DEBUG] [LOCAL ] CTRA: Loaded 53649 existing records from primary storage. [2025-09-22T22:18:25.732371] [DEBUG] [LOCAL ] CTRE: Loaded 49213 existing records from primary storage. [2025-09-22T22:18:25.753522] [INFO ] [MAIN ] CTRA: Loaded 53649 primary data records. [2025-09-22T22:18:25.753445] [INFO ] [MAIN ] CTRE: Loaded 49213 primary data records. [2025-09-22T22:18:26.552466] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:26.553900] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 36886 primary records. [2025-09-22T22:18:26.554301] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-22T22:18:26.572215] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-09-22T22:18:26.572817] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-22T22:18:26.574755] [INFO ] [MAIN ] Derivative Progress: 466/2091 symbols completed. CTOS took 1.1s. Estimated remaining: 10m 34s. Rate: 153.8 symbols/min [2025-09-22T22:18:26.575055] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:26.596433] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:26.597610] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53649 primary records. [2025-09-22T22:18:26.597815] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-22T22:18:26.611921] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:26.620160] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49213 primary records. [2025-09-22T22:18:26.623904] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-22T22:18:26.628764] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-09-22T22:18:26.630164] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-22T22:18:26.632582] [INFO ] [MAIN ] Derivative Progress: 467/2091 symbols completed. CTRA took 1.2s. Estimated remaining: 10m 33s. Rate: 154.0 symbols/min [2025-09-22T22:18:26.633249] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:26.658956] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-09-22T22:18:26.659424] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-22T22:18:26.661696] [INFO ] [MAIN ] Derivative Progress: 468/2091 symbols completed. CTRE took 1.2s. Estimated remaining: 10m 31s. Rate: 154.4 symbols/min [2025-09-22T22:18:26.662047] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:26.681322] [DEBUG] [LOCAL ] CTRI: Loaded 37728 existing records from primary storage. [2025-09-22T22:18:26.681616] [INFO ] [MAIN ] CTRI: Loaded 37728 primary data records. [2025-09-22T22:18:26.765284] [DEBUG] [LOCAL ] CTS: Loaded 19390 existing records from primary storage. [2025-09-22T22:18:26.777821] [INFO ] [MAIN ] CTS: Loaded 19390 primary data records. [2025-09-22T22:18:27.076076] [DEBUG] [LOCAL ] CUBE: Loaded 50744 existing records from primary storage. [2025-09-22T22:18:27.125771] [INFO ] [MAIN ] CUBE: Loaded 50744 primary data records. [2025-09-22T22:18:27.695010] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:27.709189] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 37728 primary records. [2025-09-22T22:18:27.709781] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-22T22:18:27.709544] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:27.711695] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19390 primary records. [2025-09-22T22:18:27.712256] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-22T22:18:27.746511] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-09-22T22:18:27.747491] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-09-22T22:18:27.747836] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-22T22:18:27.762184] [INFO ] [MAIN ] Derivative Progress: 469/2091 symbols completed. CTS took 1.1s. Estimated remaining: 10m 33s. Rate: 153.8 symbols/min [2025-09-22T22:18:27.748101] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-22T22:18:27.765725] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:27.764993] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:27.766512] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50744 primary records. [2025-09-22T22:18:27.766717] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-22T22:18:27.767284] [INFO ] [MAIN ] Derivative Progress: 470/2091 symbols completed. CTRI took 1.2s. Estimated remaining: 10m 31s. Rate: 154.1 symbols/min [2025-09-22T22:18:27.768014] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:27.785029] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-09-22T22:18:27.785220] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-22T22:18:27.789897] [INFO ] [MAIN ] Derivative Progress: 471/2091 symbols completed. CUBE took 1.1s. Estimated remaining: 10m 30s. Rate: 154.4 symbols/min [2025-09-22T22:18:27.790270] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:27.803336] [DEBUG] [LOCAL ] CULP: Loaded 3114 existing records from primary storage. [2025-09-22T22:18:27.803479] [INFO ] [MAIN ] CULP: Loaded 3114 primary data records. [2025-09-22T22:18:27.898934] [DEBUG] [LOCAL ] CUBI: Loaded 27251 existing records from primary storage. [2025-09-22T22:18:27.916623] [INFO ] [MAIN ] CUBI: Loaded 27251 primary data records. [2025-09-22T22:18:28.274435] [DEBUG] [LOCAL ] CUK: Loaded 51015 existing records from primary storage. [2025-09-22T22:18:28.279849] [INFO ] [MAIN ] CUK: Loaded 51015 primary data records. [2025-09-22T22:18:28.798215] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:28.799031] [INFO ] [MAIN ] CULP: Generated 1794 derivative records from 3114 primary records. [2025-09-22T22:18:28.799220] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-22T22:18:28.816828] [DEBUG] [LOCAL ] CULP: Derivative data saved (1794 records). [2025-09-22T22:18:28.824880] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-22T22:18:28.830194] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:28.833341] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27251 primary records. [2025-09-22T22:18:28.832436] [INFO ] [MAIN ] Derivative Progress: 472/2091 symbols completed. CULP took 1.0s. Estimated remaining: 10m 31s. Rate: 153.8 symbols/min [2025-09-22T22:18:28.833513] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-22T22:18:28.834177] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:28.853796] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-09-22T22:18:28.854037] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-22T22:18:28.856383] [INFO ] [MAIN ] Derivative Progress: 473/2091 symbols completed. CUBI took 1.1s. Estimated remaining: 10m 30s. Rate: 154.1 symbols/min [2025-09-22T22:18:28.856942] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:28.870066] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:28.870872] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51015 primary records. [2025-09-22T22:18:28.871691] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-22T22:18:28.888349] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-09-22T22:18:28.888494] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-22T22:18:28.891215] [INFO ] [MAIN ] Derivative Progress: 474/2091 symbols completed. CUK took 1.1s. Estimated remaining: 10m 28s. Rate: 154.4 symbols/min [2025-09-22T22:18:28.891547] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:28.916618] [DEBUG] [LOCAL ] CURB: Loaded 32976 existing records from primary storage. [2025-09-22T22:18:28.916832] [INFO ] [MAIN ] CURB: Loaded 32976 primary data records. [2025-09-22T22:18:29.112377] [DEBUG] [LOCAL ] CUZ: Loaded 49416 existing records from primary storage. [2025-09-22T22:18:29.145585] [INFO ] [MAIN ] CUZ: Loaded 49416 primary data records. [2025-09-22T22:18:29.385422] [DEBUG] [LOCAL ] CVE: Loaded 53557 existing records from primary storage. [2025-09-22T22:18:29.386140] [INFO ] [MAIN ] CVE: Loaded 53557 primary data records. [2025-09-22T22:18:29.965578] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:29.966852] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 32976 primary records. [2025-09-22T22:18:29.967235] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-22T22:18:29.985323] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-09-22T22:18:29.986749] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-22T22:18:29.989958] [INFO ] [MAIN ] Derivative Progress: 475/2091 symbols completed. CURB took 1.2s. Estimated remaining: 10m 30s. Rate: 153.8 symbols/min [2025-09-22T22:18:29.991430] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:30.005362] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:30.006393] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49416 primary records. [2025-09-22T22:18:30.006696] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-22T22:18:30.029209] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-09-22T22:18:30.029553] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-22T22:18:30.038982] [INFO ] [MAIN ] Derivative Progress: 476/2091 symbols completed. CUZ took 1.2s. Estimated remaining: 10m 29s. Rate: 154.1 symbols/min [2025-09-22T22:18:30.044264] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:30.044518] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:30.045349] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53557 primary records. [2025-09-22T22:18:30.051401] [DEBUG] [LOCAL ] CVEO: Loaded 15262 existing records from primary storage. [2025-09-22T22:18:30.051114] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-22T22:18:30.051967] [INFO ] [MAIN ] CVEO: Loaded 15262 primary data records. [2025-09-22T22:18:30.113499] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-09-22T22:18:30.127079] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-22T22:18:30.146334] [INFO ] [MAIN ] Derivative Progress: 477/2091 symbols completed. CVE took 1.3s. Estimated remaining: 10m 27s. Rate: 154.4 symbols/min [2025-09-22T22:18:30.165093] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:30.409044] [DEBUG] [LOCAL ] CVLG: Loaded 15573 existing records from primary storage. [2025-09-22T22:18:30.409203] [INFO ] [MAIN ] CVLG: Loaded 15573 primary data records. [2025-09-22T22:18:30.520915] [DEBUG] [LOCAL ] CVI: Loaded 46417 existing records from primary storage. [2025-09-22T22:18:30.540523] [INFO ] [MAIN ] CVI: Loaded 46417 primary data records. [2025-09-22T22:18:31.059818] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:31.060806] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15262 primary records. [2025-09-22T22:18:31.062869] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-22T22:18:31.100529] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:31.102697] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15573 primary records. [2025-09-22T22:18:31.101626] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-09-22T22:18:31.102992] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-22T22:18:31.103069] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-22T22:18:31.105546] [INFO ] [MAIN ] Derivative Progress: 478/2091 symbols completed. CVEO took 1.1s. Estimated remaining: 10m 29s. Rate: 153.9 symbols/min [2025-09-22T22:18:31.123300] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-09-22T22:18:31.124133] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-22T22:18:31.126388] [INFO ] [MAIN ] Derivative Progress: 479/2091 symbols completed. CVLG took 1.0s. Estimated remaining: 10m 27s. Rate: 154.2 symbols/min [2025-09-22T22:18:31.139040] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:31.139608] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46417 primary records. [2025-09-22T22:18:31.139694] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-22T22:18:31.154706] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-09-22T22:18:31.154764] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-22T22:18:31.157379] [INFO ] [MAIN ] Derivative Progress: 480/2091 symbols completed. CVI took 1.1s. Estimated remaining: 10m 26s. Rate: 154.5 symbols/min [2025-09-22T22:18:31.157980] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:31.158284] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:31.158502] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:31.235228] [DEBUG] [LOCAL ] CVS: Loaded 53698 existing records from primary storage. [2025-09-22T22:18:31.235500] [INFO ] [MAIN ] CVS: Loaded 53698 primary data records. [2025-09-22T22:18:31.370423] [DEBUG] [LOCAL ] CVNA: Loaded 53029 existing records from primary storage. [2025-09-22T22:18:31.370737] [INFO ] [MAIN ] CVNA: Loaded 53029 primary data records. [2025-09-22T22:18:31.371621] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-22T22:18:31.406579] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-09-22T22:18:32.339260] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:32.353674] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53698 primary records. [2025-09-22T22:18:32.354436] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-22T22:18:32.354123] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:32.356563] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 53029 primary records. [2025-09-22T22:18:32.356947] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-22T22:18:32.382061] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-09-22T22:18:32.385301] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-22T22:18:32.387128] [INFO ] [MAIN ] Derivative Progress: 481/2091 symbols completed. CVS took 1.2s. Estimated remaining: 10m 28s. Rate: 153.8 symbols/min [2025-09-22T22:18:32.390366] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:32.392963] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-09-22T22:18:32.393815] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-22T22:18:32.396112] [INFO ] [MAIN ] Derivative Progress: 482/2091 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 26s. Rate: 154.1 symbols/min [2025-09-22T22:18:32.396528] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:32.410481] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:32.411270] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-09-22T22:18:32.411535] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-22T22:18:32.428130] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-09-22T22:18:32.428323] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-22T22:18:32.431635] [INFO ] [MAIN ] Derivative Progress: 483/2091 symbols completed. CVX took 1.3s. Estimated remaining: 10m 25s. Rate: 154.4 symbols/min [2025-09-22T22:18:32.432168] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:32.450673] [DEBUG] [LOCAL ] CW: Loaded 22575 existing records from primary storage. [2025-09-22T22:18:32.450807] [INFO ] [MAIN ] CW: Loaded 22575 primary data records. [2025-09-22T22:18:32.790479] [DEBUG] [LOCAL ] CWAN: Loaded 52393 existing records from primary storage. [2025-09-22T22:18:32.802839] [INFO ] [MAIN ] CWAN: Loaded 52393 primary data records. [2025-09-22T22:18:32.815086] [DEBUG] [LOCAL ] CWEN: Loaded 45071 existing records from primary storage. [2025-09-22T22:18:32.835715] [INFO ] [MAIN ] CWEN: Loaded 45071 primary data records. [2025-09-22T22:18:33.449305] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:18:33.450504] [INFO ] [MAIN ] CW: Generated 1793 derivative records from 22575 primary records. [2025-09-22T22:18:33.450750] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-22T22:18:33.469253] [DEBUG] [LOCAL ] CW: Derivative data saved (1793 records). [2025-09-22T22:18:33.469745] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-22T22:18:33.472064] [INFO ] [MAIN ] Derivative Progress: 484/2091 symbols completed. CW took 1.1s. Estimated remaining: 10m 27s. Rate: 153.9 symbols/min [2025-09-22T22:18:33.472601] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:33.492710] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:33.494211] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52393 primary records. [2025-09-22T22:18:33.494379] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-22T22:18:33.516411] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:33.522433] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45071 primary records. [2025-09-22T22:18:33.524391] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-09-22T22:18:33.524539] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-22T22:18:33.524447] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-22T22:18:33.527080] [INFO ] [MAIN ] Derivative Progress: 485/2091 symbols completed. CWAN took 1.1s. Estimated remaining: 10m 25s. Rate: 154.1 symbols/min [2025-09-22T22:18:33.527781] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:33.544701] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-09-22T22:18:33.544832] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-22T22:18:33.547212] [INFO ] [MAIN ] Derivative Progress: 486/2091 symbols completed. CWEN took 1.1s. Estimated remaining: 10m 24s. Rate: 154.4 symbols/min [2025-09-22T22:18:33.547593] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:33.593111] [DEBUG] [LOCAL ] CWH: Loaded 51418 existing records from primary storage. [2025-09-22T22:18:33.593426] [INFO ] [MAIN ] CWH: Loaded 51418 primary data records. [2025-09-22T22:18:33.702108] [DEBUG] [LOCAL ] CWT: Loaded 27803 existing records from primary storage. [2025-09-22T22:18:33.726869] [INFO ] [MAIN ] CWT: Loaded 27803 primary data records. [2025-09-22T22:18:33.867868] [DEBUG] [LOCAL ] CWK: Loaded 49391 existing records from primary storage. [2025-09-22T22:18:33.903605] [INFO ] [MAIN ] CWK: Loaded 49391 primary data records. [2025-09-22T22:18:34.687219] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:34.688800] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51418 primary records. [2025-09-22T22:18:34.689136] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-22T22:18:34.709447] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-09-22T22:18:34.709789] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-22T22:18:34.720435] [INFO ] [MAIN ] Derivative Progress: 487/2091 symbols completed. CWH took 1.2s. Estimated remaining: 10m 26s. Rate: 153.8 symbols/min [2025-09-22T22:18:34.721939] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:34.740779] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:34.741338] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:34.742505] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 27803 primary records. [2025-09-22T22:18:34.742810] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-22T22:18:34.743712] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49391 primary records. [2025-09-22T22:18:34.744735] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-22T22:18:34.763777] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-09-22T22:18:34.767524] [DEBUG] [LOCAL ] CXE: Loaded 7246 existing records from primary storage. [2025-09-22T22:18:34.775045] [INFO ] [MAIN ] CXE: Loaded 7246 primary data records. [2025-09-22T22:18:34.767892] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-22T22:18:34.798157] [INFO ] [MAIN ] Derivative Progress: 488/2091 symbols completed. CWT took 1.3s. Estimated remaining: 10m 24s. Rate: 154.1 symbols/min [2025-09-22T22:18:34.845778] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:34.833038] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-09-22T22:18:34.891494] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-22T22:18:34.898056] [INFO ] [MAIN ] Derivative Progress: 489/2091 symbols completed. CWK took 1.4s. Estimated remaining: 10m 23s. Rate: 154.3 symbols/min [2025-09-22T22:18:34.909234] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:34.956867] [DEBUG] [LOCAL ] CXH: Loaded 4404 existing records from primary storage. [2025-09-22T22:18:34.957136] [INFO ] [MAIN ] CXH: Loaded 4404 primary data records. [2025-09-22T22:18:35.455431] [DEBUG] [LOCAL ] CXM: Loaded 47973 existing records from primary storage. [2025-09-22T22:18:35.456102] [INFO ] [MAIN ] CXM: Loaded 47973 primary data records. [2025-09-22T22:18:35.666821] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:35.790310] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 7246 primary records. [2025-09-22T22:18:35.791032] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-22T22:18:35.810935] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-09-22T22:18:35.813899] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-22T22:18:35.816279] [INFO ] [MAIN ] Derivative Progress: 490/2091 symbols completed. CXE took 1.1s. Estimated remaining: 10m 24s. Rate: 153.9 symbols/min [2025-09-22T22:18:35.817382] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:35.832262] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-22T22:18:35.833109] [INFO ] [MAIN ] CXH: Generated 1792 derivative records from 4404 primary records. [2025-09-22T22:18:35.833311] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-22T22:18:35.850392] [DEBUG] [LOCAL ] CXH: Derivative data saved (1792 records). [2025-09-22T22:18:35.850586] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-22T22:18:35.853030] [INFO ] [MAIN ] Derivative Progress: 491/2091 symbols completed. CXH took 1.0s. Estimated remaining: 10m 23s. Rate: 154.1 symbols/min [2025-09-22T22:18:35.855856] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:35.881974] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:35.893015] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47973 primary records. [2025-09-22T22:18:35.893211] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-22T22:18:35.894577] [DEBUG] [LOCAL ] CXT: Loaded 31010 existing records from primary storage. [2025-09-22T22:18:35.903369] [INFO ] [MAIN ] CXT: Loaded 31010 primary data records. [2025-09-22T22:18:35.948208] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-09-22T22:18:35.948378] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-22T22:18:35.957628] [INFO ] [MAIN ] Derivative Progress: 492/2091 symbols completed. CXM took 1.1s. Estimated remaining: 10m 21s. Rate: 154.4 symbols/min [2025-09-22T22:18:35.994721] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:36.131495] [DEBUG] [LOCAL ] CXW: Loaded 44413 existing records from primary storage. [2025-09-22T22:18:36.131810] [INFO ] [MAIN ] CXW: Loaded 44413 primary data records. [2025-09-22T22:18:36.418508] [DEBUG] [LOCAL ] CYD: Loaded 26609 existing records from primary storage. [2025-09-22T22:18:36.430174] [INFO ] [MAIN ] CYD: Loaded 26609 primary data records. [2025-09-22T22:18:36.960553] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:36.961438] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 31010 primary records. [2025-09-22T22:18:36.963121] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-22T22:18:36.982760] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-09-22T22:18:36.983053] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-22T22:18:36.985219] [INFO ] [MAIN ] Derivative Progress: 493/2091 symbols completed. CXT took 1.2s. Estimated remaining: 10m 23s. Rate: 153.9 symbols/min [2025-09-22T22:18:37.006326] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:37.007115] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 44413 primary records. [2025-09-22T22:18:37.007264] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-22T22:18:37.037909] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-09-22T22:18:37.037998] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-22T22:18:37.036799] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:37.038726] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26609 primary records. [2025-09-22T22:18:37.040945] [INFO ] [MAIN ] Derivative Progress: 494/2091 symbols completed. CXW took 1.2s. Estimated remaining: 10m 22s. Rate: 154.1 symbols/min [2025-09-22T22:18:37.041096] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-22T22:18:37.056848] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-09-22T22:18:37.057081] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-22T22:18:37.060187] [INFO ] [MAIN ] Derivative Progress: 495/2091 symbols completed. CYD took 1.1s. Estimated remaining: 10m 20s. Rate: 154.4 symbols/min [2025-09-22T22:18:37.061115] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:37.061179] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:37.060869] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:37.077468] [DEBUG] [LOCAL ] DAC: Loaded 12616 existing records from primary storage. [2025-09-22T22:18:37.077693] [INFO ] [MAIN ] DAC: Loaded 12616 primary data records. [2025-09-22T22:18:37.414321] [DEBUG] [LOCAL ] CYH: Loaded 47883 existing records from primary storage. [2025-09-22T22:18:37.414583] [INFO ] [MAIN ] CYH: Loaded 47883 primary data records. [2025-09-22T22:18:37.554442] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-22T22:18:37.589722] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-09-22T22:18:38.068439] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:38.069464] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12616 primary records. [2025-09-22T22:18:38.069852] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-22T22:18:38.087887] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-09-22T22:18:38.088376] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-22T22:18:38.091000] [INFO ] [MAIN ] Derivative Progress: 496/2091 symbols completed. DAC took 1.0s. Estimated remaining: 10m 22s. Rate: 153.9 symbols/min [2025-09-22T22:18:38.091250] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:38.108392] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:38.109779] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47883 primary records. [2025-09-22T22:18:38.110944] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-22T22:18:38.127402] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-09-22T22:18:38.127556] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-22T22:18:38.129392] [INFO ] [MAIN ] Derivative Progress: 497/2091 symbols completed. CYH took 1.1s. Estimated remaining: 10m 20s. Rate: 154.2 symbols/min [2025-09-22T22:18:38.130212] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:38.148227] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:38.149078] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-09-22T22:18:38.159888] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-22T22:18:38.186411] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-09-22T22:18:38.188437] [DEBUG] [LOCAL ] DAO: Loaded 21421 existing records from primary storage. [2025-09-22T22:18:38.200629] [INFO ] [MAIN ] DAO: Loaded 21421 primary data records. [2025-09-22T22:18:38.188718] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-22T22:18:38.247969] [DEBUG] [LOCAL ] DAN: Loaded 49005 existing records from primary storage. [2025-09-22T22:18:38.248128] [INFO ] [MAIN ] DAN: Loaded 49005 primary data records. [2025-09-22T22:18:38.239991] [INFO ] [MAIN ] Derivative Progress: 498/2091 symbols completed. DAL took 1.2s. Estimated remaining: 10m 19s. Rate: 154.4 symbols/min [2025-09-22T22:18:38.320719] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:38.871262] [DEBUG] [LOCAL ] DAR: Loaded 51861 existing records from primary storage. [2025-09-22T22:18:38.871596] [INFO ] [MAIN ] DAR: Loaded 51861 primary data records. [2025-09-22T22:18:39.024859] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:39.037530] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 21421 primary records. [2025-09-22T22:18:39.037676] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-22T22:18:39.274913] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-09-22T22:18:39.276825] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:39.277720] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49005 primary records. [2025-09-22T22:18:39.276905] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-22T22:18:39.280883] [INFO ] [MAIN ] Derivative Progress: 499/2091 symbols completed. DAO took 1.2s. Estimated remaining: 10m 21s. Rate: 153.9 symbols/min [2025-09-22T22:18:39.281398] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:39.277824] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-22T22:18:39.304116] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-09-22T22:18:39.304720] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-22T22:18:39.307763] [INFO ] [MAIN ] Derivative Progress: 500/2091 symbols completed. DAN took 1.2s. Estimated remaining: 10m 19s. Rate: 154.2 symbols/min [2025-09-22T22:18:39.308332] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:39.339960] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:39.340594] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51861 primary records. [2025-09-22T22:18:39.340773] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-22T22:18:39.390356] [DEBUG] [LOCAL ] DAVA: Loaded 40440 existing records from primary storage. [2025-09-22T22:18:39.391069] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-09-22T22:18:39.391193] [INFO ] [MAIN ] DAVA: Loaded 40440 primary data records. [2025-09-22T22:18:39.391297] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-22T22:18:39.399214] [INFO ] [MAIN ] Derivative Progress: 501/2091 symbols completed. DAR took 1.1s. Estimated remaining: 10m 18s. Rate: 154.4 symbols/min [2025-09-22T22:18:39.428109] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:39.517713] [DEBUG] [LOCAL ] DAY: Loaded 49932 existing records from primary storage. [2025-09-22T22:18:39.534098] [INFO ] [MAIN ] DAY: Loaded 49932 primary data records. [2025-09-22T22:18:40.066145] [DEBUG] [LOCAL ] DB: Loaded 52637 existing records from primary storage. [2025-09-22T22:18:40.067462] [INFO ] [MAIN ] DB: Loaded 52637 primary data records. [2025-09-22T22:18:40.470942] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:40.472413] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 40440 primary records. [2025-09-22T22:18:40.473515] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-22T22:18:40.505264] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-09-22T22:18:40.510124] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-22T22:18:40.510760] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:40.514959] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49932 primary records. [2025-09-22T22:18:40.514027] [INFO ] [MAIN ] Derivative Progress: 502/2091 symbols completed. DAVA took 1.2s. Estimated remaining: 10m 20s. Rate: 153.8 symbols/min [2025-09-22T22:18:40.515136] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-22T22:18:40.515728] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:40.535185] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-09-22T22:18:40.535732] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-22T22:18:40.540032] [INFO ] [MAIN ] Derivative Progress: 503/2091 symbols completed. DAY took 1.2s. Estimated remaining: 10m 18s. Rate: 154.1 symbols/min [2025-09-22T22:18:40.540842] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:40.559771] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:40.560682] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52637 primary records. [2025-09-22T22:18:40.560875] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-22T22:18:40.591680] [DEBUG] [LOCAL ] DBL: Loaded 9064 existing records from primary storage. [2025-09-22T22:18:40.592838] [INFO ] [MAIN ] DBL: Loaded 9064 primary data records. [2025-09-22T22:18:40.606552] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-09-22T22:18:40.617421] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-22T22:18:40.630968] [INFO ] [MAIN ] Derivative Progress: 504/2091 symbols completed. DB took 1.2s. Estimated remaining: 10m 17s. Rate: 154.4 symbols/min [2025-09-22T22:18:40.649198] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:40.709932] [DEBUG] [LOCAL ] DBI: Loaded 45104 existing records from primary storage. [2025-09-22T22:18:40.721726] [INFO ] [MAIN ] DBI: Loaded 45104 primary data records. [2025-09-22T22:18:41.251670] [DEBUG] [LOCAL ] DCI: Loaded 37609 existing records from primary storage. [2025-09-22T22:18:41.252639] [INFO ] [MAIN ] DCI: Loaded 37609 primary data records. [2025-09-22T22:18:41.590219] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:41.592742] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9064 primary records. [2025-09-22T22:18:41.593954] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-22T22:18:41.621043] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:41.625002] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-09-22T22:18:41.625106] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-22T22:18:41.627170] [INFO ] [MAIN ] Derivative Progress: 505/2091 symbols completed. DBL took 1.1s. Estimated remaining: 10m 18s. Rate: 153.9 symbols/min [2025-09-22T22:18:41.624037] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 45104 primary records. [2025-09-22T22:18:41.628878] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-22T22:18:41.627876] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:41.646225] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-09-22T22:18:41.646488] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-22T22:18:41.648518] [INFO ] [MAIN ] Derivative Progress: 506/2091 symbols completed. DBI took 1.1s. Estimated remaining: 10m 17s. Rate: 154.2 symbols/min [2025-09-22T22:18:41.648986] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:41.663076] [DEBUG] [LOCAL ] DCO: Loaded 13666 existing records from primary storage. [2025-09-22T22:18:41.677508] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:41.677716] [INFO ] [MAIN ] DCO: Loaded 13666 primary data records. [2025-09-22T22:18:41.678622] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 37609 primary records. [2025-09-22T22:18:41.684122] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-22T22:18:41.899111] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-09-22T22:18:41.899308] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-22T22:18:41.902188] [INFO ] [MAIN ] Derivative Progress: 507/2091 symbols completed. DCI took 1.3s. Estimated remaining: 10m 16s. Rate: 154.3 symbols/min [2025-09-22T22:18:42.025810] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:42.045441] [DEBUG] [LOCAL ] DD: Loaded 52821 existing records from primary storage. [2025-09-22T22:18:42.046509] [INFO ] [MAIN ] DD: Loaded 52821 primary data records. [2025-09-22T22:18:42.172488] [DEBUG] [LOCAL ] DDS: Loaded 13317 existing records from primary storage. [2025-09-22T22:18:42.174112] [INFO ] [MAIN ] DDS: Loaded 13317 primary data records. [2025-09-22T22:18:42.773684] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:42.774814] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13666 primary records. [2025-09-22T22:18:42.776028] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-22T22:18:42.798387] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-09-22T22:18:42.799025] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-22T22:18:42.801879] [INFO ] [MAIN ] Derivative Progress: 508/2091 symbols completed. DCO took 1.2s. Estimated remaining: 10m 17s. Rate: 153.9 symbols/min [2025-09-22T22:18:42.821388] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:18:42.822217] [INFO ] [MAIN ] DD: Generated 1793 derivative records from 52821 primary records. [2025-09-22T22:18:42.822523] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-22T22:18:42.853626] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:42.854900] [INFO ] [MAIN ] DDS: Generated 1794 derivative records from 13317 primary records. [2025-09-22T22:18:42.855412] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-22T22:18:42.855323] [DEBUG] [LOCAL ] DD: Derivative data saved (1793 records). [2025-09-22T22:18:42.855578] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-22T22:18:42.857594] [INFO ] [MAIN ] Derivative Progress: 509/2091 symbols completed. DD took 1.2s. Estimated remaining: 10m 16s. Rate: 154.1 symbols/min [2025-09-22T22:18:42.873628] [DEBUG] [LOCAL ] DDS: Derivative data saved (1794 records). [2025-09-22T22:18:42.873740] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-22T22:18:42.876288] [INFO ] [MAIN ] Derivative Progress: 510/2091 symbols completed. DDS took 0.9s. Estimated remaining: 10m 14s. Rate: 154.4 symbols/min [2025-09-22T22:18:42.877040] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:42.877184] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:42.877624] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:42.883368] [DEBUG] [LOCAL ] DDT: Loaded 2092 existing records from primary storage. [2025-09-22T22:18:42.883493] [INFO ] [MAIN ] DDT: Loaded 2092 primary data records. [2025-09-22T22:18:43.252375] [DEBUG] [LOCAL ] DEA: Loaded 41546 existing records from primary storage. [2025-09-22T22:18:43.254967] [INFO ] [MAIN ] DEA: Loaded 41546 primary data records. [2025-09-22T22:18:43.256347] [DEBUG] [LOCAL ] DE: Loaded 47776 existing records from primary storage. [2025-09-22T22:18:43.268119] [INFO ] [MAIN ] DE: Loaded 47776 primary data records. [2025-09-22T22:18:43.880987] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:43.883029] [INFO ] [MAIN ] DDT: Generated 1794 derivative records from 2092 primary records. [2025-09-22T22:18:43.884080] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-22T22:18:43.905476] [DEBUG] [LOCAL ] DDT: Derivative data saved (1794 records). [2025-09-22T22:18:43.905889] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-22T22:18:43.910739] [INFO ] [MAIN ] Derivative Progress: 511/2091 symbols completed. DDT took 1.0s. Estimated remaining: 10m 16s. Rate: 153.9 symbols/min [2025-09-22T22:18:43.912022] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:43.945722] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:43.951760] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 41546 primary records. [2025-09-22T22:18:43.952117] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:43.952250] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-22T22:18:43.953737] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47776 primary records. [2025-09-22T22:18:43.953832] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-22T22:18:43.991616] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-09-22T22:18:43.992519] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-22T22:18:43.996883] [INFO ] [MAIN ] Derivative Progress: 512/2091 symbols completed. DE took 1.1s. Estimated remaining: 10m 15s. Rate: 154.2 symbols/min [2025-09-22T22:18:43.997538] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:44.010063] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-09-22T22:18:44.010304] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-22T22:18:44.019254] [INFO ] [MAIN ] Derivative Progress: 513/2091 symbols completed. DEA took 1.1s. Estimated remaining: 10m 13s. Rate: 154.5 symbols/min [2025-09-22T22:18:44.019741] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:44.020411] [DEBUG] [LOCAL ] DEC: Loaded 30832 existing records from primary storage. [2025-09-22T22:18:44.021000] [INFO ] [MAIN ] DEC: Loaded 30832 primary data records. [2025-09-22T22:18:44.379755] [DEBUG] [LOCAL ] DEI: Loaded 48508 existing records from primary storage. [2025-09-22T22:18:44.379911] [INFO ] [MAIN ] DEI: Loaded 48508 primary data records. [2025-09-22T22:18:44.488250] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-09-22T22:18:44.506680] [INFO ] [MAIN ] DELL: Loaded 53735 primary data records. [2025-09-22T22:18:45.096157] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:45.097963] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30832 primary records. [2025-09-22T22:18:45.098217] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-22T22:18:45.116502] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-09-22T22:18:45.116729] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-22T22:18:45.119427] [INFO ] [MAIN ] Derivative Progress: 514/2091 symbols completed. DEC took 1.2s. Estimated remaining: 10m 15s. Rate: 153.9 symbols/min [2025-09-22T22:18:45.120413] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:45.139490] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:45.140395] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48508 primary records. [2025-09-22T22:18:45.141120] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-22T22:18:45.160558] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-09-22T22:18:45.162205] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-22T22:18:45.164282] [INFO ] [MAIN ] Derivative Progress: 515/2091 symbols completed. DEI took 1.2s. Estimated remaining: 10m 13s. Rate: 154.2 symbols/min [2025-09-22T22:18:45.164951] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:45.179171] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:45.180077] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53735 primary records. [2025-09-22T22:18:45.180234] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-22T22:18:45.209800] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-09-22T22:18:45.209962] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-22T22:18:45.212327] [INFO ] [MAIN ] Derivative Progress: 516/2091 symbols completed. DELL took 1.2s. Estimated remaining: 10m 12s. Rate: 154.4 symbols/min [2025-09-22T22:18:45.212833] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:45.232451] [DEBUG] [LOCAL ] DEO: Loaded 49009 existing records from primary storage. [2025-09-22T22:18:45.241985] [INFO ] [MAIN ] DEO: Loaded 49009 primary data records. [2025-09-22T22:18:45.342164] [DEBUG] [LOCAL ] DFH: Loaded 32971 existing records from primary storage. [2025-09-22T22:18:45.361374] [INFO ] [MAIN ] DFH: Loaded 32971 primary data records. [2025-09-22T22:18:45.415431] [DEBUG] [LOCAL ] DFIN: Loaded 23411 existing records from primary storage. [2025-09-22T22:18:45.444264] [INFO ] [MAIN ] DFIN: Loaded 23411 primary data records. [2025-09-22T22:18:46.224583] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:46.225786] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 49009 primary records. [2025-09-22T22:18:46.227711] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-22T22:18:46.253887] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:46.259169] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32971 primary records. [2025-09-22T22:18:46.258409] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-09-22T22:18:46.259813] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-22T22:18:46.260342] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-22T22:18:46.262481] [INFO ] [MAIN ] Derivative Progress: 517/2091 symbols completed. DEO took 1.1s. Estimated remaining: 10m 14s. Rate: 153.9 symbols/min [2025-09-22T22:18:46.273184] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:46.281164] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-09-22T22:18:46.281314] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-22T22:18:46.283461] [INFO ] [MAIN ] Derivative Progress: 518/2091 symbols completed. DFH took 1.1s. Estimated remaining: 10m 12s. Rate: 154.2 symbols/min [2025-09-22T22:18:46.284443] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:46.299066] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:46.300027] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 23411 primary records. [2025-09-22T22:18:46.300184] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-22T22:18:46.320055] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-09-22T22:18:46.320244] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-22T22:18:46.322522] [INFO ] [MAIN ] Derivative Progress: 519/2091 symbols completed. DFIN took 1.1s. Estimated remaining: 10m 11s. Rate: 154.5 symbols/min [2025-09-22T22:18:46.322935] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:46.328485] [DEBUG] [LOCAL ] DFP: Loaded 11675 existing records from primary storage. [2025-09-22T22:18:46.329805] [INFO ] [MAIN ] DFP: Loaded 11675 primary data records. [2025-09-22T22:18:46.555179] [DEBUG] [LOCAL ] DGX: Loaded 45280 existing records from primary storage. [2025-09-22T22:18:46.554349] [DEBUG] [LOCAL ] DHF: Loaded 20893 existing records from primary storage. [2025-09-22T22:18:46.633754] [INFO ] [MAIN ] DGX: Loaded 45280 primary data records. [2025-09-22T22:18:46.692198] [INFO ] [MAIN ] DHF: Loaded 20893 primary data records. [2025-09-22T22:18:47.361159] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:47.362600] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11675 primary records. [2025-09-22T22:18:47.363538] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-22T22:18:47.398519] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-09-22T22:18:47.398428] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:47.399717] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-22T22:18:47.404097] [INFO ] [MAIN ] Derivative Progress: 520/2091 symbols completed. DFP took 1.1s. Estimated remaining: 10m 12s. Rate: 153.9 symbols/min [2025-09-22T22:18:47.402090] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 45280 primary records. [2025-09-22T22:18:47.404715] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-22T22:18:47.405463] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:47.428576] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:47.433256] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 20893 primary records. [2025-09-22T22:18:47.434908] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-22T22:18:47.438353] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-09-22T22:18:47.438848] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-22T22:18:47.440893] [INFO ] [MAIN ] Derivative Progress: 521/2091 symbols completed. DGX took 1.2s. Estimated remaining: 10m 11s. Rate: 154.2 symbols/min [2025-09-22T22:18:47.441463] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:47.457230] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-09-22T22:18:47.457412] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-22T22:18:47.460044] [INFO ] [MAIN ] Derivative Progress: 522/2091 symbols completed. DHF took 1.1s. Estimated remaining: 10m 9s. Rate: 154.5 symbols/min [2025-09-22T22:18:47.460389] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:47.475769] [DEBUG] [LOCAL ] DIAX: Loaded 12386 existing records from primary storage. [2025-09-22T22:18:47.476076] [INFO ] [MAIN ] DIAX: Loaded 12386 primary data records. [2025-09-22T22:18:47.833603] [DEBUG] [LOCAL ] DHI: Loaded 53377 existing records from primary storage. [2025-09-22T22:18:47.834076] [INFO ] [MAIN ] DHI: Loaded 53377 primary data records. [2025-09-22T22:18:47.903020] [DEBUG] [LOCAL ] DHT: Loaded 47958 existing records from primary storage. [2025-09-22T22:18:47.911694] [INFO ] [MAIN ] DHT: Loaded 47958 primary data records. [2025-09-22T22:18:48.564052] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:48.567057] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 12386 primary records. [2025-09-22T22:18:48.567746] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-22T22:18:48.586356] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-09-22T22:18:48.586796] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-22T22:18:48.589026] [INFO ] [MAIN ] Derivative Progress: 523/2091 symbols completed. DIAX took 1.1s. Estimated remaining: 10m 11s. Rate: 153.9 symbols/min [2025-09-22T22:18:48.607076] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:48.607938] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53377 primary records. [2025-09-22T22:18:48.608147] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-22T22:18:48.627924] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-09-22T22:18:48.628111] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-22T22:18:48.630801] [INFO ] [MAIN ] Derivative Progress: 524/2091 symbols completed. DHI took 1.2s. Estimated remaining: 10m 10s. Rate: 154.2 symbols/min [2025-09-22T22:18:48.643451] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:48.644062] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47958 primary records. [2025-09-22T22:18:48.644125] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-22T22:18:48.660014] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-09-22T22:18:48.660078] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-22T22:18:48.662309] [INFO ] [MAIN ] Derivative Progress: 525/2091 symbols completed. DHT took 1.2s. Estimated remaining: 10m 8s. Rate: 154.5 symbols/min [2025-09-22T22:18:48.662825] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:48.662986] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:48.663180] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:48.703054] [DEBUG] [LOCAL ] DIN: Loaded 37289 existing records from primary storage. [2025-09-22T22:18:48.703310] [INFO ] [MAIN ] DIN: Loaded 37289 primary data records. [2025-09-22T22:18:49.090830] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-22T22:18:49.091029] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-09-22T22:18:49.103724] [DEBUG] [LOCAL ] DINO: Loaded 52964 existing records from primary storage. [2025-09-22T22:18:49.113669] [INFO ] [MAIN ] DINO: Loaded 52964 primary data records. [2025-09-22T22:18:49.736404] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:49.739494] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37289 primary records. [2025-09-22T22:18:49.740768] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-22T22:18:49.772575] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-09-22T22:18:49.772948] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:49.773296] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-22T22:18:49.774404] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-09-22T22:18:49.774551] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-22T22:18:49.776955] [INFO ] [MAIN ] Derivative Progress: 526/2091 symbols completed. DIN took 1.1s. Estimated remaining: 10m 10s. Rate: 153.9 symbols/min [2025-09-22T22:18:49.778870] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:49.797511] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-09-22T22:18:49.798546] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-22T22:18:49.800407] [INFO ] [MAIN ] Derivative Progress: 527/2091 symbols completed. DIS took 1.1s. Estimated remaining: 10m 9s. Rate: 154.2 symbols/min [2025-09-22T22:18:49.800909] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:49.815737] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:49.816555] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52964 primary records. [2025-09-22T22:18:49.816726] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-22T22:18:49.840571] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-09-22T22:18:49.849709] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-22T22:18:49.853945] [DEBUG] [LOCAL ] DKL: Loaded 19282 existing records from primary storage. [2025-09-22T22:18:49.853009] [INFO ] [MAIN ] Derivative Progress: 528/2091 symbols completed. DINO took 1.2s. Estimated remaining: 10m 7s. Rate: 154.5 symbols/min [2025-09-22T22:18:49.854305] [INFO ] [MAIN ] DKL: Loaded 19282 primary data records. [2025-09-22T22:18:49.854513] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:49.853329] [DEBUG] [LOCAL ] DLNG: Loaded 6220 existing records from primary storage. [2025-09-22T22:18:49.899583] [INFO ] [MAIN ] DLNG: Loaded 6220 primary data records. [2025-09-22T22:18:50.276248] [DEBUG] [LOCAL ] DLX: Loaded 29127 existing records from primary storage. [2025-09-22T22:18:50.522477] [INFO ] [MAIN ] DLX: Loaded 29127 primary data records. [2025-09-22T22:18:50.911390] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:50.919958] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 19282 primary records. [2025-09-22T22:18:50.924682] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-22T22:18:50.925991] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:50.927624] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6220 primary records. [2025-09-22T22:18:50.928095] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-22T22:18:50.951904] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-09-22T22:18:50.955980] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-22T22:18:50.962329] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-09-22T22:18:50.959382] [INFO ] [MAIN ] Derivative Progress: 529/2091 symbols completed. DKL took 1.2s. Estimated remaining: 10m 9s. Rate: 153.9 symbols/min [2025-09-22T22:18:50.962673] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-22T22:18:50.965359] [INFO ] [MAIN ] Derivative Progress: 530/2091 symbols completed. DLNG took 1.2s. Estimated remaining: 10m 7s. Rate: 154.2 symbols/min [2025-09-22T22:18:50.963046] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:50.966370] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:50.977198] [DEBUG] [LOCAL ] DMA: Loaded 4495 existing records from primary storage. [2025-09-22T22:18:50.989966] [INFO ] [MAIN ] DMA: Loaded 4495 primary data records. [2025-09-22T22:18:51.017286] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:51.070631] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 29127 primary records. [2025-09-22T22:18:51.109264] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-22T22:18:51.114041] [DEBUG] [LOCAL ] DLY: Loaded 19427 existing records from primary storage. [2025-09-22T22:18:51.122207] [INFO ] [MAIN ] DLY: Loaded 19427 primary data records. [2025-09-22T22:18:51.293737] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-09-22T22:18:51.304866] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-22T22:18:51.394000] [INFO ] [MAIN ] Derivative Progress: 531/2091 symbols completed. DLX took 1.5s. Estimated remaining: 10m 7s. Rate: 154.2 symbols/min [2025-09-22T22:18:51.407216] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:51.644493] [DEBUG] [LOCAL ] DMB: Loaded 10109 existing records from primary storage. [2025-09-22T22:18:51.654707] [INFO ] [MAIN ] DMB: Loaded 10109 primary data records. [2025-09-22T22:18:52.015200] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:52.016877] [INFO ] [MAIN ] DMA: Generated 1794 derivative records from 4495 primary records. [2025-09-22T22:18:52.017054] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-22T22:18:52.042429] [DEBUG] [LOCAL ] DMA: Derivative data saved (1794 records). [2025-09-22T22:18:52.048601] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-22T22:18:52.049296] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:52.052424] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 19427 primary records. [2025-09-22T22:18:52.052679] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-22T22:18:52.051317] [INFO ] [MAIN ] Derivative Progress: 532/2091 symbols completed. DMA took 1.1s. Estimated remaining: 10m 8s. Rate: 154.0 symbols/min [2025-09-22T22:18:52.054075] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:52.070759] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-09-22T22:18:52.071168] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-22T22:18:52.073544] [INFO ] [MAIN ] Derivative Progress: 533/2091 symbols completed. DLY took 1.1s. Estimated remaining: 10m 6s. Rate: 154.2 symbols/min [2025-09-22T22:18:52.074133] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:52.097307] [DEBUG] [LOCAL ] DMO: Loaded 9863 existing records from primary storage. [2025-09-22T22:18:52.097919] [INFO ] [MAIN ] DMO: Loaded 9863 primary data records. [2025-09-22T22:18:52.109622] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:52.164512] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10109 primary records. [2025-09-22T22:18:52.187542] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-22T22:18:52.443700] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-09-22T22:18:52.443956] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-22T22:18:52.447572] [DEBUG] [LOCAL ] DNA: Loaded 48411 existing records from primary storage. [2025-09-22T22:18:52.446193] [INFO ] [MAIN ] Derivative Progress: 534/2091 symbols completed. DMB took 1.0s. Estimated remaining: 10m 6s. Rate: 154.3 symbols/min [2025-09-22T22:18:52.448461] [INFO ] [MAIN ] DNA: Loaded 48411 primary data records. [2025-09-22T22:18:52.448781] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:52.821630] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:52.822911] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9863 primary records. [2025-09-22T22:18:52.823009] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-22T22:18:52.837012] [DEBUG] [LOCAL ] DNOW: Loaded 43495 existing records from primary storage. [2025-09-22T22:18:52.837138] [INFO ] [MAIN ] DNOW: Loaded 43495 primary data records. [2025-09-22T22:18:52.956332] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-09-22T22:18:52.956538] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-22T22:18:52.958587] [INFO ] [MAIN ] Derivative Progress: 535/2091 symbols completed. DMO took 0.9s. Estimated remaining: 10m 6s. Rate: 154.2 symbols/min [2025-09-22T22:18:52.959462] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:53.187605] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:53.188380] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48411 primary records. [2025-09-22T22:18:53.188455] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-22T22:18:53.207176] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-09-22T22:18:53.207556] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-22T22:18:53.209742] [INFO ] [MAIN ] Derivative Progress: 536/2091 symbols completed. DNA took 1.1s. Estimated remaining: 10m 5s. Rate: 154.3 symbols/min [2025-09-22T22:18:53.210801] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:53.246831] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:53.261018] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43495 primary records. [2025-09-22T22:18:53.262225] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-22T22:18:53.264380] [DEBUG] [LOCAL ] DOCN: Loaded 50462 existing records from primary storage. [2025-09-22T22:18:53.271568] [INFO ] [MAIN ] DOCN: Loaded 50462 primary data records. [2025-09-22T22:18:53.395737] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-09-22T22:18:53.399315] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-22T22:18:53.401571] [INFO ] [MAIN ] Derivative Progress: 537/2091 symbols completed. DNOW took 1.0s. Estimated remaining: 10m 4s. Rate: 154.4 symbols/min [2025-09-22T22:18:53.415474] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:53.437998] [DEBUG] [LOCAL ] DOCS: Loaded 51285 existing records from primary storage. [2025-09-22T22:18:53.474814] [INFO ] [MAIN ] DOCS: Loaded 51285 primary data records. [2025-09-22T22:18:53.941427] [DEBUG] [LOCAL ] DOUG: Loaded 34760 existing records from primary storage. [2025-09-22T22:18:53.942066] [INFO ] [MAIN ] DOUG: Loaded 34760 primary data records. [2025-09-22T22:18:54.154990] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:54.269558] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50462 primary records. [2025-09-22T22:18:54.278287] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-22T22:18:54.315769] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:54.316527] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 51285 primary records. [2025-09-22T22:18:54.316603] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-22T22:18:54.315433] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-09-22T22:18:54.320281] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-22T22:18:54.330161] [INFO ] [MAIN ] Derivative Progress: 538/2091 symbols completed. DOCN took 1.4s. Estimated remaining: 10m 5s. Rate: 154.0 symbols/min [2025-09-22T22:18:54.338899] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-09-22T22:18:54.339220] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-22T22:18:54.341708] [INFO ] [MAIN ] Derivative Progress: 539/2091 symbols completed. DOCS took 1.1s. Estimated remaining: 10m 4s. Rate: 154.3 symbols/min [2025-09-22T22:18:54.359281] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:54.359874] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34760 primary records. [2025-09-22T22:18:54.359956] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-22T22:18:54.374959] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-09-22T22:18:54.375017] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-22T22:18:54.377712] [INFO ] [MAIN ] Derivative Progress: 540/2091 symbols completed. DOUG took 1.0s. Estimated remaining: 10m 2s. Rate: 154.6 symbols/min [2025-09-22T22:18:54.378396] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:54.378336] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:54.378612] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:54.400325] [DEBUG] [LOCAL ] DPG: Loaded 13309 existing records from primary storage. [2025-09-22T22:18:54.400632] [INFO ] [MAIN ] DPG: Loaded 13309 primary data records. [2025-09-22T22:18:54.799860] [DEBUG] [LOCAL ] DOV: Loaded 45742 existing records from primary storage. [2025-09-22T22:18:54.800192] [INFO ] [MAIN ] DOV: Loaded 45742 primary data records. [2025-09-22T22:18:54.812512] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-22T22:18:54.823164] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-09-22T22:18:55.438969] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:55.440095] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13309 primary records. [2025-09-22T22:18:55.440422] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-22T22:18:55.457409] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-09-22T22:18:55.458787] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-22T22:18:55.461220] [INFO ] [MAIN ] Derivative Progress: 541/2091 symbols completed. DPG took 1.1s. Estimated remaining: 10m 4s. Rate: 154.0 symbols/min [2025-09-22T22:18:55.461788] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:55.486004] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:55.488790] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45742 primary records. [2025-09-22T22:18:55.488972] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-22T22:18:55.502489] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:55.503899] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-09-22T22:18:55.504070] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-22T22:18:55.542524] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-09-22T22:18:55.545177] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-22T22:18:55.547911] [INFO ] [MAIN ] Derivative Progress: 542/2091 symbols completed. DOV took 1.2s. Estimated remaining: 10m 2s. Rate: 154.3 symbols/min [2025-09-22T22:18:55.548433] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:55.549213] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-09-22T22:18:55.549887] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-22T22:18:55.552992] [INFO ] [MAIN ] Derivative Progress: 543/2091 symbols completed. DOW took 1.2s. Estimated remaining: 10m 1s. Rate: 154.5 symbols/min [2025-09-22T22:18:55.567133] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:55.568983] [DEBUG] [LOCAL ] DRH: Loaded 50454 existing records from primary storage. [2025-09-22T22:18:55.569224] [INFO ] [MAIN ] DRH: Loaded 50454 primary data records. [2025-09-22T22:18:55.918324] [DEBUG] [LOCAL ] DSL: Loaded 28194 existing records from primary storage. [2025-09-22T22:18:55.918585] [INFO ] [MAIN ] DSL: Loaded 28194 primary data records. [2025-09-22T22:18:56.020960] [DEBUG] [LOCAL ] DRI: Loaded 47858 existing records from primary storage. [2025-09-22T22:18:56.033392] [INFO ] [MAIN ] DRI: Loaded 47858 primary data records. [2025-09-22T22:18:56.626473] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:56.628034] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50454 primary records. [2025-09-22T22:18:56.630286] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-22T22:18:56.650448] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-09-22T22:18:56.650878] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-22T22:18:56.653059] [INFO ] [MAIN ] Derivative Progress: 544/2091 symbols completed. DRH took 1.2s. Estimated remaining: 10m 3s. Rate: 154.0 symbols/min [2025-09-22T22:18:56.653438] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:56.670795] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:56.671529] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28194 primary records. [2025-09-22T22:18:56.671736] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-22T22:18:56.700775] [DEBUG] [LOCAL ] DSM: Loaded 15726 existing records from primary storage. [2025-09-22T22:18:56.700424] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-09-22T22:18:56.700946] [INFO ] [MAIN ] DSM: Loaded 15726 primary data records. [2025-09-22T22:18:56.701112] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-22T22:18:56.722549] [INFO ] [MAIN ] Derivative Progress: 545/2091 symbols completed. DSL took 1.2s. Estimated remaining: 10m 1s. Rate: 154.3 symbols/min [2025-09-22T22:18:56.753210] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:56.753421] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:56.754142] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47858 primary records. [2025-09-22T22:18:56.761231] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-22T22:18:56.846038] [DEBUG] [LOCAL ] DSMC: Loaded 1965 existing records from primary storage. [2025-09-22T22:18:56.857426] [INFO ] [MAIN ] DSMC: Loaded 1965 primary data records. [2025-09-22T22:18:57.153608] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-09-22T22:18:57.154492] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-22T22:18:57.157611] [INFO ] [MAIN ] Derivative Progress: 546/2091 symbols completed. DRI took 1.6s. Estimated remaining: 10m 1s. Rate: 154.2 symbols/min [2025-09-22T22:18:57.174248] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:57.380899] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:57.381983] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 15726 primary records. [2025-09-22T22:18:57.389340] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-22T22:18:57.389874] [DEBUG] [LOCAL ] DSU: Loaded 21791 existing records from primary storage. [2025-09-22T22:18:57.398971] [INFO ] [MAIN ] DSU: Loaded 21791 primary data records. [2025-09-22T22:18:57.450267] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-09-22T22:18:57.484850] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-22T22:18:57.503509] [INFO ] [MAIN ] Derivative Progress: 547/2091 symbols completed. DSM took 0.9s. Estimated remaining: 10m 1s. Rate: 154.3 symbols/min [2025-09-22T22:18:57.528101] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:57.529201] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:18:57.536045] [INFO ] [MAIN ] DSMC: Generated 1793 derivative records from 1965 primary records. [2025-09-22T22:18:57.541319] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-22T22:18:57.753803] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1793 records). [2025-09-22T22:18:57.754070] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-22T22:18:57.756513] [INFO ] [MAIN ] Derivative Progress: 548/2091 symbols completed. DSMC took 1.0s. Estimated remaining: 9m 60s. Rate: 154.4 symbols/min [2025-09-22T22:18:57.757188] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:57.772559] [DEBUG] [LOCAL ] DSX: Loaded 24550 existing records from primary storage. [2025-09-22T22:18:57.773063] [INFO ] [MAIN ] DSX: Loaded 24550 primary data records. [2025-09-22T22:18:58.147683] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:58.150073] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 21791 primary records. [2025-09-22T22:18:58.150171] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-22T22:18:58.188620] [DEBUG] [LOCAL ] DT: Loaded 52947 existing records from primary storage. [2025-09-22T22:18:58.189798] [INFO ] [MAIN ] DT: Loaded 52947 primary data records. [2025-09-22T22:18:58.305183] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-09-22T22:18:58.309595] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-22T22:18:58.312303] [INFO ] [MAIN ] Derivative Progress: 549/2091 symbols completed. DSU took 1.1s. Estimated remaining: 9m 60s. Rate: 154.2 symbols/min [2025-09-22T22:18:58.318178] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:58.533326] [DEBUG] [LOCAL ] DTB: Loaded 4724 existing records from primary storage. [2025-09-22T22:18:58.535486] [INFO ] [MAIN ] DTB: Loaded 4724 primary data records. [2025-09-22T22:18:58.610396] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:58.638960] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 24550 primary records. [2025-09-22T22:18:58.668593] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-22T22:18:58.774967] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-09-22T22:18:58.930752] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-22T22:18:58.949164] [INFO ] [MAIN ] Derivative Progress: 550/2091 symbols completed. DSX took 1.4s. Estimated remaining: 10m 0s. Rate: 154.1 symbols/min [2025-09-22T22:18:58.952014] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:58.970702] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:58.972093] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52947 primary records. [2025-09-22T22:18:58.972267] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-22T22:18:58.992082] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-09-22T22:18:58.992299] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-22T22:18:58.994484] [INFO ] [MAIN ] Derivative Progress: 551/2091 symbols completed. DT took 1.2s. Estimated remaining: 9m 59s. Rate: 154.3 symbols/min [2025-09-22T22:18:58.994890] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:59.013426] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:18:59.014264] [INFO ] [MAIN ] DTB: Generated 1794 derivative records from 4724 primary records. [2025-09-22T22:18:59.014453] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-22T22:18:59.018815] [DEBUG] [LOCAL ] DTG: Loaded 5902 existing records from primary storage. [2025-09-22T22:18:59.040666] [INFO ] [MAIN ] DTG: Loaded 5902 primary data records. [2025-09-22T22:18:59.121508] [DEBUG] [LOCAL ] DTB: Derivative data saved (1794 records). [2025-09-22T22:18:59.147068] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-22T22:18:59.155470] [INFO ] [MAIN ] Derivative Progress: 552/2091 symbols completed. DTB took 0.8s. Estimated remaining: 9m 58s. Rate: 154.5 symbols/min [2025-09-22T22:18:59.155883] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:18:59.183312] [DEBUG] [LOCAL ] DTE: Loaded 48004 existing records from primary storage. [2025-09-22T22:18:59.183633] [INFO ] [MAIN ] DTE: Loaded 48004 primary data records. [2025-09-22T22:18:59.645002] [DEBUG] [LOCAL ] DTM: Loaded 44544 existing records from primary storage. [2025-09-22T22:18:59.646498] [INFO ] [MAIN ] DTM: Loaded 44544 primary data records. [2025-09-22T22:19:00.156990] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:00.160216] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5902 primary records. [2025-09-22T22:19:00.160700] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-22T22:19:00.184352] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-09-22T22:19:00.198050] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:00.199332] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 48004 primary records. [2025-09-22T22:19:00.197297] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-22T22:19:00.201742] [INFO ] [MAIN ] Derivative Progress: 553/2091 symbols completed. DTG took 1.2s. Estimated remaining: 9m 59s. Rate: 154.0 symbols/min [2025-09-22T22:19:00.202014] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-22T22:19:00.221472] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-09-22T22:19:00.234979] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-22T22:19:00.237353] [INFO ] [MAIN ] Derivative Progress: 554/2091 symbols completed. DTE took 1.3s. Estimated remaining: 9m 58s. Rate: 154.2 symbols/min [2025-09-22T22:19:00.234900] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:00.238206] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 44544 primary records. [2025-09-22T22:19:00.238427] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-22T22:19:00.253873] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-09-22T22:19:00.253930] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-22T22:19:00.256316] [INFO ] [MAIN ] Derivative Progress: 555/2091 symbols completed. DTM took 1.1s. Estimated remaining: 9m 56s. Rate: 154.5 symbols/min [2025-09-22T22:19:00.257094] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:00.257036] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:00.256946] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:00.268366] [DEBUG] [LOCAL ] DTW: Loaded 4901 existing records from primary storage. [2025-09-22T22:19:00.268552] [INFO ] [MAIN ] DTW: Loaded 4901 primary data records. [2025-09-22T22:19:00.335884] [DEBUG] [LOCAL ] DUKB: Loaded 6388 existing records from primary storage. [2025-09-22T22:19:00.362460] [INFO ] [MAIN ] DUKB: Loaded 6388 primary data records. [2025-09-22T22:19:00.816054] [DEBUG] [LOCAL ] DV: Loaded 51276 existing records from primary storage. [2025-09-22T22:19:00.821581] [INFO ] [MAIN ] DV: Loaded 51276 primary data records. [2025-09-22T22:19:01.329073] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:01.335084] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6388 primary records. [2025-09-22T22:19:01.336024] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:01.337579] [INFO ] [MAIN ] DTW: Generated 1794 derivative records from 4901 primary records. [2025-09-22T22:19:01.335836] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-22T22:19:01.338308] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-22T22:19:01.371988] [DEBUG] [LOCAL ] DTW: Derivative data saved (1794 records). [2025-09-22T22:19:01.373400] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-22T22:19:01.375698] [INFO ] [MAIN ] Derivative Progress: 556/2091 symbols completed. DTW took 1.1s. Estimated remaining: 9m 58s. Rate: 154.0 symbols/min [2025-09-22T22:19:01.377585] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:01.381849] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-09-22T22:19:01.382121] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-22T22:19:01.384606] [INFO ] [MAIN ] Derivative Progress: 557/2091 symbols completed. DUKB took 1.1s. Estimated remaining: 9m 57s. Rate: 154.3 symbols/min [2025-09-22T22:19:01.392894] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:01.398404] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:01.399574] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51276 primary records. [2025-09-22T22:19:01.399705] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-22T22:19:01.421535] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-09-22T22:19:01.421815] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-22T22:19:01.424864] [INFO ] [MAIN ] Derivative Progress: 558/2091 symbols completed. DV took 1.2s. Estimated remaining: 9m 55s. Rate: 154.5 symbols/min [2025-09-22T22:19:01.425293] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:01.469607] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-22T22:19:01.470039] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-09-22T22:19:01.639109] [DEBUG] [LOCAL ] DX: Loaded 52475 existing records from primary storage. [2025-09-22T22:19:01.702454] [INFO ] [MAIN ] DX: Loaded 52475 primary data records. [2025-09-22T22:19:01.847273] [DEBUG] [LOCAL ] DXC: Loaded 49606 existing records from primary storage. [2025-09-22T22:19:01.865092] [INFO ] [MAIN ] DXC: Loaded 49606 primary data records. [2025-09-22T22:19:02.497597] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:02.498550] [INFO ] [MAIN ] DVN: Generated 1794 derivative records from 53699 primary records. [2025-09-22T22:19:02.498783] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-22T22:19:02.521168] [DEBUG] [LOCAL ] DVN: Derivative data saved (1794 records). [2025-09-22T22:19:02.521460] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-22T22:19:02.524202] [INFO ] [MAIN ] Derivative Progress: 559/2091 symbols completed. DVN took 1.1s. Estimated remaining: 9m 57s. Rate: 154.0 symbols/min [2025-09-22T22:19:02.536849] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:02.537509] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:02.539374] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52475 primary records. [2025-09-22T22:19:02.540397] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-22T22:19:02.567834] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:02.570485] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49606 primary records. [2025-09-22T22:19:02.571531] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-22T22:19:02.588096] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-09-22T22:19:02.589057] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-22T22:19:02.590025] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-09-22T22:19:02.592866] [INFO ] [MAIN ] Derivative Progress: 560/2091 symbols completed. DX took 1.2s. Estimated remaining: 9m 56s. Rate: 154.2 symbols/min [2025-09-22T22:19:02.590121] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-22T22:19:02.595448] [INFO ] [MAIN ] Derivative Progress: 561/2091 symbols completed. DXC took 1.2s. Estimated remaining: 9m 54s. Rate: 154.5 symbols/min [2025-09-22T22:19:02.595622] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:02.605417] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:02.624058] [DEBUG] [LOCAL ] DXYZ: Loaded 36760 existing records from primary storage. [2025-09-22T22:19:02.624306] [INFO ] [MAIN ] DXYZ: Loaded 36760 primary data records. [2025-09-22T22:19:02.827007] [DEBUG] [LOCAL ] E: Loaded 33511 existing records from primary storage. [2025-09-22T22:19:02.828388] [DEBUG] [LOCAL ] DY: Loaded 29922 existing records from primary storage. [2025-09-22T22:19:02.849118] [INFO ] [MAIN ] DY: Loaded 29922 primary data records. [2025-09-22T22:19:02.844032] [INFO ] [MAIN ] E: Loaded 33511 primary data records. [2025-09-22T22:19:03.671753] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:03.674487] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 36760 primary records. [2025-09-22T22:19:03.675594] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-22T22:19:03.713254] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-09-22T22:19:03.726912] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-22T22:19:03.734275] [INFO ] [MAIN ] Derivative Progress: 562/2091 symbols completed. DXYZ took 1.2s. Estimated remaining: 9m 56s. Rate: 154.0 symbols/min [2025-09-22T22:19:03.731979] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:03.734954] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:03.735490] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:03.737291] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33511 primary records. [2025-09-22T22:19:03.736354] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 29922 primary records. [2025-09-22T22:19:03.737850] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-22T22:19:03.737940] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-22T22:19:03.768420] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-09-22T22:19:03.770846] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-09-22T22:19:03.771071] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-22T22:19:03.773412] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-22T22:19:03.773306] [INFO ] [MAIN ] Derivative Progress: 563/2091 symbols completed. E took 1.2s. Estimated remaining: 9m 54s. Rate: 154.2 symbols/min [2025-09-22T22:19:03.776384] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:03.776263] [INFO ] [MAIN ] Derivative Progress: 564/2091 symbols completed. DY took 1.2s. Estimated remaining: 9m 53s. Rate: 154.5 symbols/min [2025-09-22T22:19:03.777327] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:03.784451] [DEBUG] [LOCAL ] EAI: Loaded 3977 existing records from primary storage. [2025-09-22T22:19:03.794900] [INFO ] [MAIN ] EAI: Loaded 3977 primary data records. [2025-09-22T22:19:03.930800] [DEBUG] [LOCAL ] EAF: Loaded 43968 existing records from primary storage. [2025-09-22T22:19:03.968639] [INFO ] [MAIN ] EAF: Loaded 43968 primary data records. [2025-09-22T22:19:04.003291] [DEBUG] [LOCAL ] EARN: Loaded 30462 existing records from primary storage. [2025-09-22T22:19:04.008631] [INFO ] [MAIN ] EARN: Loaded 30462 primary data records. [2025-09-22T22:19:04.813184] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:04.814876] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 3977 primary records. [2025-09-22T22:19:04.815005] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-22T22:19:04.831707] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-09-22T22:19:04.833169] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-22T22:19:04.835325] [INFO ] [MAIN ] Derivative Progress: 565/2091 symbols completed. EAI took 1.1s. Estimated remaining: 9m 54s. Rate: 154.0 symbols/min [2025-09-22T22:19:04.837742] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:04.852055] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:04.853383] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 43968 primary records. [2025-09-22T22:19:04.853690] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-22T22:19:04.873019] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-09-22T22:19:04.873113] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-22T22:19:04.875395] [INFO ] [MAIN ] Derivative Progress: 566/2091 symbols completed. EAF took 1.1s. Estimated remaining: 9m 53s. Rate: 154.3 symbols/min [2025-09-22T22:19:04.883604] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:04.892982] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:04.894041] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 30462 primary records. [2025-09-22T22:19:04.894126] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-22T22:19:04.923876] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-09-22T22:19:04.924077] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-22T22:19:04.926456] [INFO ] [MAIN ] Derivative Progress: 567/2091 symbols completed. EARN took 1.1s. Estimated remaining: 9m 52s. Rate: 154.5 symbols/min [2025-09-22T22:19:04.927439] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:04.946091] [DEBUG] [LOCAL ] EBF: Loaded 19545 existing records from primary storage. [2025-09-22T22:19:04.947751] [DEBUG] [LOCAL ] EB: Loaded 37957 existing records from primary storage. [2025-09-22T22:19:04.948144] [INFO ] [MAIN ] EB: Loaded 37957 primary data records. [2025-09-22T22:19:04.948074] [INFO ] [MAIN ] EBF: Loaded 19545 primary data records. [2025-09-22T22:19:05.526405] [DEBUG] [LOCAL ] EC: Loaded 49397 existing records from primary storage. [2025-09-22T22:19:05.637447] [INFO ] [MAIN ] EC: Loaded 49397 primary data records. [2025-09-22T22:19:05.998332] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:06.011704] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 37957 primary records. [2025-09-22T22:19:06.012200] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-22T22:19:06.013936] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:06.021883] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19545 primary records. [2025-09-22T22:19:06.026517] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-22T22:19:06.031803] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-09-22T22:19:06.032639] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-22T22:19:06.041997] [INFO ] [MAIN ] Derivative Progress: 568/2091 symbols completed. EB took 1.2s. Estimated remaining: 9m 53s. Rate: 154.0 symbols/min [2025-09-22T22:19:06.052282] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-09-22T22:19:06.052597] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-22T22:19:06.054943] [INFO ] [MAIN ] Derivative Progress: 569/2091 symbols completed. EBF took 1.2s. Estimated remaining: 9m 52s. Rate: 154.3 symbols/min [2025-09-22T22:19:06.070522] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:06.071286] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49397 primary records. [2025-09-22T22:19:06.071351] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-22T22:19:06.086956] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-09-22T22:19:06.087052] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-22T22:19:06.090183] [INFO ] [MAIN ] Derivative Progress: 570/2091 symbols completed. EC took 1.2s. Estimated remaining: 9m 51s. Rate: 154.5 symbols/min [2025-09-22T22:19:06.090892] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:06.090738] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:06.091448] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:06.155092] [DEBUG] [LOCAL ] ECAT: Loaded 29793 existing records from primary storage. [2025-09-22T22:19:06.156845] [INFO ] [MAIN ] ECAT: Loaded 29793 primary data records. [2025-09-22T22:19:06.156626] [DEBUG] [LOCAL ] ECG: Loaded 34377 existing records from primary storage. [2025-09-22T22:19:06.163410] [INFO ] [MAIN ] ECG: Loaded 34377 primary data records. [2025-09-22T22:19:06.368094] [DEBUG] [LOCAL ] ECL: Loaded 46762 existing records from primary storage. [2025-09-22T22:19:06.385484] [INFO ] [MAIN ] ECL: Loaded 46762 primary data records. [2025-09-22T22:19:07.221635] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:07.233143] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29793 primary records. [2025-09-22T22:19:07.238688] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:07.239504] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 34377 primary records. [2025-09-22T22:19:07.238803] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-22T22:19:07.240931] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-22T22:19:07.276422] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-09-22T22:19:07.277925] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-09-22T22:19:07.278831] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-22T22:19:07.278030] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-22T22:19:07.281388] [INFO ] [MAIN ] Derivative Progress: 571/2091 symbols completed. ECG took 1.2s. Estimated remaining: 9m 52s. Rate: 153.9 symbols/min [2025-09-22T22:19:07.284438] [INFO ] [MAIN ] Derivative Progress: 572/2091 symbols completed. ECAT took 1.2s. Estimated remaining: 9m 51s. Rate: 154.2 symbols/min [2025-09-22T22:19:07.292699] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:07.292940] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:07.298866] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:07.301146] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46762 primary records. [2025-09-22T22:19:07.301534] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-22T22:19:07.327095] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-09-22T22:19:07.327321] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-22T22:19:07.329570] [INFO ] [MAIN ] Derivative Progress: 573/2091 symbols completed. ECL took 1.2s. Estimated remaining: 9m 50s. Rate: 154.5 symbols/min [2025-09-22T22:19:07.329926] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:07.337738] [DEBUG] [LOCAL ] ECO: Loaded 18495 existing records from primary storage. [2025-09-22T22:19:07.337891] [INFO ] [MAIN ] ECO: Loaded 18495 primary data records. [2025-09-22T22:19:07.482265] [DEBUG] [LOCAL ] ECVT: Loaded 43080 existing records from primary storage. [2025-09-22T22:19:07.492841] [INFO ] [MAIN ] ECVT: Loaded 43080 primary data records. [2025-09-22T22:19:08.087324] [DEBUG] [LOCAL ] ED: Loaded 52808 existing records from primary storage. [2025-09-22T22:19:08.098617] [INFO ] [MAIN ] ED: Loaded 52808 primary data records. [2025-09-22T22:19:08.358358] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:08.495807] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18495 primary records. [2025-09-22T22:19:08.509337] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-22T22:19:08.541486] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-09-22T22:19:08.548818] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-22T22:19:08.565381] [INFO ] [MAIN ] Derivative Progress: 574/2091 symbols completed. ECO took 1.3s. Estimated remaining: 9m 52s. Rate: 153.9 symbols/min [2025-09-22T22:19:08.568323] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:08.568966] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:08.569819] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43080 primary records. [2025-09-22T22:19:08.570118] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-22T22:19:08.591711] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-09-22T22:19:08.591957] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-22T22:19:08.594877] [INFO ] [MAIN ] Derivative Progress: 575/2091 symbols completed. ECVT took 1.3s. Estimated remaining: 9m 50s. Rate: 154.1 symbols/min [2025-09-22T22:19:08.596052] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:08.627337] [DEBUG] [LOCAL ] EDN: Loaded 18016 existing records from primary storage. [2025-09-22T22:19:08.641360] [INFO ] [MAIN ] EDN: Loaded 18016 primary data records. [2025-09-22T22:19:08.642084] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:08.670515] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52808 primary records. [2025-09-22T22:19:08.703474] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-22T22:19:08.860715] [DEBUG] [LOCAL ] EDU: Loaded 45124 existing records from primary storage. [2025-09-22T22:19:08.921081] [INFO ] [MAIN ] EDU: Loaded 45124 primary data records. [2025-09-22T22:19:09.093369] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-09-22T22:19:09.112188] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-22T22:19:09.142879] [INFO ] [MAIN ] Derivative Progress: 576/2091 symbols completed. ED took 1.8s. Estimated remaining: 9m 50s. Rate: 154.0 symbols/min [2025-09-22T22:19:09.180985] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:09.502580] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:09.503818] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18016 primary records. [2025-09-22T22:19:09.504922] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-22T22:19:09.517061] [DEBUG] [LOCAL ] EE: Loaded 32535 existing records from primary storage. [2025-09-22T22:19:09.524281] [INFO ] [MAIN ] EE: Loaded 32535 primary data records. [2025-09-22T22:19:09.603770] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-09-22T22:19:09.616722] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-22T22:19:09.623956] [INFO ] [MAIN ] Derivative Progress: 577/2091 symbols completed. EDN took 1.1s. Estimated remaining: 9m 50s. Rate: 153.9 symbols/min [2025-09-22T22:19:09.639726] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:09.730257] [DEBUG] [LOCAL ] EEA: Loaded 2752 existing records from primary storage. [2025-09-22T22:19:09.836965] [INFO ] [MAIN ] EEA: Loaded 2752 primary data records. [2025-09-22T22:19:09.954105] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:09.960757] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 45124 primary records. [2025-09-22T22:19:09.973541] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-22T22:19:10.028869] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-09-22T22:19:10.061549] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-22T22:19:10.089706] [INFO ] [MAIN ] Derivative Progress: 578/2091 symbols completed. EDU took 1.5s. Estimated remaining: 9m 50s. Rate: 153.9 symbols/min [2025-09-22T22:19:10.205270] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:10.237397] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:10.238753] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32535 primary records. [2025-09-22T22:19:10.240312] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-22T22:19:10.258509] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-09-22T22:19:10.258983] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-22T22:19:10.261153] [INFO ] [MAIN ] Derivative Progress: 579/2091 symbols completed. EE took 1.1s. Estimated remaining: 9m 49s. Rate: 154.0 symbols/min [2025-09-22T22:19:10.261906] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:10.292301] [DEBUG] [MAIN ] EEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:10.293128] [INFO ] [MAIN ] EEA: Generated 1794 derivative records from 2752 primary records. [2025-09-22T22:19:10.293202] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-22T22:19:10.315198] [DEBUG] [LOCAL ] EFC: Loaded 46187 existing records from primary storage. [2025-09-22T22:19:10.328555] [INFO ] [MAIN ] EFC: Loaded 46187 primary data records. [2025-09-22T22:19:10.340173] [DEBUG] [LOCAL ] EFR: Loaded 14225 existing records from primary storage. [2025-09-22T22:19:10.341605] [DEBUG] [LOCAL ] EEA: Derivative data saved (1794 records). [2025-09-22T22:19:10.373743] [INFO ] [MAIN ] EFR: Loaded 14225 primary data records. [2025-09-22T22:19:10.380586] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-22T22:19:10.448572] [INFO ] [MAIN ] Derivative Progress: 580/2091 symbols completed. EEA took 0.8s. Estimated remaining: 9m 48s. Rate: 154.2 symbols/min [2025-09-22T22:19:10.503493] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:10.993064] [DEBUG] [LOCAL ] EFX: Loaded 44961 existing records from primary storage. [2025-09-22T22:19:10.993736] [INFO ] [MAIN ] EFX: Loaded 44961 primary data records. [2025-09-22T22:19:11.136800] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:11.143678] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 14225 primary records. [2025-09-22T22:19:11.143929] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-22T22:19:11.245113] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-09-22T22:19:11.365762] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-22T22:19:11.390951] [INFO ] [MAIN ] Derivative Progress: 581/2091 symbols completed. EFR took 1.1s. Estimated remaining: 9m 49s. Rate: 153.8 symbols/min [2025-09-22T22:19:11.391402] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:11.391782] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:11.393408] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46187 primary records. [2025-09-22T22:19:11.393721] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-22T22:19:11.415123] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-09-22T22:19:11.415377] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-22T22:19:11.418292] [INFO ] [MAIN ] Derivative Progress: 582/2091 symbols completed. EFC took 1.2s. Estimated remaining: 9m 48s. Rate: 154.0 symbols/min [2025-09-22T22:19:11.420015] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:11.460396] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:11.461026] [DEBUG] [LOCAL ] EFXT: Loaded 29392 existing records from primary storage. [2025-09-22T22:19:11.462180] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44961 primary records. [2025-09-22T22:19:11.462373] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-22T22:19:11.462844] [INFO ] [MAIN ] EFXT: Loaded 29392 primary data records. [2025-09-22T22:19:11.619049] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-09-22T22:19:11.624032] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-22T22:19:11.632532] [INFO ] [MAIN ] Derivative Progress: 583/2091 symbols completed. EFX took 1.1s. Estimated remaining: 9m 47s. Rate: 154.2 symbols/min [2025-09-22T22:19:11.709511] [DEBUG] [LOCAL ] EGO: Loaded 51470 existing records from primary storage. [2025-09-22T22:19:11.754536] [INFO ] [MAIN ] EGO: Loaded 51470 primary data records. [2025-09-22T22:19:12.213185] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:12.214134] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29392 primary records. [2025-09-22T22:19:12.214411] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-22T22:19:12.230617] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-09-22T22:19:12.231044] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-22T22:19:12.232987] [INFO ] [MAIN ] Derivative Progress: 584/2091 symbols completed. EFXT took 0.8s. Estimated remaining: 9m 47s. Rate: 154.0 symbols/min [2025-09-22T22:19:12.249471] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:12.250222] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51470 primary records. [2025-09-22T22:19:12.250285] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-22T22:19:12.267544] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-09-22T22:19:12.267631] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-22T22:19:12.270312] [INFO ] [MAIN ] Derivative Progress: 585/2091 symbols completed. EGO took 0.9s. Estimated remaining: 9m 46s. Rate: 154.3 symbols/min [2025-09-22T22:19:12.270961] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:12.271163] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:12.271322] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:12.318258] [DEBUG] [LOCAL ] EHAB: Loaded 30099 existing records from primary storage. [2025-09-22T22:19:12.318401] [INFO ] [MAIN ] EHAB: Loaded 30099 primary data records. [2025-09-22T22:19:12.446889] [DEBUG] [LOCAL ] EGP: Loaded 31337 existing records from primary storage. [2025-09-22T22:19:12.447088] [INFO ] [MAIN ] EGP: Loaded 31337 primary data records. [2025-09-22T22:19:12.446299] [DEBUG] [LOCAL ] EGY: Loaded 42312 existing records from primary storage. [2025-09-22T22:19:12.459446] [INFO ] [MAIN ] EGY: Loaded 42312 primary data records. [2025-09-22T22:19:13.290636] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:13.291711] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 30099 primary records. [2025-09-22T22:19:13.291963] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-22T22:19:13.308845] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-09-22T22:19:13.309072] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-22T22:19:13.311456] [INFO ] [MAIN ] Derivative Progress: 586/2091 symbols completed. EHAB took 1.0s. Estimated remaining: 9m 47s. Rate: 153.8 symbols/min [2025-09-22T22:19:13.311940] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:13.338508] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:13.343871] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 31337 primary records. [2025-09-22T22:19:13.344050] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-22T22:19:13.345255] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:13.345948] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 42312 primary records. [2025-09-22T22:19:13.346110] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-22T22:19:13.375091] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-09-22T22:19:13.377222] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-22T22:19:13.380203] [INFO ] [MAIN ] Derivative Progress: 587/2091 symbols completed. EGP took 1.1s. Estimated remaining: 9m 46s. Rate: 154.0 symbols/min [2025-09-22T22:19:13.381136] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-09-22T22:19:13.381403] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-22T22:19:13.384005] [INFO ] [MAIN ] Derivative Progress: 588/2091 symbols completed. EGY took 1.1s. Estimated remaining: 9m 44s. Rate: 154.3 symbols/min [2025-09-22T22:19:13.381211] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:13.393454] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:13.405886] [DEBUG] [LOCAL ] EHI: Loaded 10286 existing records from primary storage. [2025-09-22T22:19:13.406035] [INFO ] [MAIN ] EHI: Loaded 10286 primary data records. [2025-09-22T22:19:13.540550] [DEBUG] [LOCAL ] EIC: Loaded 24344 existing records from primary storage. [2025-09-22T22:19:13.540144] [DEBUG] [LOCAL ] EHC: Loaded 41502 existing records from primary storage. [2025-09-22T22:19:13.556762] [INFO ] [MAIN ] EHC: Loaded 41502 primary data records. [2025-09-22T22:19:13.556913] [INFO ] [MAIN ] EIC: Loaded 24344 primary data records. [2025-09-22T22:19:14.436544] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:14.437007] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:14.438421] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10286 primary records. [2025-09-22T22:19:14.439679] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-22T22:19:14.439477] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41502 primary records. [2025-09-22T22:19:14.440990] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-22T22:19:14.467603] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-09-22T22:19:14.472007] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-22T22:19:14.474602] [INFO ] [MAIN ] Derivative Progress: 589/2091 symbols completed. EHI took 1.1s. Estimated remaining: 9m 46s. Rate: 153.8 symbols/min [2025-09-22T22:19:14.493366] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-09-22T22:19:14.492846] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:14.493675] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-22T22:19:14.496670] [INFO ] [MAIN ] Derivative Progress: 590/2091 symbols completed. EHC took 1.2s. Estimated remaining: 9m 45s. Rate: 154.1 symbols/min [2025-09-22T22:19:14.497792] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:14.497239] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:14.498690] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 24344 primary records. [2025-09-22T22:19:14.498909] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-22T22:19:14.527370] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-09-22T22:19:14.527602] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-22T22:19:14.530572] [INFO ] [MAIN ] Derivative Progress: 591/2091 symbols completed. EIC took 1.1s. Estimated remaining: 9m 43s. Rate: 154.3 symbols/min [2025-09-22T22:19:14.531191] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:14.541534] [DEBUG] [LOCAL ] EIG: Loaded 20316 existing records from primary storage. [2025-09-22T22:19:14.541753] [INFO ] [MAIN ] EIG: Loaded 20316 primary data records. [2025-09-22T22:19:14.889027] [DEBUG] [LOCAL ] EIX: Loaded 53346 existing records from primary storage. [2025-09-22T22:19:14.889812] [INFO ] [MAIN ] EIX: Loaded 53346 primary data records. [2025-09-22T22:19:15.031788] [DEBUG] [LOCAL ] EL: Loaded 53412 existing records from primary storage. [2025-09-22T22:19:15.042749] [INFO ] [MAIN ] EL: Loaded 53412 primary data records. [2025-09-22T22:19:15.628750] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:15.631184] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20316 primary records. [2025-09-22T22:19:15.631377] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-22T22:19:15.652148] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-09-22T22:19:15.652337] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-22T22:19:15.654918] [INFO ] [MAIN ] Derivative Progress: 592/2091 symbols completed. EIG took 1.2s. Estimated remaining: 9m 45s. Rate: 153.8 symbols/min [2025-09-22T22:19:15.655280] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:15.675172] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:15.675997] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53346 primary records. [2025-09-22T22:19:15.676228] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-22T22:19:15.710910] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-09-22T22:19:15.711360] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-22T22:19:15.711281] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:15.714337] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53412 primary records. [2025-09-22T22:19:15.713521] [INFO ] [MAIN ] Derivative Progress: 593/2091 symbols completed. EIX took 1.2s. Estimated remaining: 9m 43s. Rate: 154.0 symbols/min [2025-09-22T22:19:15.714765] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:15.714937] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-22T22:19:15.747203] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-09-22T22:19:15.750093] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-22T22:19:15.753176] [INFO ] [MAIN ] Derivative Progress: 594/2091 symbols completed. EL took 1.2s. Estimated remaining: 9m 42s. Rate: 154.3 symbols/min [2025-09-22T22:19:15.750424] [DEBUG] [LOCAL ] ELC: Loaded 3492 existing records from primary storage. [2025-09-22T22:19:15.754221] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:15.754419] [INFO ] [MAIN ] ELC: Loaded 3492 primary data records. [2025-09-22T22:19:15.856717] [DEBUG] [LOCAL ] ELAN: Loaded 53187 existing records from primary storage. [2025-09-22T22:19:15.878381] [INFO ] [MAIN ] ELAN: Loaded 53187 primary data records. [2025-09-22T22:19:16.433868] [DEBUG] [LOCAL ] ELF: Loaded 52315 existing records from primary storage. [2025-09-22T22:19:16.434676] [INFO ] [MAIN ] ELF: Loaded 52315 primary data records. [2025-09-22T22:19:16.794203] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:16.795552] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3492 primary records. [2025-09-22T22:19:16.796026] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-22T22:19:16.832635] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-09-22T22:19:16.833307] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:16.834211] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53187 primary records. [2025-09-22T22:19:16.834301] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-22T22:19:16.834407] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-22T22:19:16.837508] [INFO ] [MAIN ] Derivative Progress: 595/2091 symbols completed. ELC took 1.1s. Estimated remaining: 9m 44s. Rate: 153.8 symbols/min [2025-09-22T22:19:16.851740] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:16.856801] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-09-22T22:19:16.857090] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-22T22:19:16.860440] [INFO ] [MAIN ] Derivative Progress: 596/2091 symbols completed. ELAN took 1.2s. Estimated remaining: 9m 42s. Rate: 154.1 symbols/min [2025-09-22T22:19:16.861249] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:16.883165] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:16.884124] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52315 primary records. [2025-09-22T22:19:16.889463] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-22T22:19:16.927778] [DEBUG] [LOCAL ] EMD: Loaded 21191 existing records from primary storage. [2025-09-22T22:19:16.928806] [INFO ] [MAIN ] EMD: Loaded 21191 primary data records. [2025-09-22T22:19:16.928703] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-09-22T22:19:16.929126] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-22T22:19:16.951192] [INFO ] [MAIN ] Derivative Progress: 597/2091 symbols completed. ELF took 1.2s. Estimated remaining: 9m 41s. Rate: 154.3 symbols/min [2025-09-22T22:19:16.969045] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:17.027867] [DEBUG] [LOCAL ] ELME: Loaded 39258 existing records from primary storage. [2025-09-22T22:19:17.053608] [INFO ] [MAIN ] ELME: Loaded 39258 primary data records. [2025-09-22T22:19:17.583693] [DEBUG] [LOCAL ] EME: Loaded 31792 existing records from primary storage. [2025-09-22T22:19:17.584812] [INFO ] [MAIN ] EME: Loaded 31792 primary data records. [2025-09-22T22:19:17.982463] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:17.996337] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 21191 primary records. [2025-09-22T22:19:17.997417] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:17.999128] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39258 primary records. [2025-09-22T22:19:17.999589] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-22T22:19:17.999638] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-22T22:19:18.034232] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-09-22T22:19:18.034371] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-22T22:19:18.036929] [INFO ] [MAIN ] Derivative Progress: 598/2091 symbols completed. EMD took 1.2s. Estimated remaining: 9m 42s. Rate: 153.8 symbols/min [2025-09-22T22:19:18.032767] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-09-22T22:19:18.037510] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-22T22:19:18.040461] [INFO ] [MAIN ] Derivative Progress: 599/2091 symbols completed. ELME took 1.2s. Estimated remaining: 9m 41s. Rate: 154.0 symbols/min [2025-09-22T22:19:18.056007] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:18.056694] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 31792 primary records. [2025-09-22T22:19:18.056763] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-22T22:19:18.073089] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-09-22T22:19:18.073240] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-22T22:19:18.075552] [INFO ] [MAIN ] Derivative Progress: 600/2091 symbols completed. EME took 1.1s. Estimated remaining: 9m 40s. Rate: 154.3 symbols/min [2025-09-22T22:19:18.076484] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:18.076363] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:18.076312] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:18.083491] [DEBUG] [LOCAL ] EMF: Loaded 3627 existing records from primary storage. [2025-09-22T22:19:18.083837] [INFO ] [MAIN ] EMF: Loaded 3627 primary data records. [2025-09-22T22:19:18.197562] [DEBUG] [LOCAL ] EMO: Loaded 12340 existing records from primary storage. [2025-09-22T22:19:18.201009] [INFO ] [MAIN ] EMO: Loaded 12340 primary data records. [2025-09-22T22:19:18.610561] [DEBUG] [LOCAL ] EMN: Loaded 50340 existing records from primary storage. [2025-09-22T22:19:18.718261] [INFO ] [MAIN ] EMN: Loaded 50340 primary data records. [2025-09-22T22:19:19.061153] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:19.062444] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3627 primary records. [2025-09-22T22:19:19.062899] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-22T22:19:19.081054] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-09-22T22:19:19.081334] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-22T22:19:19.084109] [INFO ] [MAIN ] Derivative Progress: 601/2091 symbols completed. EMF took 1.0s. Estimated remaining: 9m 41s. Rate: 153.9 symbols/min [2025-09-22T22:19:19.084770] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:19.103991] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:19.106710] [DEBUG] [LOCAL ] EMP: Loaded 3032 existing records from primary storage. [2025-09-22T22:19:19.108058] [INFO ] [MAIN ] EMP: Loaded 3032 primary data records. [2025-09-22T22:19:19.107790] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 12340 primary records. [2025-09-22T22:19:19.120000] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-22T22:19:19.241877] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-09-22T22:19:19.279196] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-22T22:19:19.291069] [INFO ] [MAIN ] Derivative Progress: 602/2091 symbols completed. EMO took 1.2s. Estimated remaining: 9m 40s. Rate: 154.0 symbols/min [2025-09-22T22:19:19.301263] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:19.449253] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:19.464777] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50340 primary records. [2025-09-22T22:19:19.465161] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-22T22:19:19.483695] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-09-22T22:19:19.484230] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-22T22:19:19.487445] [INFO ] [MAIN ] Derivative Progress: 603/2091 symbols completed. EMN took 1.4s. Estimated remaining: 9m 39s. Rate: 154.1 symbols/min [2025-09-22T22:19:19.488500] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:19.528950] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:19.529744] [INFO ] [MAIN ] EMP: Generated 1794 derivative records from 3032 primary records. [2025-09-22T22:19:19.529832] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-22T22:19:19.561121] [DEBUG] [LOCAL ] EMP: Derivative data saved (1794 records). [2025-09-22T22:19:19.562279] [DEBUG] [LOCAL ] EMR: Loaded 53258 existing records from primary storage. [2025-09-22T22:19:19.562387] [INFO ] [MAIN ] EMR: Loaded 53258 primary data records. [2025-09-22T22:19:19.561266] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-22T22:19:19.564477] [INFO ] [MAIN ] Derivative Progress: 604/2091 symbols completed. EMP took 0.5s. Estimated remaining: 9m 38s. Rate: 154.3 symbols/min [2025-09-22T22:19:19.586320] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:19.706884] [DEBUG] [LOCAL ] ENFY: Loaded 3051 existing records from primary storage. [2025-09-22T22:19:19.718720] [INFO ] [MAIN ] ENFY: Loaded 3051 primary data records. [2025-09-22T22:19:19.749453] [DEBUG] [LOCAL ] ENB: Loaded 53518 existing records from primary storage. [2025-09-22T22:19:19.820211] [INFO ] [MAIN ] ENB: Loaded 53518 primary data records. [2025-09-22T22:19:20.587999] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:20.589467] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53258 primary records. [2025-09-22T22:19:20.590107] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-22T22:19:20.615447] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-09-22T22:19:20.617232] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-22T22:19:20.620567] [INFO ] [MAIN ] Derivative Progress: 605/2091 symbols completed. EMR took 1.3s. Estimated remaining: 9m 39s. Rate: 153.9 symbols/min [2025-09-22T22:19:20.622359] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:20.637203] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:20.638510] [INFO ] [MAIN ] ENFY: Generated 1794 derivative records from 3051 primary records. [2025-09-22T22:19:20.638616] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-22T22:19:20.657766] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1794 records). [2025-09-22T22:19:20.670558] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-22T22:19:20.673533] [INFO ] [MAIN ] Derivative Progress: 606/2091 symbols completed. ENFY took 1.1s. Estimated remaining: 9m 38s. Rate: 154.1 symbols/min [2025-09-22T22:19:20.683768] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:20.683972] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:20.685058] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53518 primary records. [2025-09-22T22:19:20.685320] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-22T22:19:20.699745] [DEBUG] [LOCAL ] ENO: Loaded 1966 existing records from primary storage. [2025-09-22T22:19:20.713364] [INFO ] [MAIN ] ENO: Loaded 1966 primary data records. [2025-09-22T22:19:20.734351] [DEBUG] [LOCAL ] ENIC: Loaded 36699 existing records from primary storage. [2025-09-22T22:19:20.747822] [INFO ] [MAIN ] ENIC: Loaded 36699 primary data records. [2025-09-22T22:19:20.941878] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-09-22T22:19:20.987628] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-22T22:19:20.990712] [INFO ] [MAIN ] Derivative Progress: 607/2091 symbols completed. ENB took 1.5s. Estimated remaining: 9m 38s. Rate: 154.2 symbols/min [2025-09-22T22:19:21.007774] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:21.447432] [DEBUG] [LOCAL ] ENOV: Loaded 45225 existing records from primary storage. [2025-09-22T22:19:21.448340] [INFO ] [MAIN ] ENOV: Loaded 45225 primary data records. [2025-09-22T22:19:21.577672] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:21.593905] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36699 primary records. [2025-09-22T22:19:21.594051] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-22T22:19:21.604844] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:19:21.632545] [INFO ] [MAIN ] ENO: Generated 1793 derivative records from 1966 primary records. [2025-09-22T22:19:21.632695] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-22T22:19:21.868456] [DEBUG] [LOCAL ] ENO: Derivative data saved (1793 records). [2025-09-22T22:19:21.869243] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-22T22:19:21.872003] [INFO ] [MAIN ] Derivative Progress: 608/2091 symbols completed. ENO took 1.2s. Estimated remaining: 9m 38s. Rate: 153.8 symbols/min [2025-09-22T22:19:21.872885] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:21.878376] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-09-22T22:19:21.878488] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-22T22:19:21.880525] [INFO ] [MAIN ] Derivative Progress: 609/2091 symbols completed. ENIC took 1.3s. Estimated remaining: 9m 37s. Rate: 154.1 symbols/min [2025-09-22T22:19:21.881004] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:21.902018] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:21.902638] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 45225 primary records. [2025-09-22T22:19:21.902781] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-22T22:19:21.936928] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-09-22T22:19:21.944757] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-22T22:19:21.947038] [INFO ] [MAIN ] Derivative Progress: 610/2091 symbols completed. ENOV took 1.0s. Estimated remaining: 9m 36s. Rate: 154.3 symbols/min [2025-09-22T22:19:21.960178] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:21.960978] [DEBUG] [LOCAL ] ENS: Loaded 29351 existing records from primary storage. [2025-09-22T22:19:21.961938] [DEBUG] [LOCAL ] ENR: Loaded 42631 existing records from primary storage. [2025-09-22T22:19:21.962151] [INFO ] [MAIN ] ENR: Loaded 42631 primary data records. [2025-09-22T22:19:21.962228] [INFO ] [MAIN ] ENS: Loaded 29351 primary data records. [2025-09-22T22:19:22.140614] [DEBUG] [LOCAL ] EOD: Loaded 14053 existing records from primary storage. [2025-09-22T22:19:22.153713] [INFO ] [MAIN ] EOD: Loaded 14053 primary data records. [2025-09-22T22:19:22.963417] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:22.963949] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:22.964712] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29351 primary records. [2025-09-22T22:19:22.964952] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-22T22:19:22.965536] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 42631 primary records. [2025-09-22T22:19:22.966523] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-09-22T22:19:23.010579] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:23.012108] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14053 primary records. [2025-09-22T22:19:23.012462] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-22T22:19:23.015803] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-09-22T22:19:23.016153] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-22T22:19:23.025497] [INFO ] [MAIN ] Derivative Progress: 611/2091 symbols completed. ENR took 1.2s. Estimated remaining: 9m 37s. Rate: 153.8 symbols/min [2025-09-22T22:19:23.026197] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-09-22T22:19:23.030828] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-22T22:19:23.033715] [INFO ] [MAIN ] Derivative Progress: 612/2091 symbols completed. ENS took 1.2s. Estimated remaining: 9m 36s. Rate: 154.1 symbols/min [2025-09-22T22:19:23.026418] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:23.034685] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:23.038267] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-09-22T22:19:23.038397] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-22T22:19:23.041131] [INFO ] [MAIN ] Derivative Progress: 613/2091 symbols completed. EOD took 1.1s. Estimated remaining: 9m 35s. Rate: 154.3 symbols/min [2025-09-22T22:19:23.050661] [DEBUG] [LOCAL ] EOI: Loaded 10586 existing records from primary storage. [2025-09-22T22:19:23.050835] [INFO ] [MAIN ] EOI: Loaded 10586 primary data records. [2025-09-22T22:19:23.411640] [DEBUG] [LOCAL ] EOG: Loaded 53341 existing records from primary storage. [2025-09-22T22:19:23.412332] [INFO ] [MAIN ] EOG: Loaded 53341 primary data records. [2025-09-22T22:19:23.754768] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:23.756388] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10586 primary records. [2025-09-22T22:19:23.756680] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-22T22:19:23.774683] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-09-22T22:19:23.774830] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-22T22:19:23.777175] [INFO ] [MAIN ] Derivative Progress: 614/2091 symbols completed. EOI took 0.7s. Estimated remaining: 9m 35s. Rate: 154.1 symbols/min [2025-09-22T22:19:23.793792] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:23.794373] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53341 primary records. [2025-09-22T22:19:23.794447] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-22T22:19:23.811013] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-09-22T22:19:23.811087] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-22T22:19:23.813597] [INFO ] [MAIN ] Derivative Progress: 615/2091 symbols completed. EOG took 0.8s. Estimated remaining: 9m 34s. Rate: 154.3 symbols/min [2025-09-22T22:19:23.814415] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:23.814678] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:23.814854] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:23.825925] [DEBUG] [LOCAL ] EOT: Loaded 6845 existing records from primary storage. [2025-09-22T22:19:23.826119] [INFO ] [MAIN ] EOT: Loaded 6845 primary data records. [2025-09-22T22:19:23.926301] [DEBUG] [LOCAL ] EOS: Loaded 15475 existing records from primary storage. [2025-09-22T22:19:23.954706] [INFO ] [MAIN ] EOS: Loaded 15475 primary data records. [2025-09-22T22:19:24.059629] [DEBUG] [LOCAL ] EPAC: Loaded 27030 existing records from primary storage. [2025-09-22T22:19:24.100514] [INFO ] [MAIN ] EPAC: Loaded 27030 primary data records. [2025-09-22T22:19:24.905913] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:24.919961] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6845 primary records. [2025-09-22T22:19:24.920155] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-22T22:19:24.921734] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:24.922776] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15475 primary records. [2025-09-22T22:19:24.935872] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-22T22:19:24.941078] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-09-22T22:19:24.941551] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-22T22:19:24.943808] [INFO ] [MAIN ] Derivative Progress: 616/2091 symbols completed. EOT took 1.1s. Estimated remaining: 9m 35s. Rate: 153.9 symbols/min [2025-09-22T22:19:24.975035] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:24.974701] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:24.975742] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-09-22T22:19:24.976149] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-22T22:19:24.977017] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 27030 primary records. [2025-09-22T22:19:24.979979] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-22T22:19:24.979879] [INFO ] [MAIN ] Derivative Progress: 617/2091 symbols completed. EOS took 1.2s. Estimated remaining: 9m 34s. Rate: 154.1 symbols/min [2025-09-22T22:19:24.981405] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:25.002155] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-09-22T22:19:25.002498] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-22T22:19:25.006001] [INFO ] [MAIN ] Derivative Progress: 618/2091 symbols completed. EPAC took 1.2s. Estimated remaining: 9m 33s. Rate: 154.3 symbols/min [2025-09-22T22:19:25.006432] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:25.049441] [DEBUG] [LOCAL ] EPAM: Loaded 39649 existing records from primary storage. [2025-09-22T22:19:25.050096] [INFO ] [MAIN ] EPAM: Loaded 39649 primary data records. [2025-09-22T22:19:25.160447] [DEBUG] [LOCAL ] EPC: Loaded 39905 existing records from primary storage. [2025-09-22T22:19:25.180492] [INFO ] [MAIN ] EPC: Loaded 39905 primary data records. [2025-09-22T22:19:25.340166] [DEBUG] [LOCAL ] EPD: Loaded 53616 existing records from primary storage. [2025-09-22T22:19:25.471874] [INFO ] [MAIN ] EPD: Loaded 53616 primary data records. [2025-09-22T22:19:26.111266] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:26.112524] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39649 primary records. [2025-09-22T22:19:26.112924] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-22T22:19:26.147772] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:26.150438] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39905 primary records. [2025-09-22T22:19:26.151261] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-09-22T22:19:26.151794] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-22T22:19:26.151679] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-22T22:19:26.155023] [INFO ] [MAIN ] Derivative Progress: 619/2091 symbols completed. EPAM took 1.2s. Estimated remaining: 9m 34s. Rate: 153.8 symbols/min [2025-09-22T22:19:26.163153] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:26.175769] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-09-22T22:19:26.176011] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-22T22:19:26.178663] [INFO ] [MAIN ] Derivative Progress: 620/2091 symbols completed. EPC took 1.2s. Estimated remaining: 9m 33s. Rate: 154.1 symbols/min [2025-09-22T22:19:26.188597] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:26.196488] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:26.197627] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53616 primary records. [2025-09-22T22:19:26.197884] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-22T22:19:26.217821] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-09-22T22:19:26.217965] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-22T22:19:26.220202] [INFO ] [MAIN ] Derivative Progress: 621/2091 symbols completed. EPD took 1.2s. Estimated remaining: 9m 32s. Rate: 154.3 symbols/min [2025-09-22T22:19:26.225336] [DEBUG] [LOCAL ] EQBK: Loaded 10916 existing records from primary storage. [2025-09-22T22:19:26.225493] [INFO ] [MAIN ] EQBK: Loaded 10916 primary data records. [2025-09-22T22:19:26.225013] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:26.398635] [DEBUG] [LOCAL ] EPR: Loaded 44290 existing records from primary storage. [2025-09-22T22:19:26.402467] [INFO ] [MAIN ] EPR: Loaded 44290 primary data records. [2025-09-22T22:19:26.715181] [DEBUG] [LOCAL ] EQH: Loaded 52672 existing records from primary storage. [2025-09-22T22:19:26.766809] [INFO ] [MAIN ] EQH: Loaded 52672 primary data records. [2025-09-22T22:19:27.249034] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:27.251290] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 10916 primary records. [2025-09-22T22:19:27.252027] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-22T22:19:27.274273] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-09-22T22:19:27.274734] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-22T22:19:27.276909] [INFO ] [MAIN ] Derivative Progress: 622/2091 symbols completed. EQBK took 1.1s. Estimated remaining: 9m 33s. Rate: 153.9 symbols/min [2025-09-22T22:19:27.277447] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:27.294998] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:27.296099] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 44290 primary records. [2025-09-22T22:19:27.298948] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-22T22:19:27.325993] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:27.330010] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52672 primary records. [2025-09-22T22:19:27.333151] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-09-22T22:19:27.330227] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-22T22:19:27.333357] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-22T22:19:27.335540] [INFO ] [MAIN ] Derivative Progress: 623/2091 symbols completed. EPR took 1.2s. Estimated remaining: 9m 32s. Rate: 154.1 symbols/min [2025-09-22T22:19:27.336673] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:27.353112] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-09-22T22:19:27.353296] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-22T22:19:27.355974] [INFO ] [MAIN ] Derivative Progress: 624/2091 symbols completed. EQH took 1.1s. Estimated remaining: 9m 30s. Rate: 154.3 symbols/min [2025-09-22T22:19:27.356365] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:27.392857] [DEBUG] [LOCAL ] EQNR: Loaded 53042 existing records from primary storage. [2025-09-22T22:19:27.393107] [INFO ] [MAIN ] EQNR: Loaded 53042 primary data records. [2025-09-22T22:19:27.743534] [DEBUG] [LOCAL ] EQR: Loaded 51410 existing records from primary storage. [2025-09-22T22:19:27.757420] [INFO ] [MAIN ] EQR: Loaded 51410 primary data records. [2025-09-22T22:19:27.759236] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-22T22:19:27.790782] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-09-22T22:19:28.440514] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:28.441608] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53042 primary records. [2025-09-22T22:19:28.441730] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-22T22:19:28.460049] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-09-22T22:19:28.460462] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-22T22:19:28.463203] [INFO ] [MAIN ] Derivative Progress: 625/2091 symbols completed. EQNR took 1.2s. Estimated remaining: 9m 32s. Rate: 153.9 symbols/min [2025-09-22T22:19:28.463465] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:28.484367] [DEBUG] [LOCAL ] EQV: Loaded 2833 existing records from primary storage. [2025-09-22T22:19:28.485451] [INFO ] [MAIN ] EQV: Loaded 2833 primary data records. [2025-09-22T22:19:28.486012] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:28.543489] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51410 primary records. [2025-09-22T22:19:28.564928] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-22T22:19:28.624488] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:28.636751] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-09-22T22:19:28.647893] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-22T22:19:28.663087] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-09-22T22:19:28.672068] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-22T22:19:28.683873] [INFO ] [MAIN ] Derivative Progress: 626/2091 symbols completed. EQR took 1.3s. Estimated remaining: 9m 31s. Rate: 154.0 symbols/min [2025-09-22T22:19:28.717218] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:28.839048] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-09-22T22:19:28.839726] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-22T22:19:28.845257] [INFO ] [MAIN ] Derivative Progress: 627/2091 symbols completed. EQT took 1.5s. Estimated remaining: 9m 30s. Rate: 154.1 symbols/min [2025-09-22T22:19:28.846414] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:28.869281] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:28.870036] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2833 primary records. [2025-09-22T22:19:28.870150] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-22T22:19:28.893184] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-09-22T22:19:28.893246] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-22T22:19:28.895687] [INFO ] [MAIN ] Derivative Progress: 628/2091 symbols completed. EQV took 0.4s. Estimated remaining: 9m 29s. Rate: 154.3 symbols/min [2025-09-22T22:19:28.928450] [DEBUG] [LOCAL ] ESAB: Loaded 25962 existing records from primary storage. [2025-09-22T22:19:28.942583] [INFO ] [MAIN ] ESAB: Loaded 25962 primary data records. [2025-09-22T22:19:29.015916] [DEBUG] [LOCAL ] ERJ: Loaded 50813 existing records from primary storage. [2025-09-22T22:19:29.026983] [INFO ] [MAIN ] ERJ: Loaded 50813 primary data records. [2025-09-22T22:19:29.573538] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:29.574241] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 25962 primary records. [2025-09-22T22:19:29.574386] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-22T22:19:29.602433] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:29.604492] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-09-22T22:19:29.605131] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50813 primary records. [2025-09-22T22:19:29.605228] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-22T22:19:29.605835] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-22T22:19:29.607905] [INFO ] [MAIN ] Derivative Progress: 629/2091 symbols completed. ESAB took 0.8s. Estimated remaining: 9m 29s. Rate: 154.1 symbols/min [2025-09-22T22:19:29.622549] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-09-22T22:19:29.622612] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-22T22:19:29.625256] [INFO ] [MAIN ] Derivative Progress: 630/2091 symbols completed. ERJ took 0.9s. Estimated remaining: 9m 28s. Rate: 154.4 symbols/min [2025-09-22T22:19:29.626133] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:29.626341] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:29.626953] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:29.646977] [DEBUG] [LOCAL ] ESE: Loaded 16560 existing records from primary storage. [2025-09-22T22:19:29.647301] [INFO ] [MAIN ] ESE: Loaded 16560 primary data records. [2025-09-22T22:19:29.808565] [DEBUG] [LOCAL ] ESNT: Loaded 38709 existing records from primary storage. [2025-09-22T22:19:29.836353] [INFO ] [MAIN ] ESNT: Loaded 38709 primary data records. [2025-09-22T22:19:30.112598] [DEBUG] [LOCAL ] ESI: Loaded 50861 existing records from primary storage. [2025-09-22T22:19:30.118138] [INFO ] [MAIN ] ESI: Loaded 50861 primary data records. [2025-09-22T22:19:30.659794] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:30.661265] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16560 primary records. [2025-09-22T22:19:30.662625] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-22T22:19:30.682399] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-09-22T22:19:30.682539] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-22T22:19:30.684930] [INFO ] [MAIN ] Derivative Progress: 631/2091 symbols completed. ESE took 1.1s. Estimated remaining: 9m 29s. Rate: 153.9 symbols/min [2025-09-22T22:19:30.685443] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:30.705073] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:30.705913] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38709 primary records. [2025-09-22T22:19:30.706089] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-22T22:19:30.730310] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:30.734837] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-09-22T22:19:30.735691] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50861 primary records. [2025-09-22T22:19:30.735782] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-22T22:19:30.735854] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-22T22:19:30.738103] [INFO ] [MAIN ] Derivative Progress: 632/2091 symbols completed. ESNT took 1.1s. Estimated remaining: 9m 28s. Rate: 154.1 symbols/min [2025-09-22T22:19:30.746540] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:30.764847] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-09-22T22:19:30.765062] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-22T22:19:30.767754] [INFO ] [MAIN ] Derivative Progress: 633/2091 symbols completed. ESI took 1.1s. Estimated remaining: 9m 27s. Rate: 154.4 symbols/min [2025-09-22T22:19:30.768211] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:30.784811] [DEBUG] [LOCAL ] ESRT: Loaded 46390 existing records from primary storage. [2025-09-22T22:19:30.785020] [INFO ] [MAIN ] ESRT: Loaded 46390 primary data records. [2025-09-22T22:19:31.111098] [DEBUG] [LOCAL ] ESS: Loaded 30116 existing records from primary storage. [2025-09-22T22:19:31.111967] [INFO ] [MAIN ] ESS: Loaded 30116 primary data records. [2025-09-22T22:19:31.204216] [DEBUG] [LOCAL ] ESTC: Loaded 50184 existing records from primary storage. [2025-09-22T22:19:31.223532] [INFO ] [MAIN ] ESTC: Loaded 50184 primary data records. [2025-09-22T22:19:31.810850] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:31.811918] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46390 primary records. [2025-09-22T22:19:31.812744] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-22T22:19:31.834078] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-09-22T22:19:31.834443] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-22T22:19:31.836983] [INFO ] [MAIN ] Derivative Progress: 634/2091 symbols completed. ESRT took 1.2s. Estimated remaining: 9m 28s. Rate: 153.9 symbols/min [2025-09-22T22:19:31.837997] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:31.879915] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:31.880361] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:31.881379] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 30116 primary records. [2025-09-22T22:19:31.882239] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50184 primary records. [2025-09-22T22:19:31.882423] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-22T22:19:31.882517] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-22T22:19:31.911979] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-09-22T22:19:31.912615] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-22T22:19:31.915047] [INFO ] [MAIN ] Derivative Progress: 635/2091 symbols completed. ESS took 1.2s. Estimated remaining: 9m 27s. Rate: 154.1 symbols/min [2025-09-22T22:19:31.929260] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:31.932805] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-09-22T22:19:31.932970] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-22T22:19:31.935429] [INFO ] [MAIN ] Derivative Progress: 636/2091 symbols completed. ESTC took 1.2s. Estimated remaining: 9m 26s. Rate: 154.4 symbols/min [2025-09-22T22:19:31.935875] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:31.954732] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-22T22:19:31.954950] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-09-22T22:19:32.086255] [DEBUG] [LOCAL ] ETG: Loaded 16734 existing records from primary storage. [2025-09-22T22:19:32.092493] [DEBUG] [LOCAL ] ETD: Loaded 27409 existing records from primary storage. [2025-09-22T22:19:32.097777] [INFO ] [MAIN ] ETG: Loaded 16734 primary data records. [2025-09-22T22:19:32.103116] [INFO ] [MAIN ] ETD: Loaded 27409 primary data records. [2025-09-22T22:19:32.957091] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:32.958239] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-09-22T22:19:32.958571] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-22T22:19:32.978780] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-09-22T22:19:32.987438] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-22T22:19:32.995775] [INFO ] [MAIN ] Derivative Progress: 637/2091 symbols completed. ET took 1.2s. Estimated remaining: 9m 27s. Rate: 154.0 symbols/min [2025-09-22T22:19:32.996093] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:32.996995] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:32.997877] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27409 primary records. [2025-09-22T22:19:32.998392] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-22T22:19:33.019774] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:33.028865] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16734 primary records. [2025-09-22T22:19:33.032862] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-09-22T22:19:33.033010] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-22T22:19:33.033909] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-22T22:19:33.037033] [INFO ] [MAIN ] Derivative Progress: 638/2091 symbols completed. ETD took 1.1s. Estimated remaining: 9m 25s. Rate: 154.2 symbols/min [2025-09-22T22:19:33.051134] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:33.059261] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-09-22T22:19:33.059458] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-22T22:19:33.058315] [DEBUG] [LOCAL ] ETJ: Loaded 16753 existing records from primary storage. [2025-09-22T22:19:33.059894] [INFO ] [MAIN ] ETJ: Loaded 16753 primary data records. [2025-09-22T22:19:33.063096] [INFO ] [MAIN ] Derivative Progress: 639/2091 symbols completed. ETG took 1.1s. Estimated remaining: 9m 24s. Rate: 154.4 symbols/min [2025-09-22T22:19:33.092932] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:33.313820] [DEBUG] [LOCAL ] ETV: Loaded 21450 existing records from primary storage. [2025-09-22T22:19:33.375809] [INFO ] [MAIN ] ETV: Loaded 21450 primary data records. [2025-09-22T22:19:33.563879] [DEBUG] [LOCAL ] ETN: Loaded 52837 existing records from primary storage. [2025-09-22T22:19:33.569461] [INFO ] [MAIN ] ETN: Loaded 52837 primary data records. [2025-09-22T22:19:34.115460] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:34.117958] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16753 primary records. [2025-09-22T22:19:34.119135] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-22T22:19:34.140003] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-09-22T22:19:34.140265] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-22T22:19:34.144558] [INFO ] [MAIN ] Derivative Progress: 640/2091 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 25s. Rate: 154.0 symbols/min [2025-09-22T22:19:34.146743] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:34.161421] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:34.162218] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21450 primary records. [2025-09-22T22:19:34.162315] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-22T22:19:34.179228] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-09-22T22:19:34.185910] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-22T22:19:34.189331] [INFO ] [MAIN ] Derivative Progress: 641/2091 symbols completed. ETV took 1.1s. Estimated remaining: 9m 24s. Rate: 154.2 symbols/min [2025-09-22T22:19:34.190526] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:34.203863] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:34.205615] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52837 primary records. [2025-09-22T22:19:34.205784] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-22T22:19:34.223903] [DEBUG] [LOCAL ] ETW: Loaded 25180 existing records from primary storage. [2025-09-22T22:19:34.226562] [INFO ] [MAIN ] ETW: Loaded 25180 primary data records. [2025-09-22T22:19:34.230888] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-09-22T22:19:34.230985] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-22T22:19:34.244780] [INFO ] [MAIN ] Derivative Progress: 642/2091 symbols completed. ETN took 1.2s. Estimated remaining: 9m 23s. Rate: 154.4 symbols/min [2025-09-22T22:19:34.300827] [DEBUG] [LOCAL ] ETX: Loaded 4913 existing records from primary storage. [2025-09-22T22:19:34.307309] [INFO ] [MAIN ] ETX: Loaded 4913 primary data records. [2025-09-22T22:19:34.313103] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:34.571088] [DEBUG] [LOCAL ] ETY: Loaded 22861 existing records from primary storage. [2025-09-22T22:19:34.626129] [INFO ] [MAIN ] ETY: Loaded 22861 primary data records. [2025-09-22T22:19:35.243411] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:35.255950] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25180 primary records. [2025-09-22T22:19:35.258280] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:19:35.259337] [INFO ] [MAIN ] ETX: Generated 1793 derivative records from 4913 primary records. [2025-09-22T22:19:35.258513] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-22T22:19:35.259755] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-22T22:19:35.290198] [DEBUG] [LOCAL ] ETX: Derivative data saved (1793 records). [2025-09-22T22:19:35.290374] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-22T22:19:35.293072] [INFO ] [MAIN ] Derivative Progress: 643/2091 symbols completed. ETX took 1.1s. Estimated remaining: 9m 24s. Rate: 154.0 symbols/min [2025-09-22T22:19:35.296343] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-09-22T22:19:35.296435] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-22T22:19:35.298727] [INFO ] [MAIN ] Derivative Progress: 644/2091 symbols completed. ETW took 1.2s. Estimated remaining: 9m 23s. Rate: 154.2 symbols/min [2025-09-22T22:19:35.314849] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:35.315493] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 22861 primary records. [2025-09-22T22:19:35.315554] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-22T22:19:35.331082] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-09-22T22:19:35.331151] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-22T22:19:35.333892] [INFO ] [MAIN ] Derivative Progress: 645/2091 symbols completed. ETY took 1.0s. Estimated remaining: 9m 22s. Rate: 154.4 symbols/min [2025-09-22T22:19:35.334538] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:35.334801] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:35.334910] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:35.346566] [DEBUG] [LOCAL ] EVF: Loaded 9041 existing records from primary storage. [2025-09-22T22:19:35.346794] [INFO ] [MAIN ] EVF: Loaded 9041 primary data records. [2025-09-22T22:19:35.472292] [DEBUG] [LOCAL ] EVC: Loaded 19774 existing records from primary storage. [2025-09-22T22:19:35.472859] [INFO ] [MAIN ] EVC: Loaded 19774 primary data records. [2025-09-22T22:19:35.564030] [DEBUG] [LOCAL ] EVEX: Loaded 29592 existing records from primary storage. [2025-09-22T22:19:35.660900] [INFO ] [MAIN ] EVEX: Loaded 29592 primary data records. [2025-09-22T22:19:36.399241] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:36.400548] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9041 primary records. [2025-09-22T22:19:36.403508] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-22T22:19:36.432771] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:36.434554] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 19774 primary records. [2025-09-22T22:19:36.435156] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-22T22:19:36.449289] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-09-22T22:19:36.453163] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-22T22:19:36.456604] [INFO ] [MAIN ] Derivative Progress: 646/2091 symbols completed. EVF took 1.1s. Estimated remaining: 9m 23s. Rate: 154.0 symbols/min [2025-09-22T22:19:36.457603] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:36.457772] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-09-22T22:19:36.459277] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-22T22:19:36.463348] [INFO ] [MAIN ] Derivative Progress: 647/2091 symbols completed. EVC took 1.1s. Estimated remaining: 9m 22s. Rate: 154.2 symbols/min [2025-09-22T22:19:36.464372] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:36.479122] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:36.481396] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 29592 primary records. [2025-09-22T22:19:36.481596] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-22T22:19:36.501512] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-09-22T22:19:36.498525] [DEBUG] [LOCAL ] EVG: Loaded 5780 existing records from primary storage. [2025-09-22T22:19:36.501819] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-22T22:19:36.501748] [INFO ] [MAIN ] EVG: Loaded 5780 primary data records. [2025-09-22T22:19:36.516087] [INFO ] [MAIN ] Derivative Progress: 648/2091 symbols completed. EVEX took 1.2s. Estimated remaining: 9m 21s. Rate: 154.4 symbols/min [2025-09-22T22:19:36.551379] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:36.846037] [DEBUG] [LOCAL ] EVN: Loaded 10956 existing records from primary storage. [2025-09-22T22:19:36.847386] [DEBUG] [LOCAL ] EVH: Loaded 49345 existing records from primary storage. [2025-09-22T22:19:36.847927] [INFO ] [MAIN ] EVH: Loaded 49345 primary data records. [2025-09-22T22:19:36.847844] [INFO ] [MAIN ] EVN: Loaded 10956 primary data records. [2025-09-22T22:19:37.511958] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:37.513806] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5780 primary records. [2025-09-22T22:19:37.514027] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-22T22:19:37.532528] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-09-22T22:19:37.533395] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-22T22:19:37.536114] [INFO ] [MAIN ] Derivative Progress: 649/2091 symbols completed. EVG took 1.1s. Estimated remaining: 9m 22s. Rate: 154.0 symbols/min [2025-09-22T22:19:37.536943] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:37.556315] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:37.557157] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 10956 primary records. [2025-09-22T22:19:37.557367] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-22T22:19:37.583727] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-09-22T22:19:37.589055] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-22T22:19:37.589373] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:37.592088] [INFO ] [MAIN ] Derivative Progress: 650/2091 symbols completed. EVN took 1.0s. Estimated remaining: 9m 21s. Rate: 154.2 symbols/min [2025-09-22T22:19:37.592495] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:37.593547] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49345 primary records. [2025-09-22T22:19:37.594002] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-22T22:19:37.618724] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-09-22T22:19:37.618827] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-22T22:19:37.621309] [INFO ] [MAIN ] Derivative Progress: 651/2091 symbols completed. EVH took 1.2s. Estimated remaining: 9m 19s. Rate: 154.5 symbols/min [2025-09-22T22:19:37.621870] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:37.638508] [DEBUG] [LOCAL ] EVR: Loaded 35778 existing records from primary storage. [2025-09-22T22:19:37.638751] [INFO ] [MAIN ] EVR: Loaded 35778 primary data records. [2025-09-22T22:19:37.715188] [DEBUG] [LOCAL ] EVT: Loaded 17313 existing records from primary storage. [2025-09-22T22:19:37.726837] [INFO ] [MAIN ] EVT: Loaded 17313 primary data records. [2025-09-22T22:19:38.003609] [DEBUG] [LOCAL ] EVTL: Loaded 36915 existing records from primary storage. [2025-09-22T22:19:38.086770] [INFO ] [MAIN ] EVTL: Loaded 36915 primary data records. [2025-09-22T22:19:38.660307] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:38.661917] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 35778 primary records. [2025-09-22T22:19:38.662273] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-22T22:19:38.680405] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-09-22T22:19:38.681960] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-22T22:19:38.686135] [INFO ] [MAIN ] Derivative Progress: 652/2091 symbols completed. EVR took 1.1s. Estimated remaining: 9m 20s. Rate: 154.0 symbols/min [2025-09-22T22:19:38.687865] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:38.702364] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:38.703394] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 17313 primary records. [2025-09-22T22:19:38.703612] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-22T22:19:38.721228] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-09-22T22:19:38.728329] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-22T22:19:38.731948] [INFO ] [MAIN ] Derivative Progress: 653/2091 symbols completed. EVT took 1.1s. Estimated remaining: 9m 19s. Rate: 154.3 symbols/min [2025-09-22T22:19:38.732311] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:38.752781] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:38.754350] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 36915 primary records. [2025-09-22T22:19:38.754554] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-22T22:19:38.754966] [DEBUG] [LOCAL ] EVTR: Loaded 23026 existing records from primary storage. [2025-09-22T22:19:38.755589] [INFO ] [MAIN ] EVTR: Loaded 23026 primary data records. [2025-09-22T22:19:38.964804] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-09-22T22:19:38.965907] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-22T22:19:39.109914] [INFO ] [MAIN ] Derivative Progress: 654/2091 symbols completed. EVTL took 1.5s. Estimated remaining: 9m 19s. Rate: 154.3 symbols/min [2025-09-22T22:19:39.111578] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:39.111080] [DEBUG] [LOCAL ] EW: Loaded 53396 existing records from primary storage. [2025-09-22T22:19:39.111767] [INFO ] [MAIN ] EW: Loaded 53396 primary data records. [2025-09-22T22:19:39.442509] [DEBUG] [LOCAL ] EXG: Loaded 34542 existing records from primary storage. [2025-09-22T22:19:39.443302] [INFO ] [MAIN ] EXG: Loaded 34542 primary data records. [2025-09-22T22:19:39.647683] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:39.770704] [INFO ] [MAIN ] EVTR: Generated 1794 derivative records from 23026 primary records. [2025-09-22T22:19:39.771115] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-22T22:19:39.789522] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1794 records). [2025-09-22T22:19:39.790043] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-22T22:19:39.794418] [INFO ] [MAIN ] Derivative Progress: 655/2091 symbols completed. EVTR took 1.1s. Estimated remaining: 9m 19s. Rate: 154.1 symbols/min [2025-09-22T22:19:39.796736] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:39.810516] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:39.811446] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53396 primary records. [2025-09-22T22:19:39.811668] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-22T22:19:39.828971] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-09-22T22:19:39.829085] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-22T22:19:39.831924] [INFO ] [MAIN ] Derivative Progress: 656/2091 symbols completed. EW took 1.1s. Estimated remaining: 9m 18s. Rate: 154.3 symbols/min [2025-09-22T22:19:39.832442] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:39.853875] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:39.862926] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34542 primary records. [2025-09-22T22:19:39.863143] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-22T22:19:39.882108] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-09-22T22:19:39.890237] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-22T22:19:39.894023] [INFO ] [MAIN ] Derivative Progress: 657/2091 symbols completed. EXG took 0.8s. Estimated remaining: 9m 17s. Rate: 154.5 symbols/min [2025-09-22T22:19:39.894521] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:39.895479] [DEBUG] [LOCAL ] EXP: Loaded 30188 existing records from primary storage. [2025-09-22T22:19:39.896032] [INFO ] [MAIN ] EXP: Loaded 30188 primary data records. [2025-09-22T22:19:40.032964] [DEBUG] [LOCAL ] EXPD: Loaded 48212 existing records from primary storage. [2025-09-22T22:19:40.033482] [INFO ] [MAIN ] EXPD: Loaded 48212 primary data records. [2025-09-22T22:19:40.594397] [DEBUG] [LOCAL ] EXR: Loaded 45520 existing records from primary storage. [2025-09-22T22:19:40.596327] [INFO ] [MAIN ] EXR: Loaded 45520 primary data records. [2025-09-22T22:19:40.918082] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:40.920751] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 30188 primary records. [2025-09-22T22:19:40.921592] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-22T22:19:40.951455] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-09-22T22:19:40.951857] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:40.952124] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-22T22:19:40.954972] [INFO ] [MAIN ] Derivative Progress: 658/2091 symbols completed. EXP took 1.2s. Estimated remaining: 9m 18s. Rate: 154.1 symbols/min [2025-09-22T22:19:40.956070] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 48212 primary records. [2025-09-22T22:19:40.956301] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-22T22:19:40.972891] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-09-22T22:19:40.973067] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-22T22:19:40.975662] [INFO ] [MAIN ] Derivative Progress: 659/2091 symbols completed. EXPD took 1.1s. Estimated remaining: 9m 17s. Rate: 154.3 symbols/min [2025-09-22T22:19:40.990481] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:40.991034] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45520 primary records. [2025-09-22T22:19:40.991095] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-22T22:19:41.007299] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-09-22T22:19:41.007372] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-22T22:19:41.010297] [INFO ] [MAIN ] Derivative Progress: 660/2091 symbols completed. EXR took 1.1s. Estimated remaining: 9m 16s. Rate: 154.5 symbols/min [2025-09-22T22:19:41.010885] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:41.010786] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:41.011296] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:41.076536] [DEBUG] [LOCAL ] FAF: Loaded 42036 existing records from primary storage. [2025-09-22T22:19:41.076742] [INFO ] [MAIN ] FAF: Loaded 42036 primary data records. [2025-09-22T22:19:41.210720] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-22T22:19:41.216401] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-09-22T22:19:41.222116] [DEBUG] [LOCAL ] FBIN: Loaded 50429 existing records from primary storage. [2025-09-22T22:19:41.250574] [INFO ] [MAIN ] FBIN: Loaded 50429 primary data records. [2025-09-22T22:19:42.102091] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:42.103303] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 42036 primary records. [2025-09-22T22:19:42.103498] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-22T22:19:42.121617] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-09-22T22:19:42.121857] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-22T22:19:42.123734] [INFO ] [MAIN ] Derivative Progress: 661/2091 symbols completed. FAF took 1.1s. Estimated remaining: 9m 17s. Rate: 154.1 symbols/min [2025-09-22T22:19:42.124209] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:42.140814] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:42.141875] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-09-22T22:19:42.142051] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-22T22:19:42.158423] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-09-22T22:19:42.158592] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-22T22:19:42.161056] [INFO ] [MAIN ] Derivative Progress: 662/2091 symbols completed. F took 1.2s. Estimated remaining: 9m 16s. Rate: 154.3 symbols/min [2025-09-22T22:19:42.171856] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:42.186761] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:42.194509] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50429 primary records. [2025-09-22T22:19:42.194731] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-22T22:19:42.196405] [DEBUG] [LOCAL ] FBK: Loaded 25489 existing records from primary storage. [2025-09-22T22:19:42.196674] [INFO ] [MAIN ] FBK: Loaded 25489 primary data records. [2025-09-22T22:19:42.302488] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-09-22T22:19:42.320111] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-22T22:19:42.322902] [INFO ] [MAIN ] Derivative Progress: 663/2091 symbols completed. FBIN took 1.3s. Estimated remaining: 9m 15s. Rate: 154.4 symbols/min [2025-09-22T22:19:42.323189] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:42.554066] [DEBUG] [LOCAL ] FBP: Loaded 46272 existing records from primary storage. [2025-09-22T22:19:42.554482] [INFO ] [MAIN ] FBP: Loaded 46272 primary data records. [2025-09-22T22:19:42.694091] [DEBUG] [LOCAL ] FBRT: Loaded 34333 existing records from primary storage. [2025-09-22T22:19:42.704977] [INFO ] [MAIN ] FBRT: Loaded 34333 primary data records. [2025-09-22T22:19:43.066002] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:43.088532] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 25489 primary records. [2025-09-22T22:19:43.088843] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-22T22:19:43.224100] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-09-22T22:19:43.224698] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-22T22:19:43.227453] [INFO ] [MAIN ] Derivative Progress: 664/2091 symbols completed. FBK took 1.1s. Estimated remaining: 9m 16s. Rate: 154.1 symbols/min [2025-09-22T22:19:43.228676] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:43.264234] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:43.264798] [DEBUG] [LOCAL ] FC: Loaded 15403 existing records from primary storage. [2025-09-22T22:19:43.266154] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 46272 primary records. [2025-09-22T22:19:43.266247] [INFO ] [MAIN ] FC: Loaded 15403 primary data records. [2025-09-22T22:19:43.278414] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-22T22:19:43.379477] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-09-22T22:19:43.392540] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-22T22:19:43.417932] [INFO ] [MAIN ] Derivative Progress: 665/2091 symbols completed. FBP took 1.2s. Estimated remaining: 9m 15s. Rate: 154.2 symbols/min [2025-09-22T22:19:43.422372] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:43.422553] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:43.423479] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 34333 primary records. [2025-09-22T22:19:43.423639] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-22T22:19:43.658898] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-09-22T22:19:43.659086] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-22T22:19:43.661613] [INFO ] [MAIN ] Derivative Progress: 666/2091 symbols completed. FBRT took 1.3s. Estimated remaining: 9m 14s. Rate: 154.3 symbols/min [2025-09-22T22:19:43.663017] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:43.695632] [DEBUG] [LOCAL ] FCF: Loaded 39806 existing records from primary storage. [2025-09-22T22:19:43.703803] [INFO ] [MAIN ] FCF: Loaded 39806 primary data records. [2025-09-22T22:19:43.798619] [DEBUG] [LOCAL ] FCN: Loaded 26353 existing records from primary storage. [2025-09-22T22:19:43.819274] [INFO ] [MAIN ] FCN: Loaded 26353 primary data records. [2025-09-22T22:19:43.863845] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:43.902501] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15403 primary records. [2025-09-22T22:19:43.907768] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-22T22:19:44.056506] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-09-22T22:19:44.060442] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-22T22:19:44.062484] [INFO ] [MAIN ] Derivative Progress: 667/2091 symbols completed. FC took 0.8s. Estimated remaining: 9m 14s. Rate: 154.3 symbols/min [2025-09-22T22:19:44.190668] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:44.472795] [DEBUG] [LOCAL ] FCPT: Loaded 37416 existing records from primary storage. [2025-09-22T22:19:44.473459] [INFO ] [MAIN ] FCPT: Loaded 37416 primary data records. [2025-09-22T22:19:44.533886] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:44.548195] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39806 primary records. [2025-09-22T22:19:44.574364] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-22T22:19:44.615516] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:44.616803] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26353 primary records. [2025-09-22T22:19:44.623993] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-22T22:19:44.642915] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-09-22T22:19:44.643290] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-22T22:19:44.664129] [INFO ] [MAIN ] Derivative Progress: 668/2091 symbols completed. FCF took 1.2s. Estimated remaining: 9m 14s. Rate: 154.2 symbols/min [2025-09-22T22:19:44.729309] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:44.852223] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-09-22T22:19:44.853620] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-22T22:19:44.856532] [INFO ] [MAIN ] Derivative Progress: 669/2091 symbols completed. FCN took 1.2s. Estimated remaining: 9m 13s. Rate: 154.3 symbols/min [2025-09-22T22:19:44.857202] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:44.870004] [DEBUG] [LOCAL ] FCT: Loaded 14298 existing records from primary storage. [2025-09-22T22:19:44.870150] [INFO ] [MAIN ] FCT: Loaded 14298 primary data records. [2025-09-22T22:19:45.200973] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:45.201929] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37416 primary records. [2025-09-22T22:19:45.202182] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-22T22:19:45.224694] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-09-22T22:19:45.225113] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-22T22:19:45.243157] [INFO ] [MAIN ] Derivative Progress: 670/2091 symbols completed. FCPT took 1.1s. Estimated remaining: 9m 13s. Rate: 154.3 symbols/min [2025-09-22T22:19:45.243820] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:45.245358] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-22T22:19:45.245847] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-09-22T22:19:45.589440] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:45.600533] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14298 primary records. [2025-09-22T22:19:45.600809] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-22T22:19:45.601938] [DEBUG] [LOCAL ] FDP: Loaded 30411 existing records from primary storage. [2025-09-22T22:19:45.602683] [INFO ] [MAIN ] FDP: Loaded 30411 primary data records. [2025-09-22T22:19:45.663027] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-09-22T22:19:45.690327] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-22T22:19:45.692985] [INFO ] [MAIN ] Derivative Progress: 671/2091 symbols completed. FCT took 1.0s. Estimated remaining: 9m 12s. Rate: 154.3 symbols/min [2025-09-22T22:19:45.698730] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:45.956097] [DEBUG] [LOCAL ] FDS: Loaded 25991 existing records from primary storage. [2025-09-22T22:19:45.958614] [INFO ] [MAIN ] FDS: Loaded 25991 primary data records. [2025-09-22T22:19:46.040569] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:46.081560] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-09-22T22:19:46.081838] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-22T22:19:46.349054] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-09-22T22:19:46.352065] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-22T22:19:46.354629] [INFO ] [MAIN ] Derivative Progress: 672/2091 symbols completed. FCX took 1.5s. Estimated remaining: 9m 12s. Rate: 154.1 symbols/min [2025-09-22T22:19:46.368597] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:46.368229] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:46.369873] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30411 primary records. [2025-09-22T22:19:46.370153] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-22T22:19:46.393199] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-09-22T22:19:46.394351] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-22T22:19:46.397936] [INFO ] [MAIN ] Derivative Progress: 673/2091 symbols completed. FDP took 1.2s. Estimated remaining: 9m 11s. Rate: 154.3 symbols/min [2025-09-22T22:19:46.412778] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:46.413419] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 25991 primary records. [2025-09-22T22:19:46.413485] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-22T22:19:46.429442] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-09-22T22:19:46.429518] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-22T22:19:46.431824] [INFO ] [MAIN ] Derivative Progress: 674/2091 symbols completed. FDS took 0.7s. Estimated remaining: 9m 10s. Rate: 154.5 symbols/min [2025-09-22T22:19:46.467958] [DEBUG] [LOCAL ] FDX: Loaded 51613 existing records from primary storage. [2025-09-22T22:19:46.468093] [INFO ] [MAIN ] FDX: Loaded 51613 primary data records. [2025-09-22T22:19:46.772491] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:46.773129] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51613 primary records. [2025-09-22T22:19:46.773192] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-22T22:19:46.788967] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-09-22T22:19:46.789028] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-22T22:19:46.790912] [INFO ] [MAIN ] Derivative Progress: 675/2091 symbols completed. FDX took 0.4s. Estimated remaining: 9m 10s. Rate: 154.5 symbols/min [2025-09-22T22:19:46.791866] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:46.792041] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:46.791972] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:46.806788] [DEBUG] [LOCAL ] FET: Loaded 12626 existing records from primary storage. [2025-09-22T22:19:46.807038] [INFO ] [MAIN ] FET: Loaded 12626 primary data records. [2025-09-22T22:19:47.175441] [DEBUG] [LOCAL ] FERG: Loaded 49036 existing records from primary storage. [2025-09-22T22:19:47.175212] [DEBUG] [LOCAL ] FE: Loaded 53438 existing records from primary storage. [2025-09-22T22:19:47.175624] [INFO ] [MAIN ] FE: Loaded 53438 primary data records. [2025-09-22T22:19:47.175873] [INFO ] [MAIN ] FERG: Loaded 49036 primary data records. [2025-09-22T22:19:47.809056] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:47.810216] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12626 primary records. [2025-09-22T22:19:47.810413] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-22T22:19:47.842543] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:47.844195] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53438 primary records. [2025-09-22T22:19:47.844385] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-09-22T22:19:47.845589] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-22T22:19:47.845488] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-22T22:19:47.848740] [INFO ] [MAIN ] Derivative Progress: 676/2091 symbols completed. FET took 1.1s. Estimated remaining: 9m 11s. Rate: 154.2 symbols/min [2025-09-22T22:19:47.850935] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:47.877893] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:47.880800] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 49036 primary records. [2025-09-22T22:19:47.880960] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-09-22T22:19:47.881041] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-22T22:19:47.883101] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-22T22:19:47.883039] [INFO ] [MAIN ] Derivative Progress: 677/2091 symbols completed. FE took 1.1s. Estimated remaining: 9m 10s. Rate: 154.4 symbols/min [2025-09-22T22:19:47.884590] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:47.904492] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-09-22T22:19:47.915284] [DEBUG] [LOCAL ] FFA: Loaded 5609 existing records from primary storage. [2025-09-22T22:19:47.915499] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-22T22:19:47.918517] [INFO ] [MAIN ] Derivative Progress: 678/2091 symbols completed. FERG took 1.1s. Estimated remaining: 9m 8s. Rate: 154.6 symbols/min [2025-09-22T22:19:47.918828] [INFO ] [MAIN ] FFA: Loaded 5609 primary data records. [2025-09-22T22:19:47.949478] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:48.017372] [DEBUG] [LOCAL ] FF: Loaded 25726 existing records from primary storage. [2025-09-22T22:19:48.035851] [INFO ] [MAIN ] FF: Loaded 25726 primary data records. [2025-09-22T22:19:48.380406] [DEBUG] [LOCAL ] FFC: Loaded 16591 existing records from primary storage. [2025-09-22T22:19:48.416380] [INFO ] [MAIN ] FFC: Loaded 16591 primary data records. [2025-09-22T22:19:48.934543] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:48.937674] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 5609 primary records. [2025-09-22T22:19:48.937865] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-22T22:19:48.961843] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:48.962731] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 25726 primary records. [2025-09-22T22:19:48.966302] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-22T22:19:48.967776] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-09-22T22:19:48.968099] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-22T22:19:48.977167] [INFO ] [MAIN ] Derivative Progress: 679/2091 symbols completed. FFA took 1.1s. Estimated remaining: 9m 9s. Rate: 154.2 symbols/min [2025-09-22T22:19:48.981016] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:49.000583] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:49.001525] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-09-22T22:19:49.002273] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16591 primary records. [2025-09-22T22:19:49.002376] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-22T22:19:49.002814] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-22T22:19:49.005617] [INFO ] [MAIN ] Derivative Progress: 680/2091 symbols completed. FF took 1.2s. Estimated remaining: 9m 8s. Rate: 154.4 symbols/min [2025-09-22T22:19:49.005879] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:49.021828] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-09-22T22:19:49.022008] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-22T22:19:49.025447] [INFO ] [MAIN ] Derivative Progress: 681/2091 symbols completed. FFC took 1.1s. Estimated remaining: 9m 7s. Rate: 154.6 symbols/min [2025-09-22T22:19:49.031488] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:49.057276] [DEBUG] [LOCAL ] FGN: Loaded 3942 existing records from primary storage. [2025-09-22T22:19:49.058286] [INFO ] [MAIN ] FGN: Loaded 3942 primary data records. [2025-09-22T22:19:49.160865] [DEBUG] [LOCAL ] FFWM: Loaded 36236 existing records from primary storage. [2025-09-22T22:19:49.177352] [DEBUG] [LOCAL ] FG: Loaded 22417 existing records from primary storage. [2025-09-22T22:19:49.177682] [INFO ] [MAIN ] FG: Loaded 22417 primary data records. [2025-09-22T22:19:49.177609] [INFO ] [MAIN ] FFWM: Loaded 36236 primary data records. [2025-09-22T22:19:50.028267] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:50.029363] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3942 primary records. [2025-09-22T22:19:50.029722] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-22T22:19:50.048188] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-09-22T22:19:50.048297] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-22T22:19:50.050511] [INFO ] [MAIN ] Derivative Progress: 682/2091 symbols completed. FGN took 1.0s. Estimated remaining: 9m 8s. Rate: 154.2 symbols/min [2025-09-22T22:19:50.050873] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:50.066761] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:50.067634] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 36236 primary records. [2025-09-22T22:19:50.067830] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-22T22:19:50.087879] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:50.088548] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22417 primary records. [2025-09-22T22:19:50.089966] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-22T22:19:50.115691] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-09-22T22:19:50.116010] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-22T22:19:50.119015] [INFO ] [MAIN ] Derivative Progress: 683/2091 symbols completed. FFWM took 1.1s. Estimated remaining: 9m 7s. Rate: 154.4 symbols/min [2025-09-22T22:19:50.119754] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:50.120812] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-09-22T22:19:50.120996] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-22T22:19:50.123865] [INFO ] [MAIN ] Derivative Progress: 684/2091 symbols completed. FG took 1.1s. Estimated remaining: 9m 6s. Rate: 154.6 symbols/min [2025-09-22T22:19:50.134131] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:50.151115] [DEBUG] [LOCAL ] FHI: Loaded 40812 existing records from primary storage. [2025-09-22T22:19:50.151351] [INFO ] [MAIN ] FHI: Loaded 40812 primary data records. [2025-09-22T22:19:50.541694] [DEBUG] [LOCAL ] FHN: Loaded 53369 existing records from primary storage. [2025-09-22T22:19:50.542562] [INFO ] [MAIN ] FHN: Loaded 53369 primary data records. [2025-09-22T22:19:50.543746] [DEBUG] [LOCAL ] FI: Loaded 53506 existing records from primary storage. [2025-09-22T22:19:50.543964] [INFO ] [MAIN ] FI: Loaded 53506 primary data records. [2025-09-22T22:19:51.193106] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:51.195118] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 40812 primary records. [2025-09-22T22:19:51.195306] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-22T22:19:51.213736] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-09-22T22:19:51.215247] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-22T22:19:51.217707] [INFO ] [MAIN ] Derivative Progress: 685/2091 symbols completed. FHI took 1.2s. Estimated remaining: 9m 7s. Rate: 154.2 symbols/min [2025-09-22T22:19:51.218103] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:51.255033] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:51.260967] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53369 primary records. [2025-09-22T22:19:51.261461] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-22T22:19:51.261382] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:51.263176] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53506 primary records. [2025-09-22T22:19:51.263284] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-22T22:19:51.283248] [DEBUG] [LOCAL ] FICO: Loaded 20499 existing records from primary storage. [2025-09-22T22:19:51.286672] [INFO ] [MAIN ] FICO: Loaded 20499 primary data records. [2025-09-22T22:19:51.288202] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-09-22T22:19:51.295755] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-22T22:19:51.311756] [INFO ] [MAIN ] Derivative Progress: 686/2091 symbols completed. FHN took 1.2s. Estimated remaining: 9m 6s. Rate: 154.4 symbols/min [2025-09-22T22:19:51.324845] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:51.367272] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-09-22T22:19:51.389558] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-22T22:19:51.419761] [INFO ] [MAIN ] Derivative Progress: 687/2091 symbols completed. FI took 1.3s. Estimated remaining: 9m 5s. Rate: 154.6 symbols/min [2025-09-22T22:19:51.420252] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:51.662240] [DEBUG] [LOCAL ] FIGS: Loaded 48969 existing records from primary storage. [2025-09-22T22:19:51.673015] [INFO ] [MAIN ] FIGS: Loaded 48969 primary data records. [2025-09-22T22:19:51.686712] [DEBUG] [LOCAL ] FIHL: Loaded 40389 existing records from primary storage. [2025-09-22T22:19:51.708299] [INFO ] [MAIN ] FIHL: Loaded 40389 primary data records. [2025-09-22T22:19:52.017535] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:52.091006] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 20499 primary records. [2025-09-22T22:19:52.208683] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-22T22:19:52.399781] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-09-22T22:19:52.400146] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-22T22:19:52.402242] [INFO ] [MAIN ] Derivative Progress: 688/2091 symbols completed. FICO took 1.2s. Estimated remaining: 9m 6s. Rate: 154.2 symbols/min [2025-09-22T22:19:52.450728] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:52.451126] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:52.452100] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 40389 primary records. [2025-09-22T22:19:52.452186] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-22T22:19:52.453230] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48969 primary records. [2025-09-22T22:19:52.454308] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-22T22:19:52.481026] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-09-22T22:19:52.487097] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-22T22:19:52.489894] [INFO ] [MAIN ] Derivative Progress: 689/2091 symbols completed. FIHL took 1.1s. Estimated remaining: 9m 5s. Rate: 154.4 symbols/min [2025-09-22T22:19:52.495841] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-09-22T22:19:52.496029] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-22T22:19:52.499325] [INFO ] [MAIN ] Derivative Progress: 690/2091 symbols completed. FIGS took 1.2s. Estimated remaining: 9m 4s. Rate: 154.6 symbols/min [2025-09-22T22:19:52.500444] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:52.500288] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:52.500589] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:52.515735] [DEBUG] [LOCAL ] FINS: Loaded 8193 existing records from primary storage. [2025-09-22T22:19:52.515980] [INFO ] [MAIN ] FINS: Loaded 8193 primary data records. [2025-09-22T22:19:52.751491] [DEBUG] [LOCAL ] FINV: Loaded 45117 existing records from primary storage. [2025-09-22T22:19:52.859604] [INFO ] [MAIN ] FINV: Loaded 45117 primary data records. [2025-09-22T22:19:52.988540] [DEBUG] [LOCAL ] FIS: Loaded 53366 existing records from primary storage. [2025-09-22T22:19:52.993687] [INFO ] [MAIN ] FIS: Loaded 53366 primary data records. [2025-09-22T22:19:53.513795] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:53.515775] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8193 primary records. [2025-09-22T22:19:53.516954] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-22T22:19:53.543402] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-09-22T22:19:53.543639] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-22T22:19:53.546034] [INFO ] [MAIN ] Derivative Progress: 691/2091 symbols completed. FINS took 1.0s. Estimated remaining: 9m 5s. Rate: 154.2 symbols/min [2025-09-22T22:19:53.558288] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:53.566684] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:53.568174] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45117 primary records. [2025-09-22T22:19:53.568614] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-22T22:19:53.594976] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-09-22T22:19:53.602878] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-22T22:19:53.621228] [INFO ] [MAIN ] Derivative Progress: 692/2091 symbols completed. FINV took 1.1s. Estimated remaining: 9m 4s. Rate: 154.4 symbols/min [2025-09-22T22:19:53.622742] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:53.632793] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53366 primary records. [2025-09-22T22:19:53.632953] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-22T22:19:53.622859] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:53.666510] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-09-22T22:19:53.664716] [DEBUG] [LOCAL ] FIX: Loaded 30683 existing records from primary storage. [2025-09-22T22:19:53.666859] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-22T22:19:53.666782] [INFO ] [MAIN ] FIX: Loaded 30683 primary data records. [2025-09-22T22:19:53.676152] [INFO ] [MAIN ] Derivative Progress: 693/2091 symbols completed. FIS took 1.2s. Estimated remaining: 9m 3s. Rate: 154.6 symbols/min [2025-09-22T22:19:53.693596] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:53.773033] [DEBUG] [LOCAL ] FLC: Loaded 5602 existing records from primary storage. [2025-09-22T22:19:53.792022] [INFO ] [MAIN ] FLC: Loaded 5602 primary data records. [2025-09-22T22:19:54.469033] [DEBUG] [LOCAL ] FLG: Loaded 53331 existing records from primary storage. [2025-09-22T22:19:54.470071] [INFO ] [MAIN ] FLG: Loaded 53331 primary data records. [2025-09-22T22:19:54.810270] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:54.811389] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 30683 primary records. [2025-09-22T22:19:54.811631] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-22T22:19:54.827253] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:54.840229] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5602 primary records. [2025-09-22T22:19:54.840617] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-22T22:19:54.853248] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-09-22T22:19:54.853486] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-22T22:19:54.857360] [INFO ] [MAIN ] Derivative Progress: 694/2091 symbols completed. FIX took 1.3s. Estimated remaining: 9m 4s. Rate: 154.2 symbols/min [2025-09-22T22:19:54.860469] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:54.866021] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-09-22T22:19:54.866229] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-22T22:19:54.868895] [INFO ] [MAIN ] Derivative Progress: 695/2091 symbols completed. FLC took 1.2s. Estimated remaining: 9m 3s. Rate: 154.4 symbols/min [2025-09-22T22:19:54.869634] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:54.887808] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:54.888633] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53331 primary records. [2025-09-22T22:19:54.888799] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-22T22:19:54.909170] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-09-22T22:19:54.912562] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-22T22:19:54.915165] [INFO ] [MAIN ] Derivative Progress: 696/2091 symbols completed. FLG took 1.2s. Estimated remaining: 9m 2s. Rate: 154.6 symbols/min [2025-09-22T22:19:54.915466] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:54.941410] [DEBUG] [LOCAL ] FLNG: Loaded 34117 existing records from primary storage. [2025-09-22T22:19:54.941739] [INFO ] [MAIN ] FLNG: Loaded 34117 primary data records. [2025-09-22T22:19:55.160183] [DEBUG] [LOCAL ] FLO: Loaded 51894 existing records from primary storage. [2025-09-22T22:19:55.165628] [INFO ] [MAIN ] FLO: Loaded 51894 primary data records. [2025-09-22T22:19:55.448550] [DEBUG] [LOCAL ] FLR: Loaded 53122 existing records from primary storage. [2025-09-22T22:19:55.480621] [INFO ] [MAIN ] FLR: Loaded 53122 primary data records. [2025-09-22T22:19:56.034120] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:56.035378] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 34117 primary records. [2025-09-22T22:19:56.035612] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-22T22:19:56.056616] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-09-22T22:19:56.057083] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-22T22:19:56.059290] [INFO ] [MAIN ] Derivative Progress: 697/2091 symbols completed. FLNG took 1.2s. Estimated remaining: 9m 3s. Rate: 154.1 symbols/min [2025-09-22T22:19:56.059927] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:56.073381] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:56.074339] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51894 primary records. [2025-09-22T22:19:56.074799] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-22T22:19:56.092053] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-09-22T22:19:56.093574] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-22T22:19:56.095769] [INFO ] [MAIN ] Derivative Progress: 698/2091 symbols completed. FLO took 1.2s. Estimated remaining: 9m 2s. Rate: 154.3 symbols/min [2025-09-22T22:19:56.096171] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:56.110564] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:56.111919] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53122 primary records. [2025-09-22T22:19:56.112121] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-22T22:19:56.131037] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-09-22T22:19:56.131213] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-22T22:19:56.135040] [INFO ] [MAIN ] Derivative Progress: 699/2091 symbols completed. FLR took 1.2s. Estimated remaining: 9m 0s. Rate: 154.5 symbols/min [2025-09-22T22:19:56.135591] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:56.194080] [DEBUG] [LOCAL ] FLS: Loaded 50181 existing records from primary storage. [2025-09-22T22:19:56.194403] [INFO ] [MAIN ] FLS: Loaded 50181 primary data records. [2025-09-22T22:19:56.280999] [DEBUG] [LOCAL ] FLXR: Loaded 19779 existing records from primary storage. [2025-09-22T22:19:56.312862] [INFO ] [MAIN ] FLXR: Loaded 19779 primary data records. [2025-09-22T22:19:56.356358] [DEBUG] [LOCAL ] FLUT: Loaded 50933 existing records from primary storage. [2025-09-22T22:19:56.397210] [INFO ] [MAIN ] FLUT: Loaded 50933 primary data records. [2025-09-22T22:19:57.196289] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:57.197228] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50181 primary records. [2025-09-22T22:19:57.197499] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-22T22:19:57.217190] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-09-22T22:19:57.217684] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-22T22:19:57.233533] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:57.233143] [INFO ] [MAIN ] Derivative Progress: 700/2091 symbols completed. FLS took 1.2s. Estimated remaining: 9m 1s. Rate: 154.1 symbols/min [2025-09-22T22:19:57.234589] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:57.234392] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50933 primary records. [2025-09-22T22:19:57.235005] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-22T22:19:57.260282] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:57.264516] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-09-22T22:19:57.264769] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-22T22:19:57.267719] [INFO ] [MAIN ] Derivative Progress: 701/2091 symbols completed. FLUT took 1.2s. Estimated remaining: 9m 0s. Rate: 154.3 symbols/min [2025-09-22T22:19:57.268841] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 19779 primary records. [2025-09-22T22:19:57.268960] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:57.269215] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-22T22:19:57.285181] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-09-22T22:19:57.286577] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-22T22:19:57.288986] [INFO ] [MAIN ] Derivative Progress: 702/2091 symbols completed. FLXR took 1.2s. Estimated remaining: 8m 59s. Rate: 154.5 symbols/min [2025-09-22T22:19:57.290529] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:57.294499] [DEBUG] [LOCAL ] FMN: Loaded 6172 existing records from primary storage. [2025-09-22T22:19:57.294669] [INFO ] [MAIN ] FMN: Loaded 6172 primary data records. [2025-09-22T22:19:57.653384] [DEBUG] [LOCAL ] FMC: Loaded 51794 existing records from primary storage. [2025-09-22T22:19:57.654335] [INFO ] [MAIN ] FMC: Loaded 51794 primary data records. [2025-09-22T22:19:57.655504] [DEBUG] [LOCAL ] FMS: Loaded 30396 existing records from primary storage. [2025-09-22T22:19:57.661446] [INFO ] [MAIN ] FMS: Loaded 30396 primary data records. [2025-09-22T22:19:58.357475] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:58.358430] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 6172 primary records. [2025-09-22T22:19:58.358530] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-22T22:19:58.377790] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-09-22T22:19:58.378122] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-22T22:19:58.380787] [INFO ] [MAIN ] Derivative Progress: 703/2091 symbols completed. FMN took 1.1s. Estimated remaining: 9m 0s. Rate: 154.1 symbols/min [2025-09-22T22:19:58.401002] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:58.401877] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51794 primary records. [2025-09-22T22:19:58.401959] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-22T22:19:58.433087] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:58.432922] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-09-22T22:19:58.433225] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-22T22:19:58.433917] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30396 primary records. [2025-09-22T22:19:58.436147] [INFO ] [MAIN ] Derivative Progress: 704/2091 symbols completed. FMC took 1.2s. Estimated remaining: 8m 59s. Rate: 154.3 symbols/min [2025-09-22T22:19:58.434020] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-22T22:19:58.451694] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-09-22T22:19:58.451755] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-22T22:19:58.454659] [INFO ] [MAIN ] Derivative Progress: 705/2091 symbols completed. FMS took 1.2s. Estimated remaining: 8m 58s. Rate: 154.5 symbols/min [2025-09-22T22:19:58.455399] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:58.455329] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:58.455630] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:58.459966] [DEBUG] [LOCAL ] FMY: Loaded 1383 existing records from primary storage. [2025-09-22T22:19:58.460126] [INFO ] [MAIN ] FMY: Loaded 1383 primary data records. [2025-09-22T22:19:58.838497] [DEBUG] [LOCAL ] FMX: Loaded 40726 existing records from primary storage. [2025-09-22T22:19:58.840220] [INFO ] [MAIN ] FMX: Loaded 40726 primary data records. [2025-09-22T22:19:58.861740] [DEBUG] [LOCAL ] FN: Loaded 39605 existing records from primary storage. [2025-09-22T22:19:58.872598] [INFO ] [MAIN ] FN: Loaded 39605 primary data records. [2025-09-22T22:19:59.476960] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:59.478153] [INFO ] [MAIN ] FMY: Generated 1794 derivative records from 1383 primary records. [2025-09-22T22:19:59.479337] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-22T22:19:59.494850] [DEBUG] [LOCAL ] FMY: Derivative data saved (1794 records). [2025-09-22T22:19:59.495103] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-22T22:19:59.497604] [INFO ] [MAIN ] Derivative Progress: 706/2091 symbols completed. FMY took 1.0s. Estimated remaining: 8m 59s. Rate: 154.2 symbols/min [2025-09-22T22:19:59.498363] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:59.517430] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:59.519803] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 39605 primary records. [2025-09-22T22:19:59.520013] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-22T22:19:59.549443] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-09-22T22:19:59.550028] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:19:59.550186] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-22T22:19:59.553555] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40726 primary records. [2025-09-22T22:19:59.552465] [INFO ] [MAIN ] Derivative Progress: 707/2091 symbols completed. FN took 1.1s. Estimated remaining: 8m 58s. Rate: 154.4 symbols/min [2025-09-22T22:19:59.553852] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-22T22:19:59.554107] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:59.571691] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-09-22T22:19:59.571907] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-22T22:19:59.574736] [INFO ] [MAIN ] Derivative Progress: 708/2091 symbols completed. FMX took 1.1s. Estimated remaining: 8m 57s. Rate: 154.6 symbols/min [2025-09-22T22:19:59.575144] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:19:59.645444] [DEBUG] [LOCAL ] FNB: Loaded 52454 existing records from primary storage. [2025-09-22T22:19:59.646713] [INFO ] [MAIN ] FNB: Loaded 52454 primary data records. [2025-09-22T22:19:59.647498] [DEBUG] [LOCAL ] FND: Loaded 52159 existing records from primary storage. [2025-09-22T22:19:59.679672] [INFO ] [MAIN ] FND: Loaded 52159 primary data records. [2025-09-22T22:20:00.062144] [DEBUG] [LOCAL ] FNF: Loaded 49257 existing records from primary storage. [2025-09-22T22:20:00.062306] [INFO ] [MAIN ] FNF: Loaded 49257 primary data records. [2025-09-22T22:20:00.679169] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:00.694092] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52454 primary records. [2025-09-22T22:20:00.693253] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:00.695034] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52159 primary records. [2025-09-22T22:20:00.695111] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-22T22:20:00.695836] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-22T22:20:00.729428] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-09-22T22:20:00.729684] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-22T22:20:00.729596] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-09-22T22:20:00.732043] [INFO ] [MAIN ] Derivative Progress: 709/2091 symbols completed. FND took 1.2s. Estimated remaining: 8m 58s. Rate: 154.1 symbols/min [2025-09-22T22:20:00.732316] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-22T22:20:00.735431] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:00.735165] [INFO ] [MAIN ] Derivative Progress: 710/2091 symbols completed. FNB took 1.2s. Estimated remaining: 8m 57s. Rate: 154.3 symbols/min [2025-09-22T22:20:00.736591] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:00.754244] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:00.758666] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 49257 primary records. [2025-09-22T22:20:00.758837] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-22T22:20:00.776529] [DEBUG] [LOCAL ] FOA: Loaded 13132 existing records from primary storage. [2025-09-22T22:20:00.779708] [INFO ] [MAIN ] FOA: Loaded 13132 primary data records. [2025-09-22T22:20:00.780108] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-09-22T22:20:00.801048] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-22T22:20:00.826515] [INFO ] [MAIN ] Derivative Progress: 711/2091 symbols completed. FNF took 1.3s. Estimated remaining: 8m 56s. Rate: 154.5 symbols/min [2025-09-22T22:20:00.853866] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:01.000567] [DEBUG] [LOCAL ] FOF: Loaded 8383 existing records from primary storage. [2025-09-22T22:20:01.114718] [INFO ] [MAIN ] FOF: Loaded 8383 primary data records. [2025-09-22T22:20:01.130451] [DEBUG] [LOCAL ] FNV: Loaded 46472 existing records from primary storage. [2025-09-22T22:20:01.159405] [INFO ] [MAIN ] FNV: Loaded 46472 primary data records. [2025-09-22T22:20:01.884894] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:01.886173] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13132 primary records. [2025-09-22T22:20:01.888029] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-22T22:20:01.909007] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-09-22T22:20:01.909232] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-22T22:20:01.911475] [INFO ] [MAIN ] Derivative Progress: 712/2091 symbols completed. FOA took 1.2s. Estimated remaining: 8m 57s. Rate: 154.1 symbols/min [2025-09-22T22:20:01.912174] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:01.936776] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:01.938166] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8383 primary records. [2025-09-22T22:20:01.938339] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-22T22:20:01.986084] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-09-22T22:20:01.987442] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-22T22:20:01.991300] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:01.990695] [INFO ] [MAIN ] Derivative Progress: 713/2091 symbols completed. FOF took 1.1s. Estimated remaining: 8m 56s. Rate: 154.3 symbols/min [2025-09-22T22:20:01.993329] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46472 primary records. [2025-09-22T22:20:01.993762] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-22T22:20:01.991934] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:02.011086] [DEBUG] [LOCAL ] FOR: Loaded 20202 existing records from primary storage. [2025-09-22T22:20:02.023420] [INFO ] [MAIN ] FOR: Loaded 20202 primary data records. [2025-09-22T22:20:02.103371] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-09-22T22:20:02.120596] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-22T22:20:02.151142] [INFO ] [MAIN ] Derivative Progress: 714/2091 symbols completed. FNV took 1.4s. Estimated remaining: 8m 55s. Rate: 154.4 symbols/min [2025-09-22T22:20:02.168819] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:02.394090] [DEBUG] [LOCAL ] FPF: Loaded 17594 existing records from primary storage. [2025-09-22T22:20:02.396485] [DEBUG] [LOCAL ] FOUR: Loaded 49522 existing records from primary storage. [2025-09-22T22:20:02.397030] [INFO ] [MAIN ] FOUR: Loaded 49522 primary data records. [2025-09-22T22:20:02.397343] [INFO ] [MAIN ] FPF: Loaded 17594 primary data records. [2025-09-22T22:20:03.421446] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:03.422301] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 20202 primary records. [2025-09-22T22:20:03.423047] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-22T22:20:03.442065] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-09-22T22:20:03.442967] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-22T22:20:03.445104] [INFO ] [MAIN ] Derivative Progress: 715/2091 symbols completed. FOR took 1.5s. Estimated remaining: 8m 56s. Rate: 153.9 symbols/min [2025-09-22T22:20:03.445802] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:03.470216] [DEBUG] [LOCAL ] FPH: Loaded 19781 existing records from primary storage. [2025-09-22T22:20:03.471919] [INFO ] [MAIN ] FPH: Loaded 19781 primary data records. [2025-09-22T22:20:03.517860] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:03.552114] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 17594 primary records. [2025-09-22T22:20:03.583384] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:03.577859] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-22T22:20:03.611591] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49522 primary records. [2025-09-22T22:20:03.617948] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-22T22:20:03.722165] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-09-22T22:20:03.735093] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-22T22:20:03.818047] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-09-22T22:20:03.738428] [INFO ] [MAIN ] Derivative Progress: 716/2091 symbols completed. FPF took 1.6s. Estimated remaining: 8m 56s. Rate: 154.0 symbols/min [2025-09-22T22:20:03.866074] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-22T22:20:03.879822] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:03.882915] [INFO ] [MAIN ] Derivative Progress: 717/2091 symbols completed. FOUR took 1.9s. Estimated remaining: 8m 55s. Rate: 154.1 symbols/min [2025-09-22T22:20:03.883518] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:03.943110] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:03.945337] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19781 primary records. [2025-09-22T22:20:03.946127] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-22T22:20:03.946033] [DEBUG] [LOCAL ] FPI: Loaded 31107 existing records from primary storage. [2025-09-22T22:20:03.946306] [INFO ] [MAIN ] FPI: Loaded 31107 primary data records. [2025-09-22T22:20:04.082216] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-09-22T22:20:04.082386] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-22T22:20:04.085560] [INFO ] [MAIN ] Derivative Progress: 718/2091 symbols completed. FPH took 0.6s. Estimated remaining: 8m 54s. Rate: 154.2 symbols/min [2025-09-22T22:20:04.082118] [DEBUG] [LOCAL ] FR: Loaded 46677 existing records from primary storage. [2025-09-22T22:20:04.106845] [INFO ] [MAIN ] FR: Loaded 46677 primary data records. [2025-09-22T22:20:04.640344] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:04.641287] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31107 primary records. [2025-09-22T22:20:04.641444] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-22T22:20:04.660293] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-09-22T22:20:04.660567] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-22T22:20:04.663771] [INFO ] [MAIN ] Derivative Progress: 719/2091 symbols completed. FPI took 0.8s. Estimated remaining: 8m 54s. Rate: 154.1 symbols/min [2025-09-22T22:20:04.678703] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:04.679352] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46677 primary records. [2025-09-22T22:20:04.679439] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-22T22:20:04.694832] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-09-22T22:20:04.694917] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-22T22:20:04.697441] [INFO ] [MAIN ] Derivative Progress: 720/2091 symbols completed. FR took 0.8s. Estimated remaining: 8m 53s. Rate: 154.3 symbols/min [2025-09-22T22:20:04.697974] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:04.698207] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:04.698139] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:04.720131] [DEBUG] [LOCAL ] FRA: Loaded 14592 existing records from primary storage. [2025-09-22T22:20:04.720399] [INFO ] [MAIN ] FRA: Loaded 14592 primary data records. [2025-09-22T22:20:04.803059] [DEBUG] [LOCAL ] FRGE: Loaded 18734 existing records from primary storage. [2025-09-22T22:20:04.838390] [INFO ] [MAIN ] FRGE: Loaded 18734 primary data records. [2025-09-22T22:20:05.271129] [DEBUG] [LOCAL ] FRO: Loaded 51881 existing records from primary storage. [2025-09-22T22:20:05.301879] [INFO ] [MAIN ] FRO: Loaded 51881 primary data records. [2025-09-22T22:20:05.807290] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:05.808620] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14592 primary records. [2025-09-22T22:20:05.809030] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-22T22:20:05.827977] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-09-22T22:20:05.831826] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-22T22:20:05.834309] [INFO ] [MAIN ] Derivative Progress: 721/2091 symbols completed. FRA took 1.1s. Estimated remaining: 8m 54s. Rate: 153.9 symbols/min [2025-09-22T22:20:05.834948] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:05.854770] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:05.856430] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 18734 primary records. [2025-09-22T22:20:05.856701] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-22T22:20:05.876939] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-09-22T22:20:05.878078] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-22T22:20:05.881546] [INFO ] [MAIN ] Derivative Progress: 722/2091 symbols completed. FRGE took 1.2s. Estimated remaining: 8m 53s. Rate: 154.1 symbols/min [2025-09-22T22:20:05.882862] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:05.897573] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:05.898354] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51881 primary records. [2025-09-22T22:20:05.898461] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-22T22:20:05.925278] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-09-22T22:20:05.925477] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-22T22:20:05.927791] [INFO ] [MAIN ] Derivative Progress: 723/2091 symbols completed. FRO took 1.2s. Estimated remaining: 8m 52s. Rate: 154.3 symbols/min [2025-09-22T22:20:05.928266] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:05.944826] [DEBUG] [LOCAL ] FRT: Loaded 42371 existing records from primary storage. [2025-09-22T22:20:05.945045] [INFO ] [MAIN ] FRT: Loaded 42371 primary data records. [2025-09-22T22:20:06.118981] [DEBUG] [LOCAL ] FSCO: Loaded 36753 existing records from primary storage. [2025-09-22T22:20:06.178073] [INFO ] [MAIN ] FSCO: Loaded 36753 primary data records. [2025-09-22T22:20:06.424075] [DEBUG] [LOCAL ] FSK: Loaded 49383 existing records from primary storage. [2025-09-22T22:20:06.437946] [INFO ] [MAIN ] FSK: Loaded 49383 primary data records. [2025-09-22T22:20:06.988882] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:06.990372] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 42371 primary records. [2025-09-22T22:20:06.990555] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-22T22:20:07.008921] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-09-22T22:20:07.009754] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-22T22:20:07.011945] [INFO ] [MAIN ] Derivative Progress: 724/2091 symbols completed. FRT took 1.2s. Estimated remaining: 8m 53s. Rate: 153.9 symbols/min [2025-09-22T22:20:07.013277] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:07.030540] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:07.031427] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 36753 primary records. [2025-09-22T22:20:07.031600] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-22T22:20:07.049786] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-09-22T22:20:07.051634] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-22T22:20:07.054231] [INFO ] [MAIN ] Derivative Progress: 725/2091 symbols completed. FSCO took 1.2s. Estimated remaining: 8m 52s. Rate: 154.1 symbols/min [2025-09-22T22:20:07.054721] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:07.071721] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:07.072577] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49383 primary records. [2025-09-22T22:20:07.072777] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-22T22:20:07.091503] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-09-22T22:20:07.104618] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-22T22:20:07.107064] [INFO ] [MAIN ] Derivative Progress: 726/2091 symbols completed. FSK took 1.2s. Estimated remaining: 8m 51s. Rate: 154.3 symbols/min [2025-09-22T22:20:07.107573] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:07.128145] [DEBUG] [LOCAL ] FSLY: Loaded 51270 existing records from primary storage. [2025-09-22T22:20:07.128401] [INFO ] [MAIN ] FSLY: Loaded 51270 primary data records. [2025-09-22T22:20:07.514856] [DEBUG] [LOCAL ] FSS: Loaded 34636 existing records from primary storage. [2025-09-22T22:20:07.530407] [DEBUG] [LOCAL ] FSM: Loaded 53288 existing records from primary storage. [2025-09-22T22:20:07.530283] [INFO ] [MAIN ] FSS: Loaded 34636 primary data records. [2025-09-22T22:20:07.530779] [INFO ] [MAIN ] FSM: Loaded 53288 primary data records. [2025-09-22T22:20:08.172888] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:08.173701] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51270 primary records. [2025-09-22T22:20:08.173995] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-22T22:20:08.191209] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-09-22T22:20:08.191450] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-22T22:20:08.194449] [INFO ] [MAIN ] Derivative Progress: 727/2091 symbols completed. FSLY took 1.2s. Estimated remaining: 8m 52s. Rate: 153.9 symbols/min [2025-09-22T22:20:08.195171] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:08.216482] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:08.232329] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:08.232046] [DEBUG] [LOCAL ] FT: Loaded 6280 existing records from primary storage. [2025-09-22T22:20:08.233115] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53288 primary records. [2025-09-22T22:20:08.233898] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 34636 primary records. [2025-09-22T22:20:08.233290] [INFO ] [MAIN ] FT: Loaded 6280 primary data records. [2025-09-22T22:20:08.233226] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-22T22:20:08.239599] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-22T22:20:08.320424] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-09-22T22:20:08.340134] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-22T22:20:08.342852] [INFO ] [MAIN ] Derivative Progress: 728/2091 symbols completed. FSM took 1.3s. Estimated remaining: 8m 51s. Rate: 154.0 symbols/min [2025-09-22T22:20:08.348796] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:08.471839] [DEBUG] [LOCAL ] FTHY: Loaded 11687 existing records from primary storage. [2025-09-22T22:20:08.471456] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-09-22T22:20:08.494917] [INFO ] [MAIN ] FTHY: Loaded 11687 primary data records. [2025-09-22T22:20:08.500925] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-22T22:20:08.521316] [INFO ] [MAIN ] Derivative Progress: 729/2091 symbols completed. FSS took 1.4s. Estimated remaining: 8m 50s. Rate: 154.1 symbols/min [2025-09-22T22:20:08.688554] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:09.000715] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:09.002339] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6280 primary records. [2025-09-22T22:20:09.016906] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-22T22:20:09.031923] [DEBUG] [LOCAL ] FTI: Loaded 53303 existing records from primary storage. [2025-09-22T22:20:09.032316] [INFO ] [MAIN ] FTI: Loaded 53303 primary data records. [2025-09-22T22:20:09.140334] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-09-22T22:20:09.165350] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-22T22:20:09.165247] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:09.166470] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 11687 primary records. [2025-09-22T22:20:09.185428] [INFO ] [MAIN ] Derivative Progress: 730/2091 symbols completed. FT took 1.0s. Estimated remaining: 8m 50s. Rate: 154.0 symbols/min [2025-09-22T22:20:09.177637] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-22T22:20:09.222997] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:09.391435] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-09-22T22:20:09.391592] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-22T22:20:09.394523] [INFO ] [MAIN ] Derivative Progress: 731/2091 symbols completed. FTHY took 1.0s. Estimated remaining: 8m 50s. Rate: 154.1 symbols/min [2025-09-22T22:20:09.394897] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:09.433521] [DEBUG] [LOCAL ] FTK: Loaded 32110 existing records from primary storage. [2025-09-22T22:20:09.434015] [INFO ] [MAIN ] FTK: Loaded 32110 primary data records. [2025-09-22T22:20:09.472505] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:09.505456] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53303 primary records. [2025-09-22T22:20:09.515920] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-22T22:20:09.594227] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-09-22T22:20:09.598974] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-22T22:20:09.601289] [INFO ] [MAIN ] Derivative Progress: 732/2091 symbols completed. FTI took 0.9s. Estimated remaining: 8m 49s. Rate: 154.2 symbols/min [2025-09-22T22:20:09.658126] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:09.674969] [DEBUG] [LOCAL ] FTS: Loaded 42110 existing records from primary storage. [2025-09-22T22:20:09.686451] [INFO ] [MAIN ] FTS: Loaded 42110 primary data records. [2025-09-22T22:20:10.241455] [DEBUG] [LOCAL ] FTV: Loaded 52917 existing records from primary storage. [2025-09-22T22:20:10.242136] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:10.244231] [INFO ] [MAIN ] FTV: Loaded 52917 primary data records. [2025-09-22T22:20:10.245214] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32110 primary records. [2025-09-22T22:20:10.267426] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-22T22:20:10.371229] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-09-22T22:20:10.372185] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-22T22:20:10.385818] [INFO ] [MAIN ] Derivative Progress: 733/2091 symbols completed. FTK took 1.2s. Estimated remaining: 8m 49s. Rate: 154.0 symbols/min [2025-09-22T22:20:10.593500] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:10.609938] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42110 primary records. [2025-09-22T22:20:10.610081] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-22T22:20:10.632137] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-09-22T22:20:10.632403] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-22T22:20:10.635479] [INFO ] [MAIN ] Derivative Progress: 734/2091 symbols completed. FTS took 1.2s. Estimated remaining: 8m 49s. Rate: 154.0 symbols/min [2025-09-22T22:20:10.656518] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:10.657199] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52917 primary records. [2025-09-22T22:20:10.657262] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-22T22:20:10.672671] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-09-22T22:20:10.672777] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-22T22:20:10.674852] [INFO ] [MAIN ] Derivative Progress: 735/2091 symbols completed. FTV took 1.1s. Estimated remaining: 8m 48s. Rate: 154.2 symbols/min [2025-09-22T22:20:10.675729] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:10.676082] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:10.676003] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:10.681259] [DEBUG] [LOCAL ] FTWO: Loaded 1779 existing records from primary storage. [2025-09-22T22:20:10.681533] [INFO ] [MAIN ] FTWO: Loaded 1779 primary data records. [2025-09-22T22:20:11.040591] [DEBUG] [LOCAL ] FUL: Loaded 33021 existing records from primary storage. [2025-09-22T22:20:11.055926] [INFO ] [MAIN ] FUL: Loaded 33021 primary data records. [2025-09-22T22:20:11.173869] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-09-22T22:20:11.186802] [INFO ] [MAIN ] FUBO: Loaded 53700 primary data records. [2025-09-22T22:20:11.805739] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:20:11.807617] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1779 primary records. [2025-09-22T22:20:11.807984] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-22T22:20:11.827464] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-09-22T22:20:11.827974] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-22T22:20:11.830516] [INFO ] [MAIN ] Derivative Progress: 736/2091 symbols completed. FTWO took 1.2s. Estimated remaining: 8m 49s. Rate: 153.8 symbols/min [2025-09-22T22:20:11.831289] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:11.851252] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:11.852383] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 33021 primary records. [2025-09-22T22:20:11.852624] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-22T22:20:11.869279] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-09-22T22:20:11.869938] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-22T22:20:11.873042] [INFO ] [MAIN ] Derivative Progress: 737/2091 symbols completed. FUL took 1.2s. Estimated remaining: 8m 48s. Rate: 154.0 symbols/min [2025-09-22T22:20:11.874099] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:11.888120] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:11.888873] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53700 primary records. [2025-09-22T22:20:11.889068] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-22T22:20:11.923366] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-09-22T22:20:11.923547] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-22T22:20:11.925862] [INFO ] [MAIN ] Derivative Progress: 738/2091 symbols completed. FUBO took 1.3s. Estimated remaining: 8m 47s. Rate: 154.2 symbols/min [2025-09-22T22:20:11.926325] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:11.936871] [DEBUG] [LOCAL ] FVR: Loaded 22151 existing records from primary storage. [2025-09-22T22:20:11.937249] [INFO ] [MAIN ] FVR: Loaded 22151 primary data records. [2025-09-22T22:20:12.011142] [DEBUG] [LOCAL ] FUN: Loaded 51566 existing records from primary storage. [2025-09-22T22:20:12.054679] [INFO ] [MAIN ] FUN: Loaded 51566 primary data records. [2025-09-22T22:20:12.433126] [DEBUG] [LOCAL ] FVRR: Loaded 40203 existing records from primary storage. [2025-09-22T22:20:12.466023] [INFO ] [MAIN ] FVRR: Loaded 40203 primary data records. [2025-09-22T22:20:12.954437] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:20:12.968966] [INFO ] [MAIN ] FVR: Generated 1793 derivative records from 22151 primary records. [2025-09-22T22:20:12.969543] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:12.971024] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51566 primary records. [2025-09-22T22:20:12.971801] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-22T22:20:12.969831] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-22T22:20:13.006296] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-09-22T22:20:13.006450] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-22T22:20:13.006172] [DEBUG] [LOCAL ] FVR: Derivative data saved (1793 records). [2025-09-22T22:20:13.006840] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-22T22:20:13.009307] [INFO ] [MAIN ] Derivative Progress: 739/2091 symbols completed. FUN took 1.2s. Estimated remaining: 8m 47s. Rate: 153.8 symbols/min [2025-09-22T22:20:13.011975] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:13.013015] [INFO ] [MAIN ] Derivative Progress: 740/2091 symbols completed. FVR took 1.1s. Estimated remaining: 8m 46s. Rate: 154.0 symbols/min [2025-09-22T22:20:13.014927] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:13.029182] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:13.030099] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40203 primary records. [2025-09-22T22:20:13.030291] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-22T22:20:13.032439] [DEBUG] [LOCAL ] FXED: Loaded 1217 existing records from primary storage. [2025-09-22T22:20:13.032573] [INFO ] [MAIN ] FXED: Loaded 1217 primary data records. [2025-09-22T22:20:13.160695] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-09-22T22:20:13.172557] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-22T22:20:13.175217] [INFO ] [MAIN ] Derivative Progress: 741/2091 symbols completed. FVRR took 1.2s. Estimated remaining: 8m 45s. Rate: 154.1 symbols/min [2025-09-22T22:20:13.176043] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:13.404484] [DEBUG] [LOCAL ] G: Loaded 49754 existing records from primary storage. [2025-09-22T22:20:13.405075] [INFO ] [MAIN ] G: Loaded 49754 primary data records. [2025-09-22T22:20:13.448994] [DEBUG] [LOCAL ] GAB: Loaded 27907 existing records from primary storage. [2025-09-22T22:20:13.474757] [INFO ] [MAIN ] GAB: Loaded 27907 primary data records. [2025-09-22T22:20:14.093411] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:14.095512] [INFO ] [MAIN ] FXED: Generated 1794 derivative records from 1217 primary records. [2025-09-22T22:20:14.095967] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-22T22:20:14.113933] [DEBUG] [LOCAL ] FXED: Derivative data saved (1794 records). [2025-09-22T22:20:14.115012] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-22T22:20:14.117893] [INFO ] [MAIN ] Derivative Progress: 742/2091 symbols completed. FXED took 1.1s. Estimated remaining: 8m 46s. Rate: 153.8 symbols/min [2025-09-22T22:20:14.118330] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:14.126337] [DEBUG] [LOCAL ] GAM: Loaded 4217 existing records from primary storage. [2025-09-22T22:20:14.126576] [INFO ] [MAIN ] GAM: Loaded 4217 primary data records. [2025-09-22T22:20:14.281365] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:14.292401] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49754 primary records. [2025-09-22T22:20:14.324121] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:14.348887] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27907 primary records. [2025-09-22T22:20:14.349180] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-22T22:20:14.349048] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-22T22:20:14.504410] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-09-22T22:20:14.503385] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-09-22T22:20:14.504552] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-22T22:20:14.507589] [INFO ] [MAIN ] Derivative Progress: 743/2091 symbols completed. G took 1.5s. Estimated remaining: 8m 46s. Rate: 153.8 symbols/min [2025-09-22T22:20:14.505202] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-22T22:20:14.508383] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:14.511122] [INFO ] [MAIN ] Derivative Progress: 744/2091 symbols completed. GAB took 1.3s. Estimated remaining: 8m 45s. Rate: 154.1 symbols/min [2025-09-22T22:20:14.511689] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:14.541249] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:14.542051] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 4217 primary records. [2025-09-22T22:20:14.542181] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-22T22:20:14.557467] [DEBUG] [LOCAL ] GATX: Loaded 18149 existing records from primary storage. [2025-09-22T22:20:14.563947] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-09-22T22:20:14.564054] [INFO ] [MAIN ] GATX: Loaded 18149 primary data records. [2025-09-22T22:20:14.564255] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-22T22:20:14.577942] [INFO ] [MAIN ] Derivative Progress: 745/2091 symbols completed. GAM took 0.5s. Estimated remaining: 8m 44s. Rate: 154.2 symbols/min [2025-09-22T22:20:14.596434] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:14.798293] [DEBUG] [LOCAL ] GBAB: Loaded 13020 existing records from primary storage. [2025-09-22T22:20:14.814426] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-22T22:20:14.931245] [INFO ] [MAIN ] GBAB: Loaded 13020 primary data records. [2025-09-22T22:20:14.931151] [INFO ] [MAIN ] GAP: Loaded 53655 primary data records. [2025-09-22T22:20:15.626925] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:15.628183] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18149 primary records. [2025-09-22T22:20:15.628507] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-22T22:20:15.646778] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-09-22T22:20:15.647305] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-22T22:20:15.649492] [INFO ] [MAIN ] Derivative Progress: 746/2091 symbols completed. GATX took 1.1s. Estimated remaining: 8m 44s. Rate: 153.9 symbols/min [2025-09-22T22:20:15.650115] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:15.667041] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:15.668113] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53655 primary records. [2025-09-22T22:20:15.668317] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-22T22:20:15.687544] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-09-22T22:20:15.695337] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-22T22:20:15.703114] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:15.704014] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 13020 primary records. [2025-09-22T22:20:15.702756] [INFO ] [MAIN ] Derivative Progress: 747/2091 symbols completed. GAP took 1.2s. Estimated remaining: 8m 44s. Rate: 154.0 symbols/min [2025-09-22T22:20:15.704134] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-22T22:20:15.704371] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:15.730435] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-09-22T22:20:15.730591] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-22T22:20:15.732806] [INFO ] [MAIN ] Derivative Progress: 748/2091 symbols completed. GBAB took 1.1s. Estimated remaining: 8m 42s. Rate: 154.2 symbols/min [2025-09-22T22:20:15.750960] [DEBUG] [LOCAL ] GBCI: Loaded 40084 existing records from primary storage. [2025-09-22T22:20:15.751125] [INFO ] [MAIN ] GBCI: Loaded 40084 primary data records. [2025-09-22T22:20:15.922016] [DEBUG] [LOCAL ] GBTG: Loaded 40434 existing records from primary storage. [2025-09-22T22:20:15.945816] [INFO ] [MAIN ] GBTG: Loaded 40434 primary data records. [2025-09-22T22:20:16.387442] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:16.388315] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40084 primary records. [2025-09-22T22:20:16.388393] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-22T22:20:16.405220] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-09-22T22:20:16.405407] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-22T22:20:16.407503] [INFO ] [MAIN ] Derivative Progress: 749/2091 symbols completed. GBCI took 0.8s. Estimated remaining: 8m 43s. Rate: 154.1 symbols/min [2025-09-22T22:20:16.423553] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:16.424106] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40434 primary records. [2025-09-22T22:20:16.424166] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-22T22:20:16.439302] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-09-22T22:20:16.439362] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-22T22:20:16.441610] [INFO ] [MAIN ] Derivative Progress: 750/2091 symbols completed. GBTG took 0.7s. Estimated remaining: 8m 42s. Rate: 154.3 symbols/min [2025-09-22T22:20:16.442319] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:16.442254] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:16.442559] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:16.470256] [DEBUG] [LOCAL ] GCO: Loaded 25807 existing records from primary storage. [2025-09-22T22:20:16.476963] [INFO ] [MAIN ] GCO: Loaded 25807 primary data records. [2025-09-22T22:20:16.622194] [DEBUG] [LOCAL ] GBX: Loaded 29314 existing records from primary storage. [2025-09-22T22:20:16.638152] [DEBUG] [LOCAL ] GCI: Loaded 44231 existing records from primary storage. [2025-09-22T22:20:16.686695] [INFO ] [MAIN ] GCI: Loaded 44231 primary data records. [2025-09-22T22:20:16.659630] [INFO ] [MAIN ] GBX: Loaded 29314 primary data records. [2025-09-22T22:20:17.422890] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:17.423621] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 25807 primary records. [2025-09-22T22:20:17.423895] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-22T22:20:17.441566] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-09-22T22:20:17.442490] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-22T22:20:17.445213] [INFO ] [MAIN ] Derivative Progress: 751/2091 symbols completed. GCO took 1.0s. Estimated remaining: 8m 42s. Rate: 153.9 symbols/min [2025-09-22T22:20:17.445532] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:17.460721] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:17.462228] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44231 primary records. [2025-09-22T22:20:17.462325] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-22T22:20:17.475335] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:17.476200] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29314 primary records. [2025-09-22T22:20:17.491639] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-22T22:20:17.496427] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-09-22T22:20:17.496552] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-22T22:20:17.499037] [INFO ] [MAIN ] Derivative Progress: 752/2091 symbols completed. GCI took 1.1s. Estimated remaining: 8m 41s. Rate: 154.1 symbols/min [2025-09-22T22:20:17.511728] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:17.520830] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-09-22T22:20:17.521610] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-22T22:20:17.521407] [DEBUG] [LOCAL ] GCTS: Loaded 19736 existing records from primary storage. [2025-09-22T22:20:17.521865] [INFO ] [MAIN ] GCTS: Loaded 19736 primary data records. [2025-09-22T22:20:17.524211] [INFO ] [MAIN ] Derivative Progress: 753/2091 symbols completed. GBX took 1.1s. Estimated remaining: 8m 40s. Rate: 154.3 symbols/min [2025-09-22T22:20:17.524505] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:17.601875] [DEBUG] [LOCAL ] GCV: Loaded 7100 existing records from primary storage. [2025-09-22T22:20:17.614273] [INFO ] [MAIN ] GCV: Loaded 7100 primary data records. [2025-09-22T22:20:18.216403] [DEBUG] [LOCAL ] GD: Loaded 47324 existing records from primary storage. [2025-09-22T22:20:18.217230] [INFO ] [MAIN ] GD: Loaded 47324 primary data records. [2025-09-22T22:20:18.541146] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:18.543324] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 19736 primary records. [2025-09-22T22:20:18.543731] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-22T22:20:18.561746] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-09-22T22:20:18.561885] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-22T22:20:18.567821] [INFO ] [MAIN ] Derivative Progress: 754/2091 symbols completed. GCTS took 1.1s. Estimated remaining: 8m 41s. Rate: 154.0 symbols/min [2025-09-22T22:20:18.568165] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:18.582986] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:18.583718] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7100 primary records. [2025-09-22T22:20:18.584073] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-22T22:20:18.615557] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:18.617082] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 47324 primary records. [2025-09-22T22:20:18.617214] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-22T22:20:18.617318] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-09-22T22:20:18.618353] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-22T22:20:18.620828] [INFO ] [MAIN ] Derivative Progress: 755/2091 symbols completed. GCV took 1.1s. Estimated remaining: 8m 40s. Rate: 154.1 symbols/min [2025-09-22T22:20:18.629334] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:18.647457] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-09-22T22:20:18.648909] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-22T22:20:18.651176] [INFO ] [MAIN ] Derivative Progress: 756/2091 symbols completed. GD took 1.1s. Estimated remaining: 8m 39s. Rate: 154.3 symbols/min [2025-09-22T22:20:18.651666] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:18.654872] [DEBUG] [LOCAL ] GDIV: Loaded 3716 existing records from primary storage. [2025-09-22T22:20:18.655014] [INFO ] [MAIN ] GDIV: Loaded 3716 primary data records. [2025-09-22T22:20:18.767457] [DEBUG] [LOCAL ] GDDY: Loaded 49765 existing records from primary storage. [2025-09-22T22:20:18.789407] [DEBUG] [LOCAL ] GDO: Loaded 6067 existing records from primary storage. [2025-09-22T22:20:18.792926] [INFO ] [MAIN ] GDO: Loaded 6067 primary data records. [2025-09-22T22:20:18.792805] [INFO ] [MAIN ] GDDY: Loaded 49765 primary data records. [2025-09-22T22:20:19.677876] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:20:19.678977] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3716 primary records. [2025-09-22T22:20:19.679425] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-22T22:20:19.716306] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-09-22T22:20:19.716617] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:19.717575] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49765 primary records. [2025-09-22T22:20:19.717777] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-22T22:20:19.716853] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-22T22:20:19.727748] [INFO ] [MAIN ] Derivative Progress: 757/2091 symbols completed. GDIV took 1.1s. Estimated remaining: 8m 40s. Rate: 154.0 symbols/min [2025-09-22T22:20:19.733762] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:19.734350] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:19.743948] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 6067 primary records. [2025-09-22T22:20:19.746724] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-22T22:20:19.751607] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-09-22T22:20:19.752194] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-22T22:20:19.754690] [INFO ] [MAIN ] Derivative Progress: 758/2091 symbols completed. GDDY took 1.2s. Estimated remaining: 8m 39s. Rate: 154.2 symbols/min [2025-09-22T22:20:19.762797] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:19.770984] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-09-22T22:20:19.771129] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-22T22:20:19.773551] [INFO ] [MAIN ] Derivative Progress: 759/2091 symbols completed. GDO took 1.1s. Estimated remaining: 8m 38s. Rate: 154.4 symbols/min [2025-09-22T22:20:19.773944] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:19.798160] [DEBUG] [LOCAL ] GDV: Loaded 19856 existing records from primary storage. [2025-09-22T22:20:19.798377] [INFO ] [MAIN ] GDV: Loaded 19856 primary data records. [2025-09-22T22:20:19.916953] [DEBUG] [LOCAL ] GDOT: Loaded 38655 existing records from primary storage. [2025-09-22T22:20:19.933371] [INFO ] [MAIN ] GDOT: Loaded 38655 primary data records. [2025-09-22T22:20:20.284448] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-22T22:20:20.310267] [INFO ] [MAIN ] GE: Loaded 53713 primary data records. [2025-09-22T22:20:20.795728] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:20.797025] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19856 primary records. [2025-09-22T22:20:20.797120] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-22T22:20:20.827527] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:20.828760] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 38655 primary records. [2025-09-22T22:20:20.829847] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-22T22:20:20.832075] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-09-22T22:20:20.832338] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-22T22:20:20.834629] [INFO ] [MAIN ] Derivative Progress: 760/2091 symbols completed. GDV took 1.1s. Estimated remaining: 8m 39s. Rate: 154.0 symbols/min [2025-09-22T22:20:20.841861] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:20.851752] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-09-22T22:20:20.851840] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-22T22:20:20.853895] [INFO ] [MAIN ] Derivative Progress: 761/2091 symbols completed. GDOT took 1.1s. Estimated remaining: 8m 38s. Rate: 154.2 symbols/min [2025-09-22T22:20:20.854392] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:20.876839] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:20.877617] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53713 primary records. [2025-09-22T22:20:20.877812] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-22T22:20:20.896970] [DEBUG] [LOCAL ] GEF: Loaded 20694 existing records from primary storage. [2025-09-22T22:20:20.901334] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-09-22T22:20:20.901725] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-22T22:20:20.901639] [INFO ] [MAIN ] GEF: Loaded 20694 primary data records. [2025-09-22T22:20:20.916046] [INFO ] [MAIN ] Derivative Progress: 762/2091 symbols completed. GE took 1.1s. Estimated remaining: 8m 37s. Rate: 154.4 symbols/min [2025-09-22T22:20:20.997675] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:21.226442] [DEBUG] [LOCAL ] GEL: Loaded 34191 existing records from primary storage. [2025-09-22T22:20:21.227248] [INFO ] [MAIN ] GEL: Loaded 34191 primary data records. [2025-09-22T22:20:21.622143] [DEBUG] [LOCAL ] GENI: Loaded 52914 existing records from primary storage. [2025-09-22T22:20:21.622807] [INFO ] [MAIN ] GENI: Loaded 52914 primary data records. [2025-09-22T22:20:21.946824] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:21.947924] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20694 primary records. [2025-09-22T22:20:21.948201] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-22T22:20:21.966400] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-09-22T22:20:21.968148] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-22T22:20:21.970709] [INFO ] [MAIN ] Derivative Progress: 763/2091 symbols completed. GEF took 1.1s. Estimated remaining: 8m 37s. Rate: 154.0 symbols/min [2025-09-22T22:20:21.986243] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:21.987621] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 34191 primary records. [2025-09-22T22:20:21.987908] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-22T22:20:22.004173] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-09-22T22:20:22.004287] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-22T22:20:22.006800] [INFO ] [MAIN ] Derivative Progress: 764/2091 symbols completed. GEL took 1.2s. Estimated remaining: 8m 36s. Rate: 154.2 symbols/min [2025-09-22T22:20:22.021707] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:22.022230] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52914 primary records. [2025-09-22T22:20:22.022291] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-22T22:20:22.037472] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-09-22T22:20:22.037530] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-22T22:20:22.039792] [INFO ] [MAIN ] Derivative Progress: 765/2091 symbols completed. GENI took 1.1s. Estimated remaining: 8m 35s. Rate: 154.4 symbols/min [2025-09-22T22:20:22.040390] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:22.040270] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:22.040508] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:22.100557] [DEBUG] [LOCAL ] GETY: Loaded 36102 existing records from primary storage. [2025-09-22T22:20:22.100817] [INFO ] [MAIN ] GETY: Loaded 36102 primary data records. [2025-09-22T22:20:22.227104] [DEBUG] [LOCAL ] GEO: Loaded 52179 existing records from primary storage. [2025-09-22T22:20:22.237743] [INFO ] [MAIN ] GEO: Loaded 52179 primary data records. [2025-09-22T22:20:22.238332] [DEBUG] [LOCAL ] GES: Loaded 40196 existing records from primary storage. [2025-09-22T22:20:22.269393] [INFO ] [MAIN ] GES: Loaded 40196 primary data records. [2025-09-22T22:20:23.092876] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:23.094027] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 36102 primary records. [2025-09-22T22:20:23.094278] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-22T22:20:23.113114] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-09-22T22:20:23.113712] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-22T22:20:23.116633] [INFO ] [MAIN ] Derivative Progress: 766/2091 symbols completed. GETY took 1.1s. Estimated remaining: 8m 36s. Rate: 154.0 symbols/min [2025-09-22T22:20:23.117525] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:23.133913] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:23.134763] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 52179 primary records. [2025-09-22T22:20:23.134975] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-22T22:20:23.159857] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:23.161789] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 40196 primary records. [2025-09-22T22:20:23.163268] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-22T22:20:23.173617] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-09-22T22:20:23.177744] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-22T22:20:23.180609] [INFO ] [MAIN ] Derivative Progress: 767/2091 symbols completed. GEO took 1.1s. Estimated remaining: 8m 35s. Rate: 154.2 symbols/min [2025-09-22T22:20:23.184149] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:23.185835] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-09-22T22:20:23.185995] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-22T22:20:23.189020] [INFO ] [MAIN ] Derivative Progress: 768/2091 symbols completed. GES took 1.1s. Estimated remaining: 8m 34s. Rate: 154.4 symbols/min [2025-09-22T22:20:23.189428] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:23.194362] [DEBUG] [LOCAL ] GF: Loaded 3368 existing records from primary storage. [2025-09-22T22:20:23.194464] [INFO ] [MAIN ] GF: Loaded 3368 primary data records. [2025-09-22T22:20:23.515037] [DEBUG] [LOCAL ] GEV: Loaded 53150 existing records from primary storage. [2025-09-22T22:20:23.528685] [INFO ] [MAIN ] GEV: Loaded 53150 primary data records. [2025-09-22T22:20:23.595534] [DEBUG] [LOCAL ] GFF: Loaded 30950 existing records from primary storage. [2025-09-22T22:20:23.623384] [INFO ] [MAIN ] GFF: Loaded 30950 primary data records. [2025-09-22T22:20:24.222486] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:24.223410] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 3368 primary records. [2025-09-22T22:20:24.223592] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-22T22:20:24.241442] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-09-22T22:20:24.242095] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-22T22:20:24.244259] [INFO ] [MAIN ] Derivative Progress: 769/2091 symbols completed. GF took 1.1s. Estimated remaining: 8m 35s. Rate: 154.1 symbols/min [2025-09-22T22:20:24.245303] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:24.264441] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:24.265781] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53150 primary records. [2025-09-22T22:20:24.266058] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-22T22:20:24.288557] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-09-22T22:20:24.301190] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-22T22:20:24.303827] [INFO ] [MAIN ] Derivative Progress: 770/2091 symbols completed. GEV took 1.2s. Estimated remaining: 8m 34s. Rate: 154.2 symbols/min [2025-09-22T22:20:24.304230] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:24.304729] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:24.305806] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30950 primary records. [2025-09-22T22:20:24.305948] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-22T22:20:24.336179] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-09-22T22:20:24.336315] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-22T22:20:24.338931] [INFO ] [MAIN ] Derivative Progress: 771/2091 symbols completed. GFF took 1.1s. Estimated remaining: 8m 33s. Rate: 154.4 symbols/min [2025-09-22T22:20:24.339367] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:24.360775] [DEBUG] [LOCAL ] GFI: Loaded 53104 existing records from primary storage. [2025-09-22T22:20:24.361060] [INFO ] [MAIN ] GFI: Loaded 53104 primary data records. [2025-09-22T22:20:24.408630] [DEBUG] [LOCAL ] GFR: Loaded 8382 existing records from primary storage. [2025-09-22T22:20:24.446917] [INFO ] [MAIN ] GFR: Loaded 8382 primary data records. [2025-09-22T22:20:24.691165] [DEBUG] [LOCAL ] GFL: Loaded 48052 existing records from primary storage. [2025-09-22T22:20:24.815423] [INFO ] [MAIN ] GFL: Loaded 48052 primary data records. [2025-09-22T22:20:25.329832] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:25.338980] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53104 primary records. [2025-09-22T22:20:25.339221] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-22T22:20:25.346033] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:25.354433] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 8382 primary records. [2025-09-22T22:20:25.356310] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-22T22:20:25.379868] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-09-22T22:20:25.378379] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-09-22T22:20:25.380058] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-22T22:20:25.380393] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-22T22:20:25.382502] [INFO ] [MAIN ] Derivative Progress: 772/2091 symbols completed. GFI took 1.1s. Estimated remaining: 8m 34s. Rate: 154.1 symbols/min [2025-09-22T22:20:25.382996] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:25.385511] [INFO ] [MAIN ] Derivative Progress: 773/2091 symbols completed. GFR took 1.0s. Estimated remaining: 8m 33s. Rate: 154.3 symbols/min [2025-09-22T22:20:25.386378] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:25.406314] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:25.407322] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 48052 primary records. [2025-09-22T22:20:25.407480] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-22T22:20:25.428093] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-09-22T22:20:25.428316] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-22T22:20:25.431397] [INFO ] [MAIN ] Derivative Progress: 774/2091 symbols completed. GFL took 1.1s. Estimated remaining: 8m 32s. Rate: 154.4 symbols/min [2025-09-22T22:20:25.431908] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:25.476228] [DEBUG] [LOCAL ] GGG: Loaded 41029 existing records from primary storage. [2025-09-22T22:20:25.476549] [INFO ] [MAIN ] GGG: Loaded 41029 primary data records. [2025-09-22T22:20:25.595535] [DEBUG] [LOCAL ] GGT: Loaded 14114 existing records from primary storage. [2025-09-22T22:20:25.609209] [INFO ] [MAIN ] GGT: Loaded 14114 primary data records. [2025-09-22T22:20:25.648417] [DEBUG] [LOCAL ] GGB: Loaded 51011 existing records from primary storage. [2025-09-22T22:20:25.680208] [INFO ] [MAIN ] GGB: Loaded 51011 primary data records. [2025-09-22T22:20:26.515725] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:26.517794] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 41029 primary records. [2025-09-22T22:20:26.519677] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-22T22:20:26.541353] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:26.548027] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14114 primary records. [2025-09-22T22:20:26.549752] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-22T22:20:26.553682] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-09-22T22:20:26.554581] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-22T22:20:26.567157] [INFO ] [MAIN ] Derivative Progress: 775/2091 symbols completed. GGG took 1.2s. Estimated remaining: 8m 33s. Rate: 154.1 symbols/min [2025-09-22T22:20:26.583830] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:26.584391] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:26.583942] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-09-22T22:20:26.585397] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51011 primary records. [2025-09-22T22:20:26.585501] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-22T22:20:26.588166] [INFO ] [MAIN ] Derivative Progress: 776/2091 symbols completed. GGT took 1.2s. Estimated remaining: 8m 32s. Rate: 154.2 symbols/min [2025-09-22T22:20:26.588432] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-22T22:20:26.588836] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:26.609288] [DEBUG] [LOCAL ] GGZ: Loaded 2460 existing records from primary storage. [2025-09-22T22:20:26.609612] [INFO ] [MAIN ] GGZ: Loaded 2460 primary data records. [2025-09-22T22:20:26.612286] [DEBUG] [LOCAL ] GHC: Loaded 2629 existing records from primary storage. [2025-09-22T22:20:26.606595] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-09-22T22:20:26.624405] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-22T22:20:26.624304] [INFO ] [MAIN ] GHC: Loaded 2629 primary data records. [2025-09-22T22:20:26.649480] [INFO ] [MAIN ] Derivative Progress: 777/2091 symbols completed. GGB took 1.3s. Estimated remaining: 8m 31s. Rate: 154.4 symbols/min [2025-09-22T22:20:26.689604] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:26.883361] [DEBUG] [LOCAL ] GHG: Loaded 3157 existing records from primary storage. [2025-09-22T22:20:26.913799] [INFO ] [MAIN ] GHG: Loaded 3157 primary data records. [2025-09-22T22:20:27.613511] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:27.615085] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2460 primary records. [2025-09-22T22:20:27.616105] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-22T22:20:27.633255] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-09-22T22:20:27.633586] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-22T22:20:27.648539] [INFO ] [MAIN ] Derivative Progress: 778/2091 symbols completed. GGZ took 1.1s. Estimated remaining: 8m 31s. Rate: 154.1 symbols/min [2025-09-22T22:20:27.649428] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:27.650271] [INFO ] [MAIN ] GHC: Generated 1794 derivative records from 2629 primary records. [2025-09-22T22:20:27.650524] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-22T22:20:27.667602] [DEBUG] [LOCAL ] GHC: Derivative data saved (1794 records). [2025-09-22T22:20:27.667766] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-22T22:20:27.670475] [INFO ] [MAIN ] Derivative Progress: 779/2091 symbols completed. GHC took 1.1s. Estimated remaining: 8m 30s. Rate: 154.3 symbols/min [2025-09-22T22:20:27.683239] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-22T22:20:27.683846] [INFO ] [MAIN ] GHG: Generated 1792 derivative records from 3157 primary records. [2025-09-22T22:20:27.683908] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-22T22:20:27.696881] [DEBUG] [LOCAL ] GHG: Derivative data saved (1792 records). [2025-09-22T22:20:27.696945] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-22T22:20:27.699275] [INFO ] [MAIN ] Derivative Progress: 780/2091 symbols completed. GHG took 1.0s. Estimated remaining: 8m 29s. Rate: 154.5 symbols/min [2025-09-22T22:20:27.699955] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:27.699818] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:27.700068] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:27.707378] [DEBUG] [LOCAL ] GHLD: Loaded 4078 existing records from primary storage. [2025-09-22T22:20:27.707688] [INFO ] [MAIN ] GHLD: Loaded 4078 primary data records. [2025-09-22T22:20:27.825529] [DEBUG] [LOCAL ] GHI: Loaded 6952 existing records from primary storage. [2025-09-22T22:20:27.825242] [DEBUG] [LOCAL ] GHM: Loaded 14159 existing records from primary storage. [2025-09-22T22:20:27.825803] [INFO ] [MAIN ] GHM: Loaded 14159 primary data records. [2025-09-22T22:20:27.826240] [INFO ] [MAIN ] GHI: Loaded 6952 primary data records. [2025-09-22T22:20:28.673060] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:28.674412] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4078 primary records. [2025-09-22T22:20:28.674506] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-22T22:20:28.694094] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-09-22T22:20:28.694405] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-22T22:20:28.696547] [INFO ] [MAIN ] Derivative Progress: 781/2091 symbols completed. GHLD took 1.0s. Estimated remaining: 8m 30s. Rate: 154.2 symbols/min [2025-09-22T22:20:28.697068] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:28.723847] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:28.725122] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 6952 primary records. [2025-09-22T22:20:28.724250] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:28.725271] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-22T22:20:28.726972] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14159 primary records. [2025-09-22T22:20:28.727306] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-22T22:20:28.761662] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-09-22T22:20:28.762578] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-22T22:20:28.773911] [DEBUG] [LOCAL ] GHY: Loaded 20934 existing records from primary storage. [2025-09-22T22:20:28.774700] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-09-22T22:20:28.773320] [INFO ] [MAIN ] Derivative Progress: 782/2091 symbols completed. GHM took 1.1s. Estimated remaining: 8m 29s. Rate: 154.3 symbols/min [2025-09-22T22:20:28.774844] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-22T22:20:28.775023] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:28.777821] [INFO ] [MAIN ] Derivative Progress: 783/2091 symbols completed. GHI took 1.1s. Estimated remaining: 8m 28s. Rate: 154.5 symbols/min [2025-09-22T22:20:28.775181] [INFO ] [MAIN ] GHY: Loaded 20934 primary data records. [2025-09-22T22:20:28.778108] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:29.100612] [DEBUG] [LOCAL ] GIC: Loaded 13763 existing records from primary storage. [2025-09-22T22:20:29.110630] [DEBUG] [LOCAL ] GIB: Loaded 32195 existing records from primary storage. [2025-09-22T22:20:29.110036] [INFO ] [MAIN ] GIC: Loaded 13763 primary data records. [2025-09-22T22:20:29.116156] [INFO ] [MAIN ] GIB: Loaded 32195 primary data records. [2025-09-22T22:20:29.806510] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:29.807537] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20934 primary records. [2025-09-22T22:20:29.807658] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-22T22:20:29.826889] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-09-22T22:20:29.826963] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-22T22:20:29.829060] [INFO ] [MAIN ] Derivative Progress: 784/2091 symbols completed. GHY took 1.1s. Estimated remaining: 8m 29s. Rate: 154.2 symbols/min [2025-09-22T22:20:29.829417] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:29.863970] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:29.864382] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:29.865335] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 32195 primary records. [2025-09-22T22:20:29.866300] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13763 primary records. [2025-09-22T22:20:29.865509] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-22T22:20:29.866520] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-22T22:20:29.903940] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-09-22T22:20:29.902876] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-09-22T22:20:29.913503] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-22T22:20:29.916178] [INFO ] [MAIN ] Derivative Progress: 785/2091 symbols completed. GIB took 1.1s. Estimated remaining: 8m 28s. Rate: 154.3 symbols/min [2025-09-22T22:20:29.916550] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-22T22:20:29.916739] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:29.919466] [INFO ] [MAIN ] Derivative Progress: 786/2091 symbols completed. GIC took 1.1s. Estimated remaining: 8m 27s. Rate: 154.5 symbols/min [2025-09-22T22:20:29.919961] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:29.937230] [DEBUG] [LOCAL ] GIL: Loaded 43097 existing records from primary storage. [2025-09-22T22:20:29.937499] [INFO ] [MAIN ] GIL: Loaded 43097 primary data records. [2025-09-22T22:20:30.257602] [DEBUG] [LOCAL ] GKOS: Loaded 43097 existing records from primary storage. [2025-09-22T22:20:30.263638] [INFO ] [MAIN ] GKOS: Loaded 43097 primary data records. [2025-09-22T22:20:30.374379] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-09-22T22:20:30.397630] [INFO ] [MAIN ] GIS: Loaded 53675 primary data records. [2025-09-22T22:20:30.934175] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:30.936787] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43097 primary records. [2025-09-22T22:20:30.937708] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-22T22:20:30.959077] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-09-22T22:20:30.959518] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-22T22:20:30.974988] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:30.974007] [INFO ] [MAIN ] Derivative Progress: 787/2091 symbols completed. GIL took 1.1s. Estimated remaining: 8m 27s. Rate: 154.2 symbols/min [2025-09-22T22:20:30.976428] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 43097 primary records. [2025-09-22T22:20:30.976929] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-22T22:20:30.976826] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:30.995959] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-09-22T22:20:30.996174] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-22T22:20:30.998575] [INFO ] [MAIN ] Derivative Progress: 788/2091 symbols completed. GKOS took 1.1s. Estimated remaining: 8m 26s. Rate: 154.4 symbols/min [2025-09-22T22:20:30.999838] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:31.014790] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:31.015310] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53675 primary records. [2025-09-22T22:20:31.015465] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-22T22:20:31.040256] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-09-22T22:20:31.040412] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-22T22:20:31.043081] [INFO ] [MAIN ] Derivative Progress: 789/2091 symbols completed. GIS took 1.1s. Estimated remaining: 8m 25s. Rate: 154.6 symbols/min [2025-09-22T22:20:31.043592] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:31.066317] [DEBUG] [LOCAL ] GLP: Loaded 9519 existing records from primary storage. [2025-09-22T22:20:31.066502] [INFO ] [MAIN ] GLP: Loaded 9519 primary data records. [2025-09-22T22:20:31.067162] [DEBUG] [LOCAL ] GL: Loaded 37985 existing records from primary storage. [2025-09-22T22:20:31.109200] [INFO ] [MAIN ] GL: Loaded 37985 primary data records. [2025-09-22T22:20:31.578504] [DEBUG] [LOCAL ] GLOB: Loaded 47283 existing records from primary storage. [2025-09-22T22:20:31.743630] [INFO ] [MAIN ] GLOB: Loaded 47283 primary data records. [2025-09-22T22:20:32.116832] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:32.117743] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:32.119393] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9519 primary records. [2025-09-22T22:20:32.120799] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-22T22:20:32.120573] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37985 primary records. [2025-09-22T22:20:32.121070] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-22T22:20:32.149792] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-09-22T22:20:32.150049] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-22T22:20:32.156409] [INFO ] [MAIN ] Derivative Progress: 790/2091 symbols completed. GLP took 1.1s. Estimated remaining: 8m 26s. Rate: 154.2 symbols/min [2025-09-22T22:20:32.156729] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:32.154035] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-09-22T22:20:32.157097] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-22T22:20:32.159679] [INFO ] [MAIN ] Derivative Progress: 791/2091 symbols completed. GL took 1.2s. Estimated remaining: 8m 25s. Rate: 154.4 symbols/min [2025-09-22T22:20:32.160590] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:32.178182] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:32.178930] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47283 primary records. [2025-09-22T22:20:32.178996] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-22T22:20:32.196470] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-09-22T22:20:32.196556] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-22T22:20:32.199167] [INFO ] [MAIN ] Derivative Progress: 792/2091 symbols completed. GLOB took 1.2s. Estimated remaining: 8m 24s. Rate: 154.6 symbols/min [2025-09-22T22:20:32.199624] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:32.253036] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-22T22:20:32.253213] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-09-22T22:20:32.373489] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-22T22:20:32.388013] [INFO ] [MAIN ] GM: Loaded 53728 primary data records. [2025-09-22T22:20:32.585882] [DEBUG] [LOCAL ] GME: Loaded 53761 existing records from primary storage. [2025-09-22T22:20:32.589522] [INFO ] [MAIN ] GME: Loaded 53761 primary data records. [2025-09-22T22:20:33.258738] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:33.265244] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53635 primary records. [2025-09-22T22:20:33.265344] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-22T22:20:33.264403] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:33.266252] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53728 primary records. [2025-09-22T22:20:33.266484] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-22T22:20:33.314582] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-09-22T22:20:33.315245] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-09-22T22:20:33.315390] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-22T22:20:33.317970] [INFO ] [MAIN ] Derivative Progress: 793/2091 symbols completed. GLW took 1.2s. Estimated remaining: 8m 25s. Rate: 154.2 symbols/min [2025-09-22T22:20:33.312283] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:33.318207] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-22T22:20:33.319177] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53761 primary records. [2025-09-22T22:20:33.319488] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-22T22:20:33.321947] [INFO ] [MAIN ] Derivative Progress: 794/2091 symbols completed. GM took 1.2s. Estimated remaining: 8m 24s. Rate: 154.4 symbols/min [2025-09-22T22:20:33.340062] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-09-22T22:20:33.340188] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-22T22:20:33.342805] [INFO ] [MAIN ] Derivative Progress: 795/2091 symbols completed. GME took 1.1s. Estimated remaining: 8m 23s. Rate: 154.6 symbols/min [2025-09-22T22:20:33.343458] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:33.343868] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:33.344156] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:33.366177] [DEBUG] [LOCAL ] GNE: Loaded 17531 existing records from primary storage. [2025-09-22T22:20:33.366325] [INFO ] [MAIN ] GNE: Loaded 17531 primary data records. [2025-09-22T22:20:33.541342] [DEBUG] [LOCAL ] GMRE: Loaded 37625 existing records from primary storage. [2025-09-22T22:20:33.571548] [INFO ] [MAIN ] GMRE: Loaded 37625 primary data records. [2025-09-22T22:20:33.616294] [DEBUG] [LOCAL ] GMED: Loaded 48319 existing records from primary storage. [2025-09-22T22:20:33.643327] [INFO ] [MAIN ] GMED: Loaded 48319 primary data records. [2025-09-22T22:20:34.394337] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:34.395522] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17531 primary records. [2025-09-22T22:20:34.395764] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-22T22:20:34.415610] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-09-22T22:20:34.416280] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-22T22:20:34.419023] [INFO ] [MAIN ] Derivative Progress: 796/2091 symbols completed. GNE took 1.1s. Estimated remaining: 8m 24s. Rate: 154.2 symbols/min [2025-09-22T22:20:34.420117] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:34.456934] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:34.458477] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37625 primary records. [2025-09-22T22:20:34.457558] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:34.459224] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-22T22:20:34.459155] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48319 primary records. [2025-09-22T22:20:34.459333] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-22T22:20:34.498390] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-09-22T22:20:34.499027] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-22T22:20:34.501769] [INFO ] [MAIN ] Derivative Progress: 797/2091 symbols completed. GMRE took 1.2s. Estimated remaining: 8m 23s. Rate: 154.4 symbols/min [2025-09-22T22:20:34.502373] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:34.504963] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-09-22T22:20:34.505045] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-22T22:20:34.507488] [INFO ] [MAIN ] Derivative Progress: 798/2091 symbols completed. GMED took 1.2s. Estimated remaining: 8m 22s. Rate: 154.6 symbols/min [2025-09-22T22:20:34.507892] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:34.526842] [DEBUG] [LOCAL ] GNK: Loaded 40728 existing records from primary storage. [2025-09-22T22:20:34.527017] [INFO ] [MAIN ] GNK: Loaded 40728 primary data records. [2025-09-22T22:20:34.883869] [DEBUG] [LOCAL ] GNL: Loaded 47345 existing records from primary storage. [2025-09-22T22:20:34.885153] [DEBUG] [LOCAL ] GNRC: Loaded 45155 existing records from primary storage. [2025-09-22T22:20:34.885551] [INFO ] [MAIN ] GNL: Loaded 47345 primary data records. [2025-09-22T22:20:34.885831] [INFO ] [MAIN ] GNRC: Loaded 45155 primary data records. [2025-09-22T22:20:35.591768] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:35.593390] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40728 primary records. [2025-09-22T22:20:35.593621] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-22T22:20:35.616414] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-09-22T22:20:35.616594] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-22T22:20:35.619479] [INFO ] [MAIN ] Derivative Progress: 799/2091 symbols completed. GNK took 1.2s. Estimated remaining: 8m 23s. Rate: 154.2 symbols/min [2025-09-22T22:20:35.620237] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:35.633722] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:35.635324] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 47345 primary records. [2025-09-22T22:20:35.635769] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-22T22:20:35.670579] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-09-22T22:20:35.671176] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-22T22:20:35.670931] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:35.674318] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45155 primary records. [2025-09-22T22:20:35.673530] [INFO ] [MAIN ] Derivative Progress: 800/2091 symbols completed. GNL took 1.2s. Estimated remaining: 8m 22s. Rate: 154.4 symbols/min [2025-09-22T22:20:35.674564] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-22T22:20:35.674874] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:35.680082] [DEBUG] [LOCAL ] GNT: Loaded 7946 existing records from primary storage. [2025-09-22T22:20:35.680731] [INFO ] [MAIN ] GNT: Loaded 7946 primary data records. [2025-09-22T22:20:35.752487] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-09-22T22:20:35.768912] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-22T22:20:35.783780] [INFO ] [MAIN ] Derivative Progress: 801/2091 symbols completed. GNRC took 1.3s. Estimated remaining: 8m 21s. Rate: 154.5 symbols/min [2025-09-22T22:20:35.808962] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:35.809513] [DEBUG] [LOCAL ] GNTY: Loaded 7079 existing records from primary storage. [2025-09-22T22:20:35.809860] [INFO ] [MAIN ] GNTY: Loaded 7079 primary data records. [2025-09-22T22:20:36.350148] [DEBUG] [LOCAL ] GNW: Loaded 51338 existing records from primary storage. [2025-09-22T22:20:36.351171] [INFO ] [MAIN ] GNW: Loaded 51338 primary data records. [2025-09-22T22:20:36.493298] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:36.504546] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 7946 primary records. [2025-09-22T22:20:36.504747] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-22T22:20:36.725319] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-09-22T22:20:36.725452] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-22T22:20:36.725241] [DEBUG] [MAIN ] GNTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:36.726377] [INFO ] [MAIN ] GNTY: Generated 1794 derivative records from 7079 primary records. [2025-09-22T22:20:36.729254] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-22T22:20:36.729137] [INFO ] [MAIN ] Derivative Progress: 802/2091 symbols completed. GNT took 1.1s. Estimated remaining: 8m 21s. Rate: 154.2 symbols/min [2025-09-22T22:20:36.731281] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:36.751818] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1794 records). [2025-09-22T22:20:36.752128] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-22T22:20:36.754901] [INFO ] [MAIN ] Derivative Progress: 803/2091 symbols completed. GNTY took 1.1s. Estimated remaining: 8m 20s. Rate: 154.4 symbols/min [2025-09-22T22:20:36.755290] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:36.779901] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:36.780621] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51338 primary records. [2025-09-22T22:20:36.789462] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-22T22:20:36.824566] [DEBUG] [LOCAL ] GOLF: Loaded 31784 existing records from primary storage. [2025-09-22T22:20:36.825785] [INFO ] [MAIN ] GOLF: Loaded 31784 primary data records. [2025-09-22T22:20:36.883350] [DEBUG] [LOCAL ] GOF: Loaded 42926 existing records from primary storage. [2025-09-22T22:20:36.917624] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-09-22T22:20:36.917534] [INFO ] [MAIN ] GOF: Loaded 42926 primary data records. [2025-09-22T22:20:36.928248] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-22T22:20:36.956171] [INFO ] [MAIN ] Derivative Progress: 804/2091 symbols completed. GNW took 1.2s. Estimated remaining: 8m 20s. Rate: 154.5 symbols/min [2025-09-22T22:20:36.979476] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:37.510402] [DEBUG] [LOCAL ] GOOS: Loaded 45674 existing records from primary storage. [2025-09-22T22:20:37.512213] [INFO ] [MAIN ] GOOS: Loaded 45674 primary data records. [2025-09-22T22:20:37.596114] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:37.620002] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31784 primary records. [2025-09-22T22:20:37.637975] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-22T22:20:37.710229] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:37.746535] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-09-22T22:20:37.753582] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-22T22:20:37.747348] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42926 primary records. [2025-09-22T22:20:37.755729] [INFO ] [MAIN ] Derivative Progress: 805/2091 symbols completed. GOLF took 1.0s. Estimated remaining: 8m 20s. Rate: 154.3 symbols/min [2025-09-22T22:20:37.753759] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-22T22:20:37.907673] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:37.937479] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-09-22T22:20:37.938003] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-22T22:20:37.940706] [INFO ] [MAIN ] Derivative Progress: 806/2091 symbols completed. GOF took 1.2s. Estimated remaining: 8m 19s. Rate: 154.4 symbols/min [2025-09-22T22:20:37.941453] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:37.974464] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:37.976132] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 45674 primary records. [2025-09-22T22:20:37.976315] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-22T22:20:37.989301] [DEBUG] [LOCAL ] GOTU: Loaded 39180 existing records from primary storage. [2025-09-22T22:20:37.997040] [INFO ] [MAIN ] GOTU: Loaded 39180 primary data records. [2025-09-22T22:20:38.052336] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-09-22T22:20:38.080149] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-22T22:20:38.117387] [INFO ] [MAIN ] Derivative Progress: 807/2091 symbols completed. GOOS took 1.1s. Estimated remaining: 8m 19s. Rate: 154.5 symbols/min [2025-09-22T22:20:38.151124] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:38.152519] [DEBUG] [LOCAL ] GPC: Loaded 46710 existing records from primary storage. [2025-09-22T22:20:38.153108] [INFO ] [MAIN ] GPC: Loaded 46710 primary data records. [2025-09-22T22:20:38.478671] [DEBUG] [LOCAL ] GPI: Loaded 14915 existing records from primary storage. [2025-09-22T22:20:38.495841] [INFO ] [MAIN ] GPI: Loaded 14915 primary data records. [2025-09-22T22:20:39.031403] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:39.032472] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 39180 primary records. [2025-09-22T22:20:39.032755] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-22T22:20:39.050535] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-09-22T22:20:39.051987] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-22T22:20:39.054163] [INFO ] [MAIN ] Derivative Progress: 808/2091 symbols completed. GOTU took 1.2s. Estimated remaining: 8m 19s. Rate: 154.2 symbols/min [2025-09-22T22:20:39.069033] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:39.069736] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46710 primary records. [2025-09-22T22:20:39.069887] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-22T22:20:39.086380] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-09-22T22:20:39.086621] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-22T22:20:39.089705] [INFO ] [MAIN ] Derivative Progress: 809/2091 symbols completed. GPC took 1.1s. Estimated remaining: 8m 18s. Rate: 154.4 symbols/min [2025-09-22T22:20:39.103839] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:20:39.104393] [INFO ] [MAIN ] GPI: Generated 1793 derivative records from 14915 primary records. [2025-09-22T22:20:39.104454] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-22T22:20:39.119305] [DEBUG] [LOCAL ] GPI: Derivative data saved (1793 records). [2025-09-22T22:20:39.119367] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-22T22:20:39.121988] [INFO ] [MAIN ] Derivative Progress: 810/2091 symbols completed. GPI took 1.0s. Estimated remaining: 8m 17s. Rate: 154.6 symbols/min [2025-09-22T22:20:39.122615] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:39.122847] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:39.123009] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:39.131254] [DEBUG] [LOCAL ] GPJA: Loaded 4078 existing records from primary storage. [2025-09-22T22:20:39.131399] [INFO ] [MAIN ] GPJA: Loaded 4078 primary data records. [2025-09-22T22:20:39.465162] [DEBUG] [LOCAL ] GPMT: Loaded 26820 existing records from primary storage. [2025-09-22T22:20:39.475018] [INFO ] [MAIN ] GPMT: Loaded 26820 primary data records. [2025-09-22T22:20:39.546447] [DEBUG] [LOCAL ] GPK: Loaded 52695 existing records from primary storage. [2025-09-22T22:20:39.561513] [INFO ] [MAIN ] GPK: Loaded 52695 primary data records. [2025-09-22T22:20:40.179778] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:40.181244] [INFO ] [MAIN ] GPJA: Generated 1794 derivative records from 4078 primary records. [2025-09-22T22:20:40.181602] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-22T22:20:40.198797] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1794 records). [2025-09-22T22:20:40.199038] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-22T22:20:40.204837] [INFO ] [MAIN ] Derivative Progress: 811/2091 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 18s. Rate: 154.2 symbols/min [2025-09-22T22:20:40.205971] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:40.220776] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:40.221789] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 26820 primary records. [2025-09-22T22:20:40.221988] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-22T22:20:40.238371] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-09-22T22:20:40.238478] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-22T22:20:40.240698] [INFO ] [MAIN ] Derivative Progress: 812/2091 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 17s. Rate: 154.4 symbols/min [2025-09-22T22:20:40.242371] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:40.260004] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:40.261229] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52695 primary records. [2025-09-22T22:20:40.261372] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-22T22:20:40.294234] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-09-22T22:20:40.294474] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-22T22:20:40.297809] [INFO ] [MAIN ] Derivative Progress: 813/2091 symbols completed. GPK took 1.2s. Estimated remaining: 8m 16s. Rate: 154.6 symbols/min [2025-09-22T22:20:40.298303] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:40.294907] [DEBUG] [LOCAL ] GPOR: Loaded 22934 existing records from primary storage. [2025-09-22T22:20:40.298558] [INFO ] [MAIN ] GPOR: Loaded 22934 primary data records. [2025-09-22T22:20:40.459792] [DEBUG] [LOCAL ] GPN: Loaded 52107 existing records from primary storage. [2025-09-22T22:20:40.505198] [INFO ] [MAIN ] GPN: Loaded 52107 primary data records. [2025-09-22T22:20:40.751611] [DEBUG] [LOCAL ] GPRK: Loaded 39112 existing records from primary storage. [2025-09-22T22:20:40.758305] [INFO ] [MAIN ] GPRK: Loaded 39112 primary data records. [2025-09-22T22:20:41.279344] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:41.280671] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 22934 primary records. [2025-09-22T22:20:41.280944] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-22T22:20:41.311905] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:41.314784] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52107 primary records. [2025-09-22T22:20:41.316168] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-22T22:20:41.318346] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-09-22T22:20:41.325739] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-22T22:20:41.332802] [INFO ] [MAIN ] Derivative Progress: 814/2091 symbols completed. GPOR took 1.1s. Estimated remaining: 8m 17s. Rate: 154.3 symbols/min [2025-09-22T22:20:41.335089] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:41.336243] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-09-22T22:20:41.338554] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-22T22:20:41.342255] [INFO ] [MAIN ] Derivative Progress: 815/2091 symbols completed. GPN took 1.1s. Estimated remaining: 8m 16s. Rate: 154.5 symbols/min [2025-09-22T22:20:41.342971] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:41.356485] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:41.357389] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39112 primary records. [2025-09-22T22:20:41.357496] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-22T22:20:41.375328] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-09-22T22:20:41.382220] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-22T22:20:41.384814] [INFO ] [MAIN ] Derivative Progress: 816/2091 symbols completed. GPRK took 1.1s. Estimated remaining: 8m 15s. Rate: 154.6 symbols/min [2025-09-22T22:20:41.389229] [DEBUG] [LOCAL ] GRC: Loaded 8788 existing records from primary storage. [2025-09-22T22:20:41.389362] [INFO ] [MAIN ] GRC: Loaded 8788 primary data records. [2025-09-22T22:20:41.419490] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:41.470768] [DEBUG] [LOCAL ] GRBK: Loaded 27108 existing records from primary storage. [2025-09-22T22:20:41.493605] [INFO ] [MAIN ] GRBK: Loaded 27108 primary data records. [2025-09-22T22:20:41.670194] [DEBUG] [LOCAL ] GRDN: Loaded 19640 existing records from primary storage. [2025-09-22T22:20:41.675508] [INFO ] [MAIN ] GRDN: Loaded 19640 primary data records. [2025-09-22T22:20:42.425503] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:42.426747] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 8788 primary records. [2025-09-22T22:20:42.426869] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-22T22:20:42.462702] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:42.464416] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 27108 primary records. [2025-09-22T22:20:42.465719] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-22T22:20:42.468546] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-09-22T22:20:42.481171] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-22T22:20:42.484728] [INFO ] [MAIN ] Derivative Progress: 817/2091 symbols completed. GRC took 1.1s. Estimated remaining: 8m 15s. Rate: 154.3 symbols/min [2025-09-22T22:20:42.487423] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:42.500160] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-09-22T22:20:42.505898] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:42.505985] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-22T22:20:42.509001] [INFO ] [MAIN ] Derivative Progress: 818/2091 symbols completed. GRBK took 1.2s. Estimated remaining: 8m 15s. Rate: 154.5 symbols/min [2025-09-22T22:20:42.510012] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 19640 primary records. [2025-09-22T22:20:42.510487] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:42.510408] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-22T22:20:42.531207] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-09-22T22:20:42.531358] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-22T22:20:42.534049] [INFO ] [MAIN ] Derivative Progress: 819/2091 symbols completed. GRDN took 1.1s. Estimated remaining: 8m 14s. Rate: 154.6 symbols/min [2025-09-22T22:20:42.534446] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:42.592903] [DEBUG] [LOCAL ] GRMN: Loaded 41568 existing records from primary storage. [2025-09-22T22:20:42.608274] [INFO ] [MAIN ] GRMN: Loaded 41568 primary data records. [2025-09-22T22:20:42.621489] [DEBUG] [LOCAL ] GRND: Loaded 50065 existing records from primary storage. [2025-09-22T22:20:42.657401] [INFO ] [MAIN ] GRND: Loaded 50065 primary data records. [2025-09-22T22:20:42.717053] [DEBUG] [LOCAL ] GRNT: Loaded 33861 existing records from primary storage. [2025-09-22T22:20:42.739545] [INFO ] [MAIN ] GRNT: Loaded 33861 primary data records. [2025-09-22T22:20:43.577809] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:43.583465] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:43.585334] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 41568 primary records. [2025-09-22T22:20:43.584570] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 50065 primary records. [2025-09-22T22:20:43.585624] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-22T22:20:43.586149] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-22T22:20:43.615692] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-09-22T22:20:43.617620] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-22T22:20:43.618947] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-09-22T22:20:43.619961] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-22T22:20:43.622080] [INFO ] [MAIN ] Derivative Progress: 820/2091 symbols completed. GRMN took 1.1s. Estimated remaining: 8m 14s. Rate: 154.3 symbols/min [2025-09-22T22:20:43.622519] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:43.625104] [INFO ] [MAIN ] Derivative Progress: 821/2091 symbols completed. GRND took 1.1s. Estimated remaining: 8m 13s. Rate: 154.5 symbols/min [2025-09-22T22:20:43.626356] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:43.643593] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:43.644524] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33861 primary records. [2025-09-22T22:20:43.644718] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-22T22:20:43.647522] [DEBUG] [LOCAL ] GRX: Loaded 4423 existing records from primary storage. [2025-09-22T22:20:43.648109] [INFO ] [MAIN ] GRX: Loaded 4423 primary data records. [2025-09-22T22:20:43.735245] [DEBUG] [LOCAL ] GROV: Loaded 9089 existing records from primary storage. [2025-09-22T22:20:43.748610] [INFO ] [MAIN ] GROV: Loaded 9089 primary data records. [2025-09-22T22:20:43.816361] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-09-22T22:20:43.829031] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-22T22:20:43.861679] [INFO ] [MAIN ] Derivative Progress: 822/2091 symbols completed. GRNT took 1.3s. Estimated remaining: 8m 13s. Rate: 154.5 symbols/min [2025-09-22T22:20:43.872361] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:44.338450] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:44.339819] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4423 primary records. [2025-09-22T22:20:44.342196] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-22T22:20:44.382033] [DEBUG] [LOCAL ] GS: Loaded 52088 existing records from primary storage. [2025-09-22T22:20:44.384427] [INFO ] [MAIN ] GS: Loaded 52088 primary data records. [2025-09-22T22:20:44.384528] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-09-22T22:20:44.396045] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-22T22:20:44.384946] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:44.407473] [INFO ] [MAIN ] Derivative Progress: 823/2091 symbols completed. GRX took 0.8s. Estimated remaining: 8m 13s. Rate: 154.5 symbols/min [2025-09-22T22:20:44.418363] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 9089 primary records. [2025-09-22T22:20:44.423634] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-22T22:20:44.551482] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-09-22T22:20:44.559664] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-22T22:20:44.578116] [INFO ] [MAIN ] Derivative Progress: 824/2091 symbols completed. GROV took 1.0s. Estimated remaining: 8m 12s. Rate: 154.6 symbols/min [2025-09-22T22:20:44.715324] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:44.716025] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 52088 primary records. [2025-09-22T22:20:44.716089] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-22T22:20:44.731047] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-09-22T22:20:44.731106] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-22T22:20:44.733118] [INFO ] [MAIN ] Derivative Progress: 825/2091 symbols completed. GS took 0.9s. Estimated remaining: 8m 11s. Rate: 154.7 symbols/min [2025-09-22T22:20:44.733638] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:44.734037] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:44.733887] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:44.802670] [DEBUG] [LOCAL ] GSL: Loaded 33677 existing records from primary storage. [2025-09-22T22:20:44.803832] [INFO ] [MAIN ] GSL: Loaded 33677 primary data records. [2025-09-22T22:20:44.825870] [DEBUG] [LOCAL ] GSBD: Loaded 39134 existing records from primary storage. [2025-09-22T22:20:44.848261] [INFO ] [MAIN ] GSBD: Loaded 39134 primary data records. [2025-09-22T22:20:44.992671] [DEBUG] [LOCAL ] GSK: Loaded 53495 existing records from primary storage. [2025-09-22T22:20:44.992908] [INFO ] [MAIN ] GSK: Loaded 53495 primary data records. [2025-09-22T22:20:45.816383] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:45.817554] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33677 primary records. [2025-09-22T22:20:45.817709] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-22T22:20:45.818184] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:45.839019] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39134 primary records. [2025-09-22T22:20:45.843133] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:45.843670] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-22T22:20:45.844977] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53495 primary records. [2025-09-22T22:20:45.846330] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-22T22:20:45.871240] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-09-22T22:20:45.872975] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-09-22T22:20:45.875562] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-22T22:20:45.875962] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-22T22:20:45.879007] [INFO ] [MAIN ] Derivative Progress: 826/2091 symbols completed. GSBD took 1.1s. Estimated remaining: 8m 12s. Rate: 154.3 symbols/min [2025-09-22T22:20:45.881551] [INFO ] [MAIN ] Derivative Progress: 827/2091 symbols completed. GSL took 1.1s. Estimated remaining: 8m 11s. Rate: 154.5 symbols/min [2025-09-22T22:20:45.879800] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:45.883417] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:45.888010] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-09-22T22:20:45.888139] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-22T22:20:45.890712] [INFO ] [MAIN ] Derivative Progress: 828/2091 symbols completed. GSK took 1.2s. Estimated remaining: 8m 10s. Rate: 154.7 symbols/min [2025-09-22T22:20:45.891056] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:45.976542] [DEBUG] [LOCAL ] GTLS: Loaded 43065 existing records from primary storage. [2025-09-22T22:20:45.990882] [INFO ] [MAIN ] GTLS: Loaded 43065 primary data records. [2025-09-22T22:20:46.004001] [DEBUG] [LOCAL ] GTN: Loaded 45674 existing records from primary storage. [2025-09-22T22:20:46.015678] [INFO ] [MAIN ] GTN: Loaded 45674 primary data records. [2025-09-22T22:20:46.015762] [DEBUG] [LOCAL ] GTES: Loaded 50703 existing records from primary storage. [2025-09-22T22:20:46.117724] [INFO ] [MAIN ] GTES: Loaded 50703 primary data records. [2025-09-22T22:20:46.952748] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:46.955190] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 43065 primary records. [2025-09-22T22:20:46.963229] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-22T22:20:46.971005] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:46.972521] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45674 primary records. [2025-09-22T22:20:46.992705] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-22T22:20:47.000272] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:47.012911] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50703 primary records. [2025-09-22T22:20:47.013223] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-22T22:20:47.033330] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-09-22T22:20:47.032166] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-09-22T22:20:47.033720] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-22T22:20:47.036254] [INFO ] [MAIN ] Derivative Progress: 829/2091 symbols completed. GTN took 1.1s. Estimated remaining: 8m 11s. Rate: 154.3 symbols/min [2025-09-22T22:20:47.036785] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:47.037205] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-22T22:20:47.039666] [INFO ] [MAIN ] Derivative Progress: 830/2091 symbols completed. GTLS took 1.2s. Estimated remaining: 8m 10s. Rate: 154.5 symbols/min [2025-09-22T22:20:47.041861] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:47.045865] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-09-22T22:20:47.046029] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-22T22:20:47.048112] [INFO ] [MAIN ] Derivative Progress: 831/2091 symbols completed. GTES took 1.2s. Estimated remaining: 8m 9s. Rate: 154.7 symbols/min [2025-09-22T22:20:47.048415] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:47.060847] [DEBUG] [LOCAL ] GUG: Loaded 12212 existing records from primary storage. [2025-09-22T22:20:47.061247] [INFO ] [MAIN ] GUG: Loaded 12212 primary data records. [2025-09-22T22:20:47.192348] [DEBUG] [LOCAL ] GTY: Loaded 30384 existing records from primary storage. [2025-09-22T22:20:47.192980] [DEBUG] [LOCAL ] GUT: Loaded 15525 existing records from primary storage. [2025-09-22T22:20:47.203507] [INFO ] [MAIN ] GTY: Loaded 30384 primary data records. [2025-09-22T22:20:47.214005] [INFO ] [MAIN ] GUT: Loaded 15525 primary data records. [2025-09-22T22:20:48.096034] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:20:48.097141] [INFO ] [MAIN ] GUG: Generated 1793 derivative records from 12212 primary records. [2025-09-22T22:20:48.097613] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-22T22:20:48.115753] [DEBUG] [LOCAL ] GUG: Derivative data saved (1793 records). [2025-09-22T22:20:48.117150] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-22T22:20:48.120432] [INFO ] [MAIN ] Derivative Progress: 832/2091 symbols completed. GUG took 1.1s. Estimated remaining: 8m 9s. Rate: 154.4 symbols/min [2025-09-22T22:20:48.121117] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:48.137710] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:48.151395] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15525 primary records. [2025-09-22T22:20:48.151836] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:48.151968] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-22T22:20:48.153341] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30384 primary records. [2025-09-22T22:20:48.153745] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-22T22:20:48.184204] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-09-22T22:20:48.192877] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-22T22:20:48.196283] [INFO ] [MAIN ] Derivative Progress: 833/2091 symbols completed. GTY took 1.2s. Estimated remaining: 8m 8s. Rate: 154.5 symbols/min [2025-09-22T22:20:48.197760] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:48.198866] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-09-22T22:20:48.198974] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-22T22:20:48.201304] [INFO ] [MAIN ] Derivative Progress: 834/2091 symbols completed. GUT took 1.2s. Estimated remaining: 8m 8s. Rate: 154.7 symbols/min [2025-09-22T22:20:48.201751] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:48.214229] [DEBUG] [LOCAL ] GVA: Loaded 33963 existing records from primary storage. [2025-09-22T22:20:48.214601] [INFO ] [MAIN ] GVA: Loaded 33963 primary data records. [2025-09-22T22:20:48.325081] [DEBUG] [LOCAL ] GWH: Loaded 15311 existing records from primary storage. [2025-09-22T22:20:48.328716] [INFO ] [MAIN ] GWH: Loaded 15311 primary data records. [2025-09-22T22:20:48.654217] [DEBUG] [LOCAL ] GWRE: Loaded 41190 existing records from primary storage. [2025-09-22T22:20:48.668681] [INFO ] [MAIN ] GWRE: Loaded 41190 primary data records. [2025-09-22T22:20:49.178470] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:49.179619] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 33963 primary records. [2025-09-22T22:20:49.179824] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-22T22:20:49.199638] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-09-22T22:20:49.199868] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-22T22:20:49.209930] [INFO ] [MAIN ] Derivative Progress: 835/2091 symbols completed. GVA took 1.1s. Estimated remaining: 8m 8s. Rate: 154.4 symbols/min [2025-09-22T22:20:49.215265] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:49.216277] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:49.217228] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 15311 primary records. [2025-09-22T22:20:49.217836] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-22T22:20:49.249417] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:49.255946] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 41190 primary records. [2025-09-22T22:20:49.256124] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-22T22:20:49.265907] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-09-22T22:20:49.269684] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-22T22:20:49.273469] [INFO ] [MAIN ] Derivative Progress: 836/2091 symbols completed. GWH took 1.1s. Estimated remaining: 8m 7s. Rate: 154.6 symbols/min [2025-09-22T22:20:49.281792] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:49.282529] [DEBUG] [LOCAL ] GWW: Loaded 19947 existing records from primary storage. [2025-09-22T22:20:49.283068] [INFO ] [MAIN ] GWW: Loaded 19947 primary data records. [2025-09-22T22:20:49.323008] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-09-22T22:20:49.361048] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-22T22:20:49.370146] [INFO ] [MAIN ] Derivative Progress: 837/2091 symbols completed. GWRE took 1.2s. Estimated remaining: 8m 6s. Rate: 154.7 symbols/min [2025-09-22T22:20:49.381376] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:49.484424] [DEBUG] [LOCAL ] GYLD: Loaded 1553 existing records from primary storage. [2025-09-22T22:20:49.544045] [INFO ] [MAIN ] GYLD: Loaded 1553 primary data records. [2025-09-22T22:20:49.732636] [DEBUG] [LOCAL ] GXO: Loaded 47683 existing records from primary storage. [2025-09-22T22:20:49.736362] [INFO ] [MAIN ] GXO: Loaded 47683 primary data records. [2025-09-22T22:20:50.292856] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:50.293782] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19947 primary records. [2025-09-22T22:20:50.293994] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-22T22:20:50.315047] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-09-22T22:20:50.315559] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-22T22:20:50.317906] [INFO ] [MAIN ] Derivative Progress: 838/2091 symbols completed. GWW took 1.1s. Estimated remaining: 8m 7s. Rate: 154.4 symbols/min [2025-09-22T22:20:50.331399] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-22T22:20:50.332181] [INFO ] [MAIN ] GYLD: Generated 1791 derivative records from 1553 primary records. [2025-09-22T22:20:50.332331] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-22T22:20:50.359564] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:50.360681] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1791 records). [2025-09-22T22:20:50.361318] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47683 primary records. [2025-09-22T22:20:50.361401] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-22T22:20:50.361486] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-22T22:20:50.363526] [INFO ] [MAIN ] Derivative Progress: 839/2091 symbols completed. GYLD took 1.0s. Estimated remaining: 8m 6s. Rate: 154.6 symbols/min [2025-09-22T22:20:50.379242] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-09-22T22:20:50.379304] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-22T22:20:50.381955] [INFO ] [MAIN ] Derivative Progress: 840/2091 symbols completed. GXO took 1.1s. Estimated remaining: 8m 5s. Rate: 154.8 symbols/min [2025-09-22T22:20:50.382524] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:50.382671] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:50.382756] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:50.441472] [DEBUG] [LOCAL ] HAE: Loaded 39515 existing records from primary storage. [2025-09-22T22:20:50.454404] [DEBUG] [LOCAL ] HAFN: Loaded 43630 existing records from primary storage. [2025-09-22T22:20:50.453740] [INFO ] [MAIN ] HAE: Loaded 39515 primary data records. [2025-09-22T22:20:50.454680] [INFO ] [MAIN ] HAFN: Loaded 43630 primary data records. [2025-09-22T22:20:50.593225] [DEBUG] [LOCAL ] H: Loaded 44926 existing records from primary storage. [2025-09-22T22:20:50.674575] [INFO ] [MAIN ] H: Loaded 44926 primary data records. [2025-09-22T22:20:51.407503] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:51.421077] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43630 primary records. [2025-09-22T22:20:51.421585] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:51.422730] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39515 primary records. [2025-09-22T22:20:51.421694] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-22T22:20:51.422937] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-22T22:20:51.449912] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-09-22T22:20:51.453155] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-22T22:20:51.458662] [INFO ] [MAIN ] Derivative Progress: 841/2091 symbols completed. HAFN took 1.1s. Estimated remaining: 8m 6s. Rate: 154.4 symbols/min [2025-09-22T22:20:51.461169] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:51.471267] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-09-22T22:20:51.476867] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-22T22:20:51.479278] [INFO ] [MAIN ] Derivative Progress: 842/2091 symbols completed. HAE took 1.1s. Estimated remaining: 8m 5s. Rate: 154.6 symbols/min [2025-09-22T22:20:51.476771] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:51.479692] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:51.480944] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44926 primary records. [2025-09-22T22:20:51.481105] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-22T22:20:51.499482] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-09-22T22:20:51.499724] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-22T22:20:51.502027] [INFO ] [MAIN ] Derivative Progress: 843/2091 symbols completed. H took 1.1s. Estimated remaining: 8m 4s. Rate: 154.8 symbols/min [2025-09-22T22:20:51.502435] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:51.568800] [DEBUG] [LOCAL ] HASI: Loaded 47201 existing records from primary storage. [2025-09-22T22:20:51.569594] [INFO ] [MAIN ] HASI: Loaded 47201 primary data records. [2025-09-22T22:20:51.665124] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-22T22:20:51.688373] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-09-22T22:20:51.752948] [DEBUG] [LOCAL ] HAYW: Loaded 48763 existing records from primary storage. [2025-09-22T22:20:51.768303] [INFO ] [MAIN ] HAYW: Loaded 48763 primary data records. [2025-09-22T22:20:52.598151] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:52.611549] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47201 primary records. [2025-09-22T22:20:52.612048] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-22T22:20:52.612338] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:52.614036] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-09-22T22:20:52.614324] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-22T22:20:52.643341] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-09-22T22:20:52.645264] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-22T22:20:52.647429] [INFO ] [MAIN ] Derivative Progress: 844/2091 symbols completed. HASI took 1.2s. Estimated remaining: 8m 4s. Rate: 154.4 symbols/min [2025-09-22T22:20:52.648518] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:52.664021] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:52.665924] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48763 primary records. [2025-09-22T22:20:52.666558] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-09-22T22:20:52.666670] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-22T22:20:52.666481] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-22T22:20:52.669792] [INFO ] [MAIN ] Derivative Progress: 845/2091 symbols completed. HAL took 1.2s. Estimated remaining: 8m 4s. Rate: 154.6 symbols/min [2025-09-22T22:20:52.670162] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:52.692784] [DEBUG] [LOCAL ] HBB: Loaded 6937 existing records from primary storage. [2025-09-22T22:20:52.693936] [INFO ] [MAIN ] HBB: Loaded 6937 primary data records. [2025-09-22T22:20:52.707160] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-09-22T22:20:52.728298] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-22T22:20:52.757017] [INFO ] [MAIN ] Derivative Progress: 846/2091 symbols completed. HAYW took 1.3s. Estimated remaining: 8m 3s. Rate: 154.7 symbols/min [2025-09-22T22:20:52.807733] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:53.049127] [DEBUG] [LOCAL ] HBI: Loaded 53019 existing records from primary storage. [2025-09-22T22:20:53.049899] [INFO ] [MAIN ] HBI: Loaded 53019 primary data records. [2025-09-22T22:20:53.390620] [DEBUG] [LOCAL ] HBM: Loaded 52908 existing records from primary storage. [2025-09-22T22:20:53.391495] [INFO ] [MAIN ] HBM: Loaded 52908 primary data records. [2025-09-22T22:20:53.607183] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:53.639513] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6937 primary records. [2025-09-22T22:20:53.660829] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-22T22:20:53.848764] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-09-22T22:20:53.850010] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-22T22:20:53.852142] [INFO ] [MAIN ] Derivative Progress: 847/2091 symbols completed. HBB took 1.2s. Estimated remaining: 8m 3s. Rate: 154.4 symbols/min [2025-09-22T22:20:53.852796] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:53.872548] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:53.873856] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 53019 primary records. [2025-09-22T22:20:53.873984] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-22T22:20:53.890327] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-09-22T22:20:53.890714] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-22T22:20:53.893372] [INFO ] [MAIN ] Derivative Progress: 848/2091 symbols completed. HBI took 1.2s. Estimated remaining: 8m 2s. Rate: 154.6 symbols/min [2025-09-22T22:20:53.894110] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:53.912316] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:53.913154] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52908 primary records. [2025-09-22T22:20:53.913279] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-22T22:20:53.940758] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-09-22T22:20:53.940951] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-22T22:20:53.943122] [INFO ] [MAIN ] Derivative Progress: 849/2091 symbols completed. HBM took 1.2s. Estimated remaining: 8m 2s. Rate: 154.7 symbols/min [2025-09-22T22:20:53.946667] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:53.970171] [DEBUG] [LOCAL ] HCA: Loaded 47317 existing records from primary storage. [2025-09-22T22:20:53.970513] [INFO ] [MAIN ] HCA: Loaded 47317 primary data records. [2025-09-22T22:20:54.096366] [DEBUG] [LOCAL ] HCC: Loaded 45340 existing records from primary storage. [2025-09-22T22:20:54.096618] [INFO ] [MAIN ] HCC: Loaded 45340 primary data records. [2025-09-22T22:20:54.112807] [DEBUG] [LOCAL ] HCI: Loaded 13850 existing records from primary storage. [2025-09-22T22:20:54.184818] [INFO ] [MAIN ] HCI: Loaded 13850 primary data records. [2025-09-22T22:20:54.951183] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:54.952564] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 47317 primary records. [2025-09-22T22:20:54.965535] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-22T22:20:54.966735] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:54.967928] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45340 primary records. [2025-09-22T22:20:54.968288] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-22T22:20:55.009482] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-09-22T22:20:55.015270] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-22T22:20:55.017767] [INFO ] [MAIN ] Derivative Progress: 850/2091 symbols completed. HCC took 1.1s. Estimated remaining: 8m 2s. Rate: 154.4 symbols/min [2025-09-22T22:20:55.019311] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-09-22T22:20:55.020042] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:55.019783] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:55.021006] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 13850 primary records. [2025-09-22T22:20:55.021126] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-22T22:20:55.021402] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-22T22:20:55.023639] [INFO ] [MAIN ] Derivative Progress: 851/2091 symbols completed. HCA took 1.2s. Estimated remaining: 8m 1s. Rate: 154.6 symbols/min [2025-09-22T22:20:55.024864] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:55.041920] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-09-22T22:20:55.042134] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-22T22:20:55.044681] [INFO ] [MAIN ] Derivative Progress: 852/2091 symbols completed. HCI took 1.1s. Estimated remaining: 8m 0s. Rate: 154.8 symbols/min [2025-09-22T22:20:55.045019] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:55.114262] [DEBUG] [LOCAL ] HDB: Loaded 51938 existing records from primary storage. [2025-09-22T22:20:55.140199] [INFO ] [MAIN ] HDB: Loaded 51938 primary data records. [2025-09-22T22:20:55.147577] [DEBUG] [LOCAL ] HE: Loaded 49245 existing records from primary storage. [2025-09-22T22:20:55.227454] [INFO ] [MAIN ] HE: Loaded 49245 primary data records. [2025-09-22T22:20:55.284319] [DEBUG] [LOCAL ] HD: Loaded 53519 existing records from primary storage. [2025-09-22T22:20:55.328158] [INFO ] [MAIN ] HD: Loaded 53519 primary data records. [2025-09-22T22:20:56.184418] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:56.185955] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51938 primary records. [2025-09-22T22:20:56.186628] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-22T22:20:56.209639] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-09-22T22:20:56.210115] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-22T22:20:56.221052] [INFO ] [MAIN ] Derivative Progress: 853/2091 symbols completed. HDB took 1.2s. Estimated remaining: 8m 1s. Rate: 154.4 symbols/min [2025-09-22T22:20:56.228734] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:56.242371] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:56.242116] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53519 primary records. [2025-09-22T22:20:56.242475] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-22T22:20:56.243064] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 49245 primary records. [2025-09-22T22:20:56.243401] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-22T22:20:56.275207] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-09-22T22:20:56.274148] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-09-22T22:20:56.275322] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-22T22:20:56.277853] [INFO ] [MAIN ] Derivative Progress: 854/2091 symbols completed. HD took 1.3s. Estimated remaining: 8m 0s. Rate: 154.6 symbols/min [2025-09-22T22:20:56.275412] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-22T22:20:56.280537] [INFO ] [MAIN ] Derivative Progress: 855/2091 symbols completed. HE took 1.2s. Estimated remaining: 7m 59s. Rate: 154.7 symbols/min [2025-09-22T22:20:56.281431] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:56.281200] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:56.281345] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:56.293241] [DEBUG] [LOCAL ] HEQ: Loaded 6186 existing records from primary storage. [2025-09-22T22:20:56.293427] [INFO ] [MAIN ] HEQ: Loaded 6186 primary data records. [2025-09-22T22:20:56.654257] [DEBUG] [LOCAL ] HEI: Loaded 32667 existing records from primary storage. [2025-09-22T22:20:56.671056] [INFO ] [MAIN ] HEI: Loaded 32667 primary data records. [2025-09-22T22:20:56.673526] [DEBUG] [LOCAL ] HESM: Loaded 48154 existing records from primary storage. [2025-09-22T22:20:56.674023] [INFO ] [MAIN ] HESM: Loaded 48154 primary data records. [2025-09-22T22:20:57.559600] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:57.561419] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6186 primary records. [2025-09-22T22:20:57.561988] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-22T22:20:57.592332] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-09-22T22:20:57.593247] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-22T22:20:57.596240] [INFO ] [MAIN ] Derivative Progress: 856/2091 symbols completed. HEQ took 1.3s. Estimated remaining: 8m 0s. Rate: 154.3 symbols/min [2025-09-22T22:20:57.597693] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:57.617990] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:57.628159] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48154 primary records. [2025-09-22T22:20:57.634879] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-22T22:20:57.657132] [DEBUG] [LOCAL ] HFRO: Loaded 17449 existing records from primary storage. [2025-09-22T22:20:57.656553] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:57.658489] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 32667 primary records. [2025-09-22T22:20:57.658731] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-22T22:20:57.658635] [INFO ] [MAIN ] HFRO: Loaded 17449 primary data records. [2025-09-22T22:20:57.818581] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-09-22T22:20:57.823906] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-22T22:20:57.843606] [INFO ] [MAIN ] Derivative Progress: 857/2091 symbols completed. HESM took 1.6s. Estimated remaining: 7m 60s. Rate: 154.4 symbols/min [2025-09-22T22:20:57.865046] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:57.882814] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-09-22T22:20:57.900996] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-22T22:20:57.928584] [INFO ] [MAIN ] Derivative Progress: 858/2091 symbols completed. HEI took 1.6s. Estimated remaining: 7m 59s. Rate: 154.5 symbols/min [2025-09-22T22:20:58.053604] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:58.067552] [DEBUG] [LOCAL ] HGER: Loaded 12907 existing records from primary storage. [2025-09-22T22:20:58.070252] [INFO ] [MAIN ] HGER: Loaded 12907 primary data records. [2025-09-22T22:20:58.120004] [DEBUG] [LOCAL ] HGLB: Loaded 9732 existing records from primary storage. [2025-09-22T22:20:58.154190] [INFO ] [MAIN ] HGLB: Loaded 9732 primary data records. [2025-09-22T22:20:58.745429] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:58.746383] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17449 primary records. [2025-09-22T22:20:58.746677] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-22T22:20:58.766825] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-09-22T22:20:58.767345] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-22T22:20:58.769467] [INFO ] [MAIN ] Derivative Progress: 859/2091 symbols completed. HFRO took 1.2s. Estimated remaining: 7m 59s. Rate: 154.3 symbols/min [2025-09-22T22:20:58.770062] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:58.798772] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:58.805332] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 12907 primary records. [2025-09-22T22:20:58.805433] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-22T22:20:58.804629] [DEBUG] [LOCAL ] HGTY: Loaded 13004 existing records from primary storage. [2025-09-22T22:20:58.805599] [INFO ] [MAIN ] HGTY: Loaded 13004 primary data records. [2025-09-22T22:20:58.942967] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-09-22T22:20:58.938099] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:58.943154] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-22T22:20:58.946687] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9732 primary records. [2025-09-22T22:20:58.945825] [INFO ] [MAIN ] Derivative Progress: 860/2091 symbols completed. HGER took 1.1s. Estimated remaining: 7m 58s. Rate: 154.4 symbols/min [2025-09-22T22:20:58.946851] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-22T22:20:58.948149] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:59.043779] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-09-22T22:20:59.163925] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-22T22:20:59.166564] [INFO ] [MAIN ] Derivative Progress: 861/2091 symbols completed. HGLB took 1.1s. Estimated remaining: 7m 58s. Rate: 154.5 symbols/min [2025-09-22T22:20:59.167140] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:59.201162] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:20:59.219907] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13004 primary records. [2025-09-22T22:20:59.220156] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-22T22:20:59.236666] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-09-22T22:20:59.246790] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-22T22:20:59.249477] [INFO ] [MAIN ] Derivative Progress: 862/2091 symbols completed. HGTY took 0.5s. Estimated remaining: 7m 57s. Rate: 154.6 symbols/min [2025-09-22T22:20:59.250067] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:20:59.263932] [DEBUG] [LOCAL ] HHH: Loaded 32676 existing records from primary storage. [2025-09-22T22:20:59.264213] [INFO ] [MAIN ] HHH: Loaded 32676 primary data records. [2025-09-22T22:20:59.276706] [DEBUG] [LOCAL ] HGV: Loaded 47015 existing records from primary storage. [2025-09-22T22:20:59.303491] [INFO ] [MAIN ] HGV: Loaded 47015 primary data records. [2025-09-22T22:20:59.899148] [DEBUG] [LOCAL ] HI: Loaded 35066 existing records from primary storage. [2025-09-22T22:20:59.899998] [INFO ] [MAIN ] HI: Loaded 35066 primary data records. [2025-09-22T22:21:00.292310] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:00.293430] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32676 primary records. [2025-09-22T22:21:00.293970] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-22T22:21:00.316322] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:00.319883] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 47015 primary records. [2025-09-22T22:21:00.322375] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-22T22:21:00.326190] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-09-22T22:21:00.333434] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-22T22:21:00.336849] [INFO ] [MAIN ] Derivative Progress: 863/2091 symbols completed. HHH took 1.2s. Estimated remaining: 7m 58s. Rate: 154.3 symbols/min [2025-09-22T22:21:00.340231] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:00.345624] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-09-22T22:21:00.345991] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-22T22:21:00.348077] [INFO ] [MAIN ] Derivative Progress: 864/2091 symbols completed. HGV took 1.4s. Estimated remaining: 7m 57s. Rate: 154.5 symbols/min [2025-09-22T22:21:00.348392] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:00.368941] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:00.369810] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35066 primary records. [2025-09-22T22:21:00.370102] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-22T22:21:00.399122] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-09-22T22:21:00.399297] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-22T22:21:00.401882] [INFO ] [MAIN ] Derivative Progress: 865/2091 symbols completed. HI took 1.2s. Estimated remaining: 7m 56s. Rate: 154.6 symbols/min [2025-09-22T22:21:00.402463] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:00.428869] [DEBUG] [LOCAL ] HII: Loaded 35414 existing records from primary storage. [2025-09-22T22:21:00.429084] [INFO ] [MAIN ] HII: Loaded 35414 primary data records. [2025-09-22T22:21:00.565321] [DEBUG] [LOCAL ] HIG: Loaded 51259 existing records from primary storage. [2025-09-22T22:21:00.575861] [INFO ] [MAIN ] HIG: Loaded 51259 primary data records. [2025-09-22T22:21:01.089191] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-22T22:21:01.090857] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-09-22T22:21:01.432052] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:01.432926] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 35414 primary records. [2025-09-22T22:21:01.434119] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-22T22:21:01.476490] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:01.479063] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51259 primary records. [2025-09-22T22:21:01.479699] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-22T22:21:01.481308] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-09-22T22:21:01.481674] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-22T22:21:01.483713] [INFO ] [MAIN ] Derivative Progress: 866/2091 symbols completed. HII took 1.1s. Estimated remaining: 7m 56s. Rate: 154.3 symbols/min [2025-09-22T22:21:01.500113] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:01.507149] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-09-22T22:21:01.507524] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-22T22:21:01.510055] [INFO ] [MAIN ] Derivative Progress: 867/2091 symbols completed. HIG took 1.2s. Estimated remaining: 7m 55s. Rate: 154.5 symbols/min [2025-09-22T22:21:01.512886] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:01.539319] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:01.540374] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-09-22T22:21:01.540495] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-22T22:21:01.549420] [DEBUG] [LOCAL ] HIO: Loaded 23761 existing records from primary storage. [2025-09-22T22:21:01.549734] [INFO ] [MAIN ] HIO: Loaded 23761 primary data records. [2025-09-22T22:21:01.631603] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-09-22T22:21:01.649216] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-22T22:21:01.670045] [INFO ] [MAIN ] Derivative Progress: 868/2091 symbols completed. HIMS took 1.3s. Estimated remaining: 7m 55s. Rate: 154.6 symbols/min [2025-09-22T22:21:01.702244] [DEBUG] [LOCAL ] HIPO: Loaded 22871 existing records from primary storage. [2025-09-22T22:21:01.702428] [INFO ] [MAIN ] HIPO: Loaded 22871 primary data records. [2025-09-22T22:21:02.234628] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:02.235404] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 23761 primary records. [2025-09-22T22:21:02.235561] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-22T22:21:02.267319] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-09-22T22:21:02.266581] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:02.268128] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-22T22:21:02.270080] [INFO ] [MAIN ] Derivative Progress: 869/2091 symbols completed. HIO took 0.8s. Estimated remaining: 7m 55s. Rate: 154.5 symbols/min [2025-09-22T22:21:02.268074] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 22871 primary records. [2025-09-22T22:21:02.270200] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-22T22:21:02.285342] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-09-22T22:21:02.285402] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-22T22:21:02.287942] [INFO ] [MAIN ] Derivative Progress: 870/2091 symbols completed. HIPO took 0.8s. Estimated remaining: 7m 54s. Rate: 154.6 symbols/min [2025-09-22T22:21:02.288532] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:02.288441] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:02.289311] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:02.320523] [DEBUG] [LOCAL ] HIX: Loaded 20268 existing records from primary storage. [2025-09-22T22:21:02.320803] [INFO ] [MAIN ] HIX: Loaded 20268 primary data records. [2025-09-22T22:21:02.320049] [DEBUG] [LOCAL ] HKD: Loaded 18201 existing records from primary storage. [2025-09-22T22:21:02.320892] [INFO ] [MAIN ] HKD: Loaded 18201 primary data records. [2025-09-22T22:21:02.591135] [DEBUG] [LOCAL ] HIW: Loaded 44755 existing records from primary storage. [2025-09-22T22:21:02.624997] [INFO ] [MAIN ] HIW: Loaded 44755 primary data records. [2025-09-22T22:21:03.330257] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:03.331462] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18201 primary records. [2025-09-22T22:21:03.331626] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-22T22:21:03.345122] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:03.345848] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20268 primary records. [2025-09-22T22:21:03.352896] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-22T22:21:03.362359] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-09-22T22:21:03.362461] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-22T22:21:03.376186] [INFO ] [MAIN ] Derivative Progress: 871/2091 symbols completed. HKD took 1.1s. Estimated remaining: 7m 54s. Rate: 154.3 symbols/min [2025-09-22T22:21:03.377284] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:03.392880] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:03.394600] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44755 primary records. [2025-09-22T22:21:03.395427] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-22T22:21:03.397186] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-09-22T22:21:03.397490] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-22T22:21:03.399951] [INFO ] [MAIN ] Derivative Progress: 872/2091 symbols completed. HIX took 1.1s. Estimated remaining: 7m 53s. Rate: 154.5 symbols/min [2025-09-22T22:21:03.408828] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:03.418996] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-09-22T22:21:03.419266] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-22T22:21:03.421997] [INFO ] [MAIN ] Derivative Progress: 873/2091 symbols completed. HIW took 1.1s. Estimated remaining: 7m 53s. Rate: 154.7 symbols/min [2025-09-22T22:21:03.422403] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:03.502699] [DEBUG] [LOCAL ] HL: Loaded 53670 existing records from primary storage. [2025-09-22T22:21:03.503508] [DEBUG] [LOCAL ] HLF: Loaded 48773 existing records from primary storage. [2025-09-22T22:21:03.503722] [INFO ] [MAIN ] HLF: Loaded 48773 primary data records. [2025-09-22T22:21:03.503627] [INFO ] [MAIN ] HL: Loaded 53670 primary data records. [2025-09-22T22:21:03.689726] [DEBUG] [LOCAL ] HLI: Loaded 31269 existing records from primary storage. [2025-09-22T22:21:03.729879] [INFO ] [MAIN ] HLI: Loaded 31269 primary data records. [2025-09-22T22:21:04.524366] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:04.537765] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48773 primary records. [2025-09-22T22:21:04.538199] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:04.538587] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-22T22:21:04.539242] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53670 primary records. [2025-09-22T22:21:04.539334] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-22T22:21:04.578940] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-09-22T22:21:04.579689] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-22T22:21:04.583240] [INFO ] [MAIN ] Derivative Progress: 874/2091 symbols completed. HLF took 1.2s. Estimated remaining: 7m 53s. Rate: 154.3 symbols/min [2025-09-22T22:21:04.584146] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:04.600505] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:04.602155] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 31269 primary records. [2025-09-22T22:21:04.602348] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-22T22:21:04.604966] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-09-22T22:21:04.612385] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-22T22:21:04.616383] [INFO ] [MAIN ] Derivative Progress: 875/2091 symbols completed. HL took 1.2s. Estimated remaining: 7m 52s. Rate: 154.5 symbols/min [2025-09-22T22:21:04.616697] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:04.634974] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-09-22T22:21:04.635168] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-22T22:21:04.637477] [INFO ] [MAIN ] Derivative Progress: 876/2091 symbols completed. HLI took 1.2s. Estimated remaining: 7m 51s. Rate: 154.6 symbols/min [2025-09-22T22:21:04.637867] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:04.649578] [DEBUG] [LOCAL ] HLIO: Loaded 28176 existing records from primary storage. [2025-09-22T22:21:04.649791] [INFO ] [MAIN ] HLIO: Loaded 28176 primary data records. [2025-09-22T22:21:04.815861] [DEBUG] [LOCAL ] HLLY: Loaded 33370 existing records from primary storage. [2025-09-22T22:21:04.870387] [INFO ] [MAIN ] HLLY: Loaded 33370 primary data records. [2025-09-22T22:21:05.087926] [DEBUG] [LOCAL ] HLN: Loaded 53089 existing records from primary storage. [2025-09-22T22:21:05.116076] [INFO ] [MAIN ] HLN: Loaded 53089 primary data records. [2025-09-22T22:21:05.662956] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:05.664070] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28176 primary records. [2025-09-22T22:21:05.664320] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-22T22:21:05.682703] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-09-22T22:21:05.682818] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-22T22:21:05.684812] [INFO ] [MAIN ] Derivative Progress: 877/2091 symbols completed. HLIO took 1.1s. Estimated remaining: 7m 52s. Rate: 154.3 symbols/min [2025-09-22T22:21:05.685256] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:05.703818] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:05.704530] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33370 primary records. [2025-09-22T22:21:05.704752] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-22T22:21:05.737256] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:05.736889] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-09-22T22:21:05.737406] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-22T22:21:05.740410] [INFO ] [MAIN ] Derivative Progress: 878/2091 symbols completed. HLLY took 1.1s. Estimated remaining: 7m 51s. Rate: 154.5 symbols/min [2025-09-22T22:21:05.738125] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53089 primary records. [2025-09-22T22:21:05.740785] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:05.740957] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-22T22:21:05.770921] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-09-22T22:21:05.771217] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-22T22:21:05.773562] [INFO ] [MAIN ] Derivative Progress: 879/2091 symbols completed. HLN took 1.1s. Estimated remaining: 7m 50s. Rate: 154.6 symbols/min [2025-09-22T22:21:05.773953] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:05.793234] [DEBUG] [LOCAL ] HLT: Loaded 50774 existing records from primary storage. [2025-09-22T22:21:05.793495] [INFO ] [MAIN ] HLT: Loaded 50774 primary data records. [2025-09-22T22:21:06.023872] [DEBUG] [LOCAL ] HLX: Loaded 48084 existing records from primary storage. [2025-09-22T22:21:06.149687] [INFO ] [MAIN ] HLX: Loaded 48084 primary data records. [2025-09-22T22:21:06.180884] [DEBUG] [LOCAL ] HMC: Loaded 46929 existing records from primary storage. [2025-09-22T22:21:06.204378] [INFO ] [MAIN ] HMC: Loaded 46929 primary data records. [2025-09-22T22:21:06.857418] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:06.859060] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50774 primary records. [2025-09-22T22:21:06.859161] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-22T22:21:06.878464] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-09-22T22:21:06.880203] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-22T22:21:06.882749] [INFO ] [MAIN ] Derivative Progress: 880/2091 symbols completed. HLT took 1.2s. Estimated remaining: 7m 51s. Rate: 154.3 symbols/min [2025-09-22T22:21:06.883258] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:06.902693] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:06.905073] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 48084 primary records. [2025-09-22T22:21:06.905867] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-22T22:21:06.936324] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:06.938454] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46929 primary records. [2025-09-22T22:21:06.945623] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-22T22:21:06.958509] [DEBUG] [LOCAL ] HMN: Loaded 23306 existing records from primary storage. [2025-09-22T22:21:06.950020] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-09-22T22:21:06.958679] [INFO ] [MAIN ] HMN: Loaded 23306 primary data records. [2025-09-22T22:21:06.963936] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-22T22:21:06.972806] [INFO ] [MAIN ] Derivative Progress: 881/2091 symbols completed. HLX took 1.2s. Estimated remaining: 7m 50s. Rate: 154.5 symbols/min [2025-09-22T22:21:06.980234] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-09-22T22:21:07.001429] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-22T22:21:06.973070] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:07.039298] [INFO ] [MAIN ] Derivative Progress: 882/2091 symbols completed. HMC took 1.3s. Estimated remaining: 7m 49s. Rate: 154.6 symbols/min [2025-09-22T22:21:07.069351] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:07.321843] [DEBUG] [LOCAL ] HNI: Loaded 28782 existing records from primary storage. [2025-09-22T22:21:07.322186] [INFO ] [MAIN ] HNI: Loaded 28782 primary data records. [2025-09-22T22:21:07.433072] [DEBUG] [LOCAL ] HMY: Loaded 53128 existing records from primary storage. [2025-09-22T22:21:07.444718] [INFO ] [MAIN ] HMY: Loaded 53128 primary data records. [2025-09-22T22:21:07.808825] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:07.830986] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23306 primary records. [2025-09-22T22:21:07.966668] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-22T22:21:07.998276] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-09-22T22:21:07.999054] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-22T22:21:08.001300] [INFO ] [MAIN ] Derivative Progress: 883/2091 symbols completed. HMN took 1.1s. Estimated remaining: 7m 50s. Rate: 154.3 symbols/min [2025-09-22T22:21:08.031380] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:08.032575] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 28782 primary records. [2025-09-22T22:21:08.033486] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-22T22:21:08.060787] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:08.061987] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53128 primary records. [2025-09-22T22:21:08.062283] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-22T22:21:08.082013] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-09-22T22:21:08.080828] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-09-22T22:21:08.082262] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-22T22:21:08.082175] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-22T22:21:08.084258] [INFO ] [MAIN ] Derivative Progress: 884/2091 symbols completed. HNI took 1.0s. Estimated remaining: 7m 49s. Rate: 154.5 symbols/min [2025-09-22T22:21:08.087308] [INFO ] [MAIN ] Derivative Progress: 885/2091 symbols completed. HMY took 1.1s. Estimated remaining: 7m 48s. Rate: 154.7 symbols/min [2025-09-22T22:21:08.087991] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:08.088200] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:08.088096] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:08.151049] [DEBUG] [LOCAL ] HOMB: Loaded 43641 existing records from primary storage. [2025-09-22T22:21:08.151309] [INFO ] [MAIN ] HOMB: Loaded 43641 primary data records. [2025-09-22T22:21:08.284015] [DEBUG] [LOCAL ] HOUS: Loaded 44037 existing records from primary storage. [2025-09-22T22:21:08.295087] [INFO ] [MAIN ] HOUS: Loaded 44037 primary data records. [2025-09-22T22:21:08.450964] [DEBUG] [LOCAL ] HOG: Loaded 51269 existing records from primary storage. [2025-09-22T22:21:08.532078] [INFO ] [MAIN ] HOG: Loaded 51269 primary data records. [2025-09-22T22:21:09.188896] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:09.189917] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43641 primary records. [2025-09-22T22:21:09.190299] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-22T22:21:09.211297] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-09-22T22:21:09.230478] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-22T22:21:09.232087] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:09.234112] [INFO ] [MAIN ] Derivative Progress: 886/2091 symbols completed. HOMB took 1.1s. Estimated remaining: 7m 49s. Rate: 154.3 symbols/min [2025-09-22T22:21:09.236858] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:09.235726] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 44037 primary records. [2025-09-22T22:21:09.237939] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-22T22:21:09.269785] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:09.271518] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51269 primary records. [2025-09-22T22:21:09.272156] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-22T22:21:09.295565] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-09-22T22:21:09.296327] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-22T22:21:09.306197] [DEBUG] [LOCAL ] HOV: Loaded 13753 existing records from primary storage. [2025-09-22T22:21:09.304990] [INFO ] [MAIN ] Derivative Progress: 887/2091 symbols completed. HOUS took 1.2s. Estimated remaining: 7m 48s. Rate: 154.5 symbols/min [2025-09-22T22:21:09.307270] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:09.306615] [INFO ] [MAIN ] HOV: Loaded 13753 primary data records. [2025-09-22T22:21:09.329822] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-09-22T22:21:09.353248] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-22T22:21:09.356090] [INFO ] [MAIN ] Derivative Progress: 888/2091 symbols completed. HOG took 1.3s. Estimated remaining: 7m 47s. Rate: 154.6 symbols/min [2025-09-22T22:21:09.383767] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:09.691734] [DEBUG] [LOCAL ] HP: Loaded 51601 existing records from primary storage. [2025-09-22T22:21:09.692539] [INFO ] [MAIN ] HP: Loaded 51601 primary data records. [2025-09-22T22:21:09.800485] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-22T22:21:09.812076] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-09-22T22:21:09.873962] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:09.899784] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13753 primary records. [2025-09-22T22:21:09.941157] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-22T22:21:10.169517] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-09-22T22:21:10.180450] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-22T22:21:10.183046] [INFO ] [MAIN ] Derivative Progress: 889/2091 symbols completed. HOV took 0.9s. Estimated remaining: 7m 47s. Rate: 154.4 symbols/min [2025-09-22T22:21:10.222566] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:10.388682] [DEBUG] [LOCAL ] HPF: Loaded 7280 existing records from primary storage. [2025-09-22T22:21:10.389175] [INFO ] [MAIN ] HPF: Loaded 7280 primary data records. [2025-09-22T22:21:10.543871] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:10.569378] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51601 primary records. [2025-09-22T22:21:10.580529] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-22T22:21:10.800262] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-09-22T22:21:10.800760] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-22T22:21:10.804293] [INFO ] [MAIN ] Derivative Progress: 890/2091 symbols completed. HP took 1.5s. Estimated remaining: 7m 47s. Rate: 154.3 symbols/min [2025-09-22T22:21:10.812464] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:10.818297] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:10.819541] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-09-22T22:21:10.819815] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-22T22:21:10.841851] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-09-22T22:21:10.842082] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-22T22:21:10.844411] [INFO ] [MAIN ] Derivative Progress: 891/2091 symbols completed. HPE took 1.5s. Estimated remaining: 7m 46s. Rate: 154.5 symbols/min [2025-09-22T22:21:10.845036] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:10.851751] [DEBUG] [LOCAL ] HPI: Loaded 10105 existing records from primary storage. [2025-09-22T22:21:10.851922] [INFO ] [MAIN ] HPI: Loaded 10105 primary data records. [2025-09-22T22:21:11.000015] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:11.027436] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7280 primary records. [2025-09-22T22:21:11.062734] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-22T22:21:11.228894] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-09-22T22:21:11.229461] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-22T22:21:11.232247] [INFO ] [MAIN ] Derivative Progress: 892/2091 symbols completed. HPF took 1.0s. Estimated remaining: 7m 46s. Rate: 154.5 symbols/min [2025-09-22T22:21:11.233992] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:11.249463] [DEBUG] [LOCAL ] HPP: Loaded 50793 existing records from primary storage. [2025-09-22T22:21:11.249728] [INFO ] [MAIN ] HPP: Loaded 50793 primary data records. [2025-09-22T22:21:11.586479] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:11.587721] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10105 primary records. [2025-09-22T22:21:11.588085] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-22T22:21:11.604843] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-09-22T22:21:11.605200] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-22T22:21:11.607249] [INFO ] [MAIN ] Derivative Progress: 893/2091 symbols completed. HPI took 0.8s. Estimated remaining: 7m 45s. Rate: 154.5 symbols/min [2025-09-22T22:21:11.627397] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:11.630996] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-22T22:21:11.631228] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-09-22T22:21:11.729930] [DEBUG] [LOCAL ] HPS: Loaded 10262 existing records from primary storage. [2025-09-22T22:21:11.749106] [INFO ] [MAIN ] HPS: Loaded 10262 primary data records. [2025-09-22T22:21:12.238090] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:12.255634] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 50793 primary records. [2025-09-22T22:21:12.256421] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-22T22:21:12.275925] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-09-22T22:21:12.277213] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-22T22:21:12.279661] [INFO ] [MAIN ] Derivative Progress: 894/2091 symbols completed. HPP took 1.4s. Estimated remaining: 7m 45s. Rate: 154.3 symbols/min [2025-09-22T22:21:12.280036] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:12.308410] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:12.310716] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-09-22T22:21:12.310862] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-22T22:21:12.354932] [DEBUG] [LOCAL ] HQH: Loaded 24877 existing records from primary storage. [2025-09-22T22:21:12.355502] [INFO ] [MAIN ] HQH: Loaded 24877 primary data records. [2025-09-22T22:21:12.354426] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:12.356722] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10262 primary records. [2025-09-22T22:21:12.357439] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-09-22T22:21:12.379430] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-22T22:21:12.379350] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-22T22:21:12.401757] [INFO ] [MAIN ] Derivative Progress: 895/2091 symbols completed. HPQ took 1.2s. Estimated remaining: 7m 45s. Rate: 154.5 symbols/min [2025-09-22T22:21:12.437349] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:12.545696] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-09-22T22:21:12.566755] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-22T22:21:12.718401] [INFO ] [MAIN ] Derivative Progress: 896/2091 symbols completed. HPS took 0.9s. Estimated remaining: 7m 44s. Rate: 154.5 symbols/min [2025-09-22T22:21:12.727704] [DEBUG] [LOCAL ] HQL: Loaded 15995 existing records from primary storage. [2025-09-22T22:21:12.728018] [INFO ] [MAIN ] HQL: Loaded 15995 primary data records. [2025-09-22T22:21:12.749577] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:13.073751] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:13.074827] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 24877 primary records. [2025-09-22T22:21:13.074999] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-22T22:21:13.104902] [DEBUG] [LOCAL ] HR: Loaded 51967 existing records from primary storage. [2025-09-22T22:21:13.105821] [INFO ] [MAIN ] HR: Loaded 51967 primary data records. [2025-09-22T22:21:13.119284] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-09-22T22:21:13.140377] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-22T22:21:13.142700] [INFO ] [MAIN ] Derivative Progress: 897/2091 symbols completed. HQH took 0.9s. Estimated remaining: 7m 44s. Rate: 154.5 symbols/min [2025-09-22T22:21:13.156043] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:13.261221] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:13.277715] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 15995 primary records. [2025-09-22T22:21:13.327338] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-22T22:21:13.486440] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-09-22T22:21:13.486807] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-22T22:21:13.488870] [INFO ] [MAIN ] Derivative Progress: 898/2091 symbols completed. HQL took 1.1s. Estimated remaining: 7m 43s. Rate: 154.5 symbols/min [2025-09-22T22:21:13.510480] [DEBUG] [LOCAL ] HRB: Loaded 48621 existing records from primary storage. [2025-09-22T22:21:13.510893] [INFO ] [MAIN ] HRB: Loaded 48621 primary data records. [2025-09-22T22:21:13.639225] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:13.655323] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51967 primary records. [2025-09-22T22:21:13.668029] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-22T22:21:13.841410] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-09-22T22:21:13.841544] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-22T22:21:13.843664] [INFO ] [MAIN ] Derivative Progress: 899/2091 symbols completed. HR took 1.1s. Estimated remaining: 7m 43s. Rate: 154.5 symbols/min [2025-09-22T22:21:13.864956] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:13.865598] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48621 primary records. [2025-09-22T22:21:13.865687] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-22T22:21:13.880621] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-09-22T22:21:13.880711] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-22T22:21:13.882631] [INFO ] [MAIN ] Derivative Progress: 900/2091 symbols completed. HRB took 0.7s. Estimated remaining: 7m 42s. Rate: 154.7 symbols/min [2025-09-22T22:21:13.883475] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:13.883304] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:13.883367] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:13.945345] [DEBUG] [LOCAL ] HRTG: Loaded 32764 existing records from primary storage. [2025-09-22T22:21:13.959367] [INFO ] [MAIN ] HRTG: Loaded 32764 primary data records. [2025-09-22T22:21:13.982133] [DEBUG] [LOCAL ] HRI: Loaded 33152 existing records from primary storage. [2025-09-22T22:21:14.006285] [INFO ] [MAIN ] HRI: Loaded 33152 primary data records. [2025-09-22T22:21:14.170830] [DEBUG] [LOCAL ] HRL: Loaded 53077 existing records from primary storage. [2025-09-22T22:21:14.241680] [INFO ] [MAIN ] HRL: Loaded 53077 primary data records. [2025-09-22T22:21:14.997015] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:14.997982] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 32764 primary records. [2025-09-22T22:21:14.998330] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-22T22:21:15.011551] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:15.024023] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 33152 primary records. [2025-09-22T22:21:15.026398] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-22T22:21:15.029057] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-09-22T22:21:15.029220] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-22T22:21:15.031035] [INFO ] [MAIN ] Derivative Progress: 901/2091 symbols completed. HRTG took 1.1s. Estimated remaining: 7m 43s. Rate: 154.3 symbols/min [2025-09-22T22:21:15.039245] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:15.048982] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-09-22T22:21:15.049587] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-22T22:21:15.056668] [INFO ] [MAIN ] Derivative Progress: 902/2091 symbols completed. HRI took 1.2s. Estimated remaining: 7m 42s. Rate: 154.5 symbols/min [2025-09-22T22:21:15.057190] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:15.070522] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:15.071239] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53077 primary records. [2025-09-22T22:21:15.071301] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-22T22:21:15.098893] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-09-22T22:21:15.098231] [DEBUG] [LOCAL ] HSHP: Loaded 15572 existing records from primary storage. [2025-09-22T22:21:15.099093] [INFO ] [MAIN ] HSHP: Loaded 15572 primary data records. [2025-09-22T22:21:15.099215] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-22T22:21:15.102078] [INFO ] [MAIN ] Derivative Progress: 903/2091 symbols completed. HRL took 1.2s. Estimated remaining: 7m 41s. Rate: 154.6 symbols/min [2025-09-22T22:21:15.114168] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:15.271172] [DEBUG] [LOCAL ] HTD: Loaded 13500 existing records from primary storage. [2025-09-22T22:21:15.312526] [INFO ] [MAIN ] HTD: Loaded 13500 primary data records. [2025-09-22T22:21:15.573921] [DEBUG] [LOCAL ] HSY: Loaded 50458 existing records from primary storage. [2025-09-22T22:21:15.590816] [INFO ] [MAIN ] HSY: Loaded 50458 primary data records. [2025-09-22T22:21:16.111749] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:16.113425] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15572 primary records. [2025-09-22T22:21:16.113747] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-22T22:21:16.131715] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-09-22T22:21:16.132659] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-22T22:21:16.135341] [INFO ] [MAIN ] Derivative Progress: 904/2091 symbols completed. HSHP took 1.1s. Estimated remaining: 7m 41s. Rate: 154.4 symbols/min [2025-09-22T22:21:16.135777] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:16.149916] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:16.150609] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13500 primary records. [2025-09-22T22:21:16.150799] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-22T22:21:16.167465] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-09-22T22:21:16.167586] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-22T22:21:16.169400] [INFO ] [MAIN ] Derivative Progress: 905/2091 symbols completed. HTD took 1.1s. Estimated remaining: 7m 41s. Rate: 154.5 symbols/min [2025-09-22T22:21:16.169661] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:16.186632] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:16.187373] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50458 primary records. [2025-09-22T22:21:16.187568] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-22T22:21:16.203892] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-09-22T22:21:16.204088] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-22T22:21:16.206599] [INFO ] [MAIN ] Derivative Progress: 906/2091 symbols completed. HSY took 1.1s. Estimated remaining: 7m 40s. Rate: 154.7 symbols/min [2025-09-22T22:21:16.206999] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:16.239735] [DEBUG] [LOCAL ] HTH: Loaded 32579 existing records from primary storage. [2025-09-22T22:21:16.252395] [INFO ] [MAIN ] HTH: Loaded 32579 primary data records. [2025-09-22T22:21:16.259587] [DEBUG] [LOCAL ] HTGC: Loaded 47623 existing records from primary storage. [2025-09-22T22:21:16.265306] [INFO ] [MAIN ] HTGC: Loaded 47623 primary data records. [2025-09-22T22:21:16.683279] [DEBUG] [LOCAL ] HUBB: Loaded 37308 existing records from primary storage. [2025-09-22T22:21:16.726493] [INFO ] [MAIN ] HUBB: Loaded 37308 primary data records. [2025-09-22T22:21:17.311702] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:17.311046] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:17.312513] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32579 primary records. [2025-09-22T22:21:17.313242] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47623 primary records. [2025-09-22T22:21:17.313460] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-22T22:21:17.313517] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-22T22:21:17.342223] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-09-22T22:21:17.345872] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-22T22:21:17.347094] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-09-22T22:21:17.349494] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-22T22:21:17.349255] [INFO ] [MAIN ] Derivative Progress: 907/2091 symbols completed. HTGC took 1.2s. Estimated remaining: 7m 40s. Rate: 154.3 symbols/min [2025-09-22T22:21:17.351782] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:17.352215] [INFO ] [MAIN ] Derivative Progress: 908/2091 symbols completed. HTH took 1.2s. Estimated remaining: 7m 39s. Rate: 154.5 symbols/min [2025-09-22T22:21:17.353975] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:17.370760] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:17.371581] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 37308 primary records. [2025-09-22T22:21:17.371802] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-22T22:21:17.394283] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-09-22T22:21:17.394547] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-22T22:21:17.397537] [INFO ] [MAIN ] Derivative Progress: 909/2091 symbols completed. HUBB took 1.2s. Estimated remaining: 7m 39s. Rate: 154.7 symbols/min [2025-09-22T22:21:17.401539] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:17.445225] [DEBUG] [LOCAL ] HUBS: Loaded 39661 existing records from primary storage. [2025-09-22T22:21:17.458784] [INFO ] [MAIN ] HUBS: Loaded 39661 primary data records. [2025-09-22T22:21:17.459669] [DEBUG] [LOCAL ] HUM: Loaded 48899 existing records from primary storage. [2025-09-22T22:21:17.459884] [INFO ] [MAIN ] HUM: Loaded 48899 primary data records. [2025-09-22T22:21:17.953596] [DEBUG] [LOCAL ] HUN: Loaded 53203 existing records from primary storage. [2025-09-22T22:21:17.994245] [INFO ] [MAIN ] HUN: Loaded 53203 primary data records. [2025-09-22T22:21:18.448222] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:18.450839] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39661 primary records. [2025-09-22T22:21:18.452494] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-22T22:21:18.478347] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:18.480039] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 48899 primary records. [2025-09-22T22:21:18.480605] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-22T22:21:18.500177] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-09-22T22:21:18.500743] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-22T22:21:18.504289] [INFO ] [MAIN ] Derivative Progress: 910/2091 symbols completed. HUM took 1.2s. Estimated remaining: 7m 39s. Rate: 154.3 symbols/min [2025-09-22T22:21:18.506057] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:18.507995] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-09-22T22:21:18.508565] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-22T22:21:18.510596] [INFO ] [MAIN ] Derivative Progress: 911/2091 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 38s. Rate: 154.5 symbols/min [2025-09-22T22:21:18.511061] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:18.528858] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:18.529589] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53203 primary records. [2025-09-22T22:21:18.529790] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-22T22:21:18.551618] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-09-22T22:21:18.559007] [DEBUG] [LOCAL ] HVT: Loaded 16157 existing records from primary storage. [2025-09-22T22:21:18.558441] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-22T22:21:18.559162] [INFO ] [MAIN ] HVT: Loaded 16157 primary data records. [2025-09-22T22:21:18.562093] [INFO ] [MAIN ] Derivative Progress: 912/2091 symbols completed. HUN took 1.2s. Estimated remaining: 7m 37s. Rate: 154.7 symbols/min [2025-09-22T22:21:18.562391] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:18.746859] [DEBUG] [LOCAL ] HUYA: Loaded 44445 existing records from primary storage. [2025-09-22T22:21:18.778755] [INFO ] [MAIN ] HUYA: Loaded 44445 primary data records. [2025-09-22T22:21:19.132991] [DEBUG] [LOCAL ] HWM: Loaded 53021 existing records from primary storage. [2025-09-22T22:21:19.150173] [INFO ] [MAIN ] HWM: Loaded 53021 primary data records. [2025-09-22T22:21:19.609834] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:19.612942] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 16157 primary records. [2025-09-22T22:21:19.615062] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-22T22:21:19.630361] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:19.631625] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 44445 primary records. [2025-09-22T22:21:19.631836] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-22T22:21:19.663010] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-09-22T22:21:19.664272] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-22T22:21:19.666743] [INFO ] [MAIN ] Derivative Progress: 913/2091 symbols completed. HVT took 1.2s. Estimated remaining: 7m 38s. Rate: 154.3 symbols/min [2025-09-22T22:21:19.670348] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-09-22T22:21:19.670687] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-22T22:21:19.674105] [INFO ] [MAIN ] Derivative Progress: 914/2091 symbols completed. HUYA took 1.2s. Estimated remaining: 7m 37s. Rate: 154.5 symbols/min [2025-09-22T22:21:19.689047] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:19.689637] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 53021 primary records. [2025-09-22T22:21:19.689727] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-22T22:21:19.706708] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-09-22T22:21:19.706834] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-22T22:21:19.710713] [INFO ] [MAIN ] Derivative Progress: 915/2091 symbols completed. HWM took 1.1s. Estimated remaining: 7m 36s. Rate: 154.7 symbols/min [2025-09-22T22:21:19.711409] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:19.711306] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:19.712288] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:19.724528] [DEBUG] [LOCAL ] HY: Loaded 10144 existing records from primary storage. [2025-09-22T22:21:19.724687] [INFO ] [MAIN ] HY: Loaded 10144 primary data records. [2025-09-22T22:21:19.803264] [DEBUG] [LOCAL ] HYI: Loaded 8846 existing records from primary storage. [2025-09-22T22:21:19.809229] [INFO ] [MAIN ] HYI: Loaded 8846 primary data records. [2025-09-22T22:21:20.367055] [DEBUG] [LOCAL ] HXL: Loaded 46127 existing records from primary storage. [2025-09-22T22:21:20.368987] [INFO ] [MAIN ] HXL: Loaded 46127 primary data records. [2025-09-22T22:21:20.758729] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:20.772941] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:20.772605] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 10144 primary records. [2025-09-22T22:21:20.773745] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-22T22:21:20.773625] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 8846 primary records. [2025-09-22T22:21:20.775061] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-22T22:21:20.803987] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-09-22T22:21:20.804733] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-22T22:21:20.807221] [INFO ] [MAIN ] Derivative Progress: 916/2091 symbols completed. HY took 1.1s. Estimated remaining: 7m 37s. Rate: 154.4 symbols/min [2025-09-22T22:21:20.810273] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:20.813853] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-09-22T22:21:20.814444] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-22T22:21:20.817056] [INFO ] [MAIN ] Derivative Progress: 917/2091 symbols completed. HYI took 1.1s. Estimated remaining: 7m 36s. Rate: 154.5 symbols/min [2025-09-22T22:21:20.817523] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:20.826257] [DEBUG] [LOCAL ] HYTR: Loaded 3174 existing records from primary storage. [2025-09-22T22:21:20.834180] [INFO ] [MAIN ] HYTR: Loaded 3174 primary data records. [2025-09-22T22:21:20.852153] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:20.882249] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 46127 primary records. [2025-09-22T22:21:20.925633] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-22T22:21:21.003143] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-09-22T22:21:21.046027] [DEBUG] [LOCAL ] HYT: Loaded 33218 existing records from primary storage. [2025-09-22T22:21:21.045228] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-22T22:21:21.051078] [INFO ] [MAIN ] Derivative Progress: 918/2091 symbols completed. HXL took 1.3s. Estimated remaining: 7m 35s. Rate: 154.6 symbols/min [2025-09-22T22:21:21.051183] [INFO ] [MAIN ] HYT: Loaded 33218 primary data records. [2025-09-22T22:21:21.077220] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:21.526125] [DEBUG] [LOCAL ] HZO: Loaded 29378 existing records from primary storage. [2025-09-22T22:21:21.528002] [INFO ] [MAIN ] HZO: Loaded 29378 primary data records. [2025-09-22T22:21:21.655025] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-22T22:21:21.690677] [INFO ] [MAIN ] HYTR: Generated 1792 derivative records from 3174 primary records. [2025-09-22T22:21:21.731290] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-22T22:21:21.887360] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1792 records). [2025-09-22T22:21:21.889258] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-22T22:21:21.893195] [INFO ] [MAIN ] Derivative Progress: 919/2091 symbols completed. HYTR took 1.1s. Estimated remaining: 7m 35s. Rate: 154.4 symbols/min [2025-09-22T22:21:21.894296] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:21.911156] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:21.912704] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33218 primary records. [2025-09-22T22:21:21.915215] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-22T22:21:21.927862] [DEBUG] [LOCAL ] IAE: Loaded 5843 existing records from primary storage. [2025-09-22T22:21:21.930562] [INFO ] [MAIN ] IAE: Loaded 5843 primary data records. [2025-09-22T22:21:21.991880] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-09-22T22:21:22.001067] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-22T22:21:22.009214] [INFO ] [MAIN ] Derivative Progress: 920/2091 symbols completed. HYT took 1.2s. Estimated remaining: 7m 35s. Rate: 154.5 symbols/min [2025-09-22T22:21:22.031809] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:22.239759] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:22.255549] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29378 primary records. [2025-09-22T22:21:22.255788] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-22T22:21:22.277194] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-09-22T22:21:22.291713] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-22T22:21:22.294328] [INFO ] [MAIN ] Derivative Progress: 921/2091 symbols completed. HZO took 1.2s. Estimated remaining: 7m 34s. Rate: 154.5 symbols/min [2025-09-22T22:21:22.295278] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:22.328410] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:22.329286] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 5843 primary records. [2025-09-22T22:21:22.330393] [DEBUG] [LOCAL ] IAG: Loaded 53442 existing records from primary storage. [2025-09-22T22:21:22.330552] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-22T22:21:22.330612] [INFO ] [MAIN ] IAG: Loaded 53442 primary data records. [2025-09-22T22:21:22.508333] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-09-22T22:21:22.523792] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-22T22:21:22.535200] [INFO ] [MAIN ] Derivative Progress: 922/2091 symbols completed. IAE took 0.6s. Estimated remaining: 7m 34s. Rate: 154.6 symbols/min [2025-09-22T22:21:22.561056] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:22.699206] [DEBUG] [LOCAL ] IBM: Loaded 53638 existing records from primary storage. [2025-09-22T22:21:22.699407] [INFO ] [MAIN ] IBM: Loaded 53638 primary data records. [2025-09-22T22:21:23.106496] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:23.109160] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53442 primary records. [2025-09-22T22:21:23.109401] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-22T22:21:23.111201] [DEBUG] [LOCAL ] IBN: Loaded 52896 existing records from primary storage. [2025-09-22T22:21:23.111758] [INFO ] [MAIN ] IBN: Loaded 52896 primary data records. [2025-09-22T22:21:23.181469] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-09-22T22:21:23.181672] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-22T22:21:23.183938] [INFO ] [MAIN ] Derivative Progress: 923/2091 symbols completed. IAG took 1.2s. Estimated remaining: 7m 34s. Rate: 154.5 symbols/min [2025-09-22T22:21:23.201605] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:23.293004] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:23.293823] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53638 primary records. [2025-09-22T22:21:23.294267] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-22T22:21:23.532039] [DEBUG] [LOCAL ] IBP: Loaded 29382 existing records from primary storage. [2025-09-22T22:21:23.532986] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-09-22T22:21:23.533503] [INFO ] [MAIN ] IBP: Loaded 29382 primary data records. [2025-09-22T22:21:23.545403] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-22T22:21:23.568711] [INFO ] [MAIN ] Derivative Progress: 924/2091 symbols completed. IBM took 1.3s. Estimated remaining: 7m 33s. Rate: 154.5 symbols/min [2025-09-22T22:21:23.593089] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:23.878409] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:23.879936] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52896 primary records. [2025-09-22T22:21:23.880067] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-22T22:21:23.880919] [DEBUG] [LOCAL ] IBTA: Loaded 38115 existing records from primary storage. [2025-09-22T22:21:23.882368] [INFO ] [MAIN ] IBTA: Loaded 38115 primary data records. [2025-09-22T22:21:23.995900] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-09-22T22:21:24.007106] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-22T22:21:24.009747] [INFO ] [MAIN ] Derivative Progress: 925/2091 symbols completed. IBN took 1.4s. Estimated remaining: 7m 33s. Rate: 154.5 symbols/min [2025-09-22T22:21:24.010191] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:24.226192] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:24.227067] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 29382 primary records. [2025-09-22T22:21:24.227233] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-22T22:21:24.245934] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-09-22T22:21:24.246459] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-22T22:21:24.248777] [INFO ] [MAIN ] Derivative Progress: 926/2091 symbols completed. IBP took 1.1s. Estimated remaining: 7m 32s. Rate: 154.5 symbols/min [2025-09-22T22:21:24.249114] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:24.286139] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:24.287119] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 38115 primary records. [2025-09-22T22:21:24.301769] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-22T22:21:24.303849] [DEBUG] [LOCAL ] ICE: Loaded 53023 existing records from primary storage. [2025-09-22T22:21:24.304307] [INFO ] [MAIN ] ICE: Loaded 53023 primary data records. [2025-09-22T22:21:24.453038] [DEBUG] [LOCAL ] ICL: Loaded 38776 existing records from primary storage. [2025-09-22T22:21:24.457967] [INFO ] [MAIN ] ICL: Loaded 38776 primary data records. [2025-09-22T22:21:24.458133] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-09-22T22:21:24.519154] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-22T22:21:24.546152] [INFO ] [MAIN ] Derivative Progress: 927/2091 symbols completed. IBTA took 1.0s. Estimated remaining: 7m 32s. Rate: 154.6 symbols/min [2025-09-22T22:21:24.585847] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:25.026215] [DEBUG] [LOCAL ] IDA: Loaded 31959 existing records from primary storage. [2025-09-22T22:21:25.026805] [INFO ] [MAIN ] IDA: Loaded 31959 primary data records. [2025-09-22T22:21:25.098215] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:25.128327] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53023 primary records. [2025-09-22T22:21:25.141304] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-22T22:21:25.174008] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:25.184122] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38776 primary records. [2025-09-22T22:21:25.189583] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-22T22:21:25.278164] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-09-22T22:21:25.267904] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-09-22T22:21:25.278571] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-22T22:21:25.278433] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-22T22:21:25.352820] [INFO ] [MAIN ] Derivative Progress: 928/2091 symbols completed. ICL took 1.1s. Estimated remaining: 7m 32s. Rate: 154.4 symbols/min [2025-09-22T22:21:25.403423] [INFO ] [MAIN ] Derivative Progress: 929/2091 symbols completed. ICE took 1.4s. Estimated remaining: 7m 31s. Rate: 154.5 symbols/min [2025-09-22T22:21:25.427839] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:25.428422] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 31959 primary records. [2025-09-22T22:21:25.428489] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-22T22:21:25.443755] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-09-22T22:21:25.443814] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-22T22:21:25.446402] [INFO ] [MAIN ] Derivative Progress: 930/2091 symbols completed. IDA took 0.9s. Estimated remaining: 7m 30s. Rate: 154.7 symbols/min [2025-09-22T22:21:25.447086] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:25.447020] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:25.447326] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:25.458693] [DEBUG] [LOCAL ] IDE: Loaded 8405 existing records from primary storage. [2025-09-22T22:21:25.458825] [INFO ] [MAIN ] IDE: Loaded 8405 primary data records. [2025-09-22T22:21:25.571825] [DEBUG] [LOCAL ] IDT: Loaded 17600 existing records from primary storage. [2025-09-22T22:21:25.572104] [INFO ] [MAIN ] IDT: Loaded 17600 primary data records. [2025-09-22T22:21:25.755041] [DEBUG] [LOCAL ] IEX: Loaded 38423 existing records from primary storage. [2025-09-22T22:21:25.900155] [INFO ] [MAIN ] IEX: Loaded 38423 primary data records. [2025-09-22T22:21:26.459595] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:26.460900] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8405 primary records. [2025-09-22T22:21:26.461996] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-22T22:21:26.495638] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:26.496502] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-09-22T22:21:26.497780] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 17600 primary records. [2025-09-22T22:21:26.498149] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-22T22:21:26.501096] [INFO ] [MAIN ] Derivative Progress: 931/2091 symbols completed. IDE took 1.1s. Estimated remaining: 7m 31s. Rate: 154.4 symbols/min [2025-09-22T22:21:26.498335] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-22T22:21:26.505075] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:26.534753] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-09-22T22:21:26.535108] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-22T22:21:26.535025] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:26.537413] [INFO ] [MAIN ] Derivative Progress: 932/2091 symbols completed. IDT took 1.1s. Estimated remaining: 7m 30s. Rate: 154.6 symbols/min [2025-09-22T22:21:26.538365] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38423 primary records. [2025-09-22T22:21:26.538815] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:26.538905] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-22T22:21:26.557572] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-09-22T22:21:26.557757] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-22T22:21:26.560015] [INFO ] [MAIN ] Derivative Progress: 933/2091 symbols completed. IEX took 1.1s. Estimated remaining: 7m 29s. Rate: 154.7 symbols/min [2025-09-22T22:21:26.560330] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:26.576404] [DEBUG] [LOCAL ] IFN: Loaded 18150 existing records from primary storage. [2025-09-22T22:21:26.576895] [INFO ] [MAIN ] IFN: Loaded 18150 primary data records. [2025-09-22T22:21:26.727410] [DEBUG] [LOCAL ] IFS: Loaded 23060 existing records from primary storage. [2025-09-22T22:21:26.728150] [INFO ] [MAIN ] IFS: Loaded 23060 primary data records. [2025-09-22T22:21:26.859198] [DEBUG] [LOCAL ] IFF: Loaded 50956 existing records from primary storage. [2025-09-22T22:21:26.872466] [INFO ] [MAIN ] IFF: Loaded 50956 primary data records. [2025-09-22T22:21:27.620839] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:27.621847] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18150 primary records. [2025-09-22T22:21:27.622681] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-22T22:21:27.641599] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-09-22T22:21:27.641902] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-22T22:21:27.644136] [INFO ] [MAIN ] Derivative Progress: 934/2091 symbols completed. IFN took 1.1s. Estimated remaining: 7m 30s. Rate: 154.4 symbols/min [2025-09-22T22:21:27.645072] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:27.673356] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:27.681864] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:27.682736] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 50956 primary records. [2025-09-22T22:21:27.682939] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-22T22:21:27.681494] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 23060 primary records. [2025-09-22T22:21:27.688141] [DEBUG] [LOCAL ] IGA: Loaded 9666 existing records from primary storage. [2025-09-22T22:21:27.696419] [INFO ] [MAIN ] IGA: Loaded 9666 primary data records. [2025-09-22T22:21:27.696513] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-22T22:21:27.777492] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-09-22T22:21:27.799143] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-22T22:21:27.802904] [INFO ] [MAIN ] Derivative Progress: 935/2091 symbols completed. IFF took 1.3s. Estimated remaining: 7m 29s. Rate: 154.5 symbols/min [2025-09-22T22:21:27.809548] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-09-22T22:21:27.823403] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-22T22:21:27.826979] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:27.829270] [INFO ] [MAIN ] Derivative Progress: 936/2091 symbols completed. IFS took 1.3s. Estimated remaining: 7m 28s. Rate: 154.7 symbols/min [2025-09-22T22:21:27.835369] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:28.031558] [DEBUG] [LOCAL ] IGI: Loaded 3702 existing records from primary storage. [2025-09-22T22:21:28.031793] [INFO ] [MAIN ] IGI: Loaded 3702 primary data records. [2025-09-22T22:21:28.095699] [DEBUG] [LOCAL ] IGD: Loaded 18971 existing records from primary storage. [2025-09-22T22:21:28.096264] [INFO ] [MAIN ] IGD: Loaded 18971 primary data records. [2025-09-22T22:21:28.669708] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:28.670607] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 9666 primary records. [2025-09-22T22:21:28.670839] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-22T22:21:28.688516] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-09-22T22:21:28.688724] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-22T22:21:28.691285] [INFO ] [MAIN ] Derivative Progress: 937/2091 symbols completed. IGA took 1.0s. Estimated remaining: 7m 28s. Rate: 154.5 symbols/min [2025-09-22T22:21:28.694694] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:28.709139] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:28.711258] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3702 primary records. [2025-09-22T22:21:28.711533] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-22T22:21:28.734507] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:28.735496] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 18971 primary records. [2025-09-22T22:21:28.736096] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-22T22:21:28.759620] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-09-22T22:21:28.760337] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-22T22:21:28.762717] [INFO ] [MAIN ] Derivative Progress: 938/2091 symbols completed. IGI took 0.9s. Estimated remaining: 7m 27s. Rate: 154.6 symbols/min [2025-09-22T22:21:28.763217] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:28.776222] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-09-22T22:21:28.776920] [DEBUG] [LOCAL ] IGR: Loaded 30584 existing records from primary storage. [2025-09-22T22:21:28.776440] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-22T22:21:28.777088] [INFO ] [MAIN ] IGR: Loaded 30584 primary data records. [2025-09-22T22:21:28.779363] [INFO ] [MAIN ] Derivative Progress: 939/2091 symbols completed. IGD took 1.0s. Estimated remaining: 7m 27s. Rate: 154.8 symbols/min [2025-09-22T22:21:28.782042] [DEBUG] [LOCAL ] IH: Loaded 3545 existing records from primary storage. [2025-09-22T22:21:28.782226] [INFO ] [MAIN ] IH: Loaded 3545 primary data records. [2025-09-22T22:21:28.793390] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:28.997258] [DEBUG] [LOCAL ] IHD: Loaded 7246 existing records from primary storage. [2025-09-22T22:21:29.018706] [INFO ] [MAIN ] IHD: Loaded 7246 primary data records. [2025-09-22T22:21:29.745383] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:29.746804] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30584 primary records. [2025-09-22T22:21:29.758971] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-22T22:21:29.760108] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:29.761879] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 3545 primary records. [2025-09-22T22:21:29.762000] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-22T22:21:29.790379] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-09-22T22:21:29.790545] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-22T22:21:29.793309] [INFO ] [MAIN ] Derivative Progress: 940/2091 symbols completed. IGR took 1.1s. Estimated remaining: 7m 27s. Rate: 154.5 symbols/min [2025-09-22T22:21:29.794750] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:29.809957] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:29.811110] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7246 primary records. [2025-09-22T22:21:29.811632] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-22T22:21:29.821149] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-09-22T22:21:29.821338] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-22T22:21:29.827468] [INFO ] [MAIN ] Derivative Progress: 941/2091 symbols completed. IH took 1.1s. Estimated remaining: 7m 26s. Rate: 154.6 symbols/min [2025-09-22T22:21:29.832073] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:29.832182] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-09-22T22:21:29.832674] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-22T22:21:29.835266] [INFO ] [MAIN ] Derivative Progress: 942/2091 symbols completed. IHD took 1.1s. Estimated remaining: 7m 25s. Rate: 154.8 symbols/min [2025-09-22T22:21:29.835724] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:29.844921] [DEBUG] [LOCAL ] IIF: Loaded 5789 existing records from primary storage. [2025-09-22T22:21:29.845043] [INFO ] [MAIN ] IIF: Loaded 5789 primary data records. [2025-09-22T22:21:30.067772] [DEBUG] [LOCAL ] IHG: Loaded 24753 existing records from primary storage. [2025-09-22T22:21:30.074897] [INFO ] [MAIN ] IHG: Loaded 24753 primary data records. [2025-09-22T22:21:30.272500] [DEBUG] [LOCAL ] IHS: Loaded 38999 existing records from primary storage. [2025-09-22T22:21:30.279878] [INFO ] [MAIN ] IHS: Loaded 38999 primary data records. [2025-09-22T22:21:30.895401] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:30.896540] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5789 primary records. [2025-09-22T22:21:30.896930] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-22T22:21:30.917210] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-09-22T22:21:30.919469] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-22T22:21:30.922190] [INFO ] [MAIN ] Derivative Progress: 943/2091 symbols completed. IIF took 1.1s. Estimated remaining: 7m 26s. Rate: 154.5 symbols/min [2025-09-22T22:21:30.936706] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:30.938408] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24753 primary records. [2025-09-22T22:21:30.939261] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-22T22:21:30.953414] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:30.962905] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 38999 primary records. [2025-09-22T22:21:30.965616] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-22T22:21:30.983667] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-09-22T22:21:30.984032] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-22T22:21:30.986346] [INFO ] [MAIN ] Derivative Progress: 944/2091 symbols completed. IHG took 1.2s. Estimated remaining: 7m 25s. Rate: 154.6 symbols/min [2025-09-22T22:21:30.989140] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-09-22T22:21:30.989206] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-22T22:21:30.991625] [INFO ] [MAIN ] Derivative Progress: 945/2091 symbols completed. IHS took 1.2s. Estimated remaining: 7m 24s. Rate: 154.8 symbols/min [2025-09-22T22:21:30.992195] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:30.992378] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:30.992520] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:31.015602] [DEBUG] [LOCAL ] IIIN: Loaded 16813 existing records from primary storage. [2025-09-22T22:21:31.015824] [INFO ] [MAIN ] IIIN: Loaded 16813 primary data records. [2025-09-22T22:21:31.106000] [DEBUG] [LOCAL ] IIM: Loaded 15903 existing records from primary storage. [2025-09-22T22:21:31.133505] [INFO ] [MAIN ] IIM: Loaded 15903 primary data records. [2025-09-22T22:21:31.272852] [DEBUG] [LOCAL ] IIPR: Loaded 29620 existing records from primary storage. [2025-09-22T22:21:31.281303] [INFO ] [MAIN ] IIPR: Loaded 29620 primary data records. [2025-09-22T22:21:31.997531] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:32.001287] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16813 primary records. [2025-09-22T22:21:32.002541] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-22T22:21:32.028450] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:32.030001] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15903 primary records. [2025-09-22T22:21:32.030636] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-22T22:21:32.050465] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-09-22T22:21:32.052385] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-22T22:21:32.054899] [INFO ] [MAIN ] Derivative Progress: 946/2091 symbols completed. IIIN took 1.1s. Estimated remaining: 7m 25s. Rate: 154.5 symbols/min [2025-09-22T22:21:32.057306] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-09-22T22:21:32.069894] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-22T22:21:32.072685] [INFO ] [MAIN ] Derivative Progress: 947/2091 symbols completed. IIM took 1.1s. Estimated remaining: 7m 24s. Rate: 154.7 symbols/min [2025-09-22T22:21:32.073408] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:32.073976] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:32.057428] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:32.074903] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29620 primary records. [2025-09-22T22:21:32.075621] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-22T22:21:32.094853] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-09-22T22:21:32.095121] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-22T22:21:32.097911] [INFO ] [MAIN ] Derivative Progress: 948/2091 symbols completed. IIPR took 1.1s. Estimated remaining: 7m 23s. Rate: 154.8 symbols/min [2025-09-22T22:21:32.098389] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:32.147636] [DEBUG] [LOCAL ] IMAX: Loaded 42779 existing records from primary storage. [2025-09-22T22:21:32.147929] [INFO ] [MAIN ] IMAX: Loaded 42779 primary data records. [2025-09-22T22:21:32.280430] [DEBUG] [LOCAL ] INFA: Loaded 50099 existing records from primary storage. [2025-09-22T22:21:32.293664] [INFO ] [MAIN ] INFA: Loaded 50099 primary data records. [2025-09-22T22:21:32.622992] [DEBUG] [LOCAL ] INFY: Loaded 53601 existing records from primary storage. [2025-09-22T22:21:32.636927] [INFO ] [MAIN ] INFY: Loaded 53601 primary data records. [2025-09-22T22:21:33.223363] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:33.224545] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42779 primary records. [2025-09-22T22:21:33.225159] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-22T22:21:33.243277] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-09-22T22:21:33.243721] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-22T22:21:33.245950] [INFO ] [MAIN ] Derivative Progress: 949/2091 symbols completed. IMAX took 1.2s. Estimated remaining: 7m 23s. Rate: 154.5 symbols/min [2025-09-22T22:21:33.246978] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:33.265460] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:33.266572] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 50099 primary records. [2025-09-22T22:21:33.266859] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-22T22:21:33.300489] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:33.302707] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53601 primary records. [2025-09-22T22:21:33.301670] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-09-22T22:21:33.302890] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-22T22:21:33.302967] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-22T22:21:33.306132] [INFO ] [MAIN ] Derivative Progress: 950/2091 symbols completed. INFA took 1.2s. Estimated remaining: 7m 23s. Rate: 154.7 symbols/min [2025-09-22T22:21:33.307007] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:33.324154] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-09-22T22:21:33.337200] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-22T22:21:33.340016] [INFO ] [MAIN ] Derivative Progress: 951/2091 symbols completed. INFY took 1.2s. Estimated remaining: 7m 22s. Rate: 154.8 symbols/min [2025-09-22T22:21:33.340461] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:33.361518] [DEBUG] [LOCAL ] ING: Loaded 50823 existing records from primary storage. [2025-09-22T22:21:33.361768] [INFO ] [MAIN ] ING: Loaded 50823 primary data records. [2025-09-22T22:21:33.492745] [DEBUG] [LOCAL ] INGM: Loaded 28926 existing records from primary storage. [2025-09-22T22:21:33.503627] [INFO ] [MAIN ] INGM: Loaded 28926 primary data records. [2025-09-22T22:21:33.570302] [DEBUG] [LOCAL ] INGR: Loaded 33393 existing records from primary storage. [2025-09-22T22:21:33.609576] [INFO ] [MAIN ] INGR: Loaded 33393 primary data records. [2025-09-22T22:21:34.348047] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:34.349466] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50823 primary records. [2025-09-22T22:21:34.349557] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-22T22:21:34.367899] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-09-22T22:21:34.368147] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-22T22:21:34.370290] [INFO ] [MAIN ] Derivative Progress: 952/2091 symbols completed. ING took 1.1s. Estimated remaining: 7m 22s. Rate: 154.5 symbols/min [2025-09-22T22:21:34.371006] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:34.390290] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:34.403291] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28926 primary records. [2025-09-22T22:21:34.403591] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:34.403693] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-22T22:21:34.404360] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33393 primary records. [2025-09-22T22:21:34.404764] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-22T22:21:34.434886] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-09-22T22:21:34.435307] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-22T22:21:34.438340] [INFO ] [MAIN ] Derivative Progress: 953/2091 symbols completed. INGM took 1.1s. Estimated remaining: 7m 21s. Rate: 154.7 symbols/min [2025-09-22T22:21:34.447518] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:34.449724] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-09-22T22:21:34.449899] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-22T22:21:34.452617] [INFO ] [MAIN ] Derivative Progress: 954/2091 symbols completed. INGR took 1.1s. Estimated remaining: 7m 21s. Rate: 154.8 symbols/min [2025-09-22T22:21:34.453134] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:34.467775] [DEBUG] [LOCAL ] INN: Loaded 41951 existing records from primary storage. [2025-09-22T22:21:34.467919] [INFO ] [MAIN ] INN: Loaded 41951 primary data records. [2025-09-22T22:21:34.807729] [DEBUG] [LOCAL ] INSP: Loaded 36812 existing records from primary storage. [2025-09-22T22:21:34.808844] [INFO ] [MAIN ] INSP: Loaded 36812 primary data records. [2025-09-22T22:21:34.821380] [DEBUG] [LOCAL ] INSW: Loaded 40407 existing records from primary storage. [2025-09-22T22:21:34.842459] [INFO ] [MAIN ] INSW: Loaded 40407 primary data records. [2025-09-22T22:21:35.469243] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:35.470760] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41951 primary records. [2025-09-22T22:21:35.470975] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-22T22:21:35.492087] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-09-22T22:21:35.492322] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-22T22:21:35.494844] [INFO ] [MAIN ] Derivative Progress: 955/2091 symbols completed. INN took 1.1s. Estimated remaining: 7m 21s. Rate: 154.5 symbols/min [2025-09-22T22:21:35.495450] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:35.515342] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:35.528230] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 36812 primary records. [2025-09-22T22:21:35.528421] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-22T22:21:35.528776] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:35.530136] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 40407 primary records. [2025-09-22T22:21:35.530381] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-22T22:21:35.563311] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-09-22T22:21:35.563599] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-09-22T22:21:35.563836] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-22T22:21:35.563918] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-22T22:21:35.565993] [INFO ] [MAIN ] Derivative Progress: 956/2091 symbols completed. INSP took 1.1s. Estimated remaining: 7m 20s. Rate: 154.7 symbols/min [2025-09-22T22:21:35.581869] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:35.582149] [INFO ] [MAIN ] Derivative Progress: 957/2091 symbols completed. INSW took 1.1s. Estimated remaining: 7m 19s. Rate: 154.8 symbols/min [2025-09-22T22:21:35.582619] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:35.603319] [DEBUG] [LOCAL ] INVH: Loaded 53139 existing records from primary storage. [2025-09-22T22:21:35.603612] [INFO ] [MAIN ] INVH: Loaded 53139 primary data records. [2025-09-22T22:21:35.762388] [DEBUG] [LOCAL ] INVX: Loaded 28990 existing records from primary storage. [2025-09-22T22:21:35.813845] [INFO ] [MAIN ] INVX: Loaded 28990 primary data records. [2025-09-22T22:21:36.034093] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-22T22:21:36.046601] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-09-22T22:21:36.588310] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:21:36.591875] [INFO ] [MAIN ] INVH: Generated 1793 derivative records from 53139 primary records. [2025-09-22T22:21:36.592166] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-22T22:21:36.619160] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:36.620586] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 28990 primary records. [2025-09-22T22:21:36.621410] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-22T22:21:36.647342] [DEBUG] [LOCAL ] INVH: Derivative data saved (1793 records). [2025-09-22T22:21:36.648244] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-22T22:21:36.652220] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-09-22T22:21:36.651184] [INFO ] [MAIN ] Derivative Progress: 958/2091 symbols completed. INVH took 1.2s. Estimated remaining: 7m 20s. Rate: 154.6 symbols/min [2025-09-22T22:21:36.652374] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-22T22:21:36.662913] [INFO ] [MAIN ] Derivative Progress: 959/2091 symbols completed. INVX took 1.1s. Estimated remaining: 7m 19s. Rate: 154.7 symbols/min [2025-09-22T22:21:36.668187] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:36.668872] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-09-22T22:21:36.668948] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-22T22:21:36.685038] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-09-22T22:21:36.685097] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-22T22:21:36.688253] [INFO ] [MAIN ] Derivative Progress: 960/2091 symbols completed. IONQ took 1.1s. Estimated remaining: 7m 18s. Rate: 154.9 symbols/min [2025-09-22T22:21:36.689125] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:36.688973] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:36.689403] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:36.759268] [DEBUG] [LOCAL ] IP: Loaded 53326 existing records from primary storage. [2025-09-22T22:21:36.759516] [INFO ] [MAIN ] IP: Loaded 53326 primary data records. [2025-09-22T22:21:36.920224] [DEBUG] [LOCAL ] IPG: Loaded 53332 existing records from primary storage. [2025-09-22T22:21:36.941962] [DEBUG] [LOCAL ] IOT: Loaded 53472 existing records from primary storage. [2025-09-22T22:21:36.996958] [INFO ] [MAIN ] IPG: Loaded 53332 primary data records. [2025-09-22T22:21:37.065139] [INFO ] [MAIN ] IOT: Loaded 53472 primary data records. [2025-09-22T22:21:37.806628] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:37.809360] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53326 primary records. [2025-09-22T22:21:37.809815] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-22T22:21:37.830137] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-09-22T22:21:37.830390] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-22T22:21:37.832636] [INFO ] [MAIN ] Derivative Progress: 961/2091 symbols completed. IP took 1.1s. Estimated remaining: 7m 19s. Rate: 154.5 symbols/min [2025-09-22T22:21:37.834986] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:37.852736] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:37.862144] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53472 primary records. [2025-09-22T22:21:37.867197] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-22T22:21:37.875977] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:37.890552] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-09-22T22:21:37.890219] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53332 primary records. [2025-09-22T22:21:37.890746] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-22T22:21:37.890856] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-22T22:21:37.893739] [INFO ] [MAIN ] Derivative Progress: 962/2091 symbols completed. IOT took 1.2s. Estimated remaining: 7m 18s. Rate: 154.7 symbols/min [2025-09-22T22:21:37.902291] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:37.902787] [DEBUG] [LOCAL ] IPI: Loaded 21232 existing records from primary storage. [2025-09-22T22:21:37.912819] [INFO ] [MAIN ] IPI: Loaded 21232 primary data records. [2025-09-22T22:21:37.927041] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-09-22T22:21:37.928750] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-22T22:21:37.947131] [INFO ] [MAIN ] Derivative Progress: 963/2091 symbols completed. IPG took 1.3s. Estimated remaining: 7m 17s. Rate: 154.8 symbols/min [2025-09-22T22:21:37.969269] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:38.275635] [DEBUG] [LOCAL ] IQV: Loaded 50377 existing records from primary storage. [2025-09-22T22:21:38.276064] [INFO ] [MAIN ] IQV: Loaded 50377 primary data records. [2025-09-22T22:21:38.469168] [DEBUG] [LOCAL ] IR: Loaded 52696 existing records from primary storage. [2025-09-22T22:21:38.501427] [INFO ] [MAIN ] IR: Loaded 52696 primary data records. [2025-09-22T22:21:38.843313] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:38.865054] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21232 primary records. [2025-09-22T22:21:39.046604] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-22T22:21:39.069300] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-09-22T22:21:39.072539] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-22T22:21:39.075342] [INFO ] [MAIN ] Derivative Progress: 964/2091 symbols completed. IPI took 1.2s. Estimated remaining: 7m 18s. Rate: 154.5 symbols/min [2025-09-22T22:21:39.076180] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:39.090142] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:39.092542] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50377 primary records. [2025-09-22T22:21:39.093075] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-22T22:21:39.113558] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-09-22T22:21:39.114085] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-22T22:21:39.116639] [INFO ] [MAIN ] Derivative Progress: 965/2091 symbols completed. IQV took 1.2s. Estimated remaining: 7m 17s. Rate: 154.7 symbols/min [2025-09-22T22:21:39.117257] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:39.137045] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:39.138296] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52696 primary records. [2025-09-22T22:21:39.138482] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-22T22:21:39.172955] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-09-22T22:21:39.173166] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-22T22:21:39.175957] [INFO ] [MAIN ] Derivative Progress: 966/2091 symbols completed. IR took 1.2s. Estimated remaining: 7m 16s. Rate: 154.8 symbols/min [2025-09-22T22:21:39.176450] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:39.186430] [DEBUG] [LOCAL ] IRS: Loaded 21606 existing records from primary storage. [2025-09-22T22:21:39.186748] [INFO ] [MAIN ] IRS: Loaded 21606 primary data records. [2025-09-22T22:21:39.294982] [DEBUG] [LOCAL ] IRM: Loaded 49510 existing records from primary storage. [2025-09-22T22:21:39.312463] [INFO ] [MAIN ] IRM: Loaded 49510 primary data records. [2025-09-22T22:21:39.730161] [DEBUG] [LOCAL ] IRT: Loaded 50393 existing records from primary storage. [2025-09-22T22:21:39.737446] [INFO ] [MAIN ] IRT: Loaded 50393 primary data records. [2025-09-22T22:21:40.207223] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:40.208971] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 21606 primary records. [2025-09-22T22:21:40.209069] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-22T22:21:40.230465] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-09-22T22:21:40.230880] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-22T22:21:40.247198] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:40.246996] [INFO ] [MAIN ] Derivative Progress: 967/2091 symbols completed. IRS took 1.1s. Estimated remaining: 7m 16s. Rate: 154.5 symbols/min [2025-09-22T22:21:40.248067] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49510 primary records. [2025-09-22T22:21:40.248303] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-22T22:21:40.249746] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:40.265732] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-09-22T22:21:40.265931] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-22T22:21:40.268757] [INFO ] [MAIN ] Derivative Progress: 968/2091 symbols completed. IRM took 1.2s. Estimated remaining: 7m 16s. Rate: 154.7 symbols/min [2025-09-22T22:21:40.269176] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:40.290505] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:40.291275] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50393 primary records. [2025-09-22T22:21:40.291407] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-22T22:21:40.309490] [DEBUG] [LOCAL ] ISD: Loaded 15668 existing records from primary storage. [2025-09-22T22:21:40.310355] [INFO ] [MAIN ] ISD: Loaded 15668 primary data records. [2025-09-22T22:21:40.447374] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-09-22T22:21:40.504881] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-22T22:21:40.530630] [DEBUG] [LOCAL ] IT: Loaded 41446 existing records from primary storage. [2025-09-22T22:21:40.529628] [INFO ] [MAIN ] Derivative Progress: 969/2091 symbols completed. IRT took 1.4s. Estimated remaining: 7m 15s. Rate: 154.7 symbols/min [2025-09-22T22:21:40.648407] [INFO ] [MAIN ] IT: Loaded 41446 primary data records. [2025-09-22T22:21:40.649133] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:40.982040] [DEBUG] [LOCAL ] ITGR: Loaded 31574 existing records from primary storage. [2025-09-22T22:21:40.982545] [INFO ] [MAIN ] ITGR: Loaded 31574 primary data records. [2025-09-22T22:21:41.146869] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:41.184757] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15668 primary records. [2025-09-22T22:21:41.202022] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-22T22:21:41.400394] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-09-22T22:21:41.401671] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-22T22:21:41.404249] [INFO ] [MAIN ] Derivative Progress: 970/2091 symbols completed. ISD took 1.2s. Estimated remaining: 7m 15s. Rate: 154.5 symbols/min [2025-09-22T22:21:41.418232] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:41.420809] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 41446 primary records. [2025-09-22T22:21:41.421240] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-22T22:21:41.436442] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:41.450838] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-09-22T22:21:41.452948] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-22T22:21:41.456407] [INFO ] [MAIN ] Derivative Progress: 971/2091 symbols completed. IT took 1.2s. Estimated remaining: 7m 15s. Rate: 154.7 symbols/min [2025-09-22T22:21:41.464484] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:41.474422] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:41.475550] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31574 primary records. [2025-09-22T22:21:41.475776] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-22T22:21:41.503307] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-09-22T22:21:41.503536] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-22T22:21:41.506374] [INFO ] [MAIN ] Derivative Progress: 972/2091 symbols completed. ITGR took 0.9s. Estimated remaining: 7m 14s. Rate: 154.8 symbols/min [2025-09-22T22:21:41.507455] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:41.518600] [DEBUG] [LOCAL ] ITT: Loaded 33181 existing records from primary storage. [2025-09-22T22:21:41.518969] [INFO ] [MAIN ] ITT: Loaded 33181 primary data records. [2025-09-22T22:21:41.875310] [DEBUG] [LOCAL ] ITUB: Loaded 53299 existing records from primary storage. [2025-09-22T22:21:41.876229] [INFO ] [MAIN ] ITUB: Loaded 53299 primary data records. [2025-09-22T22:21:42.001394] [DEBUG] [LOCAL ] ITW: Loaded 46386 existing records from primary storage. [2025-09-22T22:21:42.017588] [INFO ] [MAIN ] ITW: Loaded 46386 primary data records. [2025-09-22T22:21:42.561880] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:42.563163] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 33181 primary records. [2025-09-22T22:21:42.563878] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-22T22:21:42.584327] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-09-22T22:21:42.585446] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-22T22:21:42.589830] [INFO ] [MAIN ] Derivative Progress: 973/2091 symbols completed. ITT took 1.2s. Estimated remaining: 7m 14s. Rate: 154.5 symbols/min [2025-09-22T22:21:42.604567] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:42.605473] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53299 primary records. [2025-09-22T22:21:42.605721] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-22T22:21:42.638768] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:42.639974] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-09-22T22:21:42.640880] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-22T22:21:42.640731] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 46386 primary records. [2025-09-22T22:21:42.643618] [INFO ] [MAIN ] Derivative Progress: 974/2091 symbols completed. ITUB took 1.2s. Estimated remaining: 7m 13s. Rate: 154.6 symbols/min [2025-09-22T22:21:42.643855] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-22T22:21:42.659409] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-09-22T22:21:42.659470] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-22T22:21:42.661893] [INFO ] [MAIN ] Derivative Progress: 975/2091 symbols completed. ITW took 1.2s. Estimated remaining: 7m 13s. Rate: 154.8 symbols/min [2025-09-22T22:21:42.662819] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:42.662384] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:42.662723] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:42.723039] [DEBUG] [LOCAL ] IVT: Loaded 30914 existing records from primary storage. [2025-09-22T22:21:42.723347] [INFO ] [MAIN ] IVT: Loaded 30914 primary data records. [2025-09-22T22:21:42.864371] [DEBUG] [LOCAL ] IVR: Loaded 47819 existing records from primary storage. [2025-09-22T22:21:42.874954] [INFO ] [MAIN ] IVR: Loaded 47819 primary data records. [2025-09-22T22:21:42.863343] [DEBUG] [LOCAL ] IVZ: Loaded 53143 existing records from primary storage. [2025-09-22T22:21:42.952964] [INFO ] [MAIN ] IVZ: Loaded 53143 primary data records. [2025-09-22T22:21:43.766317] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:43.767133] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 30914 primary records. [2025-09-22T22:21:43.767453] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-22T22:21:43.788881] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-09-22T22:21:43.789710] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-22T22:21:43.791876] [INFO ] [MAIN ] Derivative Progress: 976/2091 symbols completed. IVT took 1.1s. Estimated remaining: 7m 13s. Rate: 154.5 symbols/min [2025-09-22T22:21:43.792481] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:43.822885] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:43.822691] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:43.824378] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47819 primary records. [2025-09-22T22:21:43.824546] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-22T22:21:43.823788] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53143 primary records. [2025-09-22T22:21:43.824945] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-22T22:21:43.860517] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-09-22T22:21:43.861550] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-22T22:21:43.864153] [INFO ] [MAIN ] Derivative Progress: 977/2091 symbols completed. IVR took 1.2s. Estimated remaining: 7m 12s. Rate: 154.6 symbols/min [2025-09-22T22:21:43.872400] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:43.875356] [DEBUG] [LOCAL ] IX: Loaded 22628 existing records from primary storage. [2025-09-22T22:21:43.876587] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-09-22T22:21:43.876895] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-22T22:21:43.879686] [INFO ] [MAIN ] Derivative Progress: 978/2091 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 11s. Rate: 154.8 symbols/min [2025-09-22T22:21:43.879863] [INFO ] [MAIN ] IX: Loaded 22628 primary data records. [2025-09-22T22:21:43.880062] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:44.213427] [DEBUG] [LOCAL ] J: Loaded 40502 existing records from primary storage. [2025-09-22T22:21:44.213800] [INFO ] [MAIN ] J: Loaded 40502 primary data records. [2025-09-22T22:21:44.332724] [DEBUG] [LOCAL ] JBGS: Loaded 42420 existing records from primary storage. [2025-09-22T22:21:44.354107] [INFO ] [MAIN ] JBGS: Loaded 42420 primary data records. [2025-09-22T22:21:44.867342] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:44.869160] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22628 primary records. [2025-09-22T22:21:44.869618] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-22T22:21:44.889148] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-09-22T22:21:44.889520] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-22T22:21:44.893198] [INFO ] [MAIN ] Derivative Progress: 979/2091 symbols completed. IX took 1.1s. Estimated remaining: 7m 12s. Rate: 154.5 symbols/min [2025-09-22T22:21:44.894424] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:44.910372] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:44.911366] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40502 primary records. [2025-09-22T22:21:44.911602] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-22T22:21:44.933428] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-09-22T22:21:44.955795] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:44.955981] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-22T22:21:44.956764] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42420 primary records. [2025-09-22T22:21:44.958817] [INFO ] [MAIN ] Derivative Progress: 980/2091 symbols completed. J took 1.1s. Estimated remaining: 7m 11s. Rate: 154.6 symbols/min [2025-09-22T22:21:44.959128] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-22T22:21:44.959288] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:44.987710] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-09-22T22:21:44.988837] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-22T22:21:44.991578] [INFO ] [MAIN ] Derivative Progress: 981/2091 symbols completed. JBGS took 1.1s. Estimated remaining: 7m 10s. Rate: 154.8 symbols/min [2025-09-22T22:21:44.993065] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:44.992999] [DEBUG] [LOCAL ] JBI: Loaded 44019 existing records from primary storage. [2025-09-22T22:21:44.993239] [INFO ] [MAIN ] JBI: Loaded 44019 primary data records. [2025-09-22T22:21:45.340420] [DEBUG] [LOCAL ] JBND: Loaded 25326 existing records from primary storage. [2025-09-22T22:21:45.362679] [INFO ] [MAIN ] JBND: Loaded 25326 primary data records. [2025-09-22T22:21:45.396203] [DEBUG] [LOCAL ] JBL: Loaded 48357 existing records from primary storage. [2025-09-22T22:21:45.420839] [INFO ] [MAIN ] JBL: Loaded 48357 primary data records. [2025-09-22T22:21:46.024254] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:46.025257] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 44019 primary records. [2025-09-22T22:21:46.025634] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-22T22:21:46.044745] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-09-22T22:21:46.045162] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-22T22:21:46.047330] [INFO ] [MAIN ] Derivative Progress: 982/2091 symbols completed. JBI took 1.2s. Estimated remaining: 7m 11s. Rate: 154.5 symbols/min [2025-09-22T22:21:46.047912] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:46.062048] [DEBUG] [LOCAL ] JCE: Loaded 6457 existing records from primary storage. [2025-09-22T22:21:46.063091] [INFO ] [MAIN ] JCE: Loaded 6457 primary data records. [2025-09-22T22:21:46.138186] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:46.093750] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:46.139212] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 25326 primary records. [2025-09-22T22:21:46.145138] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48357 primary records. [2025-09-22T22:21:46.162586] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-22T22:21:46.153459] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-22T22:21:46.447220] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-09-22T22:21:46.456470] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-22T22:21:46.460011] [INFO ] [MAIN ] Derivative Progress: 983/2091 symbols completed. JBL took 1.5s. Estimated remaining: 7m 10s. Rate: 154.5 symbols/min [2025-09-22T22:21:46.461565] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:46.461236] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-09-22T22:21:46.461746] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-22T22:21:46.464231] [INFO ] [MAIN ] Derivative Progress: 984/2091 symbols completed. JBND took 1.5s. Estimated remaining: 7m 9s. Rate: 154.7 symbols/min [2025-09-22T22:21:46.464765] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:46.491954] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:46.492839] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 6457 primary records. [2025-09-22T22:21:46.492942] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-22T22:21:46.532414] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-09-22T22:21:46.532490] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-22T22:21:46.534611] [INFO ] [MAIN ] Derivative Progress: 985/2091 symbols completed. JCE took 0.5s. Estimated remaining: 7m 9s. Rate: 154.8 symbols/min [2025-09-22T22:21:46.535055] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:46.555938] [DEBUG] [LOCAL ] JELD: Loaded 46169 existing records from primary storage. [2025-09-22T22:21:46.556227] [INFO ] [MAIN ] JELD: Loaded 46169 primary data records. [2025-09-22T22:21:46.616619] [DEBUG] [LOCAL ] JEQ: Loaded 9079 existing records from primary storage. [2025-09-22T22:21:46.639842] [INFO ] [MAIN ] JEQ: Loaded 9079 primary data records. [2025-09-22T22:21:46.598428] [DEBUG] [LOCAL ] JCI: Loaded 53548 existing records from primary storage. [2025-09-22T22:21:46.705529] [INFO ] [MAIN ] JCI: Loaded 53548 primary data records. [2025-09-22T22:21:47.617202] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:47.630507] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46169 primary records. [2025-09-22T22:21:47.630955] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:47.630621] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-22T22:21:47.631799] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 9079 primary records. [2025-09-22T22:21:47.632603] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-22T22:21:47.669439] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-09-22T22:21:47.675191] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-22T22:21:47.678168] [INFO ] [MAIN ] Derivative Progress: 986/2091 symbols completed. JELD took 1.2s. Estimated remaining: 7m 9s. Rate: 154.5 symbols/min [2025-09-22T22:21:47.678920] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:47.680027] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53548 primary records. [2025-09-22T22:21:47.680292] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:47.681055] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-22T22:21:47.683913] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-09-22T22:21:47.685372] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-22T22:21:47.695864] [INFO ] [MAIN ] Derivative Progress: 987/2091 symbols completed. JEQ took 1.2s. Estimated remaining: 7m 8s. Rate: 154.6 symbols/min [2025-09-22T22:21:47.699349] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:47.704470] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-09-22T22:21:47.704581] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-22T22:21:47.707266] [INFO ] [MAIN ] Derivative Progress: 988/2091 symbols completed. JCI took 1.2s. Estimated remaining: 7m 8s. Rate: 154.8 symbols/min [2025-09-22T22:21:47.717106] [DEBUG] [LOCAL ] JGH: Loaded 10943 existing records from primary storage. [2025-09-22T22:21:47.717302] [INFO ] [MAIN ] JGH: Loaded 10943 primary data records. [2025-09-22T22:21:47.848542] [DEBUG] [LOCAL ] JFR: Loaded 30377 existing records from primary storage. [2025-09-22T22:21:47.854469] [INFO ] [MAIN ] JFR: Loaded 30377 primary data records. [2025-09-22T22:21:48.372891] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:48.373923] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 10943 primary records. [2025-09-22T22:21:48.374276] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-22T22:21:48.403405] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:48.404963] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30377 primary records. [2025-09-22T22:21:48.405290] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-22T22:21:48.414952] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-09-22T22:21:48.419055] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-22T22:21:48.423080] [INFO ] [MAIN ] Derivative Progress: 989/2091 symbols completed. JGH took 0.7s. Estimated remaining: 7m 8s. Rate: 154.7 symbols/min [2025-09-22T22:21:48.425853] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-09-22T22:21:48.425967] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-22T22:21:48.428028] [INFO ] [MAIN ] Derivative Progress: 990/2091 symbols completed. JFR took 0.7s. Estimated remaining: 7m 7s. Rate: 154.8 symbols/min [2025-09-22T22:21:48.428984] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:48.428556] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:48.428805] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:48.435100] [DEBUG] [LOCAL ] JHS: Loaded 2890 existing records from primary storage. [2025-09-22T22:21:48.436346] [INFO ] [MAIN ] JHS: Loaded 2890 primary data records. [2025-09-22T22:21:48.495198] [DEBUG] [LOCAL ] JHI: Loaded 3589 existing records from primary storage. [2025-09-22T22:21:48.516067] [INFO ] [MAIN ] JHI: Loaded 3589 primary data records. [2025-09-22T22:21:49.069031] [DEBUG] [LOCAL ] JHG: Loaded 48043 existing records from primary storage. [2025-09-22T22:21:49.080587] [INFO ] [MAIN ] JHG: Loaded 48043 primary data records. [2025-09-22T22:21:49.482530] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:49.484452] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2890 primary records. [2025-09-22T22:21:49.484592] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-22T22:21:49.530114] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:49.532419] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3589 primary records. [2025-09-22T22:21:49.534460] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-22T22:21:49.534317] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-09-22T22:21:49.535752] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-22T22:21:49.538850] [INFO ] [MAIN ] Derivative Progress: 991/2091 symbols completed. JHS took 1.1s. Estimated remaining: 7m 7s. Rate: 154.5 symbols/min [2025-09-22T22:21:49.539759] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:49.575830] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:49.577839] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-09-22T22:21:49.577744] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 48043 primary records. [2025-09-22T22:21:49.577985] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-22T22:21:49.578132] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-22T22:21:49.581754] [INFO ] [MAIN ] Derivative Progress: 992/2091 symbols completed. JHI took 1.2s. Estimated remaining: 7m 6s. Rate: 154.7 symbols/min [2025-09-22T22:21:49.582509] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:49.602291] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-09-22T22:21:49.602602] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-22T22:21:49.606969] [INFO ] [MAIN ] Derivative Progress: 993/2091 symbols completed. JHG took 1.2s. Estimated remaining: 7m 6s. Rate: 154.8 symbols/min [2025-09-22T22:21:49.607555] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:49.636315] [DEBUG] [LOCAL ] JILL: Loaded 16727 existing records from primary storage. [2025-09-22T22:21:49.636508] [INFO ] [MAIN ] JILL: Loaded 16727 primary data records. [2025-09-22T22:21:49.782155] [DEBUG] [LOCAL ] JHX: Loaded 49815 existing records from primary storage. [2025-09-22T22:21:49.824500] [INFO ] [MAIN ] JHX: Loaded 49815 primary data records. [2025-09-22T22:21:49.852327] [DEBUG] [LOCAL ] JKS: Loaded 40152 existing records from primary storage. [2025-09-22T22:21:49.864096] [INFO ] [MAIN ] JKS: Loaded 40152 primary data records. [2025-09-22T22:21:50.914680] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:50.915966] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16727 primary records. [2025-09-22T22:21:50.916115] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-22T22:21:50.954167] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:50.973604] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 49815 primary records. [2025-09-22T22:21:50.976351] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-22T22:21:50.976234] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:50.978321] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 40152 primary records. [2025-09-22T22:21:50.979196] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-09-22T22:21:50.979804] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-22T22:21:50.979882] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-22T22:21:50.982049] [INFO ] [MAIN ] Derivative Progress: 994/2091 symbols completed. JILL took 1.4s. Estimated remaining: 7m 6s. Rate: 154.4 symbols/min [2025-09-22T22:21:50.983728] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:51.017553] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-09-22T22:21:51.018128] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-22T22:21:51.021297] [INFO ] [MAIN ] Derivative Progress: 995/2091 symbols completed. JKS took 1.4s. Estimated remaining: 7m 5s. Rate: 154.5 symbols/min [2025-09-22T22:21:51.022007] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:51.025088] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-09-22T22:21:51.025173] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-22T22:21:51.027470] [INFO ] [MAIN ] Derivative Progress: 996/2091 symbols completed. JHX took 1.5s. Estimated remaining: 7m 5s. Rate: 154.7 symbols/min [2025-09-22T22:21:51.029104] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:51.032897] [DEBUG] [LOCAL ] JLS: Loaded 4074 existing records from primary storage. [2025-09-22T22:21:51.033003] [INFO ] [MAIN ] JLS: Loaded 4074 primary data records. [2025-09-22T22:21:51.187299] [DEBUG] [LOCAL ] JLL: Loaded 32228 existing records from primary storage. [2025-09-22T22:21:51.197904] [INFO ] [MAIN ] JLL: Loaded 32228 primary data records. [2025-09-22T22:21:51.540954] [DEBUG] [LOCAL ] JMIA: Loaded 50473 existing records from primary storage. [2025-09-22T22:21:51.546959] [INFO ] [MAIN ] JMIA: Loaded 50473 primary data records. [2025-09-22T22:21:52.123353] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:52.124901] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4074 primary records. [2025-09-22T22:21:52.126196] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-22T22:21:52.142859] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-09-22T22:21:52.144040] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-22T22:21:52.146990] [INFO ] [MAIN ] Derivative Progress: 997/2091 symbols completed. JLS took 1.1s. Estimated remaining: 7m 5s. Rate: 154.4 symbols/min [2025-09-22T22:21:52.148126] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:52.162118] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:52.162852] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 32228 primary records. [2025-09-22T22:21:52.163052] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-22T22:21:52.194077] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:52.195391] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50473 primary records. [2025-09-22T22:21:52.196148] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-09-22T22:21:52.196306] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-22T22:21:52.196241] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-22T22:21:52.199053] [INFO ] [MAIN ] Derivative Progress: 998/2091 symbols completed. JLL took 1.2s. Estimated remaining: 7m 4s. Rate: 154.5 symbols/min [2025-09-22T22:21:52.199713] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:52.215752] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-09-22T22:21:52.215873] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-22T22:21:52.218953] [INFO ] [MAIN ] Derivative Progress: 999/2091 symbols completed. JMIA took 1.2s. Estimated remaining: 7m 4s. Rate: 154.7 symbols/min [2025-09-22T22:21:52.219287] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:52.261988] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-22T22:21:52.262210] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-09-22T22:21:52.386930] [DEBUG] [LOCAL ] JOE: Loaded 24699 existing records from primary storage. [2025-09-22T22:21:52.392810] [INFO ] [MAIN ] JOE: Loaded 24699 primary data records. [2025-09-22T22:21:52.699423] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-22T22:21:52.703547] [INFO ] [MAIN ] JOBY: Loaded 53799 primary data records. [2025-09-22T22:21:53.262228] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:53.264286] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-09-22T22:21:53.264576] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-22T22:21:53.285776] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-09-22T22:21:53.286206] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-22T22:21:53.288272] [INFO ] [MAIN ] Derivative Progress: 1000/2091 symbols completed. JNJ took 1.1s. Estimated remaining: 7m 4s. Rate: 154.4 symbols/min [2025-09-22T22:21:53.288554] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:53.307781] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:53.308622] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 24699 primary records. [2025-09-22T22:21:53.309632] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-22T22:21:53.348740] [DEBUG] [LOCAL ] JOF: Loaded 7137 existing records from primary storage. [2025-09-22T22:21:53.345066] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-09-22T22:21:53.348930] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-22T22:21:53.342034] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:53.351280] [INFO ] [MAIN ] Derivative Progress: 1001/2091 symbols completed. JOE took 1.1s. Estimated remaining: 7m 3s. Rate: 154.5 symbols/min [2025-09-22T22:21:53.351740] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:53.351672] [INFO ] [MAIN ] JOF: Loaded 7137 primary data records. [2025-09-22T22:21:53.352910] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53799 primary records. [2025-09-22T22:21:53.390903] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-22T22:21:53.738344] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-09-22T22:21:53.738538] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-22T22:21:53.742840] [INFO ] [MAIN ] Derivative Progress: 1002/2091 symbols completed. JOBY took 1.5s. Estimated remaining: 7m 3s. Rate: 154.5 symbols/min [2025-09-22T22:21:53.743357] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:53.758470] [DEBUG] [LOCAL ] JPC: Loaded 37152 existing records from primary storage. [2025-09-22T22:21:53.759107] [INFO ] [MAIN ] JPC: Loaded 37152 primary data records. [2025-09-22T22:21:54.117623] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:54.117193] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-22T22:21:54.118679] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 7137 primary records. [2025-09-22T22:21:54.119245] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-22T22:21:54.119482] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-09-22T22:21:54.230178] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-09-22T22:21:54.239698] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-22T22:21:54.247259] [INFO ] [MAIN ] Derivative Progress: 1003/2091 symbols completed. JOF took 1.0s. Estimated remaining: 7m 3s. Rate: 154.5 symbols/min [2025-09-22T22:21:54.475132] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:54.475923] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37152 primary records. [2025-09-22T22:21:54.476075] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-22T22:21:54.492831] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-09-22T22:21:54.493055] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-22T22:21:54.495788] [INFO ] [MAIN ] Derivative Progress: 1004/2091 symbols completed. JPC took 1.1s. Estimated remaining: 7m 2s. Rate: 154.6 symbols/min [2025-09-22T22:21:54.515549] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:54.516210] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-09-22T22:21:54.516272] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-22T22:21:54.532987] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-09-22T22:21:54.533061] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-22T22:21:54.535231] [INFO ] [MAIN ] Derivative Progress: 1005/2091 symbols completed. JPM took 0.8s. Estimated remaining: 7m 1s. Rate: 154.7 symbols/min [2025-09-22T22:21:54.536005] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:54.536224] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:54.536313] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:54.549804] [DEBUG] [LOCAL ] JRS: Loaded 11083 existing records from primary storage. [2025-09-22T22:21:54.553272] [INFO ] [MAIN ] JRS: Loaded 11083 primary data records. [2025-09-22T22:21:54.650188] [DEBUG] [LOCAL ] JRI: Loaded 15004 existing records from primary storage. [2025-09-22T22:21:54.684013] [INFO ] [MAIN ] JRI: Loaded 15004 primary data records. [2025-09-22T22:21:54.696153] [DEBUG] [LOCAL ] JQC: Loaded 33859 existing records from primary storage. [2025-09-22T22:21:54.736954] [INFO ] [MAIN ] JQC: Loaded 33859 primary data records. [2025-09-22T22:21:55.527880] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:55.529215] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11083 primary records. [2025-09-22T22:21:55.529359] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-22T22:21:55.549141] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-09-22T22:21:55.573984] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:55.574089] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-22T22:21:55.574879] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15004 primary records. [2025-09-22T22:21:55.576999] [INFO ] [MAIN ] Derivative Progress: 1006/2091 symbols completed. JRS took 1.0s. Estimated remaining: 7m 2s. Rate: 154.4 symbols/min [2025-09-22T22:21:55.577549] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:55.577691] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-22T22:21:55.578355] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33859 primary records. [2025-09-22T22:21:55.577252] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:55.578518] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-22T22:21:55.609616] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-09-22T22:21:55.608639] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-09-22T22:21:55.609856] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-22T22:21:55.609905] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-22T22:21:55.612390] [INFO ] [MAIN ] Derivative Progress: 1007/2091 symbols completed. JQC took 1.1s. Estimated remaining: 7m 1s. Rate: 154.6 symbols/min [2025-09-22T22:21:55.614822] [INFO ] [MAIN ] Derivative Progress: 1008/2091 symbols completed. JRI took 1.1s. Estimated remaining: 6m 60s. Rate: 154.7 symbols/min [2025-09-22T22:21:55.615087] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:55.615393] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:55.632671] [DEBUG] [LOCAL ] KAI: Loaded 13617 existing records from primary storage. [2025-09-22T22:21:55.632884] [INFO ] [MAIN ] KAI: Loaded 13617 primary data records. [2025-09-22T22:21:55.849242] [DEBUG] [LOCAL ] JXN: Loaded 46037 existing records from primary storage. [2025-09-22T22:21:55.861511] [INFO ] [MAIN ] JXN: Loaded 46037 primary data records. [2025-09-22T22:21:56.010552] [DEBUG] [LOCAL ] K: Loaded 49811 existing records from primary storage. [2025-09-22T22:21:56.043125] [INFO ] [MAIN ] K: Loaded 49811 primary data records. [2025-09-22T22:21:56.623426] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:56.624600] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13617 primary records. [2025-09-22T22:21:56.624794] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-22T22:21:56.642896] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-09-22T22:21:56.643708] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-22T22:21:56.646005] [INFO ] [MAIN ] Derivative Progress: 1009/2091 symbols completed. KAI took 1.0s. Estimated remaining: 7m 0s. Rate: 154.5 symbols/min [2025-09-22T22:21:56.646532] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:56.660464] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:56.661205] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 46037 primary records. [2025-09-22T22:21:56.661322] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-22T22:21:56.679392] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-09-22T22:21:56.679726] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-22T22:21:56.681903] [INFO ] [MAIN ] Derivative Progress: 1010/2091 symbols completed. JXN took 1.1s. Estimated remaining: 6m 59s. Rate: 154.6 symbols/min [2025-09-22T22:21:56.690824] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:56.696450] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:56.697348] [INFO ] [MAIN ] K: Generated 1794 derivative records from 49811 primary records. [2025-09-22T22:21:56.697510] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-22T22:21:56.715306] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-09-22T22:21:56.725966] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-22T22:21:56.729143] [INFO ] [MAIN ] Derivative Progress: 1011/2091 symbols completed. K took 1.1s. Estimated remaining: 6m 59s. Rate: 154.7 symbols/min [2025-09-22T22:21:56.734113] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:56.756393] [DEBUG] [LOCAL ] KB: Loaded 24236 existing records from primary storage. [2025-09-22T22:21:56.756549] [INFO ] [MAIN ] KB: Loaded 24236 primary data records. [2025-09-22T22:21:56.778962] [DEBUG] [LOCAL ] KAR: Loaded 39949 existing records from primary storage. [2025-09-22T22:21:56.794473] [INFO ] [MAIN ] KAR: Loaded 39949 primary data records. [2025-09-22T22:21:56.954688] [DEBUG] [LOCAL ] KBDC: Loaded 20592 existing records from primary storage. [2025-09-22T22:21:56.974578] [INFO ] [MAIN ] KBDC: Loaded 20592 primary data records. [2025-09-22T22:21:57.765134] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:57.765953] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 24236 primary records. [2025-09-22T22:21:57.764856] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:57.766073] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-22T22:21:57.768102] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 39949 primary records. [2025-09-22T22:21:57.768432] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-22T22:21:57.808263] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-09-22T22:21:57.808200] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-09-22T22:21:57.813739] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-22T22:21:57.813671] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-22T22:21:57.816498] [INFO ] [MAIN ] Derivative Progress: 1012/2091 symbols completed. KAR took 1.2s. Estimated remaining: 6m 59s. Rate: 154.5 symbols/min [2025-09-22T22:21:57.816818] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:57.814084] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:57.818778] [INFO ] [MAIN ] Derivative Progress: 1013/2091 symbols completed. KB took 1.1s. Estimated remaining: 6m 58s. Rate: 154.6 symbols/min [2025-09-22T22:21:57.820074] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 20592 primary records. [2025-09-22T22:21:57.820229] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:57.820368] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-22T22:21:57.839351] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-09-22T22:21:57.839511] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-22T22:21:57.842417] [INFO ] [MAIN ] Derivative Progress: 1014/2091 symbols completed. KBDC took 1.1s. Estimated remaining: 6m 58s. Rate: 154.8 symbols/min [2025-09-22T22:21:57.842852] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:57.883615] [DEBUG] [LOCAL ] KBR: Loaded 48204 existing records from primary storage. [2025-09-22T22:21:57.883923] [INFO ] [MAIN ] KBR: Loaded 48204 primary data records. [2025-09-22T22:21:58.054252] [DEBUG] [LOCAL ] KBH: Loaded 48917 existing records from primary storage. [2025-09-22T22:21:58.070459] [INFO ] [MAIN ] KBH: Loaded 48917 primary data records. [2025-09-22T22:21:58.313231] [DEBUG] [LOCAL ] KD: Loaded 52291 existing records from primary storage. [2025-09-22T22:21:58.336450] [INFO ] [MAIN ] KD: Loaded 52291 primary data records. [2025-09-22T22:21:58.883130] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:58.884373] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48204 primary records. [2025-09-22T22:21:58.884483] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-22T22:21:58.914398] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:58.915960] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48917 primary records. [2025-09-22T22:21:58.916081] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-22T22:21:58.939052] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-09-22T22:21:58.939190] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-22T22:21:58.941670] [INFO ] [MAIN ] Derivative Progress: 1015/2091 symbols completed. KBR took 1.1s. Estimated remaining: 6m 58s. Rate: 154.5 symbols/min [2025-09-22T22:21:58.938687] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-09-22T22:21:58.941916] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-22T22:21:58.944875] [INFO ] [MAIN ] Derivative Progress: 1016/2091 symbols completed. KBH took 1.1s. Estimated remaining: 6m 57s. Rate: 154.6 symbols/min [2025-09-22T22:21:58.946771] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:58.946901] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:58.961123] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:21:58.961921] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52291 primary records. [2025-09-22T22:21:58.963311] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-22T22:21:58.979960] [DEBUG] [LOCAL ] KEN: Loaded 4763 existing records from primary storage. [2025-09-22T22:21:58.983123] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-09-22T22:21:58.983309] [INFO ] [MAIN ] KEN: Loaded 4763 primary data records. [2025-09-22T22:21:58.995115] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-22T22:21:59.054587] [INFO ] [MAIN ] Derivative Progress: 1017/2091 symbols completed. KD took 1.2s. Estimated remaining: 6m 56s. Rate: 154.7 symbols/min [2025-09-22T22:21:59.072142] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:21:59.319059] [DEBUG] [LOCAL ] KEP: Loaded 30456 existing records from primary storage. [2025-09-22T22:21:59.319489] [INFO ] [MAIN ] KEP: Loaded 30456 primary data records. [2025-09-22T22:21:59.544065] [DEBUG] [LOCAL ] KEX: Loaded 37878 existing records from primary storage. [2025-09-22T22:21:59.698411] [INFO ] [MAIN ] KEX: Loaded 37878 primary data records. [2025-09-22T22:21:59.914236] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:00.022318] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4763 primary records. [2025-09-22T22:22:00.036360] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-22T22:22:00.054316] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-09-22T22:22:00.054550] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-22T22:22:00.057133] [INFO ] [MAIN ] Derivative Progress: 1018/2091 symbols completed. KEN took 1.1s. Estimated remaining: 6m 57s. Rate: 154.5 symbols/min [2025-09-22T22:22:00.074959] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:00.075764] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 30456 primary records. [2025-09-22T22:22:00.075945] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-22T22:22:00.092367] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-09-22T22:22:00.092477] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-22T22:22:00.095119] [INFO ] [MAIN ] Derivative Progress: 1019/2091 symbols completed. KEP took 1.1s. Estimated remaining: 6m 56s. Rate: 154.6 symbols/min [2025-09-22T22:22:00.110600] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:00.111222] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 37878 primary records. [2025-09-22T22:22:00.111287] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-22T22:22:00.126361] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-09-22T22:22:00.126421] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-22T22:22:00.128979] [INFO ] [MAIN ] Derivative Progress: 1020/2091 symbols completed. KEX took 1.1s. Estimated remaining: 6m 55s. Rate: 154.8 symbols/min [2025-09-22T22:22:00.129521] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:00.129899] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:00.129824] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:00.136187] [DEBUG] [LOCAL ] KF: Loaded 2480 existing records from primary storage. [2025-09-22T22:22:00.136351] [INFO ] [MAIN ] KF: Loaded 2480 primary data records. [2025-09-22T22:22:00.263360] [DEBUG] [LOCAL ] KFRC: Loaded 19257 existing records from primary storage. [2025-09-22T22:22:00.263626] [INFO ] [MAIN ] KFRC: Loaded 19257 primary data records. [2025-09-22T22:22:00.619381] [DEBUG] [LOCAL ] KEYS: Loaded 43401 existing records from primary storage. [2025-09-22T22:22:00.642359] [INFO ] [MAIN ] KEYS: Loaded 43401 primary data records. [2025-09-22T22:22:01.133574] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:01.146435] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2480 primary records. [2025-09-22T22:22:01.147131] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:01.148207] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-22T22:22:01.149324] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19257 primary records. [2025-09-22T22:22:01.150099] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-22T22:22:01.175246] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-09-22T22:22:01.176368] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-22T22:22:01.179189] [INFO ] [MAIN ] Derivative Progress: 1021/2091 symbols completed. KFRC took 1.0s. Estimated remaining: 6m 55s. Rate: 154.5 symbols/min [2025-09-22T22:22:01.179562] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:01.188396] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-09-22T22:22:01.188604] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-22T22:22:01.190962] [INFO ] [MAIN ] Derivative Progress: 1022/2091 symbols completed. KF took 1.1s. Estimated remaining: 6m 55s. Rate: 154.7 symbols/min [2025-09-22T22:22:01.191361] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:01.208891] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:01.209236] [DEBUG] [LOCAL ] KFS: Loaded 8242 existing records from primary storage. [2025-09-22T22:22:01.209943] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43401 primary records. [2025-09-22T22:22:01.210194] [INFO ] [MAIN ] KFS: Loaded 8242 primary data records. [2025-09-22T22:22:01.210132] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-22T22:22:01.419514] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-09-22T22:22:01.444588] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-22T22:22:01.448213] [INFO ] [MAIN ] Derivative Progress: 1023/2091 symbols completed. KEYS took 1.3s. Estimated remaining: 6m 54s. Rate: 154.7 symbols/min [2025-09-22T22:22:01.445719] [DEBUG] [LOCAL ] KFY: Loaded 30690 existing records from primary storage. [2025-09-22T22:22:01.448547] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:01.448610] [INFO ] [MAIN ] KFY: Loaded 30690 primary data records. [2025-09-22T22:22:02.048115] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:22:02.050224] [INFO ] [MAIN ] KFS: Generated 1793 derivative records from 8242 primary records. [2025-09-22T22:22:02.051453] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-22T22:22:02.051860] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-22T22:22:02.053234] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-09-22T22:22:02.181094] [DEBUG] [LOCAL ] KFS: Derivative data saved (1793 records). [2025-09-22T22:22:02.187085] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-22T22:22:02.199883] [INFO ] [MAIN ] Derivative Progress: 1024/2091 symbols completed. KFS took 1.0s. Estimated remaining: 6m 54s. Rate: 154.6 symbols/min [2025-09-22T22:22:02.224836] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:02.408879] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:02.410371] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 30690 primary records. [2025-09-22T22:22:02.410710] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-22T22:22:02.430798] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-09-22T22:22:02.431060] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-22T22:22:02.433438] [INFO ] [MAIN ] Derivative Progress: 1025/2091 symbols completed. KFY took 1.2s. Estimated remaining: 6m 54s. Rate: 154.6 symbols/min [2025-09-22T22:22:02.434031] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:02.469504] [DEBUG] [LOCAL ] KGS: Loaded 45789 existing records from primary storage. [2025-09-22T22:22:02.481851] [INFO ] [MAIN ] KGS: Loaded 45789 primary data records. [2025-09-22T22:22:02.488445] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:02.518003] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-09-22T22:22:02.545274] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-22T22:22:02.826166] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-09-22T22:22:02.840545] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-22T22:22:02.842946] [INFO ] [MAIN ] Derivative Progress: 1026/2091 symbols completed. KGC took 1.4s. Estimated remaining: 6m 53s. Rate: 154.6 symbols/min [2025-09-22T22:22:02.858747] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:02.862848] [DEBUG] [LOCAL ] KIM: Loaded 53071 existing records from primary storage. [2025-09-22T22:22:02.863432] [INFO ] [MAIN ] KIM: Loaded 53071 primary data records. [2025-09-22T22:22:03.042075] [DEBUG] [LOCAL ] KIO: Loaded 21326 existing records from primary storage. [2025-09-22T22:22:03.065730] [INFO ] [MAIN ] KIO: Loaded 21326 primary data records. [2025-09-22T22:22:03.318903] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:03.335761] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45789 primary records. [2025-09-22T22:22:03.368126] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-22T22:22:03.541350] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-09-22T22:22:03.541717] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-22T22:22:03.544388] [INFO ] [MAIN ] Derivative Progress: 1027/2091 symbols completed. KGS took 1.3s. Estimated remaining: 6m 53s. Rate: 154.5 symbols/min [2025-09-22T22:22:03.544990] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:03.564722] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:22:03.565751] [INFO ] [MAIN ] KIM: Generated 1793 derivative records from 53071 primary records. [2025-09-22T22:22:03.566000] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-22T22:22:03.584210] [DEBUG] [LOCAL ] KIM: Derivative data saved (1793 records). [2025-09-22T22:22:03.584478] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-22T22:22:03.587003] [INFO ] [MAIN ] Derivative Progress: 1028/2091 symbols completed. KIM took 1.2s. Estimated remaining: 6m 52s. Rate: 154.6 symbols/min [2025-09-22T22:22:03.588437] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:03.606736] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:03.610024] [DEBUG] [LOCAL ] KKRS: Loaded 5760 existing records from primary storage. [2025-09-22T22:22:03.610743] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21326 primary records. [2025-09-22T22:22:03.610899] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-22T22:22:03.610841] [INFO ] [MAIN ] KKRS: Loaded 5760 primary data records. [2025-09-22T22:22:03.721012] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-09-22T22:22:03.733955] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-22T22:22:03.764746] [INFO ] [MAIN ] Derivative Progress: 1029/2091 symbols completed. KIO took 0.9s. Estimated remaining: 6m 52s. Rate: 154.7 symbols/min [2025-09-22T22:22:03.781068] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:03.862431] [DEBUG] [LOCAL ] KKR: Loaded 53505 existing records from primary storage. [2025-09-22T22:22:03.862669] [INFO ] [MAIN ] KKR: Loaded 53505 primary data records. [2025-09-22T22:22:04.221428] [DEBUG] [LOCAL ] KLC: Loaded 36380 existing records from primary storage. [2025-09-22T22:22:04.325900] [INFO ] [MAIN ] KLC: Loaded 36380 primary data records. [2025-09-22T22:22:04.672294] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:04.682791] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5760 primary records. [2025-09-22T22:22:04.683240] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-22T22:22:04.700671] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-09-22T22:22:04.702471] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-22T22:22:04.705258] [INFO ] [MAIN ] Derivative Progress: 1030/2091 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 52s. Rate: 154.5 symbols/min [2025-09-22T22:22:04.706781] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:04.726586] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:04.727542] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53505 primary records. [2025-09-22T22:22:04.727792] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-22T22:22:04.764230] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:04.763917] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-09-22T22:22:04.764375] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-22T22:22:04.767370] [INFO ] [MAIN ] Derivative Progress: 1031/2091 symbols completed. KKR took 1.2s. Estimated remaining: 6m 51s. Rate: 154.6 symbols/min [2025-09-22T22:22:04.767841] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:04.765129] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36380 primary records. [2025-09-22T22:22:04.768492] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-22T22:22:04.794977] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-09-22T22:22:04.795115] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-22T22:22:04.797796] [INFO ] [MAIN ] Derivative Progress: 1032/2091 symbols completed. KLC took 1.0s. Estimated remaining: 6m 51s. Rate: 154.8 symbols/min [2025-09-22T22:22:04.798334] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:04.813285] [DEBUG] [LOCAL ] KLG: Loaded 41901 existing records from primary storage. [2025-09-22T22:22:04.814680] [INFO ] [MAIN ] KLG: Loaded 41901 primary data records. [2025-09-22T22:22:04.852079] [DEBUG] [LOCAL ] KMPB: Loaded 3581 existing records from primary storage. [2025-09-22T22:22:04.857745] [INFO ] [MAIN ] KMPB: Loaded 3581 primary data records. [2025-09-22T22:22:05.472484] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-22T22:22:05.472820] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-09-22T22:22:05.870946] [DEBUG] [MAIN ] KLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:05.872898] [INFO ] [MAIN ] KLG: Generated 1794 derivative records from 41901 primary records. [2025-09-22T22:22:05.870554] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-22T22:22:05.874038] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-22T22:22:05.873910] [INFO ] [MAIN ] KMPB: Generated 1791 derivative records from 3581 primary records. [2025-09-22T22:22:05.874170] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-22T22:22:05.890993] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1791 records). [2025-09-22T22:22:05.899129] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-22T22:22:05.902950] [INFO ] [MAIN ] Derivative Progress: 1033/2091 symbols completed. KMPB took 1.1s. Estimated remaining: 6m 51s. Rate: 154.5 symbols/min [2025-09-22T22:22:05.910535] [DEBUG] [LOCAL ] KLG: Derivative data saved (1794 records). [2025-09-22T22:22:05.910707] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-22T22:22:05.913018] [INFO ] [MAIN ] Derivative Progress: 1034/2091 symbols completed. KLG took 1.2s. Estimated remaining: 6m 50s. Rate: 154.6 symbols/min [2025-09-22T22:22:05.928968] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:05.929684] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-09-22T22:22:05.929750] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-22T22:22:05.946079] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-09-22T22:22:05.946208] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-22T22:22:05.948258] [INFO ] [MAIN ] Derivative Progress: 1035/2091 symbols completed. KMI took 1.2s. Estimated remaining: 6m 49s. Rate: 154.8 symbols/min [2025-09-22T22:22:05.949161] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:05.949085] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:05.948969] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:06.012992] [DEBUG] [LOCAL ] KMPR: Loaded 38145 existing records from primary storage. [2025-09-22T22:22:06.027203] [INFO ] [MAIN ] KMPR: Loaded 38145 primary data records. [2025-09-22T22:22:06.072765] [DEBUG] [LOCAL ] KMX: Loaded 53109 existing records from primary storage. [2025-09-22T22:22:06.078086] [INFO ] [MAIN ] KMX: Loaded 53109 primary data records. [2025-09-22T22:22:06.119257] [DEBUG] [LOCAL ] KMT: Loaded 43079 existing records from primary storage. [2025-09-22T22:22:06.149504] [INFO ] [MAIN ] KMT: Loaded 43079 primary data records. [2025-09-22T22:22:07.054266] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:07.057017] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 38145 primary records. [2025-09-22T22:22:07.070674] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-22T22:22:07.071490] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:07.072920] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53109 primary records. [2025-09-22T22:22:07.081469] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-22T22:22:07.117770] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-09-22T22:22:07.120027] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:07.119667] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-22T22:22:07.120970] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 43079 primary records. [2025-09-22T22:22:07.123380] [INFO ] [MAIN ] Derivative Progress: 1036/2091 symbols completed. KMX took 1.2s. Estimated remaining: 6m 50s. Rate: 154.5 symbols/min [2025-09-22T22:22:07.121094] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-22T22:22:07.124238] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:07.124969] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-09-22T22:22:07.126238] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-22T22:22:07.127994] [INFO ] [MAIN ] Derivative Progress: 1037/2091 symbols completed. KMPR took 1.2s. Estimated remaining: 6m 49s. Rate: 154.6 symbols/min [2025-09-22T22:22:07.140369] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:07.145221] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-09-22T22:22:07.145395] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-22T22:22:07.148245] [INFO ] [MAIN ] Derivative Progress: 1038/2091 symbols completed. KMT took 1.2s. Estimated remaining: 6m 48s. Rate: 154.8 symbols/min [2025-09-22T22:22:07.148796] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:07.167414] [DEBUG] [LOCAL ] KNOP: Loaded 9908 existing records from primary storage. [2025-09-22T22:22:07.167549] [INFO ] [MAIN ] KNOP: Loaded 9908 primary data records. [2025-09-22T22:22:07.391081] [DEBUG] [LOCAL ] KN: Loaded 38942 existing records from primary storage. [2025-09-22T22:22:07.391711] [DEBUG] [LOCAL ] KNF: Loaded 35762 existing records from primary storage. [2025-09-22T22:22:07.391851] [INFO ] [MAIN ] KNF: Loaded 35762 primary data records. [2025-09-22T22:22:07.409793] [INFO ] [MAIN ] KN: Loaded 38942 primary data records. [2025-09-22T22:22:08.196473] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:22:08.197943] [INFO ] [MAIN ] KNOP: Generated 1793 derivative records from 9908 primary records. [2025-09-22T22:22:08.198893] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-22T22:22:08.233147] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1793 records). [2025-09-22T22:22:08.234829] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-22T22:22:08.238081] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:08.237603] [INFO ] [MAIN ] Derivative Progress: 1039/2091 symbols completed. KNOP took 1.1s. Estimated remaining: 6m 49s. Rate: 154.5 symbols/min [2025-09-22T22:22:08.239079] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 35762 primary records. [2025-09-22T22:22:08.239185] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:08.239400] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-22T22:22:08.265010] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:08.266051] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38942 primary records. [2025-09-22T22:22:08.266589] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-22T22:22:08.289826] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-09-22T22:22:08.290447] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-09-22T22:22:08.290396] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-22T22:22:08.294144] [INFO ] [MAIN ] Derivative Progress: 1040/2091 symbols completed. KN took 1.2s. Estimated remaining: 6m 48s. Rate: 154.6 symbols/min [2025-09-22T22:22:08.294632] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:08.294588] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-22T22:22:08.297403] [INFO ] [MAIN ] Derivative Progress: 1041/2091 symbols completed. KNF took 1.2s. Estimated remaining: 6m 47s. Rate: 154.8 symbols/min [2025-09-22T22:22:08.303876] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:08.305381] [DEBUG] [LOCAL ] KNSL: Loaded 18127 existing records from primary storage. [2025-09-22T22:22:08.305674] [INFO ] [MAIN ] KNSL: Loaded 18127 primary data records. [2025-09-22T22:22:08.657226] [DEBUG] [LOCAL ] KNTK: Loaded 46086 existing records from primary storage. [2025-09-22T22:22:08.657590] [INFO ] [MAIN ] KNTK: Loaded 46086 primary data records. [2025-09-22T22:22:08.795070] [DEBUG] [LOCAL ] KNX: Loaded 52594 existing records from primary storage. [2025-09-22T22:22:08.855634] [INFO ] [MAIN ] KNX: Loaded 52594 primary data records. [2025-09-22T22:22:09.313010] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:09.314091] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18127 primary records. [2025-09-22T22:22:09.314210] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-22T22:22:09.337016] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-09-22T22:22:09.337239] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-22T22:22:09.339343] [INFO ] [MAIN ] Derivative Progress: 1042/2091 symbols completed. KNSL took 1.1s. Estimated remaining: 6m 47s. Rate: 154.5 symbols/min [2025-09-22T22:22:09.339607] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:09.354627] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:09.355472] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46086 primary records. [2025-09-22T22:22:09.355732] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-22T22:22:09.372154] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-09-22T22:22:09.372370] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-22T22:22:09.374583] [INFO ] [MAIN ] Derivative Progress: 1043/2091 symbols completed. KNTK took 1.1s. Estimated remaining: 6m 47s. Rate: 154.7 symbols/min [2025-09-22T22:22:09.374951] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:09.391667] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:09.392443] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52594 primary records. [2025-09-22T22:22:09.392557] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-22T22:22:09.420095] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-09-22T22:22:09.420355] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-22T22:22:09.423392] [INFO ] [MAIN ] Derivative Progress: 1044/2091 symbols completed. KNX took 1.1s. Estimated remaining: 6m 46s. Rate: 154.8 symbols/min [2025-09-22T22:22:09.424459] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:09.444763] [DEBUG] [LOCAL ] KODK: Loaded 43420 existing records from primary storage. [2025-09-22T22:22:09.445038] [INFO ] [MAIN ] KODK: Loaded 43420 primary data records. [2025-09-22T22:22:09.578210] [DEBUG] [LOCAL ] KOF: Loaded 25911 existing records from primary storage. [2025-09-22T22:22:09.624159] [DEBUG] [LOCAL ] KOP: Loaded 17960 existing records from primary storage. [2025-09-22T22:22:09.599525] [INFO ] [MAIN ] KOF: Loaded 25911 primary data records. [2025-09-22T22:22:09.654097] [INFO ] [MAIN ] KOP: Loaded 17960 primary data records. [2025-09-22T22:22:10.454788] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:10.456010] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43420 primary records. [2025-09-22T22:22:10.456202] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-22T22:22:10.473355] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-09-22T22:22:10.473710] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-22T22:22:10.475774] [INFO ] [MAIN ] Derivative Progress: 1045/2091 symbols completed. KODK took 1.1s. Estimated remaining: 6m 46s. Rate: 154.5 symbols/min [2025-09-22T22:22:10.476678] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:10.483407] [DEBUG] [LOCAL ] KORE: Loaded 1940 existing records from primary storage. [2025-09-22T22:22:10.504009] [INFO ] [MAIN ] KORE: Loaded 1940 primary data records. [2025-09-22T22:22:10.503630] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:10.510885] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 25911 primary records. [2025-09-22T22:22:10.518556] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-22T22:22:10.637143] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-09-22T22:22:10.648288] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-22T22:22:10.679329] [INFO ] [MAIN ] Derivative Progress: 1046/2091 symbols completed. KOF took 1.3s. Estimated remaining: 6m 46s. Rate: 154.6 symbols/min [2025-09-22T22:22:10.740669] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:10.740353] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:10.859934] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17960 primary records. [2025-09-22T22:22:10.860322] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-22T22:22:10.880830] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-09-22T22:22:10.881096] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-22T22:22:10.884106] [INFO ] [MAIN ] Derivative Progress: 1047/2091 symbols completed. KOP took 1.5s. Estimated remaining: 6m 45s. Rate: 154.7 symbols/min [2025-09-22T22:22:10.884509] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:10.906522] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:10.907270] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 1940 primary records. [2025-09-22T22:22:10.907371] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-22T22:22:10.934873] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-09-22T22:22:10.934988] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-22T22:22:10.937076] [INFO ] [MAIN ] Derivative Progress: 1048/2091 symbols completed. KORE took 0.5s. Estimated remaining: 6m 44s. Rate: 154.8 symbols/min [2025-09-22T22:22:10.968756] [DEBUG] [LOCAL ] KOS: Loaded 53066 existing records from primary storage. [2025-09-22T22:22:10.968975] [INFO ] [MAIN ] KOS: Loaded 53066 primary data records. [2025-09-22T22:22:11.115691] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-22T22:22:11.141309] [INFO ] [MAIN ] KR: Loaded 53682 primary data records. [2025-09-22T22:22:11.626460] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:11.627389] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53066 primary records. [2025-09-22T22:22:11.627495] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-22T22:22:11.645458] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-09-22T22:22:11.645542] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-22T22:22:11.647602] [INFO ] [MAIN ] Derivative Progress: 1049/2091 symbols completed. KOS took 0.9s. Estimated remaining: 6m 44s. Rate: 154.7 symbols/min [2025-09-22T22:22:11.663298] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:11.663882] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53682 primary records. [2025-09-22T22:22:11.663945] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-22T22:22:11.679687] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-09-22T22:22:11.679834] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-22T22:22:11.681922] [INFO ] [MAIN ] Derivative Progress: 1050/2091 symbols completed. KR took 0.8s. Estimated remaining: 6m 43s. Rate: 154.8 symbols/min [2025-09-22T22:22:11.682993] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:11.683279] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:11.683572] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:11.755904] [DEBUG] [LOCAL ] KREF: Loaded 37002 existing records from primary storage. [2025-09-22T22:22:11.767604] [INFO ] [MAIN ] KREF: Loaded 37002 primary data records. [2025-09-22T22:22:11.768551] [DEBUG] [LOCAL ] KRC: Loaded 48433 existing records from primary storage. [2025-09-22T22:22:11.789924] [INFO ] [MAIN ] KRC: Loaded 48433 primary data records. [2025-09-22T22:22:11.965402] [DEBUG] [LOCAL ] KRG: Loaded 49118 existing records from primary storage. [2025-09-22T22:22:11.972788] [INFO ] [MAIN ] KRG: Loaded 49118 primary data records. [2025-09-22T22:22:12.829192] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:12.829583] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:12.830687] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37002 primary records. [2025-09-22T22:22:12.830868] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-22T22:22:12.831683] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48433 primary records. [2025-09-22T22:22:12.831874] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-22T22:22:12.863416] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-09-22T22:22:12.864259] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-22T22:22:12.868869] [INFO ] [MAIN ] Derivative Progress: 1051/2091 symbols completed. KREF took 1.2s. Estimated remaining: 6m 44s. Rate: 154.5 symbols/min [2025-09-22T22:22:12.869566] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:12.889793] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-09-22T22:22:12.890774] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:12.890967] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-22T22:22:12.894782] [INFO ] [MAIN ] Derivative Progress: 1052/2091 symbols completed. KRC took 1.2s. Estimated remaining: 6m 43s. Rate: 154.6 symbols/min [2025-09-22T22:22:12.895897] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49118 primary records. [2025-09-22T22:22:12.896259] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:12.896422] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-22T22:22:12.924325] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-09-22T22:22:12.924495] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-22T22:22:12.927270] [INFO ] [MAIN ] Derivative Progress: 1053/2091 symbols completed. KRG took 1.2s. Estimated remaining: 6m 42s. Rate: 154.8 symbols/min [2025-09-22T22:22:12.927806] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:12.943156] [DEBUG] [LOCAL ] KRO: Loaded 25937 existing records from primary storage. [2025-09-22T22:22:12.943453] [INFO ] [MAIN ] KRO: Loaded 25937 primary data records. [2025-09-22T22:22:13.094982] [DEBUG] [LOCAL ] KRP: Loaded 37738 existing records from primary storage. [2025-09-22T22:22:13.101022] [INFO ] [MAIN ] KRP: Loaded 37738 primary data records. [2025-09-22T22:22:13.443039] [DEBUG] [LOCAL ] KSS: Loaded 53610 existing records from primary storage. [2025-09-22T22:22:13.484507] [INFO ] [MAIN ] KSS: Loaded 53610 primary data records. [2025-09-22T22:22:14.062571] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:14.064180] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 25937 primary records. [2025-09-22T22:22:14.064476] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-22T22:22:14.099289] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:14.101670] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 37738 primary records. [2025-09-22T22:22:14.102055] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-22T22:22:14.103120] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-09-22T22:22:14.103914] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-22T22:22:14.106354] [INFO ] [MAIN ] Derivative Progress: 1054/2091 symbols completed. KRO took 1.2s. Estimated remaining: 6m 43s. Rate: 154.5 symbols/min [2025-09-22T22:22:14.106883] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:14.126787] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-09-22T22:22:14.127068] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-22T22:22:14.129288] [INFO ] [MAIN ] Derivative Progress: 1055/2091 symbols completed. KRP took 1.2s. Estimated remaining: 6m 42s. Rate: 154.6 symbols/min [2025-09-22T22:22:14.143097] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:14.143491] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:14.144723] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53610 primary records. [2025-09-22T22:22:14.144876] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-22T22:22:14.164623] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-09-22T22:22:14.164857] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-22T22:22:14.167341] [INFO ] [MAIN ] Derivative Progress: 1056/2091 symbols completed. KSS took 1.2s. Estimated remaining: 6m 41s. Rate: 154.8 symbols/min [2025-09-22T22:22:14.167618] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:14.197341] [DEBUG] [LOCAL ] KTF: Loaded 13028 existing records from primary storage. [2025-09-22T22:22:14.197479] [INFO ] [MAIN ] KTF: Loaded 13028 primary data records. [2025-09-22T22:22:14.337770] [DEBUG] [LOCAL ] KT: Loaded 45662 existing records from primary storage. [2025-09-22T22:22:14.365414] [INFO ] [MAIN ] KT: Loaded 45662 primary data records. [2025-09-22T22:22:14.429194] [DEBUG] [LOCAL ] KTB: Loaded 41193 existing records from primary storage. [2025-09-22T22:22:14.448206] [INFO ] [MAIN ] KTB: Loaded 41193 primary data records. [2025-09-22T22:22:15.224142] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:15.225153] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 13028 primary records. [2025-09-22T22:22:15.225250] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-22T22:22:15.246398] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-09-22T22:22:15.246578] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-22T22:22:15.248584] [INFO ] [MAIN ] Derivative Progress: 1057/2091 symbols completed. KTF took 1.1s. Estimated remaining: 6m 42s. Rate: 154.5 symbols/min [2025-09-22T22:22:15.249105] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:15.263500] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:15.265739] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45662 primary records. [2025-09-22T22:22:15.265957] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-22T22:22:15.286777] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:15.293883] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 41193 primary records. [2025-09-22T22:22:15.294079] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-22T22:22:15.304562] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-09-22T22:22:15.311096] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-22T22:22:15.313537] [INFO ] [MAIN ] Derivative Progress: 1058/2091 symbols completed. KT took 1.2s. Estimated remaining: 6m 41s. Rate: 154.6 symbols/min [2025-09-22T22:22:15.314106] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-09-22T22:22:15.314398] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:15.314536] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-22T22:22:15.317171] [INFO ] [MAIN ] Derivative Progress: 1059/2091 symbols completed. KTB took 1.2s. Estimated remaining: 6m 40s. Rate: 154.8 symbols/min [2025-09-22T22:22:15.317455] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:15.381830] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-22T22:22:15.382241] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-09-22T22:22:15.532923] [DEBUG] [LOCAL ] KW: Loaded 40648 existing records from primary storage. [2025-09-22T22:22:15.538683] [INFO ] [MAIN ] KW: Loaded 40648 primary data records. [2025-09-22T22:22:15.560677] [DEBUG] [LOCAL ] KVYO: Loaded 49852 existing records from primary storage. [2025-09-22T22:22:15.571148] [INFO ] [MAIN ] KVYO: Loaded 49852 primary data records. [2025-09-22T22:22:16.450341] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:16.451511] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-09-22T22:22:16.451994] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-22T22:22:16.472444] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-09-22T22:22:16.487232] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:16.486731] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-22T22:22:16.488069] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 49852 primary records. [2025-09-22T22:22:16.490074] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-22T22:22:16.489992] [INFO ] [MAIN ] Derivative Progress: 1060/2091 symbols completed. KVUE took 1.2s. Estimated remaining: 6m 40s. Rate: 154.5 symbols/min [2025-09-22T22:22:16.491735] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:16.522854] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-09-22T22:22:16.523669] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-22T22:22:16.527169] [INFO ] [MAIN ] Derivative Progress: 1061/2091 symbols completed. KVYO took 1.2s. Estimated remaining: 6m 40s. Rate: 154.6 symbols/min [2025-09-22T22:22:16.527547] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:16.523601] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:16.529264] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40648 primary records. [2025-09-22T22:22:16.529567] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-22T22:22:16.559162] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-09-22T22:22:16.559349] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-22T22:22:16.561769] [INFO ] [MAIN ] Derivative Progress: 1062/2091 symbols completed. KW took 1.2s. Estimated remaining: 6m 39s. Rate: 154.7 symbols/min [2025-09-22T22:22:16.558247] [DEBUG] [LOCAL ] KWR: Loaded 16817 existing records from primary storage. [2025-09-22T22:22:16.562347] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:16.562266] [INFO ] [MAIN ] KWR: Loaded 16817 primary data records. [2025-09-22T22:22:16.727994] [DEBUG] [LOCAL ] KYN: Loaded 30236 existing records from primary storage. [2025-09-22T22:22:16.793366] [INFO ] [MAIN ] KYN: Loaded 30236 primary data records. [2025-09-22T22:22:17.047862] [DEBUG] [LOCAL ] L: Loaded 40967 existing records from primary storage. [2025-09-22T22:22:17.053499] [INFO ] [MAIN ] L: Loaded 40967 primary data records. [2025-09-22T22:22:17.604501] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:17.605527] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16817 primary records. [2025-09-22T22:22:17.605669] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-22T22:22:17.624917] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-09-22T22:22:17.625060] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-22T22:22:17.627259] [INFO ] [MAIN ] Derivative Progress: 1063/2091 symbols completed. KWR took 1.1s. Estimated remaining: 6m 39s. Rate: 154.5 symbols/min [2025-09-22T22:22:17.652877] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:17.654580] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30236 primary records. [2025-09-22T22:22:17.654763] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-22T22:22:17.668482] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:17.681361] [INFO ] [MAIN ] L: Generated 1794 derivative records from 40967 primary records. [2025-09-22T22:22:17.681440] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-22T22:22:17.704156] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-09-22T22:22:17.704961] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-22T22:22:17.707564] [INFO ] [MAIN ] Derivative Progress: 1064/2091 symbols completed. KYN took 1.2s. Estimated remaining: 6m 39s. Rate: 154.6 symbols/min [2025-09-22T22:22:17.711557] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-09-22T22:22:17.711631] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-22T22:22:17.713883] [INFO ] [MAIN ] Derivative Progress: 1065/2091 symbols completed. L took 1.2s. Estimated remaining: 6m 38s. Rate: 154.7 symbols/min [2025-09-22T22:22:17.714465] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:17.714630] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:17.714791] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:17.754587] [DEBUG] [LOCAL ] LAD: Loaded 23764 existing records from primary storage. [2025-09-22T22:22:17.754875] [INFO ] [MAIN ] LAD: Loaded 23764 primary data records. [2025-09-22T22:22:17.892316] [DEBUG] [LOCAL ] LADR: Loaded 38703 existing records from primary storage. [2025-09-22T22:22:17.903802] [INFO ] [MAIN ] LADR: Loaded 38703 primary data records. [2025-09-22T22:22:18.253554] [DEBUG] [LOCAL ] LAC: Loaded 52302 existing records from primary storage. [2025-09-22T22:22:18.264343] [INFO ] [MAIN ] LAC: Loaded 52302 primary data records. [2025-09-22T22:22:18.868524] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:18.869788] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23764 primary records. [2025-09-22T22:22:18.870295] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-22T22:22:18.903982] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-09-22T22:22:18.904802] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:18.904974] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-22T22:22:18.905676] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 38703 primary records. [2025-09-22T22:22:18.908030] [INFO ] [MAIN ] Derivative Progress: 1066/2091 symbols completed. LAD took 1.2s. Estimated remaining: 6m 38s. Rate: 154.4 symbols/min [2025-09-22T22:22:18.908151] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-22T22:22:18.909806] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:18.928462] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-09-22T22:22:18.931062] [DEBUG] [LOCAL ] LANV: Loaded 2697 existing records from primary storage. [2025-09-22T22:22:18.931256] [INFO ] [MAIN ] LANV: Loaded 2697 primary data records. [2025-09-22T22:22:18.928725] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-22T22:22:18.992303] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:18.963214] [INFO ] [MAIN ] Derivative Progress: 1067/2091 symbols completed. LADR took 1.2s. Estimated remaining: 6m 38s. Rate: 154.6 symbols/min [2025-09-22T22:22:19.015762] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52302 primary records. [2025-09-22T22:22:19.026272] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:19.046370] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-22T22:22:19.075030] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-09-22T22:22:19.099312] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-22T22:22:19.121531] [INFO ] [MAIN ] Derivative Progress: 1068/2091 symbols completed. LAC took 1.4s. Estimated remaining: 6m 37s. Rate: 154.6 symbols/min [2025-09-22T22:22:19.139819] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:19.290514] [DEBUG] [LOCAL ] LAW: Loaded 13887 existing records from primary storage. [2025-09-22T22:22:19.290976] [INFO ] [MAIN ] LAW: Loaded 13887 primary data records. [2025-09-22T22:22:19.647749] [DEBUG] [LOCAL ] LAZ: Loaded 45362 existing records from primary storage. [2025-09-22T22:22:19.648241] [INFO ] [MAIN ] LAZ: Loaded 45362 primary data records. [2025-09-22T22:22:19.824852] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:22:19.968996] [INFO ] [MAIN ] LANV: Generated 1793 derivative records from 2697 primary records. [2025-09-22T22:22:19.976853] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-22T22:22:19.998186] [DEBUG] [LOCAL ] LANV: Derivative data saved (1793 records). [2025-09-22T22:22:19.998694] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-22T22:22:20.001618] [INFO ] [MAIN ] Derivative Progress: 1069/2091 symbols completed. LANV took 1.1s. Estimated remaining: 6m 37s. Rate: 154.5 symbols/min [2025-09-22T22:22:20.002308] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:20.017477] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:20.018678] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 13887 primary records. [2025-09-22T22:22:20.018952] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-22T22:22:20.036468] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-09-22T22:22:20.036891] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-22T22:22:20.039583] [INFO ] [MAIN ] Derivative Progress: 1070/2091 symbols completed. LAW took 1.0s. Estimated remaining: 6m 36s. Rate: 154.6 symbols/min [2025-09-22T22:22:20.040205] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:20.059087] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:20.060059] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 45362 primary records. [2025-09-22T22:22:20.060198] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-22T22:22:20.087511] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-09-22T22:22:20.087774] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-22T22:22:20.099789] [INFO ] [MAIN ] Derivative Progress: 1071/2091 symbols completed. LAZ took 1.0s. Estimated remaining: 6m 36s. Rate: 154.7 symbols/min [2025-09-22T22:22:20.100224] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:20.113375] [DEBUG] [LOCAL ] LB: Loaded 37682 existing records from primary storage. [2025-09-22T22:22:20.113608] [INFO ] [MAIN ] LB: Loaded 37682 primary data records. [2025-09-22T22:22:20.505907] [DEBUG] [LOCAL ] LBRT: Loaded 52920 existing records from primary storage. [2025-09-22T22:22:20.515785] [INFO ] [MAIN ] LBRT: Loaded 52920 primary data records. [2025-09-22T22:22:20.630432] [DEBUG] [LOCAL ] LC: Loaded 47959 existing records from primary storage. [2025-09-22T22:22:20.650581] [INFO ] [MAIN ] LC: Loaded 47959 primary data records. [2025-09-22T22:22:21.221992] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:21.223325] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37682 primary records. [2025-09-22T22:22:21.223805] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-22T22:22:21.242172] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-09-22T22:22:21.243304] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-22T22:22:21.245559] [INFO ] [MAIN ] Derivative Progress: 1072/2091 symbols completed. LB took 1.2s. Estimated remaining: 6m 36s. Rate: 154.4 symbols/min [2025-09-22T22:22:21.246528] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:21.264108] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:21.264936] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52920 primary records. [2025-09-22T22:22:21.265065] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-22T22:22:21.292882] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-09-22T22:22:21.293268] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-22T22:22:21.295737] [INFO ] [MAIN ] Derivative Progress: 1073/2091 symbols completed. LBRT took 1.3s. Estimated remaining: 6m 35s. Rate: 154.6 symbols/min [2025-09-22T22:22:21.296399] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:21.319862] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:21.320726] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 47959 primary records. [2025-09-22T22:22:21.320893] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-22T22:22:21.346799] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-09-22T22:22:21.346988] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-22T22:22:21.346117] [DEBUG] [LOCAL ] LCII: Loaded 28723 existing records from primary storage. [2025-09-22T22:22:21.347108] [INFO ] [MAIN ] LCII: Loaded 28723 primary data records. [2025-09-22T22:22:21.350150] [INFO ] [MAIN ] Derivative Progress: 1074/2091 symbols completed. LC took 1.3s. Estimated remaining: 6m 35s. Rate: 154.7 symbols/min [2025-09-22T22:22:21.371953] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:21.523793] [DEBUG] [LOCAL ] LDI: Loaded 43700 existing records from primary storage. [2025-09-22T22:22:21.535779] [INFO ] [MAIN ] LDI: Loaded 43700 primary data records. [2025-09-22T22:22:21.890512] [DEBUG] [LOCAL ] LDOS: Loaded 45918 existing records from primary storage. [2025-09-22T22:22:21.919105] [INFO ] [MAIN ] LDOS: Loaded 45918 primary data records. [2025-09-22T22:22:22.392909] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:22.394407] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 28723 primary records. [2025-09-22T22:22:22.394623] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-22T22:22:22.417311] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-09-22T22:22:22.420896] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-22T22:22:22.425036] [INFO ] [MAIN ] Derivative Progress: 1075/2091 symbols completed. LCII took 1.2s. Estimated remaining: 6m 35s. Rate: 154.4 symbols/min [2025-09-22T22:22:22.425812] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:22.440457] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:22.442005] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 43700 primary records. [2025-09-22T22:22:22.442426] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-22T22:22:22.462189] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-09-22T22:22:22.466498] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-22T22:22:22.468825] [INFO ] [MAIN ] Derivative Progress: 1076/2091 symbols completed. LDI took 1.2s. Estimated remaining: 6m 34s. Rate: 154.5 symbols/min [2025-09-22T22:22:22.469514] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:22.480142] [DEBUG] [LOCAL ] LDP: Loaded 13072 existing records from primary storage. [2025-09-22T22:22:22.480428] [INFO ] [MAIN ] LDP: Loaded 13072 primary data records. [2025-09-22T22:22:22.551994] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:22.580593] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45918 primary records. [2025-09-22T22:22:22.592671] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-22T22:22:22.879501] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-09-22T22:22:22.893996] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-22T22:22:22.897634] [INFO ] [MAIN ] Derivative Progress: 1077/2091 symbols completed. LDOS took 1.5s. Estimated remaining: 6m 34s. Rate: 154.5 symbols/min [2025-09-22T22:22:22.898480] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:22.899362] [DEBUG] [LOCAL ] LEA: Loaded 41859 existing records from primary storage. [2025-09-22T22:22:22.900982] [INFO ] [MAIN ] LEA: Loaded 41859 primary data records. [2025-09-22T22:22:23.278774] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:23.294523] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 13072 primary records. [2025-09-22T22:22:23.294769] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-22T22:22:23.296837] [DEBUG] [LOCAL ] LEG: Loaded 50389 existing records from primary storage. [2025-09-22T22:22:23.297260] [INFO ] [MAIN ] LEG: Loaded 50389 primary data records. [2025-09-22T22:22:23.445417] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-09-22T22:22:23.446075] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-22T22:22:23.448551] [INFO ] [MAIN ] Derivative Progress: 1078/2091 symbols completed. LDP took 1.0s. Estimated remaining: 6m 33s. Rate: 154.5 symbols/min [2025-09-22T22:22:23.679310] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:23.680131] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41859 primary records. [2025-09-22T22:22:23.680596] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-22T22:22:23.700603] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-09-22T22:22:23.700845] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-22T22:22:23.703347] [INFO ] [MAIN ] Derivative Progress: 1079/2091 symbols completed. LEA took 1.2s. Estimated remaining: 6m 33s. Rate: 154.5 symbols/min [2025-09-22T22:22:23.724554] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:23.725405] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50389 primary records. [2025-09-22T22:22:23.725469] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-22T22:22:23.741330] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-09-22T22:22:23.741402] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-22T22:22:23.743835] [INFO ] [MAIN ] Derivative Progress: 1080/2091 symbols completed. LEG took 0.8s. Estimated remaining: 6m 32s. Rate: 154.7 symbols/min [2025-09-22T22:22:23.744611] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:23.744746] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:23.744562] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:23.769995] [DEBUG] [LOCAL ] LEO: Loaded 17610 existing records from primary storage. [2025-09-22T22:22:23.770324] [INFO ] [MAIN ] LEO: Loaded 17610 primary data records. [2025-09-22T22:22:24.148588] [DEBUG] [LOCAL ] LEN: Loaded 53191 existing records from primary storage. [2025-09-22T22:22:24.162991] [INFO ] [MAIN ] LEN: Loaded 53191 primary data records. [2025-09-22T22:22:24.202586] [DEBUG] [LOCAL ] LEVI: Loaded 51526 existing records from primary storage. [2025-09-22T22:22:24.218260] [INFO ] [MAIN ] LEVI: Loaded 51526 primary data records. [2025-09-22T22:22:24.896347] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:24.897378] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 17610 primary records. [2025-09-22T22:22:24.899806] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-22T22:22:24.917515] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-09-22T22:22:24.917938] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-22T22:22:24.920556] [INFO ] [MAIN ] Derivative Progress: 1081/2091 symbols completed. LEO took 1.2s. Estimated remaining: 6m 33s. Rate: 154.4 symbols/min [2025-09-22T22:22:24.921227] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:24.961291] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:22:24.962055] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:24.968165] [INFO ] [MAIN ] LEVI: Generated 1793 derivative records from 51526 primary records. [2025-09-22T22:22:24.969271] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-22T22:22:24.969083] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53191 primary records. [2025-09-22T22:22:24.970430] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-22T22:22:24.992343] [DEBUG] [LOCAL ] LFT: Loaded 17970 existing records from primary storage. [2025-09-22T22:22:25.001944] [INFO ] [MAIN ] LFT: Loaded 17970 primary data records. [2025-09-22T22:22:25.031877] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1793 records). [2025-09-22T22:22:25.048182] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-22T22:22:25.051248] [INFO ] [MAIN ] Derivative Progress: 1082/2091 symbols completed. LEVI took 1.3s. Estimated remaining: 6m 32s. Rate: 154.5 symbols/min [2025-09-22T22:22:25.070523] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:25.122461] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-09-22T22:22:25.122616] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-22T22:22:25.143048] [INFO ] [MAIN ] Derivative Progress: 1083/2091 symbols completed. LEN took 1.4s. Estimated remaining: 6m 31s. Rate: 154.6 symbols/min [2025-09-22T22:22:25.175700] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:25.210544] [DEBUG] [LOCAL ] LGI: Loaded 10075 existing records from primary storage. [2025-09-22T22:22:25.210731] [INFO ] [MAIN ] LGI: Loaded 10075 primary data records. [2025-09-22T22:22:25.670513] [DEBUG] [LOCAL ] LH: Loaded 38477 existing records from primary storage. [2025-09-22T22:22:25.671866] [INFO ] [MAIN ] LH: Loaded 38477 primary data records. [2025-09-22T22:22:25.807374] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:25.814487] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 17970 primary records. [2025-09-22T22:22:25.814832] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-22T22:22:26.027742] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-09-22T22:22:26.028253] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-22T22:22:26.030455] [INFO ] [MAIN ] Derivative Progress: 1084/2091 symbols completed. LFT took 1.1s. Estimated remaining: 6m 31s. Rate: 154.4 symbols/min [2025-09-22T22:22:26.031919] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:26.050134] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:26.051587] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 10075 primary records. [2025-09-22T22:22:26.052144] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-22T22:22:26.071283] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-09-22T22:22:26.071619] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-22T22:22:26.074085] [INFO ] [MAIN ] Derivative Progress: 1085/2091 symbols completed. LGI took 1.0s. Estimated remaining: 6m 31s. Rate: 154.5 symbols/min [2025-09-22T22:22:26.074511] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:26.104215] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:26.105003] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 38477 primary records. [2025-09-22T22:22:26.105154] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-22T22:22:26.121943] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-09-22T22:22:26.122135] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-22T22:22:26.124677] [INFO ] [MAIN ] Derivative Progress: 1086/2091 symbols completed. LH took 1.0s. Estimated remaining: 6m 30s. Rate: 154.6 symbols/min [2025-09-22T22:22:26.139051] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:26.147091] [DEBUG] [LOCAL ] LHX: Loaded 48812 existing records from primary storage. [2025-09-22T22:22:26.147456] [INFO ] [MAIN ] LHX: Loaded 48812 primary data records. [2025-09-22T22:22:26.244073] [DEBUG] [LOCAL ] LII: Loaded 28510 existing records from primary storage. [2025-09-22T22:22:26.251258] [INFO ] [MAIN ] LII: Loaded 28510 primary data records. [2025-09-22T22:22:26.621800] [DEBUG] [LOCAL ] LION: Loaded 42858 existing records from primary storage. [2025-09-22T22:22:26.632490] [INFO ] [MAIN ] LION: Loaded 42858 primary data records. [2025-09-22T22:22:27.248620] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:27.251304] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48812 primary records. [2025-09-22T22:22:27.252202] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-22T22:22:27.283892] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-09-22T22:22:27.280087] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:27.284096] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-22T22:22:27.287530] [INFO ] [MAIN ] Derivative Progress: 1087/2091 symbols completed. LHX took 1.3s. Estimated remaining: 6m 30s. Rate: 154.3 symbols/min [2025-09-22T22:22:27.285408] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 28510 primary records. [2025-09-22T22:22:27.288434] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-22T22:22:27.288546] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:27.313461] [DEBUG] [LOCAL ] LITB: Loaded 4300 existing records from primary storage. [2025-09-22T22:22:27.314045] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-09-22T22:22:27.314379] [INFO ] [MAIN ] LITB: Loaded 4300 primary data records. [2025-09-22T22:22:27.322437] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-22T22:22:27.341697] [INFO ] [MAIN ] Derivative Progress: 1088/2091 symbols completed. LII took 1.3s. Estimated remaining: 6m 30s. Rate: 154.5 symbols/min [2025-09-22T22:22:27.375381] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:27.381259] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:27.387917] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 42858 primary records. [2025-09-22T22:22:27.405923] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-22T22:22:27.497951] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-09-22T22:22:27.514579] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-22T22:22:27.526399] [INFO ] [MAIN ] Derivative Progress: 1089/2091 symbols completed. LION took 1.4s. Estimated remaining: 6m 29s. Rate: 154.5 symbols/min [2025-09-22T22:22:27.526915] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:27.734448] [DEBUG] [LOCAL ] LLY: Loaded 53294 existing records from primary storage. [2025-09-22T22:22:27.747633] [INFO ] [MAIN ] LLY: Loaded 53294 primary data records. [2025-09-22T22:22:27.748437] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:27.776622] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4300 primary records. [2025-09-22T22:22:27.802691] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-22T22:22:27.898857] [DEBUG] [LOCAL ] LMND: Loaded 51870 existing records from primary storage. [2025-09-22T22:22:27.901793] [INFO ] [MAIN ] LMND: Loaded 51870 primary data records. [2025-09-22T22:22:27.915855] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-09-22T22:22:27.971421] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-22T22:22:28.036602] [INFO ] [MAIN ] Derivative Progress: 1090/2091 symbols completed. LITB took 0.7s. Estimated remaining: 6m 29s. Rate: 154.5 symbols/min [2025-09-22T22:22:28.058215] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:28.445857] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:28.446877] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53294 primary records. [2025-09-22T22:22:28.447165] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-22T22:22:28.476896] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-09-22T22:22:28.477280] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-22T22:22:28.492714] [INFO ] [MAIN ] Derivative Progress: 1091/2091 symbols completed. LLY took 1.1s. Estimated remaining: 6m 28s. Rate: 154.5 symbols/min [2025-09-22T22:22:28.493358] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:28.508246] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:28.508097] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51870 primary records. [2025-09-22T22:22:28.508681] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-22T22:22:28.509957] [DEBUG] [LOCAL ] LMT: Loaded 49955 existing records from primary storage. [2025-09-22T22:22:28.510429] [INFO ] [MAIN ] LMT: Loaded 49955 primary data records. [2025-09-22T22:22:28.644394] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-09-22T22:22:28.648861] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-22T22:22:28.658379] [INFO ] [MAIN ] Derivative Progress: 1092/2091 symbols completed. LMND took 1.1s. Estimated remaining: 6m 28s. Rate: 154.6 symbols/min [2025-09-22T22:22:28.658737] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:28.861671] [DEBUG] [LOCAL ] LND: Loaded 5026 existing records from primary storage. [2025-09-22T22:22:28.886507] [INFO ] [MAIN ] LND: Loaded 5026 primary data records. [2025-09-22T22:22:29.013526] [DEBUG] [LOCAL ] LNC: Loaded 51637 existing records from primary storage. [2025-09-22T22:22:29.079257] [INFO ] [MAIN ] LNC: Loaded 51637 primary data records. [2025-09-22T22:22:29.595014] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:29.596011] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49955 primary records. [2025-09-22T22:22:29.596307] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-22T22:22:29.617552] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-09-22T22:22:29.617770] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-22T22:22:29.621139] [INFO ] [MAIN ] Derivative Progress: 1093/2091 symbols completed. LMT took 1.6s. Estimated remaining: 6m 28s. Rate: 154.3 symbols/min [2025-09-22T22:22:29.637505] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:29.638297] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 5026 primary records. [2025-09-22T22:22:29.638603] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-22T22:22:29.653975] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-09-22T22:22:29.654067] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-22T22:22:29.656400] [INFO ] [MAIN ] Derivative Progress: 1094/2091 symbols completed. LND took 1.0s. Estimated remaining: 6m 27s. Rate: 154.5 symbols/min [2025-09-22T22:22:29.671359] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:29.672030] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51637 primary records. [2025-09-22T22:22:29.672092] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-22T22:22:29.687662] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-09-22T22:22:29.687734] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-22T22:22:29.690166] [INFO ] [MAIN ] Derivative Progress: 1095/2091 symbols completed. LNC took 1.2s. Estimated remaining: 6m 27s. Rate: 154.6 symbols/min [2025-09-22T22:22:29.690842] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:29.690736] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:29.691075] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:29.704870] [DEBUG] [LOCAL ] LNN: Loaded 11247 existing records from primary storage. [2025-09-22T22:22:29.704999] [INFO ] [MAIN ] LNN: Loaded 11247 primary data records. [2025-09-22T22:22:30.055961] [DEBUG] [LOCAL ] LOAR: Loaded 41710 existing records from primary storage. [2025-09-22T22:22:30.056680] [INFO ] [MAIN ] LOAR: Loaded 41710 primary data records. [2025-09-22T22:22:30.122107] [DEBUG] [LOCAL ] LNG: Loaded 51517 existing records from primary storage. [2025-09-22T22:22:30.144942] [INFO ] [MAIN ] LNG: Loaded 51517 primary data records. [2025-09-22T22:22:30.711826] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:30.713159] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11247 primary records. [2025-09-22T22:22:30.713851] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-22T22:22:30.734039] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-09-22T22:22:30.734182] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-22T22:22:30.737004] [INFO ] [MAIN ] Derivative Progress: 1096/2091 symbols completed. LNN took 1.0s. Estimated remaining: 6m 27s. Rate: 154.4 symbols/min [2025-09-22T22:22:30.737755] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:30.757380] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:30.758333] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 41710 primary records. [2025-09-22T22:22:30.758525] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-22T22:22:30.804126] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-09-22T22:22:30.813244] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:30.814239] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51517 primary records. [2025-09-22T22:22:30.814779] [DEBUG] [LOCAL ] LOB: Loaded 27551 existing records from primary storage. [2025-09-22T22:22:30.813467] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-22T22:22:30.814930] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-22T22:22:30.815041] [INFO ] [MAIN ] LOB: Loaded 27551 primary data records. [2025-09-22T22:22:30.818150] [INFO ] [MAIN ] Derivative Progress: 1097/2091 symbols completed. LOAR took 1.1s. Estimated remaining: 6m 26s. Rate: 154.5 symbols/min [2025-09-22T22:22:30.819023] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:30.908442] [DEBUG] [LOCAL ] LOCL: Loaded 3572 existing records from primary storage. [2025-09-22T22:22:30.915538] [INFO ] [MAIN ] LOCL: Loaded 3572 primary data records. [2025-09-22T22:22:31.031673] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-09-22T22:22:31.037001] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-22T22:22:31.101800] [INFO ] [MAIN ] Derivative Progress: 1098/2091 symbols completed. LNG took 1.4s. Estimated remaining: 6m 26s. Rate: 154.5 symbols/min [2025-09-22T22:22:31.138862] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:31.565077] [DEBUG] [LOCAL ] LOMA: Loaded 31689 existing records from primary storage. [2025-09-22T22:22:31.566286] [INFO ] [MAIN ] LOMA: Loaded 31689 primary data records. [2025-09-22T22:22:31.691460] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:31.721028] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27551 primary records. [2025-09-22T22:22:31.721398] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:31.732733] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3572 primary records. [2025-09-22T22:22:31.731941] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-22T22:22:31.788419] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-22T22:22:31.946441] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-09-22T22:22:31.947168] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-22T22:22:31.951130] [INFO ] [MAIN ] Derivative Progress: 1099/2091 symbols completed. LOCL took 1.1s. Estimated remaining: 6m 26s. Rate: 154.3 symbols/min [2025-09-22T22:22:31.952916] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-09-22T22:22:31.953071] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:31.953987] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-22T22:22:31.956585] [INFO ] [MAIN ] Derivative Progress: 1100/2091 symbols completed. LOB took 1.2s. Estimated remaining: 6m 25s. Rate: 154.5 symbols/min [2025-09-22T22:22:31.957325] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:31.982279] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:31.983089] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 31689 primary records. [2025-09-22T22:22:31.983550] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-22T22:22:32.023732] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-09-22T22:22:32.024020] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-22T22:22:32.026556] [INFO ] [MAIN ] Derivative Progress: 1101/2091 symbols completed. LOMA took 0.9s. Estimated remaining: 6m 24s. Rate: 154.6 symbols/min [2025-09-22T22:22:32.027679] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:32.042165] [DEBUG] [LOCAL ] LPG: Loaded 40243 existing records from primary storage. [2025-09-22T22:22:32.057964] [INFO ] [MAIN ] LPG: Loaded 40243 primary data records. [2025-09-22T22:22:32.082995] [DEBUG] [LOCAL ] LOW: Loaded 52956 existing records from primary storage. [2025-09-22T22:22:32.095720] [INFO ] [MAIN ] LOW: Loaded 52956 primary data records. [2025-09-22T22:22:32.305726] [DEBUG] [LOCAL ] LPL: Loaded 25401 existing records from primary storage. [2025-09-22T22:22:32.363866] [INFO ] [MAIN ] LPL: Loaded 25401 primary data records. [2025-09-22T22:22:33.220937] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:33.234864] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 40243 primary records. [2025-09-22T22:22:33.235778] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-22T22:22:33.236072] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:33.253731] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52956 primary records. [2025-09-22T22:22:33.254736] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-22T22:22:33.283066] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:33.290042] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 25401 primary records. [2025-09-22T22:22:33.290472] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-22T22:22:33.291879] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-09-22T22:22:33.292856] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-09-22T22:22:33.304157] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-22T22:22:33.310167] [INFO ] [MAIN ] Derivative Progress: 1102/2091 symbols completed. LOW took 1.4s. Estimated remaining: 6m 25s. Rate: 154.3 symbols/min [2025-09-22T22:22:33.310633] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-22T22:22:33.313402] [INFO ] [MAIN ] Derivative Progress: 1103/2091 symbols completed. LPG took 1.4s. Estimated remaining: 6m 24s. Rate: 154.4 symbols/min [2025-09-22T22:22:33.311516] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:33.313779] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:33.315976] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-09-22T22:22:33.316137] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-22T22:22:33.318479] [INFO ] [MAIN ] Derivative Progress: 1104/2091 symbols completed. LPL took 1.3s. Estimated remaining: 6m 23s. Rate: 154.6 symbols/min [2025-09-22T22:22:33.319069] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:33.394692] [DEBUG] [LOCAL ] LSPD: Loaded 43453 existing records from primary storage. [2025-09-22T22:22:33.394951] [INFO ] [MAIN ] LSPD: Loaded 43453 primary data records. [2025-09-22T22:22:33.480945] [DEBUG] [LOCAL ] LRN: Loaded 40065 existing records from primary storage. [2025-09-22T22:22:33.481178] [INFO ] [MAIN ] LRN: Loaded 40065 primary data records. [2025-09-22T22:22:33.501177] [DEBUG] [LOCAL ] LPX: Loaded 39748 existing records from primary storage. [2025-09-22T22:22:33.511814] [INFO ] [MAIN ] LPX: Loaded 39748 primary data records. [2025-09-22T22:22:34.498999] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:34.500565] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 43453 primary records. [2025-09-22T22:22:34.500984] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:34.504001] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 40065 primary records. [2025-09-22T22:22:34.502542] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-22T22:22:34.504259] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-22T22:22:34.546214] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:34.548379] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39748 primary records. [2025-09-22T22:22:34.549204] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-22T22:22:34.559497] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-09-22T22:22:34.564065] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-22T22:22:34.566528] [INFO ] [MAIN ] Derivative Progress: 1105/2091 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 24s. Rate: 154.2 symbols/min [2025-09-22T22:22:34.568482] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:34.569999] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-09-22T22:22:34.570463] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-22T22:22:34.573029] [INFO ] [MAIN ] Derivative Progress: 1106/2091 symbols completed. LRN took 1.3s. Estimated remaining: 6m 23s. Rate: 154.4 symbols/min [2025-09-22T22:22:34.573252] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:34.577828] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-09-22T22:22:34.578046] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-22T22:22:34.580512] [INFO ] [MAIN ] Derivative Progress: 1107/2091 symbols completed. LPX took 1.3s. Estimated remaining: 6m 22s. Rate: 154.5 symbols/min [2025-09-22T22:22:34.581024] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:34.616111] [DEBUG] [LOCAL ] LTC: Loaded 29864 existing records from primary storage. [2025-09-22T22:22:34.616257] [INFO ] [MAIN ] LTC: Loaded 29864 primary data records. [2025-09-22T22:22:34.759844] [DEBUG] [LOCAL ] LTM: Loaded 36009 existing records from primary storage. [2025-09-22T22:22:34.779488] [INFO ] [MAIN ] LTM: Loaded 36009 primary data records. [2025-09-22T22:22:34.795918] [DEBUG] [LOCAL ] LTH: Loaded 51890 existing records from primary storage. [2025-09-22T22:22:34.863917] [INFO ] [MAIN ] LTH: Loaded 51890 primary data records. [2025-09-22T22:22:35.672774] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:35.674079] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 29864 primary records. [2025-09-22T22:22:35.674381] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-22T22:22:35.693004] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-09-22T22:22:35.695835] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-22T22:22:35.698934] [INFO ] [MAIN ] Derivative Progress: 1108/2091 symbols completed. LTC took 1.1s. Estimated remaining: 6m 22s. Rate: 154.3 symbols/min [2025-09-22T22:22:35.713456] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:35.714518] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 36009 primary records. [2025-09-22T22:22:35.714755] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-22T22:22:35.735668] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:35.736548] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51890 primary records. [2025-09-22T22:22:35.736677] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-22T22:22:35.759854] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-09-22T22:22:35.760190] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-22T22:22:35.762922] [INFO ] [MAIN ] Derivative Progress: 1109/2091 symbols completed. LTH took 1.2s. Estimated remaining: 6m 22s. Rate: 154.4 symbols/min [2025-09-22T22:22:35.764419] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-09-22T22:22:35.764695] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-22T22:22:35.767115] [INFO ] [MAIN ] Derivative Progress: 1110/2091 symbols completed. LTM took 1.2s. Estimated remaining: 6m 21s. Rate: 154.5 symbols/min [2025-09-22T22:22:35.767750] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:35.767945] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:35.767598] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:35.815250] [DEBUG] [LOCAL ] LU: Loaded 48994 existing records from primary storage. [2025-09-22T22:22:35.815426] [INFO ] [MAIN ] LU: Loaded 48994 primary data records. [2025-09-22T22:22:36.071837] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-22T22:22:36.072038] [INFO ] [MAIN ] LUMN: Loaded 53634 primary data records. [2025-09-22T22:22:36.211997] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-22T22:22:36.222689] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-09-22T22:22:36.884937] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:36.885879] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48994 primary records. [2025-09-22T22:22:36.886134] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-22T22:22:36.922303] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-09-22T22:22:36.922411] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-22T22:22:36.921749] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:36.924616] [INFO ] [MAIN ] Derivative Progress: 1111/2091 symbols completed. LU took 1.2s. Estimated remaining: 6m 21s. Rate: 154.2 symbols/min [2025-09-22T22:22:36.925055] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:36.926301] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53634 primary records. [2025-09-22T22:22:36.927556] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-22T22:22:36.958313] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-09-22T22:22:36.959181] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:36.960144] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-09-22T22:22:36.959360] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-22T22:22:36.962348] [INFO ] [MAIN ] Derivative Progress: 1112/2091 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 21s. Rate: 154.4 symbols/min [2025-09-22T22:22:36.962494] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-22T22:22:36.962834] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:36.979763] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-09-22T22:22:36.979943] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-22T22:22:36.982422] [INFO ] [MAIN ] Derivative Progress: 1113/2091 symbols completed. LUV took 1.2s. Estimated remaining: 6m 20s. Rate: 154.5 symbols/min [2025-09-22T22:22:36.982897] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:36.999345] [DEBUG] [LOCAL ] LVWR: Loaded 17418 existing records from primary storage. [2025-09-22T22:22:36.999522] [INFO ] [MAIN ] LVWR: Loaded 17418 primary data records. [2025-09-22T22:22:37.151944] [DEBUG] [LOCAL ] LVS: Loaded 53567 existing records from primary storage. [2025-09-22T22:22:37.176537] [INFO ] [MAIN ] LVS: Loaded 53567 primary data records. [2025-09-22T22:22:37.517400] [DEBUG] [LOCAL ] LW: Loaded 51236 existing records from primary storage. [2025-09-22T22:22:37.532773] [INFO ] [MAIN ] LW: Loaded 51236 primary data records. [2025-09-22T22:22:38.047558] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:38.049303] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 17418 primary records. [2025-09-22T22:22:38.049629] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-22T22:22:38.069315] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-09-22T22:22:38.070242] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-22T22:22:38.080466] [INFO ] [MAIN ] Derivative Progress: 1114/2091 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 20s. Rate: 154.2 symbols/min [2025-09-22T22:22:38.087030] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:38.088385] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53567 primary records. [2025-09-22T22:22:38.088486] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-22T22:22:38.087580] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:38.108203] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-09-22T22:22:38.110976] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-22T22:22:38.113518] [INFO ] [MAIN ] Derivative Progress: 1115/2091 symbols completed. LVS took 1.2s. Estimated remaining: 6m 19s. Rate: 154.4 symbols/min [2025-09-22T22:22:38.113948] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:38.133442] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:38.134303] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51236 primary records. [2025-09-22T22:22:38.134405] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-22T22:22:38.155136] [DEBUG] [LOCAL ] LXFR: Loaded 17038 existing records from primary storage. [2025-09-22T22:22:38.157395] [INFO ] [MAIN ] LXFR: Loaded 17038 primary data records. [2025-09-22T22:22:38.171500] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-09-22T22:22:38.203279] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-22T22:22:38.240016] [INFO ] [MAIN ] Derivative Progress: 1116/2091 symbols completed. LW took 1.3s. Estimated remaining: 6m 19s. Rate: 154.5 symbols/min [2025-09-22T22:22:38.267561] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:38.507903] [DEBUG] [LOCAL ] LXP: Loaded 50627 existing records from primary storage. [2025-09-22T22:22:38.509015] [INFO ] [MAIN ] LXP: Loaded 50627 primary data records. [2025-09-22T22:22:38.627300] [DEBUG] [LOCAL ] LXU: Loaded 32066 existing records from primary storage. [2025-09-22T22:22:38.648585] [INFO ] [MAIN ] LXU: Loaded 32066 primary data records. [2025-09-22T22:22:39.134245] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:39.149013] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 17038 primary records. [2025-09-22T22:22:39.149210] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-22T22:22:39.169562] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-09-22T22:22:39.170460] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-22T22:22:39.172815] [INFO ] [MAIN ] Derivative Progress: 1117/2091 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 19s. Rate: 154.3 symbols/min [2025-09-22T22:22:39.173899] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:39.192879] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:39.194113] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50627 primary records. [2025-09-22T22:22:39.194214] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-22T22:22:39.215470] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-09-22T22:22:39.222002] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-22T22:22:39.224196] [INFO ] [MAIN ] Derivative Progress: 1118/2091 symbols completed. LXP took 1.1s. Estimated remaining: 6m 18s. Rate: 154.4 symbols/min [2025-09-22T22:22:39.237532] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:39.238987] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:39.240352] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 32066 primary records. [2025-09-22T22:22:39.240583] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-22T22:22:39.271898] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-09-22T22:22:39.272078] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-22T22:22:39.275036] [INFO ] [MAIN ] Derivative Progress: 1119/2091 symbols completed. LXU took 1.0s. Estimated remaining: 6m 17s. Rate: 154.5 symbols/min [2025-09-22T22:22:39.275429] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:39.293200] [DEBUG] [LOCAL ] LYB: Loaded 53598 existing records from primary storage. [2025-09-22T22:22:39.293424] [INFO ] [MAIN ] LYB: Loaded 53598 primary data records. [2025-09-22T22:22:39.670186] [DEBUG] [LOCAL ] LYG: Loaded 52882 existing records from primary storage. [2025-09-22T22:22:39.670532] [INFO ] [MAIN ] LYG: Loaded 52882 primary data records. [2025-09-22T22:22:39.793018] [DEBUG] [LOCAL ] LYV: Loaded 51216 existing records from primary storage. [2025-09-22T22:22:39.797181] [INFO ] [MAIN ] LYV: Loaded 51216 primary data records. [2025-09-22T22:22:40.328528] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:40.329301] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53598 primary records. [2025-09-22T22:22:40.329577] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-22T22:22:40.348300] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-09-22T22:22:40.348426] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-22T22:22:40.350633] [INFO ] [MAIN ] Derivative Progress: 1120/2091 symbols completed. LYB took 1.2s. Estimated remaining: 6m 18s. Rate: 154.3 symbols/min [2025-09-22T22:22:40.351312] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:40.372700] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:40.373479] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52882 primary records. [2025-09-22T22:22:40.373859] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-22T22:22:40.399696] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-09-22T22:22:40.400051] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-22T22:22:40.402759] [INFO ] [MAIN ] Derivative Progress: 1121/2091 symbols completed. LYG took 1.2s. Estimated remaining: 6m 17s. Rate: 154.4 symbols/min [2025-09-22T22:22:40.403368] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:40.419209] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:40.429368] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51216 primary records. [2025-09-22T22:22:40.429522] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-22T22:22:40.435710] [DEBUG] [LOCAL ] LZB: Loaded 35557 existing records from primary storage. [2025-09-22T22:22:40.443365] [INFO ] [MAIN ] LZB: Loaded 35557 primary data records. [2025-09-22T22:22:40.484104] [DEBUG] [LOCAL ] LZM: Loaded 13402 existing records from primary storage. [2025-09-22T22:22:40.505242] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-09-22T22:22:40.521710] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-22T22:22:40.490443] [INFO ] [MAIN ] LZM: Loaded 13402 primary data records. [2025-09-22T22:22:40.571118] [INFO ] [MAIN ] Derivative Progress: 1122/2091 symbols completed. LYV took 1.3s. Estimated remaining: 6m 16s. Rate: 154.5 symbols/min [2025-09-22T22:22:40.599854] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:41.125056] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-22T22:22:41.123944] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:41.125356] [INFO ] [MAIN ] M: Loaded 53536 primary data records. [2025-09-22T22:22:41.126331] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35557 primary records. [2025-09-22T22:22:41.147484] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-22T22:22:41.263197] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-09-22T22:22:41.268696] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-22T22:22:41.298742] [INFO ] [MAIN ] Derivative Progress: 1123/2091 symbols completed. LZB took 0.9s. Estimated remaining: 6m 16s. Rate: 154.3 symbols/min [2025-09-22T22:22:41.338917] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:41.518520] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 13402 primary records. [2025-09-22T22:22:41.528281] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-22T22:22:41.546478] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-09-22T22:22:41.546931] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-22T22:22:41.549467] [INFO ] [MAIN ] Derivative Progress: 1124/2091 symbols completed. LZM took 1.1s. Estimated remaining: 6m 16s. Rate: 154.4 symbols/min [2025-09-22T22:22:41.570462] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:41.571087] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53536 primary records. [2025-09-22T22:22:41.571151] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-22T22:22:41.587049] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-09-22T22:22:41.587166] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-22T22:22:41.589063] [INFO ] [MAIN ] Derivative Progress: 1125/2091 symbols completed. M took 1.0s. Estimated remaining: 6m 15s. Rate: 154.5 symbols/min [2025-09-22T22:22:41.589784] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:41.589635] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:41.589910] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:41.657145] [DEBUG] [LOCAL ] MAA: Loaded 42917 existing records from primary storage. [2025-09-22T22:22:41.657834] [INFO ] [MAIN ] MAA: Loaded 42917 primary data records. [2025-09-22T22:22:41.796528] [DEBUG] [LOCAL ] MA: Loaded 52581 existing records from primary storage. [2025-09-22T22:22:41.797508] [DEBUG] [LOCAL ] MAC: Loaded 49726 existing records from primary storage. [2025-09-22T22:22:41.798118] [INFO ] [MAIN ] MAC: Loaded 49726 primary data records. [2025-09-22T22:22:41.798239] [INFO ] [MAIN ] MA: Loaded 52581 primary data records. [2025-09-22T22:22:42.654516] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:42.655514] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42917 primary records. [2025-09-22T22:22:42.655781] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-22T22:22:42.679490] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-09-22T22:22:42.681670] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-22T22:22:42.683928] [INFO ] [MAIN ] Derivative Progress: 1126/2091 symbols completed. MAA took 1.1s. Estimated remaining: 6m 15s. Rate: 154.3 symbols/min [2025-09-22T22:22:42.692074] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:42.706061] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:42.712176] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52581 primary records. [2025-09-22T22:22:42.712582] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-22T22:22:42.713092] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:42.715164] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49726 primary records. [2025-09-22T22:22:42.724130] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-22T22:22:42.739818] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-09-22T22:22:42.741503] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-22T22:22:42.746424] [INFO ] [MAIN ] Derivative Progress: 1127/2091 symbols completed. MA took 1.2s. Estimated remaining: 6m 15s. Rate: 154.4 symbols/min [2025-09-22T22:22:42.747248] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:42.761437] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-09-22T22:22:42.761715] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-22T22:22:42.764816] [INFO ] [MAIN ] Derivative Progress: 1128/2091 symbols completed. MAC took 1.2s. Estimated remaining: 6m 14s. Rate: 154.5 symbols/min [2025-09-22T22:22:42.765222] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:42.780343] [DEBUG] [LOCAL ] MAGN: Loaded 34950 existing records from primary storage. [2025-09-22T22:22:42.780707] [INFO ] [MAIN ] MAGN: Loaded 34950 primary data records. [2025-09-22T22:22:43.006255] [DEBUG] [LOCAL ] MAIN: Loaded 41410 existing records from primary storage. [2025-09-22T22:22:43.137032] [INFO ] [MAIN ] MAIN: Loaded 41410 primary data records. [2025-09-22T22:22:43.159299] [DEBUG] [LOCAL ] MAN: Loaded 43595 existing records from primary storage. [2025-09-22T22:22:43.183306] [INFO ] [MAIN ] MAN: Loaded 43595 primary data records. [2025-09-22T22:22:43.836281] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:43.837491] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 34950 primary records. [2025-09-22T22:22:43.837766] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-22T22:22:43.857066] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-09-22T22:22:43.857391] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-22T22:22:43.861002] [INFO ] [MAIN ] Derivative Progress: 1129/2091 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 14s. Rate: 154.3 symbols/min [2025-09-22T22:22:43.861608] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:43.883500] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:43.897109] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43595 primary records. [2025-09-22T22:22:43.905813] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-22T22:22:43.906701] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:43.907867] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41410 primary records. [2025-09-22T22:22:43.908206] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-22T22:22:43.943944] [DEBUG] [LOCAL ] MANU: Loaded 27184 existing records from primary storage. [2025-09-22T22:22:43.944562] [INFO ] [MAIN ] MANU: Loaded 27184 primary data records. [2025-09-22T22:22:43.958888] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-09-22T22:22:43.985296] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-22T22:22:44.007417] [INFO ] [MAIN ] Derivative Progress: 1130/2091 symbols completed. MAN took 1.2s. Estimated remaining: 6m 14s. Rate: 154.3 symbols/min [2025-09-22T22:22:44.007839] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-09-22T22:22:44.035878] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:44.048444] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-22T22:22:44.059332] [INFO ] [MAIN ] Derivative Progress: 1131/2091 symbols completed. MAIN took 1.3s. Estimated remaining: 6m 13s. Rate: 154.5 symbols/min [2025-09-22T22:22:44.063960] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:44.311797] [DEBUG] [LOCAL ] MATV: Loaded 37736 existing records from primary storage. [2025-09-22T22:22:44.312371] [INFO ] [MAIN ] MATV: Loaded 37736 primary data records. [2025-09-22T22:22:44.434056] [DEBUG] [LOCAL ] MAS: Loaded 52354 existing records from primary storage. [2025-09-22T22:22:44.445801] [INFO ] [MAIN ] MAS: Loaded 52354 primary data records. [2025-09-22T22:22:44.771053] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:44.807046] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27184 primary records. [2025-09-22T22:22:44.839052] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-22T22:22:44.984612] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-09-22T22:22:44.985819] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-22T22:22:44.988472] [INFO ] [MAIN ] Derivative Progress: 1132/2091 symbols completed. MANU took 1.1s. Estimated remaining: 6m 13s. Rate: 154.3 symbols/min [2025-09-22T22:22:44.989244] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:45.016249] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:45.017336] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 37736 primary records. [2025-09-22T22:22:45.025121] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-22T22:22:45.039574] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:45.047699] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52354 primary records. [2025-09-22T22:22:45.051532] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-22T22:22:45.055685] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-09-22T22:22:45.056542] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-22T22:22:45.068296] [INFO ] [MAIN ] Derivative Progress: 1133/2091 symbols completed. MATV took 1.0s. Estimated remaining: 6m 12s. Rate: 154.4 symbols/min [2025-09-22T22:22:45.080439] [DEBUG] [LOCAL ] MATX: Loaded 31663 existing records from primary storage. [2025-09-22T22:22:45.076843] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:45.080900] [INFO ] [MAIN ] MATX: Loaded 31663 primary data records. [2025-09-22T22:22:45.156796] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-09-22T22:22:45.169497] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-22T22:22:45.177361] [INFO ] [MAIN ] Derivative Progress: 1134/2091 symbols completed. MAS took 1.1s. Estimated remaining: 6m 12s. Rate: 154.5 symbols/min [2025-09-22T22:22:45.185959] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:45.425493] [DEBUG] [LOCAL ] MAX: Loaded 30950 existing records from primary storage. [2025-09-22T22:22:45.425701] [INFO ] [MAIN ] MAX: Loaded 30950 primary data records. [2025-09-22T22:22:45.616286] [DEBUG] [LOCAL ] MBC: Loaded 43106 existing records from primary storage. [2025-09-22T22:22:45.651090] [INFO ] [MAIN ] MBC: Loaded 43106 primary data records. [2025-09-22T22:22:46.027457] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:46.029404] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31663 primary records. [2025-09-22T22:22:46.029666] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-22T22:22:46.179206] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-09-22T22:22:46.179748] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-22T22:22:46.181857] [INFO ] [MAIN ] Derivative Progress: 1135/2091 symbols completed. MATX took 1.2s. Estimated remaining: 6m 12s. Rate: 154.3 symbols/min [2025-09-22T22:22:46.182544] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:46.201940] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:46.202801] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30950 primary records. [2025-09-22T22:22:46.203138] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-22T22:22:46.225911] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-09-22T22:22:46.226163] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-22T22:22:46.228479] [INFO ] [MAIN ] Derivative Progress: 1136/2091 symbols completed. MAX took 1.2s. Estimated remaining: 6m 11s. Rate: 154.4 symbols/min [2025-09-22T22:22:46.230972] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:46.240935] [DEBUG] [LOCAL ] MBI: Loaded 24778 existing records from primary storage. [2025-09-22T22:22:46.241219] [INFO ] [MAIN ] MBI: Loaded 24778 primary data records. [2025-09-22T22:22:46.309712] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:46.325406] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43106 primary records. [2025-09-22T22:22:46.331691] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-22T22:22:46.588150] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-09-22T22:22:46.588415] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-22T22:22:46.590784] [INFO ] [MAIN ] Derivative Progress: 1137/2091 symbols completed. MBC took 1.4s. Estimated remaining: 6m 11s. Rate: 154.4 symbols/min [2025-09-22T22:22:46.592029] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:46.609698] [DEBUG] [LOCAL ] MC: Loaded 44356 existing records from primary storage. [2025-09-22T22:22:46.610252] [INFO ] [MAIN ] MC: Loaded 44356 primary data records. [2025-09-22T22:22:46.700597] [DEBUG] [LOCAL ] MCB: Loaded 11758 existing records from primary storage. [2025-09-22T22:22:46.712328] [INFO ] [MAIN ] MCB: Loaded 11758 primary data records. [2025-09-22T22:22:47.237216] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:47.238696] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24778 primary records. [2025-09-22T22:22:47.238814] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-22T22:22:47.259716] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-09-22T22:22:47.259901] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-22T22:22:47.262167] [INFO ] [MAIN ] Derivative Progress: 1138/2091 symbols completed. MBI took 1.1s. Estimated remaining: 6m 11s. Rate: 154.3 symbols/min [2025-09-22T22:22:47.282216] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:47.283065] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44356 primary records. [2025-09-22T22:22:47.283843] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-22T22:22:47.310945] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:47.313425] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-09-22T22:22:47.313507] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-22T22:22:47.314140] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11758 primary records. [2025-09-22T22:22:47.316232] [INFO ] [MAIN ] Derivative Progress: 1139/2091 symbols completed. MC took 1.1s. Estimated remaining: 6m 10s. Rate: 154.4 symbols/min [2025-09-22T22:22:47.316334] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-22T22:22:47.331411] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-09-22T22:22:47.331469] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-22T22:22:47.333683] [INFO ] [MAIN ] Derivative Progress: 1140/2091 symbols completed. MCB took 0.7s. Estimated remaining: 6m 9s. Rate: 154.5 symbols/min [2025-09-22T22:22:47.334513] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:47.334460] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:47.334292] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:47.349459] [DEBUG] [LOCAL ] MCI: Loaded 6370 existing records from primary storage. [2025-09-22T22:22:47.349589] [INFO ] [MAIN ] MCI: Loaded 6370 primary data records. [2025-09-22T22:22:47.346574] [DEBUG] [LOCAL ] MCN: Loaded 8119 existing records from primary storage. [2025-09-22T22:22:47.361786] [INFO ] [MAIN ] MCN: Loaded 8119 primary data records. [2025-09-22T22:22:47.879783] [DEBUG] [LOCAL ] MCK: Loaded 39352 existing records from primary storage. [2025-09-22T22:22:47.998096] [INFO ] [MAIN ] MCK: Loaded 39352 primary data records. [2025-09-22T22:22:48.354120] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:48.363191] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8119 primary records. [2025-09-22T22:22:48.368458] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:48.368225] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-22T22:22:48.369472] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6370 primary records. [2025-09-22T22:22:48.370085] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-22T22:22:48.398479] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-09-22T22:22:48.402545] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-09-22T22:22:48.399079] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-22T22:22:48.405042] [INFO ] [MAIN ] Derivative Progress: 1141/2091 symbols completed. MCI took 1.1s. Estimated remaining: 6m 9s. Rate: 154.3 symbols/min [2025-09-22T22:22:48.405344] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:48.402693] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-22T22:22:48.407913] [INFO ] [MAIN ] Derivative Progress: 1142/2091 symbols completed. MCN took 1.1s. Estimated remaining: 6m 9s. Rate: 154.4 symbols/min [2025-09-22T22:22:48.415937] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:48.421735] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:48.422559] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 39352 primary records. [2025-09-22T22:22:48.422682] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-22T22:22:48.443933] [DEBUG] [LOCAL ] MCR: Loaded 8813 existing records from primary storage. [2025-09-22T22:22:48.444772] [INFO ] [MAIN ] MCR: Loaded 8813 primary data records. [2025-09-22T22:22:48.511277] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-09-22T22:22:48.549119] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-22T22:22:48.564054] [INFO ] [MAIN ] Derivative Progress: 1143/2091 symbols completed. MCK took 1.2s. Estimated remaining: 6m 8s. Rate: 154.5 symbols/min [2025-09-22T22:22:48.620462] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:48.772822] [DEBUG] [LOCAL ] MCO: Loaded 39615 existing records from primary storage. [2025-09-22T22:22:48.773069] [INFO ] [MAIN ] MCO: Loaded 39615 primary data records. [2025-09-22T22:22:48.903209] [DEBUG] [LOCAL ] MCS: Loaded 21239 existing records from primary storage. [2025-09-22T22:22:48.934684] [INFO ] [MAIN ] MCS: Loaded 21239 primary data records. [2025-09-22T22:22:49.423369] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:49.424553] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8813 primary records. [2025-09-22T22:22:49.424824] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-22T22:22:49.442572] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-09-22T22:22:49.442793] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-22T22:22:49.445461] [INFO ] [MAIN ] Derivative Progress: 1144/2091 symbols completed. MCR took 1.0s. Estimated remaining: 6m 8s. Rate: 154.3 symbols/min [2025-09-22T22:22:49.446096] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:49.463939] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:49.464879] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39615 primary records. [2025-09-22T22:22:49.465114] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-22T22:22:49.493787] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-09-22T22:22:49.495545] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-22T22:22:49.520233] [DEBUG] [LOCAL ] MCY: Loaded 25232 existing records from primary storage. [2025-09-22T22:22:49.506395] [INFO ] [MAIN ] Derivative Progress: 1145/2091 symbols completed. MCO took 1.1s. Estimated remaining: 6m 7s. Rate: 154.5 symbols/min [2025-09-22T22:22:49.520540] [INFO ] [MAIN ] MCY: Loaded 25232 primary data records. [2025-09-22T22:22:49.521236] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:49.521046] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:49.527630] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 21239 primary records. [2025-09-22T22:22:49.534340] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-22T22:22:49.684250] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-09-22T22:22:49.712003] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-22T22:22:49.715580] [INFO ] [MAIN ] Derivative Progress: 1146/2091 symbols completed. MCS took 1.1s. Estimated remaining: 6m 7s. Rate: 154.5 symbols/min [2025-09-22T22:22:49.735421] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:49.892777] [DEBUG] [LOCAL ] MD: Loaded 38643 existing records from primary storage. [2025-09-22T22:22:49.896426] [DEBUG] [LOCAL ] MDST: Loaded 5476 existing records from primary storage. [2025-09-22T22:22:49.896557] [INFO ] [MAIN ] MDST: Loaded 5476 primary data records. [2025-09-22T22:22:49.907812] [INFO ] [MAIN ] MD: Loaded 38643 primary data records. [2025-09-22T22:22:50.536438] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:50.537812] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 25232 primary records. [2025-09-22T22:22:50.537950] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-22T22:22:50.555950] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-09-22T22:22:50.556352] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-22T22:22:50.558755] [INFO ] [MAIN ] Derivative Progress: 1147/2091 symbols completed. MCY took 1.1s. Estimated remaining: 6m 7s. Rate: 154.4 symbols/min [2025-09-22T22:22:50.559351] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:50.580137] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:50.580988] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5476 primary records. [2025-09-22T22:22:50.581142] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-22T22:22:50.594110] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:50.595075] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38643 primary records. [2025-09-22T22:22:50.605543] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-22T22:22:50.622183] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-09-22T22:22:50.624151] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-22T22:22:50.627114] [INFO ] [MAIN ] Derivative Progress: 1148/2091 symbols completed. MDST took 0.9s. Estimated remaining: 6m 6s. Rate: 154.5 symbols/min [2025-09-22T22:22:50.628293] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-09-22T22:22:50.628398] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-22T22:22:50.628705] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:50.631117] [INFO ] [MAIN ] Derivative Progress: 1149/2091 symbols completed. MD took 1.1s. Estimated remaining: 6m 6s. Rate: 154.6 symbols/min [2025-09-22T22:22:50.631508] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:50.655557] [DEBUG] [LOCAL ] MDV: Loaded 8806 existing records from primary storage. [2025-09-22T22:22:50.655737] [INFO ] [MAIN ] MDV: Loaded 8806 primary data records. [2025-09-22T22:22:50.776532] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-22T22:22:50.782289] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-09-22T22:22:51.112121] [DEBUG] [LOCAL ] MDU: Loaded 47873 existing records from primary storage. [2025-09-22T22:22:51.128763] [INFO ] [MAIN ] MDU: Loaded 47873 primary data records. [2025-09-22T22:22:51.684973] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:51.686761] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8806 primary records. [2025-09-22T22:22:51.687175] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-22T22:22:51.709088] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-09-22T22:22:51.717056] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-22T22:22:51.724272] [INFO ] [MAIN ] Derivative Progress: 1150/2091 symbols completed. MDV took 1.1s. Estimated remaining: 6m 6s. Rate: 154.4 symbols/min [2025-09-22T22:22:51.724755] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:51.725775] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-09-22T22:22:51.726355] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:51.726779] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-22T22:22:51.752344] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-09-22T22:22:51.752616] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-22T22:22:51.762883] [INFO ] [MAIN ] Derivative Progress: 1151/2091 symbols completed. MDT took 1.2s. Estimated remaining: 6m 5s. Rate: 154.5 symbols/min [2025-09-22T22:22:51.768845] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:51.769317] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:51.775289] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47873 primary records. [2025-09-22T22:22:51.775749] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-22T22:22:51.780107] [DEBUG] [LOCAL ] MEC: Loaded 16481 existing records from primary storage. [2025-09-22T22:22:51.780213] [INFO ] [MAIN ] MEC: Loaded 16481 primary data records. [2025-09-22T22:22:51.909534] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-09-22T22:22:51.925499] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-22T22:22:51.944474] [INFO ] [MAIN ] Derivative Progress: 1152/2091 symbols completed. MDU took 1.3s. Estimated remaining: 6m 5s. Rate: 154.6 symbols/min [2025-09-22T22:22:52.000282] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:52.003162] [DEBUG] [LOCAL ] MED: Loaded 21844 existing records from primary storage. [2025-09-22T22:22:52.007882] [INFO ] [MAIN ] MED: Loaded 21844 primary data records. [2025-09-22T22:22:52.450604] [DEBUG] [LOCAL ] MEG: Loaded 31952 existing records from primary storage. [2025-09-22T22:22:52.451149] [INFO ] [MAIN ] MEG: Loaded 31952 primary data records. [2025-09-22T22:22:52.655186] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:52.695170] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16481 primary records. [2025-09-22T22:22:52.781268] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-22T22:22:52.801123] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-09-22T22:22:52.801397] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-22T22:22:52.803675] [INFO ] [MAIN ] Derivative Progress: 1153/2091 symbols completed. MEC took 1.1s. Estimated remaining: 6m 5s. Rate: 154.4 symbols/min [2025-09-22T22:22:52.821404] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:52.822337] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21844 primary records. [2025-09-22T22:22:52.822534] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-22T22:22:52.839973] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-09-22T22:22:52.840114] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-22T22:22:52.842601] [INFO ] [MAIN ] Derivative Progress: 1154/2091 symbols completed. MED took 1.1s. Estimated remaining: 6m 4s. Rate: 154.5 symbols/min [2025-09-22T22:22:52.856966] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:52.857693] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31952 primary records. [2025-09-22T22:22:52.857758] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-22T22:22:52.873289] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-09-22T22:22:52.873347] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-22T22:22:52.875686] [INFO ] [MAIN ] Derivative Progress: 1155/2091 symbols completed. MEG took 0.9s. Estimated remaining: 6m 3s. Rate: 154.6 symbols/min [2025-09-22T22:22:52.876150] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:52.876391] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:52.876597] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:52.906572] [DEBUG] [LOCAL ] MEGI: Loaded 20533 existing records from primary storage. [2025-09-22T22:22:52.906800] [INFO ] [MAIN ] MEGI: Loaded 20533 primary data records. [2025-09-22T22:22:53.034833] [DEBUG] [LOCAL ] MEI: Loaded 32712 existing records from primary storage. [2025-09-22T22:22:53.034989] [INFO ] [MAIN ] MEI: Loaded 32712 primary data records. [2025-09-22T22:22:53.337464] [DEBUG] [LOCAL ] MET: Loaded 53315 existing records from primary storage. [2025-09-22T22:22:53.369231] [INFO ] [MAIN ] MET: Loaded 53315 primary data records. [2025-09-22T22:22:53.930280] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:53.932016] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 20533 primary records. [2025-09-22T22:22:53.932252] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-22T22:22:53.964247] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:53.966418] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 32712 primary records. [2025-09-22T22:22:53.966659] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-22T22:22:53.968985] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-09-22T22:22:53.969356] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-22T22:22:53.971847] [INFO ] [MAIN ] Derivative Progress: 1156/2091 symbols completed. MEGI took 1.1s. Estimated remaining: 6m 3s. Rate: 154.4 symbols/min [2025-09-22T22:22:53.979056] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:53.990329] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-09-22T22:22:53.991368] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-22T22:22:53.993709] [INFO ] [MAIN ] Derivative Progress: 1157/2091 symbols completed. MEI took 1.1s. Estimated remaining: 6m 3s. Rate: 154.5 symbols/min [2025-09-22T22:22:53.995003] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:54.009458] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:54.010098] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53315 primary records. [2025-09-22T22:22:54.010159] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-22T22:22:54.026877] [DEBUG] [LOCAL ] MFAN: Loaded 4283 existing records from primary storage. [2025-09-22T22:22:54.027509] [INFO ] [MAIN ] MFAN: Loaded 4283 primary data records. [2025-09-22T22:22:54.152049] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-09-22T22:22:54.152327] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-22T22:22:54.155375] [INFO ] [MAIN ] Derivative Progress: 1158/2091 symbols completed. MET took 1.3s. Estimated remaining: 6m 2s. Rate: 154.6 symbols/min [2025-09-22T22:22:54.155782] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:54.254067] [DEBUG] [LOCAL ] MFA: Loaded 45255 existing records from primary storage. [2025-09-22T22:22:54.254247] [DEBUG] [LOCAL ] MFAO: Loaded 3825 existing records from primary storage. [2025-09-22T22:22:54.360928] [INFO ] [MAIN ] MFA: Loaded 45255 primary data records. [2025-09-22T22:22:54.366275] [INFO ] [MAIN ] MFAO: Loaded 3825 primary data records. [2025-09-22T22:22:55.020397] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:55.021454] [INFO ] [MAIN ] MFAN: Generated 1794 derivative records from 4283 primary records. [2025-09-22T22:22:55.021669] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-22T22:22:55.044220] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1794 records). [2025-09-22T22:22:55.044353] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-22T22:22:55.046471] [INFO ] [MAIN ] Derivative Progress: 1159/2091 symbols completed. MFAN took 1.1s. Estimated remaining: 6m 2s. Rate: 154.4 symbols/min [2025-09-22T22:22:55.046914] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:55.062516] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:55.064052] [INFO ] [MAIN ] MFAO: Generated 1794 derivative records from 3825 primary records. [2025-09-22T22:22:55.064392] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-22T22:22:55.088813] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:55.091118] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45255 primary records. [2025-09-22T22:22:55.093435] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1794 records). [2025-09-22T22:22:55.093774] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-22T22:22:55.096404] [INFO ] [MAIN ] Derivative Progress: 1160/2091 symbols completed. MFAO took 0.9s. Estimated remaining: 6m 1s. Rate: 154.5 symbols/min [2025-09-22T22:22:55.093580] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-22T22:22:55.097453] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:55.113605] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-09-22T22:22:55.113791] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-22T22:22:55.116318] [INFO ] [MAIN ] Derivative Progress: 1161/2091 symbols completed. MFA took 1.1s. Estimated remaining: 6m 1s. Rate: 154.7 symbols/min [2025-09-22T22:22:55.116664] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:55.145617] [DEBUG] [LOCAL ] MFM: Loaded 14268 existing records from primary storage. [2025-09-22T22:22:55.145830] [INFO ] [MAIN ] MFM: Loaded 14268 primary data records. [2025-09-22T22:22:55.277615] [DEBUG] [LOCAL ] MFC: Loaded 51327 existing records from primary storage. [2025-09-22T22:22:55.293394] [INFO ] [MAIN ] MFC: Loaded 51327 primary data records. [2025-09-22T22:22:55.579006] [DEBUG] [LOCAL ] MFG: Loaded 49048 existing records from primary storage. [2025-09-22T22:22:55.598106] [INFO ] [MAIN ] MFG: Loaded 49048 primary data records. [2025-09-22T22:22:56.170344] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:56.171999] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14268 primary records. [2025-09-22T22:22:56.172371] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-22T22:22:56.191603] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-09-22T22:22:56.204357] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-22T22:22:56.204667] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:56.208120] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51327 primary records. [2025-09-22T22:22:56.207193] [INFO ] [MAIN ] Derivative Progress: 1162/2091 symbols completed. MFM took 1.1s. Estimated remaining: 6m 1s. Rate: 154.4 symbols/min [2025-09-22T22:22:56.208809] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:56.208587] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-22T22:22:56.247933] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:56.248961] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49048 primary records. [2025-09-22T22:22:56.248083] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-09-22T22:22:56.249096] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-22T22:22:56.249275] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-22T22:22:56.251380] [INFO ] [MAIN ] Derivative Progress: 1163/2091 symbols completed. MFC took 1.2s. Estimated remaining: 6m 0s. Rate: 154.5 symbols/min [2025-09-22T22:22:56.257905] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:56.265328] [DEBUG] [LOCAL ] MG: Loaded 16813 existing records from primary storage. [2025-09-22T22:22:56.269207] [INFO ] [MAIN ] MG: Loaded 16813 primary data records. [2025-09-22T22:22:56.316301] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-09-22T22:22:56.328361] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-22T22:22:56.339502] [INFO ] [MAIN ] Derivative Progress: 1164/2091 symbols completed. MFG took 1.2s. Estimated remaining: 5m 60s. Rate: 154.6 symbols/min [2025-09-22T22:22:56.351710] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:56.460681] [DEBUG] [LOCAL ] MGF: Loaded 4108 existing records from primary storage. [2025-09-22T22:22:56.460815] [INFO ] [MAIN ] MGF: Loaded 4108 primary data records. [2025-09-22T22:22:56.730876] [DEBUG] [LOCAL ] MGA: Loaded 50661 existing records from primary storage. [2025-09-22T22:22:56.765257] [INFO ] [MAIN ] MGA: Loaded 50661 primary data records. [2025-09-22T22:22:57.231971] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:57.233505] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16813 primary records. [2025-09-22T22:22:57.234786] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-22T22:22:57.251772] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-09-22T22:22:57.251983] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-22T22:22:57.253912] [INFO ] [MAIN ] Derivative Progress: 1165/2091 symbols completed. MG took 1.0s. Estimated remaining: 5m 60s. Rate: 154.5 symbols/min [2025-09-22T22:22:57.254160] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:57.272015] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:57.272734] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4108 primary records. [2025-09-22T22:22:57.273116] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-22T22:22:57.292524] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-09-22T22:22:57.292813] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-22T22:22:57.295225] [INFO ] [MAIN ] Derivative Progress: 1166/2091 symbols completed. MGF took 0.9s. Estimated remaining: 5m 59s. Rate: 154.6 symbols/min [2025-09-22T22:22:57.304158] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:57.310792] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:57.325475] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50661 primary records. [2025-09-22T22:22:57.325976] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-22T22:22:57.331808] [DEBUG] [LOCAL ] MGR: Loaded 5660 existing records from primary storage. [2025-09-22T22:22:57.332179] [INFO ] [MAIN ] MGR: Loaded 5660 primary data records. [2025-09-22T22:22:57.468743] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-09-22T22:22:57.469707] [DEBUG] [LOCAL ] MGM: Loaded 53609 existing records from primary storage. [2025-09-22T22:22:57.470182] [INFO ] [MAIN ] MGM: Loaded 53609 primary data records. [2025-09-22T22:22:57.480679] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-22T22:22:57.529306] [INFO ] [MAIN ] Derivative Progress: 1167/2091 symbols completed. MGA took 1.3s. Estimated remaining: 5m 59s. Rate: 154.6 symbols/min [2025-09-22T22:22:57.577693] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:57.803099] [DEBUG] [LOCAL ] MGRB: Loaded 4092 existing records from primary storage. [2025-09-22T22:22:57.843372] [INFO ] [MAIN ] MGRB: Loaded 4092 primary data records. [2025-09-22T22:22:58.311160] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-09-22T22:22:58.313067] [INFO ] [MAIN ] MGR: Generated 1790 derivative records from 5660 primary records. [2025-09-22T22:22:58.313240] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-22T22:22:58.343571] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:58.345438] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53609 primary records. [2025-09-22T22:22:58.346586] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-22T22:22:58.360977] [DEBUG] [LOCAL ] MGR: Derivative data saved (1790 records). [2025-09-22T22:22:58.361329] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-22T22:22:58.365315] [INFO ] [MAIN ] Derivative Progress: 1168/2091 symbols completed. MGR took 1.1s. Estimated remaining: 5m 58s. Rate: 154.5 symbols/min [2025-09-22T22:22:58.368250] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-09-22T22:22:58.368402] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-22T22:22:58.370737] [INFO ] [MAIN ] Derivative Progress: 1169/2091 symbols completed. MGM took 1.1s. Estimated remaining: 5m 58s. Rate: 154.6 symbols/min [2025-09-22T22:22:58.385300] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:58.385881] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4092 primary records. [2025-09-22T22:22:58.385942] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-22T22:22:58.400013] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-09-22T22:22:58.400072] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-22T22:22:58.402419] [INFO ] [MAIN ] Derivative Progress: 1170/2091 symbols completed. MGRB took 0.8s. Estimated remaining: 5m 57s. Rate: 154.7 symbols/min [2025-09-22T22:22:58.403071] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:58.403011] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:58.403140] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:58.414311] [DEBUG] [LOCAL ] MGRD: Loaded 2208 existing records from primary storage. [2025-09-22T22:22:58.414553] [INFO ] [MAIN ] MGRD: Loaded 2208 primary data records. [2025-09-22T22:22:58.509171] [DEBUG] [LOCAL ] MGRE: Loaded 6610 existing records from primary storage. [2025-09-22T22:22:58.527216] [INFO ] [MAIN ] MGRE: Loaded 6610 primary data records. [2025-09-22T22:22:59.075351] [DEBUG] [LOCAL ] MGY: Loaded 52428 existing records from primary storage. [2025-09-22T22:22:59.076065] [INFO ] [MAIN ] MGY: Loaded 52428 primary data records. [2025-09-22T22:22:59.448380] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:59.450588] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2208 primary records. [2025-09-22T22:22:59.452282] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-22T22:22:59.477218] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:59.479227] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6610 primary records. [2025-09-22T22:22:59.479878] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-22T22:22:59.483771] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-09-22T22:22:59.490530] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-22T22:22:59.497450] [INFO ] [MAIN ] Derivative Progress: 1171/2091 symbols completed. MGRD took 1.1s. Estimated remaining: 5m 57s. Rate: 154.5 symbols/min [2025-09-22T22:22:59.500246] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:59.501617] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-09-22T22:22:59.502031] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-22T22:22:59.504718] [INFO ] [MAIN ] Derivative Progress: 1172/2091 symbols completed. MGRE took 1.1s. Estimated remaining: 5m 57s. Rate: 154.6 symbols/min [2025-09-22T22:22:59.505181] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:59.521758] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:22:59.522394] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52428 primary records. [2025-09-22T22:22:59.527483] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-22T22:22:59.543740] [DEBUG] [LOCAL ] MHF: Loaded 8591 existing records from primary storage. [2025-09-22T22:22:59.552215] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-09-22T22:22:59.549240] [INFO ] [MAIN ] MHF: Loaded 8591 primary data records. [2025-09-22T22:22:59.552309] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-22T22:22:59.554865] [INFO ] [MAIN ] Derivative Progress: 1173/2091 symbols completed. MGY took 1.2s. Estimated remaining: 5m 56s. Rate: 154.7 symbols/min [2025-09-22T22:22:59.552635] [DEBUG] [LOCAL ] MHD: Loaded 12106 existing records from primary storage. [2025-09-22T22:22:59.560496] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:22:59.566614] [INFO ] [MAIN ] MHD: Loaded 12106 primary data records. [2025-09-22T22:23:00.204822] [DEBUG] [LOCAL ] MHK: Loaded 42556 existing records from primary storage. [2025-09-22T22:23:00.205224] [INFO ] [MAIN ] MHK: Loaded 42556 primary data records. [2025-09-22T22:23:00.549734] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:00.551523] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8591 primary records. [2025-09-22T22:23:00.565457] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-22T22:23:00.566501] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:00.568410] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12106 primary records. [2025-09-22T22:23:00.578488] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-22T22:23:00.582483] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-09-22T22:23:00.583595] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-22T22:23:00.586044] [INFO ] [MAIN ] Derivative Progress: 1174/2091 symbols completed. MHF took 1.1s. Estimated remaining: 5m 56s. Rate: 154.5 symbols/min [2025-09-22T22:23:00.593798] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:00.624289] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-09-22T22:23:00.624593] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:00.624908] [DEBUG] [LOCAL ] MHN: Loaded 7771 existing records from primary storage. [2025-09-22T22:23:00.625779] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42556 primary records. [2025-09-22T22:23:00.625008] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-22T22:23:00.625879] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-22T22:23:00.628543] [INFO ] [MAIN ] Derivative Progress: 1175/2091 symbols completed. MHD took 1.1s. Estimated remaining: 5m 55s. Rate: 154.6 symbols/min [2025-09-22T22:23:00.625974] [INFO ] [MAIN ] MHN: Loaded 7771 primary data records. [2025-09-22T22:23:00.635122] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:00.748322] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-09-22T22:23:00.758868] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-22T22:23:00.776965] [INFO ] [MAIN ] Derivative Progress: 1176/2091 symbols completed. MHK took 1.2s. Estimated remaining: 5m 55s. Rate: 154.7 symbols/min [2025-09-22T22:23:00.804447] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:00.961129] [DEBUG] [LOCAL ] MHO: Loaded 24376 existing records from primary storage. [2025-09-22T22:23:00.961930] [INFO ] [MAIN ] MHO: Loaded 24376 primary data records. [2025-09-22T22:23:01.023260] [DEBUG] [LOCAL ] MIN: Loaded 13161 existing records from primary storage. [2025-09-22T22:23:01.044282] [INFO ] [MAIN ] MIN: Loaded 13161 primary data records. [2025-09-22T22:23:01.636470] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:01.637799] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7771 primary records. [2025-09-22T22:23:01.638034] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-22T22:23:01.654621] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-09-22T22:23:01.655034] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-22T22:23:01.657130] [INFO ] [MAIN ] Derivative Progress: 1177/2091 symbols completed. MHN took 1.1s. Estimated remaining: 5m 55s. Rate: 154.6 symbols/min [2025-09-22T22:23:01.657588] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:01.676104] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:01.676879] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 24376 primary records. [2025-09-22T22:23:01.677094] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-22T22:23:01.708759] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:01.710248] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13161 primary records. [2025-09-22T22:23:01.710433] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-22T22:23:01.724749] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-09-22T22:23:01.725531] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-22T22:23:01.728672] [INFO ] [MAIN ] Derivative Progress: 1178/2091 symbols completed. MHO took 1.1s. Estimated remaining: 5m 54s. Rate: 154.7 symbols/min [2025-09-22T22:23:01.729532] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:01.746125] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-09-22T22:23:01.746312] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-22T22:23:01.749245] [INFO ] [MAIN ] Derivative Progress: 1179/2091 symbols completed. MIN took 1.0s. Estimated remaining: 5m 54s. Rate: 154.8 symbols/min [2025-09-22T22:23:01.749708] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:01.752573] [DEBUG] [LOCAL ] MITP: Loaded 2445 existing records from primary storage. [2025-09-22T22:23:01.752761] [INFO ] [MAIN ] MITP: Loaded 2445 primary data records. [2025-09-22T22:23:01.880054] [DEBUG] [LOCAL ] MIR: Loaded 50819 existing records from primary storage. [2025-09-22T22:23:01.885377] [INFO ] [MAIN ] MIR: Loaded 50819 primary data records. [2025-09-22T22:23:02.038422] [DEBUG] [LOCAL ] MITT: Loaded 22866 existing records from primary storage. [2025-09-22T22:23:02.173715] [INFO ] [MAIN ] MITT: Loaded 22866 primary data records. [2025-09-22T22:23:02.925320] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-22T22:23:02.927476] [INFO ] [MAIN ] MITP: Generated 1791 derivative records from 2445 primary records. [2025-09-22T22:23:02.928812] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-22T22:23:02.951487] [DEBUG] [LOCAL ] MITP: Derivative data saved (1791 records). [2025-09-22T22:23:02.952162] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-22T22:23:02.957122] [INFO ] [MAIN ] Derivative Progress: 1180/2091 symbols completed. MITP took 1.2s. Estimated remaining: 5m 54s. Rate: 154.5 symbols/min [2025-09-22T22:23:02.959041] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:02.975026] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:02.976529] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 50819 primary records. [2025-09-22T22:23:02.978528] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-22T22:23:03.001817] [DEBUG] [LOCAL ] MIY: Loaded 5997 existing records from primary storage. [2025-09-22T22:23:03.003836] [INFO ] [MAIN ] MIY: Loaded 5997 primary data records. [2025-09-22T22:23:03.067031] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-09-22T22:23:03.083838] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-22T22:23:03.113071] [INFO ] [MAIN ] Derivative Progress: 1181/2091 symbols completed. MIR took 1.5s. Estimated remaining: 5m 53s. Rate: 154.6 symbols/min [2025-09-22T22:23:03.161171] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:03.161825] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:03.168776] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22866 primary records. [2025-09-22T22:23:03.174348] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-22T22:23:03.504171] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-09-22T22:23:03.526822] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-22T22:23:03.530777] [INFO ] [MAIN ] Derivative Progress: 1182/2091 symbols completed. MITT took 1.8s. Estimated remaining: 5m 53s. Rate: 154.6 symbols/min [2025-09-22T22:23:03.531252] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:03.565459] [DEBUG] [LOCAL ] MKC: Loaded 52437 existing records from primary storage. [2025-09-22T22:23:03.566348] [INFO ] [MAIN ] MKC: Loaded 52437 primary data records. [2025-09-22T22:23:03.778278] [DEBUG] [LOCAL ] MKL: Loaded 34159 existing records from primary storage. [2025-09-22T22:23:03.778616] [INFO ] [MAIN ] MKL: Loaded 34159 primary data records. [2025-09-22T22:23:03.776328] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:23:03.780163] [INFO ] [MAIN ] MIY: Generated 1793 derivative records from 5997 primary records. [2025-09-22T22:23:03.780287] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-22T22:23:04.207627] [DEBUG] [LOCAL ] MIY: Derivative data saved (1793 records). [2025-09-22T22:23:04.208330] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-22T22:23:04.210516] [INFO ] [MAIN ] Derivative Progress: 1183/2091 symbols completed. MIY took 1.3s. Estimated remaining: 5m 53s. Rate: 154.5 symbols/min [2025-09-22T22:23:04.437577] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:04.438716] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52437 primary records. [2025-09-22T22:23:04.439847] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-22T22:23:04.457585] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-09-22T22:23:04.457731] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-22T22:23:04.460056] [INFO ] [MAIN ] Derivative Progress: 1184/2091 symbols completed. MKC took 1.3s. Estimated remaining: 5m 52s. Rate: 154.5 symbols/min [2025-09-22T22:23:04.476394] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:04.476989] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34159 primary records. [2025-09-22T22:23:04.477051] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-22T22:23:04.492534] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-09-22T22:23:04.492613] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-22T22:23:04.494826] [INFO ] [MAIN ] Derivative Progress: 1185/2091 symbols completed. MKL took 1.0s. Estimated remaining: 5m 52s. Rate: 154.6 symbols/min [2025-09-22T22:23:04.495549] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:04.495775] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:04.496229] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:04.549627] [DEBUG] [LOCAL ] MLNK: Loaded 25620 existing records from primary storage. [2025-09-22T22:23:04.549986] [INFO ] [MAIN ] MLNK: Loaded 25620 primary data records. [2025-09-22T22:23:04.627887] [DEBUG] [LOCAL ] MLM: Loaded 31033 existing records from primary storage. [2025-09-22T22:23:04.652571] [INFO ] [MAIN ] MLM: Loaded 31033 primary data records. [2025-09-22T22:23:04.678435] [DEBUG] [LOCAL ] MLI: Loaded 43864 existing records from primary storage. [2025-09-22T22:23:04.703227] [INFO ] [MAIN ] MLI: Loaded 43864 primary data records. [2025-09-22T22:23:05.548330] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:05.556617] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25620 primary records. [2025-09-22T22:23:05.562233] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-22T22:23:05.562172] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:05.562945] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 31033 primary records. [2025-09-22T22:23:05.563973] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-22T22:23:05.611893] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-09-22T22:23:05.612548] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-22T22:23:05.615351] [INFO ] [MAIN ] Derivative Progress: 1186/2091 symbols completed. MLM took 1.1s. Estimated remaining: 5m 52s. Rate: 154.4 symbols/min [2025-09-22T22:23:05.612939] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:05.617582] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-09-22T22:23:05.617717] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-22T22:23:05.616368] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43864 primary records. [2025-09-22T22:23:05.620048] [INFO ] [MAIN ] Derivative Progress: 1187/2091 symbols completed. MLNK took 1.1s. Estimated remaining: 5m 51s. Rate: 154.5 symbols/min [2025-09-22T22:23:05.620209] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-22T22:23:05.620431] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:05.621237] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:05.640140] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-09-22T22:23:05.646207] [DEBUG] [LOCAL ] MLP: Loaded 3049 existing records from primary storage. [2025-09-22T22:23:05.646484] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-22T22:23:05.649443] [INFO ] [MAIN ] MLP: Loaded 3049 primary data records. [2025-09-22T22:23:05.649239] [INFO ] [MAIN ] Derivative Progress: 1188/2091 symbols completed. MLI took 1.2s. Estimated remaining: 5m 50s. Rate: 154.7 symbols/min [2025-09-22T22:23:05.649825] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:05.699613] [DEBUG] [LOCAL ] MLR: Loaded 13064 existing records from primary storage. [2025-09-22T22:23:05.721146] [INFO ] [MAIN ] MLR: Loaded 13064 primary data records. [2025-09-22T22:23:06.321989] [DEBUG] [LOCAL ] MMC: Loaded 51805 existing records from primary storage. [2025-09-22T22:23:06.322563] [INFO ] [MAIN ] MMC: Loaded 51805 primary data records. [2025-09-22T22:23:06.649499] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-22T22:23:06.652318] [INFO ] [MAIN ] MLP: Generated 1792 derivative records from 3049 primary records. [2025-09-22T22:23:06.654497] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-22T22:23:06.683828] [DEBUG] [LOCAL ] MLP: Derivative data saved (1792 records). [2025-09-22T22:23:06.684049] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-22T22:23:06.686272] [INFO ] [MAIN ] Derivative Progress: 1189/2091 symbols completed. MLP took 1.1s. Estimated remaining: 5m 50s. Rate: 154.4 symbols/min [2025-09-22T22:23:06.683100] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:06.686812] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:06.687622] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 13064 primary records. [2025-09-22T22:23:06.687759] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-22T22:23:06.705315] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-09-22T22:23:06.707973] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-22T22:23:06.710339] [INFO ] [MAIN ] Derivative Progress: 1190/2091 symbols completed. MLR took 1.1s. Estimated remaining: 5m 50s. Rate: 154.6 symbols/min [2025-09-22T22:23:06.710965] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:06.718747] [DEBUG] [LOCAL ] MMD: Loaded 11103 existing records from primary storage. [2025-09-22T22:23:06.731960] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:06.731669] [INFO ] [MAIN ] MMD: Loaded 11103 primary data records. [2025-09-22T22:23:06.732733] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51805 primary records. [2025-09-22T22:23:06.732887] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-22T22:23:06.878547] [DEBUG] [LOCAL ] MMI: Loaded 15311 existing records from primary storage. [2025-09-22T22:23:06.880329] [INFO ] [MAIN ] MMI: Loaded 15311 primary data records. [2025-09-22T22:23:06.919088] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-09-22T22:23:06.940251] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-22T22:23:06.957241] [INFO ] [MAIN ] Derivative Progress: 1191/2091 symbols completed. MMC took 1.3s. Estimated remaining: 5m 49s. Rate: 154.6 symbols/min [2025-09-22T22:23:07.194594] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:07.470378] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:07.471524] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11103 primary records. [2025-09-22T22:23:07.471873] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-22T22:23:07.507337] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-09-22T22:23:07.520589] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-22T22:23:07.523212] [INFO ] [MAIN ] Derivative Progress: 1192/2091 symbols completed. MMD took 0.8s. Estimated remaining: 5m 49s. Rate: 154.5 symbols/min [2025-09-22T22:23:07.520952] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:07.524253] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15311 primary records. [2025-09-22T22:23:07.524378] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-22T22:23:07.525807] [DEBUG] [LOCAL ] MMM: Loaded 53259 existing records from primary storage. [2025-09-22T22:23:07.524581] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:07.526974] [INFO ] [MAIN ] MMM: Loaded 53259 primary data records. [2025-09-22T22:23:07.621351] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-09-22T22:23:07.633108] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-22T22:23:07.635710] [INFO ] [MAIN ] Derivative Progress: 1193/2091 symbols completed. MMI took 0.9s. Estimated remaining: 5m 48s. Rate: 154.6 symbols/min [2025-09-22T22:23:07.653542] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:07.874432] [DEBUG] [LOCAL ] MMT: Loaded 11071 existing records from primary storage. [2025-09-22T22:23:07.874687] [INFO ] [MAIN ] MMT: Loaded 11071 primary data records. [2025-09-22T22:23:07.875766] [DEBUG] [LOCAL ] MMS: Loaded 34017 existing records from primary storage. [2025-09-22T22:23:07.902282] [INFO ] [MAIN ] MMS: Loaded 34017 primary data records. [2025-09-22T22:23:08.600575] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:08.603145] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53259 primary records. [2025-09-22T22:23:08.603277] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-22T22:23:08.636506] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-09-22T22:23:08.636900] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-22T22:23:08.637234] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:08.639605] [INFO ] [MAIN ] Derivative Progress: 1194/2091 symbols completed. MMM took 1.5s. Estimated remaining: 5m 49s. Rate: 154.4 symbols/min [2025-09-22T22:23:08.641101] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 11071 primary records. [2025-09-22T22:23:08.641292] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-22T22:23:08.642880] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:08.662638] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-09-22T22:23:08.663071] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-22T22:23:08.666458] [INFO ] [MAIN ] Derivative Progress: 1195/2091 symbols completed. MMT took 1.0s. Estimated remaining: 5m 48s. Rate: 154.5 symbols/min [2025-09-22T22:23:08.674767] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:08.684945] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:08.686271] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 34017 primary records. [2025-09-22T22:23:08.686469] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-22T22:23:08.719986] [DEBUG] [LOCAL ] MMU: Loaded 17018 existing records from primary storage. [2025-09-22T22:23:08.722877] [INFO ] [MAIN ] MMU: Loaded 17018 primary data records. [2025-09-22T22:23:08.722715] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-09-22T22:23:08.728330] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-22T22:23:08.751986] [INFO ] [MAIN ] Derivative Progress: 1196/2091 symbols completed. MMS took 1.2s. Estimated remaining: 5m 47s. Rate: 154.7 symbols/min [2025-09-22T22:23:08.794359] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:08.893554] [DEBUG] [LOCAL ] MNR: Loaded 24727 existing records from primary storage. [2025-09-22T22:23:08.928865] [INFO ] [MAIN ] MNR: Loaded 24727 primary data records. [2025-09-22T22:23:09.276810] [DEBUG] [LOCAL ] MNSO: Loaded 44431 existing records from primary storage. [2025-09-22T22:23:09.402784] [INFO ] [MAIN ] MNSO: Loaded 44431 primary data records. [2025-09-22T22:23:09.744609] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:09.746790] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 17018 primary records. [2025-09-22T22:23:09.747074] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-22T22:23:09.766176] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-09-22T22:23:09.766496] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-22T22:23:09.769060] [INFO ] [MAIN ] Derivative Progress: 1197/2091 symbols completed. MMU took 1.1s. Estimated remaining: 5m 47s. Rate: 154.4 symbols/min [2025-09-22T22:23:09.774428] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:09.789693] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:09.790669] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24727 primary records. [2025-09-22T22:23:09.790851] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-22T22:23:09.811821] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-09-22T22:23:09.812011] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-22T22:23:09.814966] [INFO ] [MAIN ] Derivative Progress: 1198/2091 symbols completed. MNR took 1.1s. Estimated remaining: 5m 47s. Rate: 154.6 symbols/min [2025-09-22T22:23:09.831628] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:09.832402] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44431 primary records. [2025-09-22T22:23:09.832591] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-22T22:23:09.859327] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-09-22T22:23:09.859474] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-22T22:23:09.862068] [INFO ] [MAIN ] Derivative Progress: 1199/2091 symbols completed. MNSO took 1.1s. Estimated remaining: 5m 46s. Rate: 154.7 symbols/min [2025-09-22T22:23:09.878294] [DEBUG] [LOCAL ] MOD: Loaded 45647 existing records from primary storage. [2025-09-22T22:23:09.878452] [INFO ] [MAIN ] MOD: Loaded 45647 primary data records. [2025-09-22T22:23:10.240272] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:10.241026] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 45647 primary records. [2025-09-22T22:23:10.241121] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-22T22:23:10.257517] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-09-22T22:23:10.257620] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-22T22:23:10.259958] [INFO ] [MAIN ] Derivative Progress: 1200/2091 symbols completed. MOD took 0.5s. Estimated remaining: 5m 46s. Rate: 154.7 symbols/min [2025-09-22T22:23:10.260708] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:10.260598] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:10.261819] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:10.328693] [DEBUG] [LOCAL ] MOH: Loaded 41736 existing records from primary storage. [2025-09-22T22:23:10.328925] [INFO ] [MAIN ] MOH: Loaded 41736 primary data records. [2025-09-22T22:23:10.464689] [DEBUG] [LOCAL ] MODG: Loaded 51622 existing records from primary storage. [2025-09-22T22:23:10.460722] [DEBUG] [LOCAL ] MOS: Loaded 53506 existing records from primary storage. [2025-09-22T22:23:10.464869] [INFO ] [MAIN ] MODG: Loaded 51622 primary data records. [2025-09-22T22:23:10.465121] [INFO ] [MAIN ] MOS: Loaded 53506 primary data records. [2025-09-22T22:23:11.338353] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:11.338075] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:11.339331] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53506 primary records. [2025-09-22T22:23:11.340333] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 41736 primary records. [2025-09-22T22:23:11.339698] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-22T22:23:11.341503] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-22T22:23:11.374179] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-09-22T22:23:11.375617] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-22T22:23:11.378400] [INFO ] [MAIN ] Derivative Progress: 1201/2091 symbols completed. MOH took 1.1s. Estimated remaining: 5m 46s. Rate: 154.4 symbols/min [2025-09-22T22:23:11.379083] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:11.393387] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:11.394486] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51622 primary records. [2025-09-22T22:23:11.394789] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-22T22:23:11.395424] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-09-22T22:23:11.395721] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-22T22:23:11.399065] [INFO ] [MAIN ] Derivative Progress: 1202/2091 symbols completed. MOS took 1.1s. Estimated remaining: 5m 45s. Rate: 154.5 symbols/min [2025-09-22T22:23:11.407889] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:11.417422] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-09-22T22:23:11.417589] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-22T22:23:11.419871] [INFO ] [MAIN ] Derivative Progress: 1203/2091 symbols completed. MODG took 1.2s. Estimated remaining: 5m 44s. Rate: 154.7 symbols/min [2025-09-22T22:23:11.420221] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:11.434308] [DEBUG] [LOCAL ] MPA: Loaded 5242 existing records from primary storage. [2025-09-22T22:23:11.434469] [INFO ] [MAIN ] MPA: Loaded 5242 primary data records. [2025-09-22T22:23:11.479025] [DEBUG] [LOCAL ] MOV: Loaded 22254 existing records from primary storage. [2025-09-22T22:23:11.504343] [INFO ] [MAIN ] MOV: Loaded 22254 primary data records. [2025-09-22T22:23:11.947383] [DEBUG] [LOCAL ] MP: Loaded 53662 existing records from primary storage. [2025-09-22T22:23:11.979589] [INFO ] [MAIN ] MP: Loaded 53662 primary data records. [2025-09-22T22:23:12.463994] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:12.465114] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5242 primary records. [2025-09-22T22:23:12.465547] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-22T22:23:12.485171] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-09-22T22:23:12.485513] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-22T22:23:12.487677] [INFO ] [MAIN ] Derivative Progress: 1204/2091 symbols completed. MPA took 1.1s. Estimated remaining: 5m 45s. Rate: 154.4 symbols/min [2025-09-22T22:23:12.495844] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:12.502038] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:12.502755] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 22254 primary records. [2025-09-22T22:23:12.503011] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-22T22:23:12.536567] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-09-22T22:23:12.537221] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-22T22:23:12.536962] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:12.540427] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53662 primary records. [2025-09-22T22:23:12.539460] [INFO ] [MAIN ] Derivative Progress: 1205/2091 symbols completed. MOV took 1.2s. Estimated remaining: 5m 44s. Rate: 154.6 symbols/min [2025-09-22T22:23:12.540780] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:12.540892] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-22T22:23:12.560548] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-09-22T22:23:12.560836] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-22T22:23:12.563810] [INFO ] [MAIN ] Derivative Progress: 1206/2091 symbols completed. MP took 1.2s. Estimated remaining: 5m 43s. Rate: 154.7 symbols/min [2025-09-22T22:23:12.564264] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:12.595228] [DEBUG] [LOCAL ] MPV: Loaded 5174 existing records from primary storage. [2025-09-22T22:23:12.595448] [INFO ] [MAIN ] MPV: Loaded 5174 primary data records. [2025-09-22T22:23:12.735042] [DEBUG] [LOCAL ] MPC: Loaded 52129 existing records from primary storage. [2025-09-22T22:23:12.746055] [INFO ] [MAIN ] MPC: Loaded 52129 primary data records. [2025-09-22T22:23:12.913062] [DEBUG] [LOCAL ] MPLX: Loaded 50758 existing records from primary storage. [2025-09-22T22:23:12.932387] [INFO ] [MAIN ] MPLX: Loaded 50758 primary data records. [2025-09-22T22:23:13.606792] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:13.608549] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 5174 primary records. [2025-09-22T22:23:13.621836] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-22T22:23:13.621634] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:13.623946] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52129 primary records. [2025-09-22T22:23:13.631141] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-22T22:23:13.653335] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-09-22T22:23:13.654814] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-22T22:23:13.661940] [INFO ] [MAIN ] Derivative Progress: 1207/2091 symbols completed. MPV took 1.1s. Estimated remaining: 5m 43s. Rate: 154.4 symbols/min [2025-09-22T22:23:13.664910] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:13.666903] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-09-22T22:23:13.667301] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-22T22:23:13.674315] [INFO ] [MAIN ] Derivative Progress: 1208/2091 symbols completed. MPC took 1.2s. Estimated remaining: 5m 43s. Rate: 154.6 symbols/min [2025-09-22T22:23:13.674670] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:13.692931] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:13.694019] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50758 primary records. [2025-09-22T22:23:13.696948] [DEBUG] [LOCAL ] MPX: Loaded 4229 existing records from primary storage. [2025-09-22T22:23:13.697055] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-22T22:23:13.697918] [INFO ] [MAIN ] MPX: Loaded 4229 primary data records. [2025-09-22T22:23:13.822677] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-09-22T22:23:13.823099] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-22T22:23:13.830798] [INFO ] [MAIN ] Derivative Progress: 1209/2091 symbols completed. MPLX took 1.3s. Estimated remaining: 5m 42s. Rate: 154.6 symbols/min [2025-09-22T22:23:13.855874] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:14.059913] [DEBUG] [LOCAL ] MPW: Loaded 53504 existing records from primary storage. [2025-09-22T22:23:14.062567] [INFO ] [MAIN ] MPW: Loaded 53504 primary data records. [2025-09-22T22:23:14.098888] [DEBUG] [LOCAL ] MQT: Loaded 8375 existing records from primary storage. [2025-09-22T22:23:14.111519] [INFO ] [MAIN ] MQT: Loaded 8375 primary data records. [2025-09-22T22:23:14.777744] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:14.779911] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4229 primary records. [2025-09-22T22:23:14.780108] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-22T22:23:14.797389] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-09-22T22:23:14.797591] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-22T22:23:14.799736] [INFO ] [MAIN ] Derivative Progress: 1210/2091 symbols completed. MPX took 1.1s. Estimated remaining: 5m 42s. Rate: 154.4 symbols/min [2025-09-22T22:23:14.800389] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:14.819435] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:14.820338] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53504 primary records. [2025-09-22T22:23:14.820515] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-22T22:23:14.837787] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:14.838753] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8375 primary records. [2025-09-22T22:23:14.838877] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-22T22:23:14.856486] [DEBUG] [LOCAL ] MQY: Loaded 16777 existing records from primary storage. [2025-09-22T22:23:14.865218] [INFO ] [MAIN ] MQY: Loaded 16777 primary data records. [2025-09-22T22:23:14.918324] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-09-22T22:23:14.918445] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-22T22:23:14.917889] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-09-22T22:23:14.931342] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-22T22:23:14.942569] [INFO ] [MAIN ] Derivative Progress: 1211/2091 symbols completed. MQT took 1.1s. Estimated remaining: 5m 42s. Rate: 154.5 symbols/min [2025-09-22T22:23:14.957322] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:14.957471] [INFO ] [MAIN ] Derivative Progress: 1212/2091 symbols completed. MPW took 1.3s. Estimated remaining: 5m 41s. Rate: 154.7 symbols/min [2025-09-22T22:23:14.974183] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:15.239065] [DEBUG] [LOCAL ] MRC: Loaded 37550 existing records from primary storage. [2025-09-22T22:23:15.239676] [INFO ] [MAIN ] MRC: Loaded 37550 primary data records. [2025-09-22T22:23:15.361116] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-22T22:23:15.367109] [INFO ] [MAIN ] MRK: Loaded 53789 primary data records. [2025-09-22T22:23:15.688072] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:15.689504] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16777 primary records. [2025-09-22T22:23:15.701066] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-22T22:23:15.789499] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-09-22T22:23:15.902848] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-22T22:23:15.913873] [INFO ] [MAIN ] Derivative Progress: 1213/2091 symbols completed. MQY took 1.1s. Estimated remaining: 5m 41s. Rate: 154.5 symbols/min [2025-09-22T22:23:15.936509] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:15.937271] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37550 primary records. [2025-09-22T22:23:15.937523] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-22T22:23:15.954434] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-09-22T22:23:15.954616] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-22T22:23:15.956798] [INFO ] [MAIN ] Derivative Progress: 1214/2091 symbols completed. MRC took 1.0s. Estimated remaining: 5m 40s. Rate: 154.6 symbols/min [2025-09-22T22:23:15.971810] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:15.972328] [INFO ] [MAIN ] MRK: Generated 1794 derivative records from 53789 primary records. [2025-09-22T22:23:15.972388] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-22T22:23:15.987767] [DEBUG] [LOCAL ] MRK: Derivative data saved (1794 records). [2025-09-22T22:23:15.987827] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-22T22:23:15.990721] [INFO ] [MAIN ] Derivative Progress: 1215/2091 symbols completed. MRK took 1.0s. Estimated remaining: 5m 40s. Rate: 154.7 symbols/min [2025-09-22T22:23:15.991612] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:15.991822] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:15.991983] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:16.005058] [DEBUG] [LOCAL ] MSB: Loaded 7852 existing records from primary storage. [2025-09-22T22:23:16.005380] [INFO ] [MAIN ] MSB: Loaded 7852 primary data records. [2025-09-22T22:23:16.098525] [DEBUG] [LOCAL ] MSA: Loaded 18724 existing records from primary storage. [2025-09-22T22:23:16.115792] [INFO ] [MAIN ] MSA: Loaded 18724 primary data records. [2025-09-22T22:23:16.690981] [DEBUG] [LOCAL ] MS: Loaded 53693 existing records from primary storage. [2025-09-22T22:23:16.691689] [INFO ] [MAIN ] MS: Loaded 53693 primary data records. [2025-09-22T22:23:17.025442] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:17.026545] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7852 primary records. [2025-09-22T22:23:17.026790] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-22T22:23:17.048447] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:17.055037] [INFO ] [MAIN ] MSA: Generated 1794 derivative records from 18724 primary records. [2025-09-22T22:23:17.055272] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-22T22:23:17.059500] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-09-22T22:23:17.060586] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-22T22:23:17.063043] [INFO ] [MAIN ] Derivative Progress: 1216/2091 symbols completed. MSB took 1.1s. Estimated remaining: 5m 40s. Rate: 154.5 symbols/min [2025-09-22T22:23:17.075150] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:17.082779] [DEBUG] [LOCAL ] MSA: Derivative data saved (1794 records). [2025-09-22T22:23:17.082975] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-22T22:23:17.086477] [INFO ] [MAIN ] Derivative Progress: 1217/2091 symbols completed. MSA took 1.1s. Estimated remaining: 5m 39s. Rate: 154.6 symbols/min [2025-09-22T22:23:17.086746] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:17.103763] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:17.104743] [INFO ] [MAIN ] MS: Generated 1794 derivative records from 53693 primary records. [2025-09-22T22:23:17.105062] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-22T22:23:17.142190] [DEBUG] [LOCAL ] MS: Derivative data saved (1794 records). [2025-09-22T22:23:17.143106] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-22T22:23:17.143012] [DEBUG] [LOCAL ] MSD: Loaded 15603 existing records from primary storage. [2025-09-22T22:23:17.145942] [INFO ] [MAIN ] Derivative Progress: 1218/2091 symbols completed. MS took 1.2s. Estimated remaining: 5m 39s. Rate: 154.7 symbols/min [2025-09-22T22:23:17.146906] [INFO ] [MAIN ] MSD: Loaded 15603 primary data records. [2025-09-22T22:23:17.147043] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:17.262281] [DEBUG] [LOCAL ] MSCI: Loaded 34854 existing records from primary storage. [2025-09-22T22:23:17.284088] [INFO ] [MAIN ] MSCI: Loaded 34854 primary data records. [2025-09-22T22:23:17.613303] [DEBUG] [LOCAL ] MSDL: Loaded 38008 existing records from primary storage. [2025-09-22T22:23:17.633125] [INFO ] [MAIN ] MSDL: Loaded 38008 primary data records. [2025-09-22T22:23:18.171400] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:18.172679] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 15603 primary records. [2025-09-22T22:23:18.174855] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-22T22:23:18.205099] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-09-22T22:23:18.205034] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:18.206075] [INFO ] [MAIN ] MSCI: Generated 1794 derivative records from 34854 primary records. [2025-09-22T22:23:18.206331] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-22T22:23:18.207036] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-22T22:23:18.209208] [INFO ] [MAIN ] Derivative Progress: 1219/2091 symbols completed. MSD took 1.1s. Estimated remaining: 5m 39s. Rate: 154.5 symbols/min [2025-09-22T22:23:18.209721] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:18.226188] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1794 records). [2025-09-22T22:23:18.228586] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-22T22:23:18.231034] [INFO ] [MAIN ] Derivative Progress: 1220/2091 symbols completed. MSCI took 1.2s. Estimated remaining: 5m 38s. Rate: 154.6 symbols/min [2025-09-22T22:23:18.231562] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:18.245214] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:18.246163] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38008 primary records. [2025-09-22T22:23:18.246424] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-22T22:23:18.277762] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-09-22T22:23:18.282668] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-22T22:23:18.285036] [INFO ] [MAIN ] Derivative Progress: 1221/2091 symbols completed. MSDL took 1.1s. Estimated remaining: 5m 37s. Rate: 154.7 symbols/min [2025-09-22T22:23:18.286113] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:18.285843] [DEBUG] [LOCAL ] MSGE: Loaded 27081 existing records from primary storage. [2025-09-22T22:23:18.286572] [INFO ] [MAIN ] MSGE: Loaded 27081 primary data records. [2025-09-22T22:23:18.357876] [DEBUG] [LOCAL ] MSGS: Loaded 16853 existing records from primary storage. [2025-09-22T22:23:18.369766] [INFO ] [MAIN ] MSGS: Loaded 16853 primary data records. [2025-09-22T22:23:18.837752] [DEBUG] [LOCAL ] MSI: Loaded 40595 existing records from primary storage. [2025-09-22T22:23:18.928991] [INFO ] [MAIN ] MSI: Loaded 40595 primary data records. [2025-09-22T22:23:19.272043] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:19.285185] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 27081 primary records. [2025-09-22T22:23:19.285724] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:19.285871] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-22T22:23:19.286507] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 16853 primary records. [2025-09-22T22:23:19.295464] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-22T22:23:19.312003] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-09-22T22:23:19.313055] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-22T22:23:19.319278] [INFO ] [MAIN ] Derivative Progress: 1222/2091 symbols completed. MSGE took 1.1s. Estimated remaining: 5m 37s. Rate: 154.5 symbols/min [2025-09-22T22:23:19.320274] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:19.324611] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-09-22T22:23:19.324941] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-22T22:23:19.326918] [INFO ] [MAIN ] Derivative Progress: 1223/2091 symbols completed. MSGS took 1.1s. Estimated remaining: 5m 37s. Rate: 154.6 symbols/min [2025-09-22T22:23:19.327728] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:19.344776] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:23:19.345497] [INFO ] [MAIN ] MSI: Generated 1793 derivative records from 40595 primary records. [2025-09-22T22:23:19.345662] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-22T22:23:19.361617] [DEBUG] [LOCAL ] MSI: Derivative data saved (1793 records). [2025-09-22T22:23:19.361907] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-22T22:23:19.365165] [INFO ] [MAIN ] Derivative Progress: 1224/2091 symbols completed. MSI took 1.1s. Estimated remaining: 5m 36s. Rate: 154.7 symbols/min [2025-09-22T22:23:19.365573] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:19.390361] [DEBUG] [LOCAL ] MSM: Loaded 35425 existing records from primary storage. [2025-09-22T22:23:19.390589] [INFO ] [MAIN ] MSM: Loaded 35425 primary data records. [2025-09-22T22:23:19.737130] [DEBUG] [LOCAL ] MT: Loaded 50759 existing records from primary storage. [2025-09-22T22:23:19.737408] [INFO ] [MAIN ] MT: Loaded 50759 primary data records. [2025-09-22T22:23:19.738124] [DEBUG] [LOCAL ] MTAL: Loaded 36305 existing records from primary storage. [2025-09-22T22:23:19.750217] [INFO ] [MAIN ] MTAL: Loaded 36305 primary data records. [2025-09-22T22:23:20.428855] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:20.430256] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35425 primary records. [2025-09-22T22:23:20.430405] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-22T22:23:20.452518] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-09-22T22:23:20.452826] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-22T22:23:20.455401] [INFO ] [MAIN ] Derivative Progress: 1225/2091 symbols completed. MSM took 1.1s. Estimated remaining: 5m 36s. Rate: 154.5 symbols/min [2025-09-22T22:23:20.457221] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:20.485979] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:20.487232] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50759 primary records. [2025-09-22T22:23:20.486533] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:20.487349] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-22T22:23:20.488018] [INFO ] [MAIN ] MTAL: Generated 1794 derivative records from 36305 primary records. [2025-09-22T22:23:20.488549] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-22T22:23:20.515604] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-09-22T22:23:20.518678] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-22T22:23:20.521293] [INFO ] [MAIN ] Derivative Progress: 1226/2091 symbols completed. MT took 1.2s. Estimated remaining: 5m 36s. Rate: 154.6 symbols/min [2025-09-22T22:23:20.521556] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:20.523319] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1794 records). [2025-09-22T22:23:20.523389] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-22T22:23:20.525362] [INFO ] [MAIN ] Derivative Progress: 1227/2091 symbols completed. MTAL took 1.2s. Estimated remaining: 5m 35s. Rate: 154.7 symbols/min [2025-09-22T22:23:20.525925] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:20.552093] [DEBUG] [LOCAL ] MTD: Loaded 15215 existing records from primary storage. [2025-09-22T22:23:20.552252] [INFO ] [MAIN ] MTD: Loaded 15215 primary data records. [2025-09-22T22:23:20.670156] [DEBUG] [LOCAL ] MTB: Loaded 47175 existing records from primary storage. [2025-09-22T22:23:20.686960] [INFO ] [MAIN ] MTB: Loaded 47175 primary data records. [2025-09-22T22:23:21.064745] [DEBUG] [LOCAL ] MTDR: Loaded 51549 existing records from primary storage. [2025-09-22T22:23:21.099090] [INFO ] [MAIN ] MTDR: Loaded 51549 primary data records. [2025-09-22T22:23:21.551151] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:21.552126] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15215 primary records. [2025-09-22T22:23:21.552524] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-22T22:23:21.570878] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-09-22T22:23:21.571108] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-22T22:23:21.573338] [INFO ] [MAIN ] Derivative Progress: 1228/2091 symbols completed. MTD took 1.1s. Estimated remaining: 5m 35s. Rate: 154.5 symbols/min [2025-09-22T22:23:21.590272] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:21.590979] [INFO ] [MAIN ] MTB: Generated 1794 derivative records from 47175 primary records. [2025-09-22T22:23:21.591129] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-22T22:23:21.607933] [DEBUG] [LOCAL ] MTB: Derivative data saved (1794 records). [2025-09-22T22:23:21.608953] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-22T22:23:21.612078] [INFO ] [MAIN ] Derivative Progress: 1229/2091 symbols completed. MTB took 1.2s. Estimated remaining: 5m 34s. Rate: 154.6 symbols/min [2025-09-22T22:23:21.625679] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:21.626229] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51549 primary records. [2025-09-22T22:23:21.626289] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-22T22:23:21.641414] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-09-22T22:23:21.641532] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-22T22:23:21.643866] [INFO ] [MAIN ] Derivative Progress: 1230/2091 symbols completed. MTDR took 1.1s. Estimated remaining: 5m 34s. Rate: 154.7 symbols/min [2025-09-22T22:23:21.644560] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:21.644506] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:21.644413] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:21.716852] [DEBUG] [LOCAL ] MTH: Loaded 43969 existing records from primary storage. [2025-09-22T22:23:21.717047] [INFO ] [MAIN ] MTH: Loaded 43969 primary data records. [2025-09-22T22:23:21.825944] [DEBUG] [LOCAL ] MTG: Loaded 51374 existing records from primary storage. [2025-09-22T22:23:21.846391] [DEBUG] [LOCAL ] MTN: Loaded 38983 existing records from primary storage. [2025-09-22T22:23:21.849911] [INFO ] [MAIN ] MTG: Loaded 51374 primary data records. [2025-09-22T22:23:21.850427] [INFO ] [MAIN ] MTN: Loaded 38983 primary data records. [2025-09-22T22:23:22.735359] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:22.736594] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43969 primary records. [2025-09-22T22:23:22.736909] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-22T22:23:22.756585] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-09-22T22:23:22.758129] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-22T22:23:22.760008] [INFO ] [MAIN ] Derivative Progress: 1231/2091 symbols completed. MTH took 1.1s. Estimated remaining: 5m 34s. Rate: 154.5 symbols/min [2025-09-22T22:23:22.761142] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:22.793126] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:22.799548] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51374 primary records. [2025-09-22T22:23:22.799766] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-22T22:23:22.800903] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:22.802149] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 38983 primary records. [2025-09-22T22:23:22.802274] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-22T22:23:22.836457] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-09-22T22:23:22.837778] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-22T22:23:22.840225] [INFO ] [MAIN ] Derivative Progress: 1232/2091 symbols completed. MTG took 1.2s. Estimated remaining: 5m 33s. Rate: 154.6 symbols/min [2025-09-22T22:23:22.842069] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:22.842128] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-09-22T22:23:22.842363] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-22T22:23:22.855907] [INFO ] [MAIN ] Derivative Progress: 1233/2091 symbols completed. MTN took 1.2s. Estimated remaining: 5m 33s. Rate: 154.7 symbols/min [2025-09-22T22:23:22.855761] [DEBUG] [LOCAL ] MTRN: Loaded 18011 existing records from primary storage. [2025-09-22T22:23:22.856132] [INFO ] [MAIN ] MTRN: Loaded 18011 primary data records. [2025-09-22T22:23:22.856490] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:23.065854] [DEBUG] [LOCAL ] MTUS: Loaded 28785 existing records from primary storage. [2025-09-22T22:23:23.069714] [INFO ] [MAIN ] MTUS: Loaded 28785 primary data records. [2025-09-22T22:23:23.093198] [DEBUG] [LOCAL ] MTW: Loaded 26506 existing records from primary storage. [2025-09-22T22:23:23.105638] [INFO ] [MAIN ] MTW: Loaded 26506 primary data records. [2025-09-22T22:23:23.883843] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:23.885171] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 18011 primary records. [2025-09-22T22:23:23.885289] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-22T22:23:23.904504] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-09-22T22:23:23.904762] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-22T22:23:23.906767] [INFO ] [MAIN ] Derivative Progress: 1234/2091 symbols completed. MTRN took 1.1s. Estimated remaining: 5m 33s. Rate: 154.5 symbols/min [2025-09-22T22:23:23.907268] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:23.949550] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:23.950297] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:23.951361] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 28785 primary records. [2025-09-22T22:23:23.952141] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26506 primary records. [2025-09-22T22:23:23.952227] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-22T22:23:23.951536] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-22T22:23:23.989135] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-09-22T22:23:23.987081] [DEBUG] [LOCAL ] MTX: Loaded 22850 existing records from primary storage. [2025-09-22T22:23:23.990955] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-22T22:23:23.992895] [INFO ] [MAIN ] MTX: Loaded 22850 primary data records. [2025-09-22T22:23:23.993940] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-09-22T22:23:24.002219] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-22T22:23:24.002101] [INFO ] [MAIN ] Derivative Progress: 1235/2091 symbols completed. MTW took 1.1s. Estimated remaining: 5m 32s. Rate: 154.6 symbols/min [2025-09-22T22:23:24.038516] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:24.038428] [INFO ] [MAIN ] Derivative Progress: 1236/2091 symbols completed. MTUS took 1.2s. Estimated remaining: 5m 32s. Rate: 154.7 symbols/min [2025-09-22T22:23:24.079317] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:24.344368] [DEBUG] [LOCAL ] MUA: Loaded 12232 existing records from primary storage. [2025-09-22T22:23:24.344677] [INFO ] [MAIN ] MUA: Loaded 12232 primary data records. [2025-09-22T22:23:24.523184] [DEBUG] [LOCAL ] MTZ: Loaded 43479 existing records from primary storage. [2025-09-22T22:23:24.545815] [INFO ] [MAIN ] MTZ: Loaded 43479 primary data records. [2025-09-22T22:23:24.902380] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:24.907091] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22850 primary records. [2025-09-22T22:23:24.908320] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-22T22:23:25.042464] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-09-22T22:23:25.042824] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-22T22:23:25.045868] [INFO ] [MAIN ] Derivative Progress: 1237/2091 symbols completed. MTX took 1.1s. Estimated remaining: 5m 32s. Rate: 154.5 symbols/min [2025-09-22T22:23:25.046441] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:25.066877] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:25.067738] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 12232 primary records. [2025-09-22T22:23:25.067939] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-22T22:23:25.096822] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-09-22T22:23:25.098702] [DEBUG] [LOCAL ] MUC: Loaded 20075 existing records from primary storage. [2025-09-22T22:23:25.099726] [INFO ] [MAIN ] MUC: Loaded 20075 primary data records. [2025-09-22T22:23:25.099620] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-22T22:23:25.114876] [INFO ] [MAIN ] Derivative Progress: 1238/2091 symbols completed. MUA took 1.0s. Estimated remaining: 5m 31s. Rate: 154.6 symbols/min [2025-09-22T22:23:25.140237] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:25.193780] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:23:25.218823] [INFO ] [MAIN ] MTZ: Generated 1793 derivative records from 43479 primary records. [2025-09-22T22:23:25.222710] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-22T22:23:25.328429] [DEBUG] [LOCAL ] MUE: Loaded 11972 existing records from primary storage. [2025-09-22T22:23:25.330588] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1793 records). [2025-09-22T22:23:25.330834] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-22T22:23:25.330714] [INFO ] [MAIN ] MUE: Loaded 11972 primary data records. [2025-09-22T22:23:25.333618] [INFO ] [MAIN ] Derivative Progress: 1239/2091 symbols completed. MTZ took 1.3s. Estimated remaining: 5m 30s. Rate: 154.7 symbols/min [2025-09-22T22:23:25.339059] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:25.807069] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:25.808015] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20075 primary records. [2025-09-22T22:23:25.810308] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-22T22:23:25.839612] [DEBUG] [LOCAL ] MUFG: Loaded 52636 existing records from primary storage. [2025-09-22T22:23:25.842144] [INFO ] [MAIN ] MUFG: Loaded 52636 primary data records. [2025-09-22T22:23:25.842076] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-09-22T22:23:25.842482] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-22T22:23:25.865776] [INFO ] [MAIN ] Derivative Progress: 1240/2091 symbols completed. MUC took 0.8s. Estimated remaining: 5m 30s. Rate: 154.6 symbols/min [2025-09-22T22:23:25.882325] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:26.029114] [DEBUG] [LOCAL ] MUJ: Loaded 13226 existing records from primary storage. [2025-09-22T22:23:26.040529] [INFO ] [MAIN ] MUJ: Loaded 13226 primary data records. [2025-09-22T22:23:26.245181] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:26.286219] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11972 primary records. [2025-09-22T22:23:26.307400] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-22T22:23:26.420917] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-09-22T22:23:26.454489] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-22T22:23:26.572411] [INFO ] [MAIN ] Derivative Progress: 1241/2091 symbols completed. MUE took 1.4s. Estimated remaining: 5m 30s. Rate: 154.5 symbols/min [2025-09-22T22:23:26.582911] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:26.605336] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:26.606204] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52636 primary records. [2025-09-22T22:23:26.606318] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-22T22:23:26.631021] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-09-22T22:23:26.631431] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-22T22:23:26.633491] [INFO ] [MAIN ] Derivative Progress: 1242/2091 symbols completed. MUFG took 1.3s. Estimated remaining: 5m 29s. Rate: 154.6 symbols/min [2025-09-22T22:23:26.633983] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:26.667937] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:26.669217] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13226 primary records. [2025-09-22T22:23:26.669401] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-22T22:23:26.705706] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-09-22T22:23:26.713778] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-22T22:23:26.717577] [INFO ] [MAIN ] Derivative Progress: 1243/2091 symbols completed. MUJ took 0.8s. Estimated remaining: 5m 29s. Rate: 154.7 symbols/min [2025-09-22T22:23:26.706763] [DEBUG] [LOCAL ] MUR: Loaded 52929 existing records from primary storage. [2025-09-22T22:23:26.718064] [INFO ] [MAIN ] MUR: Loaded 52929 primary data records. [2025-09-22T22:23:26.718419] [DEBUG] [LOCAL ] MUSA: Loaded 25049 existing records from primary storage. [2025-09-22T22:23:26.718600] [INFO ] [MAIN ] MUSA: Loaded 25049 primary data records. [2025-09-22T22:23:27.334788] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:27.336686] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52929 primary records. [2025-09-22T22:23:27.336866] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-22T22:23:27.349993] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:27.358876] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 25049 primary records. [2025-09-22T22:23:27.361490] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-22T22:23:27.374666] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-09-22T22:23:27.379774] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-22T22:23:27.382054] [INFO ] [MAIN ] Derivative Progress: 1244/2091 symbols completed. MUR took 0.8s. Estimated remaining: 5m 29s. Rate: 154.6 symbols/min [2025-09-22T22:23:27.383225] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-09-22T22:23:27.383412] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-22T22:23:27.385561] [INFO ] [MAIN ] Derivative Progress: 1245/2091 symbols completed. MUSA took 0.8s. Estimated remaining: 5m 28s. Rate: 154.8 symbols/min [2025-09-22T22:23:27.386141] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:27.386248] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:27.386566] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:27.401030] [DEBUG] [LOCAL ] MVO: Loaded 9049 existing records from primary storage. [2025-09-22T22:23:27.401197] [INFO ] [MAIN ] MVO: Loaded 9049 primary data records. [2025-09-22T22:23:27.471390] [DEBUG] [LOCAL ] MVF: Loaded 12801 existing records from primary storage. [2025-09-22T22:23:27.483501] [INFO ] [MAIN ] MVF: Loaded 12801 primary data records. [2025-09-22T22:23:27.649713] [DEBUG] [LOCAL ] MUX: Loaded 42394 existing records from primary storage. [2025-09-22T22:23:27.699294] [INFO ] [MAIN ] MUX: Loaded 42394 primary data records. [2025-09-22T22:23:28.423194] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:28.424079] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 9049 primary records. [2025-09-22T22:23:28.424367] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-22T22:23:28.443869] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-09-22T22:23:28.444081] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-22T22:23:28.446542] [INFO ] [MAIN ] Derivative Progress: 1246/2091 symbols completed. MVO took 1.1s. Estimated remaining: 5m 28s. Rate: 154.6 symbols/min [2025-09-22T22:23:28.460405] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:28.462334] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:28.464432] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12801 primary records. [2025-09-22T22:23:28.464692] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-22T22:23:28.486042] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:28.489504] [INFO ] [MAIN ] MUX: Generated 1794 derivative records from 42394 primary records. [2025-09-22T22:23:28.489714] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-22T22:23:28.507604] [DEBUG] [LOCAL ] MVT: Loaded 10049 existing records from primary storage. [2025-09-22T22:23:28.512761] [INFO ] [MAIN ] MVT: Loaded 10049 primary data records. [2025-09-22T22:23:28.521972] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-09-22T22:23:28.522410] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-22T22:23:28.554557] [DEBUG] [LOCAL ] MUX: Derivative data saved (1794 records). [2025-09-22T22:23:28.542801] [INFO ] [MAIN ] Derivative Progress: 1247/2091 symbols completed. MVF took 1.2s. Estimated remaining: 5m 27s. Rate: 154.6 symbols/min [2025-09-22T22:23:28.579246] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-22T22:23:28.603373] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:28.608776] [INFO ] [MAIN ] Derivative Progress: 1248/2091 symbols completed. MUX took 1.2s. Estimated remaining: 5m 27s. Rate: 154.8 symbols/min [2025-09-22T22:23:28.631390] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:28.856880] [DEBUG] [LOCAL ] MX: Loaded 22982 existing records from primary storage. [2025-09-22T22:23:28.857298] [INFO ] [MAIN ] MX: Loaded 22982 primary data records. [2025-09-22T22:23:29.081461] [DEBUG] [LOCAL ] MWA: Loaded 47143 existing records from primary storage. [2025-09-22T22:23:29.206345] [INFO ] [MAIN ] MWA: Loaded 47143 primary data records. [2025-09-22T22:23:29.372613] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:29.393833] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10049 primary records. [2025-09-22T22:23:29.402659] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-22T22:23:29.574557] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-09-22T22:23:29.576678] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-22T22:23:29.578989] [INFO ] [MAIN ] Derivative Progress: 1249/2091 symbols completed. MVT took 1.1s. Estimated remaining: 5m 27s. Rate: 154.6 symbols/min [2025-09-22T22:23:29.579617] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:29.594408] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:29.596003] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22982 primary records. [2025-09-22T22:23:29.596227] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-22T22:23:29.615688] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-09-22T22:23:29.615955] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-22T22:23:29.621746] [INFO ] [MAIN ] Derivative Progress: 1250/2091 symbols completed. MX took 1.0s. Estimated remaining: 5m 26s. Rate: 154.7 symbols/min [2025-09-22T22:23:29.621982] [DEBUG] [LOCAL ] MXF: Loaded 6012 existing records from primary storage. [2025-09-22T22:23:29.622898] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:29.622985] [INFO ] [MAIN ] MXF: Loaded 6012 primary data records. [2025-09-22T22:23:29.751906] [DEBUG] [LOCAL ] MYD: Loaded 13748 existing records from primary storage. [2025-09-22T22:23:29.769872] [INFO ] [MAIN ] MYD: Loaded 13748 primary data records. [2025-09-22T22:23:30.031021] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:30.037229] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 47143 primary records. [2025-09-22T22:23:30.043178] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-22T22:23:30.323928] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-09-22T22:23:30.324319] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-22T22:23:30.326490] [INFO ] [MAIN ] Derivative Progress: 1251/2091 symbols completed. MWA took 1.7s. Estimated remaining: 5m 26s. Rate: 154.6 symbols/min [2025-09-22T22:23:30.327739] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:30.350625] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:30.351325] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 6012 primary records. [2025-09-22T22:23:30.351520] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-22T22:23:30.375184] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-09-22T22:23:30.376163] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-22T22:23:30.378766] [INFO ] [MAIN ] Derivative Progress: 1252/2091 symbols completed. MXF took 0.8s. Estimated remaining: 5m 25s. Rate: 154.7 symbols/min [2025-09-22T22:23:30.388627] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:30.389235] [DEBUG] [LOCAL ] MYE: Loaded 25322 existing records from primary storage. [2025-09-22T22:23:30.389497] [INFO ] [MAIN ] MYE: Loaded 25322 primary data records. [2025-09-22T22:23:30.468796] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:30.493697] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13748 primary records. [2025-09-22T22:23:30.510180] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-22T22:23:30.612337] [DEBUG] [LOCAL ] MYI: Loaded 19310 existing records from primary storage. [2025-09-22T22:23:30.716014] [INFO ] [MAIN ] MYI: Loaded 19310 primary data records. [2025-09-22T22:23:30.732687] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-09-22T22:23:30.746897] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-22T22:23:30.749550] [INFO ] [MAIN ] Derivative Progress: 1253/2091 symbols completed. MYD took 1.1s. Estimated remaining: 5m 25s. Rate: 154.7 symbols/min [2025-09-22T22:23:30.777042] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:30.926033] [DEBUG] [LOCAL ] MYN: Loaded 10334 existing records from primary storage. [2025-09-22T22:23:31.057610] [INFO ] [MAIN ] MYN: Loaded 10334 primary data records. [2025-09-22T22:23:31.205227] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:31.222175] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 25322 primary records. [2025-09-22T22:23:31.222297] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-22T22:23:31.427575] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-09-22T22:23:31.427905] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-22T22:23:31.430142] [INFO ] [MAIN ] Derivative Progress: 1254/2091 symbols completed. MYE took 1.1s. Estimated remaining: 5m 25s. Rate: 154.6 symbols/min [2025-09-22T22:23:31.430913] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:31.449607] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:31.450486] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19310 primary records. [2025-09-22T22:23:31.450675] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-22T22:23:31.470759] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-09-22T22:23:31.471141] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-22T22:23:31.473573] [INFO ] [MAIN ] Derivative Progress: 1255/2091 symbols completed. MYI took 1.1s. Estimated remaining: 5m 24s. Rate: 154.7 symbols/min [2025-09-22T22:23:31.495528] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:31.495869] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:31.497052] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 10334 primary records. [2025-09-22T22:23:31.497253] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-22T22:23:31.523147] [DEBUG] [LOCAL ] NABL: Loaded 40033 existing records from primary storage. [2025-09-22T22:23:31.524265] [INFO ] [MAIN ] NABL: Loaded 40033 primary data records. [2025-09-22T22:23:31.567501] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-09-22T22:23:31.574753] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-22T22:23:31.598577] [INFO ] [MAIN ] Derivative Progress: 1256/2091 symbols completed. MYN took 0.8s. Estimated remaining: 5m 24s. Rate: 154.8 symbols/min [2025-09-22T22:23:31.623717] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:31.635865] [DEBUG] [LOCAL ] NAC: Loaded 24636 existing records from primary storage. [2025-09-22T22:23:31.647162] [INFO ] [MAIN ] NAC: Loaded 24636 primary data records. [2025-09-22T22:23:32.212701] [DEBUG] [LOCAL ] NAD: Loaded 34029 existing records from primary storage. [2025-09-22T22:23:32.213805] [INFO ] [MAIN ] NAD: Loaded 34029 primary data records. [2025-09-22T22:23:32.537743] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:32.538828] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 40033 primary records. [2025-09-22T22:23:32.538945] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-22T22:23:32.572630] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:32.573719] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24636 primary records. [2025-09-22T22:23:32.574163] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-22T22:23:32.588267] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-09-22T22:23:32.588688] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-22T22:23:32.591301] [INFO ] [MAIN ] Derivative Progress: 1257/2091 symbols completed. NABL took 1.2s. Estimated remaining: 5m 24s. Rate: 154.6 symbols/min [2025-09-22T22:23:32.592469] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:32.598219] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-09-22T22:23:32.600368] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-22T22:23:32.602813] [INFO ] [MAIN ] Derivative Progress: 1258/2091 symbols completed. NAC took 1.1s. Estimated remaining: 5m 23s. Rate: 154.7 symbols/min [2025-09-22T22:23:32.610449] [DEBUG] [LOCAL ] NAN: Loaded 9054 existing records from primary storage. [2025-09-22T22:23:32.622712] [INFO ] [MAIN ] NAN: Loaded 9054 primary data records. [2025-09-22T22:23:32.656537] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:32.691102] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 34029 primary records. [2025-09-22T22:23:32.703119] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-22T22:23:32.763544] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-09-22T22:23:32.773938] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-22T22:23:32.798976] [INFO ] [MAIN ] Derivative Progress: 1259/2091 symbols completed. NAD took 1.2s. Estimated remaining: 5m 23s. Rate: 154.8 symbols/min [2025-09-22T22:23:32.962134] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:32.962851] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 9054 primary records. [2025-09-22T22:23:32.962915] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-22T22:23:32.978382] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-09-22T22:23:32.978520] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-22T22:23:32.980713] [INFO ] [MAIN ] Derivative Progress: 1260/2091 symbols completed. NAN took 0.4s. Estimated remaining: 5m 22s. Rate: 154.8 symbols/min [2025-09-22T22:23:32.981845] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:32.981699] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:32.982053] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:32.989465] [DEBUG] [LOCAL ] NAZ: Loaded 2636 existing records from primary storage. [2025-09-22T22:23:32.989693] [INFO ] [MAIN ] NAZ: Loaded 2636 primary data records. [2025-09-22T22:23:33.203793] [DEBUG] [LOCAL ] NATL: Loaded 32779 existing records from primary storage. [2025-09-22T22:23:33.316256] [INFO ] [MAIN ] NATL: Loaded 32779 primary data records. [2025-09-22T22:23:33.428572] [DEBUG] [LOCAL ] NAT: Loaded 49108 existing records from primary storage. [2025-09-22T22:23:33.446241] [INFO ] [MAIN ] NAT: Loaded 49108 primary data records. [2025-09-22T22:23:33.976196] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:33.977794] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2636 primary records. [2025-09-22T22:23:33.978140] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-22T22:23:34.000470] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-09-22T22:23:34.000934] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-22T22:23:34.016595] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:34.017488] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32779 primary records. [2025-09-22T22:23:34.017698] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-22T22:23:34.016227] [INFO ] [MAIN ] Derivative Progress: 1261/2091 symbols completed. NAZ took 1.0s. Estimated remaining: 5m 22s. Rate: 154.6 symbols/min [2025-09-22T22:23:34.027793] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:34.053463] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:34.055496] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49108 primary records. [2025-09-22T22:23:34.055728] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-22T22:23:34.054595] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-09-22T22:23:34.055833] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-22T22:23:34.060789] [DEBUG] [LOCAL ] NBB: Loaded 8877 existing records from primary storage. [2025-09-22T22:23:34.062907] [INFO ] [MAIN ] Derivative Progress: 1262/2091 symbols completed. NATL took 1.1s. Estimated remaining: 5m 21s. Rate: 154.7 symbols/min [2025-09-22T22:23:34.063114] [INFO ] [MAIN ] NBB: Loaded 8877 primary data records. [2025-09-22T22:23:34.063699] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:34.171268] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-09-22T22:23:34.187639] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-22T22:23:34.190059] [INFO ] [MAIN ] Derivative Progress: 1263/2091 symbols completed. NAT took 1.2s. Estimated remaining: 5m 21s. Rate: 154.8 symbols/min [2025-09-22T22:23:34.195777] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:34.262405] [DEBUG] [LOCAL ] NBHC: Loaded 23082 existing records from primary storage. [2025-09-22T22:23:34.284542] [INFO ] [MAIN ] NBHC: Loaded 23082 primary data records. [2025-09-22T22:23:34.549991] [DEBUG] [LOCAL ] NBR: Loaded 34821 existing records from primary storage. [2025-09-22T22:23:34.565930] [INFO ] [MAIN ] NBR: Loaded 34821 primary data records. [2025-09-22T22:23:35.091020] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:35.092926] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 8877 primary records. [2025-09-22T22:23:35.093676] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-22T22:23:35.117360] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-09-22T22:23:35.131033] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:35.130846] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-22T22:23:35.134050] [INFO ] [MAIN ] Derivative Progress: 1264/2091 symbols completed. NBB took 1.1s. Estimated remaining: 5m 21s. Rate: 154.7 symbols/min [2025-09-22T22:23:35.131775] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 23082 primary records. [2025-09-22T22:23:35.134371] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-22T22:23:35.135463] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:35.166778] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:35.167885] [INFO ] [MAIN ] NBR: Generated 1794 derivative records from 34821 primary records. [2025-09-22T22:23:35.168033] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-09-22T22:23:35.168198] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-22T22:23:35.168140] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-22T22:23:35.170593] [INFO ] [MAIN ] Derivative Progress: 1265/2091 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 20s. Rate: 154.8 symbols/min [2025-09-22T22:23:35.176978] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:35.201803] [DEBUG] [LOCAL ] NBR: Derivative data saved (1794 records). [2025-09-22T22:23:35.201937] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-22T22:23:35.194354] [DEBUG] [LOCAL ] NC: Loaded 1907 existing records from primary storage. [2025-09-22T22:23:35.205021] [INFO ] [MAIN ] Derivative Progress: 1266/2091 symbols completed. NBR took 1.0s. Estimated remaining: 5m 20s. Rate: 154.9 symbols/min [2025-09-22T22:23:35.205318] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:35.205449] [INFO ] [MAIN ] NC: Loaded 1907 primary data records. [2025-09-22T22:23:35.206148] [DEBUG] [LOCAL ] NBXG: Loaded 22674 existing records from primary storage. [2025-09-22T22:23:35.211524] [INFO ] [MAIN ] NBXG: Loaded 22674 primary data records. [2025-09-22T22:23:35.416386] [DEBUG] [LOCAL ] NCA: Loaded 10054 existing records from primary storage. [2025-09-22T22:23:35.435363] [INFO ] [MAIN ] NCA: Loaded 10054 primary data records. [2025-09-22T22:23:36.202392] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:36.204419] [INFO ] [MAIN ] NC: Generated 1794 derivative records from 1907 primary records. [2025-09-22T22:23:36.205929] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-22T22:23:36.232226] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:36.233663] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 22674 primary records. [2025-09-22T22:23:36.233761] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-22T22:23:36.261596] [DEBUG] [LOCAL ] NC: Derivative data saved (1794 records). [2025-09-22T22:23:36.261772] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-22T22:23:36.260681] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:36.266041] [INFO ] [MAIN ] Derivative Progress: 1267/2091 symbols completed. NC took 1.1s. Estimated remaining: 5m 20s. Rate: 154.7 symbols/min [2025-09-22T22:23:36.263824] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 10054 primary records. [2025-09-22T22:23:36.266746] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-22T22:23:36.269231] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:36.270893] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-09-22T22:23:36.271315] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-22T22:23:36.273451] [INFO ] [MAIN ] Derivative Progress: 1268/2091 symbols completed. NBXG took 1.1s. Estimated remaining: 5m 19s. Rate: 154.8 symbols/min [2025-09-22T22:23:36.284016] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:36.288856] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-09-22T22:23:36.288942] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-22T22:23:36.291281] [INFO ] [MAIN ] Derivative Progress: 1269/2091 symbols completed. NCA took 1.1s. Estimated remaining: 5m 18s. Rate: 154.9 symbols/min [2025-09-22T22:23:36.291596] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:36.315735] [DEBUG] [LOCAL ] NCDL: Loaded 21696 existing records from primary storage. [2025-09-22T22:23:36.316010] [INFO ] [MAIN ] NCDL: Loaded 21696 primary data records. [2025-09-22T22:23:36.398258] [DEBUG] [LOCAL ] NCV: Loaded 13376 existing records from primary storage. [2025-09-22T22:23:36.423736] [INFO ] [MAIN ] NCV: Loaded 13376 primary data records. [2025-09-22T22:23:36.769298] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-22T22:23:36.799717] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-09-22T22:23:37.306309] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:37.308444] [INFO ] [MAIN ] NCDL: Generated 1794 derivative records from 21696 primary records. [2025-09-22T22:23:37.308841] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-22T22:23:37.335635] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:37.338251] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13376 primary records. [2025-09-22T22:23:37.338477] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-22T22:23:37.358426] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-09-22T22:23:37.358588] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-22T22:23:37.361600] [INFO ] [MAIN ] Derivative Progress: 1270/2091 symbols completed. NCV took 1.1s. Estimated remaining: 5m 18s. Rate: 154.7 symbols/min [2025-09-22T22:23:37.362223] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:37.364005] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1794 records). [2025-09-22T22:23:37.364279] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-22T22:23:37.367068] [INFO ] [MAIN ] Derivative Progress: 1271/2091 symbols completed. NCDL took 1.1s. Estimated remaining: 5m 18s. Rate: 154.8 symbols/min [2025-09-22T22:23:37.367508] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:37.387171] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:37.388054] [INFO ] [MAIN ] NCLH: Generated 1794 derivative records from 53753 primary records. [2025-09-22T22:23:37.388178] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-22T22:23:37.410290] [DEBUG] [LOCAL ] NCZ: Loaded 11740 existing records from primary storage. [2025-09-22T22:23:37.411007] [INFO ] [MAIN ] NCZ: Loaded 11740 primary data records. [2025-09-22T22:23:37.463265] [DEBUG] [LOCAL ] NDMO: Loaded 16551 existing records from primary storage. [2025-09-22T22:23:37.476550] [INFO ] [MAIN ] NDMO: Loaded 16551 primary data records. [2025-09-22T22:23:37.485611] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1794 records). [2025-09-22T22:23:37.504905] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-22T22:23:37.529006] [INFO ] [MAIN ] Derivative Progress: 1272/2091 symbols completed. NCLH took 1.2s. Estimated remaining: 5m 17s. Rate: 154.9 symbols/min [2025-09-22T22:23:37.539586] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:38.130514] [DEBUG] [LOCAL ] NE: Loaded 52391 existing records from primary storage. [2025-09-22T22:23:38.131018] [INFO ] [MAIN ] NE: Loaded 52391 primary data records. [2025-09-22T22:23:38.255527] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:38.256893] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 11740 primary records. [2025-09-22T22:23:38.262410] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-22T22:23:38.317604] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:38.321298] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 16551 primary records. [2025-09-22T22:23:38.321609] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-22T22:23:38.476263] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-09-22T22:23:38.490140] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-22T22:23:38.492877] [INFO ] [MAIN ] Derivative Progress: 1273/2091 symbols completed. NCZ took 1.1s. Estimated remaining: 5m 17s. Rate: 154.7 symbols/min [2025-09-22T22:23:38.499140] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-09-22T22:23:38.499591] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-22T22:23:38.502044] [INFO ] [MAIN ] Derivative Progress: 1274/2091 symbols completed. NDMO took 1.1s. Estimated remaining: 5m 17s. Rate: 154.8 symbols/min [2025-09-22T22:23:38.521805] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:38.522357] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52391 primary records. [2025-09-22T22:23:38.522417] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-22T22:23:38.538165] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-09-22T22:23:38.538224] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-22T22:23:38.540716] [INFO ] [MAIN ] Derivative Progress: 1275/2091 symbols completed. NE took 1.0s. Estimated remaining: 5m 16s. Rate: 154.9 symbols/min [2025-09-22T22:23:38.541309] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:38.541211] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:38.541542] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:38.605513] [DEBUG] [LOCAL ] NEA: Loaded 35290 existing records from primary storage. [2025-09-22T22:23:38.605911] [INFO ] [MAIN ] NEA: Loaded 35290 primary data records. [2025-09-22T22:23:38.741970] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-22T22:23:38.743194] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-22T22:23:38.742551] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-09-22T22:23:38.753827] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-09-22T22:23:39.568736] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:39.569687] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35290 primary records. [2025-09-22T22:23:39.569893] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-22T22:23:39.600621] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:39.601935] [INFO ] [MAIN ] NEM: Generated 1794 derivative records from 53708 primary records. [2025-09-22T22:23:39.609680] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-22T22:23:39.616023] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:39.616915] [INFO ] [MAIN ] NEE: Generated 1794 derivative records from 53707 primary records. [2025-09-22T22:23:39.617604] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-22T22:23:39.630638] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-09-22T22:23:39.632557] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-22T22:23:39.641705] [INFO ] [MAIN ] Derivative Progress: 1276/2091 symbols completed. NEA took 1.1s. Estimated remaining: 5m 16s. Rate: 154.7 symbols/min [2025-09-22T22:23:39.642613] [DEBUG] [LOCAL ] NEM: Derivative data saved (1794 records). [2025-09-22T22:23:39.646631] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-22T22:23:39.650259] [INFO ] [MAIN ] Derivative Progress: 1277/2091 symbols completed. NEM took 1.1s. Estimated remaining: 5m 15s. Rate: 154.8 symbols/min [2025-09-22T22:23:39.647834] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:39.651773] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:39.655693] [DEBUG] [LOCAL ] NEE: Derivative data saved (1794 records). [2025-09-22T22:23:39.655801] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-22T22:23:39.658224] [INFO ] [MAIN ] Derivative Progress: 1278/2091 symbols completed. NEE took 1.1s. Estimated remaining: 5m 15s. Rate: 154.9 symbols/min [2025-09-22T22:23:39.658718] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:39.664785] [DEBUG] [LOCAL ] NEUE: Loaded 2247 existing records from primary storage. [2025-09-22T22:23:39.665086] [INFO ] [MAIN ] NEUE: Loaded 2247 primary data records. [2025-09-22T22:23:39.668363] [DEBUG] [LOCAL ] NEU: Loaded 8155 existing records from primary storage. [2025-09-22T22:23:39.700693] [INFO ] [MAIN ] NEU: Loaded 8155 primary data records. [2025-09-22T22:23:40.216623] [DEBUG] [LOCAL ] NET: Loaded 53072 existing records from primary storage. [2025-09-22T22:23:40.336522] [INFO ] [MAIN ] NET: Loaded 53072 primary data records. [2025-09-22T22:23:40.664090] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:40.668355] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8155 primary records. [2025-09-22T22:23:40.668790] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-22T22:23:40.695144] [DEBUG] [MAIN ] NEUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:40.699835] [INFO ] [MAIN ] NEUE: Generated 1794 derivative records from 2247 primary records. [2025-09-22T22:23:40.700361] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-22T22:23:40.701531] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-09-22T22:23:40.701701] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-22T22:23:40.704925] [INFO ] [MAIN ] Derivative Progress: 1279/2091 symbols completed. NEU took 1.1s. Estimated remaining: 5m 15s. Rate: 154.7 symbols/min [2025-09-22T22:23:40.705198] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:40.721144] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1794 records). [2025-09-22T22:23:40.724261] [DEBUG] [LOCAL ] NEXA: Loaded 4047 existing records from primary storage. [2025-09-22T22:23:40.724498] [INFO ] [MAIN ] NEXA: Loaded 4047 primary data records. [2025-09-22T22:23:40.724401] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-22T22:23:40.748297] [INFO ] [MAIN ] Derivative Progress: 1280/2091 symbols completed. NEUE took 1.1s. Estimated remaining: 5m 14s. Rate: 154.8 symbols/min [2025-09-22T22:23:40.810439] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:40.864132] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:40.888608] [INFO ] [MAIN ] NET: Generated 1794 derivative records from 53072 primary records. [2025-09-22T22:23:40.927495] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-22T22:23:41.064031] [DEBUG] [LOCAL ] NET: Derivative data saved (1794 records). [2025-09-22T22:23:41.064462] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-22T22:23:41.067334] [INFO ] [MAIN ] Derivative Progress: 1281/2091 symbols completed. NET took 1.4s. Estimated remaining: 5m 14s. Rate: 154.9 symbols/min [2025-09-22T22:23:41.068371] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:41.104304] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:41.105033] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 4047 primary records. [2025-09-22T22:23:41.105144] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-22T22:23:41.137134] [DEBUG] [LOCAL ] NFG: Loaded 38524 existing records from primary storage. [2025-09-22T22:23:41.141470] [DEBUG] [LOCAL ] NFJ: Loaded 20357 existing records from primary storage. [2025-09-22T22:23:41.141591] [INFO ] [MAIN ] NFG: Loaded 38524 primary data records. [2025-09-22T22:23:41.142441] [INFO ] [MAIN ] NFJ: Loaded 20357 primary data records. [2025-09-22T22:23:41.145863] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-09-22T22:23:41.172788] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-22T22:23:41.209201] [INFO ] [MAIN ] Derivative Progress: 1282/2091 symbols completed. NEXA took 0.5s. Estimated remaining: 5m 13s. Rate: 154.9 symbols/min [2025-09-22T22:23:41.226753] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:41.808881] [DEBUG] [LOCAL ] NGG: Loaded 46155 existing records from primary storage. [2025-09-22T22:23:41.809357] [INFO ] [MAIN ] NGG: Loaded 46155 primary data records. [2025-09-22T22:23:41.933849] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:41.945498] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20357 primary records. [2025-09-22T22:23:41.950964] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-22T22:23:42.191067] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-09-22T22:23:42.204736] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-22T22:23:42.206902] [INFO ] [MAIN ] Derivative Progress: 1283/2091 symbols completed. NFJ took 1.1s. Estimated remaining: 5m 13s. Rate: 154.7 symbols/min [2025-09-22T22:23:42.208550] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:42.210146] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38524 primary records. [2025-09-22T22:23:42.209330] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:42.210363] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-22T22:23:42.230486] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-09-22T22:23:42.233082] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-22T22:23:42.235616] [INFO ] [MAIN ] Derivative Progress: 1284/2091 symbols completed. NFG took 1.5s. Estimated remaining: 5m 13s. Rate: 154.9 symbols/min [2025-09-22T22:23:42.236240] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:42.272169] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:42.274497] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46155 primary records. [2025-09-22T22:23:42.280134] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-22T22:23:42.281418] [DEBUG] [LOCAL ] NGS: Loaded 11503 existing records from primary storage. [2025-09-22T22:23:42.283091] [DEBUG] [LOCAL ] NGL: Loaded 30374 existing records from primary storage. [2025-09-22T22:23:42.283639] [INFO ] [MAIN ] NGL: Loaded 30374 primary data records. [2025-09-22T22:23:42.281635] [INFO ] [MAIN ] NGS: Loaded 11503 primary data records. [2025-09-22T22:23:42.365268] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-09-22T22:23:42.415981] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-22T22:23:42.443635] [INFO ] [MAIN ] Derivative Progress: 1285/2091 symbols completed. NGG took 1.2s. Estimated remaining: 5m 12s. Rate: 154.9 symbols/min [2025-09-22T22:23:42.466593] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:42.799128] [DEBUG] [LOCAL ] NGVC: Loaded 22375 existing records from primary storage. [2025-09-22T22:23:42.922991] [INFO ] [MAIN ] NGVC: Loaded 22375 primary data records. [2025-09-22T22:23:43.268000] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:43.281508] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30374 primary records. [2025-09-22T22:23:43.281962] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:43.282488] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-22T22:23:43.283258] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11503 primary records. [2025-09-22T22:23:43.284146] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-22T22:23:43.308869] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-09-22T22:23:43.312183] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-22T22:23:43.314939] [INFO ] [MAIN ] Derivative Progress: 1286/2091 symbols completed. NGL took 1.1s. Estimated remaining: 5m 12s. Rate: 154.8 symbols/min [2025-09-22T22:23:43.316099] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:43.335922] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-09-22T22:23:43.336204] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:43.337064] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22375 primary records. [2025-09-22T22:23:43.337162] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-22T22:23:43.336350] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-22T22:23:43.340120] [INFO ] [MAIN ] Derivative Progress: 1287/2091 symbols completed. NGS took 1.1s. Estimated remaining: 5m 11s. Rate: 154.9 symbols/min [2025-09-22T22:23:43.340357] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:43.371223] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-09-22T22:23:43.371838] [DEBUG] [LOCAL ] NGVT: Loaded 24402 existing records from primary storage. [2025-09-22T22:23:43.372010] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-22T22:23:43.374603] [INFO ] [MAIN ] NGVT: Loaded 24402 primary data records. [2025-09-22T22:23:43.374458] [INFO ] [MAIN ] Derivative Progress: 1288/2091 symbols completed. NGVC took 0.9s. Estimated remaining: 5m 11s. Rate: 155.0 symbols/min [2025-09-22T22:23:43.509561] [DEBUG] [LOCAL ] NHI: Loaded 22012 existing records from primary storage. [2025-09-22T22:23:43.525833] [INFO ] [MAIN ] NHI: Loaded 22012 primary data records. [2025-09-22T22:23:44.116996] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:44.117842] [INFO ] [MAIN ] NGVT: Generated 1794 derivative records from 24402 primary records. [2025-09-22T22:23:44.118086] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-22T22:23:44.134629] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1794 records). [2025-09-22T22:23:44.134855] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-22T22:23:44.137064] [INFO ] [MAIN ] Derivative Progress: 1289/2091 symbols completed. NGVT took 0.8s. Estimated remaining: 5m 11s. Rate: 154.9 symbols/min [2025-09-22T22:23:44.154328] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:44.155109] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 22012 primary records. [2025-09-22T22:23:44.155177] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-22T22:23:44.172103] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-09-22T22:23:44.172231] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-22T22:23:44.174942] [INFO ] [MAIN ] Derivative Progress: 1290/2091 symbols completed. NHI took 0.8s. Estimated remaining: 5m 10s. Rate: 155.0 symbols/min [2025-09-22T22:23:44.175933] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:44.175611] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:44.175878] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:44.183946] [DEBUG] [LOCAL ] NIM: Loaded 4079 existing records from primary storage. [2025-09-22T22:23:44.184180] [INFO ] [MAIN ] NIM: Loaded 4079 primary data records. [2025-09-22T22:23:44.276230] [DEBUG] [LOCAL ] NIE: Loaded 11610 existing records from primary storage. [2025-09-22T22:23:44.317619] [DEBUG] [LOCAL ] NIC: Loaded 8853 existing records from primary storage. [2025-09-22T22:23:44.321966] [INFO ] [MAIN ] NIE: Loaded 11610 primary data records. [2025-09-22T22:23:44.322157] [INFO ] [MAIN ] NIC: Loaded 8853 primary data records. [2025-09-22T22:23:45.203904] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:45.206683] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 4079 primary records. [2025-09-22T22:23:45.207218] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-22T22:23:45.224754] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:45.248619] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8853 primary records. [2025-09-22T22:23:45.248910] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-22T22:23:45.249171] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:45.252974] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11610 primary records. [2025-09-22T22:23:45.254391] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-22T22:23:45.255635] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-09-22T22:23:45.267254] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-22T22:23:45.270012] [INFO ] [MAIN ] Derivative Progress: 1291/2091 symbols completed. NIM took 1.1s. Estimated remaining: 5m 10s. Rate: 154.8 symbols/min [2025-09-22T22:23:45.271318] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:45.289195] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-09-22T22:23:45.289944] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-22T22:23:45.292725] [INFO ] [MAIN ] Derivative Progress: 1292/2091 symbols completed. NIE took 1.1s. Estimated remaining: 5m 10s. Rate: 154.9 symbols/min [2025-09-22T22:23:45.294293] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:45.294006] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-09-22T22:23:45.294893] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-22T22:23:45.297447] [INFO ] [MAIN ] Derivative Progress: 1293/2091 symbols completed. NIC took 1.1s. Estimated remaining: 5m 9s. Rate: 155.0 symbols/min [2025-09-22T22:23:45.297846] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:45.322775] [DEBUG] [LOCAL ] NINE: Loaded 28634 existing records from primary storage. [2025-09-22T22:23:45.322918] [INFO ] [MAIN ] NINE: Loaded 28634 primary data records. [2025-09-22T22:23:45.545036] [DEBUG] [LOCAL ] NJR: Loaded 38056 existing records from primary storage. [2025-09-22T22:23:45.674606] [INFO ] [MAIN ] NJR: Loaded 38056 primary data records. [2025-09-22T22:23:45.687334] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-22T22:23:45.707476] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-09-22T22:23:46.362745] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:46.364166] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28634 primary records. [2025-09-22T22:23:46.365254] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-22T22:23:46.386849] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-09-22T22:23:46.387222] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-22T22:23:46.389690] [INFO ] [MAIN ] Derivative Progress: 1294/2091 symbols completed. NINE took 1.1s. Estimated remaining: 5m 9s. Rate: 154.8 symbols/min [2025-09-22T22:23:46.390914] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:46.407728] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:46.409972] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 38056 primary records. [2025-09-22T22:23:46.410149] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-22T22:23:46.445098] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-09-22T22:23:46.443607] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:46.445302] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-22T22:23:46.446154] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-09-22T22:23:46.446310] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-22T22:23:46.449628] [INFO ] [MAIN ] Derivative Progress: 1295/2091 symbols completed. NJR took 1.2s. Estimated remaining: 5m 8s. Rate: 154.9 symbols/min [2025-09-22T22:23:46.458269] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:46.473147] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-09-22T22:23:46.473366] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-22T22:23:46.471968] [DEBUG] [LOCAL ] NKX: Loaded 13576 existing records from primary storage. [2025-09-22T22:23:46.476401] [INFO ] [MAIN ] NKX: Loaded 13576 primary data records. [2025-09-22T22:23:46.476000] [INFO ] [MAIN ] Derivative Progress: 1296/2091 symbols completed. NIO took 1.2s. Estimated remaining: 5m 8s. Rate: 155.0 symbols/min [2025-09-22T22:23:46.488135] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:46.606378] [DEBUG] [LOCAL ] NLOP: Loaded 11818 existing records from primary storage. [2025-09-22T22:23:46.606696] [INFO ] [MAIN ] NLOP: Loaded 11818 primary data records. [2025-09-22T22:23:47.033340] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-09-22T22:23:47.140578] [INFO ] [MAIN ] NLY: Loaded 53581 primary data records. [2025-09-22T22:23:47.495302] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:47.496330] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13576 primary records. [2025-09-22T22:23:47.496416] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-22T22:23:47.517468] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-09-22T22:23:47.517994] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-22T22:23:47.520490] [INFO ] [MAIN ] Derivative Progress: 1297/2091 symbols completed. NKX took 1.1s. Estimated remaining: 5m 8s. Rate: 154.8 symbols/min [2025-09-22T22:23:47.534090] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:47.534610] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:47.535858] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11818 primary records. [2025-09-22T22:23:47.535921] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-22T22:23:47.564764] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-09-22T22:23:47.564929] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-22T22:23:47.565272] [DEBUG] [LOCAL ] NMAI: Loaded 13187 existing records from primary storage. [2025-09-22T22:23:47.567802] [INFO ] [MAIN ] Derivative Progress: 1298/2091 symbols completed. NLOP took 1.1s. Estimated remaining: 5m 7s. Rate: 154.9 symbols/min [2025-09-22T22:23:47.568290] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:47.568860] [INFO ] [MAIN ] NMAI: Loaded 13187 primary data records. [2025-09-22T22:23:47.695458] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:47.718121] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53581 primary records. [2025-09-22T22:23:47.718507] [DEBUG] [LOCAL ] NMCO: Loaded 16527 existing records from primary storage. [2025-09-22T22:23:47.723877] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-22T22:23:47.743075] [INFO ] [MAIN ] NMCO: Loaded 16527 primary data records. [2025-09-22T22:23:48.019455] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-09-22T22:23:48.020172] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-22T22:23:48.022591] [INFO ] [MAIN ] Derivative Progress: 1299/2091 symbols completed. NLY took 1.5s. Estimated remaining: 5m 7s. Rate: 154.9 symbols/min [2025-09-22T22:23:48.034106] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:48.261201] [DEBUG] [LOCAL ] NMG: Loaded 7500 existing records from primary storage. [2025-09-22T22:23:48.261550] [INFO ] [MAIN ] NMG: Loaded 7500 primary data records. [2025-09-22T22:23:48.455006] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:48.462118] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 13187 primary records. [2025-09-22T22:23:48.463000] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-22T22:23:48.597190] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-09-22T22:23:48.597770] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-22T22:23:48.600291] [INFO ] [MAIN ] Derivative Progress: 1300/2091 symbols completed. NMAI took 1.1s. Estimated remaining: 5m 7s. Rate: 154.8 symbols/min [2025-09-22T22:23:48.602455] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:48.624099] [DEBUG] [LOCAL ] NMI: Loaded 4059 existing records from primary storage. [2025-09-22T22:23:48.621013] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:48.624254] [INFO ] [MAIN ] NMI: Loaded 4059 primary data records. [2025-09-22T22:23:48.624962] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16527 primary records. [2025-09-22T22:23:48.636492] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-22T22:23:48.943935] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-09-22T22:23:48.953448] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-22T22:23:48.956197] [INFO ] [MAIN ] Derivative Progress: 1301/2091 symbols completed. NMCO took 1.4s. Estimated remaining: 5m 6s. Rate: 154.8 symbols/min [2025-09-22T22:23:48.971304] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:48.971102] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:48.972574] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 7500 primary records. [2025-09-22T22:23:48.973244] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-22T22:23:49.004404] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-09-22T22:23:49.003797] [DEBUG] [LOCAL ] NMM: Loaded 14314 existing records from primary storage. [2025-09-22T22:23:49.004538] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-22T22:23:49.004711] [INFO ] [MAIN ] NMM: Loaded 14314 primary data records. [2025-09-22T22:23:49.007305] [INFO ] [MAIN ] Derivative Progress: 1302/2091 symbols completed. NMG took 1.0s. Estimated remaining: 5m 6s. Rate: 154.9 symbols/min [2025-09-22T22:23:49.028949] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:49.335792] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:49.337286] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4059 primary records. [2025-09-22T22:23:49.337432] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-22T22:23:49.361556] [DEBUG] [LOCAL ] NMR: Loaded 35091 existing records from primary storage. [2025-09-22T22:23:49.362129] [INFO ] [MAIN ] NMR: Loaded 35091 primary data records. [2025-09-22T22:23:49.446249] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-09-22T22:23:49.468818] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-22T22:23:49.481526] [INFO ] [MAIN ] Derivative Progress: 1303/2091 symbols completed. NMI took 0.9s. Estimated remaining: 5m 5s. Rate: 154.9 symbols/min [2025-09-22T22:23:49.682814] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:49.684412] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14314 primary records. [2025-09-22T22:23:49.684719] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-22T22:23:49.704264] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-09-22T22:23:49.704582] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-22T22:23:49.707167] [INFO ] [MAIN ] Derivative Progress: 1304/2091 symbols completed. NMM took 0.7s. Estimated remaining: 5m 5s. Rate: 154.9 symbols/min [2025-09-22T22:23:49.722957] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:49.723580] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35091 primary records. [2025-09-22T22:23:49.723662] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-22T22:23:49.739295] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-09-22T22:23:49.739356] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-22T22:23:49.741487] [INFO ] [MAIN ] Derivative Progress: 1305/2091 symbols completed. NMR took 0.7s. Estimated remaining: 5m 4s. Rate: 155.0 symbols/min [2025-09-22T22:23:49.742077] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:49.742269] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:49.742958] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:49.751516] [DEBUG] [LOCAL ] NMS: Loaded 2888 existing records from primary storage. [2025-09-22T22:23:49.751796] [INFO ] [MAIN ] NMS: Loaded 2888 primary data records. [2025-09-22T22:23:49.749616] [DEBUG] [LOCAL ] NMT: Loaded 2845 existing records from primary storage. [2025-09-22T22:23:49.751894] [INFO ] [MAIN ] NMT: Loaded 2845 primary data records. [2025-09-22T22:23:50.044931] [DEBUG] [LOCAL ] NMZ: Loaded 21499 existing records from primary storage. [2025-09-22T22:23:50.107583] [INFO ] [MAIN ] NMZ: Loaded 21499 primary data records. [2025-09-22T22:23:50.743601] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:50.746039] [INFO ] [MAIN ] NMT: Generated 1794 derivative records from 2845 primary records. [2025-09-22T22:23:50.746670] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-22T22:23:50.774765] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:23:50.776326] [DEBUG] [LOCAL ] NMT: Derivative data saved (1794 records). [2025-09-22T22:23:50.777307] [INFO ] [MAIN ] NMS: Generated 1793 derivative records from 2888 primary records. [2025-09-22T22:23:50.777566] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-22T22:23:50.780090] [INFO ] [MAIN ] Derivative Progress: 1306/2091 symbols completed. NMT took 1.0s. Estimated remaining: 5m 4s. Rate: 154.8 symbols/min [2025-09-22T22:23:50.777818] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-22T22:23:50.781343] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:50.818421] [DEBUG] [LOCAL ] NMS: Derivative data saved (1793 records). [2025-09-22T22:23:50.818329] [DEBUG] [LOCAL ] NNI: Loaded 9907 existing records from primary storage. [2025-09-22T22:23:50.818792] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:50.819634] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-22T22:23:50.819565] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21499 primary records. [2025-09-22T22:23:50.819735] [INFO ] [MAIN ] NNI: Loaded 9907 primary data records. [2025-09-22T22:23:50.822211] [INFO ] [MAIN ] Derivative Progress: 1307/2091 symbols completed. NMS took 1.1s. Estimated remaining: 5m 4s. Rate: 155.0 symbols/min [2025-09-22T22:23:50.822352] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-22T22:23:50.828323] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:51.050902] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-09-22T22:23:51.166669] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-22T22:23:51.169921] [INFO ] [MAIN ] Derivative Progress: 1308/2091 symbols completed. NMZ took 1.4s. Estimated remaining: 5m 3s. Rate: 155.0 symbols/min [2025-09-22T22:23:51.173845] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:51.192514] [DEBUG] [LOCAL ] NNN: Loaded 48446 existing records from primary storage. [2025-09-22T22:23:51.194594] [INFO ] [MAIN ] NNN: Loaded 48446 primary data records. [2025-09-22T22:23:51.232836] [DEBUG] [LOCAL ] NNY: Loaded 5719 existing records from primary storage. [2025-09-22T22:23:51.246443] [INFO ] [MAIN ] NNY: Loaded 5719 primary data records. [2025-09-22T22:23:51.732597] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:51.849616] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 9907 primary records. [2025-09-22T22:23:51.850397] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-22T22:23:51.870266] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-09-22T22:23:51.871072] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-22T22:23:51.874222] [INFO ] [MAIN ] Derivative Progress: 1309/2091 symbols completed. NNI took 1.1s. Estimated remaining: 5m 3s. Rate: 154.9 symbols/min [2025-09-22T22:23:51.875292] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:51.919268] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:51.919468] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:51.925834] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48446 primary records. [2025-09-22T22:23:51.926971] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5719 primary records. [2025-09-22T22:23:51.926219] [DEBUG] [LOCAL ] NOA: Loaded 16312 existing records from primary storage. [2025-09-22T22:23:51.927216] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-22T22:23:51.927100] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-22T22:23:51.928105] [INFO ] [MAIN ] NOA: Loaded 16312 primary data records. [2025-09-22T22:23:52.032680] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-09-22T22:23:52.038669] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-22T22:23:52.041418] [INFO ] [MAIN ] Derivative Progress: 1310/2091 symbols completed. NNN took 1.2s. Estimated remaining: 5m 2s. Rate: 154.9 symbols/min [2025-09-22T22:23:52.060811] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:52.065753] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-09-22T22:23:52.065959] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-22T22:23:52.068824] [INFO ] [MAIN ] Derivative Progress: 1311/2091 symbols completed. NNY took 0.9s. Estimated remaining: 5m 2s. Rate: 155.0 symbols/min [2025-09-22T22:23:52.100355] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:52.307179] [DEBUG] [LOCAL ] NOAH: Loaded 20036 existing records from primary storage. [2025-09-22T22:23:52.307350] [INFO ] [MAIN ] NOAH: Loaded 20036 primary data records. [2025-09-22T22:23:52.644568] [DEBUG] [LOCAL ] NOC: Loaded 42698 existing records from primary storage. [2025-09-22T22:23:52.645543] [INFO ] [MAIN ] NOC: Loaded 42698 primary data records. [2025-09-22T22:23:52.766442] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:52.806969] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 16312 primary records. [2025-09-22T22:23:52.839897] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-22T22:23:52.980155] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-09-22T22:23:52.981156] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-22T22:23:52.983671] [INFO ] [MAIN ] Derivative Progress: 1312/2091 symbols completed. NOA took 1.1s. Estimated remaining: 5m 2s. Rate: 154.9 symbols/min [2025-09-22T22:23:52.984461] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:53.006999] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:53.010148] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 20036 primary records. [2025-09-22T22:23:53.010251] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-22T22:23:53.032350] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-09-22T22:23:53.033703] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-22T22:23:53.036394] [INFO ] [MAIN ] Derivative Progress: 1313/2091 symbols completed. NOAH took 1.0s. Estimated remaining: 5m 1s. Rate: 155.0 symbols/min [2025-09-22T22:23:53.037806] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:53.053144] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:53.054197] [INFO ] [MAIN ] NOC: Generated 1794 derivative records from 42698 primary records. [2025-09-22T22:23:53.054530] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-22T22:23:53.085188] [DEBUG] [LOCAL ] NOC: Derivative data saved (1794 records). [2025-09-22T22:23:53.085330] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-22T22:23:53.088246] [INFO ] [MAIN ] Derivative Progress: 1314/2091 symbols completed. NOC took 1.0s. Estimated remaining: 5m 1s. Rate: 155.1 symbols/min [2025-09-22T22:23:53.089750] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:53.107788] [DEBUG] [LOCAL ] NOG: Loaded 51153 existing records from primary storage. [2025-09-22T22:23:53.108135] [INFO ] [MAIN ] NOG: Loaded 51153 primary data records. [2025-09-22T22:23:53.468216] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-09-22T22:23:53.470502] [INFO ] [MAIN ] NOK: Loaded 53621 primary data records. [2025-09-22T22:23:53.493568] [DEBUG] [LOCAL ] NOMD: Loaded 41390 existing records from primary storage. [2025-09-22T22:23:53.510300] [INFO ] [MAIN ] NOMD: Loaded 41390 primary data records. [2025-09-22T22:23:54.191767] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:54.193738] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51153 primary records. [2025-09-22T22:23:54.194347] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-22T22:23:54.214479] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-09-22T22:23:54.214688] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-22T22:23:54.217351] [INFO ] [MAIN ] Derivative Progress: 1315/2091 symbols completed. NOG took 1.2s. Estimated remaining: 5m 1s. Rate: 154.9 symbols/min [2025-09-22T22:23:54.217793] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:54.235258] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:54.236261] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 41390 primary records. [2025-09-22T22:23:54.236677] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-22T22:23:54.267191] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:54.269929] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53621 primary records. [2025-09-22T22:23:54.270534] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-22T22:23:54.271459] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-09-22T22:23:54.272557] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-22T22:23:54.274793] [INFO ] [MAIN ] Derivative Progress: 1316/2091 symbols completed. NOMD took 1.2s. Estimated remaining: 5m 0s. Rate: 155.0 symbols/min [2025-09-22T22:23:54.285268] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:54.317523] [DEBUG] [LOCAL ] NOTE: Loaded 43132 existing records from primary storage. [2025-09-22T22:23:54.318512] [INFO ] [MAIN ] NOTE: Loaded 43132 primary data records. [2025-09-22T22:23:54.318922] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-09-22T22:23:54.324639] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-22T22:23:54.327515] [INFO ] [MAIN ] Derivative Progress: 1317/2091 symbols completed. NOK took 1.3s. Estimated remaining: 4m 59s. Rate: 155.1 symbols/min [2025-09-22T22:23:54.354902] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:54.659959] [DEBUG] [LOCAL ] NPCT: Loaded 16799 existing records from primary storage. [2025-09-22T22:23:54.675668] [INFO ] [MAIN ] NPCT: Loaded 16799 primary data records. [2025-09-22T22:23:54.698380] [DEBUG] [LOCAL ] NOV: Loaded 53184 existing records from primary storage. [2025-09-22T22:23:54.709775] [INFO ] [MAIN ] NOV: Loaded 53184 primary data records. [2025-09-22T22:23:55.325325] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:55.326201] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 43132 primary records. [2025-09-22T22:23:55.326531] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-22T22:23:55.345633] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-09-22T22:23:55.345944] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-22T22:23:55.348544] [INFO ] [MAIN ] Derivative Progress: 1318/2091 symbols completed. NOTE took 1.1s. Estimated remaining: 4m 59s. Rate: 154.9 symbols/min [2025-09-22T22:23:55.366531] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:55.367325] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 16799 primary records. [2025-09-22T22:23:55.367478] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-22T22:23:55.398358] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:55.399239] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53184 primary records. [2025-09-22T22:23:55.399619] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-09-22T22:23:55.399694] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-22T22:23:55.399803] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-22T22:23:55.402263] [INFO ] [MAIN ] Derivative Progress: 1319/2091 symbols completed. NPCT took 1.0s. Estimated remaining: 4m 59s. Rate: 155.0 symbols/min [2025-09-22T22:23:55.417958] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-09-22T22:23:55.418019] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-22T22:23:55.420879] [INFO ] [MAIN ] Derivative Progress: 1320/2091 symbols completed. NOV took 1.1s. Estimated remaining: 4m 58s. Rate: 155.1 symbols/min [2025-09-22T22:23:55.421964] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:55.422125] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:55.422196] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:55.433817] [DEBUG] [LOCAL ] NPK: Loaded 8089 existing records from primary storage. [2025-09-22T22:23:55.434001] [INFO ] [MAIN ] NPK: Loaded 8089 primary data records. [2025-09-22T22:23:55.532070] [DEBUG] [LOCAL ] NPO: Loaded 12809 existing records from primary storage. [2025-09-22T22:23:55.555194] [DEBUG] [LOCAL ] NPFD: Loaded 9764 existing records from primary storage. [2025-09-22T22:23:55.551625] [INFO ] [MAIN ] NPO: Loaded 12809 primary data records. [2025-09-22T22:23:55.555430] [INFO ] [MAIN ] NPFD: Loaded 9764 primary data records. [2025-09-22T22:23:56.439159] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:56.442366] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8089 primary records. [2025-09-22T22:23:56.442883] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-22T22:23:56.457495] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:56.458597] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 12809 primary records. [2025-09-22T22:23:56.465775] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-22T22:23:56.512040] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-09-22T22:23:56.513035] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:56.513857] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9764 primary records. [2025-09-22T22:23:56.515053] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-22T22:23:56.516632] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-22T22:23:56.516967] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-09-22T22:23:56.520178] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-22T22:23:56.519804] [INFO ] [MAIN ] Derivative Progress: 1321/2091 symbols completed. NPO took 1.1s. Estimated remaining: 4m 58s. Rate: 154.9 symbols/min [2025-09-22T22:23:56.523396] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:56.523901] [INFO ] [MAIN ] Derivative Progress: 1322/2091 symbols completed. NPK took 1.1s. Estimated remaining: 4m 58s. Rate: 155.0 symbols/min [2025-09-22T22:23:56.535970] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:56.543276] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-09-22T22:23:56.543563] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-22T22:23:56.546740] [INFO ] [MAIN ] Derivative Progress: 1323/2091 symbols completed. NPFD took 1.1s. Estimated remaining: 4m 57s. Rate: 155.1 symbols/min [2025-09-22T22:23:56.552512] [DEBUG] [LOCAL ] NPV: Loaded 4937 existing records from primary storage. [2025-09-22T22:23:56.552890] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:56.553014] [INFO ] [MAIN ] NPV: Loaded 4937 primary data records. [2025-09-22T22:23:56.681326] [DEBUG] [LOCAL ] NQP: Loaded 9278 existing records from primary storage. [2025-09-22T22:23:56.701738] [INFO ] [MAIN ] NQP: Loaded 9278 primary data records. [2025-09-22T22:23:57.131927] [DEBUG] [LOCAL ] NPWR: Loaded 43055 existing records from primary storage. [2025-09-22T22:23:57.148081] [INFO ] [MAIN ] NPWR: Loaded 43055 primary data records. [2025-09-22T22:23:57.897958] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:57.899967] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 4937 primary records. [2025-09-22T22:23:57.900339] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-22T22:23:57.928848] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-09-22T22:23:57.930913] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-22T22:23:57.934026] [INFO ] [MAIN ] Derivative Progress: 1324/2091 symbols completed. NPV took 1.4s. Estimated remaining: 4m 57s. Rate: 154.8 symbols/min [2025-09-22T22:23:57.934606] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:57.949602] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:57.950535] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9278 primary records. [2025-09-22T22:23:57.950941] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-22T22:23:57.974616] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-09-22T22:23:57.974841] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-22T22:23:57.977670] [INFO ] [MAIN ] Derivative Progress: 1325/2091 symbols completed. NQP took 1.4s. Estimated remaining: 4m 57s. Rate: 154.9 symbols/min [2025-09-22T22:23:57.991586] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:58.004072] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:58.005260] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 43055 primary records. [2025-09-22T22:23:58.005537] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-22T22:23:58.043036] [DEBUG] [LOCAL ] NREF: Loaded 7823 existing records from primary storage. [2025-09-22T22:23:58.044716] [INFO ] [MAIN ] NREF: Loaded 7823 primary data records. [2025-09-22T22:23:58.044602] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-09-22T22:23:58.044834] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-22T22:23:58.068977] [INFO ] [MAIN ] Derivative Progress: 1326/2091 symbols completed. NPWR took 1.5s. Estimated remaining: 4m 56s. Rate: 155.0 symbols/min [2025-09-22T22:23:58.070468] [DEBUG] [LOCAL ] NRDY: Loaded 33052 existing records from primary storage. [2025-09-22T22:23:58.088293] [INFO ] [MAIN ] NRDY: Loaded 33052 primary data records. [2025-09-22T22:23:58.088221] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:58.751159] [DEBUG] [LOCAL ] NRGV: Loaded 42806 existing records from primary storage. [2025-09-22T22:23:58.752272] [INFO ] [MAIN ] NRGV: Loaded 42806 primary data records. [2025-09-22T22:23:59.112042] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:59.113558] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7823 primary records. [2025-09-22T22:23:59.113751] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-22T22:23:59.115590] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:59.117720] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 33052 primary records. [2025-09-22T22:23:59.124746] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-22T22:23:59.148768] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-09-22T22:23:59.149289] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-22T22:23:59.151921] [INFO ] [MAIN ] Derivative Progress: 1327/2091 symbols completed. NREF took 1.2s. Estimated remaining: 4m 56s. Rate: 154.8 symbols/min [2025-09-22T22:23:59.153223] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:59.156937] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-09-22T22:23:59.157721] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-22T22:23:59.161533] [INFO ] [MAIN ] Derivative Progress: 1328/2091 symbols completed. NRDY took 1.2s. Estimated remaining: 4m 56s. Rate: 154.9 symbols/min [2025-09-22T22:23:59.162537] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:59.179043] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:23:59.182774] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 42806 primary records. [2025-09-22T22:23:59.182996] [DEBUG] [LOCAL ] NRP: Loaded 4088 existing records from primary storage. [2025-09-22T22:23:59.183229] [INFO ] [MAIN ] NRP: Loaded 4088 primary data records. [2025-09-22T22:23:59.188594] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-22T22:23:59.307589] [DEBUG] [LOCAL ] NRK: Loaded 19581 existing records from primary storage. [2025-09-22T22:23:59.316030] [INFO ] [MAIN ] NRK: Loaded 19581 primary data records. [2025-09-22T22:23:59.320357] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-09-22T22:23:59.347062] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-22T22:23:59.370617] [INFO ] [MAIN ] Derivative Progress: 1329/2091 symbols completed. NRGV took 1.3s. Estimated remaining: 4m 55s. Rate: 154.9 symbols/min [2025-09-22T22:23:59.443710] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:23:59.685343] [DEBUG] [LOCAL ] NRT: Loaded 4853 existing records from primary storage. [2025-09-22T22:23:59.713711] [INFO ] [MAIN ] NRT: Loaded 4853 primary data records. [2025-09-22T22:24:00.171094] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:00.172263] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4088 primary records. [2025-09-22T22:24:00.172504] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-22T22:24:00.209052] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-09-22T22:24:00.209407] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:00.209528] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-22T22:24:00.212152] [INFO ] [MAIN ] Derivative Progress: 1330/2091 symbols completed. NRP took 1.0s. Estimated remaining: 4m 55s. Rate: 154.8 symbols/min [2025-09-22T22:24:00.213213] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 19581 primary records. [2025-09-22T22:24:00.213695] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:00.213612] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-22T22:24:00.233780] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-09-22T22:24:00.235786] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-22T22:24:00.238524] [DEBUG] [LOCAL ] NRUC: Loaded 3101 existing records from primary storage. [2025-09-22T22:24:00.241460] [INFO ] [MAIN ] NRUC: Loaded 3101 primary data records. [2025-09-22T22:24:00.241370] [INFO ] [MAIN ] Derivative Progress: 1331/2091 symbols completed. NRK took 1.1s. Estimated remaining: 4m 54s. Rate: 154.9 symbols/min [2025-09-22T22:24:00.281972] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:00.281678] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:00.316438] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4853 primary records. [2025-09-22T22:24:00.330969] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-22T22:24:00.425719] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-09-22T22:24:00.439857] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-22T22:24:00.480537] [INFO ] [MAIN ] Derivative Progress: 1332/2091 symbols completed. NRT took 1.1s. Estimated remaining: 4m 54s. Rate: 155.0 symbols/min [2025-09-22T22:24:00.488087] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:00.654799] [DEBUG] [LOCAL ] NSA: Loaded 44842 existing records from primary storage. [2025-09-22T22:24:00.656172] [INFO ] [MAIN ] NSA: Loaded 44842 primary data records. [2025-09-22T22:24:00.975094] [DEBUG] [LOCAL ] NSP: Loaded 34883 existing records from primary storage. [2025-09-22T22:24:00.984235] [INFO ] [MAIN ] NSP: Loaded 34883 primary data records. [2025-09-22T22:24:01.144742] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:01.175418] [INFO ] [MAIN ] NRUC: Generated 1794 derivative records from 3101 primary records. [2025-09-22T22:24:01.211299] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-22T22:24:01.358231] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1794 records). [2025-09-22T22:24:01.358404] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-22T22:24:01.360933] [INFO ] [MAIN ] Derivative Progress: 1333/2091 symbols completed. NRUC took 1.1s. Estimated remaining: 4m 54s. Rate: 154.8 symbols/min [2025-09-22T22:24:01.380953] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:01.381763] [INFO ] [MAIN ] NSA: Generated 1794 derivative records from 44842 primary records. [2025-09-22T22:24:01.381914] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-22T22:24:01.400225] [DEBUG] [LOCAL ] NSA: Derivative data saved (1794 records). [2025-09-22T22:24:01.400515] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-22T22:24:01.403326] [INFO ] [MAIN ] Derivative Progress: 1334/2091 symbols completed. NSA took 1.1s. Estimated remaining: 4m 53s. Rate: 154.9 symbols/min [2025-09-22T22:24:01.418376] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:01.419040] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 34883 primary records. [2025-09-22T22:24:01.419104] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-22T22:24:01.435303] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-09-22T22:24:01.435368] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-22T22:24:01.438232] [INFO ] [MAIN ] Derivative Progress: 1335/2091 symbols completed. NSP took 1.0s. Estimated remaining: 4m 53s. Rate: 155.0 symbols/min [2025-09-22T22:24:01.438915] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:01.439149] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:01.439377] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:01.462918] [DEBUG] [LOCAL ] NTB: Loaded 20720 existing records from primary storage. [2025-09-22T22:24:01.463046] [INFO ] [MAIN ] NTB: Loaded 20720 primary data records. [2025-09-22T22:24:01.658713] [DEBUG] [LOCAL ] NTST: Loaded 43435 existing records from primary storage. [2025-09-22T22:24:01.702426] [INFO ] [MAIN ] NTST: Loaded 43435 primary data records. [2025-09-22T22:24:01.812925] [DEBUG] [LOCAL ] NTR: Loaded 52586 existing records from primary storage. [2025-09-22T22:24:01.835040] [INFO ] [MAIN ] NTR: Loaded 52586 primary data records. [2025-09-22T22:24:02.528118] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:02.529204] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20720 primary records. [2025-09-22T22:24:02.529513] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-22T22:24:02.548426] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-09-22T22:24:02.550018] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-22T22:24:02.552748] [INFO ] [MAIN ] Derivative Progress: 1336/2091 symbols completed. NTB took 1.1s. Estimated remaining: 4m 53s. Rate: 154.8 symbols/min [2025-09-22T22:24:02.554125] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:02.568484] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:02.569582] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 43435 primary records. [2025-09-22T22:24:02.569930] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-22T22:24:02.590251] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-09-22T22:24:02.602687] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-22T22:24:02.606195] [INFO ] [MAIN ] Derivative Progress: 1337/2091 symbols completed. NTST took 1.2s. Estimated remaining: 4m 52s. Rate: 154.9 symbols/min [2025-09-22T22:24:02.603195] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:02.606666] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:02.607520] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52586 primary records. [2025-09-22T22:24:02.608153] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-22T22:24:02.625455] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-09-22T22:24:02.625587] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-22T22:24:02.627985] [INFO ] [MAIN ] Derivative Progress: 1338/2091 symbols completed. NTR took 1.2s. Estimated remaining: 4m 51s. Rate: 155.0 symbols/min [2025-09-22T22:24:02.628393] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:02.675172] [DEBUG] [LOCAL ] NUS: Loaded 36414 existing records from primary storage. [2025-09-22T22:24:02.675373] [INFO ] [MAIN ] NUS: Loaded 36414 primary data records. [2025-09-22T22:24:02.791415] [DEBUG] [LOCAL ] NUV: Loaded 23066 existing records from primary storage. [2025-09-22T22:24:02.802725] [INFO ] [MAIN ] NUV: Loaded 23066 primary data records. [2025-09-22T22:24:02.825503] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-22T22:24:02.861881] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-09-22T22:24:03.638328] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:03.639483] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36414 primary records. [2025-09-22T22:24:03.639709] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-22T22:24:03.686129] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:03.686422] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:03.687675] [INFO ] [MAIN ] NU: Generated 1794 derivative records from 53746 primary records. [2025-09-22T22:24:03.688671] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-09-22T22:24:03.689275] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23066 primary records. [2025-09-22T22:24:03.689577] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-22T22:24:03.689462] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-22T22:24:03.691538] [INFO ] [MAIN ] Derivative Progress: 1339/2091 symbols completed. NUS took 1.1s. Estimated remaining: 4m 51s. Rate: 154.8 symbols/min [2025-09-22T22:24:03.689518] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-22T22:24:03.693163] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:03.725437] [DEBUG] [LOCAL ] NU: Derivative data saved (1794 records). [2025-09-22T22:24:03.725549] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-22T22:24:03.728404] [INFO ] [MAIN ] Derivative Progress: 1340/2091 symbols completed. NU took 1.2s. Estimated remaining: 4m 51s. Rate: 154.9 symbols/min [2025-09-22T22:24:03.725314] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-09-22T22:24:03.728808] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:03.728956] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-22T22:24:03.735687] [INFO ] [MAIN ] Derivative Progress: 1341/2091 symbols completed. NUV took 1.1s. Estimated remaining: 4m 50s. Rate: 155.0 symbols/min [2025-09-22T22:24:03.736437] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:03.761274] [DEBUG] [LOCAL ] NUW: Loaded 7413 existing records from primary storage. [2025-09-22T22:24:03.761405] [INFO ] [MAIN ] NUW: Loaded 7413 primary data records. [2025-09-22T22:24:03.888085] [DEBUG] [LOCAL ] NUVB: Loaded 51209 existing records from primary storage. [2025-09-22T22:24:03.899014] [INFO ] [MAIN ] NUVB: Loaded 51209 primary data records. [2025-09-22T22:24:03.975764] [DEBUG] [LOCAL ] NVG: Loaded 27227 existing records from primary storage. [2025-09-22T22:24:04.017359] [INFO ] [MAIN ] NVG: Loaded 27227 primary data records. [2025-09-22T22:24:04.759996] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:04.761395] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 7413 primary records. [2025-09-22T22:24:04.762003] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-22T22:24:04.784672] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-09-22T22:24:04.797149] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-22T22:24:04.799579] [INFO ] [MAIN ] Derivative Progress: 1342/2091 symbols completed. NUW took 1.1s. Estimated remaining: 4m 50s. Rate: 154.8 symbols/min [2025-09-22T22:24:04.799953] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:24:04.802401] [INFO ] [MAIN ] NUVB: Generated 1793 derivative records from 51209 primary records. [2025-09-22T22:24:04.802603] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:04.803564] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-22T22:24:04.829915] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:04.831126] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27227 primary records. [2025-09-22T22:24:04.831440] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-22T22:24:04.846939] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1793 records). [2025-09-22T22:24:04.847300] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-22T22:24:04.850634] [INFO ] [MAIN ] Derivative Progress: 1343/2091 symbols completed. NUVB took 1.2s. Estimated remaining: 4m 50s. Rate: 154.9 symbols/min [2025-09-22T22:24:04.851184] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:04.863569] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-09-22T22:24:04.863804] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-22T22:24:04.866066] [INFO ] [MAIN ] Derivative Progress: 1344/2091 symbols completed. NVG took 1.1s. Estimated remaining: 4m 49s. Rate: 155.0 symbols/min [2025-09-22T22:24:04.866523] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:04.887101] [DEBUG] [LOCAL ] NVGS: Loaded 31141 existing records from primary storage. [2025-09-22T22:24:04.887396] [INFO ] [MAIN ] NVGS: Loaded 31141 primary data records. [2025-09-22T22:24:05.011319] [DEBUG] [LOCAL ] NVR: Loaded 19257 existing records from primary storage. [2025-09-22T22:24:05.011563] [INFO ] [MAIN ] NVR: Loaded 19257 primary data records. [2025-09-22T22:24:05.316761] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-22T22:24:05.325787] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-09-22T22:24:05.880857] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:05.881894] [INFO ] [MAIN ] NVGS: Generated 1794 derivative records from 31141 primary records. [2025-09-22T22:24:05.881995] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-22T22:24:05.900276] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1794 records). [2025-09-22T22:24:05.900758] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-22T22:24:05.903103] [INFO ] [MAIN ] Derivative Progress: 1345/2091 symbols completed. NVGS took 1.1s. Estimated remaining: 4m 49s. Rate: 154.8 symbols/min [2025-09-22T22:24:05.903802] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:05.921871] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:24:05.922796] [INFO ] [MAIN ] NVR: Generated 1793 derivative records from 19257 primary records. [2025-09-22T22:24:05.922936] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-22T22:24:05.966308] [DEBUG] [LOCAL ] NVR: Derivative data saved (1793 records). [2025-09-22T22:24:05.965727] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:05.966551] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-22T22:24:05.967482] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-09-22T22:24:05.970253] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-22T22:24:05.970087] [INFO ] [MAIN ] Derivative Progress: 1346/2091 symbols completed. NVR took 1.1s. Estimated remaining: 4m 48s. Rate: 154.9 symbols/min [2025-09-22T22:24:05.972384] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:05.997567] [DEBUG] [LOCAL ] NVRI: Loaded 38810 existing records from primary storage. [2025-09-22T22:24:05.998363] [INFO ] [MAIN ] NVRI: Loaded 38810 primary data records. [2025-09-22T22:24:06.073346] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-09-22T22:24:06.085030] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-22T22:24:06.110523] [INFO ] [MAIN ] Derivative Progress: 1347/2091 symbols completed. NVO took 1.3s. Estimated remaining: 4m 48s. Rate: 155.0 symbols/min [2025-09-22T22:24:06.121917] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:06.342415] [DEBUG] [LOCAL ] NVS: Loaded 51691 existing records from primary storage. [2025-09-22T22:24:06.342902] [INFO ] [MAIN ] NVS: Loaded 51691 primary data records. [2025-09-22T22:24:06.726585] [DEBUG] [LOCAL ] NVST: Loaded 51671 existing records from primary storage. [2025-09-22T22:24:06.727132] [INFO ] [MAIN ] NVST: Loaded 51671 primary data records. [2025-09-22T22:24:06.900776] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:06.947557] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 38810 primary records. [2025-09-22T22:24:06.953148] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-22T22:24:07.093367] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-09-22T22:24:07.095674] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-22T22:24:07.100162] [INFO ] [MAIN ] Derivative Progress: 1348/2091 symbols completed. NVRI took 1.2s. Estimated remaining: 4m 48s. Rate: 154.8 symbols/min [2025-09-22T22:24:07.114982] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:07.115875] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51691 primary records. [2025-09-22T22:24:07.115960] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-22T22:24:07.134897] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-09-22T22:24:07.135022] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-22T22:24:07.137887] [INFO ] [MAIN ] Derivative Progress: 1349/2091 symbols completed. NVS took 1.2s. Estimated remaining: 4m 47s. Rate: 154.9 symbols/min [2025-09-22T22:24:07.153372] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:07.154041] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51671 primary records. [2025-09-22T22:24:07.154104] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-22T22:24:07.170071] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-09-22T22:24:07.170134] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-22T22:24:07.172729] [INFO ] [MAIN ] Derivative Progress: 1350/2091 symbols completed. NVST took 1.1s. Estimated remaining: 4m 47s. Rate: 155.0 symbols/min [2025-09-22T22:24:07.173695] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:07.173484] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:07.173994] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:07.203887] [DEBUG] [LOCAL ] NWN: Loaded 26838 existing records from primary storage. [2025-09-22T22:24:07.204097] [INFO ] [MAIN ] NWN: Loaded 26838 primary data records. [2025-09-22T22:24:07.481414] [DEBUG] [LOCAL ] NVT: Loaded 51608 existing records from primary storage. [2025-09-22T22:24:07.570697] [INFO ] [MAIN ] NVT: Loaded 51608 primary data records. [2025-09-22T22:24:07.572388] [DEBUG] [LOCAL ] NWG: Loaded 51636 existing records from primary storage. [2025-09-22T22:24:07.586159] [INFO ] [MAIN ] NWG: Loaded 51636 primary data records. [2025-09-22T22:24:08.248758] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:08.250705] [INFO ] [MAIN ] NWN: Generated 1794 derivative records from 26838 primary records. [2025-09-22T22:24:08.250807] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-22T22:24:08.276779] [DEBUG] [LOCAL ] NWN: Derivative data saved (1794 records). [2025-09-22T22:24:08.290808] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-22T22:24:08.293315] [INFO ] [MAIN ] Derivative Progress: 1351/2091 symbols completed. NWN took 1.1s. Estimated remaining: 4m 47s. Rate: 154.8 symbols/min [2025-09-22T22:24:08.294051] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:08.307975] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51636 primary records. [2025-09-22T22:24:08.294170] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:08.308122] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-22T22:24:08.309502] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:08.310505] [INFO ] [MAIN ] NVT: Generated 1794 derivative records from 51608 primary records. [2025-09-22T22:24:08.322680] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-22T22:24:08.343440] [DEBUG] [LOCAL ] NVT: Derivative data saved (1794 records). [2025-09-22T22:24:08.344147] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-22T22:24:08.347463] [INFO ] [MAIN ] Derivative Progress: 1352/2091 symbols completed. NVT took 1.2s. Estimated remaining: 4m 46s. Rate: 154.9 symbols/min [2025-09-22T22:24:08.348660] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:08.350104] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-09-22T22:24:08.350347] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-22T22:24:08.353447] [INFO ] [MAIN ] Derivative Progress: 1353/2091 symbols completed. NWG took 1.2s. Estimated remaining: 4m 46s. Rate: 155.0 symbols/min [2025-09-22T22:24:08.363168] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:08.368551] [DEBUG] [LOCAL ] NXC: Loaded 4193 existing records from primary storage. [2025-09-22T22:24:08.368819] [INFO ] [MAIN ] NXC: Loaded 4193 primary data records. [2025-09-22T22:24:08.500500] [DEBUG] [LOCAL ] NX: Loaded 33418 existing records from primary storage. [2025-09-22T22:24:08.500833] [INFO ] [MAIN ] NX: Loaded 33418 primary data records. [2025-09-22T22:24:08.548020] [DEBUG] [LOCAL ] NXDT: Loaded 16470 existing records from primary storage. [2025-09-22T22:24:08.583712] [INFO ] [MAIN ] NXDT: Loaded 16470 primary data records. [2025-09-22T22:24:09.426912] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:09.427907] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4193 primary records. [2025-09-22T22:24:09.430392] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-22T22:24:09.448031] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-09-22T22:24:09.448166] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-22T22:24:09.450216] [INFO ] [MAIN ] Derivative Progress: 1354/2091 symbols completed. NXC took 1.1s. Estimated remaining: 4m 46s. Rate: 154.8 symbols/min [2025-09-22T22:24:09.450832] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:09.483842] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:09.484250] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:09.486180] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33418 primary records. [2025-09-22T22:24:09.486262] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-22T22:24:09.486702] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 16470 primary records. [2025-09-22T22:24:09.486783] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-22T22:24:09.516589] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-09-22T22:24:09.517265] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-22T22:24:09.519761] [INFO ] [MAIN ] Derivative Progress: 1355/2091 symbols completed. NX took 1.2s. Estimated remaining: 4m 45s. Rate: 154.9 symbols/min [2025-09-22T22:24:09.521412] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:09.537533] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-09-22T22:24:09.537839] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-22T22:24:09.540499] [INFO ] [MAIN ] Derivative Progress: 1356/2091 symbols completed. NXDT took 1.2s. Estimated remaining: 4m 44s. Rate: 155.0 symbols/min [2025-09-22T22:24:09.540816] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:09.560862] [DEBUG] [LOCAL ] NXE: Loaded 52981 existing records from primary storage. [2025-09-22T22:24:09.565847] [DEBUG] [LOCAL ] NXG: Loaded 10497 existing records from primary storage. [2025-09-22T22:24:09.569587] [INFO ] [MAIN ] NXE: Loaded 52981 primary data records. [2025-09-22T22:24:09.569811] [INFO ] [MAIN ] NXG: Loaded 10497 primary data records. [2025-09-22T22:24:09.758853] [DEBUG] [LOCAL ] NXJ: Loaded 14967 existing records from primary storage. [2025-09-22T22:24:09.780784] [INFO ] [MAIN ] NXJ: Loaded 14967 primary data records. [2025-09-22T22:24:10.581503] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:10.583630] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 52981 primary records. [2025-09-22T22:24:10.583912] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-22T22:24:10.611016] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:10.612778] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10497 primary records. [2025-09-22T22:24:10.613739] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-22T22:24:10.627839] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-09-22T22:24:10.628160] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-22T22:24:10.630405] [INFO ] [MAIN ] Derivative Progress: 1357/2091 symbols completed. NXE took 1.2s. Estimated remaining: 4m 44s. Rate: 154.8 symbols/min [2025-09-22T22:24:10.646084] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:10.647062] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:10.648091] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14967 primary records. [2025-09-22T22:24:10.648484] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-22T22:24:10.658377] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-09-22T22:24:10.658527] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-22T22:24:10.661988] [INFO ] [MAIN ] Derivative Progress: 1358/2091 symbols completed. NXG took 1.1s. Estimated remaining: 4m 44s. Rate: 154.9 symbols/min [2025-09-22T22:24:10.666399] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:10.669543] [DEBUG] [LOCAL ] NXN: Loaded 2312 existing records from primary storage. [2025-09-22T22:24:10.670254] [INFO ] [MAIN ] NXN: Loaded 2312 primary data records. [2025-09-22T22:24:10.711307] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-09-22T22:24:10.718508] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-22T22:24:10.733353] [INFO ] [MAIN ] Derivative Progress: 1359/2091 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 43s. Rate: 155.0 symbols/min [2025-09-22T22:24:10.763143] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:10.795356] [DEBUG] [LOCAL ] NXP: Loaded 12323 existing records from primary storage. [2025-09-22T22:24:10.795844] [INFO ] [MAIN ] NXP: Loaded 12323 primary data records. [2025-09-22T22:24:11.169996] [DEBUG] [LOCAL ] NXRT: Loaded 18963 existing records from primary storage. [2025-09-22T22:24:11.172346] [INFO ] [MAIN ] NXRT: Loaded 18963 primary data records. [2025-09-22T22:24:11.659691] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:11.660913] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2312 primary records. [2025-09-22T22:24:11.673293] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-22T22:24:11.674928] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:11.676396] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12323 primary records. [2025-09-22T22:24:11.676783] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-22T22:24:11.705270] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-09-22T22:24:11.706387] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-22T22:24:11.707295] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-09-22T22:24:11.707438] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-22T22:24:11.710021] [INFO ] [MAIN ] Derivative Progress: 1360/2091 symbols completed. NXP took 1.0s. Estimated remaining: 4m 43s. Rate: 154.8 symbols/min [2025-09-22T22:24:11.712423] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:11.712569] [INFO ] [MAIN ] Derivative Progress: 1361/2091 symbols completed. NXN took 1.1s. Estimated remaining: 4m 43s. Rate: 155.0 symbols/min [2025-09-22T22:24:11.713136] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:11.730086] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:11.730750] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 18963 primary records. [2025-09-22T22:24:11.730814] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-22T22:24:11.747042] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-09-22T22:24:11.747283] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-22T22:24:11.749966] [INFO ] [MAIN ] Derivative Progress: 1362/2091 symbols completed. NXRT took 1.0s. Estimated remaining: 4m 42s. Rate: 155.1 symbols/min [2025-09-22T22:24:11.750426] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:11.787380] [DEBUG] [LOCAL ] NZF: Loaded 29077 existing records from primary storage. [2025-09-22T22:24:11.787625] [INFO ] [MAIN ] NZF: Loaded 29077 primary data records. [2025-09-22T22:24:11.923371] [DEBUG] [LOCAL ] NYT: Loaded 49995 existing records from primary storage. [2025-09-22T22:24:11.934063] [INFO ] [MAIN ] NYT: Loaded 49995 primary data records. [2025-09-22T22:24:12.247809] [DEBUG] [LOCAL ] OBDC: Loaded 51650 existing records from primary storage. [2025-09-22T22:24:12.259360] [INFO ] [MAIN ] OBDC: Loaded 51650 primary data records. [2025-09-22T22:24:12.852865] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:12.854813] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 29077 primary records. [2025-09-22T22:24:12.854979] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-22T22:24:12.877240] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-09-22T22:24:12.877721] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-22T22:24:12.892255] [INFO ] [MAIN ] Derivative Progress: 1363/2091 symbols completed. NZF took 1.2s. Estimated remaining: 4m 42s. Rate: 154.8 symbols/min [2025-09-22T22:24:12.893353] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:12.894446] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 49995 primary records. [2025-09-22T22:24:12.894530] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-22T22:24:12.924722] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:12.926928] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51650 primary records. [2025-09-22T22:24:12.926176] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-09-22T22:24:12.927066] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-22T22:24:12.927149] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-22T22:24:12.929464] [INFO ] [MAIN ] Derivative Progress: 1364/2091 symbols completed. NYT took 1.2s. Estimated remaining: 4m 42s. Rate: 154.9 symbols/min [2025-09-22T22:24:12.945780] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-09-22T22:24:12.945847] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-22T22:24:12.948764] [INFO ] [MAIN ] Derivative Progress: 1365/2091 symbols completed. OBDC took 1.2s. Estimated remaining: 4m 41s. Rate: 155.1 symbols/min [2025-09-22T22:24:12.949492] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:12.949420] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:12.949595] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:12.961581] [DEBUG] [LOCAL ] OCFT: Loaded 8957 existing records from primary storage. [2025-09-22T22:24:12.961692] [INFO ] [MAIN ] OCFT: Loaded 8957 primary data records. [2025-09-22T22:24:13.071708] [DEBUG] [LOCAL ] OBK: Loaded 16315 existing records from primary storage. [2025-09-22T22:24:13.075151] [INFO ] [MAIN ] OBK: Loaded 16315 primary data records. [2025-09-22T22:24:13.408979] [DEBUG] [LOCAL ] OC: Loaded 44772 existing records from primary storage. [2025-09-22T22:24:13.449059] [INFO ] [MAIN ] OC: Loaded 44772 primary data records. [2025-09-22T22:24:13.994388] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:13.998110] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 8957 primary records. [2025-09-22T22:24:13.998822] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-22T22:24:14.028815] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:14.030890] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-09-22T22:24:14.031718] [INFO ] [MAIN ] OBK: Generated 1794 derivative records from 16315 primary records. [2025-09-22T22:24:14.031989] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-22T22:24:14.031788] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-22T22:24:14.035322] [INFO ] [MAIN ] Derivative Progress: 1366/2091 symbols completed. OCFT took 1.1s. Estimated remaining: 4m 41s. Rate: 154.8 symbols/min [2025-09-22T22:24:14.043269] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:14.052066] [DEBUG] [LOCAL ] OBK: Derivative data saved (1794 records). [2025-09-22T22:24:14.052553] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-22T22:24:14.055381] [INFO ] [MAIN ] Derivative Progress: 1367/2091 symbols completed. OBK took 1.1s. Estimated remaining: 4m 40s. Rate: 155.0 symbols/min [2025-09-22T22:24:14.056036] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:14.080471] [DEBUG] [LOCAL ] ODC: Loaded 8551 existing records from primary storage. [2025-09-22T22:24:14.080704] [INFO ] [MAIN ] ODC: Loaded 8551 primary data records. [2025-09-22T22:24:14.080079] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:14.104136] [INFO ] [MAIN ] OC: Generated 1794 derivative records from 44772 primary records. [2025-09-22T22:24:14.109444] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-22T22:24:14.233686] [DEBUG] [LOCAL ] ODV: Loaded 25269 existing records from primary storage. [2025-09-22T22:24:14.250399] [INFO ] [MAIN ] ODV: Loaded 25269 primary data records. [2025-09-22T22:24:14.250846] [DEBUG] [LOCAL ] OC: Derivative data saved (1794 records). [2025-09-22T22:24:14.272501] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-22T22:24:14.307119] [INFO ] [MAIN ] Derivative Progress: 1368/2091 symbols completed. OC took 1.4s. Estimated remaining: 4m 40s. Rate: 155.0 symbols/min [2025-09-22T22:24:14.365885] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:14.812329] [DEBUG] [LOCAL ] OEC: Loaded 37238 existing records from primary storage. [2025-09-22T22:24:14.815070] [INFO ] [MAIN ] OEC: Loaded 37238 primary data records. [2025-09-22T22:24:15.151893] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:15.155244] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8551 primary records. [2025-09-22T22:24:15.156039] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-22T22:24:15.177970] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:15.183860] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 25269 primary records. [2025-09-22T22:24:15.187829] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-22T22:24:15.187508] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-09-22T22:24:15.190318] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-22T22:24:15.192736] [INFO ] [MAIN ] Derivative Progress: 1369/2091 symbols completed. ODC took 1.2s. Estimated remaining: 4m 40s. Rate: 154.8 symbols/min [2025-09-22T22:24:15.204225] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:15.211362] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-09-22T22:24:15.211560] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-22T22:24:15.214110] [INFO ] [MAIN ] Derivative Progress: 1370/2091 symbols completed. ODV took 1.2s. Estimated remaining: 4m 39s. Rate: 155.0 symbols/min [2025-09-22T22:24:15.214505] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:15.237376] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:15.238225] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 37238 primary records. [2025-09-22T22:24:15.238383] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-22T22:24:15.247601] [DEBUG] [LOCAL ] OFG: Loaded 22253 existing records from primary storage. [2025-09-22T22:24:15.259069] [INFO ] [MAIN ] OFG: Loaded 22253 primary data records. [2025-09-22T22:24:15.399914] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-09-22T22:24:15.427310] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-22T22:24:15.454789] [INFO ] [MAIN ] Derivative Progress: 1371/2091 symbols completed. OEC took 1.1s. Estimated remaining: 4m 39s. Rate: 155.0 symbols/min [2025-09-22T22:24:15.473982] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:15.589309] [DEBUG] [LOCAL ] OGE: Loaded 46509 existing records from primary storage. [2025-09-22T22:24:15.598106] [INFO ] [MAIN ] OGE: Loaded 46509 primary data records. [2025-09-22T22:24:15.946004] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:15.947694] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 22253 primary records. [2025-09-22T22:24:15.947814] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-22T22:24:15.971956] [DEBUG] [LOCAL ] OGN: Loaded 53122 existing records from primary storage. [2025-09-22T22:24:15.978791] [INFO ] [MAIN ] OGN: Loaded 53122 primary data records. [2025-09-22T22:24:16.025381] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-09-22T22:24:16.051711] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-22T22:24:16.060527] [INFO ] [MAIN ] Derivative Progress: 1372/2091 symbols completed. OFG took 0.9s. Estimated remaining: 4m 38s. Rate: 154.9 symbols/min [2025-09-22T22:24:16.066265] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:16.300143] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:16.300960] [INFO ] [MAIN ] OGE: Generated 1794 derivative records from 46509 primary records. [2025-09-22T22:24:16.301120] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-22T22:24:16.329144] [DEBUG] [LOCAL ] OGE: Derivative data saved (1794 records). [2025-09-22T22:24:16.329430] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-22T22:24:16.332277] [INFO ] [MAIN ] Derivative Progress: 1373/2091 symbols completed. OGE took 1.1s. Estimated remaining: 4m 38s. Rate: 155.0 symbols/min [2025-09-22T22:24:16.332734] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:16.345953] [DEBUG] [LOCAL ] OGS: Loaded 33911 existing records from primary storage. [2025-09-22T22:24:16.346387] [INFO ] [MAIN ] OGS: Loaded 33911 primary data records. [2025-09-22T22:24:16.734798] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:16.736346] [INFO ] [MAIN ] OGN: Generated 1794 derivative records from 53122 primary records. [2025-09-22T22:24:16.736415] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-22T22:24:16.771623] [DEBUG] [LOCAL ] OGN: Derivative data saved (1794 records). [2025-09-22T22:24:16.772905] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-22T22:24:16.772789] [DEBUG] [LOCAL ] OHI: Loaded 52117 existing records from primary storage. [2025-09-22T22:24:16.775429] [INFO ] [MAIN ] Derivative Progress: 1374/2091 symbols completed. OGN took 1.3s. Estimated remaining: 4m 38s. Rate: 155.0 symbols/min [2025-09-22T22:24:16.773156] [INFO ] [MAIN ] OHI: Loaded 52117 primary data records. [2025-09-22T22:24:16.776682] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:17.118054] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:17.118858] [INFO ] [MAIN ] OGS: Generated 1794 derivative records from 33911 primary records. [2025-09-22T22:24:17.119093] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-22T22:24:17.154205] [DEBUG] [LOCAL ] OGS: Derivative data saved (1794 records). [2025-09-22T22:24:17.154397] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-22T22:24:17.156864] [INFO ] [MAIN ] Derivative Progress: 1375/2091 symbols completed. OGS took 1.1s. Estimated remaining: 4m 37s. Rate: 155.0 symbols/min [2025-09-22T22:24:17.158022] [DEBUG] [LOCAL ] OI: Loaded 47398 existing records from primary storage. [2025-09-22T22:24:17.159471] [INFO ] [MAIN ] OI: Loaded 47398 primary data records. [2025-09-22T22:24:17.159732] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:17.300763] [DEBUG] [LOCAL ] OIA: Loaded 13892 existing records from primary storage. [2025-09-22T22:24:17.307684] [INFO ] [MAIN ] OIA: Loaded 13892 primary data records. [2025-09-22T22:24:17.447391] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:17.588003] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 52117 primary records. [2025-09-22T22:24:17.599563] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-22T22:24:17.832264] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-09-22T22:24:17.832405] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-22T22:24:17.834612] [INFO ] [MAIN ] Derivative Progress: 1376/2091 symbols completed. OHI took 1.5s. Estimated remaining: 4m 37s. Rate: 154.9 symbols/min [2025-09-22T22:24:17.835110] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:17.863605] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:17.866010] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47398 primary records. [2025-09-22T22:24:17.875701] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-22T22:24:17.889769] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:17.901462] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13892 primary records. [2025-09-22T22:24:17.905981] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-09-22T22:24:17.903534] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-22T22:24:17.906118] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-22T22:24:17.909183] [INFO ] [MAIN ] Derivative Progress: 1377/2091 symbols completed. OI took 1.1s. Estimated remaining: 4m 36s. Rate: 155.0 symbols/min [2025-09-22T22:24:17.910353] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:17.934897] [DEBUG] [LOCAL ] OII: Loaded 43007 existing records from primary storage. [2025-09-22T22:24:17.935311] [INFO ] [MAIN ] OII: Loaded 43007 primary data records. [2025-09-22T22:24:18.026045] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-09-22T22:24:18.041639] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-22T22:24:18.048470] [INFO ] [MAIN ] Derivative Progress: 1378/2091 symbols completed. OIA took 0.9s. Estimated remaining: 4m 36s. Rate: 155.0 symbols/min [2025-09-22T22:24:18.271243] [DEBUG] [LOCAL ] OIS: Loaded 40688 existing records from primary storage. [2025-09-22T22:24:18.271453] [INFO ] [MAIN ] OIS: Loaded 40688 primary data records. [2025-09-22T22:24:18.596152] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:18.596966] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 43007 primary records. [2025-09-22T22:24:18.597075] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-22T22:24:18.615162] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-09-22T22:24:18.615327] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-22T22:24:18.617567] [INFO ] [MAIN ] Derivative Progress: 1379/2091 symbols completed. OII took 0.8s. Estimated remaining: 4m 36s. Rate: 155.0 symbols/min [2025-09-22T22:24:18.632386] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:18.632946] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 40688 primary records. [2025-09-22T22:24:18.633008] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-22T22:24:18.647730] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-09-22T22:24:18.647790] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-22T22:24:18.649851] [INFO ] [MAIN ] Derivative Progress: 1380/2091 symbols completed. OIS took 0.7s. Estimated remaining: 4m 35s. Rate: 155.1 symbols/min [2025-09-22T22:24:18.650544] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:18.650783] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:18.651415] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:18.757887] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-22T22:24:18.757795] [DEBUG] [LOCAL ] OKLO: Loaded 53819 existing records from primary storage. [2025-09-22T22:24:18.759166] [INFO ] [MAIN ] OKLO: Loaded 53819 primary data records. [2025-09-22T22:24:18.759240] [INFO ] [MAIN ] OKE: Loaded 53536 primary data records. [2025-09-22T22:24:18.798487] [DEBUG] [LOCAL ] OLN: Loaded 51738 existing records from primary storage. [2025-09-22T22:24:18.815926] [INFO ] [MAIN ] OLN: Loaded 51738 primary data records. [2025-09-22T22:24:19.731571] [DEBUG] [MAIN ] OKLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:19.732599] [INFO ] [MAIN ] OKLO: Generated 1794 derivative records from 53819 primary records. [2025-09-22T22:24:19.732815] [DEBUG] [LOCAL ] OKLO: Saving derivative data. [2025-09-22T22:24:19.746523] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:19.754710] [INFO ] [MAIN ] OKE: Generated 1794 derivative records from 53536 primary records. [2025-09-22T22:24:19.754911] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-22T22:24:19.773959] [DEBUG] [LOCAL ] OKLO: Derivative data saved (1794 records). [2025-09-22T22:24:19.774159] [INFO ] [MAIN ] OKLO: Successfully saved derivative data. [2025-09-22T22:24:19.787129] [INFO ] [MAIN ] Derivative Progress: 1381/2091 symbols completed. OKLO took 1.1s. Estimated remaining: 4m 35s. Rate: 154.9 symbols/min [2025-09-22T22:24:19.793100] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:19.794997] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:19.796189] [INFO ] [MAIN ] OLN: Generated 1794 derivative records from 51738 primary records. [2025-09-22T22:24:19.796584] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-22T22:24:19.807789] [DEBUG] [LOCAL ] OKE: Derivative data saved (1794 records). [2025-09-22T22:24:19.809808] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-22T22:24:19.815182] [INFO ] [MAIN ] Derivative Progress: 1382/2091 symbols completed. OKE took 1.2s. Estimated remaining: 4m 35s. Rate: 155.0 symbols/min [2025-09-22T22:24:19.815780] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:19.821246] [DEBUG] [LOCAL ] OLP: Loaded 9647 existing records from primary storage. [2025-09-22T22:24:19.821717] [INFO ] [MAIN ] OLP: Loaded 9647 primary data records. [2025-09-22T22:24:19.930176] [DEBUG] [LOCAL ] OLN: Derivative data saved (1794 records). [2025-09-22T22:24:19.946126] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-22T22:24:19.959015] [INFO ] [MAIN ] Derivative Progress: 1383/2091 symbols completed. OLN took 1.3s. Estimated remaining: 4m 34s. Rate: 155.0 symbols/min [2025-09-22T22:24:19.972097] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:20.181777] [DEBUG] [LOCAL ] OMC: Loaded 53293 existing records from primary storage. [2025-09-22T22:24:20.187467] [INFO ] [MAIN ] OMC: Loaded 53293 primary data records. [2025-09-22T22:24:20.187300] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:24:20.188342] [INFO ] [MAIN ] OLP: Generated 1793 derivative records from 9647 primary records. [2025-09-22T22:24:20.210876] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-22T22:24:20.344277] [DEBUG] [LOCAL ] OMF: Loaded 46269 existing records from primary storage. [2025-09-22T22:24:20.349529] [INFO ] [MAIN ] OMF: Loaded 46269 primary data records. [2025-09-22T22:24:20.333070] [DEBUG] [LOCAL ] OLP: Derivative data saved (1793 records). [2025-09-22T22:24:20.373674] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-22T22:24:20.408300] [INFO ] [MAIN ] Derivative Progress: 1384/2091 symbols completed. OLP took 0.6s. Estimated remaining: 4m 34s. Rate: 155.0 symbols/min [2025-09-22T22:24:20.555150] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:20.922488] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:20.923777] [INFO ] [MAIN ] OMC: Generated 1794 derivative records from 53293 primary records. [2025-09-22T22:24:20.921972] [DEBUG] [LOCAL ] OMI: Loaded 45856 existing records from primary storage. [2025-09-22T22:24:20.924036] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-22T22:24:20.924325] [INFO ] [MAIN ] OMI: Loaded 45856 primary data records. [2025-09-22T22:24:21.063361] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:21.070494] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46269 primary records. [2025-09-22T22:24:21.075740] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-22T22:24:21.126905] [DEBUG] [LOCAL ] OMC: Derivative data saved (1794 records). [2025-09-22T22:24:21.164024] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-22T22:24:21.164151] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-09-22T22:24:21.231144] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-22T22:24:21.253746] [INFO ] [MAIN ] Derivative Progress: 1385/2091 symbols completed. OMF took 1.3s. Estimated remaining: 4m 33s. Rate: 154.9 symbols/min [2025-09-22T22:24:21.296486] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:21.296671] [INFO ] [MAIN ] Derivative Progress: 1386/2091 symbols completed. OMC took 1.5s. Estimated remaining: 4m 33s. Rate: 155.0 symbols/min [2025-09-22T22:24:21.297392] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:21.313341] [DEBUG] [LOCAL ] ONIT: Loaded 7805 existing records from primary storage. [2025-09-22T22:24:21.320742] [INFO ] [MAIN ] ONIT: Loaded 7805 primary data records. [2025-09-22T22:24:21.452776] [DEBUG] [LOCAL ] ONL: Loaded 32082 existing records from primary storage. [2025-09-22T22:24:21.452988] [INFO ] [MAIN ] ONL: Loaded 32082 primary data records. [2025-09-22T22:24:21.859735] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:21.968557] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 45856 primary records. [2025-09-22T22:24:21.977827] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-22T22:24:22.002616] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-09-22T22:24:22.003087] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-22T22:24:22.006739] [INFO ] [MAIN ] Derivative Progress: 1387/2091 symbols completed. OMI took 1.6s. Estimated remaining: 4m 33s. Rate: 154.9 symbols/min [2025-09-22T22:24:22.007159] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:22.024951] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:22.025882] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7805 primary records. [2025-09-22T22:24:22.026117] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-22T22:24:22.045012] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-09-22T22:24:22.045362] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-22T22:24:22.047632] [INFO ] [MAIN ] Derivative Progress: 1388/2091 symbols completed. ONIT took 0.8s. Estimated remaining: 4m 32s. Rate: 155.0 symbols/min [2025-09-22T22:24:22.048174] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:22.061427] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:22.062224] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 32082 primary records. [2025-09-22T22:24:22.062392] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-22T22:24:22.079093] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-09-22T22:24:22.079450] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-22T22:24:22.094996] [INFO ] [MAIN ] Derivative Progress: 1389/2091 symbols completed. ONL took 0.8s. Estimated remaining: 4m 32s. Rate: 155.1 symbols/min [2025-09-22T22:24:22.100186] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:22.110864] [DEBUG] [LOCAL ] ONTF: Loaded 23020 existing records from primary storage. [2025-09-22T22:24:22.111895] [INFO ] [MAIN ] ONTF: Loaded 23020 primary data records. [2025-09-22T22:24:22.199041] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-09-22T22:24:22.216802] [INFO ] [MAIN ] ONON: Loaded 53613 primary data records. [2025-09-22T22:24:22.474941] [DEBUG] [LOCAL ] ONTO: Loaded 46581 existing records from primary storage. [2025-09-22T22:24:22.596325] [INFO ] [MAIN ] ONTO: Loaded 46581 primary data records. [2025-09-22T22:24:23.185380] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:23.187196] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 23020 primary records. [2025-09-22T22:24:23.187436] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-22T22:24:23.209139] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-09-22T22:24:23.210753] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-22T22:24:23.212706] [INFO ] [MAIN ] Derivative Progress: 1390/2091 symbols completed. ONTF took 1.2s. Estimated remaining: 4m 32s. Rate: 154.9 symbols/min [2025-09-22T22:24:23.213197] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:23.234957] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:23.236401] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53613 primary records. [2025-09-22T22:24:23.236627] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-22T22:24:23.279463] [DEBUG] [LOCAL ] OOMA: Loaded 19185 existing records from primary storage. [2025-09-22T22:24:23.285774] [INFO ] [MAIN ] OOMA: Loaded 19185 primary data records. [2025-09-22T22:24:23.286382] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-09-22T22:24:23.291859] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-22T22:24:23.307980] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:23.341408] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 46581 primary records. [2025-09-22T22:24:23.307573] [INFO ] [MAIN ] Derivative Progress: 1391/2091 symbols completed. ONON took 1.3s. Estimated remaining: 4m 31s. Rate: 155.0 symbols/min [2025-09-22T22:24:23.360342] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:23.373612] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-22T22:24:23.649500] [DEBUG] [LOCAL ] OPAD: Loaded 19413 existing records from primary storage. [2025-09-22T22:24:23.649030] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-09-22T22:24:23.649753] [INFO ] [MAIN ] OPAD: Loaded 19413 primary data records. [2025-09-22T22:24:23.650199] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-22T22:24:23.685138] [INFO ] [MAIN ] Derivative Progress: 1392/2091 symbols completed. ONTO took 1.6s. Estimated remaining: 4m 31s. Rate: 155.0 symbols/min [2025-09-22T22:24:23.720373] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:24.020936] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:24.034772] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 19185 primary records. [2025-09-22T22:24:24.035165] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-22T22:24:24.037046] [DEBUG] [LOCAL ] OPFI: Loaded 46680 existing records from primary storage. [2025-09-22T22:24:24.037344] [INFO ] [MAIN ] OPFI: Loaded 46680 primary data records. [2025-09-22T22:24:24.160814] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-09-22T22:24:24.183377] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-22T22:24:24.191080] [INFO ] [MAIN ] Derivative Progress: 1393/2091 symbols completed. OOMA took 1.0s. Estimated remaining: 4m 30s. Rate: 154.9 symbols/min [2025-09-22T22:24:24.257072] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:24.373756] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 19413 primary records. [2025-09-22T22:24:24.374451] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-22T22:24:24.392548] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-09-22T22:24:24.393197] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-22T22:24:24.395880] [INFO ] [MAIN ] Derivative Progress: 1394/2091 symbols completed. OPAD took 1.0s. Estimated remaining: 4m 30s. Rate: 155.0 symbols/min [2025-09-22T22:24:24.416266] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:24.416947] [INFO ] [MAIN ] OPFI: Generated 1794 derivative records from 46680 primary records. [2025-09-22T22:24:24.417009] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-22T22:24:24.433163] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1794 records). [2025-09-22T22:24:24.433240] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-22T22:24:24.435199] [INFO ] [MAIN ] Derivative Progress: 1395/2091 symbols completed. OPFI took 0.7s. Estimated remaining: 4m 29s. Rate: 155.1 symbols/min [2025-09-22T22:24:24.436032] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:24.436276] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:24.436731] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:24.450784] [DEBUG] [LOCAL ] OPP: Loaded 11679 existing records from primary storage. [2025-09-22T22:24:24.450940] [INFO ] [MAIN ] OPP: Loaded 11679 primary data records. [2025-09-22T22:24:24.704505] [DEBUG] [LOCAL ] ORA: Loaded 32632 existing records from primary storage. [2025-09-22T22:24:24.836430] [INFO ] [MAIN ] ORA: Loaded 32632 primary data records. [2025-09-22T22:24:24.844267] [DEBUG] [LOCAL ] OR: Loaded 45994 existing records from primary storage. [2025-09-22T22:24:24.878164] [INFO ] [MAIN ] OR: Loaded 45994 primary data records. [2025-09-22T22:24:25.533792] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:25.535039] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 11679 primary records. [2025-09-22T22:24:25.535304] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-22T22:24:25.555031] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-09-22T22:24:25.555296] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-22T22:24:25.557623] [INFO ] [MAIN ] Derivative Progress: 1396/2091 symbols completed. OPP took 1.1s. Estimated remaining: 4m 29s. Rate: 154.9 symbols/min [2025-09-22T22:24:25.558542] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:25.581778] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:25.595307] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 32632 primary records. [2025-09-22T22:24:25.595495] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-22T22:24:25.595970] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:25.597687] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 45994 primary records. [2025-09-22T22:24:25.606056] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-22T22:24:25.642536] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-09-22T22:24:25.643419] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-22T22:24:25.643321] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-09-22T22:24:25.646948] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-22T22:24:25.646747] [INFO ] [MAIN ] Derivative Progress: 1397/2091 symbols completed. OR took 1.2s. Estimated remaining: 4m 29s. Rate: 155.0 symbols/min [2025-09-22T22:24:25.650067] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:25.650255] [INFO ] [MAIN ] Derivative Progress: 1398/2091 symbols completed. ORA took 1.2s. Estimated remaining: 4m 28s. Rate: 155.1 symbols/min [2025-09-22T22:24:25.650945] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:25.666788] [DEBUG] [LOCAL ] ORC: Loaded 52290 existing records from primary storage. [2025-09-22T22:24:25.667009] [INFO ] [MAIN ] ORC: Loaded 52290 primary data records. [2025-09-22T22:24:26.001052] [DEBUG] [LOCAL ] ORN: Loaded 31755 existing records from primary storage. [2025-09-22T22:24:26.001249] [INFO ] [MAIN ] ORN: Loaded 31755 primary data records. [2025-09-22T22:24:26.138813] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-09-22T22:24:26.149783] [INFO ] [MAIN ] OSCR: Loaded 53722 primary data records. [2025-09-22T22:24:26.677299] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:26.679369] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52290 primary records. [2025-09-22T22:24:26.679858] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-22T22:24:26.699832] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-09-22T22:24:26.700379] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-22T22:24:26.702355] [INFO ] [MAIN ] Derivative Progress: 1399/2091 symbols completed. ORC took 1.1s. Estimated remaining: 4m 28s. Rate: 154.9 symbols/min [2025-09-22T22:24:26.703045] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:26.723019] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:26.725478] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 31755 primary records. [2025-09-22T22:24:26.725824] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-22T22:24:26.753296] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:26.755771] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-09-22T22:24:26.757024] [INFO ] [MAIN ] OSCR: Generated 1794 derivative records from 53722 primary records. [2025-09-22T22:24:26.757134] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-22T22:24:26.759294] [INFO ] [MAIN ] Derivative Progress: 1400/2091 symbols completed. ORN took 1.1s. Estimated remaining: 4m 28s. Rate: 155.0 symbols/min [2025-09-22T22:24:26.759732] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:26.759835] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-22T22:24:26.777688] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1794 records). [2025-09-22T22:24:26.791619] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-22T22:24:26.794287] [INFO ] [MAIN ] Derivative Progress: 1401/2091 symbols completed. OSCR took 1.1s. Estimated remaining: 4m 27s. Rate: 155.1 symbols/min [2025-09-22T22:24:26.794629] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:26.816481] [DEBUG] [LOCAL ] OTIS: Loaded 52715 existing records from primary storage. [2025-09-22T22:24:26.816819] [INFO ] [MAIN ] OTIS: Loaded 52715 primary data records. [2025-09-22T22:24:27.020359] [DEBUG] [LOCAL ] OUT: Loaded 48126 existing records from primary storage. [2025-09-22T22:24:27.033217] [INFO ] [MAIN ] OUT: Loaded 48126 primary data records. [2025-09-22T22:24:27.310423] [DEBUG] [LOCAL ] OVV: Loaded 53516 existing records from primary storage. [2025-09-22T22:24:27.317078] [INFO ] [MAIN ] OVV: Loaded 53516 primary data records. [2025-09-22T22:24:27.860876] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:27.861900] [INFO ] [MAIN ] OTIS: Generated 1794 derivative records from 52715 primary records. [2025-09-22T22:24:27.862446] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-22T22:24:27.899088] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:27.900400] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 48126 primary records. [2025-09-22T22:24:27.908622] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-22T22:24:27.915796] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1794 records). [2025-09-22T22:24:27.924094] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:27.928300] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-22T22:24:27.931740] [INFO ] [MAIN ] Derivative Progress: 1402/2091 symbols completed. OTIS took 1.2s. Estimated remaining: 4m 27s. Rate: 154.9 symbols/min [2025-09-22T22:24:27.931975] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:27.935298] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53516 primary records. [2025-09-22T22:24:27.936262] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-22T22:24:27.936668] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-09-22T22:24:27.937605] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-22T22:24:27.950875] [INFO ] [MAIN ] Derivative Progress: 1403/2091 symbols completed. OUT took 1.2s. Estimated remaining: 4m 26s. Rate: 155.0 symbols/min [2025-09-22T22:24:27.954004] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:27.955827] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-09-22T22:24:27.956361] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-22T22:24:27.960223] [INFO ] [MAIN ] Derivative Progress: 1404/2091 symbols completed. OVV took 1.2s. Estimated remaining: 4m 26s. Rate: 155.1 symbols/min [2025-09-22T22:24:27.960626] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:27.979360] [DEBUG] [LOCAL ] OWLT: Loaded 8904 existing records from primary storage. [2025-09-22T22:24:27.979550] [INFO ] [MAIN ] OWLT: Loaded 8904 primary data records. [2025-09-22T22:24:28.329046] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-09-22T22:24:28.329830] [INFO ] [MAIN ] OWL: Loaded 53555 primary data records. [2025-09-22T22:24:28.400702] [DEBUG] [LOCAL ] OXM: Loaded 33539 existing records from primary storage. [2025-09-22T22:24:28.410456] [INFO ] [MAIN ] OXM: Loaded 33539 primary data records. [2025-09-22T22:24:29.034177] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:29.035204] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 8904 primary records. [2025-09-22T22:24:29.036338] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-22T22:24:29.055539] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-09-22T22:24:29.062326] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-22T22:24:29.065544] [INFO ] [MAIN ] Derivative Progress: 1405/2091 symbols completed. OWLT took 1.1s. Estimated remaining: 4m 26s. Rate: 154.9 symbols/min [2025-09-22T22:24:29.066613] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:29.089495] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:29.092622] [INFO ] [MAIN ] OWL: Generated 1794 derivative records from 53555 primary records. [2025-09-22T22:24:29.092828] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-22T22:24:29.107333] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:29.121451] [INFO ] [MAIN ] OXM: Generated 1794 derivative records from 33539 primary records. [2025-09-22T22:24:29.122277] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-22T22:24:29.124930] [DEBUG] [LOCAL ] OWL: Derivative data saved (1794 records). [2025-09-22T22:24:29.125949] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-22T22:24:29.129171] [INFO ] [MAIN ] Derivative Progress: 1406/2091 symbols completed. OWL took 1.2s. Estimated remaining: 4m 25s. Rate: 155.0 symbols/min [2025-09-22T22:24:29.140735] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:29.146202] [DEBUG] [LOCAL ] OXM: Derivative data saved (1794 records). [2025-09-22T22:24:29.146297] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-22T22:24:29.152562] [INFO ] [MAIN ] Derivative Progress: 1407/2091 symbols completed. OXM took 1.2s. Estimated remaining: 4m 25s. Rate: 155.1 symbols/min [2025-09-22T22:24:29.152997] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:29.181996] [DEBUG] [LOCAL ] PAC: Loaded 11560 existing records from primary storage. [2025-09-22T22:24:29.182282] [INFO ] [MAIN ] PAC: Loaded 11560 primary data records. [2025-09-22T22:24:29.285635] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-22T22:24:29.315415] [INFO ] [MAIN ] PAAS: Loaded 53603 primary data records. [2025-09-22T22:24:29.423687] [DEBUG] [LOCAL ] PACK: Loaded 32100 existing records from primary storage. [2025-09-22T22:24:29.446694] [INFO ] [MAIN ] PACK: Loaded 32100 primary data records. [2025-09-22T22:24:30.205559] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:30.206715] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11560 primary records. [2025-09-22T22:24:30.207269] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-22T22:24:30.226336] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-09-22T22:24:30.226450] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-22T22:24:30.234944] [INFO ] [MAIN ] Derivative Progress: 1408/2091 symbols completed. PAC took 1.1s. Estimated remaining: 4m 25s. Rate: 154.9 symbols/min [2025-09-22T22:24:30.252494] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:24:30.253485] [INFO ] [MAIN ] PACK: Generated 1793 derivative records from 32100 primary records. [2025-09-22T22:24:30.253716] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-22T22:24:30.267675] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:30.268721] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53603 primary records. [2025-09-22T22:24:30.268996] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-22T22:24:30.300807] [DEBUG] [LOCAL ] PACK: Derivative data saved (1793 records). [2025-09-22T22:24:30.303267] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-09-22T22:24:30.302035] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-22T22:24:30.303371] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-22T22:24:30.305911] [INFO ] [MAIN ] Derivative Progress: 1409/2091 symbols completed. PACK took 1.2s. Estimated remaining: 4m 24s. Rate: 155.0 symbols/min [2025-09-22T22:24:30.308533] [INFO ] [MAIN ] Derivative Progress: 1410/2091 symbols completed. PAAS took 1.2s. Estimated remaining: 4m 23s. Rate: 155.1 symbols/min [2025-09-22T22:24:30.309493] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:30.309293] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:30.309703] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:30.345948] [DEBUG] [LOCAL ] PAG: Loaded 21984 existing records from primary storage. [2025-09-22T22:24:30.346195] [INFO ] [MAIN ] PAG: Loaded 21984 primary data records. [2025-09-22T22:24:30.470685] [DEBUG] [LOCAL ] PACS: Loaded 34010 existing records from primary storage. [2025-09-22T22:24:30.486084] [INFO ] [MAIN ] PACS: Loaded 34010 primary data records. [2025-09-22T22:24:30.720234] [DEBUG] [LOCAL ] PAGS: Loaded 52686 existing records from primary storage. [2025-09-22T22:24:30.878577] [INFO ] [MAIN ] PAGS: Loaded 52686 primary data records. [2025-09-22T22:24:31.445355] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:31.452373] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 21984 primary records. [2025-09-22T22:24:31.452612] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-22T22:24:31.453793] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:31.455010] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 34010 primary records. [2025-09-22T22:24:31.455296] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-22T22:24:31.490618] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-09-22T22:24:31.491523] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-09-22T22:24:31.491835] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-22T22:24:31.493863] [INFO ] [MAIN ] Derivative Progress: 1411/2091 symbols completed. PAG took 1.2s. Estimated remaining: 4m 23s. Rate: 154.8 symbols/min [2025-09-22T22:24:31.491893] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-22T22:24:31.496873] [INFO ] [MAIN ] Derivative Progress: 1412/2091 symbols completed. PACS took 1.2s. Estimated remaining: 4m 23s. Rate: 154.9 symbols/min [2025-09-22T22:24:31.509678] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:31.496954] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:31.511313] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:31.512505] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52686 primary records. [2025-09-22T22:24:31.512805] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-22T22:24:31.530602] [DEBUG] [LOCAL ] PAI: Loaded 2709 existing records from primary storage. [2025-09-22T22:24:31.531751] [INFO ] [MAIN ] PAI: Loaded 2709 primary data records. [2025-09-22T22:24:31.632210] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-09-22T22:24:31.639632] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-22T22:24:31.651207] [INFO ] [MAIN ] Derivative Progress: 1413/2091 symbols completed. PAGS took 1.3s. Estimated remaining: 4m 22s. Rate: 155.0 symbols/min [2025-09-22T22:24:31.669736] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:31.670692] [DEBUG] [LOCAL ] PAM: Loaded 27892 existing records from primary storage. [2025-09-22T22:24:31.682592] [INFO ] [MAIN ] PAM: Loaded 27892 primary data records. [2025-09-22T22:24:32.093264] [DEBUG] [LOCAL ] PAR: Loaded 32523 existing records from primary storage. [2025-09-22T22:24:32.159865] [INFO ] [MAIN ] PAR: Loaded 32523 primary data records. [2025-09-22T22:24:32.538469] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:32.540356] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2709 primary records. [2025-09-22T22:24:32.540574] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-22T22:24:32.558924] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-09-22T22:24:32.560084] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-22T22:24:32.562361] [INFO ] [MAIN ] Derivative Progress: 1414/2091 symbols completed. PAI took 1.1s. Estimated remaining: 4m 22s. Rate: 154.9 symbols/min [2025-09-22T22:24:32.562761] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:32.576551] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:32.578194] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 27892 primary records. [2025-09-22T22:24:32.578416] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-22T22:24:32.595067] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-09-22T22:24:32.595337] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-22T22:24:32.597597] [INFO ] [MAIN ] Derivative Progress: 1415/2091 symbols completed. PAM took 1.1s. Estimated remaining: 4m 22s. Rate: 155.0 symbols/min [2025-09-22T22:24:32.598312] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:32.614806] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:32.615529] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 32523 primary records. [2025-09-22T22:24:32.615594] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-22T22:24:32.642529] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-09-22T22:24:32.642765] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-22T22:24:32.645266] [INFO ] [MAIN ] Derivative Progress: 1416/2091 symbols completed. PAR took 1.0s. Estimated remaining: 4m 21s. Rate: 155.1 symbols/min [2025-09-22T22:24:32.645676] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:32.675685] [DEBUG] [LOCAL ] PARR: Loaded 48356 existing records from primary storage. [2025-09-22T22:24:32.675945] [INFO ] [MAIN ] PARR: Loaded 48356 primary data records. [2025-09-22T22:24:32.809529] [DEBUG] [LOCAL ] PAXS: Loaded 21101 existing records from primary storage. [2025-09-22T22:24:32.810353] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-22T22:24:32.810981] [INFO ] [MAIN ] PATH: Loaded 53678 primary data records. [2025-09-22T22:24:32.816318] [INFO ] [MAIN ] PAXS: Loaded 21101 primary data records. [2025-09-22T22:24:33.703624] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:33.704452] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 48356 primary records. [2025-09-22T22:24:33.705273] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-22T22:24:33.757862] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:33.759774] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 21101 primary records. [2025-09-22T22:24:33.760084] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-22T22:24:33.760005] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:33.761515] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53678 primary records. [2025-09-22T22:24:33.762225] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-22T22:24:33.783306] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-09-22T22:24:33.783878] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-22T22:24:33.789501] [INFO ] [MAIN ] Derivative Progress: 1417/2091 symbols completed. PARR took 1.2s. Estimated remaining: 4m 21s. Rate: 154.8 symbols/min [2025-09-22T22:24:33.791989] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:33.798344] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-09-22T22:24:33.798939] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-22T22:24:33.803041] [INFO ] [MAIN ] Derivative Progress: 1418/2091 symbols completed. PATH took 1.2s. Estimated remaining: 4m 21s. Rate: 155.0 symbols/min [2025-09-22T22:24:33.803606] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-09-22T22:24:33.803971] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-22T22:24:33.803901] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:33.806601] [INFO ] [MAIN ] Derivative Progress: 1419/2091 symbols completed. PAXS took 1.2s. Estimated remaining: 4m 20s. Rate: 155.1 symbols/min [2025-09-22T22:24:33.807351] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:33.874588] [DEBUG] [LOCAL ] PAY: Loaded 38308 existing records from primary storage. [2025-09-22T22:24:33.874893] [INFO ] [MAIN ] PAY: Loaded 38308 primary data records. [2025-09-22T22:24:33.875570] [DEBUG] [LOCAL ] PAYC: Loaded 36350 existing records from primary storage. [2025-09-22T22:24:33.899953] [INFO ] [MAIN ] PAYC: Loaded 36350 primary data records. [2025-09-22T22:24:34.098978] [DEBUG] [LOCAL ] PB: Loaded 41351 existing records from primary storage. [2025-09-22T22:24:34.113874] [INFO ] [MAIN ] PB: Loaded 41351 primary data records. [2025-09-22T22:24:34.845407] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:34.845005] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:34.847090] [INFO ] [MAIN ] PAYC: Generated 1794 derivative records from 36350 primary records. [2025-09-22T22:24:34.846469] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 38308 primary records. [2025-09-22T22:24:34.847187] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-22T22:24:34.847418] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-22T22:24:34.880115] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1794 records). [2025-09-22T22:24:34.881790] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-22T22:24:34.884004] [INFO ] [MAIN ] Derivative Progress: 1420/2091 symbols completed. PAYC took 1.1s. Estimated remaining: 4m 20s. Rate: 154.9 symbols/min [2025-09-22T22:24:34.885210] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:34.899229] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-09-22T22:24:34.899615] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-22T22:24:34.899908] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:34.902035] [INFO ] [MAIN ] Derivative Progress: 1421/2091 symbols completed. PAY took 1.1s. Estimated remaining: 4m 19s. Rate: 155.0 symbols/min [2025-09-22T22:24:34.903038] [INFO ] [MAIN ] PB: Generated 1794 derivative records from 41351 primary records. [2025-09-22T22:24:34.903317] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:34.903569] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-22T22:24:34.920112] [DEBUG] [LOCAL ] PB: Derivative data saved (1794 records). [2025-09-22T22:24:34.920236] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-22T22:24:34.922880] [INFO ] [MAIN ] Derivative Progress: 1422/2091 symbols completed. PB took 1.1s. Estimated remaining: 4m 19s. Rate: 155.1 symbols/min [2025-09-22T22:24:34.923241] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:34.980003] [DEBUG] [LOCAL ] PBH: Loaded 31557 existing records from primary storage. [2025-09-22T22:24:34.980736] [INFO ] [MAIN ] PBH: Loaded 31557 primary data records. [2025-09-22T22:24:35.031606] [DEBUG] [LOCAL ] PBA: Loaded 48983 existing records from primary storage. [2025-09-22T22:24:35.056948] [INFO ] [MAIN ] PBA: Loaded 48983 primary data records. [2025-09-22T22:24:35.162469] [DEBUG] [LOCAL ] PBF: Loaded 53091 existing records from primary storage. [2025-09-22T22:24:35.185905] [INFO ] [MAIN ] PBF: Loaded 53091 primary data records. [2025-09-22T22:24:36.016137] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:36.017579] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 31557 primary records. [2025-09-22T22:24:36.025447] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-22T22:24:36.031232] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:36.047399] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 48983 primary records. [2025-09-22T22:24:36.047621] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-22T22:24:36.074387] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:36.076011] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53091 primary records. [2025-09-22T22:24:36.076370] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-22T22:24:36.087060] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-09-22T22:24:36.092130] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-22T22:24:36.094156] [INFO ] [MAIN ] Derivative Progress: 1423/2091 symbols completed. PBH took 1.2s. Estimated remaining: 4m 19s. Rate: 154.9 symbols/min [2025-09-22T22:24:36.100126] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-09-22T22:24:36.100733] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-22T22:24:36.103472] [INFO ] [MAIN ] Derivative Progress: 1424/2091 symbols completed. PBA took 1.2s. Estimated remaining: 4m 18s. Rate: 155.0 symbols/min [2025-09-22T22:24:36.103980] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-09-22T22:24:36.104180] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-22T22:24:36.106825] [INFO ] [MAIN ] Derivative Progress: 1425/2091 symbols completed. PBF took 1.2s. Estimated remaining: 4m 18s. Rate: 155.1 symbols/min [2025-09-22T22:24:36.107541] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:36.107453] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:36.108076] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:36.138629] [DEBUG] [LOCAL ] PBT: Loaded 17357 existing records from primary storage. [2025-09-22T22:24:36.138946] [INFO ] [MAIN ] PBT: Loaded 17357 primary data records. [2025-09-22T22:24:36.345115] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-09-22T22:24:36.390676] [INFO ] [MAIN ] PBR: Loaded 53713 primary data records. [2025-09-22T22:24:36.559148] [DEBUG] [LOCAL ] PBI: Loaded 50061 existing records from primary storage. [2025-09-22T22:24:36.588198] [INFO ] [MAIN ] PBI: Loaded 50061 primary data records. [2025-09-22T22:24:37.233308] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:37.234551] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17357 primary records. [2025-09-22T22:24:37.234753] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-22T22:24:37.252230] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-09-22T22:24:37.252361] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-22T22:24:37.255299] [INFO ] [MAIN ] Derivative Progress: 1426/2091 symbols completed. PBT took 1.1s. Estimated remaining: 4m 18s. Rate: 154.9 symbols/min [2025-09-22T22:24:37.256057] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:37.273522] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:37.274598] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53713 primary records. [2025-09-22T22:24:37.277189] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-22T22:24:37.289539] [DEBUG] [LOCAL ] PCF: Loaded 8638 existing records from primary storage. [2025-09-22T22:24:37.290373] [INFO ] [MAIN ] PCF: Loaded 8638 primary data records. [2025-09-22T22:24:37.366535] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-09-22T22:24:37.373207] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-22T22:24:37.381245] [INFO ] [MAIN ] Derivative Progress: 1427/2091 symbols completed. PBR took 1.3s. Estimated remaining: 4m 17s. Rate: 154.9 symbols/min [2025-09-22T22:24:37.405889] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:37.496563] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:37.502801] [INFO ] [MAIN ] PBI: Generated 1794 derivative records from 50061 primary records. [2025-09-22T22:24:37.502983] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-22T22:24:37.622244] [DEBUG] [LOCAL ] PCM: Loaded 6779 existing records from primary storage. [2025-09-22T22:24:37.622728] [INFO ] [MAIN ] PCM: Loaded 6779 primary data records. [2025-09-22T22:24:37.721994] [DEBUG] [LOCAL ] PBI: Derivative data saved (1794 records). [2025-09-22T22:24:37.727754] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-22T22:24:37.738235] [INFO ] [MAIN ] Derivative Progress: 1428/2091 symbols completed. PBI took 1.6s. Estimated remaining: 4m 17s. Rate: 154.9 symbols/min [2025-09-22T22:24:37.739363] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:38.015311] [DEBUG] [LOCAL ] PCN: Loaded 24213 existing records from primary storage. [2025-09-22T22:24:38.027688] [INFO ] [MAIN ] PCN: Loaded 24213 primary data records. [2025-09-22T22:24:38.029198] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:38.066012] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 8638 primary records. [2025-09-22T22:24:38.084734] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-22T22:24:38.167079] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-09-22T22:24:38.177778] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-22T22:24:38.193866] [INFO ] [MAIN ] Derivative Progress: 1429/2091 symbols completed. PCF took 0.9s. Estimated remaining: 4m 16s. Rate: 154.9 symbols/min [2025-09-22T22:24:38.354046] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:38.373731] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:38.374982] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6779 primary records. [2025-09-22T22:24:38.375245] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-22T22:24:38.395793] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-09-22T22:24:38.396249] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-22T22:24:38.398763] [INFO ] [MAIN ] Derivative Progress: 1430/2091 symbols completed. PCM took 1.0s. Estimated remaining: 4m 16s. Rate: 155.0 symbols/min [2025-09-22T22:24:38.399035] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:38.430915] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:38.431728] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24213 primary records. [2025-09-22T22:24:38.432042] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-22T22:24:38.436798] [DEBUG] [LOCAL ] PCQ: Loaded 11973 existing records from primary storage. [2025-09-22T22:24:38.437114] [INFO ] [MAIN ] PCQ: Loaded 11973 primary data records. [2025-09-22T22:24:38.578448] [DEBUG] [LOCAL ] PCOR: Loaded 48114 existing records from primary storage. [2025-09-22T22:24:38.583474] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-09-22T22:24:38.584056] [INFO ] [MAIN ] PCOR: Loaded 48114 primary data records. [2025-09-22T22:24:38.584177] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-22T22:24:38.602422] [INFO ] [MAIN ] Derivative Progress: 1431/2091 symbols completed. PCN took 0.9s. Estimated remaining: 4m 15s. Rate: 155.0 symbols/min [2025-09-22T22:24:38.613181] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:39.144001] [DEBUG] [LOCAL ] PD: Loaded 47862 existing records from primary storage. [2025-09-22T22:24:39.158480] [INFO ] [MAIN ] PD: Loaded 47862 primary data records. [2025-09-22T22:24:39.158877] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:39.160199] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 11973 primary records. [2025-09-22T22:24:39.165733] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-22T22:24:39.275538] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-09-22T22:24:39.294256] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-22T22:24:39.296904] [INFO ] [MAIN ] Derivative Progress: 1432/2091 symbols completed. PCQ took 0.9s. Estimated remaining: 4m 15s. Rate: 154.9 symbols/min [2025-09-22T22:24:39.325853] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:39.407914] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:39.559360] [INFO ] [MAIN ] PCOR: Generated 1794 derivative records from 48114 primary records. [2025-09-22T22:24:39.567101] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-22T22:24:39.588103] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1794 records). [2025-09-22T22:24:39.588845] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-22T22:24:39.591233] [INFO ] [MAIN ] Derivative Progress: 1433/2091 symbols completed. PCOR took 1.3s. Estimated remaining: 4m 15s. Rate: 155.0 symbols/min [2025-09-22T22:24:39.591556] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:39.630787] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:39.640568] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 47862 primary records. [2025-09-22T22:24:39.640856] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-22T22:24:39.665464] [DEBUG] [LOCAL ] PDI: Loaded 50242 existing records from primary storage. [2025-09-22T22:24:39.668816] [INFO ] [MAIN ] PDI: Loaded 50242 primary data records. [2025-09-22T22:24:39.673105] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-09-22T22:24:39.705980] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-22T22:24:39.730607] [INFO ] [MAIN ] Derivative Progress: 1434/2091 symbols completed. PD took 1.1s. Estimated remaining: 4m 14s. Rate: 155.0 symbols/min [2025-09-22T22:24:39.736438] [DEBUG] [LOCAL ] PDM: Loaded 39828 existing records from primary storage. [2025-09-22T22:24:39.753033] [INFO ] [MAIN ] PDM: Loaded 39828 primary data records. [2025-09-22T22:24:39.765143] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:40.341171] [DEBUG] [LOCAL ] PDO: Loaded 31798 existing records from primary storage. [2025-09-22T22:24:40.341846] [INFO ] [MAIN ] PDO: Loaded 31798 primary data records. [2025-09-22T22:24:40.673540] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:40.674375] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50242 primary records. [2025-09-22T22:24:40.675398] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-22T22:24:40.695570] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-09-22T22:24:40.695752] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-22T22:24:40.697741] [INFO ] [MAIN ] Derivative Progress: 1435/2091 symbols completed. PDI took 1.4s. Estimated remaining: 4m 14s. Rate: 154.9 symbols/min [2025-09-22T22:24:40.697978] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:40.718527] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:40.719922] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39828 primary records. [2025-09-22T22:24:40.720276] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-22T22:24:40.757159] [DEBUG] [LOCAL ] PDS: Loaded 18281 existing records from primary storage. [2025-09-22T22:24:40.757065] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-09-22T22:24:40.769798] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-22T22:24:40.772092] [INFO ] [MAIN ] PDS: Loaded 18281 primary data records. [2025-09-22T22:24:40.772006] [INFO ] [MAIN ] Derivative Progress: 1436/2091 symbols completed. PDM took 1.2s. Estimated remaining: 4m 14s. Rate: 155.0 symbols/min [2025-09-22T22:24:40.805186] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:40.778335] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:40.844560] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31798 primary records. [2025-09-22T22:24:40.844883] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-22T22:24:40.896678] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-09-22T22:24:40.927231] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-22T22:24:40.929966] [INFO ] [MAIN ] Derivative Progress: 1437/2091 symbols completed. PDO took 1.2s. Estimated remaining: 4m 13s. Rate: 155.0 symbols/min [2025-09-22T22:24:40.944130] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:41.108700] [DEBUG] [LOCAL ] PDT: Loaded 17373 existing records from primary storage. [2025-09-22T22:24:41.108863] [INFO ] [MAIN ] PDT: Loaded 17373 primary data records. [2025-09-22T22:24:41.225677] [DEBUG] [LOCAL ] PDX: Loaded 14466 existing records from primary storage. [2025-09-22T22:24:41.226584] [INFO ] [MAIN ] PDX: Loaded 14466 primary data records. [2025-09-22T22:24:41.777909] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:41.793972] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 18281 primary records. [2025-09-22T22:24:41.794137] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-22T22:24:41.812737] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-09-22T22:24:41.813212] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-22T22:24:41.815888] [INFO ] [MAIN ] Derivative Progress: 1438/2091 symbols completed. PDS took 1.1s. Estimated remaining: 4m 13s. Rate: 154.9 symbols/min [2025-09-22T22:24:41.835510] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:41.836597] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17373 primary records. [2025-09-22T22:24:41.836874] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-22T22:24:41.853416] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-09-22T22:24:41.853619] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-22T22:24:41.856029] [INFO ] [MAIN ] Derivative Progress: 1439/2091 symbols completed. PDT took 1.1s. Estimated remaining: 4m 12s. Rate: 155.0 symbols/min [2025-09-22T22:24:41.870939] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:41.871551] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14466 primary records. [2025-09-22T22:24:41.871613] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-22T22:24:41.886664] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-09-22T22:24:41.886730] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-22T22:24:41.889251] [INFO ] [MAIN ] Derivative Progress: 1440/2091 symbols completed. PDX took 0.9s. Estimated remaining: 4m 12s. Rate: 155.1 symbols/min [2025-09-22T22:24:41.890167] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:41.890312] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:41.889958] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:41.904330] [DEBUG] [LOCAL ] PEO: Loaded 10828 existing records from primary storage. [2025-09-22T22:24:41.904458] [INFO ] [MAIN ] PEO: Loaded 10828 primary data records. [2025-09-22T22:24:42.027406] [DEBUG] [LOCAL ] PEN: Loaded 30535 existing records from primary storage. [2025-09-22T22:24:42.062354] [INFO ] [MAIN ] PEN: Loaded 30535 primary data records. [2025-09-22T22:24:42.359010] [DEBUG] [LOCAL ] PEB: Loaded 50729 existing records from primary storage. [2025-09-22T22:24:42.385917] [INFO ] [MAIN ] PEB: Loaded 50729 primary data records. [2025-09-22T22:24:42.903007] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:42.904696] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 10828 primary records. [2025-09-22T22:24:42.905548] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-22T22:24:42.924231] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-09-22T22:24:42.924483] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-22T22:24:42.927945] [INFO ] [MAIN ] Derivative Progress: 1441/2091 symbols completed. PEO took 1.0s. Estimated remaining: 4m 12s. Rate: 154.9 symbols/min [2025-09-22T22:24:42.929362] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:42.945688] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:42.946476] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 30535 primary records. [2025-09-22T22:24:42.946625] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-22T22:24:42.969796] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-09-22T22:24:42.975820] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-22T22:24:42.978128] [INFO ] [MAIN ] Derivative Progress: 1442/2091 symbols completed. PEN took 1.1s. Estimated remaining: 4m 11s. Rate: 155.0 symbols/min [2025-09-22T22:24:42.991969] [DEBUG] [LOCAL ] PERF: Loaded 13989 existing records from primary storage. [2025-09-22T22:24:42.992519] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:42.992818] [INFO ] [MAIN ] PERF: Loaded 13989 primary data records. [2025-09-22T22:24:42.993519] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:43.007790] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50729 primary records. [2025-09-22T22:24:43.008016] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-22T22:24:43.102039] [DEBUG] [LOCAL ] PFD: Loaded 5143 existing records from primary storage. [2025-09-22T22:24:43.109100] [INFO ] [MAIN ] PFD: Loaded 5143 primary data records. [2025-09-22T22:24:43.157366] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-09-22T22:24:43.195865] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-22T22:24:43.247180] [INFO ] [MAIN ] Derivative Progress: 1443/2091 symbols completed. PEB took 1.4s. Estimated remaining: 4m 11s. Rate: 155.0 symbols/min [2025-09-22T22:24:43.282152] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:43.723307] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:43.737367] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 13989 primary records. [2025-09-22T22:24:43.737755] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-22T22:24:43.739256] [DEBUG] [LOCAL ] PFGC: Loaded 47028 existing records from primary storage. [2025-09-22T22:24:43.739859] [INFO ] [MAIN ] PFGC: Loaded 47028 primary data records. [2025-09-22T22:24:43.840853] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:43.835325] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-09-22T22:24:43.841081] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-22T22:24:43.859464] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5143 primary records. [2025-09-22T22:24:43.867749] [INFO ] [MAIN ] Derivative Progress: 1444/2091 symbols completed. PERF took 0.9s. Estimated remaining: 4m 11s. Rate: 155.0 symbols/min [2025-09-22T22:24:43.867831] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-22T22:24:43.880038] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:44.101004] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-09-22T22:24:44.101283] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-22T22:24:44.092177] [DEBUG] [LOCAL ] PFH: Loaded 6912 existing records from primary storage. [2025-09-22T22:24:44.101390] [INFO ] [MAIN ] PFH: Loaded 6912 primary data records. [2025-09-22T22:24:44.103693] [INFO ] [MAIN ] Derivative Progress: 1445/2091 symbols completed. PFD took 1.1s. Estimated remaining: 4m 10s. Rate: 155.0 symbols/min [2025-09-22T22:24:44.126026] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:44.294742] [DEBUG] [LOCAL ] PFL: Loaded 13814 existing records from primary storage. [2025-09-22T22:24:44.300944] [INFO ] [MAIN ] PFL: Loaded 13814 primary data records. [2025-09-22T22:24:44.599578] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:44.611264] [INFO ] [MAIN ] PFGC: Generated 1794 derivative records from 47028 primary records. [2025-09-22T22:24:44.616698] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-22T22:24:44.831170] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1794 records). [2025-09-22T22:24:44.832589] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-22T22:24:44.834874] [INFO ] [MAIN ] Derivative Progress: 1446/2091 symbols completed. PFGC took 1.6s. Estimated remaining: 4m 10s. Rate: 154.9 symbols/min [2025-09-22T22:24:44.838418] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:44.853917] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:44.854848] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6912 primary records. [2025-09-22T22:24:44.855080] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-22T22:24:44.873011] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-09-22T22:24:44.873135] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-22T22:24:44.875361] [INFO ] [MAIN ] Derivative Progress: 1447/2091 symbols completed. PFH took 1.0s. Estimated remaining: 4m 9s. Rate: 155.0 symbols/min [2025-09-22T22:24:44.876872] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:44.896736] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:44.907544] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13814 primary records. [2025-09-22T22:24:44.910855] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-22T22:24:44.911435] [DEBUG] [LOCAL ] PFO: Loaded 5850 existing records from primary storage. [2025-09-22T22:24:44.912321] [INFO ] [MAIN ] PFO: Loaded 5850 primary data records. [2025-09-22T22:24:45.009121] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-09-22T22:24:45.019754] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-22T22:24:45.051388] [DEBUG] [LOCAL ] PFLT: Loaded 43652 existing records from primary storage. [2025-09-22T22:24:45.050509] [INFO ] [MAIN ] Derivative Progress: 1448/2091 symbols completed. PFL took 0.9s. Estimated remaining: 4m 9s. Rate: 155.1 symbols/min [2025-09-22T22:24:45.062617] [INFO ] [MAIN ] PFLT: Loaded 43652 primary data records. [2025-09-22T22:24:45.090310] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:45.627995] [DEBUG] [LOCAL ] PFS: Loaded 35756 existing records from primary storage. [2025-09-22T22:24:45.629616] [INFO ] [MAIN ] PFS: Loaded 35756 primary data records. [2025-09-22T22:24:45.955685] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:45.966747] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 5850 primary records. [2025-09-22T22:24:45.967323] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-22T22:24:46.006339] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:46.009103] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-09-22T22:24:46.009748] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-22T22:24:46.012664] [INFO ] [MAIN ] Derivative Progress: 1449/2091 symbols completed. PFO took 1.1s. Estimated remaining: 4m 9s. Rate: 154.9 symbols/min [2025-09-22T22:24:46.013740] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 43652 primary records. [2025-09-22T22:24:46.014740] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-22T22:24:46.014515] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:46.038771] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-09-22T22:24:46.039191] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-22T22:24:46.041859] [INFO ] [MAIN ] Derivative Progress: 1450/2091 symbols completed. PFLT took 1.2s. Estimated remaining: 4m 8s. Rate: 155.0 symbols/min [2025-09-22T22:24:46.042360] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:46.073981] [DEBUG] [LOCAL ] PGP: Loaded 5449 existing records from primary storage. [2025-09-22T22:24:46.070298] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:46.074231] [INFO ] [MAIN ] PGP: Loaded 5449 primary data records. [2025-09-22T22:24:46.075277] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35756 primary records. [2025-09-22T22:24:46.096377] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-22T22:24:46.191785] [DEBUG] [LOCAL ] PFSI: Loaded 28855 existing records from primary storage. [2025-09-22T22:24:46.202314] [INFO ] [MAIN ] PFSI: Loaded 28855 primary data records. [2025-09-22T22:24:46.318931] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-09-22T22:24:46.340491] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-22T22:24:46.378913] [INFO ] [MAIN ] Derivative Progress: 1451/2091 symbols completed. PFS took 1.3s. Estimated remaining: 4m 8s. Rate: 155.0 symbols/min [2025-09-22T22:24:46.403298] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:46.770278] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:46.771053] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5449 primary records. [2025-09-22T22:24:46.771152] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-22T22:24:46.786628] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-09-22T22:24:46.786912] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-22T22:24:46.789084] [INFO ] [MAIN ] Derivative Progress: 1452/2091 symbols completed. PGP took 0.7s. Estimated remaining: 4m 7s. Rate: 155.0 symbols/min [2025-09-22T22:24:46.790139] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:46.809382] [DEBUG] [LOCAL ] PGRE: Loaded 46338 existing records from primary storage. [2025-09-22T22:24:46.809912] [INFO ] [MAIN ] PGRE: Loaded 46338 primary data records. [2025-09-22T22:24:46.857059] [DEBUG] [LOCAL ] PGZ: Loaded 5402 existing records from primary storage. [2025-09-22T22:24:46.902951] [INFO ] [MAIN ] PGZ: Loaded 5402 primary data records. [2025-09-22T22:24:46.903253] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:46.964426] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 28855 primary records. [2025-09-22T22:24:46.969743] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-22T22:24:47.148155] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-09-22T22:24:47.292920] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-22T22:24:47.361333] [INFO ] [MAIN ] Derivative Progress: 1453/2091 symbols completed. PFSI took 1.3s. Estimated remaining: 4m 7s. Rate: 155.0 symbols/min [2025-09-22T22:24:47.555744] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:47.556689] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46338 primary records. [2025-09-22T22:24:47.557003] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-22T22:24:47.586000] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:47.587216] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5402 primary records. [2025-09-22T22:24:47.587496] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-22T22:24:47.589314] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-09-22T22:24:47.590141] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-22T22:24:47.592250] [INFO ] [MAIN ] Derivative Progress: 1454/2091 symbols completed. PGRE took 1.2s. Estimated remaining: 4m 7s. Rate: 155.0 symbols/min [2025-09-22T22:24:47.606930] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-09-22T22:24:47.607003] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-22T22:24:47.609377] [INFO ] [MAIN ] Derivative Progress: 1455/2091 symbols completed. PGZ took 0.8s. Estimated remaining: 4m 6s. Rate: 155.1 symbols/min [2025-09-22T22:24:47.610014] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:47.610189] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:47.610357] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:47.622283] [DEBUG] [LOCAL ] PHD: Loaded 9661 existing records from primary storage. [2025-09-22T22:24:47.622386] [INFO ] [MAIN ] PHD: Loaded 9661 primary data records. [2025-09-22T22:24:47.977164] [DEBUG] [LOCAL ] PH: Loaded 39033 existing records from primary storage. [2025-09-22T22:24:47.977370] [INFO ] [MAIN ] PH: Loaded 39033 primary data records. [2025-09-22T22:24:47.989977] [DEBUG] [LOCAL ] PHG: Loaded 46232 existing records from primary storage. [2025-09-22T22:24:48.000256] [INFO ] [MAIN ] PHG: Loaded 46232 primary data records. [2025-09-22T22:24:48.628528] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:48.629601] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 9661 primary records. [2025-09-22T22:24:48.630162] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-22T22:24:48.648334] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-09-22T22:24:48.648671] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-22T22:24:48.651424] [INFO ] [MAIN ] Derivative Progress: 1456/2091 symbols completed. PHD took 1.0s. Estimated remaining: 4m 6s. Rate: 154.9 symbols/min [2025-09-22T22:24:48.651737] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:48.670270] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:48.672702] [INFO ] [MAIN ] PH: Generated 1794 derivative records from 39033 primary records. [2025-09-22T22:24:48.672876] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-22T22:24:48.711431] [DEBUG] [LOCAL ] PH: Derivative data saved (1794 records). [2025-09-22T22:24:48.701794] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:48.712102] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-22T22:24:48.713002] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 46232 primary records. [2025-09-22T22:24:48.715782] [INFO ] [MAIN ] Derivative Progress: 1457/2091 symbols completed. PH took 1.1s. Estimated remaining: 4m 5s. Rate: 155.0 symbols/min [2025-09-22T22:24:48.715972] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-22T22:24:48.718045] [DEBUG] [LOCAL ] PHI: Loaded 15014 existing records from primary storage. [2025-09-22T22:24:48.716313] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:48.718256] [INFO ] [MAIN ] PHI: Loaded 15014 primary data records. [2025-09-22T22:24:48.929252] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-09-22T22:24:48.945892] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-22T22:24:48.948560] [INFO ] [MAIN ] Derivative Progress: 1458/2091 symbols completed. PHG took 1.3s. Estimated remaining: 4m 5s. Rate: 155.0 symbols/min [2025-09-22T22:24:49.058042] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:49.052775] [DEBUG] [LOCAL ] PHIN: Loaded 33369 existing records from primary storage. [2025-09-22T22:24:49.066982] [INFO ] [MAIN ] PHIN: Loaded 33369 primary data records. [2025-09-22T22:24:49.442872] [DEBUG] [LOCAL ] PHK: Loaded 26488 existing records from primary storage. [2025-09-22T22:24:49.443919] [INFO ] [MAIN ] PHK: Loaded 26488 primary data records. [2025-09-22T22:24:49.530213] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:49.571504] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 15014 primary records. [2025-09-22T22:24:49.587983] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-22T22:24:49.794184] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-09-22T22:24:49.794479] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-22T22:24:49.796903] [INFO ] [MAIN ] Derivative Progress: 1459/2091 symbols completed. PHI took 1.1s. Estimated remaining: 4m 5s. Rate: 154.9 symbols/min [2025-09-22T22:24:49.799601] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:49.827097] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:49.828298] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 33369 primary records. [2025-09-22T22:24:49.829123] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-22T22:24:49.858678] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-09-22T22:24:49.858920] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-22T22:24:49.861541] [INFO ] [MAIN ] Derivative Progress: 1460/2091 symbols completed. PHIN took 1.1s. Estimated remaining: 4m 4s. Rate: 155.0 symbols/min [2025-09-22T22:24:49.862354] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:49.903890] [DEBUG] [LOCAL ] PHR: Loaded 37361 existing records from primary storage. [2025-09-22T22:24:49.902881] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:49.904141] [INFO ] [MAIN ] PHR: Loaded 37361 primary data records. [2025-09-22T22:24:49.905135] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26488 primary records. [2025-09-22T22:24:49.905366] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-22T22:24:49.963872] [DEBUG] [LOCAL ] PHT: Loaded 15339 existing records from primary storage. [2025-09-22T22:24:49.993680] [INFO ] [MAIN ] PHT: Loaded 15339 primary data records. [2025-09-22T22:24:50.163386] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-09-22T22:24:50.206131] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-22T22:24:50.245339] [INFO ] [MAIN ] Derivative Progress: 1461/2091 symbols completed. PHK took 1.2s. Estimated remaining: 4m 4s. Rate: 155.0 symbols/min [2025-09-22T22:24:50.288398] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:50.817730] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:50.818926] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 37361 primary records. [2025-09-22T22:24:50.819058] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-22T22:24:50.853706] [DEBUG] [LOCAL ] PII: Loaded 49284 existing records from primary storage. [2025-09-22T22:24:50.857917] [INFO ] [MAIN ] PII: Loaded 49284 primary data records. [2025-09-22T22:24:50.926154] [DEBUG] [MAIN ] PHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:50.940185] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-09-22T22:24:50.939635] [INFO ] [MAIN ] PHT: Generated 1794 derivative records from 15339 primary records. [2025-09-22T22:24:50.945473] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-22T22:24:50.951026] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-22T22:24:50.995550] [INFO ] [MAIN ] Derivative Progress: 1462/2091 symbols completed. PHR took 1.2s. Estimated remaining: 4m 4s. Rate: 154.9 symbols/min [2025-09-22T22:24:51.038560] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:51.190545] [DEBUG] [LOCAL ] PIM: Loaded 4732 existing records from primary storage. [2025-09-22T22:24:51.171278] [DEBUG] [LOCAL ] PHT: Derivative data saved (1794 records). [2025-09-22T22:24:51.197215] [INFO ] [MAIN ] PIM: Loaded 4732 primary data records. [2025-09-22T22:24:51.197394] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-22T22:24:51.206095] [INFO ] [MAIN ] Derivative Progress: 1463/2091 symbols completed. PHT took 1.3s. Estimated remaining: 4m 3s. Rate: 155.0 symbols/min [2025-09-22T22:24:51.292172] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:51.545923] [DEBUG] [LOCAL ] PINE: Loaded 14270 existing records from primary storage. [2025-09-22T22:24:51.546526] [INFO ] [MAIN ] PINE: Loaded 14270 primary data records. [2025-09-22T22:24:51.876514] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:52.030390] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 49284 primary records. [2025-09-22T22:24:52.039333] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-22T22:24:52.059019] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-09-22T22:24:52.059159] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-22T22:24:52.061887] [INFO ] [MAIN ] Derivative Progress: 1464/2091 symbols completed. PII took 1.8s. Estimated remaining: 4m 3s. Rate: 154.8 symbols/min [2025-09-22T22:24:52.063018] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:52.078526] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:52.079868] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4732 primary records. [2025-09-22T22:24:52.080126] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-22T22:24:52.097447] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-09-22T22:24:52.097805] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-22T22:24:52.100176] [INFO ] [MAIN ] Derivative Progress: 1465/2091 symbols completed. PIM took 1.1s. Estimated remaining: 4m 2s. Rate: 154.9 symbols/min [2025-09-22T22:24:52.100835] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:52.117993] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:52.118724] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14270 primary records. [2025-09-22T22:24:52.118948] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-22T22:24:52.158186] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-09-22T22:24:52.158278] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-22T22:24:52.157898] [DEBUG] [LOCAL ] PIPR: Loaded 15261 existing records from primary storage. [2025-09-22T22:24:52.160963] [INFO ] [MAIN ] Derivative Progress: 1466/2091 symbols completed. PINE took 0.9s. Estimated remaining: 4m 2s. Rate: 155.0 symbols/min [2025-09-22T22:24:52.161318] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:52.162175] [INFO ] [MAIN ] PIPR: Loaded 15261 primary data records. [2025-09-22T22:24:52.235188] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-22T22:24:52.262128] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-09-22T22:24:52.505466] [DEBUG] [LOCAL ] PJT: Loaded 22637 existing records from primary storage. [2025-09-22T22:24:52.623352] [INFO ] [MAIN ] PJT: Loaded 22637 primary data records. [2025-09-22T22:24:53.146449] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:53.159776] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-09-22T22:24:53.160217] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:53.159882] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-22T22:24:53.160988] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 15261 primary records. [2025-09-22T22:24:53.161179] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-22T22:24:53.192081] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-09-22T22:24:53.193749] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-22T22:24:53.196836] [INFO ] [MAIN ] Derivative Progress: 1467/2091 symbols completed. PINS took 1.1s. Estimated remaining: 4m 2s. Rate: 154.8 symbols/min [2025-09-22T22:24:53.197835] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-09-22T22:24:53.198438] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-22T22:24:53.198196] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:53.200667] [INFO ] [MAIN ] Derivative Progress: 1468/2091 symbols completed. PIPR took 1.1s. Estimated remaining: 4m 1s. Rate: 154.9 symbols/min [2025-09-22T22:24:53.218057] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:53.218710] [INFO ] [MAIN ] PJT: Generated 1794 derivative records from 22637 primary records. [2025-09-22T22:24:53.218810] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-22T22:24:53.234687] [DEBUG] [LOCAL ] PJT: Derivative data saved (1794 records). [2025-09-22T22:24:53.234830] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-22T22:24:53.237172] [INFO ] [MAIN ] Derivative Progress: 1469/2091 symbols completed. PJT took 1.1s. Estimated remaining: 4m 1s. Rate: 155.0 symbols/min [2025-09-22T22:24:53.278188] [DEBUG] [LOCAL ] PK: Loaded 52893 existing records from primary storage. [2025-09-22T22:24:53.278327] [INFO ] [MAIN ] PK: Loaded 52893 primary data records. [2025-09-22T22:24:53.586361] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:53.586991] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52893 primary records. [2025-09-22T22:24:53.587054] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-22T22:24:53.602419] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-09-22T22:24:53.602480] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-22T22:24:53.604571] [INFO ] [MAIN ] Derivative Progress: 1470/2091 symbols completed. PK took 0.4s. Estimated remaining: 4m 0s. Rate: 155.0 symbols/min [2025-09-22T22:24:53.605738] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:53.605594] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:53.605542] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:53.633045] [DEBUG] [LOCAL ] PKE: Loaded 12499 existing records from primary storage. [2025-09-22T22:24:53.633970] [DEBUG] [LOCAL ] PKST: Loaded 19390 existing records from primary storage. [2025-09-22T22:24:53.634044] [INFO ] [MAIN ] PKE: Loaded 12499 primary data records. [2025-09-22T22:24:53.634168] [INFO ] [MAIN ] PKST: Loaded 19390 primary data records. [2025-09-22T22:24:53.995396] [DEBUG] [LOCAL ] PKG: Loaded 39360 existing records from primary storage. [2025-09-22T22:24:54.157324] [INFO ] [MAIN ] PKG: Loaded 39360 primary data records. [2025-09-22T22:24:54.642247] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:54.642565] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:54.643684] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 12499 primary records. [2025-09-22T22:24:54.644570] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 19390 primary records. [2025-09-22T22:24:54.644704] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-22T22:24:54.644874] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-22T22:24:54.673246] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-09-22T22:24:54.675740] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-22T22:24:54.678936] [INFO ] [MAIN ] Derivative Progress: 1471/2091 symbols completed. PKE took 1.1s. Estimated remaining: 4m 0s. Rate: 154.9 symbols/min [2025-09-22T22:24:54.681112] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:54.697990] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-09-22T22:24:54.698190] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-22T22:24:54.700661] [INFO ] [MAIN ] Derivative Progress: 1472/2091 symbols completed. PKST took 1.1s. Estimated remaining: 3m 60s. Rate: 155.0 symbols/min [2025-09-22T22:24:54.697247] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:54.701848] [INFO ] [MAIN ] PKG: Generated 1794 derivative records from 39360 primary records. [2025-09-22T22:24:54.702006] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-22T22:24:54.701923] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:54.726472] [DEBUG] [LOCAL ] PKG: Derivative data saved (1794 records). [2025-09-22T22:24:54.726740] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-22T22:24:54.729796] [INFO ] [MAIN ] Derivative Progress: 1473/2091 symbols completed. PKG took 1.1s. Estimated remaining: 3m 59s. Rate: 155.1 symbols/min [2025-09-22T22:24:54.730163] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:54.741353] [DEBUG] [LOCAL ] PKX: Loaded 25251 existing records from primary storage. [2025-09-22T22:24:54.741574] [INFO ] [MAIN ] PKX: Loaded 25251 primary data records. [2025-09-22T22:24:55.103931] [DEBUG] [LOCAL ] PL: Loaded 53112 existing records from primary storage. [2025-09-22T22:24:55.104291] [INFO ] [MAIN ] PL: Loaded 53112 primary data records. [2025-09-22T22:24:55.214030] [DEBUG] [LOCAL ] PLD: Loaded 53488 existing records from primary storage. [2025-09-22T22:24:55.219829] [INFO ] [MAIN ] PLD: Loaded 53488 primary data records. [2025-09-22T22:24:55.805678] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:55.806762] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 25251 primary records. [2025-09-22T22:24:55.807237] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-22T22:24:55.831958] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-09-22T22:24:55.844867] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-22T22:24:55.847780] [INFO ] [MAIN ] Derivative Progress: 1474/2091 symbols completed. PKX took 1.2s. Estimated remaining: 3m 59s. Rate: 154.9 symbols/min [2025-09-22T22:24:55.848085] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:55.849720] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:55.849449] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53112 primary records. [2025-09-22T22:24:55.850116] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-22T22:24:55.872747] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-09-22T22:24:55.874912] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-22T22:24:55.877531] [INFO ] [MAIN ] Derivative Progress: 1475/2091 symbols completed. PL took 1.2s. Estimated remaining: 3m 59s. Rate: 155.0 symbols/min [2025-09-22T22:24:55.878176] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:55.892724] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:55.893436] [INFO ] [MAIN ] PLD: Generated 1794 derivative records from 53488 primary records. [2025-09-22T22:24:55.893567] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-22T22:24:55.909928] [DEBUG] [LOCAL ] PLD: Derivative data saved (1794 records). [2025-09-22T22:24:55.910079] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-22T22:24:55.912859] [INFO ] [MAIN ] Derivative Progress: 1476/2091 symbols completed. PLD took 1.2s. Estimated remaining: 3m 58s. Rate: 155.0 symbols/min [2025-09-22T22:24:55.913375] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:55.940702] [DEBUG] [LOCAL ] PLOW: Loaded 20572 existing records from primary storage. [2025-09-22T22:24:55.940959] [INFO ] [MAIN ] PLOW: Loaded 20572 primary data records. [2025-09-22T22:24:56.062874] [DEBUG] [LOCAL ] PLNT: Loaded 48488 existing records from primary storage. [2025-09-22T22:24:56.071318] [INFO ] [MAIN ] PLNT: Loaded 48488 primary data records. [2025-09-22T22:24:56.096140] [DEBUG] [LOCAL ] PLYM: Loaded 33185 existing records from primary storage. [2025-09-22T22:24:56.108351] [INFO ] [MAIN ] PLYM: Loaded 33185 primary data records. [2025-09-22T22:24:56.985061] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:56.986066] [INFO ] [MAIN ] PLOW: Generated 1794 derivative records from 20572 primary records. [2025-09-22T22:24:56.986270] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-22T22:24:57.018461] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:57.019453] [INFO ] [MAIN ] PLNT: Generated 1794 derivative records from 48488 primary records. [2025-09-22T22:24:57.019741] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-22T22:24:57.047055] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:57.049226] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 33185 primary records. [2025-09-22T22:24:57.050026] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-22T22:24:57.050873] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1794 records). [2025-09-22T22:24:57.052391] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-22T22:24:57.063004] [INFO ] [MAIN ] Derivative Progress: 1477/2091 symbols completed. PLOW took 1.2s. Estimated remaining: 3m 58s. Rate: 154.8 symbols/min [2025-09-22T22:24:57.063252] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:57.071246] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1794 records). [2025-09-22T22:24:57.071884] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-22T22:24:57.074300] [INFO ] [MAIN ] Derivative Progress: 1478/2091 symbols completed. PLNT took 1.2s. Estimated remaining: 3m 57s. Rate: 154.9 symbols/min [2025-09-22T22:24:57.074734] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:57.079344] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-09-22T22:24:57.079547] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-22T22:24:57.082986] [INFO ] [MAIN ] Derivative Progress: 1479/2091 symbols completed. PLYM took 1.2s. Estimated remaining: 3m 57s. Rate: 155.0 symbols/min [2025-09-22T22:24:57.091031] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:57.097258] [DEBUG] [LOCAL ] PMM: Loaded 10544 existing records from primary storage. [2025-09-22T22:24:57.103580] [INFO ] [MAIN ] PMM: Loaded 10544 primary data records. [2025-09-22T22:24:57.149242] [DEBUG] [LOCAL ] PML: Loaded 20451 existing records from primary storage. [2025-09-22T22:24:57.179178] [INFO ] [MAIN ] PML: Loaded 20451 primary data records. [2025-09-22T22:24:57.262245] [DEBUG] [LOCAL ] PMO: Loaded 10536 existing records from primary storage. [2025-09-22T22:24:57.295974] [INFO ] [MAIN ] PMO: Loaded 10536 primary data records. [2025-09-22T22:24:58.159519] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:58.159904] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:58.161184] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10544 primary records. [2025-09-22T22:24:58.162351] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 20451 primary records. [2025-09-22T22:24:58.161502] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-22T22:24:58.163399] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-22T22:24:58.191372] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-09-22T22:24:58.196256] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-22T22:24:58.195267] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-09-22T22:24:58.198811] [INFO ] [MAIN ] Derivative Progress: 1480/2091 symbols completed. PML took 1.1s. Estimated remaining: 3m 57s. Rate: 154.8 symbols/min [2025-09-22T22:24:58.198956] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-22T22:24:58.201513] [INFO ] [MAIN ] Derivative Progress: 1481/2091 symbols completed. PMM took 1.1s. Estimated remaining: 3m 56s. Rate: 155.0 symbols/min [2025-09-22T22:24:58.202478] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:58.202934] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:58.216936] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:58.217753] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10536 primary records. [2025-09-22T22:24:58.217953] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-22T22:24:58.235870] [DEBUG] [LOCAL ] PNI: Loaded 6722 existing records from primary storage. [2025-09-22T22:24:58.236547] [INFO ] [MAIN ] PNI: Loaded 6722 primary data records. [2025-09-22T22:24:58.350895] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-09-22T22:24:58.354479] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-22T22:24:58.356902] [INFO ] [MAIN ] Derivative Progress: 1482/2091 symbols completed. PMO took 1.3s. Estimated remaining: 3m 56s. Rate: 155.0 symbols/min [2025-09-22T22:24:58.373794] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:58.452534] [DEBUG] [LOCAL ] PMT: Loaded 40323 existing records from primary storage. [2025-09-22T22:24:58.567908] [INFO ] [MAIN ] PMT: Loaded 40323 primary data records. [2025-09-22T22:24:58.719424] [DEBUG] [LOCAL ] PNNT: Loaded 32871 existing records from primary storage. [2025-09-22T22:24:58.742145] [INFO ] [MAIN ] PNNT: Loaded 32871 primary data records. [2025-09-22T22:24:59.227674] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:59.229062] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6722 primary records. [2025-09-22T22:24:59.229602] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-22T22:24:59.248961] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-09-22T22:24:59.249110] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-22T22:24:59.251229] [INFO ] [MAIN ] Derivative Progress: 1483/2091 symbols completed. PNI took 1.0s. Estimated remaining: 3m 56s. Rate: 154.9 symbols/min [2025-09-22T22:24:59.266303] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:59.267179] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40323 primary records. [2025-09-22T22:24:59.267255] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-22T22:24:59.284579] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-09-22T22:24:59.284696] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-22T22:24:59.287170] [INFO ] [MAIN ] Derivative Progress: 1484/2091 symbols completed. PMT took 1.1s. Estimated remaining: 3m 55s. Rate: 155.0 symbols/min [2025-09-22T22:24:59.303486] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:24:59.304073] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 32871 primary records. [2025-09-22T22:24:59.304156] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-22T22:24:59.319082] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-09-22T22:24:59.319139] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-22T22:24:59.321738] [INFO ] [MAIN ] Derivative Progress: 1485/2091 symbols completed. PNNT took 1.0s. Estimated remaining: 3m 54s. Rate: 155.1 symbols/min [2025-09-22T22:24:59.322216] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:59.322524] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:59.322405] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:24:59.383681] [DEBUG] [LOCAL ] POST: Loaded 38990 existing records from primary storage. [2025-09-22T22:24:59.384045] [INFO ] [MAIN ] POST: Loaded 38990 primary data records. [2025-09-22T22:24:59.440991] [DEBUG] [LOCAL ] PNW: Loaded 45967 existing records from primary storage. [2025-09-22T22:24:59.479702] [INFO ] [MAIN ] PNW: Loaded 45967 primary data records. [2025-09-22T22:24:59.560051] [DEBUG] [LOCAL ] PPG: Loaded 50700 existing records from primary storage. [2025-09-22T22:24:59.582939] [INFO ] [MAIN ] PPG: Loaded 50700 primary data records. [2025-09-22T22:25:00.382191] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:00.383265] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38990 primary records. [2025-09-22T22:25:00.383476] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-22T22:25:00.404947] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-09-22T22:25:00.405354] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-22T22:25:00.420359] [INFO ] [MAIN ] Derivative Progress: 1486/2091 symbols completed. POST took 1.1s. Estimated remaining: 3m 54s. Rate: 154.9 symbols/min [2025-09-22T22:25:00.421146] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:00.422150] [INFO ] [MAIN ] PPG: Generated 1794 derivative records from 50700 primary records. [2025-09-22T22:25:00.430328] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:00.422475] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-22T22:25:00.436883] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:00.438514] [INFO ] [MAIN ] PNW: Generated 1794 derivative records from 45967 primary records. [2025-09-22T22:25:00.447506] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-22T22:25:00.467735] [DEBUG] [LOCAL ] PPG: Derivative data saved (1794 records). [2025-09-22T22:25:00.469868] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-22T22:25:00.472994] [INFO ] [MAIN ] Derivative Progress: 1487/2091 symbols completed. PPG took 1.2s. Estimated remaining: 3m 54s. Rate: 155.0 symbols/min [2025-09-22T22:25:00.475015] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:00.474734] [DEBUG] [LOCAL ] PNW: Derivative data saved (1794 records). [2025-09-22T22:25:00.475211] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-22T22:25:00.483596] [INFO ] [MAIN ] Derivative Progress: 1488/2091 symbols completed. PNW took 1.2s. Estimated remaining: 3m 53s. Rate: 155.1 symbols/min [2025-09-22T22:25:00.484030] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:00.494511] [DEBUG] [LOCAL ] PPT: Loaded 20406 existing records from primary storage. [2025-09-22T22:25:00.494957] [INFO ] [MAIN ] PPT: Loaded 20406 primary data records. [2025-09-22T22:25:00.711239] [DEBUG] [LOCAL ] PRA: Loaded 34733 existing records from primary storage. [2025-09-22T22:25:00.711479] [INFO ] [MAIN ] PRA: Loaded 34733 primary data records. [2025-09-22T22:25:00.980667] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-22T22:25:00.992087] [INFO ] [MAIN ] PR: Loaded 53609 primary data records. [2025-09-22T22:25:01.513855] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:01.514755] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 20406 primary records. [2025-09-22T22:25:01.516094] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-22T22:25:01.536163] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-09-22T22:25:01.536593] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-22T22:25:01.539439] [INFO ] [MAIN ] Derivative Progress: 1489/2091 symbols completed. PPT took 1.1s. Estimated remaining: 3m 53s. Rate: 154.9 symbols/min [2025-09-22T22:25:01.540018] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:01.561075] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:01.562133] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 34733 primary records. [2025-09-22T22:25:01.562309] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-22T22:25:01.581539] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-09-22T22:25:01.581917] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-22T22:25:01.584142] [INFO ] [MAIN ] Derivative Progress: 1490/2091 symbols completed. PRA took 1.1s. Estimated remaining: 3m 53s. Rate: 155.0 symbols/min [2025-09-22T22:25:01.584565] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:01.607948] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:01.608996] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53609 primary records. [2025-09-22T22:25:01.609202] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-22T22:25:01.635796] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-09-22T22:25:01.636438] [DEBUG] [LOCAL ] PRG: Loaded 30223 existing records from primary storage. [2025-09-22T22:25:01.636609] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-22T22:25:01.639551] [INFO ] [MAIN ] Derivative Progress: 1491/2091 symbols completed. PR took 1.2s. Estimated remaining: 3m 52s. Rate: 155.1 symbols/min [2025-09-22T22:25:01.639776] [INFO ] [MAIN ] PRG: Loaded 30223 primary data records. [2025-09-22T22:25:01.640288] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:01.756065] [DEBUG] [LOCAL ] PRH: Loaded 4919 existing records from primary storage. [2025-09-22T22:25:01.783622] [INFO ] [MAIN ] PRH: Loaded 4919 primary data records. [2025-09-22T22:25:02.108741] [DEBUG] [LOCAL ] PRGO: Loaded 46912 existing records from primary storage. [2025-09-22T22:25:02.156189] [INFO ] [MAIN ] PRGO: Loaded 46912 primary data records. [2025-09-22T22:25:02.693595] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:02.695179] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 30223 primary records. [2025-09-22T22:25:02.695392] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-22T22:25:02.715336] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-09-22T22:25:02.716404] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-22T22:25:02.718693] [INFO ] [MAIN ] Derivative Progress: 1492/2091 symbols completed. PRG took 1.2s. Estimated remaining: 3m 52s. Rate: 154.9 symbols/min [2025-09-22T22:25:02.719139] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:02.732735] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:02.733671] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4919 primary records. [2025-09-22T22:25:02.734014] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-22T22:25:02.752055] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-09-22T22:25:02.752324] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-22T22:25:02.754860] [INFO ] [MAIN ] Derivative Progress: 1493/2091 symbols completed. PRH took 1.1s. Estimated remaining: 3m 52s. Rate: 155.0 symbols/min [2025-09-22T22:25:02.763030] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:02.768425] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:02.773600] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 46912 primary records. [2025-09-22T22:25:02.773720] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-22T22:25:02.799982] [DEBUG] [LOCAL ] PRI: Loaded 18382 existing records from primary storage. [2025-09-22T22:25:02.800099] [INFO ] [MAIN ] PRI: Loaded 18382 primary data records. [2025-09-22T22:25:02.799430] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-09-22T22:25:02.800276] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-22T22:25:02.814082] [INFO ] [MAIN ] Derivative Progress: 1494/2091 symbols completed. PRGO took 1.2s. Estimated remaining: 3m 51s. Rate: 155.1 symbols/min [2025-09-22T22:25:02.835990] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:03.142079] [DEBUG] [LOCAL ] PRIM: Loaded 44558 existing records from primary storage. [2025-09-22T22:25:03.142355] [INFO ] [MAIN ] PRIM: Loaded 44558 primary data records. [2025-09-22T22:25:03.356448] [DEBUG] [LOCAL ] PRKS: Loaded 42728 existing records from primary storage. [2025-09-22T22:25:03.356781] [INFO ] [MAIN ] PRKS: Loaded 42728 primary data records. [2025-09-22T22:25:03.671805] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:03.682096] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 18382 primary records. [2025-09-22T22:25:03.706406] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-22T22:25:03.846940] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-09-22T22:25:03.848073] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-22T22:25:03.850825] [INFO ] [MAIN ] Derivative Progress: 1495/2091 symbols completed. PRI took 1.1s. Estimated remaining: 3m 51s. Rate: 154.9 symbols/min [2025-09-22T22:25:03.852744] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:03.870080] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:03.870908] [INFO ] [MAIN ] PRIM: Generated 1794 derivative records from 44558 primary records. [2025-09-22T22:25:03.871170] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-22T22:25:03.903845] [DEBUG] [LOCAL ] PRLB: Loaded 20804 existing records from primary storage. [2025-09-22T22:25:03.903492] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1794 records). [2025-09-22T22:25:03.904102] [INFO ] [MAIN ] PRLB: Loaded 20804 primary data records. [2025-09-22T22:25:03.909617] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-22T22:25:03.922264] [INFO ] [MAIN ] Derivative Progress: 1496/2091 symbols completed. PRIM took 1.2s. Estimated remaining: 3m 50s. Rate: 155.0 symbols/min [2025-09-22T22:25:03.978830] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:03.987985] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:04.005711] [INFO ] [MAIN ] PRKS: Generated 1794 derivative records from 42728 primary records. [2025-09-22T22:25:04.016443] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-22T22:25:04.180368] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1794 records). [2025-09-22T22:25:04.272626] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-22T22:25:04.275625] [INFO ] [MAIN ] Derivative Progress: 1497/2091 symbols completed. PRKS took 1.5s. Estimated remaining: 3m 50s. Rate: 155.0 symbols/min [2025-09-22T22:25:04.276064] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:04.310600] [DEBUG] [LOCAL ] PRM: Loaded 44595 existing records from primary storage. [2025-09-22T22:25:04.311834] [INFO ] [MAIN ] PRM: Loaded 44595 primary data records. [2025-09-22T22:25:04.435154] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:04.453730] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20804 primary records. [2025-09-22T22:25:04.502066] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-22T22:25:04.543671] [DEBUG] [LOCAL ] PRMB: Loaded 53164 existing records from primary storage. [2025-09-22T22:25:04.612724] [INFO ] [MAIN ] PRMB: Loaded 53164 primary data records. [2025-09-22T22:25:04.790860] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-09-22T22:25:04.802955] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-22T22:25:04.805237] [INFO ] [MAIN ] Derivative Progress: 1498/2091 symbols completed. PRLB took 1.0s. Estimated remaining: 3m 50s. Rate: 154.9 symbols/min [2025-09-22T22:25:05.028162] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:05.029391] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44595 primary records. [2025-09-22T22:25:05.029501] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-22T22:25:05.047181] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-09-22T22:25:05.047379] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-22T22:25:05.049731] [INFO ] [MAIN ] Derivative Progress: 1499/2091 symbols completed. PRM took 1.1s. Estimated remaining: 3m 49s. Rate: 155.0 symbols/min [2025-09-22T22:25:05.068815] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:05.069705] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53164 primary records. [2025-09-22T22:25:05.069770] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-22T22:25:05.087616] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-09-22T22:25:05.087729] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-22T22:25:05.090735] [INFO ] [MAIN ] Derivative Progress: 1500/2091 symbols completed. PRMB took 0.8s. Estimated remaining: 3m 49s. Rate: 155.1 symbols/min [2025-09-22T22:25:05.091425] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:05.091369] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:05.091915] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:05.099858] [DEBUG] [LOCAL ] PRT: Loaded 5343 existing records from primary storage. [2025-09-22T22:25:05.099982] [INFO ] [MAIN ] PRT: Loaded 5343 primary data records. [2025-09-22T22:25:05.447158] [DEBUG] [LOCAL ] PRO: Loaded 37483 existing records from primary storage. [2025-09-22T22:25:05.461629] [INFO ] [MAIN ] PRO: Loaded 37483 primary data records. [2025-09-22T22:25:05.473897] [DEBUG] [LOCAL ] PRU: Loaded 51519 existing records from primary storage. [2025-09-22T22:25:05.500346] [INFO ] [MAIN ] PRU: Loaded 51519 primary data records. [2025-09-22T22:25:06.153521] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:06.154803] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5343 primary records. [2025-09-22T22:25:06.155024] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-22T22:25:06.173428] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-09-22T22:25:06.173695] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-22T22:25:06.176055] [INFO ] [MAIN ] Derivative Progress: 1501/2091 symbols completed. PRT took 1.1s. Estimated remaining: 3m 49s. Rate: 154.9 symbols/min [2025-09-22T22:25:06.177171] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:06.197690] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:06.210581] [INFO ] [MAIN ] PRU: Generated 1794 derivative records from 51519 primary records. [2025-09-22T22:25:06.210895] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:06.211044] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-22T22:25:06.211605] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 37483 primary records. [2025-09-22T22:25:06.212363] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-22T22:25:06.237305] [DEBUG] [LOCAL ] PRU: Derivative data saved (1794 records). [2025-09-22T22:25:06.240012] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-22T22:25:06.242416] [INFO ] [MAIN ] Derivative Progress: 1502/2091 symbols completed. PRU took 1.2s. Estimated remaining: 3m 48s. Rate: 155.0 symbols/min [2025-09-22T22:25:06.244261] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:06.258283] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-09-22T22:25:06.258428] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-22T22:25:06.261315] [INFO ] [MAIN ] Derivative Progress: 1503/2091 symbols completed. PRO took 1.2s. Estimated remaining: 3m 48s. Rate: 155.1 symbols/min [2025-09-22T22:25:06.263687] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:06.280311] [DEBUG] [LOCAL ] PSBD: Loaded 6859 existing records from primary storage. [2025-09-22T22:25:06.280459] [INFO ] [MAIN ] PSBD: Loaded 6859 primary data records. [2025-09-22T22:25:06.292774] [DEBUG] [LOCAL ] PSA: Loaded 41908 existing records from primary storage. [2025-09-22T22:25:06.319056] [INFO ] [MAIN ] PSA: Loaded 41908 primary data records. [2025-09-22T22:25:06.474677] [DEBUG] [LOCAL ] PSF: Loaded 6776 existing records from primary storage. [2025-09-22T22:25:06.475191] [INFO ] [MAIN ] PSF: Loaded 6776 primary data records. [2025-09-22T22:25:07.273088] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:07.274933] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 6859 primary records. [2025-09-22T22:25:07.275840] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-22T22:25:07.310686] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-09-22T22:25:07.310560] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:07.311922] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-22T22:25:07.311830] [INFO ] [MAIN ] PSA: Generated 1794 derivative records from 41908 primary records. [2025-09-22T22:25:07.314358] [INFO ] [MAIN ] Derivative Progress: 1504/2091 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 47s. Rate: 154.9 symbols/min [2025-09-22T22:25:07.322173] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-22T22:25:07.328223] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:07.329008] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:07.330218] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6776 primary records. [2025-09-22T22:25:07.330519] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-22T22:25:07.358249] [DEBUG] [LOCAL ] PSA: Derivative data saved (1794 records). [2025-09-22T22:25:07.362116] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-22T22:25:07.361950] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-09-22T22:25:07.365276] [INFO ] [MAIN ] Derivative Progress: 1505/2091 symbols completed. PSA took 1.2s. Estimated remaining: 3m 47s. Rate: 155.0 symbols/min [2025-09-22T22:25:07.365729] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:07.365934] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-22T22:25:07.368937] [INFO ] [MAIN ] Derivative Progress: 1506/2091 symbols completed. PSF took 1.1s. Estimated remaining: 3m 46s. Rate: 155.1 symbols/min [2025-09-22T22:25:07.369351] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:07.398146] [DEBUG] [LOCAL ] PSFE: Loaded 30551 existing records from primary storage. [2025-09-22T22:25:07.398377] [INFO ] [MAIN ] PSFE: Loaded 30551 primary data records. [2025-09-22T22:25:07.633250] [DEBUG] [LOCAL ] PSO: Loaded 37585 existing records from primary storage. [2025-09-22T22:25:07.741943] [INFO ] [MAIN ] PSO: Loaded 37585 primary data records. [2025-09-22T22:25:07.750958] [DEBUG] [LOCAL ] PSN: Loaded 46289 existing records from primary storage. [2025-09-22T22:25:07.751792] [INFO ] [MAIN ] PSN: Loaded 46289 primary data records. [2025-09-22T22:25:08.424183] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:08.425954] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 30551 primary records. [2025-09-22T22:25:08.426638] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-22T22:25:08.453611] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-09-22T22:25:08.454165] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-22T22:25:08.457044] [INFO ] [MAIN ] Derivative Progress: 1507/2091 symbols completed. PSFE took 1.1s. Estimated remaining: 3m 46s. Rate: 154.9 symbols/min [2025-09-22T22:25:08.457579] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:08.477467] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:08.478671] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 37585 primary records. [2025-09-22T22:25:08.479742] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-22T22:25:08.521111] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:08.522564] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-09-22T22:25:08.523527] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 46289 primary records. [2025-09-22T22:25:08.523637] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-22T22:25:08.526231] [INFO ] [MAIN ] Derivative Progress: 1508/2091 symbols completed. PSO took 1.2s. Estimated remaining: 3m 46s. Rate: 155.0 symbols/min [2025-09-22T22:25:08.523798] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-22T22:25:08.527851] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:08.560435] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-09-22T22:25:08.561910] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-22T22:25:08.561788] [DEBUG] [LOCAL ] PSQH: Loaded 34454 existing records from primary storage. [2025-09-22T22:25:08.564601] [INFO ] [MAIN ] Derivative Progress: 1509/2091 symbols completed. PSN took 1.2s. Estimated remaining: 3m 45s. Rate: 155.1 symbols/min [2025-09-22T22:25:08.565155] [INFO ] [MAIN ] PSQH: Loaded 34454 primary data records. [2025-09-22T22:25:08.565236] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:08.708440] [DEBUG] [LOCAL ] PSTL: Loaded 20481 existing records from primary storage. [2025-09-22T22:25:08.724995] [INFO ] [MAIN ] PSTL: Loaded 20481 primary data records. [2025-09-22T22:25:09.098423] [DEBUG] [LOCAL ] PSTG: Loaded 52848 existing records from primary storage. [2025-09-22T22:25:09.108125] [INFO ] [MAIN ] PSTG: Loaded 52848 primary data records. [2025-09-22T22:25:09.586429] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:09.588879] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 34454 primary records. [2025-09-22T22:25:09.590194] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-22T22:25:09.610290] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-09-22T22:25:09.612154] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-22T22:25:09.614591] [INFO ] [MAIN ] Derivative Progress: 1510/2091 symbols completed. PSQH took 1.2s. Estimated remaining: 3m 45s. Rate: 154.9 symbols/min [2025-09-22T22:25:09.615221] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:09.629799] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:09.631087] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 20481 primary records. [2025-09-22T22:25:09.631383] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-22T22:25:09.650631] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-09-22T22:25:09.650942] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-22T22:25:09.653450] [INFO ] [MAIN ] Derivative Progress: 1511/2091 symbols completed. PSTL took 1.1s. Estimated remaining: 3m 45s. Rate: 155.0 symbols/min [2025-09-22T22:25:09.666552] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:09.666442] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:09.667856] [INFO ] [MAIN ] PSTG: Generated 1794 derivative records from 52848 primary records. [2025-09-22T22:25:09.668028] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-22T22:25:09.689265] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1794 records). [2025-09-22T22:25:09.694771] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-22T22:25:09.697985] [INFO ] [MAIN ] Derivative Progress: 1512/2091 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 44s. Rate: 155.1 symbols/min [2025-09-22T22:25:09.695159] [DEBUG] [LOCAL ] PTA: Loaded 14962 existing records from primary storage. [2025-09-22T22:25:09.698419] [INFO ] [MAIN ] PTA: Loaded 14962 primary data records. [2025-09-22T22:25:09.698489] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:09.900792] [DEBUG] [LOCAL ] PSX: Loaded 53126 existing records from primary storage. [2025-09-22T22:25:09.923615] [INFO ] [MAIN ] PSX: Loaded 53126 primary data records. [2025-09-22T22:25:10.151201] [DEBUG] [LOCAL ] PTY: Loaded 37378 existing records from primary storage. [2025-09-22T22:25:10.154789] [INFO ] [MAIN ] PTY: Loaded 37378 primary data records. [2025-09-22T22:25:10.727129] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:10.728719] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 14962 primary records. [2025-09-22T22:25:10.729014] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-22T22:25:10.765138] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:10.764810] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-09-22T22:25:10.766141] [INFO ] [MAIN ] PSX: Generated 1794 derivative records from 53126 primary records. [2025-09-22T22:25:10.766318] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-22T22:25:10.767368] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-22T22:25:10.769686] [INFO ] [MAIN ] Derivative Progress: 1513/2091 symbols completed. PTA took 1.1s. Estimated remaining: 3m 44s. Rate: 154.9 symbols/min [2025-09-22T22:25:10.800122] [DEBUG] [LOCAL ] PSX: Derivative data saved (1794 records). [2025-09-22T22:25:10.800236] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-22T22:25:10.803252] [INFO ] [MAIN ] Derivative Progress: 1514/2091 symbols completed. PSX took 1.2s. Estimated remaining: 3m 43s. Rate: 155.0 symbols/min [2025-09-22T22:25:10.803605] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:10.804451] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37378 primary records. [2025-09-22T22:25:10.804516] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-22T22:25:10.820076] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-09-22T22:25:10.820148] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-22T22:25:10.822616] [INFO ] [MAIN ] Derivative Progress: 1515/2091 symbols completed. PTY took 1.1s. Estimated remaining: 3m 43s. Rate: 155.1 symbols/min [2025-09-22T22:25:10.823252] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:10.824001] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:10.823557] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:10.893799] [DEBUG] [LOCAL ] PUMP: Loaded 49447 existing records from primary storage. [2025-09-22T22:25:10.907701] [INFO ] [MAIN ] PUMP: Loaded 49447 primary data records. [2025-09-22T22:25:10.942023] [DEBUG] [LOCAL ] PVH: Loaded 50466 existing records from primary storage. [2025-09-22T22:25:10.953264] [DEBUG] [LOCAL ] PUK: Loaded 44939 existing records from primary storage. [2025-09-22T22:25:10.953407] [INFO ] [MAIN ] PUK: Loaded 44939 primary data records. [2025-09-22T22:25:10.958612] [INFO ] [MAIN ] PVH: Loaded 50466 primary data records. [2025-09-22T22:25:11.872398] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:11.873684] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 50466 primary records. [2025-09-22T22:25:11.873939] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-22T22:25:11.895781] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-09-22T22:25:11.896117] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-22T22:25:11.898422] [INFO ] [MAIN ] Derivative Progress: 1516/2091 symbols completed. PVH took 1.1s. Estimated remaining: 3m 43s. Rate: 154.9 symbols/min [2025-09-22T22:25:11.906589] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:11.912698] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:11.927220] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49447 primary records. [2025-09-22T22:25:11.927609] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-22T22:25:11.927981] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:11.930510] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 44939 primary records. [2025-09-22T22:25:11.930830] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-22T22:25:11.967041] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-09-22T22:25:11.967122] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-09-22T22:25:11.951304] [DEBUG] [LOCAL ] PVL: Loaded 4716 existing records from primary storage. [2025-09-22T22:25:11.967478] [INFO ] [MAIN ] PVL: Loaded 4716 primary data records. [2025-09-22T22:25:11.967261] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-22T22:25:11.981566] [INFO ] [MAIN ] Derivative Progress: 1517/2091 symbols completed. PUK took 1.2s. Estimated remaining: 3m 42s. Rate: 155.0 symbols/min [2025-09-22T22:25:11.967606] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-22T22:25:12.014707] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:12.014526] [INFO ] [MAIN ] Derivative Progress: 1518/2091 symbols completed. PUMP took 1.2s. Estimated remaining: 3m 42s. Rate: 155.1 symbols/min [2025-09-22T22:25:12.015597] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:12.381565] [DEBUG] [LOCAL ] PX: Loaded 34678 existing records from primary storage. [2025-09-22T22:25:12.382435] [INFO ] [MAIN ] PX: Loaded 34678 primary data records. [2025-09-22T22:25:12.383294] [DEBUG] [LOCAL ] PWR: Loaded 47457 existing records from primary storage. [2025-09-22T22:25:12.383512] [INFO ] [MAIN ] PWR: Loaded 47457 primary data records. [2025-09-22T22:25:13.028064] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:13.029684] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4716 primary records. [2025-09-22T22:25:13.029884] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-22T22:25:13.050462] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-09-22T22:25:13.051329] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-22T22:25:13.054114] [INFO ] [MAIN ] Derivative Progress: 1519/2091 symbols completed. PVL took 1.2s. Estimated remaining: 3m 42s. Rate: 154.9 symbols/min [2025-09-22T22:25:13.054759] [INFO ] [MAIN ] QBTS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:13.083153] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:13.084169] [INFO ] [MAIN ] PWR: Generated 1794 derivative records from 47457 primary records. [2025-09-22T22:25:13.091701] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-22T22:25:13.106025] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:13.111261] [INFO ] [MAIN ] PX: Generated 1794 derivative records from 34678 primary records. [2025-09-22T22:25:13.112482] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-22T22:25:13.116691] [DEBUG] [LOCAL ] PWR: Derivative data saved (1794 records). [2025-09-22T22:25:13.116856] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-22T22:25:13.133360] [INFO ] [MAIN ] Derivative Progress: 1520/2091 symbols completed. PWR took 1.1s. Estimated remaining: 3m 41s. Rate: 155.0 symbols/min [2025-09-22T22:25:13.142077] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:13.149671] [DEBUG] [LOCAL ] PX: Derivative data saved (1794 records). [2025-09-22T22:25:13.154071] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-22T22:25:13.156721] [INFO ] [MAIN ] Derivative Progress: 1521/2091 symbols completed. PX took 1.1s. Estimated remaining: 3m 41s. Rate: 155.1 symbols/min [2025-09-22T22:25:13.157897] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:13.175901] [DEBUG] [LOCAL ] QBTS: Loaded 53746 existing records from primary storage. [2025-09-22T22:25:13.176114] [INFO ] [MAIN ] QBTS: Loaded 53746 primary data records. [2025-09-22T22:25:13.353847] [DEBUG] [LOCAL ] QD: Loaded 28012 existing records from primary storage. [2025-09-22T22:25:13.385394] [INFO ] [MAIN ] QD: Loaded 28012 primary data records. [2025-09-22T22:25:13.698136] [DEBUG] [LOCAL ] QGEN: Loaded 49200 existing records from primary storage. [2025-09-22T22:25:13.715859] [INFO ] [MAIN ] QGEN: Loaded 49200 primary data records. [2025-09-22T22:25:14.039377] [DEBUG] [MAIN ] QBTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:14.045043] [INFO ] [MAIN ] QBTS: Generated 1794 derivative records from 53746 primary records. [2025-09-22T22:25:14.216255] [DEBUG] [LOCAL ] QBTS: Saving derivative data. [2025-09-22T22:25:14.238429] [DEBUG] [LOCAL ] QBTS: Derivative data saved (1794 records). [2025-09-22T22:25:14.239613] [INFO ] [MAIN ] QBTS: Successfully saved derivative data. [2025-09-22T22:25:14.241914] [INFO ] [MAIN ] Derivative Progress: 1522/2091 symbols completed. QBTS took 1.2s. Estimated remaining: 3m 40s. Rate: 154.9 symbols/min [2025-09-22T22:25:14.242594] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:14.256780] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:14.257498] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 28012 primary records. [2025-09-22T22:25:14.257687] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-22T22:25:14.276475] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-09-22T22:25:14.276672] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-22T22:25:14.278952] [INFO ] [MAIN ] Derivative Progress: 1523/2091 symbols completed. QD took 1.1s. Estimated remaining: 3m 40s. Rate: 155.0 symbols/min [2025-09-22T22:25:14.279445] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:14.296114] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:14.297262] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49200 primary records. [2025-09-22T22:25:14.297436] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-22T22:25:14.329396] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-09-22T22:25:14.329511] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-22T22:25:14.332460] [INFO ] [MAIN ] Derivative Progress: 1524/2091 symbols completed. QGEN took 1.2s. Estimated remaining: 3m 39s. Rate: 155.1 symbols/min [2025-09-22T22:25:14.332888] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:14.364494] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-22T22:25:14.364846] [INFO ] [MAIN ] QS: Loaded 53742 primary data records. [2025-09-22T22:25:14.495269] [DEBUG] [LOCAL ] QSR: Loaded 52408 existing records from primary storage. [2025-09-22T22:25:14.535015] [INFO ] [MAIN ] QSR: Loaded 52408 primary data records. [2025-09-22T22:25:14.600524] [DEBUG] [LOCAL ] QTWO: Loaded 39065 existing records from primary storage. [2025-09-22T22:25:14.642470] [INFO ] [MAIN ] QTWO: Loaded 39065 primary data records. [2025-09-22T22:25:15.345757] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:15.348248] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53742 primary records. [2025-09-22T22:25:15.348897] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-22T22:25:15.379802] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:15.382576] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52408 primary records. [2025-09-22T22:25:15.383526] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-22T22:25:15.385976] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-09-22T22:25:15.400844] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-22T22:25:15.403889] [INFO ] [MAIN ] Derivative Progress: 1525/2091 symbols completed. QS took 1.2s. Estimated remaining: 3m 39s. Rate: 154.9 symbols/min [2025-09-22T22:25:15.404936] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:15.420388] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-09-22T22:25:15.420669] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:15.421057] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-22T22:25:15.423544] [INFO ] [MAIN ] Derivative Progress: 1526/2091 symbols completed. QSR took 1.1s. Estimated remaining: 3m 39s. Rate: 155.0 symbols/min [2025-09-22T22:25:15.423967] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:15.425114] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 39065 primary records. [2025-09-22T22:25:15.425368] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-22T22:25:15.444136] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-09-22T22:25:15.449720] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-22T22:25:15.454241] [INFO ] [MAIN ] Derivative Progress: 1527/2091 symbols completed. QTWO took 1.1s. Estimated remaining: 3m 38s. Rate: 155.1 symbols/min [2025-09-22T22:25:15.454661] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:15.461010] [DEBUG] [LOCAL ] QVCC: Loaded 9000 existing records from primary storage. [2025-09-22T22:25:15.461240] [INFO ] [MAIN ] QVCC: Loaded 9000 primary data records. [2025-09-22T22:25:15.530773] [DEBUG] [LOCAL ] QUAD: Loaded 23909 existing records from primary storage. [2025-09-22T22:25:15.554735] [DEBUG] [LOCAL ] QVCD: Loaded 4556 existing records from primary storage. [2025-09-22T22:25:15.560007] [INFO ] [MAIN ] QUAD: Loaded 23909 primary data records. [2025-09-22T22:25:15.560156] [INFO ] [MAIN ] QVCD: Loaded 4556 primary data records. [2025-09-22T22:25:16.501068] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:16.502339] [INFO ] [MAIN ] QVCC: Generated 1794 derivative records from 9000 primary records. [2025-09-22T22:25:16.502543] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-22T22:25:16.539998] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1794 records). [2025-09-22T22:25:16.540406] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-22T22:25:16.539061] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:16.542626] [INFO ] [MAIN ] Derivative Progress: 1528/2091 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 38s. Rate: 154.9 symbols/min [2025-09-22T22:25:16.544447] [INFO ] [MAIN ] QVCD: Generated 1794 derivative records from 4556 primary records. [2025-09-22T22:25:16.544937] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-22T22:25:16.559189] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:16.560437] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23909 primary records. [2025-09-22T22:25:16.560569] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-22T22:25:16.587855] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1794 records). [2025-09-22T22:25:16.588755] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-22T22:25:16.591044] [INFO ] [MAIN ] Derivative Progress: 1529/2091 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 38s. Rate: 155.0 symbols/min [2025-09-22T22:25:16.594316] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-09-22T22:25:16.594455] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-22T22:25:16.597042] [INFO ] [MAIN ] Derivative Progress: 1530/2091 symbols completed. QUAD took 1.2s. Estimated remaining: 3m 37s. Rate: 155.1 symbols/min [2025-09-22T22:25:16.597695] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:16.598134] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:16.598304] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:16.631767] [DEBUG] [LOCAL ] RA: Loaded 21611 existing records from primary storage. [2025-09-22T22:25:16.631942] [INFO ] [MAIN ] RA: Loaded 21611 primary data records. [2025-09-22T22:25:16.748341] [DEBUG] [LOCAL ] R: Loaded 29636 existing records from primary storage. [2025-09-22T22:25:16.755870] [INFO ] [MAIN ] R: Loaded 29636 primary data records. [2025-09-22T22:25:16.944509] [DEBUG] [LOCAL ] QXO: Loaded 53160 existing records from primary storage. [2025-09-22T22:25:17.079300] [INFO ] [MAIN ] QXO: Loaded 53160 primary data records. [2025-09-22T22:25:17.632432] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:17.633789] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21611 primary records. [2025-09-22T22:25:17.633881] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-22T22:25:17.655264] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-09-22T22:25:17.656199] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-22T22:25:17.658286] [INFO ] [MAIN ] Derivative Progress: 1531/2091 symbols completed. RA took 1.1s. Estimated remaining: 3m 37s. Rate: 154.9 symbols/min [2025-09-22T22:25:17.658871] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:17.672868] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:17.673622] [INFO ] [MAIN ] R: Generated 1794 derivative records from 29636 primary records. [2025-09-22T22:25:17.673822] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-22T22:25:17.693167] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-09-22T22:25:17.693512] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-22T22:25:17.695908] [INFO ] [MAIN ] Derivative Progress: 1532/2091 symbols completed. R took 1.1s. Estimated remaining: 3m 36s. Rate: 155.0 symbols/min [2025-09-22T22:25:17.714708] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:17.715402] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:17.716611] [INFO ] [MAIN ] QXO: Generated 1794 derivative records from 53160 primary records. [2025-09-22T22:25:17.716866] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-22T22:25:17.753995] [DEBUG] [LOCAL ] QXO: Derivative data saved (1794 records). [2025-09-22T22:25:17.754925] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-22T22:25:17.757476] [INFO ] [MAIN ] Derivative Progress: 1533/2091 symbols completed. QXO took 1.2s. Estimated remaining: 3m 36s. Rate: 155.1 symbols/min [2025-09-22T22:25:17.754815] [DEBUG] [LOCAL ] RACE: Loaded 32934 existing records from primary storage. [2025-09-22T22:25:17.758011] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:17.758145] [INFO ] [MAIN ] RACE: Loaded 32934 primary data records. [2025-09-22T22:25:17.922610] [DEBUG] [LOCAL ] RAMP: Loaded 37700 existing records from primary storage. [2025-09-22T22:25:17.946447] [INFO ] [MAIN ] RAMP: Loaded 37700 primary data records. [2025-09-22T22:25:18.308971] [DEBUG] [LOCAL ] RBA: Loaded 46015 existing records from primary storage. [2025-09-22T22:25:18.309276] [INFO ] [MAIN ] RBA: Loaded 46015 primary data records. [2025-09-22T22:25:18.812462] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:18.813638] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 32934 primary records. [2025-09-22T22:25:18.813771] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-22T22:25:18.834192] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-09-22T22:25:18.835415] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-22T22:25:18.837982] [INFO ] [MAIN ] Derivative Progress: 1534/2091 symbols completed. RACE took 1.2s. Estimated remaining: 3m 36s. Rate: 154.9 symbols/min [2025-09-22T22:25:18.838235] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:18.852468] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:18.853453] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37700 primary records. [2025-09-22T22:25:18.854851] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-22T22:25:18.882144] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-09-22T22:25:18.882307] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-22T22:25:18.884637] [INFO ] [MAIN ] Derivative Progress: 1535/2091 symbols completed. RAMP took 1.2s. Estimated remaining: 3m 35s. Rate: 155.0 symbols/min [2025-09-22T22:25:18.885692] [DEBUG] [LOCAL ] RBC: Loaded 15130 existing records from primary storage. [2025-09-22T22:25:18.885033] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:18.886396] [INFO ] [MAIN ] RBC: Loaded 15130 primary data records. [2025-09-22T22:25:19.049992] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:19.096022] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 46015 primary records. [2025-09-22T22:25:19.205117] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-22T22:25:19.267848] [DEBUG] [LOCAL ] RBLX: Loaded 53721 existing records from primary storage. [2025-09-22T22:25:19.269475] [INFO ] [MAIN ] RBLX: Loaded 53721 primary data records. [2025-09-22T22:25:19.269207] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-09-22T22:25:19.269754] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-22T22:25:19.290417] [INFO ] [MAIN ] Derivative Progress: 1536/2091 symbols completed. RBA took 1.5s. Estimated remaining: 3m 35s. Rate: 155.0 symbols/min [2025-09-22T22:25:19.301882] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:19.398091] [DEBUG] [LOCAL ] RBOT: Loaded 5044 existing records from primary storage. [2025-09-22T22:25:19.398378] [INFO ] [MAIN ] RBOT: Loaded 5044 primary data records. [2025-09-22T22:25:19.710785] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:19.734488] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 15130 primary records. [2025-09-22T22:25:19.748870] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-22T22:25:19.950551] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-09-22T22:25:19.959908] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-22T22:25:19.962594] [INFO ] [MAIN ] Derivative Progress: 1537/2091 symbols completed. RBC took 1.1s. Estimated remaining: 3m 35s. Rate: 154.9 symbols/min [2025-09-22T22:25:19.964320] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:19.989751] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:19.993614] [INFO ] [MAIN ] RBLX: Generated 1794 derivative records from 53721 primary records. [2025-09-22T22:25:19.993952] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-22T22:25:20.027580] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1794 records). [2025-09-22T22:25:20.027831] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-22T22:25:20.030216] [INFO ] [MAIN ] Derivative Progress: 1538/2091 symbols completed. RBLX took 1.1s. Estimated remaining: 3m 34s. Rate: 155.0 symbols/min [2025-09-22T22:25:20.038186] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:20.043368] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:20.044450] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 5044 primary records. [2025-09-22T22:25:20.044619] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-22T22:25:20.074083] [DEBUG] [LOCAL ] RBRK: Loaded 53104 existing records from primary storage. [2025-09-22T22:25:20.074850] [INFO ] [MAIN ] RBRK: Loaded 53104 primary data records. [2025-09-22T22:25:20.087292] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-09-22T22:25:20.087497] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-22T22:25:20.110082] [INFO ] [MAIN ] Derivative Progress: 1539/2091 symbols completed. RBOT took 0.8s. Estimated remaining: 3m 34s. Rate: 155.1 symbols/min [2025-09-22T22:25:20.135091] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:20.441156] [DEBUG] [LOCAL ] RC: Loaded 49018 existing records from primary storage. [2025-09-22T22:25:20.441544] [INFO ] [MAIN ] RC: Loaded 49018 primary data records. [2025-09-22T22:25:20.665514] [DEBUG] [LOCAL ] RCI: Loaded 48837 existing records from primary storage. [2025-09-22T22:25:20.782136] [INFO ] [MAIN ] RCI: Loaded 48837 primary data records. [2025-09-22T22:25:20.919746] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:20.941239] [INFO ] [MAIN ] RBRK: Generated 1794 derivative records from 53104 primary records. [2025-09-22T22:25:20.975967] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-22T22:25:21.147076] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1794 records). [2025-09-22T22:25:21.148395] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-22T22:25:21.152716] [INFO ] [MAIN ] Derivative Progress: 1540/2091 symbols completed. RBRK took 1.2s. Estimated remaining: 3m 33s. Rate: 154.9 symbols/min [2025-09-22T22:25:21.153521] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:21.167977] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:21.169053] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 49018 primary records. [2025-09-22T22:25:21.169385] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-22T22:25:21.195034] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-09-22T22:25:21.196329] [DEBUG] [LOCAL ] RCS: Loaded 11483 existing records from primary storage. [2025-09-22T22:25:21.197282] [INFO ] [MAIN ] RCS: Loaded 11483 primary data records. [2025-09-22T22:25:21.197599] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-22T22:25:21.269177] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:21.239276] [INFO ] [MAIN ] Derivative Progress: 1541/2091 symbols completed. RC took 1.2s. Estimated remaining: 3m 33s. Rate: 155.0 symbols/min [2025-09-22T22:25:21.306402] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:21.315082] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48837 primary records. [2025-09-22T22:25:21.318898] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-22T22:25:21.550380] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-09-22T22:25:21.550769] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-22T22:25:21.553215] [INFO ] [MAIN ] Derivative Progress: 1542/2091 symbols completed. RCI took 1.4s. Estimated remaining: 3m 32s. Rate: 155.0 symbols/min [2025-09-22T22:25:21.554609] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:21.586307] [DEBUG] [LOCAL ] RCUS: Loaded 42754 existing records from primary storage. [2025-09-22T22:25:21.586758] [INFO ] [MAIN ] RCUS: Loaded 42754 primary data records. [2025-09-22T22:25:21.693404] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:21.720589] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 11483 primary records. [2025-09-22T22:25:21.724715] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-22T22:25:21.968037] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-09-22T22:25:21.968193] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-22T22:25:21.970195] [INFO ] [MAIN ] Derivative Progress: 1543/2091 symbols completed. RCS took 0.8s. Estimated remaining: 3m 32s. Rate: 155.0 symbols/min [2025-09-22T22:25:21.971378] [DEBUG] [LOCAL ] RDDT: Loaded 53783 existing records from primary storage. [2025-09-22T22:25:21.971695] [INFO ] [MAIN ] RDDT: Loaded 53783 primary data records. [2025-09-22T22:25:22.309300] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:22.310163] [INFO ] [MAIN ] RCUS: Generated 1794 derivative records from 42754 primary records. [2025-09-22T22:25:22.311109] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-22T22:25:22.329255] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1794 records). [2025-09-22T22:25:22.330797] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-22T22:25:22.333560] [INFO ] [MAIN ] Derivative Progress: 1544/2091 symbols completed. RCUS took 1.0s. Estimated remaining: 3m 32s. Rate: 155.0 symbols/min [2025-09-22T22:25:22.346423] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:25:22.347121] [INFO ] [MAIN ] RDDT: Generated 1793 derivative records from 53783 primary records. [2025-09-22T22:25:22.347188] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-22T22:25:22.363191] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1793 records). [2025-09-22T22:25:22.363311] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-22T22:25:22.365307] [INFO ] [MAIN ] Derivative Progress: 1545/2091 symbols completed. RDDT took 0.8s. Estimated remaining: 3m 31s. Rate: 155.1 symbols/min [2025-09-22T22:25:22.366030] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:22.366237] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:22.366170] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:22.457181] [DEBUG] [LOCAL ] RDW: Loaded 52001 existing records from primary storage. [2025-09-22T22:25:22.457828] [INFO ] [MAIN ] RDW: Loaded 52001 primary data records. [2025-09-22T22:25:22.480147] [DEBUG] [LOCAL ] RDN: Loaded 45213 existing records from primary storage. [2025-09-22T22:25:22.514786] [INFO ] [MAIN ] RDN: Loaded 45213 primary data records. [2025-09-22T22:25:22.614961] [DEBUG] [LOCAL ] RDY: Loaded 46850 existing records from primary storage. [2025-09-22T22:25:22.647346] [INFO ] [MAIN ] RDY: Loaded 46850 primary data records. [2025-09-22T22:25:23.472961] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:23.474155] [INFO ] [MAIN ] RDW: Generated 1794 derivative records from 52001 primary records. [2025-09-22T22:25:23.474348] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-22T22:25:23.501448] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:23.502995] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 45213 primary records. [2025-09-22T22:25:23.506430] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-22T22:25:23.508695] [DEBUG] [LOCAL ] RDW: Derivative data saved (1794 records). [2025-09-22T22:25:23.509070] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-22T22:25:23.511202] [INFO ] [MAIN ] Derivative Progress: 1546/2091 symbols completed. RDW took 1.1s. Estimated remaining: 3m 31s. Rate: 154.9 symbols/min [2025-09-22T22:25:23.519175] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:23.528461] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-09-22T22:25:23.528869] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-22T22:25:23.531380] [INFO ] [MAIN ] Derivative Progress: 1547/2091 symbols completed. RDN took 1.2s. Estimated remaining: 3m 31s. Rate: 155.0 symbols/min [2025-09-22T22:25:23.531838] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:23.550605] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:23.551544] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 46850 primary records. [2025-09-22T22:25:23.551721] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-22T22:25:23.584531] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-09-22T22:25:23.584918] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-22T22:25:23.587833] [INFO ] [MAIN ] Derivative Progress: 1548/2091 symbols completed. RDY took 1.2s. Estimated remaining: 3m 30s. Rate: 155.1 symbols/min [2025-09-22T22:25:23.588358] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:23.616526] [DEBUG] [LOCAL ] RERE: Loaded 41004 existing records from primary storage. [2025-09-22T22:25:23.616707] [INFO ] [MAIN ] RERE: Loaded 41004 primary data records. [2025-09-22T22:25:23.736634] [DEBUG] [LOCAL ] RELX: Loaded 47843 existing records from primary storage. [2025-09-22T22:25:23.751336] [INFO ] [MAIN ] RELX: Loaded 47843 primary data records. [2025-09-22T22:25:24.074208] [DEBUG] [LOCAL ] RES: Loaded 47534 existing records from primary storage. [2025-09-22T22:25:24.101550] [INFO ] [MAIN ] RES: Loaded 47534 primary data records. [2025-09-22T22:25:24.687734] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:24.690065] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41004 primary records. [2025-09-22T22:25:24.690689] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-22T22:25:24.709914] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-09-22T22:25:24.712518] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-22T22:25:24.714989] [INFO ] [MAIN ] Derivative Progress: 1549/2091 symbols completed. RERE took 1.2s. Estimated remaining: 3m 30s. Rate: 154.9 symbols/min [2025-09-22T22:25:24.715455] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:24.729103] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:24.729785] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 47843 primary records. [2025-09-22T22:25:24.729857] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-22T22:25:24.747613] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-09-22T22:25:24.750677] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-22T22:25:24.753237] [INFO ] [MAIN ] Derivative Progress: 1550/2091 symbols completed. RELX took 1.2s. Estimated remaining: 3m 29s. Rate: 155.0 symbols/min [2025-09-22T22:25:24.753776] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:24.771706] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:24.772747] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 47534 primary records. [2025-09-22T22:25:24.772882] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-22T22:25:24.805578] [DEBUG] [LOCAL ] REX: Loaded 13909 existing records from primary storage. [2025-09-22T22:25:24.808690] [INFO ] [MAIN ] REX: Loaded 13909 primary data records. [2025-09-22T22:25:24.846664] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-09-22T22:25:24.898191] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-22T22:25:24.911284] [INFO ] [MAIN ] Derivative Progress: 1551/2091 symbols completed. RES took 1.3s. Estimated remaining: 3m 29s. Rate: 155.1 symbols/min [2025-09-22T22:25:24.929242] [DEBUG] [LOCAL ] REVG: Loaded 41123 existing records from primary storage. [2025-09-22T22:25:24.929478] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:24.929738] [INFO ] [MAIN ] REVG: Loaded 41123 primary data records. [2025-09-22T22:25:25.477336] [DEBUG] [LOCAL ] REXR: Loaded 52060 existing records from primary storage. [2025-09-22T22:25:25.478038] [INFO ] [MAIN ] REXR: Loaded 52060 primary data records. [2025-09-22T22:25:25.691850] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:25.813237] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 13909 primary records. [2025-09-22T22:25:25.814002] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-22T22:25:25.827633] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:25.840579] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 41123 primary records. [2025-09-22T22:25:25.844019] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-22T22:25:25.846559] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-09-22T22:25:25.846877] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-22T22:25:25.849538] [INFO ] [MAIN ] Derivative Progress: 1552/2091 symbols completed. REX took 1.1s. Estimated remaining: 3m 29s. Rate: 154.9 symbols/min [2025-09-22T22:25:25.850072] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:25.866432] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-09-22T22:25:25.866778] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-22T22:25:25.869097] [INFO ] [MAIN ] Derivative Progress: 1553/2091 symbols completed. REVG took 1.2s. Estimated remaining: 3m 28s. Rate: 155.0 symbols/min [2025-09-22T22:25:25.870599] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:25.891193] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:25.892342] [INFO ] [MAIN ] REXR: Generated 1794 derivative records from 52060 primary records. [2025-09-22T22:25:25.892416] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-22T22:25:25.910467] [DEBUG] [LOCAL ] REXR: Derivative data saved (1794 records). [2025-09-22T22:25:25.910751] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-22T22:25:25.913282] [INFO ] [MAIN ] Derivative Progress: 1554/2091 symbols completed. REXR took 1.0s. Estimated remaining: 3m 28s. Rate: 155.1 symbols/min [2025-09-22T22:25:25.913817] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:25.961393] [DEBUG] [LOCAL ] RFI: Loaded 10479 existing records from primary storage. [2025-09-22T22:25:25.962743] [INFO ] [MAIN ] RFI: Loaded 10479 primary data records. [2025-09-22T22:25:25.962603] [DEBUG] [LOCAL ] REZI: Loaded 46841 existing records from primary storage. [2025-09-22T22:25:26.000026] [INFO ] [MAIN ] REZI: Loaded 46841 primary data records. [2025-09-22T22:25:26.177759] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-22T22:25:26.195035] [INFO ] [MAIN ] RF: Loaded 53630 primary data records. [2025-09-22T22:25:26.953511] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:26.955962] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10479 primary records. [2025-09-22T22:25:26.956211] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-22T22:25:26.982113] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:26.985951] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 46841 primary records. [2025-09-22T22:25:26.986822] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-09-22T22:25:26.987833] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-22T22:25:26.986926] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-22T22:25:26.991210] [INFO ] [MAIN ] Derivative Progress: 1555/2091 symbols completed. RFI took 1.1s. Estimated remaining: 3m 28s. Rate: 154.9 symbols/min [2025-09-22T22:25:26.992724] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:27.017391] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:27.018540] [INFO ] [MAIN ] RF: Generated 1794 derivative records from 53630 primary records. [2025-09-22T22:25:27.019160] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-22T22:25:27.045097] [DEBUG] [LOCAL ] RFL: Loaded 10857 existing records from primary storage. [2025-09-22T22:25:27.045178] [DEBUG] [LOCAL ] RF: Derivative data saved (1794 records). [2025-09-22T22:25:27.045464] [INFO ] [MAIN ] RFL: Loaded 10857 primary data records. [2025-09-22T22:25:27.045336] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-09-22T22:25:27.045402] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-22T22:25:27.076868] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-22T22:25:27.084481] [INFO ] [MAIN ] Derivative Progress: 1556/2091 symbols completed. RF took 1.2s. Estimated remaining: 3m 27s. Rate: 155.0 symbols/min [2025-09-22T22:25:27.099010] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:27.106901] [INFO ] [MAIN ] Derivative Progress: 1557/2091 symbols completed. REZI took 1.2s. Estimated remaining: 3m 27s. Rate: 155.1 symbols/min [2025-09-22T22:25:27.107349] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:27.162297] [DEBUG] [LOCAL ] RFM: Loaded 4119 existing records from primary storage. [2025-09-22T22:25:27.173182] [INFO ] [MAIN ] RFM: Loaded 4119 primary data records. [2025-09-22T22:25:27.235478] [DEBUG] [LOCAL ] RFMZ: Loaded 8608 existing records from primary storage. [2025-09-22T22:25:27.301266] [INFO ] [MAIN ] RFMZ: Loaded 8608 primary data records. [2025-09-22T22:25:28.009069] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:28.011581] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 10857 primary records. [2025-09-22T22:25:28.011903] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-22T22:25:28.041796] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-09-22T22:25:28.042621] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:28.042264] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-22T22:25:28.046082] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4119 primary records. [2025-09-22T22:25:28.044902] [INFO ] [MAIN ] Derivative Progress: 1558/2091 symbols completed. RFL took 1.1s. Estimated remaining: 3m 26s. Rate: 154.9 symbols/min [2025-09-22T22:25:28.046274] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-22T22:25:28.060430] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:28.061460] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8608 primary records. [2025-09-22T22:25:28.061544] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-22T22:25:28.083739] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-09-22T22:25:28.083839] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-22T22:25:28.088924] [INFO ] [MAIN ] Derivative Progress: 1559/2091 symbols completed. RFM took 1.0s. Estimated remaining: 3m 26s. Rate: 155.0 symbols/min [2025-09-22T22:25:28.093833] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-09-22T22:25:28.093928] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-22T22:25:28.096464] [INFO ] [MAIN ] Derivative Progress: 1560/2091 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 25s. Rate: 155.1 symbols/min [2025-09-22T22:25:28.097008] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:28.097182] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:28.097343] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:28.105003] [DEBUG] [LOCAL ] RGT: Loaded 2903 existing records from primary storage. [2025-09-22T22:25:28.105231] [INFO ] [MAIN ] RGT: Loaded 2903 primary data records. [2025-09-22T22:25:28.232567] [DEBUG] [LOCAL ] RGR: Loaded 20285 existing records from primary storage. [2025-09-22T22:25:28.233189] [INFO ] [MAIN ] RGR: Loaded 20285 primary data records. [2025-09-22T22:25:28.409855] [DEBUG] [LOCAL ] RGA: Loaded 30179 existing records from primary storage. [2025-09-22T22:25:28.585533] [INFO ] [MAIN ] RGA: Loaded 30179 primary data records. [2025-09-22T22:25:29.158115] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:29.159184] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2903 primary records. [2025-09-22T22:25:29.159574] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-22T22:25:29.177827] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-09-22T22:25:29.179162] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-22T22:25:29.182326] [INFO ] [MAIN ] Derivative Progress: 1561/2091 symbols completed. RGT took 1.1s. Estimated remaining: 3m 25s. Rate: 155.0 symbols/min [2025-09-22T22:25:29.183772] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:29.199345] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:29.200317] [INFO ] [MAIN ] RGR: Generated 1794 derivative records from 20285 primary records. [2025-09-22T22:25:29.200504] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-22T22:25:29.220595] [DEBUG] [LOCAL ] RGR: Derivative data saved (1794 records). [2025-09-22T22:25:29.220768] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-22T22:25:29.223507] [INFO ] [MAIN ] Derivative Progress: 1562/2091 symbols completed. RGR took 1.1s. Estimated remaining: 3m 25s. Rate: 155.0 symbols/min [2025-09-22T22:25:29.224054] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:29.237666] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:29.238496] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 30179 primary records. [2025-09-22T22:25:29.238599] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-22T22:25:29.266279] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-09-22T22:25:29.266499] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-22T22:25:29.269015] [INFO ] [MAIN ] Derivative Progress: 1563/2091 symbols completed. RGA took 1.2s. Estimated remaining: 3m 24s. Rate: 155.1 symbols/min [2025-09-22T22:25:29.269382] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:29.287710] [DEBUG] [LOCAL ] RH: Loaded 47705 existing records from primary storage. [2025-09-22T22:25:29.287953] [INFO ] [MAIN ] RH: Loaded 47705 primary data records. [2025-09-22T22:25:29.469191] [DEBUG] [LOCAL ] RHI: Loaded 49247 existing records from primary storage. [2025-09-22T22:25:29.492179] [INFO ] [MAIN ] RHI: Loaded 49247 primary data records. [2025-09-22T22:25:29.692627] [DEBUG] [LOCAL ] RHP: Loaded 41809 existing records from primary storage. [2025-09-22T22:25:29.710306] [INFO ] [MAIN ] RHP: Loaded 41809 primary data records. [2025-09-22T22:25:30.316903] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:30.317979] [INFO ] [MAIN ] RH: Generated 1794 derivative records from 47705 primary records. [2025-09-22T22:25:30.318495] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-22T22:25:30.339155] [DEBUG] [LOCAL ] RH: Derivative data saved (1794 records). [2025-09-22T22:25:30.339303] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-22T22:25:30.342035] [INFO ] [MAIN ] Derivative Progress: 1564/2091 symbols completed. RH took 1.2s. Estimated remaining: 3m 24s. Rate: 155.0 symbols/min [2025-09-22T22:25:30.342632] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:30.365381] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:30.374889] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 41809 primary records. [2025-09-22T22:25:30.380376] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-22T22:25:30.380677] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:30.382370] [INFO ] [MAIN ] RHI: Generated 1794 derivative records from 49247 primary records. [2025-09-22T22:25:30.382761] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-22T22:25:30.413499] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-09-22T22:25:30.413963] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-22T22:25:30.416979] [INFO ] [MAIN ] Derivative Progress: 1565/2091 symbols completed. RHP took 1.1s. Estimated remaining: 3m 24s. Rate: 155.0 symbols/min [2025-09-22T22:25:30.417589] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:30.436518] [DEBUG] [LOCAL ] RHI: Derivative data saved (1794 records). [2025-09-22T22:25:30.436829] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-22T22:25:30.440033] [INFO ] [MAIN ] Derivative Progress: 1566/2091 symbols completed. RHI took 1.2s. Estimated remaining: 3m 23s. Rate: 155.1 symbols/min [2025-09-22T22:25:30.440659] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:30.466046] [DEBUG] [LOCAL ] RIG: Loaded 53669 existing records from primary storage. [2025-09-22T22:25:30.468739] [INFO ] [MAIN ] RIG: Loaded 53669 primary data records. [2025-09-22T22:25:30.565370] [DEBUG] [LOCAL ] RIV: Loaded 11847 existing records from primary storage. [2025-09-22T22:25:30.591633] [INFO ] [MAIN ] RIV: Loaded 11847 primary data records. [2025-09-22T22:25:30.785532] [DEBUG] [LOCAL ] RITM: Loaded 52818 existing records from primary storage. [2025-09-22T22:25:30.958432] [INFO ] [MAIN ] RITM: Loaded 52818 primary data records. [2025-09-22T22:25:31.522260] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:31.523920] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53669 primary records. [2025-09-22T22:25:31.524898] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-22T22:25:31.556598] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:31.556260] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-09-22T22:25:31.556884] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-22T22:25:31.558901] [INFO ] [MAIN ] Derivative Progress: 1567/2091 symbols completed. RIG took 1.2s. Estimated remaining: 3m 23s. Rate: 154.9 symbols/min [2025-09-22T22:25:31.559862] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 11847 primary records. [2025-09-22T22:25:31.560177] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:31.560011] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-22T22:25:31.578458] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-09-22T22:25:31.578738] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-22T22:25:31.581417] [INFO ] [MAIN ] Derivative Progress: 1568/2091 symbols completed. RIV took 1.1s. Estimated remaining: 3m 22s. Rate: 155.0 symbols/min [2025-09-22T22:25:31.582716] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:31.599397] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:31.600383] [INFO ] [MAIN ] RITM: Generated 1794 derivative records from 52818 primary records. [2025-09-22T22:25:31.600453] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-22T22:25:31.628679] [DEBUG] [LOCAL ] RITM: Derivative data saved (1794 records). [2025-09-22T22:25:31.628886] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-22T22:25:31.631523] [INFO ] [MAIN ] Derivative Progress: 1569/2091 symbols completed. RITM took 1.2s. Estimated remaining: 3m 22s. Rate: 155.1 symbols/min [2025-09-22T22:25:31.631943] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:31.664464] [DEBUG] [LOCAL ] RJF: Loaded 47125 existing records from primary storage. [2025-09-22T22:25:31.664697] [INFO ] [MAIN ] RJF: Loaded 47125 primary data records. [2025-09-22T22:25:31.837160] [DEBUG] [LOCAL ] RKT: Loaded 53721 existing records from primary storage. [2025-09-22T22:25:31.866886] [INFO ] [MAIN ] RKT: Loaded 53721 primary data records. [2025-09-22T22:25:31.889083] [DEBUG] [LOCAL ] RL: Loaded 41735 existing records from primary storage. [2025-09-22T22:25:32.074825] [INFO ] [MAIN ] RL: Loaded 41735 primary data records. [2025-09-22T22:25:32.725056] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:32.726684] [INFO ] [MAIN ] RJF: Generated 1794 derivative records from 47125 primary records. [2025-09-22T22:25:32.727307] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-22T22:25:32.765290] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:32.767236] [INFO ] [MAIN ] RKT: Generated 1794 derivative records from 53721 primary records. [2025-09-22T22:25:32.767549] [DEBUG] [LOCAL ] RJF: Derivative data saved (1794 records). [2025-09-22T22:25:32.768059] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-22T22:25:32.768141] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-22T22:25:32.773218] [INFO ] [MAIN ] Derivative Progress: 1570/2091 symbols completed. RJF took 1.2s. Estimated remaining: 3m 22s. Rate: 154.9 symbols/min [2025-09-22T22:25:32.774312] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:32.796112] [DEBUG] [LOCAL ] RKT: Derivative data saved (1794 records). [2025-09-22T22:25:32.796357] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-22T22:25:32.801386] [INFO ] [MAIN ] Derivative Progress: 1571/2091 symbols completed. RKT took 1.2s. Estimated remaining: 3m 21s. Rate: 155.0 symbols/min [2025-09-22T22:25:32.801913] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:32.822138] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:25:32.823119] [INFO ] [MAIN ] RL: Generated 1793 derivative records from 41735 primary records. [2025-09-22T22:25:32.823343] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-22T22:25:32.860421] [DEBUG] [LOCAL ] RLI: Loaded 33263 existing records from primary storage. [2025-09-22T22:25:32.860947] [INFO ] [MAIN ] RLI: Loaded 33263 primary data records. [2025-09-22T22:25:32.930021] [DEBUG] [LOCAL ] RL: Derivative data saved (1793 records). [2025-09-22T22:25:32.958870] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-22T22:25:32.974661] [INFO ] [MAIN ] Derivative Progress: 1572/2091 symbols completed. RL took 1.3s. Estimated remaining: 3m 21s. Rate: 155.1 symbols/min [2025-09-22T22:25:32.986087] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:33.096043] [DEBUG] [LOCAL ] RLJ: Loaded 48288 existing records from primary storage. [2025-09-22T22:25:33.096472] [INFO ] [MAIN ] RLJ: Loaded 48288 primary data records. [2025-09-22T22:25:33.254637] [DEBUG] [LOCAL ] RLTY: Loaded 11142 existing records from primary storage. [2025-09-22T22:25:33.268000] [INFO ] [MAIN ] RLTY: Loaded 11142 primary data records. [2025-09-22T22:25:33.883330] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:33.884787] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 33263 primary records. [2025-09-22T22:25:33.885081] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-22T22:25:33.904854] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-09-22T22:25:33.905497] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-22T22:25:33.907762] [INFO ] [MAIN ] Derivative Progress: 1573/2091 symbols completed. RLI took 1.1s. Estimated remaining: 3m 21s. Rate: 154.9 symbols/min [2025-09-22T22:25:33.921560] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:33.922308] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 48288 primary records. [2025-09-22T22:25:33.922504] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-22T22:25:33.941451] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-09-22T22:25:33.941778] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-22T22:25:33.944338] [INFO ] [MAIN ] Derivative Progress: 1574/2091 symbols completed. RLJ took 1.1s. Estimated remaining: 3m 20s. Rate: 155.0 symbols/min [2025-09-22T22:25:33.957702] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:33.958398] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11142 primary records. [2025-09-22T22:25:33.958464] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-22T22:25:33.973746] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-09-22T22:25:33.973812] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-22T22:25:33.976141] [INFO ] [MAIN ] Derivative Progress: 1575/2091 symbols completed. RLTY took 1.0s. Estimated remaining: 3m 20s. Rate: 155.1 symbols/min [2025-09-22T22:25:33.977911] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:33.978087] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:33.977715] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:34.000400] [DEBUG] [LOCAL ] RM: Loaded 7663 existing records from primary storage. [2025-09-22T22:25:34.004350] [INFO ] [MAIN ] RM: Loaded 7663 primary data records. [2025-09-22T22:25:34.069415] [DEBUG] [LOCAL ] RMAX: Loaded 21874 existing records from primary storage. [2025-09-22T22:25:34.102222] [INFO ] [MAIN ] RMAX: Loaded 21874 primary data records. [2025-09-22T22:25:34.333192] [DEBUG] [LOCAL ] RLX: Loaded 48160 existing records from primary storage. [2025-09-22T22:25:34.349337] [INFO ] [MAIN ] RLX: Loaded 48160 primary data records. [2025-09-22T22:25:35.119800] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:35.133435] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7663 primary records. [2025-09-22T22:25:35.134035] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-22T22:25:35.133869] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:35.136521] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21874 primary records. [2025-09-22T22:25:35.143466] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-22T22:25:35.167691] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-09-22T22:25:35.169797] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-22T22:25:35.172820] [INFO ] [MAIN ] Derivative Progress: 1576/2091 symbols completed. RM took 1.2s. Estimated remaining: 3m 19s. Rate: 154.9 symbols/min [2025-09-22T22:25:35.173983] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:35.176403] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-09-22T22:25:35.188990] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-22T22:25:35.192507] [INFO ] [MAIN ] Derivative Progress: 1577/2091 symbols completed. RMAX took 1.2s. Estimated remaining: 3m 19s. Rate: 155.0 symbols/min [2025-09-22T22:25:35.189378] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:35.193000] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:35.193830] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48160 primary records. [2025-09-22T22:25:35.194059] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-22T22:25:35.213217] [DEBUG] [LOCAL ] RMI: Loaded 4662 existing records from primary storage. [2025-09-22T22:25:35.214112] [INFO ] [MAIN ] RMI: Loaded 4662 primary data records. [2025-09-22T22:25:35.238130] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-09-22T22:25:35.238278] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-22T22:25:35.251910] [INFO ] [MAIN ] Derivative Progress: 1578/2091 symbols completed. RLX took 1.3s. Estimated remaining: 3m 18s. Rate: 155.1 symbols/min [2025-09-22T22:25:35.259736] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:35.371682] [DEBUG] [LOCAL ] RMM: Loaded 10264 existing records from primary storage. [2025-09-22T22:25:35.431262] [INFO ] [MAIN ] RMM: Loaded 10264 primary data records. [2025-09-22T22:25:35.568597] [DEBUG] [LOCAL ] RMD: Loaded 42401 existing records from primary storage. [2025-09-22T22:25:35.607203] [INFO ] [MAIN ] RMD: Loaded 42401 primary data records. [2025-09-22T22:25:36.259715] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:25:36.260995] [INFO ] [MAIN ] RMI: Generated 1793 derivative records from 4662 primary records. [2025-09-22T22:25:36.261154] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-22T22:25:36.283996] [DEBUG] [LOCAL ] RMI: Derivative data saved (1793 records). [2025-09-22T22:25:36.284109] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-22T22:25:36.290981] [INFO ] [MAIN ] Derivative Progress: 1579/2091 symbols completed. RMI took 1.1s. Estimated remaining: 3m 18s. Rate: 154.9 symbols/min [2025-09-22T22:25:36.291614] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:36.326872] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:36.327515] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:36.329437] [INFO ] [MAIN ] RMD: Generated 1794 derivative records from 42401 primary records. [2025-09-22T22:25:36.328391] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10264 primary records. [2025-09-22T22:25:36.329582] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-22T22:25:36.330739] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-22T22:25:36.343751] [DEBUG] [LOCAL ] RMMZ: Loaded 4827 existing records from primary storage. [2025-09-22T22:25:36.354882] [INFO ] [MAIN ] RMMZ: Loaded 4827 primary data records. [2025-09-22T22:25:36.462516] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-09-22T22:25:36.473890] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-22T22:25:36.473761] [DEBUG] [LOCAL ] RMD: Derivative data saved (1794 records). [2025-09-22T22:25:36.476660] [INFO ] [MAIN ] Derivative Progress: 1580/2091 symbols completed. RMM took 1.2s. Estimated remaining: 3m 18s. Rate: 155.0 symbols/min [2025-09-22T22:25:36.476829] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-22T22:25:36.485316] [INFO ] [MAIN ] Derivative Progress: 1581/2091 symbols completed. RMD took 1.3s. Estimated remaining: 3m 17s. Rate: 155.1 symbols/min [2025-09-22T22:25:36.485480] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:36.506569] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:36.689733] [DEBUG] [LOCAL ] RMT: Loaded 17603 existing records from primary storage. [2025-09-22T22:25:36.690015] [INFO ] [MAIN ] RMT: Loaded 17603 primary data records. [2025-09-22T22:25:37.080069] [DEBUG] [LOCAL ] RNG: Loaded 48169 existing records from primary storage. [2025-09-22T22:25:37.080694] [INFO ] [MAIN ] RNG: Loaded 48169 primary data records. [2025-09-22T22:25:37.190974] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:37.205853] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4827 primary records. [2025-09-22T22:25:37.220994] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-22T22:25:37.461809] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-09-22T22:25:37.462462] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-22T22:25:37.466970] [INFO ] [MAIN ] Derivative Progress: 1582/2091 symbols completed. RMMZ took 1.2s. Estimated remaining: 3m 17s. Rate: 154.9 symbols/min [2025-09-22T22:25:37.467415] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:37.486729] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:37.487695] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17603 primary records. [2025-09-22T22:25:37.487820] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-22T22:25:37.515115] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-09-22T22:25:37.515351] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-22T22:25:37.518037] [INFO ] [MAIN ] Derivative Progress: 1583/2091 symbols completed. RMT took 1.0s. Estimated remaining: 3m 17s. Rate: 155.0 symbols/min [2025-09-22T22:25:37.518480] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:37.538877] [DEBUG] [LOCAL ] RNGR: Loaded 20420 existing records from primary storage. [2025-09-22T22:25:37.544394] [INFO ] [MAIN ] RNGR: Loaded 20420 primary data records. [2025-09-22T22:25:37.544328] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:37.545290] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 48169 primary records. [2025-09-22T22:25:37.557081] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-22T22:25:37.651282] [DEBUG] [LOCAL ] RNP: Loaded 15794 existing records from primary storage. [2025-09-22T22:25:37.669095] [INFO ] [MAIN ] RNP: Loaded 15794 primary data records. [2025-09-22T22:25:37.809867] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-09-22T22:25:37.882432] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-22T22:25:37.995855] [INFO ] [MAIN ] Derivative Progress: 1584/2091 symbols completed. RNG took 1.5s. Estimated remaining: 3m 16s. Rate: 155.0 symbols/min [2025-09-22T22:25:38.026979] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:38.247233] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:38.248351] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20420 primary records. [2025-09-22T22:25:38.248494] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-22T22:25:38.284019] [DEBUG] [LOCAL ] RNR: Loaded 34514 existing records from primary storage. [2025-09-22T22:25:38.289173] [INFO ] [MAIN ] RNR: Loaded 34514 primary data records. [2025-09-22T22:25:38.312261] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:38.335304] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 15794 primary records. [2025-09-22T22:25:38.356140] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-22T22:25:38.375342] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-09-22T22:25:38.380596] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-22T22:25:38.396331] [INFO ] [MAIN ] Derivative Progress: 1585/2091 symbols completed. RNGR took 0.9s. Estimated remaining: 3m 16s. Rate: 155.0 symbols/min [2025-09-22T22:25:38.407555] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:38.603049] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-09-22T22:25:38.613028] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-22T22:25:38.615731] [INFO ] [MAIN ] Derivative Progress: 1586/2091 symbols completed. RNP took 1.1s. Estimated remaining: 3m 15s. Rate: 155.0 symbols/min [2025-09-22T22:25:38.616154] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:38.665460] [DEBUG] [LOCAL ] RNST: Loaded 37229 existing records from primary storage. [2025-09-22T22:25:38.666073] [INFO ] [MAIN ] RNST: Loaded 37229 primary data records. [2025-09-22T22:25:38.789735] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:38.782913] [DEBUG] [LOCAL ] ROG: Loaded 23190 existing records from primary storage. [2025-09-22T22:25:38.803408] [INFO ] [MAIN ] ROG: Loaded 23190 primary data records. [2025-09-22T22:25:38.798899] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 34514 primary records. [2025-09-22T22:25:38.803670] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-22T22:25:38.961898] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-09-22T22:25:38.967259] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-22T22:25:38.993708] [INFO ] [MAIN ] Derivative Progress: 1587/2091 symbols completed. RNR took 1.0s. Estimated remaining: 3m 15s. Rate: 155.0 symbols/min [2025-09-22T22:25:39.146203] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:39.422638] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:39.423565] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 37229 primary records. [2025-09-22T22:25:39.425333] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-22T22:25:39.424966] [DEBUG] [LOCAL ] ROK: Loaded 43991 existing records from primary storage. [2025-09-22T22:25:39.425721] [INFO ] [MAIN ] ROK: Loaded 43991 primary data records. [2025-09-22T22:25:39.507691] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:39.513960] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 23190 primary records. [2025-09-22T22:25:39.522496] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-22T22:25:39.528322] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-09-22T22:25:39.528469] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-22T22:25:39.537306] [INFO ] [MAIN ] Derivative Progress: 1588/2091 symbols completed. RNST took 1.1s. Estimated remaining: 3m 15s. Rate: 155.0 symbols/min [2025-09-22T22:25:39.636249] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-09-22T22:25:39.667226] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-22T22:25:39.699801] [INFO ] [MAIN ] Derivative Progress: 1589/2091 symbols completed. ROG took 1.1s. Estimated remaining: 3m 14s. Rate: 155.0 symbols/min [2025-09-22T22:25:39.850435] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:39.851196] [INFO ] [MAIN ] ROK: Generated 1794 derivative records from 43991 primary records. [2025-09-22T22:25:39.851260] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-22T22:25:39.866910] [DEBUG] [LOCAL ] ROK: Derivative data saved (1794 records). [2025-09-22T22:25:39.866982] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-22T22:25:39.869222] [INFO ] [MAIN ] Derivative Progress: 1590/2091 symbols completed. ROK took 0.9s. Estimated remaining: 3m 14s. Rate: 155.1 symbols/min [2025-09-22T22:25:39.870377] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:39.870290] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:39.869942] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:39.892060] [DEBUG] [LOCAL ] RPT: Loaded 19586 existing records from primary storage. [2025-09-22T22:25:39.892346] [INFO ] [MAIN ] RPT: Loaded 19586 primary data records. [2025-09-22T22:25:40.196904] [DEBUG] [LOCAL ] ROL: Loaded 50278 existing records from primary storage. [2025-09-22T22:25:40.195413] [DEBUG] [LOCAL ] RPM: Loaded 41138 existing records from primary storage. [2025-09-22T22:25:40.240980] [INFO ] [MAIN ] ROL: Loaded 50278 primary data records. [2025-09-22T22:25:40.241146] [INFO ] [MAIN ] RPM: Loaded 41138 primary data records. [2025-09-22T22:25:40.960306] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:40.961373] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 19586 primary records. [2025-09-22T22:25:40.963696] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-22T22:25:40.981840] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-09-22T22:25:40.982223] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-22T22:25:40.984356] [INFO ] [MAIN ] Derivative Progress: 1591/2091 symbols completed. RPT took 1.1s. Estimated remaining: 3m 14s. Rate: 154.9 symbols/min [2025-09-22T22:25:40.985052] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:41.006237] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:41.019420] [INFO ] [MAIN ] ROL: Generated 1794 derivative records from 50278 primary records. [2025-09-22T22:25:41.020372] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-22T22:25:41.020292] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:41.022062] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 41138 primary records. [2025-09-22T22:25:41.022166] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-22T22:25:41.061847] [DEBUG] [LOCAL ] ROL: Derivative data saved (1794 records). [2025-09-22T22:25:41.070098] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-22T22:25:41.072520] [INFO ] [MAIN ] Derivative Progress: 1592/2091 symbols completed. ROL took 1.2s. Estimated remaining: 3m 13s. Rate: 155.0 symbols/min [2025-09-22T22:25:41.075411] [DEBUG] [LOCAL ] RQI: Loaded 29114 existing records from primary storage. [2025-09-22T22:25:41.074862] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:41.076159] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-09-22T22:25:41.076278] [INFO ] [MAIN ] RQI: Loaded 29114 primary data records. [2025-09-22T22:25:41.076419] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-22T22:25:41.080171] [INFO ] [MAIN ] Derivative Progress: 1593/2091 symbols completed. RPM took 1.2s. Estimated remaining: 3m 13s. Rate: 155.1 symbols/min [2025-09-22T22:25:41.085951] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:41.452144] [DEBUG] [LOCAL ] RRC: Loaded 52775 existing records from primary storage. [2025-09-22T22:25:41.452768] [INFO ] [MAIN ] RRC: Loaded 52775 primary data records. [2025-09-22T22:25:41.453672] [DEBUG] [LOCAL ] RRX: Loaded 41123 existing records from primary storage. [2025-09-22T22:25:41.490508] [INFO ] [MAIN ] RRX: Loaded 41123 primary data records. [2025-09-22T22:25:42.118495] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:42.120387] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 29114 primary records. [2025-09-22T22:25:42.121099] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-22T22:25:42.142787] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-09-22T22:25:42.142996] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-22T22:25:42.145312] [INFO ] [MAIN ] Derivative Progress: 1594/2091 symbols completed. RQI took 1.2s. Estimated remaining: 3m 13s. Rate: 154.9 symbols/min [2025-09-22T22:25:42.147694] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:42.190871] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:42.197175] [INFO ] [MAIN ] RRC: Generated 1794 derivative records from 52775 primary records. [2025-09-22T22:25:42.197359] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-22T22:25:42.197777] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:42.210685] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 41123 primary records. [2025-09-22T22:25:42.210798] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-22T22:25:42.214538] [DEBUG] [LOCAL ] RS: Loaded 25645 existing records from primary storage. [2025-09-22T22:25:42.243139] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-09-22T22:25:42.243259] [INFO ] [MAIN ] RS: Loaded 25645 primary data records. [2025-09-22T22:25:42.246715] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-22T22:25:42.262979] [INFO ] [MAIN ] Derivative Progress: 1595/2091 symbols completed. RRX took 1.2s. Estimated remaining: 3m 12s. Rate: 155.0 symbols/min [2025-09-22T22:25:42.273714] [DEBUG] [LOCAL ] RRC: Derivative data saved (1794 records). [2025-09-22T22:25:42.298299] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:42.319475] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-22T22:25:42.344991] [INFO ] [MAIN ] Derivative Progress: 1596/2091 symbols completed. RRC took 1.3s. Estimated remaining: 3m 12s. Rate: 155.1 symbols/min [2025-09-22T22:25:42.364130] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:42.378509] [DEBUG] [LOCAL ] RSF: Loaded 4117 existing records from primary storage. [2025-09-22T22:25:42.389527] [INFO ] [MAIN ] RSF: Loaded 4117 primary data records. [2025-09-22T22:25:42.942558] [DEBUG] [LOCAL ] RSG: Loaded 47449 existing records from primary storage. [2025-09-22T22:25:42.943898] [INFO ] [MAIN ] RSG: Loaded 47449 primary data records. [2025-09-22T22:25:43.120845] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:43.137928] [INFO ] [MAIN ] RS: Generated 1794 derivative records from 25645 primary records. [2025-09-22T22:25:43.143966] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-22T22:25:43.340321] [DEBUG] [LOCAL ] RS: Derivative data saved (1794 records). [2025-09-22T22:25:43.340870] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-22T22:25:43.358519] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:43.358098] [INFO ] [MAIN ] Derivative Progress: 1597/2091 symbols completed. RS took 1.2s. Estimated remaining: 3m 11s. Rate: 154.9 symbols/min [2025-09-22T22:25:43.359615] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4117 primary records. [2025-09-22T22:25:43.360221] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-22T22:25:43.360418] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:43.379575] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-09-22T22:25:43.379924] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-22T22:25:43.382173] [INFO ] [MAIN ] Derivative Progress: 1598/2091 symbols completed. RSF took 1.1s. Estimated remaining: 3m 11s. Rate: 155.0 symbols/min [2025-09-22T22:25:43.382569] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:43.430816] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:43.431600] [INFO ] [MAIN ] RSG: Generated 1794 derivative records from 47449 primary records. [2025-09-22T22:25:43.431762] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-22T22:25:43.458581] [DEBUG] [LOCAL ] RSG: Derivative data saved (1794 records). [2025-09-22T22:25:43.470073] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-22T22:25:43.472782] [INFO ] [MAIN ] Derivative Progress: 1599/2091 symbols completed. RSG took 1.1s. Estimated remaining: 3m 10s. Rate: 155.1 symbols/min [2025-09-22T22:25:43.474771] [DEBUG] [LOCAL ] RSKD: Loaded 34175 existing records from primary storage. [2025-09-22T22:25:43.474897] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:43.475344] [INFO ] [MAIN ] RSKD: Loaded 34175 primary data records. [2025-09-22T22:25:43.521115] [DEBUG] [LOCAL ] RSI: Loaded 47135 existing records from primary storage. [2025-09-22T22:25:43.548231] [INFO ] [MAIN ] RSI: Loaded 47135 primary data records. [2025-09-22T22:25:44.043376] [DEBUG] [LOCAL ] RTO: Loaded 40406 existing records from primary storage. [2025-09-22T22:25:44.086701] [INFO ] [MAIN ] RTO: Loaded 40406 primary data records. [2025-09-22T22:25:44.812137] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:44.813128] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 34175 primary records. [2025-09-22T22:25:44.814224] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-22T22:25:44.840107] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-09-22T22:25:44.859916] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-22T22:25:44.865048] [INFO ] [MAIN ] Derivative Progress: 1600/2091 symbols completed. RSKD took 1.5s. Estimated remaining: 3m 10s. Rate: 154.8 symbols/min [2025-09-22T22:25:44.867794] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:44.868612] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:44.869839] [INFO ] [MAIN ] RSI: Generated 1794 derivative records from 47135 primary records. [2025-09-22T22:25:44.871153] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-22T22:25:44.899480] [DEBUG] [LOCAL ] RSI: Derivative data saved (1794 records). [2025-09-22T22:25:44.900199] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-22T22:25:44.903403] [INFO ] [MAIN ] Derivative Progress: 1601/2091 symbols completed. RSI took 1.5s. Estimated remaining: 3m 10s. Rate: 154.9 symbols/min [2025-09-22T22:25:44.904317] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:44.931002] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:44.932105] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 40406 primary records. [2025-09-22T22:25:44.932252] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-22T22:25:44.952388] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-09-22T22:25:44.952636] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-22T22:25:44.956112] [INFO ] [MAIN ] Derivative Progress: 1602/2091 symbols completed. RTO took 1.5s. Estimated remaining: 3m 9s. Rate: 155.0 symbols/min [2025-09-22T22:25:44.956432] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:45.029338] [DEBUG] [LOCAL ] RVLV: Loaded 47877 existing records from primary storage. [2025-09-22T22:25:45.030156] [INFO ] [MAIN ] RVLV: Loaded 47877 primary data records. [2025-09-22T22:25:45.129273] [DEBUG] [LOCAL ] RVT: Loaded 27209 existing records from primary storage. [2025-09-22T22:25:45.159699] [INFO ] [MAIN ] RVT: Loaded 27209 primary data records. [2025-09-22T22:25:45.163685] [DEBUG] [LOCAL ] RTX: Loaded 53710 existing records from primary storage. [2025-09-22T22:25:45.185460] [INFO ] [MAIN ] RTX: Loaded 53710 primary data records. [2025-09-22T22:25:46.063147] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:46.064510] [INFO ] [MAIN ] RVLV: Generated 1794 derivative records from 47877 primary records. [2025-09-22T22:25:46.064850] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-22T22:25:46.102733] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1794 records). [2025-09-22T22:25:46.103534] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-22T22:25:46.103351] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:46.113889] [INFO ] [MAIN ] RTX: Generated 1794 derivative records from 53710 primary records. [2025-09-22T22:25:46.119202] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-22T22:25:46.112943] [INFO ] [MAIN ] Derivative Progress: 1603/2091 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 9s. Rate: 154.8 symbols/min [2025-09-22T22:25:46.119511] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:46.121383] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 27209 primary records. [2025-09-22T22:25:46.129525] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-22T22:25:46.151476] [DEBUG] [LOCAL ] RTX: Derivative data saved (1794 records). [2025-09-22T22:25:46.152022] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-22T22:25:46.154766] [INFO ] [MAIN ] Derivative Progress: 1604/2091 symbols completed. RTX took 1.3s. Estimated remaining: 3m 9s. Rate: 154.9 symbols/min [2025-09-22T22:25:46.156199] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-09-22T22:25:46.156265] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-22T22:25:46.158674] [INFO ] [MAIN ] Derivative Progress: 1605/2091 symbols completed. RVT took 1.2s. Estimated remaining: 3m 8s. Rate: 155.0 symbols/min [2025-09-22T22:25:46.159303] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:46.159547] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:46.159253] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:46.200172] [DEBUG] [LOCAL ] RWT: Loaded 40595 existing records from primary storage. [2025-09-22T22:25:46.200392] [INFO ] [MAIN ] RWT: Loaded 40595 primary data records. [2025-09-22T22:25:46.367876] [DEBUG] [LOCAL ] RXO: Loaded 47790 existing records from primary storage. [2025-09-22T22:25:46.389772] [DEBUG] [LOCAL ] RVTY: Loaded 47584 existing records from primary storage. [2025-09-22T22:25:46.422705] [INFO ] [MAIN ] RVTY: Loaded 47584 primary data records. [2025-09-22T22:25:46.442853] [INFO ] [MAIN ] RXO: Loaded 47790 primary data records. [2025-09-22T22:25:47.251612] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:47.253536] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40595 primary records. [2025-09-22T22:25:47.254168] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-22T22:25:47.273043] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-09-22T22:25:47.273518] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-22T22:25:47.276078] [INFO ] [MAIN ] Derivative Progress: 1606/2091 symbols completed. RWT took 1.1s. Estimated remaining: 3m 8s. Rate: 154.8 symbols/min [2025-09-22T22:25:47.276555] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:47.296480] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:47.299808] [INFO ] [MAIN ] RVTY: Generated 1794 derivative records from 47584 primary records. [2025-09-22T22:25:47.299990] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-22T22:25:47.313846] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:47.314599] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 47790 primary records. [2025-09-22T22:25:47.315010] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-22T22:25:47.345913] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-09-22T22:25:47.346698] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-22T22:25:47.349808] [INFO ] [MAIN ] Derivative Progress: 1607/2091 symbols completed. RXO took 1.2s. Estimated remaining: 3m 8s. Rate: 154.9 symbols/min [2025-09-22T22:25:47.350942] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:47.354102] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1794 records). [2025-09-22T22:25:47.354322] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-22T22:25:47.356732] [INFO ] [MAIN ] Derivative Progress: 1608/2091 symbols completed. RVTY took 1.2s. Estimated remaining: 3m 7s. Rate: 155.0 symbols/min [2025-09-22T22:25:47.367861] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:47.402672] [DEBUG] [LOCAL ] RY: Loaded 47940 existing records from primary storage. [2025-09-22T22:25:47.403046] [INFO ] [MAIN ] RY: Loaded 47940 primary data records. [2025-09-22T22:25:47.534515] [DEBUG] [LOCAL ] RYAM: Loaded 35308 existing records from primary storage. [2025-09-22T22:25:47.539323] [INFO ] [MAIN ] RYAM: Loaded 35308 primary data records. [2025-09-22T22:25:47.907584] [DEBUG] [LOCAL ] RYAN: Loaded 44061 existing records from primary storage. [2025-09-22T22:25:47.928583] [INFO ] [MAIN ] RYAN: Loaded 44061 primary data records. [2025-09-22T22:25:48.452424] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:48.453885] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47940 primary records. [2025-09-22T22:25:48.454116] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-22T22:25:48.474312] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-09-22T22:25:48.474473] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-22T22:25:48.476493] [INFO ] [MAIN ] Derivative Progress: 1609/2091 symbols completed. RY took 1.2s. Estimated remaining: 3m 7s. Rate: 154.8 symbols/min [2025-09-22T22:25:48.476897] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:48.490758] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:48.491860] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35308 primary records. [2025-09-22T22:25:48.492159] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-22T22:25:48.508545] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-09-22T22:25:48.508872] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-22T22:25:48.512614] [INFO ] [MAIN ] Derivative Progress: 1610/2091 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 6s. Rate: 154.9 symbols/min [2025-09-22T22:25:48.513961] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:48.533860] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:48.540939] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 44061 primary records. [2025-09-22T22:25:48.541134] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-22T22:25:48.543299] [DEBUG] [LOCAL ] RYI: Loaded 21599 existing records from primary storage. [2025-09-22T22:25:48.543580] [INFO ] [MAIN ] RYI: Loaded 21599 primary data records. [2025-09-22T22:25:48.694004] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-09-22T22:25:48.705308] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-22T22:25:48.723774] [INFO ] [MAIN ] Derivative Progress: 1611/2091 symbols completed. RYAN took 1.4s. Estimated remaining: 3m 6s. Rate: 154.9 symbols/min [2025-09-22T22:25:48.781688] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:48.916399] [DEBUG] [LOCAL ] RYN: Loaded 45734 existing records from primary storage. [2025-09-22T22:25:48.926874] [INFO ] [MAIN ] RYN: Loaded 45734 primary data records. [2025-09-22T22:25:49.016745] [DEBUG] [LOCAL ] RZB: Loaded 6288 existing records from primary storage. [2025-09-22T22:25:49.036420] [INFO ] [MAIN ] RZB: Loaded 6288 primary data records. [2025-09-22T22:25:49.641951] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:49.643144] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21599 primary records. [2025-09-22T22:25:49.643428] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-22T22:25:49.663689] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-09-22T22:25:49.664065] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-22T22:25:49.666069] [INFO ] [MAIN ] Derivative Progress: 1612/2091 symbols completed. RYI took 1.2s. Estimated remaining: 3m 6s. Rate: 154.8 symbols/min [2025-09-22T22:25:49.674047] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:49.680172] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:49.681207] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45734 primary records. [2025-09-22T22:25:49.681417] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-22T22:25:49.703270] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-09-22T22:25:49.707008] [DEBUG] [LOCAL ] RZC: Loaded 6799 existing records from primary storage. [2025-09-22T22:25:49.703732] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-22T22:25:49.709413] [INFO ] [MAIN ] Derivative Progress: 1613/2091 symbols completed. RYN took 1.2s. Estimated remaining: 3m 5s. Rate: 154.9 symbols/min [2025-09-22T22:25:49.709859] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:49.707177] [INFO ] [MAIN ] RZC: Loaded 6799 primary data records. [2025-09-22T22:25:49.754486] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:49.779425] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6288 primary records. [2025-09-22T22:25:49.810294] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-22T22:25:49.890622] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-09-22T22:25:49.920822] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-22T22:25:49.986460] [INFO ] [MAIN ] Derivative Progress: 1614/2091 symbols completed. RZB took 1.2s. Estimated remaining: 3m 5s. Rate: 154.9 symbols/min [2025-09-22T22:25:50.053460] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:50.076748] [DEBUG] [LOCAL ] S: Loaded 53545 existing records from primary storage. [2025-09-22T22:25:50.077421] [INFO ] [MAIN ] S: Loaded 53545 primary data records. [2025-09-22T22:25:50.267424] [DEBUG] [LOCAL ] SA: Loaded 43072 existing records from primary storage. [2025-09-22T22:25:50.277116] [INFO ] [MAIN ] SA: Loaded 43072 primary data records. [2025-09-22T22:25:50.495518] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:50.509955] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6799 primary records. [2025-09-22T22:25:50.512716] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-22T22:25:50.581396] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-09-22T22:25:50.582414] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-22T22:25:50.584764] [INFO ] [MAIN ] Derivative Progress: 1615/2091 symbols completed. RZC took 0.9s. Estimated remaining: 3m 4s. Rate: 154.8 symbols/min [2025-09-22T22:25:50.595738] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:50.804434] [DEBUG] [LOCAL ] SABA: Loaded 9221 existing records from primary storage. [2025-09-22T22:25:50.805310] [INFO ] [MAIN ] SABA: Loaded 9221 primary data records. [2025-09-22T22:25:51.130272] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:51.131192] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53545 primary records. [2025-09-22T22:25:51.131429] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-22T22:25:51.157398] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-09-22T22:25:51.157630] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-22T22:25:51.159795] [INFO ] [MAIN ] Derivative Progress: 1616/2091 symbols completed. S took 1.5s. Estimated remaining: 3m 4s. Rate: 154.8 symbols/min [2025-09-22T22:25:51.160346] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:51.175162] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:51.176506] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 43072 primary records. [2025-09-22T22:25:51.176694] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-22T22:25:51.193737] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-09-22T22:25:51.193846] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-22T22:25:51.196224] [INFO ] [MAIN ] Derivative Progress: 1617/2091 symbols completed. SA took 1.2s. Estimated remaining: 3m 4s. Rate: 154.9 symbols/min [2025-09-22T22:25:51.197562] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:51.212960] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:51.221700] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9221 primary records. [2025-09-22T22:25:51.221841] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-22T22:25:51.245001] [DEBUG] [LOCAL ] SAFE: Loaded 30287 existing records from primary storage. [2025-09-22T22:25:51.250759] [INFO ] [MAIN ] SAFE: Loaded 30287 primary data records. [2025-09-22T22:25:51.305173] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-09-22T22:25:51.305317] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-22T22:25:51.333708] [INFO ] [MAIN ] Derivative Progress: 1618/2091 symbols completed. SABA took 0.7s. Estimated remaining: 3m 3s. Rate: 154.9 symbols/min [2025-09-22T22:25:51.339677] [DEBUG] [LOCAL ] SAH: Loaded 22148 existing records from primary storage. [2025-09-22T22:25:51.372737] [INFO ] [MAIN ] SAH: Loaded 22148 primary data records. [2025-09-22T22:25:51.964247] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:51.965247] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30287 primary records. [2025-09-22T22:25:51.965440] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-22T22:25:51.983331] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-09-22T22:25:51.984251] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-22T22:25:51.987102] [INFO ] [MAIN ] Derivative Progress: 1619/2091 symbols completed. SAFE took 0.8s. Estimated remaining: 3m 3s. Rate: 154.9 symbols/min [2025-09-22T22:25:52.001125] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:52.001921] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 22148 primary records. [2025-09-22T22:25:52.002000] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-22T22:25:52.018007] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-09-22T22:25:52.018089] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-22T22:25:52.020733] [INFO ] [MAIN ] Derivative Progress: 1620/2091 symbols completed. SAH took 0.8s. Estimated remaining: 3m 2s. Rate: 155.0 symbols/min [2025-09-22T22:25:52.021336] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:52.021507] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:52.021631] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:52.048341] [DEBUG] [LOCAL ] SAM: Loaded 21661 existing records from primary storage. [2025-09-22T22:25:52.048504] [INFO ] [MAIN ] SAM: Loaded 21661 primary data records. [2025-09-22T22:25:52.406633] [DEBUG] [LOCAL ] SAND: Loaded 51786 existing records from primary storage. [2025-09-22T22:25:52.420708] [INFO ] [MAIN ] SAND: Loaded 51786 primary data records. [2025-09-22T22:25:52.422437] [DEBUG] [LOCAL ] SAN: Loaded 53019 existing records from primary storage. [2025-09-22T22:25:52.422700] [INFO ] [MAIN ] SAN: Loaded 53019 primary data records. [2025-09-22T22:25:53.109137] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:53.110026] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21661 primary records. [2025-09-22T22:25:53.110541] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-22T22:25:53.129679] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-09-22T22:25:53.129886] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-22T22:25:53.132367] [INFO ] [MAIN ] Derivative Progress: 1621/2091 symbols completed. SAM took 1.1s. Estimated remaining: 3m 2s. Rate: 154.8 symbols/min [2025-09-22T22:25:53.133079] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:53.151186] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:53.151945] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 53019 primary records. [2025-09-22T22:25:53.152188] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-22T22:25:53.170749] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-09-22T22:25:53.170927] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-22T22:25:53.173529] [INFO ] [MAIN ] Derivative Progress: 1622/2091 symbols completed. SAN took 1.2s. Estimated remaining: 3m 2s. Rate: 154.9 symbols/min [2025-09-22T22:25:53.181919] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:53.187869] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:53.188933] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51786 primary records. [2025-09-22T22:25:53.189311] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-22T22:25:53.222239] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-09-22T22:25:53.222391] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-22T22:25:53.224911] [INFO ] [MAIN ] Derivative Progress: 1623/2091 symbols completed. SAND took 1.2s. Estimated remaining: 3m 1s. Rate: 154.9 symbols/min [2025-09-22T22:25:53.225371] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:53.233506] [DEBUG] [LOCAL ] SAR: Loaded 16175 existing records from primary storage. [2025-09-22T22:25:53.233714] [INFO ] [MAIN ] SAR: Loaded 16175 primary data records. [2025-09-22T22:25:53.344927] [DEBUG] [LOCAL ] SAP: Loaded 50093 existing records from primary storage. [2025-09-22T22:25:53.362800] [INFO ] [MAIN ] SAP: Loaded 50093 primary data records. [2025-09-22T22:25:53.748832] [DEBUG] [LOCAL ] SARO: Loaded 48810 existing records from primary storage. [2025-09-22T22:25:53.766881] [INFO ] [MAIN ] SARO: Loaded 48810 primary data records. [2025-09-22T22:25:54.363608] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:54.365694] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16175 primary records. [2025-09-22T22:25:54.366201] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-22T22:25:54.391694] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-09-22T22:25:54.399611] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-22T22:25:54.402489] [INFO ] [MAIN ] Derivative Progress: 1624/2091 symbols completed. SAR took 1.2s. Estimated remaining: 3m 1s. Rate: 154.7 symbols/min [2025-09-22T22:25:54.408260] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:54.409178] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:54.411215] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 50093 primary records. [2025-09-22T22:25:54.411695] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-22T22:25:54.429551] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-09-22T22:25:54.429730] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-22T22:25:54.432057] [INFO ] [MAIN ] Derivative Progress: 1625/2091 symbols completed. SAP took 1.3s. Estimated remaining: 3m 1s. Rate: 154.8 symbols/min [2025-09-22T22:25:54.432595] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:54.450946] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:54.451891] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48810 primary records. [2025-09-22T22:25:54.451975] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-22T22:25:54.477371] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-09-22T22:25:54.477473] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-22T22:25:54.479933] [INFO ] [MAIN ] Derivative Progress: 1626/2091 symbols completed. SARO took 1.3s. Estimated remaining: 3m 0s. Rate: 154.9 symbols/min [2025-09-22T22:25:54.480928] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:54.493445] [DEBUG] [LOCAL ] SB: Loaded 33353 existing records from primary storage. [2025-09-22T22:25:54.493689] [INFO ] [MAIN ] SB: Loaded 33353 primary data records. [2025-09-22T22:25:54.610284] [DEBUG] [LOCAL ] SBI: Loaded 7763 existing records from primary storage. [2025-09-22T22:25:54.633081] [INFO ] [MAIN ] SBI: Loaded 7763 primary data records. [2025-09-22T22:25:54.719722] [DEBUG] [LOCAL ] SBH: Loaded 49833 existing records from primary storage. [2025-09-22T22:25:54.829124] [INFO ] [MAIN ] SBH: Loaded 49833 primary data records. [2025-09-22T22:25:55.544667] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:55.545910] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33353 primary records. [2025-09-22T22:25:55.546501] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-22T22:25:55.569117] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-09-22T22:25:55.569524] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-22T22:25:55.571818] [INFO ] [MAIN ] Derivative Progress: 1627/2091 symbols completed. SB took 1.2s. Estimated remaining: 2m 60s. Rate: 154.7 symbols/min [2025-09-22T22:25:55.572455] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:55.589588] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:55.590986] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7763 primary records. [2025-09-22T22:25:55.591135] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-22T22:25:55.622400] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-09-22T22:25:55.622929] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-22T22:25:55.625557] [INFO ] [MAIN ] Derivative Progress: 1628/2091 symbols completed. SBI took 1.1s. Estimated remaining: 2m 59s. Rate: 154.8 symbols/min [2025-09-22T22:25:55.623008] [DEBUG] [LOCAL ] SBR: Loaded 7156 existing records from primary storage. [2025-09-22T22:25:55.626061] [INFO ] [MAIN ] SBR: Loaded 7156 primary data records. [2025-09-22T22:25:55.695491] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:55.682978] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:55.705532] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49833 primary records. [2025-09-22T22:25:55.722700] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-22T22:25:55.784001] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-09-22T22:25:55.802748] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-22T22:25:55.838292] [INFO ] [MAIN ] Derivative Progress: 1629/2091 symbols completed. SBH took 1.4s. Estimated remaining: 2m 59s. Rate: 154.9 symbols/min [2025-09-22T22:25:55.946042] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:55.992671] [DEBUG] [LOCAL ] SBSI: Loaded 14714 existing records from primary storage. [2025-09-22T22:25:55.993100] [INFO ] [MAIN ] SBSI: Loaded 14714 primary data records. [2025-09-22T22:25:56.131226] [DEBUG] [LOCAL ] SBS: Loaded 49482 existing records from primary storage. [2025-09-22T22:25:56.134331] [INFO ] [MAIN ] SBS: Loaded 49482 primary data records. [2025-09-22T22:25:56.300260] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:56.378421] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7156 primary records. [2025-09-22T22:25:56.398743] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-22T22:25:56.576941] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-09-22T22:25:56.588029] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-22T22:25:56.603322] [INFO ] [MAIN ] Derivative Progress: 1630/2091 symbols completed. SBR took 1.0s. Estimated remaining: 2m 59s. Rate: 154.8 symbols/min [2025-09-22T22:25:56.625036] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:56.793844] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:56.794932] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14714 primary records. [2025-09-22T22:25:56.795292] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-22T22:25:56.842615] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-09-22T22:25:56.843592] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:56.843685] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-22T22:25:56.844545] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49482 primary records. [2025-09-22T22:25:56.846993] [INFO ] [MAIN ] Derivative Progress: 1631/2091 symbols completed. SBSI took 0.9s. Estimated remaining: 2m 58s. Rate: 154.8 symbols/min [2025-09-22T22:25:56.847532] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-22T22:25:56.847673] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:56.885403] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-09-22T22:25:56.885722] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-22T22:25:56.886901] [DEBUG] [LOCAL ] SBSW: Loaded 52946 existing records from primary storage. [2025-09-22T22:25:56.887128] [INFO ] [MAIN ] SBSW: Loaded 52946 primary data records. [2025-09-22T22:25:56.889417] [INFO ] [MAIN ] Derivative Progress: 1632/2091 symbols completed. SBS took 1.3s. Estimated remaining: 2m 58s. Rate: 154.9 symbols/min [2025-09-22T22:25:56.895089] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:57.074102] [DEBUG] [LOCAL ] SCD: Loaded 12603 existing records from primary storage. [2025-09-22T22:25:57.226353] [INFO ] [MAIN ] SCD: Loaded 12603 primary data records. [2025-09-22T22:25:57.278183] [DEBUG] [LOCAL ] SCCO: Loaded 49398 existing records from primary storage. [2025-09-22T22:25:57.321506] [INFO ] [MAIN ] SCCO: Loaded 49398 primary data records. [2025-09-22T22:25:57.918704] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:57.920154] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 52946 primary records. [2025-09-22T22:25:57.920799] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-22T22:25:57.943593] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-09-22T22:25:57.944151] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-22T22:25:57.946424] [INFO ] [MAIN ] Derivative Progress: 1633/2091 symbols completed. SBSW took 1.3s. Estimated remaining: 2m 58s. Rate: 154.7 symbols/min [2025-09-22T22:25:57.961828] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:57.962532] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 12603 primary records. [2025-09-22T22:25:57.962609] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-22T22:25:57.975512] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:57.976331] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49398 primary records. [2025-09-22T22:25:57.983296] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-22T22:25:58.003088] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-09-22T22:25:58.003396] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-22T22:25:58.005819] [INFO ] [MAIN ] Derivative Progress: 1634/2091 symbols completed. SCD took 1.1s. Estimated remaining: 2m 57s. Rate: 154.8 symbols/min [2025-09-22T22:25:58.009141] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-09-22T22:25:58.009207] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-22T22:25:58.011479] [INFO ] [MAIN ] Derivative Progress: 1635/2091 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 57s. Rate: 154.9 symbols/min [2025-09-22T22:25:58.012140] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:58.012283] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:58.012188] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:58.029942] [DEBUG] [LOCAL ] SCL: Loaded 14740 existing records from primary storage. [2025-09-22T22:25:58.030282] [INFO ] [MAIN ] SCL: Loaded 14740 primary data records. [2025-09-22T22:25:58.437128] [DEBUG] [LOCAL ] SCI: Loaded 46690 existing records from primary storage. [2025-09-22T22:25:58.438423] [INFO ] [MAIN ] SCI: Loaded 46690 primary data records. [2025-09-22T22:25:58.439295] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-22T22:25:58.477227] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-09-22T22:25:59.084770] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:59.086025] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14740 primary records. [2025-09-22T22:25:59.086478] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-22T22:25:59.107426] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-09-22T22:25:59.116008] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-22T22:25:59.123376] [INFO ] [MAIN ] Derivative Progress: 1636/2091 symbols completed. SCL took 1.1s. Estimated remaining: 2m 56s. Rate: 154.7 symbols/min [2025-09-22T22:25:59.123944] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:59.124295] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:59.125964] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46690 primary records. [2025-09-22T22:25:59.126319] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-22T22:25:59.155522] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-09-22T22:25:59.160925] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-22T22:25:59.160839] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:25:59.161805] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-09-22T22:25:59.163746] [INFO ] [MAIN ] Derivative Progress: 1637/2091 symbols completed. SCI took 1.2s. Estimated remaining: 2m 56s. Rate: 154.8 symbols/min [2025-09-22T22:25:59.164035] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-22T22:25:59.164681] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:59.191022] [DEBUG] [LOCAL ] SCM: Loaded 19870 existing records from primary storage. [2025-09-22T22:25:59.191630] [INFO ] [MAIN ] SCM: Loaded 19870 primary data records. [2025-09-22T22:25:59.193766] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-09-22T22:25:59.210375] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-22T22:25:59.231196] [INFO ] [MAIN ] Derivative Progress: 1638/2091 symbols completed. SCHW took 1.2s. Estimated remaining: 2m 55s. Rate: 154.9 symbols/min [2025-09-22T22:25:59.236704] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:25:59.519622] [DEBUG] [LOCAL ] SCS: Loaded 42997 existing records from primary storage. [2025-09-22T22:25:59.529472] [INFO ] [MAIN ] SCS: Loaded 42997 primary data records. [2025-09-22T22:25:59.572820] [DEBUG] [LOCAL ] SD: Loaded 29064 existing records from primary storage. [2025-09-22T22:25:59.591554] [INFO ] [MAIN ] SD: Loaded 29064 primary data records. [2025-09-22T22:26:00.250245] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:00.251175] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19870 primary records. [2025-09-22T22:26:00.252866] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-22T22:26:00.272052] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-09-22T22:26:00.272260] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-22T22:26:00.274535] [INFO ] [MAIN ] Derivative Progress: 1639/2091 symbols completed. SCM took 1.2s. Estimated remaining: 2m 55s. Rate: 154.7 symbols/min [2025-09-22T22:26:00.275066] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:00.302820] [DEBUG] [LOCAL ] SDHC: Loaded 10500 existing records from primary storage. [2025-09-22T22:26:00.298456] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:00.303745] [INFO ] [MAIN ] SDHC: Loaded 10500 primary data records. [2025-09-22T22:26:00.303670] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 42997 primary records. [2025-09-22T22:26:00.304131] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-22T22:26:00.428455] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-09-22T22:26:00.441543] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-22T22:26:00.443597] [INFO ] [MAIN ] Derivative Progress: 1640/2091 symbols completed. SCS took 1.3s. Estimated remaining: 2m 55s. Rate: 154.8 symbols/min [2025-09-22T22:26:00.465696] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:00.485527] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 29064 primary records. [2025-09-22T22:26:00.460200] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:00.496981] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-22T22:26:00.661454] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-09-22T22:26:00.661792] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-22T22:26:00.664105] [INFO ] [MAIN ] Derivative Progress: 1641/2091 symbols completed. SD took 1.4s. Estimated remaining: 2m 54s. Rate: 154.8 symbols/min [2025-09-22T22:26:00.667847] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:00.674391] [DEBUG] [LOCAL ] SDHY: Loaded 10631 existing records from primary storage. [2025-09-22T22:26:00.674619] [INFO ] [MAIN ] SDHY: Loaded 10631 primary data records. [2025-09-22T22:26:01.016735] [DEBUG] [LOCAL ] SDRL: Loaded 41998 existing records from primary storage. [2025-09-22T22:26:01.022894] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:01.023238] [INFO ] [MAIN ] SDRL: Loaded 41998 primary data records. [2025-09-22T22:26:01.024207] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10500 primary records. [2025-09-22T22:26:01.024482] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-22T22:26:01.149996] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-09-22T22:26:01.150710] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-22T22:26:01.152975] [INFO ] [MAIN ] Derivative Progress: 1642/2091 symbols completed. SDHC took 0.9s. Estimated remaining: 2m 54s. Rate: 154.8 symbols/min [2025-09-22T22:26:01.159035] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:01.370970] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:01.371809] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10631 primary records. [2025-09-22T22:26:01.371917] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-22T22:26:01.388929] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-09-22T22:26:01.389265] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-22T22:26:01.391775] [INFO ] [MAIN ] Derivative Progress: 1643/2091 symbols completed. SDHY took 0.9s. Estimated remaining: 2m 54s. Rate: 154.8 symbols/min [2025-09-22T22:26:01.392499] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:01.430845] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:01.431622] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41998 primary records. [2025-09-22T22:26:01.431806] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-22T22:26:01.462981] [DEBUG] [LOCAL ] SE: Loaded 53377 existing records from primary storage. [2025-09-22T22:26:01.464132] [INFO ] [MAIN ] SE: Loaded 53377 primary data records. [2025-09-22T22:26:01.465208] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-09-22T22:26:01.465558] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-22T22:26:01.480000] [INFO ] [MAIN ] Derivative Progress: 1644/2091 symbols completed. SDRL took 0.8s. Estimated remaining: 2m 53s. Rate: 154.9 symbols/min [2025-09-22T22:26:01.524010] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:01.633590] [DEBUG] [LOCAL ] SEE: Loaded 48394 existing records from primary storage. [2025-09-22T22:26:01.660931] [INFO ] [MAIN ] SEE: Loaded 48394 primary data records. [2025-09-22T22:26:01.746231] [DEBUG] [LOCAL ] SEG: Loaded 13797 existing records from primary storage. [2025-09-22T22:26:01.858571] [INFO ] [MAIN ] SEG: Loaded 13797 primary data records. [2025-09-22T22:26:02.509579] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:02.511081] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53377 primary records. [2025-09-22T22:26:02.511242] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-09-22T22:26:02.532269] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-09-22T22:26:02.532856] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-09-22T22:26:02.535109] [INFO ] [MAIN ] Derivative Progress: 1645/2091 symbols completed. SE took 1.4s. Estimated remaining: 2m 53s. Rate: 154.8 symbols/min [2025-09-22T22:26:02.543161] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:02.548696] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:02.549944] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48394 primary records. [2025-09-22T22:26:02.550109] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-22T22:26:02.576049] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-09-22T22:26:02.581062] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-22T22:26:02.581344] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:02.583547] [INFO ] [MAIN ] Derivative Progress: 1646/2091 symbols completed. SEE took 1.2s. Estimated remaining: 2m 52s. Rate: 154.8 symbols/min [2025-09-22T22:26:02.583971] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:02.584720] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13797 primary records. [2025-09-22T22:26:02.584933] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-22T22:26:02.602057] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-09-22T22:26:02.602312] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-22T22:26:02.604581] [INFO ] [MAIN ] Derivative Progress: 1647/2091 symbols completed. SEG took 1.1s. Estimated remaining: 2m 52s. Rate: 154.9 symbols/min [2025-09-22T22:26:02.604994] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:02.648777] [DEBUG] [LOCAL ] SEI: Loaded 49644 existing records from primary storage. [2025-09-22T22:26:02.649142] [INFO ] [MAIN ] SEI: Loaded 49644 primary data records. [2025-09-22T22:26:02.761853] [DEBUG] [LOCAL ] SEM: Loaded 42965 existing records from primary storage. [2025-09-22T22:26:02.780065] [INFO ] [MAIN ] SEM: Loaded 42965 primary data records. [2025-09-22T22:26:02.841206] [DEBUG] [LOCAL ] SEMR: Loaded 41647 existing records from primary storage. [2025-09-22T22:26:02.884890] [INFO ] [MAIN ] SEMR: Loaded 41647 primary data records. [2025-09-22T22:26:03.629752] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:03.642241] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:03.643673] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49644 primary records. [2025-09-22T22:26:03.643072] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 42965 primary records. [2025-09-22T22:26:03.643851] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-22T22:26:03.643800] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-22T22:26:03.662461] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-09-22T22:26:03.662596] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-22T22:26:03.671723] [INFO ] [MAIN ] Derivative Progress: 1648/2091 symbols completed. SEI took 1.1s. Estimated remaining: 2m 52s. Rate: 154.8 symbols/min [2025-09-22T22:26:03.687708] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-09-22T22:26:03.692878] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:03.692620] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-22T22:26:03.695156] [INFO ] [MAIN ] Derivative Progress: 1649/2091 symbols completed. SEM took 1.1s. Estimated remaining: 2m 51s. Rate: 154.8 symbols/min [2025-09-22T22:26:03.695926] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41647 primary records. [2025-09-22T22:26:03.696035] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-22T22:26:03.711034] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-09-22T22:26:03.711092] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-22T22:26:03.713112] [INFO ] [MAIN ] Derivative Progress: 1650/2091 symbols completed. SEMR took 1.1s. Estimated remaining: 2m 51s. Rate: 154.9 symbols/min [2025-09-22T22:26:03.713628] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:03.713846] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:03.713790] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:03.721359] [DEBUG] [LOCAL ] SFB: Loaded 4042 existing records from primary storage. [2025-09-22T22:26:03.721500] [INFO ] [MAIN ] SFB: Loaded 4042 primary data records. [2025-09-22T22:26:04.069094] [DEBUG] [LOCAL ] SF: Loaded 41888 existing records from primary storage. [2025-09-22T22:26:04.069674] [INFO ] [MAIN ] SF: Loaded 41888 primary data records. [2025-09-22T22:26:04.134519] [DEBUG] [LOCAL ] SES: Loaded 51527 existing records from primary storage. [2025-09-22T22:26:04.162769] [INFO ] [MAIN ] SES: Loaded 51527 primary data records. [2025-09-22T22:26:04.749357] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:04.751191] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4042 primary records. [2025-09-22T22:26:04.751426] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-22T22:26:04.770940] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-09-22T22:26:04.771275] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-22T22:26:04.773899] [INFO ] [MAIN ] Derivative Progress: 1651/2091 symbols completed. SFB took 1.1s. Estimated remaining: 2m 51s. Rate: 154.8 symbols/min [2025-09-22T22:26:04.774475] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:04.788364] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:04.789079] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41888 primary records. [2025-09-22T22:26:04.789414] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-22T22:26:04.806752] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-09-22T22:26:04.807234] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-22T22:26:04.809074] [INFO ] [MAIN ] Derivative Progress: 1652/2091 symbols completed. SF took 1.1s. Estimated remaining: 2m 50s. Rate: 154.9 symbols/min [2025-09-22T22:26:04.809451] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:04.832743] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:04.833697] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51527 primary records. [2025-09-22T22:26:04.833911] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-22T22:26:04.850010] [DEBUG] [LOCAL ] SFBS: Loaded 21276 existing records from primary storage. [2025-09-22T22:26:04.853886] [INFO ] [MAIN ] SFBS: Loaded 21276 primary data records. [2025-09-22T22:26:05.004095] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-09-22T22:26:05.020436] [DEBUG] [LOCAL ] SFL: Loaded 45361 existing records from primary storage. [2025-09-22T22:26:05.020536] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-22T22:26:05.036761] [INFO ] [MAIN ] Derivative Progress: 1653/2091 symbols completed. SES took 1.3s. Estimated remaining: 2m 50s. Rate: 154.9 symbols/min [2025-09-22T22:26:05.054161] [INFO ] [MAIN ] SFL: Loaded 45361 primary data records. [2025-09-22T22:26:05.072394] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:05.577046] [DEBUG] [LOCAL ] SG: Loaded 53458 existing records from primary storage. [2025-09-22T22:26:05.577965] [INFO ] [MAIN ] SG: Loaded 53458 primary data records. [2025-09-22T22:26:05.624106] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:05.650317] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21276 primary records. [2025-09-22T22:26:05.672328] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-22T22:26:05.932571] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-09-22T22:26:05.940539] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-22T22:26:05.942685] [INFO ] [MAIN ] Derivative Progress: 1654/2091 symbols completed. SFBS took 1.2s. Estimated remaining: 2m 49s. Rate: 154.8 symbols/min [2025-09-22T22:26:05.948831] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:05.949404] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:05.950610] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45361 primary records. [2025-09-22T22:26:05.951588] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-22T22:26:05.972580] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-09-22T22:26:05.973011] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-22T22:26:05.975432] [INFO ] [MAIN ] Derivative Progress: 1655/2091 symbols completed. SFL took 1.2s. Estimated remaining: 2m 49s. Rate: 154.9 symbols/min [2025-09-22T22:26:05.976019] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:05.997749] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:06.001191] [DEBUG] [LOCAL ] SGU: Loaded 6675 existing records from primary storage. [2025-09-22T22:26:06.001974] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53458 primary records. [2025-09-22T22:26:06.002137] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-22T22:26:06.002060] [INFO ] [MAIN ] SGU: Loaded 6675 primary data records. [2025-09-22T22:26:06.213002] [DEBUG] [LOCAL ] SGHC: Loaded 45611 existing records from primary storage. [2025-09-22T22:26:06.231720] [INFO ] [MAIN ] SGHC: Loaded 45611 primary data records. [2025-09-22T22:26:06.418859] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-09-22T22:26:06.448203] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-22T22:26:06.473754] [INFO ] [MAIN ] Derivative Progress: 1656/2091 symbols completed. SG took 1.4s. Estimated remaining: 2m 49s. Rate: 154.8 symbols/min [2025-09-22T22:26:06.499156] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:06.741440] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:06.753802] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6675 primary records. [2025-09-22T22:26:06.753958] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-22T22:26:06.787968] [DEBUG] [LOCAL ] SHAK: Loaded 49195 existing records from primary storage. [2025-09-22T22:26:06.789285] [INFO ] [MAIN ] SHAK: Loaded 49195 primary data records. [2025-09-22T22:26:06.789589] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-09-22T22:26:06.846487] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-22T22:26:06.863932] [INFO ] [MAIN ] Derivative Progress: 1657/2091 symbols completed. SGU took 0.9s. Estimated remaining: 2m 48s. Rate: 154.8 symbols/min [2025-09-22T22:26:06.881285] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:06.922288] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:06.933697] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 45611 primary records. [2025-09-22T22:26:06.939519] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-22T22:26:07.142559] [DEBUG] [LOCAL ] SHCO: Loaded 26179 existing records from primary storage. [2025-09-22T22:26:07.142783] [INFO ] [MAIN ] SHCO: Loaded 26179 primary data records. [2025-09-22T22:26:07.141873] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-09-22T22:26:07.142968] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-22T22:26:07.181986] [INFO ] [MAIN ] Derivative Progress: 1658/2091 symbols completed. SGHC took 1.2s. Estimated remaining: 2m 48s. Rate: 154.8 symbols/min [2025-09-22T22:26:07.222824] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:07.508492] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:07.509796] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 49195 primary records. [2025-09-22T22:26:07.510126] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-22T22:26:07.528229] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-09-22T22:26:07.528376] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-22T22:26:07.531906] [INFO ] [MAIN ] Derivative Progress: 1659/2091 symbols completed. SHAK took 1.0s. Estimated remaining: 2m 47s. Rate: 154.9 symbols/min [2025-09-22T22:26:07.546310] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:07.586658] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:07.595508] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 26179 primary records. [2025-09-22T22:26:07.594433] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-09-22T22:26:07.595743] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-22T22:26:07.596687] [INFO ] [MAIN ] SHEL: Loaded 53672 primary data records. [2025-09-22T22:26:07.677581] [DEBUG] [LOCAL ] SHG: Loaded 27156 existing records from primary storage. [2025-09-22T22:26:07.679191] [INFO ] [MAIN ] SHG: Loaded 27156 primary data records. [2025-09-22T22:26:07.812306] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-09-22T22:26:07.835756] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-22T22:26:07.877054] [INFO ] [MAIN ] Derivative Progress: 1660/2091 symbols completed. SHCO took 1.0s. Estimated remaining: 2m 47s. Rate: 154.9 symbols/min [2025-09-22T22:26:07.947151] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:08.335875] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:08.336906] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53672 primary records. [2025-09-22T22:26:08.337911] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-22T22:26:08.368613] [DEBUG] [LOCAL ] SHO: Loaded 49833 existing records from primary storage. [2025-09-22T22:26:08.369083] [INFO ] [MAIN ] SHO: Loaded 49833 primary data records. [2025-09-22T22:26:08.487836] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:08.492902] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 27156 primary records. [2025-09-22T22:26:08.492247] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-09-22T22:26:08.498255] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-22T22:26:08.515833] [INFO ] [MAIN ] Derivative Progress: 1661/2091 symbols completed. SHEL took 1.3s. Estimated remaining: 2m 47s. Rate: 154.8 symbols/min [2025-09-22T22:26:08.508569] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-22T22:26:08.566850] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:08.709226] [DEBUG] [LOCAL ] SHOC: Loaded 3890 existing records from primary storage. [2025-09-22T22:26:08.710445] [INFO ] [MAIN ] SHOC: Loaded 3890 primary data records. [2025-09-22T22:26:08.749307] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-09-22T22:26:08.776923] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-22T22:26:08.807824] [INFO ] [MAIN ] Derivative Progress: 1662/2091 symbols completed. SHG took 1.3s. Estimated remaining: 2m 46s. Rate: 154.8 symbols/min [2025-09-22T22:26:08.820220] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:09.036040] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:09.037581] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49833 primary records. [2025-09-22T22:26:09.038012] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-22T22:26:09.071320] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-09-22T22:26:09.071454] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-22T22:26:09.073575] [INFO ] [MAIN ] Derivative Progress: 1663/2091 symbols completed. SHO took 1.1s. Estimated remaining: 2m 46s. Rate: 154.9 symbols/min [2025-09-22T22:26:09.105383] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:09.105080] [DEBUG] [LOCAL ] SHW: Loaded 50514 existing records from primary storage. [2025-09-22T22:26:09.105532] [INFO ] [MAIN ] SHW: Loaded 50514 primary data records. [2025-09-22T22:26:09.106276] [INFO ] [MAIN ] SHOC: Generated 1794 derivative records from 3890 primary records. [2025-09-22T22:26:09.106457] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-22T22:26:09.315853] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1794 records). [2025-09-22T22:26:09.316001] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-22T22:26:09.317972] [INFO ] [MAIN ] Derivative Progress: 1664/2091 symbols completed. SHOC took 0.8s. Estimated remaining: 2m 45s. Rate: 154.9 symbols/min [2025-09-22T22:26:09.458551] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:09.459229] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50514 primary records. [2025-09-22T22:26:09.459294] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-22T22:26:09.475549] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-09-22T22:26:09.475678] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-22T22:26:09.477735] [INFO ] [MAIN ] Derivative Progress: 1665/2091 symbols completed. SHW took 0.7s. Estimated remaining: 2m 45s. Rate: 154.9 symbols/min [2025-09-22T22:26:09.478590] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:09.478465] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:09.478288] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:09.503480] [DEBUG] [LOCAL ] SII: Loaded 23172 existing records from primary storage. [2025-09-22T22:26:09.503615] [INFO ] [MAIN ] SII: Loaded 23172 primary data records. [2025-09-22T22:26:09.682149] [DEBUG] [LOCAL ] SID: Loaded 42208 existing records from primary storage. [2025-09-22T22:26:09.718715] [INFO ] [MAIN ] SID: Loaded 42208 primary data records. [2025-09-22T22:26:09.758492] [DEBUG] [LOCAL ] SIG: Loaded 46617 existing records from primary storage. [2025-09-22T22:26:09.788767] [INFO ] [MAIN ] SIG: Loaded 46617 primary data records. [2025-09-22T22:26:10.580933] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:10.583688] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23172 primary records. [2025-09-22T22:26:10.583953] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-22T22:26:10.602151] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-09-22T22:26:10.603843] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-22T22:26:10.606050] [INFO ] [MAIN ] Derivative Progress: 1666/2091 symbols completed. SII took 1.1s. Estimated remaining: 2m 45s. Rate: 154.8 symbols/min [2025-09-22T22:26:10.606370] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:10.621863] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:10.622672] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42208 primary records. [2025-09-22T22:26:10.622987] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-22T22:26:10.651346] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:10.652881] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 46617 primary records. [2025-09-22T22:26:10.653427] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-22T22:26:10.679936] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-09-22T22:26:10.679844] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-09-22T22:26:10.680140] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-22T22:26:10.680190] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-22T22:26:10.682244] [INFO ] [MAIN ] Derivative Progress: 1667/2091 symbols completed. SID took 1.2s. Estimated remaining: 2m 44s. Rate: 154.8 symbols/min [2025-09-22T22:26:10.685442] [INFO ] [MAIN ] Derivative Progress: 1668/2091 symbols completed. SIG took 1.2s. Estimated remaining: 2m 44s. Rate: 154.9 symbols/min [2025-09-22T22:26:10.685735] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:10.685261] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:10.698367] [DEBUG] [LOCAL ] SILA: Loaded 31305 existing records from primary storage. [2025-09-22T22:26:10.698601] [INFO ] [MAIN ] SILA: Loaded 31305 primary data records. [2025-09-22T22:26:11.057831] [DEBUG] [LOCAL ] SITC: Loaded 41544 existing records from primary storage. [2025-09-22T22:26:11.058058] [INFO ] [MAIN ] SITC: Loaded 41544 primary data records. [2025-09-22T22:26:11.058553] [DEBUG] [LOCAL ] SITE: Loaded 35218 existing records from primary storage. [2025-09-22T22:26:11.058763] [INFO ] [MAIN ] SITE: Loaded 35218 primary data records. [2025-09-22T22:26:11.695840] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:11.697356] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 31305 primary records. [2025-09-22T22:26:11.698013] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-22T22:26:11.717385] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-09-22T22:26:11.717969] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-22T22:26:11.720227] [INFO ] [MAIN ] Derivative Progress: 1669/2091 symbols completed. SILA took 1.1s. Estimated remaining: 2m 44s. Rate: 154.8 symbols/min [2025-09-22T22:26:11.720490] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:11.756324] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:11.757713] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35218 primary records. [2025-09-22T22:26:11.757857] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-22T22:26:11.756924] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:11.759475] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41544 primary records. [2025-09-22T22:26:11.759571] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-22T22:26:11.784617] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-09-22T22:26:11.784793] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-22T22:26:11.789444] [INFO ] [MAIN ] Derivative Progress: 1670/2091 symbols completed. SITE took 1.1s. Estimated remaining: 2m 43s. Rate: 154.9 symbols/min [2025-09-22T22:26:11.789906] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:11.808432] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-09-22T22:26:11.808578] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-22T22:26:11.810749] [INFO ] [MAIN ] Derivative Progress: 1671/2091 symbols completed. SITC took 1.1s. Estimated remaining: 2m 43s. Rate: 154.9 symbols/min [2025-09-22T22:26:11.811197] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:11.846205] [DEBUG] [LOCAL ] SJT: Loaded 21980 existing records from primary storage. [2025-09-22T22:26:11.846453] [INFO ] [MAIN ] SJT: Loaded 21980 primary data records. [2025-09-22T22:26:11.847306] [DEBUG] [LOCAL ] SJM: Loaded 50126 existing records from primary storage. [2025-09-22T22:26:11.885321] [INFO ] [MAIN ] SJM: Loaded 50126 primary data records. [2025-09-22T22:26:12.091000] [DEBUG] [LOCAL ] SKE: Loaded 35517 existing records from primary storage. [2025-09-22T22:26:12.149730] [INFO ] [MAIN ] SKE: Loaded 35517 primary data records. [2025-09-22T22:26:12.857441] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:12.858384] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 21980 primary records. [2025-09-22T22:26:12.858480] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-22T22:26:12.899296] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:12.898612] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-09-22T22:26:12.900391] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50126 primary records. [2025-09-22T22:26:12.899614] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-22T22:26:12.903426] [INFO ] [MAIN ] Derivative Progress: 1672/2091 symbols completed. SJT took 1.1s. Estimated remaining: 2m 42s. Rate: 154.8 symbols/min [2025-09-22T22:26:12.904105] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-22T22:26:12.903898] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:12.923974] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-09-22T22:26:12.928140] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-22T22:26:12.930552] [INFO ] [MAIN ] Derivative Progress: 1673/2091 symbols completed. SJM took 1.2s. Estimated remaining: 2m 42s. Rate: 154.9 symbols/min [2025-09-22T22:26:12.931256] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:12.949011] [DEBUG] [LOCAL ] SKIL: Loaded 6382 existing records from primary storage. [2025-09-22T22:26:12.949866] [INFO ] [MAIN ] SKIL: Loaded 6382 primary data records. [2025-09-22T22:26:12.950102] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:12.956583] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 35517 primary records. [2025-09-22T22:26:12.959713] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-22T22:26:13.064857] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-09-22T22:26:13.090011] [DEBUG] [LOCAL ] SKLZ: Loaded 12006 existing records from primary storage. [2025-09-22T22:26:13.090134] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-22T22:26:13.092668] [INFO ] [MAIN ] SKLZ: Loaded 12006 primary data records. [2025-09-22T22:26:13.092517] [INFO ] [MAIN ] Derivative Progress: 1674/2091 symbols completed. SKE took 1.3s. Estimated remaining: 2m 42s. Rate: 154.9 symbols/min [2025-09-22T22:26:13.093738] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:13.647108] [DEBUG] [LOCAL ] SKM: Loaded 35277 existing records from primary storage. [2025-09-22T22:26:13.647732] [INFO ] [MAIN ] SKM: Loaded 35277 primary data records. [2025-09-22T22:26:13.983491] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:13.986821] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6382 primary records. [2025-09-22T22:26:13.987374] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-22T22:26:14.015435] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:14.016214] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-09-22T22:26:14.017523] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-22T22:26:14.019676] [INFO ] [MAIN ] Derivative Progress: 1675/2091 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 41s. Rate: 154.8 symbols/min [2025-09-22T22:26:14.017320] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 12006 primary records. [2025-09-22T22:26:14.019842] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-22T22:26:14.020081] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:14.037594] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-09-22T22:26:14.037778] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-22T22:26:14.040161] [INFO ] [MAIN ] Derivative Progress: 1676/2091 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 41s. Rate: 154.9 symbols/min [2025-09-22T22:26:14.040520] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:14.060858] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:14.061705] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35277 primary records. [2025-09-22T22:26:14.061884] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-22T22:26:14.088685] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-09-22T22:26:14.099631] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-22T22:26:14.101682] [INFO ] [MAIN ] Derivative Progress: 1677/2091 symbols completed. SKM took 1.0s. Estimated remaining: 2m 40s. Rate: 155.0 symbols/min [2025-09-22T22:26:14.103070] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:14.112741] [DEBUG] [LOCAL ] SKT: Loaded 42608 existing records from primary storage. [2025-09-22T22:26:14.113053] [INFO ] [MAIN ] SKT: Loaded 42608 primary data records. [2025-09-22T22:26:14.265301] [DEBUG] [LOCAL ] SKY: Loaded 37728 existing records from primary storage. [2025-09-22T22:26:14.293098] [INFO ] [MAIN ] SKY: Loaded 37728 primary data records. [2025-09-22T22:26:14.451555] [DEBUG] [LOCAL ] SKYH: Loaded 16593 existing records from primary storage. [2025-09-22T22:26:14.502706] [INFO ] [MAIN ] SKYH: Loaded 16593 primary data records. [2025-09-22T22:26:15.108061] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:15.109128] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42608 primary records. [2025-09-22T22:26:15.109397] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-22T22:26:15.129505] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-09-22T22:26:15.129817] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-22T22:26:15.131883] [INFO ] [MAIN ] Derivative Progress: 1678/2091 symbols completed. SKT took 1.1s. Estimated remaining: 2m 40s. Rate: 154.8 symbols/min [2025-09-22T22:26:15.145578] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:15.146292] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 37728 primary records. [2025-09-22T22:26:15.146444] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-22T22:26:15.176805] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:15.176864] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-09-22T22:26:15.177019] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-22T22:26:15.179878] [INFO ] [MAIN ] Derivative Progress: 1679/2091 symbols completed. SKY took 1.1s. Estimated remaining: 2m 40s. Rate: 154.9 symbols/min [2025-09-22T22:26:15.177669] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16593 primary records. [2025-09-22T22:26:15.180137] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-22T22:26:15.195197] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-09-22T22:26:15.195258] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-22T22:26:15.197872] [INFO ] [MAIN ] Derivative Progress: 1680/2091 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 39s. Rate: 155.0 symbols/min [2025-09-22T22:26:15.198519] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:15.198572] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:15.198433] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:15.261124] [DEBUG] [LOCAL ] SLF: Loaded 39113 existing records from primary storage. [2025-09-22T22:26:15.273849] [INFO ] [MAIN ] SLF: Loaded 39113 primary data records. [2025-09-22T22:26:15.307343] [DEBUG] [LOCAL ] SLG: Loaded 45628 existing records from primary storage. [2025-09-22T22:26:15.332899] [INFO ] [MAIN ] SLG: Loaded 45628 primary data records. [2025-09-22T22:26:15.453442] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-22T22:26:15.501461] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-09-22T22:26:16.297805] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:16.298880] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45628 primary records. [2025-09-22T22:26:16.299236] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-22T22:26:16.313073] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:16.315113] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 39113 primary records. [2025-09-22T22:26:16.315369] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-22T22:26:16.342479] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-09-22T22:26:16.343307] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-22T22:26:16.343593] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:16.351289] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-09-22T22:26:16.353073] [INFO ] [MAIN ] Derivative Progress: 1681/2091 symbols completed. SLG took 1.2s. Estimated remaining: 2m 39s. Rate: 154.8 symbols/min [2025-09-22T22:26:16.353342] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:16.353174] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-22T22:26:16.374749] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-09-22T22:26:16.375306] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-22T22:26:16.377694] [INFO ] [MAIN ] Derivative Progress: 1682/2091 symbols completed. SLF took 1.2s. Estimated remaining: 2m 38s. Rate: 154.9 symbols/min [2025-09-22T22:26:16.378451] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:16.381940] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-09-22T22:26:16.382099] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-22T22:26:16.384813] [INFO ] [MAIN ] Derivative Progress: 1683/2091 symbols completed. SLB took 1.2s. Estimated remaining: 2m 38s. Rate: 155.0 symbols/min [2025-09-22T22:26:16.385162] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:16.420411] [DEBUG] [LOCAL ] SLVM: Loaded 27918 existing records from primary storage. [2025-09-22T22:26:16.431344] [INFO ] [MAIN ] SLVM: Loaded 27918 primary data records. [2025-09-22T22:26:16.438145] [DEBUG] [LOCAL ] SLGN: Loaded 40275 existing records from primary storage. [2025-09-22T22:26:16.443494] [INFO ] [MAIN ] SLGN: Loaded 40275 primary data records. [2025-09-22T22:26:16.768324] [DEBUG] [LOCAL ] SM: Loaded 52322 existing records from primary storage. [2025-09-22T22:26:16.908759] [INFO ] [MAIN ] SM: Loaded 52322 primary data records. [2025-09-22T22:26:17.410325] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:17.411447] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40275 primary records. [2025-09-22T22:26:17.411630] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-22T22:26:17.426712] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:17.427529] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27918 primary records. [2025-09-22T22:26:17.427926] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-22T22:26:17.460062] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-09-22T22:26:17.457725] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-09-22T22:26:17.460404] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-22T22:26:17.462605] [INFO ] [MAIN ] Derivative Progress: 1684/2091 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 38s. Rate: 154.8 symbols/min [2025-09-22T22:26:17.462948] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:17.463031] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-22T22:26:17.465341] [INFO ] [MAIN ] Derivative Progress: 1685/2091 symbols completed. SLGN took 1.1s. Estimated remaining: 2m 37s. Rate: 154.9 symbols/min [2025-09-22T22:26:17.465953] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:17.482322] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:17.485112] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52322 primary records. [2025-09-22T22:26:17.485324] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-22T22:26:17.504301] [DEBUG] [LOCAL ] SMBK: Loaded 8224 existing records from primary storage. [2025-09-22T22:26:17.505159] [INFO ] [MAIN ] SMBK: Loaded 8224 primary data records. [2025-09-22T22:26:17.540854] [DEBUG] [LOCAL ] SMC: Loaded 11489 existing records from primary storage. [2025-09-22T22:26:17.566251] [INFO ] [MAIN ] SMC: Loaded 11489 primary data records. [2025-09-22T22:26:17.747384] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-09-22T22:26:17.753162] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-22T22:26:17.765940] [INFO ] [MAIN ] Derivative Progress: 1686/2091 symbols completed. SM took 1.4s. Estimated remaining: 2m 37s. Rate: 154.9 symbols/min [2025-09-22T22:26:17.791813] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:18.178465] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:18.178954] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:18.180235] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11489 primary records. [2025-09-22T22:26:18.180371] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-22T22:26:18.181066] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8224 primary records. [2025-09-22T22:26:18.181158] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-22T22:26:18.211052] [DEBUG] [LOCAL ] SMFG: Loaded 48145 existing records from primary storage. [2025-09-22T22:26:18.213896] [INFO ] [MAIN ] SMFG: Loaded 48145 primary data records. [2025-09-22T22:26:18.224346] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-09-22T22:26:18.261420] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-09-22T22:26:18.256211] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-22T22:26:18.261527] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-22T22:26:18.282092] [INFO ] [MAIN ] Derivative Progress: 1687/2091 symbols completed. SMBK took 0.8s. Estimated remaining: 2m 37s. Rate: 154.9 symbols/min [2025-09-22T22:26:18.299119] [INFO ] [MAIN ] Derivative Progress: 1688/2091 symbols completed. SMC took 0.8s. Estimated remaining: 2m 36s. Rate: 155.0 symbols/min [2025-09-22T22:26:18.299220] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:18.321058] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:18.555866] [DEBUG] [LOCAL ] SMHI: Loaded 14048 existing records from primary storage. [2025-09-22T22:26:18.556150] [INFO ] [MAIN ] SMHI: Loaded 14048 primary data records. [2025-09-22T22:26:18.883050] [DEBUG] [LOCAL ] SMG: Loaded 44060 existing records from primary storage. [2025-09-22T22:26:18.883633] [INFO ] [MAIN ] SMG: Loaded 44060 primary data records. [2025-09-22T22:26:19.056627] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:19.085772] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48145 primary records. [2025-09-22T22:26:19.085893] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-22T22:26:19.219780] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-09-22T22:26:19.220157] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-22T22:26:19.222060] [INFO ] [MAIN ] Derivative Progress: 1689/2091 symbols completed. SMFG took 1.4s. Estimated remaining: 2m 36s. Rate: 154.8 symbols/min [2025-09-22T22:26:19.223213] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:19.241595] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:19.242583] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 14048 primary records. [2025-09-22T22:26:19.243084] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-22T22:26:19.266803] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-09-22T22:26:19.266977] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-22T22:26:19.269325] [INFO ] [MAIN ] Derivative Progress: 1690/2091 symbols completed. SMHI took 1.0s. Estimated remaining: 2m 35s. Rate: 154.9 symbols/min [2025-09-22T22:26:19.269824] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:19.279605] [DEBUG] [LOCAL ] SMP: Loaded 19843 existing records from primary storage. [2025-09-22T22:26:19.281670] [INFO ] [MAIN ] SMP: Loaded 19843 primary data records. [2025-09-22T22:26:19.388289] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:19.403225] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 44060 primary records. [2025-09-22T22:26:19.415914] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-22T22:26:19.503720] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-09-22T22:26:19.526220] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-22T22:26:19.630920] [INFO ] [MAIN ] Derivative Progress: 1691/2091 symbols completed. SMG took 1.3s. Estimated remaining: 2m 35s. Rate: 154.9 symbols/min [2025-09-22T22:26:19.646370] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:19.671222] [DEBUG] [LOCAL ] SMR: Loaded 53797 existing records from primary storage. [2025-09-22T22:26:19.672482] [INFO ] [MAIN ] SMR: Loaded 53797 primary data records. [2025-09-22T22:26:20.006774] [DEBUG] [LOCAL ] SMRT: Loaded 44359 existing records from primary storage. [2025-09-22T22:26:20.007342] [INFO ] [MAIN ] SMRT: Loaded 44359 primary data records. [2025-09-22T22:26:20.137741] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:20.144809] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 19843 primary records. [2025-09-22T22:26:20.199219] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-22T22:26:20.419517] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-09-22T22:26:20.419893] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-22T22:26:20.422106] [INFO ] [MAIN ] Derivative Progress: 1692/2091 symbols completed. SMP took 1.2s. Estimated remaining: 2m 35s. Rate: 154.8 symbols/min [2025-09-22T22:26:20.435141] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:20.435426] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:20.437181] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53797 primary records. [2025-09-22T22:26:20.437806] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-09-22T22:26:20.456149] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-09-22T22:26:20.456242] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-09-22T22:26:20.458701] [INFO ] [MAIN ] Derivative Progress: 1693/2091 symbols completed. SMR took 1.2s. Estimated remaining: 2m 34s. Rate: 154.9 symbols/min [2025-09-22T22:26:20.489031] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:20.489828] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 44359 primary records. [2025-09-22T22:26:20.489900] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-22T22:26:20.512344] [DEBUG] [LOCAL ] SMWB: Loaded 33043 existing records from primary storage. [2025-09-22T22:26:20.513194] [INFO ] [MAIN ] SMWB: Loaded 33043 primary data records. [2025-09-22T22:26:20.661940] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-09-22T22:26:20.674800] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-22T22:26:20.694519] [INFO ] [MAIN ] Derivative Progress: 1694/2091 symbols completed. SMRT took 1.0s. Estimated remaining: 2m 34s. Rate: 154.9 symbols/min [2025-09-22T22:26:20.841259] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:20.841977] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 33043 primary records. [2025-09-22T22:26:20.842042] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-22T22:26:20.857789] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-09-22T22:26:20.857857] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-22T22:26:20.860369] [INFO ] [MAIN ] Derivative Progress: 1695/2091 symbols completed. SMWB took 0.4s. Estimated remaining: 2m 33s. Rate: 155.0 symbols/min [2025-09-22T22:26:20.861611] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:20.861828] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:20.861262] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:20.917468] [DEBUG] [LOCAL ] SNA: Loaded 26407 existing records from primary storage. [2025-09-22T22:26:20.917616] [INFO ] [MAIN ] SNA: Loaded 26407 primary data records. [2025-09-22T22:26:21.067250] [DEBUG] [LOCAL ] SN: Loaded 49808 existing records from primary storage. [2025-09-22T22:26:21.082889] [INFO ] [MAIN ] SN: Loaded 49808 primary data records. [2025-09-22T22:26:21.127419] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-22T22:26:21.205267] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-09-22T22:26:21.937270] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:21.938928] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 26407 primary records. [2025-09-22T22:26:21.939199] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-22T22:26:21.960088] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-09-22T22:26:21.960460] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-22T22:26:21.962327] [INFO ] [MAIN ] Derivative Progress: 1696/2091 symbols completed. SNA took 1.1s. Estimated remaining: 2m 33s. Rate: 154.8 symbols/min [2025-09-22T22:26:21.962879] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:21.976871] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:21.977598] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49808 primary records. [2025-09-22T22:26:21.977912] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-22T22:26:21.997188] [DEBUG] [LOCAL ] SNDA: Loaded 4685 existing records from primary storage. [2025-09-22T22:26:21.997615] [INFO ] [MAIN ] SNDA: Loaded 4685 primary data records. [2025-09-22T22:26:22.102473] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:22.120882] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-09-22T22:26:22.121711] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-09-22T22:26:22.121809] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-22T22:26:22.127611] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-22T22:26:22.140908] [INFO ] [MAIN ] Derivative Progress: 1697/2091 symbols completed. SN took 1.3s. Estimated remaining: 2m 33s. Rate: 154.9 symbols/min [2025-09-22T22:26:22.152015] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:22.388747] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-09-22T22:26:22.389051] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-22T22:26:22.392292] [INFO ] [MAIN ] Derivative Progress: 1698/2091 symbols completed. SNAP took 1.5s. Estimated remaining: 2m 32s. Rate: 154.9 symbols/min [2025-09-22T22:26:22.392726] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:22.432806] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:22.433521] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4685 primary records. [2025-09-22T22:26:22.433695] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-22T22:26:22.476058] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-09-22T22:26:22.476349] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-22T22:26:22.478278] [INFO ] [MAIN ] Derivative Progress: 1699/2091 symbols completed. SNDA took 0.5s. Estimated remaining: 2m 32s. Rate: 155.0 symbols/min [2025-09-22T22:26:22.478620] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:22.480077] [DEBUG] [LOCAL ] SNDR: Loaded 40586 existing records from primary storage. [2025-09-22T22:26:22.480682] [INFO ] [MAIN ] SNDR: Loaded 40586 primary data records. [2025-09-22T22:26:22.578933] [DEBUG] [LOCAL ] SNN: Loaded 44348 existing records from primary storage. [2025-09-22T22:26:22.591383] [INFO ] [MAIN ] SNN: Loaded 44348 primary data records. [2025-09-22T22:26:23.160205] [DEBUG] [LOCAL ] SNOW: Loaded 53596 existing records from primary storage. [2025-09-22T22:26:23.160667] [INFO ] [MAIN ] SNOW: Loaded 53596 primary data records. [2025-09-22T22:26:23.501602] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:23.503436] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 40586 primary records. [2025-09-22T22:26:23.503807] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-22T22:26:23.526827] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:23.536183] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44348 primary records. [2025-09-22T22:26:23.536448] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-22T22:26:23.534894] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-09-22T22:26:23.537508] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-22T22:26:23.547334] [INFO ] [MAIN ] Derivative Progress: 1700/2091 symbols completed. SNDR took 1.4s. Estimated remaining: 2m 32s. Rate: 154.8 symbols/min [2025-09-22T22:26:23.554930] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:23.557898] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-09-22T22:26:23.558172] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-22T22:26:23.561944] [INFO ] [MAIN ] Derivative Progress: 1701/2091 symbols completed. SNN took 1.2s. Estimated remaining: 2m 31s. Rate: 154.9 symbols/min [2025-09-22T22:26:23.562793] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:23.584591] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:23.585572] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53596 primary records. [2025-09-22T22:26:23.585769] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-09-22T22:26:23.631301] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-09-22T22:26:23.631511] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-22T22:26:23.634374] [INFO ] [MAIN ] Derivative Progress: 1702/2091 symbols completed. SNOW took 1.2s. Estimated remaining: 2m 31s. Rate: 155.0 symbols/min [2025-09-22T22:26:23.635048] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:23.668282] [DEBUG] [LOCAL ] SNV: Loaded 48919 existing records from primary storage. [2025-09-22T22:26:23.668615] [INFO ] [MAIN ] SNV: Loaded 48919 primary data records. [2025-09-22T22:26:23.669453] [DEBUG] [LOCAL ] SNX: Loaded 39681 existing records from primary storage. [2025-09-22T22:26:23.684782] [INFO ] [MAIN ] SNX: Loaded 39681 primary data records. [2025-09-22T22:26:23.957200] [DEBUG] [LOCAL ] SOBO: Loaded 39754 existing records from primary storage. [2025-09-22T22:26:23.978101] [INFO ] [MAIN ] SOBO: Loaded 39754 primary data records. [2025-09-22T22:26:24.757189] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:24.770272] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48919 primary records. [2025-09-22T22:26:24.770601] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:24.771146] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-22T22:26:24.771959] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39681 primary records. [2025-09-22T22:26:24.773298] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-22T22:26:24.806798] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-09-22T22:26:24.807846] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-22T22:26:24.807904] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-09-22T22:26:24.810545] [INFO ] [MAIN ] Derivative Progress: 1703/2091 symbols completed. SNX took 1.2s. Estimated remaining: 2m 30s. Rate: 154.8 symbols/min [2025-09-22T22:26:24.823228] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:24.822872] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-22T22:26:24.826258] [INFO ] [MAIN ] Derivative Progress: 1704/2091 symbols completed. SNV took 1.3s. Estimated remaining: 2m 30s. Rate: 154.9 symbols/min [2025-09-22T22:26:24.823940] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:24.827793] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39754 primary records. [2025-09-22T22:26:24.826704] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:24.828085] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-22T22:26:24.846555] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-09-22T22:26:24.846860] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-22T22:26:24.848948] [INFO ] [MAIN ] Derivative Progress: 1705/2091 symbols completed. SOBO took 1.2s. Estimated remaining: 2m 29s. Rate: 155.0 symbols/min [2025-09-22T22:26:24.849346] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:24.852628] [DEBUG] [LOCAL ] SOJC: Loaded 5096 existing records from primary storage. [2025-09-22T22:26:24.853127] [INFO ] [MAIN ] SOJC: Loaded 5096 primary data records. [2025-09-22T22:26:24.998543] [DEBUG] [LOCAL ] SOJD: Loaded 12942 existing records from primary storage. [2025-09-22T22:26:25.009714] [INFO ] [MAIN ] SOJD: Loaded 12942 primary data records. [2025-09-22T22:26:25.294501] [DEBUG] [LOCAL ] SOC: Loaded 50243 existing records from primary storage. [2025-09-22T22:26:25.321969] [INFO ] [MAIN ] SOC: Loaded 50243 primary data records. [2025-09-22T22:26:25.856582] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:25.857905] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 5096 primary records. [2025-09-22T22:26:25.858746] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-22T22:26:25.879816] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-09-22T22:26:25.880249] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-22T22:26:25.895089] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:25.894747] [INFO ] [MAIN ] Derivative Progress: 1706/2091 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 29s. Rate: 154.8 symbols/min [2025-09-22T22:26:25.895968] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12942 primary records. [2025-09-22T22:26:25.896337] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:25.896742] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-22T22:26:25.914409] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-09-22T22:26:25.916618] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-22T22:26:25.918623] [INFO ] [MAIN ] Derivative Progress: 1707/2091 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 29s. Rate: 154.9 symbols/min [2025-09-22T22:26:25.919058] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:25.927404] [DEBUG] [LOCAL ] SOJE: Loaded 9387 existing records from primary storage. [2025-09-22T22:26:25.927686] [INFO ] [MAIN ] SOJE: Loaded 9387 primary data records. [2025-09-22T22:26:25.941522] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:25.942358] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50243 primary records. [2025-09-22T22:26:25.963992] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-22T22:26:26.058887] [DEBUG] [LOCAL ] SOL: Loaded 13563 existing records from primary storage. [2025-09-22T22:26:26.069490] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-09-22T22:26:26.073361] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-22T22:26:26.073278] [INFO ] [MAIN ] SOL: Loaded 13563 primary data records. [2025-09-22T22:26:26.075881] [INFO ] [MAIN ] Derivative Progress: 1708/2091 symbols completed. SOC took 1.3s. Estimated remaining: 2m 28s. Rate: 155.0 symbols/min [2025-09-22T22:26:26.648789] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:26.649605] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9387 primary records. [2025-09-22T22:26:26.649805] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-22T22:26:26.680907] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:26.682355] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13563 primary records. [2025-09-22T22:26:26.682705] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-22T22:26:26.683435] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-09-22T22:26:26.683802] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-22T22:26:26.685769] [INFO ] [MAIN ] Derivative Progress: 1709/2091 symbols completed. SOJE took 0.8s. Estimated remaining: 2m 28s. Rate: 154.9 symbols/min [2025-09-22T22:26:26.700798] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-09-22T22:26:26.700867] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-22T22:26:26.703090] [INFO ] [MAIN ] Derivative Progress: 1710/2091 symbols completed. SOL took 0.8s. Estimated remaining: 2m 27s. Rate: 155.0 symbols/min [2025-09-22T22:26:26.703796] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:26.703913] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:26.704390] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:26.764752] [DEBUG] [LOCAL ] SOLV: Loaded 44184 existing records from primary storage. [2025-09-22T22:26:26.775323] [INFO ] [MAIN ] SOLV: Loaded 44184 primary data records. [2025-09-22T22:26:26.909187] [DEBUG] [LOCAL ] SON: Loaded 42869 existing records from primary storage. [2025-09-22T22:26:26.920804] [DEBUG] [LOCAL ] SONY: Loaded 53361 existing records from primary storage. [2025-09-22T22:26:26.931238] [INFO ] [MAIN ] SON: Loaded 42869 primary data records. [2025-09-22T22:26:26.931345] [INFO ] [MAIN ] SONY: Loaded 53361 primary data records. [2025-09-22T22:26:27.775201] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:27.776243] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 44184 primary records. [2025-09-22T22:26:27.776722] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-22T22:26:27.793923] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-09-22T22:26:27.794202] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-22T22:26:27.796874] [INFO ] [MAIN ] Derivative Progress: 1711/2091 symbols completed. SOLV took 1.1s. Estimated remaining: 2m 27s. Rate: 154.8 symbols/min [2025-09-22T22:26:27.798202] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:27.815450] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:27.816527] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 42869 primary records. [2025-09-22T22:26:27.816782] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-22T22:26:27.819479] [DEBUG] [LOCAL ] SOR: Loaded 2948 existing records from primary storage. [2025-09-22T22:26:27.832070] [INFO ] [MAIN ] SOR: Loaded 2948 primary data records. [2025-09-22T22:26:27.832857] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:27.833917] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53361 primary records. [2025-09-22T22:26:27.866956] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-22T22:26:27.909210] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-09-22T22:26:27.935855] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-22T22:26:27.969274] [INFO ] [MAIN ] Derivative Progress: 1712/2091 symbols completed. SON took 1.3s. Estimated remaining: 2m 27s. Rate: 154.9 symbols/min [2025-09-22T22:26:27.979286] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:27.997588] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-09-22T22:26:28.016781] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-22T22:26:28.059222] [INFO ] [MAIN ] Derivative Progress: 1713/2091 symbols completed. SONY took 1.4s. Estimated remaining: 2m 26s. Rate: 154.9 symbols/min [2025-09-22T22:26:28.182064] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:28.192672] [DEBUG] [LOCAL ] SOS: Loaded 7756 existing records from primary storage. [2025-09-22T22:26:28.193041] [INFO ] [MAIN ] SOS: Loaded 7756 primary data records. [2025-09-22T22:26:28.557123] [DEBUG] [LOCAL ] SPB: Loaded 34211 existing records from primary storage. [2025-09-22T22:26:28.558377] [INFO ] [MAIN ] SPB: Loaded 34211 primary data records. [2025-09-22T22:26:28.659467] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:28.683733] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2948 primary records. [2025-09-22T22:26:28.690167] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-22T22:26:28.909830] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-09-22T22:26:28.910774] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-22T22:26:28.915694] [INFO ] [MAIN ] Derivative Progress: 1714/2091 symbols completed. SOR took 1.1s. Estimated remaining: 2m 26s. Rate: 154.8 symbols/min [2025-09-22T22:26:28.916277] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:28.935856] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:28.937384] [INFO ] [MAIN ] SOS: Generated 1794 derivative records from 7756 primary records. [2025-09-22T22:26:28.937488] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-22T22:26:28.953425] [DEBUG] [LOCAL ] SOS: Derivative data saved (1794 records). [2025-09-22T22:26:28.953581] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-22T22:26:28.957570] [INFO ] [MAIN ] Derivative Progress: 1715/2091 symbols completed. SOS took 1.0s. Estimated remaining: 2m 26s. Rate: 154.9 symbols/min [2025-09-22T22:26:28.958110] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:28.972479] [DEBUG] [LOCAL ] SPE: Loaded 6383 existing records from primary storage. [2025-09-22T22:26:28.973486] [INFO ] [MAIN ] SPE: Loaded 6383 primary data records. [2025-09-22T22:26:29.053919] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:29.064454] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34211 primary records. [2025-09-22T22:26:29.070941] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-22T22:26:29.173121] [DEBUG] [LOCAL ] SPCE: Loaded 49801 existing records from primary storage. [2025-09-22T22:26:29.209619] [INFO ] [MAIN ] SPCE: Loaded 49801 primary data records. [2025-09-22T22:26:29.209519] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-09-22T22:26:29.344499] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-22T22:26:29.361125] [INFO ] [MAIN ] Derivative Progress: 1716/2091 symbols completed. SPB took 1.2s. Estimated remaining: 2m 25s. Rate: 154.9 symbols/min [2025-09-22T22:26:29.402580] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:29.670847] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:29.672011] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6383 primary records. [2025-09-22T22:26:29.686127] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-22T22:26:29.705416] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-09-22T22:26:29.705820] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-22T22:26:29.707920] [INFO ] [MAIN ] Derivative Progress: 1717/2091 symbols completed. SPE took 0.8s. Estimated remaining: 2m 25s. Rate: 154.9 symbols/min [2025-09-22T22:26:29.722490] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:29.725995] [DEBUG] [LOCAL ] SPG: Loaded 50466 existing records from primary storage. [2025-09-22T22:26:29.727038] [INFO ] [MAIN ] SPG: Loaded 50466 primary data records. [2025-09-22T22:26:29.806626] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:29.836371] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49801 primary records. [2025-09-22T22:26:29.847547] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-22T22:26:30.062581] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-09-22T22:26:30.076768] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-22T22:26:30.091319] [INFO ] [MAIN ] Derivative Progress: 1718/2091 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 24s. Rate: 154.9 symbols/min [2025-09-22T22:26:30.093056] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:30.093948] [DEBUG] [LOCAL ] SPGI: Loaded 45821 existing records from primary storage. [2025-09-22T22:26:30.094410] [INFO ] [MAIN ] SPGI: Loaded 45821 primary data records. [2025-09-22T22:26:30.269101] [DEBUG] [LOCAL ] SPH: Loaded 18307 existing records from primary storage. [2025-09-22T22:26:30.296704] [INFO ] [MAIN ] SPH: Loaded 18307 primary data records. [2025-09-22T22:26:30.810332] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:30.811978] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50466 primary records. [2025-09-22T22:26:30.812406] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-22T22:26:30.833314] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-09-22T22:26:30.833607] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-22T22:26:30.837094] [INFO ] [MAIN ] Derivative Progress: 1719/2091 symbols completed. SPG took 1.5s. Estimated remaining: 2m 24s. Rate: 154.8 symbols/min [2025-09-22T22:26:30.838570] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:30.856345] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:30.857475] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45821 primary records. [2025-09-22T22:26:30.857799] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-22T22:26:30.876192] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-09-22T22:26:30.876457] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-22T22:26:30.879395] [INFO ] [MAIN ] Derivative Progress: 1720/2091 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 24s. Rate: 154.9 symbols/min [2025-09-22T22:26:30.881492] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:30.895919] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:30.896718] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 18307 primary records. [2025-09-22T22:26:30.896910] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-22T22:26:30.922039] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-09-22T22:26:30.922224] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-22T22:26:30.924691] [INFO ] [MAIN ] Derivative Progress: 1721/2091 symbols completed. SPH took 0.8s. Estimated remaining: 2m 23s. Rate: 155.0 symbols/min [2025-09-22T22:26:30.925157] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:30.941531] [DEBUG] [LOCAL ] SPHR: Loaded 40118 existing records from primary storage. [2025-09-22T22:26:30.941790] [INFO ] [MAIN ] SPHR: Loaded 40118 primary data records. [2025-09-22T22:26:30.998699] [DEBUG] [LOCAL ] SPMC: Loaded 5632 existing records from primary storage. [2025-09-22T22:26:31.038254] [INFO ] [MAIN ] SPMC: Loaded 5632 primary data records. [2025-09-22T22:26:31.156901] [DEBUG] [LOCAL ] SPIR: Loaded 37422 existing records from primary storage. [2025-09-22T22:26:31.195827] [INFO ] [MAIN ] SPIR: Loaded 37422 primary data records. [2025-09-22T22:26:31.938501] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:31.940164] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40118 primary records. [2025-09-22T22:26:31.940370] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-22T22:26:31.966212] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:31.971024] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5632 primary records. [2025-09-22T22:26:31.971974] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-09-22T22:26:31.972061] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-22T22:26:31.972837] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-22T22:26:31.977664] [INFO ] [MAIN ] Derivative Progress: 1722/2091 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 23s. Rate: 154.8 symbols/min [2025-09-22T22:26:31.986755] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:32.004945] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:32.006357] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37422 primary records. [2025-09-22T22:26:32.006970] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-22T22:26:32.008919] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-09-22T22:26:32.016384] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-22T22:26:32.018610] [INFO ] [MAIN ] Derivative Progress: 1723/2091 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 23s. Rate: 154.9 symbols/min [2025-09-22T22:26:32.026866] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-09-22T22:26:32.026962] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-22T22:26:32.029247] [INFO ] [MAIN ] Derivative Progress: 1724/2091 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 22s. Rate: 155.0 symbols/min [2025-09-22T22:26:32.055739] [DEBUG] [LOCAL ] SPNT: Loaded 34818 existing records from primary storage. [2025-09-22T22:26:32.055867] [INFO ] [MAIN ] SPNT: Loaded 34818 primary data records. [2025-09-22T22:26:32.372881] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:32.373468] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34818 primary records. [2025-09-22T22:26:32.373528] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-22T22:26:32.388955] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-09-22T22:26:32.389015] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-22T22:26:32.391002] [INFO ] [MAIN ] Derivative Progress: 1725/2091 symbols completed. SPNT took 0.4s. Estimated remaining: 2m 22s. Rate: 155.0 symbols/min [2025-09-22T22:26:32.392290] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:32.392493] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:32.392154] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:32.403782] [DEBUG] [LOCAL ] SPRU: Loaded 8394 existing records from primary storage. [2025-09-22T22:26:32.403912] [INFO ] [MAIN ] SPRU: Loaded 8394 primary data records. [2025-09-22T22:26:32.796816] [DEBUG] [LOCAL ] SPR: Loaded 41299 existing records from primary storage. [2025-09-22T22:26:32.797561] [INFO ] [MAIN ] SPR: Loaded 41299 primary data records. [2025-09-22T22:26:32.798214] [DEBUG] [LOCAL ] SPOT: Loaded 50923 existing records from primary storage. [2025-09-22T22:26:32.798327] [INFO ] [MAIN ] SPOT: Loaded 50923 primary data records. [2025-09-22T22:26:33.418680] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:33.420281] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 8394 primary records. [2025-09-22T22:26:33.420364] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-22T22:26:33.437825] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-09-22T22:26:33.438738] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-22T22:26:33.441315] [INFO ] [MAIN ] Derivative Progress: 1726/2091 symbols completed. SPRU took 1.0s. Estimated remaining: 2m 21s. Rate: 154.9 symbols/min [2025-09-22T22:26:33.441836] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:33.462339] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:33.470623] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50923 primary records. [2025-09-22T22:26:33.471347] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-22T22:26:33.493724] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:33.500988] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41299 primary records. [2025-09-22T22:26:33.504935] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-22T22:26:33.506817] [DEBUG] [LOCAL ] SPXC: Loaded 23401 existing records from primary storage. [2025-09-22T22:26:33.507380] [INFO ] [MAIN ] SPXC: Loaded 23401 primary data records. [2025-09-22T22:26:33.567256] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-09-22T22:26:33.567367] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-22T22:26:33.582089] [INFO ] [MAIN ] Derivative Progress: 1727/2091 symbols completed. SPR took 1.2s. Estimated remaining: 2m 21s. Rate: 154.9 symbols/min [2025-09-22T22:26:33.591683] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:33.621147] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-09-22T22:26:33.628971] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-22T22:26:33.635038] [INFO ] [MAIN ] Derivative Progress: 1728/2091 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 21s. Rate: 155.0 symbols/min [2025-09-22T22:26:33.664316] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:33.720836] [DEBUG] [LOCAL ] SPXX: Loaded 8971 existing records from primary storage. [2025-09-22T22:26:33.835133] [INFO ] [MAIN ] SPXX: Loaded 8971 primary data records. [2025-09-22T22:26:34.165231] [DEBUG] [LOCAL ] SQM: Loaded 48556 existing records from primary storage. [2025-09-22T22:26:34.165978] [INFO ] [MAIN ] SQM: Loaded 48556 primary data records. [2025-09-22T22:26:34.270674] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:34.288457] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23401 primary records. [2025-09-22T22:26:34.288562] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-22T22:26:34.541028] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-09-22T22:26:34.554743] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-22T22:26:34.564474] [INFO ] [MAIN ] Derivative Progress: 1729/2091 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 20s. Rate: 154.9 symbols/min [2025-09-22T22:26:34.570172] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:34.570112] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:34.570977] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 8971 primary records. [2025-09-22T22:26:34.571402] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-22T22:26:34.588202] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-09-22T22:26:34.588774] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-22T22:26:34.591294] [INFO ] [MAIN ] Derivative Progress: 1730/2091 symbols completed. SPXX took 1.0s. Estimated remaining: 2m 20s. Rate: 155.0 symbols/min [2025-09-22T22:26:34.591841] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:34.616425] [DEBUG] [LOCAL ] SQNS: Loaded 25715 existing records from primary storage. [2025-09-22T22:26:34.616708] [INFO ] [MAIN ] SQNS: Loaded 25715 primary data records. [2025-09-22T22:26:34.662009] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:34.682426] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48556 primary records. [2025-09-22T22:26:34.707738] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-22T22:26:34.784562] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-09-22T22:26:34.814900] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-22T22:26:34.817089] [INFO ] [MAIN ] Derivative Progress: 1731/2091 symbols completed. SQM took 1.2s. Estimated remaining: 2m 19s. Rate: 155.0 symbols/min [2025-09-22T22:26:34.818295] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:34.818201] [DEBUG] [LOCAL ] SR: Loaded 32752 existing records from primary storage. [2025-09-22T22:26:34.827577] [INFO ] [MAIN ] SR: Loaded 32752 primary data records. [2025-09-22T22:26:35.341590] [DEBUG] [LOCAL ] SRE: Loaded 53426 existing records from primary storage. [2025-09-22T22:26:35.342833] [INFO ] [MAIN ] SRE: Loaded 53426 primary data records. [2025-09-22T22:26:35.457595] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:35.477863] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 25715 primary records. [2025-09-22T22:26:35.494186] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-22T22:26:35.696011] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:35.708870] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-09-22T22:26:35.709059] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-22T22:26:35.711529] [INFO ] [MAIN ] Derivative Progress: 1732/2091 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 19s. Rate: 154.9 symbols/min [2025-09-22T22:26:35.712145] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:35.707495] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32752 primary records. [2025-09-22T22:26:35.713440] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-22T22:26:35.740957] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-09-22T22:26:35.740166] [DEBUG] [LOCAL ] SREA: Loaded 10440 existing records from primary storage. [2025-09-22T22:26:35.741263] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-22T22:26:35.743475] [INFO ] [MAIN ] Derivative Progress: 1733/2091 symbols completed. SR took 1.2s. Estimated remaining: 2m 19s. Rate: 155.0 symbols/min [2025-09-22T22:26:35.743840] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:35.743617] [INFO ] [MAIN ] SREA: Loaded 10440 primary data records. [2025-09-22T22:26:36.071071] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:36.080964] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53426 primary records. [2025-09-22T22:26:36.082480] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-22T22:26:36.083996] [DEBUG] [LOCAL ] SRFM: Loaded 35323 existing records from primary storage. [2025-09-22T22:26:36.084110] [INFO ] [MAIN ] SRFM: Loaded 35323 primary data records. [2025-09-22T22:26:36.170897] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-09-22T22:26:36.206009] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-22T22:26:36.208294] [INFO ] [MAIN ] Derivative Progress: 1734/2091 symbols completed. SRE took 1.4s. Estimated remaining: 2m 18s. Rate: 154.9 symbols/min [2025-09-22T22:26:36.219761] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:36.443211] [DEBUG] [LOCAL ] SRG: Loaded 15896 existing records from primary storage. [2025-09-22T22:26:36.443747] [INFO ] [MAIN ] SRG: Loaded 15896 primary data records. [2025-09-22T22:26:36.444131] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:36.446496] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10440 primary records. [2025-09-22T22:26:36.452020] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-22T22:26:36.634466] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-09-22T22:26:36.712286] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-22T22:26:36.766205] [INFO ] [MAIN ] Derivative Progress: 1735/2091 symbols completed. SREA took 1.1s. Estimated remaining: 2m 18s. Rate: 154.9 symbols/min [2025-09-22T22:26:36.835714] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:36.857028] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:36.859163] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 35323 primary records. [2025-09-22T22:26:36.859412] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-22T22:26:36.885690] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-09-22T22:26:36.885839] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-22T22:26:36.887900] [INFO ] [MAIN ] Derivative Progress: 1736/2091 symbols completed. SRFM took 1.1s. Estimated remaining: 2m 17s. Rate: 155.0 symbols/min [2025-09-22T22:26:36.888672] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:36.917448] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:36.917144] [DEBUG] [LOCAL ] SRI: Loaded 27710 existing records from primary storage. [2025-09-22T22:26:36.917685] [INFO ] [MAIN ] SRI: Loaded 27710 primary data records. [2025-09-22T22:26:36.921783] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15896 primary records. [2025-09-22T22:26:36.922035] [DEBUG] [LOCAL ] SRV: Loaded 7679 existing records from primary storage. [2025-09-22T22:26:36.922160] [INFO ] [MAIN ] SRV: Loaded 7679 primary data records. [2025-09-22T22:26:36.922203] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-22T22:26:37.175324] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-09-22T22:26:37.186284] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-22T22:26:37.244938] [INFO ] [MAIN ] Derivative Progress: 1737/2091 symbols completed. SRG took 1.0s. Estimated remaining: 2m 17s. Rate: 155.0 symbols/min [2025-09-22T22:26:37.431174] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:37.580912] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:37.581734] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7679 primary records. [2025-09-22T22:26:37.581863] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-22T22:26:37.623388] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-09-22T22:26:37.623748] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-22T22:26:37.626031] [INFO ] [MAIN ] Derivative Progress: 1738/2091 symbols completed. SRV took 0.7s. Estimated remaining: 2m 17s. Rate: 155.0 symbols/min [2025-09-22T22:26:37.626715] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:37.627573] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 27710 primary records. [2025-09-22T22:26:37.627727] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-22T22:26:37.655513] [DEBUG] [LOCAL ] SSB: Loaded 42996 existing records from primary storage. [2025-09-22T22:26:37.656176] [INFO ] [MAIN ] SSB: Loaded 42996 primary data records. [2025-09-22T22:26:37.701847] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-09-22T22:26:37.729600] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-22T22:26:37.743003] [INFO ] [MAIN ] Derivative Progress: 1739/2091 symbols completed. SRI took 0.9s. Estimated remaining: 2m 16s. Rate: 155.0 symbols/min [2025-09-22T22:26:37.981204] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:37.981839] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42996 primary records. [2025-09-22T22:26:37.981902] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-22T22:26:37.997421] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-09-22T22:26:37.997482] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-22T22:26:37.999766] [INFO ] [MAIN ] Derivative Progress: 1740/2091 symbols completed. SSB took 0.7s. Estimated remaining: 2m 16s. Rate: 155.1 symbols/min [2025-09-22T22:26:38.000854] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:38.000570] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:38.001083] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:38.016714] [DEBUG] [LOCAL ] SST: Loaded 12280 existing records from primary storage. [2025-09-22T22:26:38.016871] [INFO ] [MAIN ] SST: Loaded 12280 primary data records. [2025-09-22T22:26:38.148549] [DEBUG] [LOCAL ] SSD: Loaded 22336 existing records from primary storage. [2025-09-22T22:26:38.148787] [INFO ] [MAIN ] SSD: Loaded 22336 primary data records. [2025-09-22T22:26:38.441676] [DEBUG] [LOCAL ] SSL: Loaded 41162 existing records from primary storage. [2025-09-22T22:26:38.453262] [INFO ] [MAIN ] SSL: Loaded 41162 primary data records. [2025-09-22T22:26:39.126696] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:39.127470] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 12280 primary records. [2025-09-22T22:26:39.127739] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-22T22:26:39.147546] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-09-22T22:26:39.147881] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-22T22:26:39.150097] [INFO ] [MAIN ] Derivative Progress: 1741/2091 symbols completed. SST took 1.1s. Estimated remaining: 2m 16s. Rate: 154.9 symbols/min [2025-09-22T22:26:39.150404] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:39.169149] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:39.170034] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22336 primary records. [2025-09-22T22:26:39.170376] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-22T22:26:39.195451] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-09-22T22:26:39.196525] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-22T22:26:39.199423] [INFO ] [MAIN ] Derivative Progress: 1742/2091 symbols completed. SSD took 1.2s. Estimated remaining: 2m 15s. Rate: 155.0 symbols/min [2025-09-22T22:26:39.199750] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:39.209793] [DEBUG] [LOCAL ] SSTK: Loaded 26778 existing records from primary storage. [2025-09-22T22:26:39.222372] [INFO ] [MAIN ] SSTK: Loaded 26778 primary data records. [2025-09-22T22:26:39.222818] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:39.235186] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41162 primary records. [2025-09-22T22:26:39.244920] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-22T22:26:39.425833] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-09-22T22:26:39.544545] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-22T22:26:39.547102] [INFO ] [MAIN ] Derivative Progress: 1743/2091 symbols completed. SSL took 1.5s. Estimated remaining: 2m 15s. Rate: 155.0 symbols/min [2025-09-22T22:26:39.548003] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:39.591185] [DEBUG] [LOCAL ] ST: Loaded 49833 existing records from primary storage. [2025-09-22T22:26:39.592046] [INFO ] [MAIN ] ST: Loaded 49833 primary data records. [2025-09-22T22:26:39.830461] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:39.837794] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 26778 primary records. [2025-09-22T22:26:39.837981] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-22T22:26:39.956773] [DEBUG] [LOCAL ] STAG: Loaded 50044 existing records from primary storage. [2025-09-22T22:26:39.971902] [INFO ] [MAIN ] STAG: Loaded 50044 primary data records. [2025-09-22T22:26:40.095153] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-09-22T22:26:40.106089] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-22T22:26:40.110332] [INFO ] [MAIN ] Derivative Progress: 1744/2091 symbols completed. SSTK took 1.0s. Estimated remaining: 2m 14s. Rate: 154.9 symbols/min [2025-09-22T22:26:40.115756] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:40.315727] [DEBUG] [LOCAL ] STC: Loaded 17811 existing records from primary storage. [2025-09-22T22:26:40.316885] [INFO ] [MAIN ] STC: Loaded 17811 primary data records. [2025-09-22T22:26:40.396510] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:40.410397] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49833 primary records. [2025-09-22T22:26:40.410536] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-22T22:26:40.711952] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-09-22T22:26:40.712352] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-22T22:26:40.714563] [INFO ] [MAIN ] Derivative Progress: 1745/2091 symbols completed. ST took 1.5s. Estimated remaining: 2m 14s. Rate: 154.9 symbols/min [2025-09-22T22:26:40.715675] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:40.737304] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:40.738326] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50044 primary records. [2025-09-22T22:26:40.738924] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-22T22:26:40.759886] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-09-22T22:26:40.768441] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-22T22:26:40.770878] [INFO ] [MAIN ] Derivative Progress: 1746/2091 symbols completed. STAG took 1.2s. Estimated remaining: 2m 14s. Rate: 155.0 symbols/min [2025-09-22T22:26:40.771581] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:40.788992] [DEBUG] [LOCAL ] STE: Loaded 35458 existing records from primary storage. [2025-09-22T22:26:40.789382] [INFO ] [MAIN ] STE: Loaded 35458 primary data records. [2025-09-22T22:26:40.858179] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:40.901925] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17811 primary records. [2025-09-22T22:26:40.913009] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-22T22:26:40.980192] [DEBUG] [LOCAL ] STEL: Loaded 23723 existing records from primary storage. [2025-09-22T22:26:41.007094] [INFO ] [MAIN ] STEL: Loaded 23723 primary data records. [2025-09-22T22:26:41.189377] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-09-22T22:26:41.203970] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-22T22:26:41.206251] [INFO ] [MAIN ] Derivative Progress: 1747/2091 symbols completed. STC took 1.1s. Estimated remaining: 2m 13s. Rate: 155.0 symbols/min [2025-09-22T22:26:41.229111] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:41.498052] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:41.510478] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35458 primary records. [2025-09-22T22:26:41.511822] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-22T22:26:41.512975] [DEBUG] [LOCAL ] STEM: Loaded 39998 existing records from primary storage. [2025-09-22T22:26:41.514805] [INFO ] [MAIN ] STEM: Loaded 39998 primary data records. [2025-09-22T22:26:41.621992] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-09-22T22:26:41.632306] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-22T22:26:41.648633] [INFO ] [MAIN ] Derivative Progress: 1748/2091 symbols completed. STE took 0.9s. Estimated remaining: 2m 13s. Rate: 154.9 symbols/min [2025-09-22T22:26:41.676757] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:41.873347] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:41.875027] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 23723 primary records. [2025-09-22T22:26:41.875159] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-22T22:26:41.899022] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-09-22T22:26:41.899462] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-22T22:26:41.901608] [INFO ] [MAIN ] Derivative Progress: 1749/2091 symbols completed. STEL took 1.1s. Estimated remaining: 2m 12s. Rate: 155.0 symbols/min [2025-09-22T22:26:41.902264] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:41.909409] [DEBUG] [LOCAL ] STEW: Loaded 16288 existing records from primary storage. [2025-09-22T22:26:41.909560] [INFO ] [MAIN ] STEW: Loaded 16288 primary data records. [2025-09-22T22:26:42.028462] [DEBUG] [LOCAL ] STK: Loaded 9385 existing records from primary storage. [2025-09-22T22:26:42.049839] [INFO ] [MAIN ] STK: Loaded 9385 primary data records. [2025-09-22T22:26:42.367375] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:42.412786] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 39998 primary records. [2025-09-22T22:26:42.427809] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-22T22:26:42.578031] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-09-22T22:26:42.578268] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-22T22:26:42.580437] [INFO ] [MAIN ] Derivative Progress: 1750/2091 symbols completed. STEM took 1.4s. Estimated remaining: 2m 12s. Rate: 154.9 symbols/min [2025-09-22T22:26:42.581365] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:42.601204] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:42.602327] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16288 primary records. [2025-09-22T22:26:42.602566] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-22T22:26:42.639730] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:42.641615] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9385 primary records. [2025-09-22T22:26:42.642978] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-22T22:26:42.643080] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-09-22T22:26:42.652823] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-22T22:26:42.658948] [INFO ] [MAIN ] Derivative Progress: 1751/2091 symbols completed. STEW took 1.0s. Estimated remaining: 2m 12s. Rate: 155.0 symbols/min [2025-09-22T22:26:42.675367] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:42.676997] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-09-22T22:26:42.677170] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-22T22:26:42.679681] [INFO ] [MAIN ] Derivative Progress: 1752/2091 symbols completed. STK took 0.8s. Estimated remaining: 2m 11s. Rate: 155.1 symbols/min [2025-09-22T22:26:42.680328] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:42.708557] [DEBUG] [LOCAL ] STM: Loaded 53588 existing records from primary storage. [2025-09-22T22:26:42.708861] [INFO ] [MAIN ] STM: Loaded 53588 primary data records. [2025-09-22T22:26:42.770394] [DEBUG] [LOCAL ] STN: Loaded 23062 existing records from primary storage. [2025-09-22T22:26:42.776676] [INFO ] [MAIN ] STN: Loaded 23062 primary data records. [2025-09-22T22:26:43.277582] [DEBUG] [LOCAL ] STNG: Loaded 44049 existing records from primary storage. [2025-09-22T22:26:43.278593] [INFO ] [MAIN ] STNG: Loaded 44049 primary data records. [2025-09-22T22:26:43.745728] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:43.747334] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 23062 primary records. [2025-09-22T22:26:43.747442] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-22T22:26:43.746398] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:43.748831] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53588 primary records. [2025-09-22T22:26:43.749202] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-22T22:26:43.783017] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-09-22T22:26:43.783830] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-22T22:26:43.786184] [INFO ] [MAIN ] Derivative Progress: 1753/2091 symbols completed. STN took 1.1s. Estimated remaining: 2m 11s. Rate: 154.9 symbols/min [2025-09-22T22:26:43.787913] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-09-22T22:26:43.788050] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-22T22:26:43.790234] [INFO ] [MAIN ] Derivative Progress: 1754/2091 symbols completed. STM took 1.2s. Estimated remaining: 2m 10s. Rate: 155.0 symbols/min [2025-09-22T22:26:43.805928] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:43.806606] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 44049 primary records. [2025-09-22T22:26:43.806698] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-22T22:26:43.822722] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-09-22T22:26:43.822789] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-22T22:26:43.825370] [INFO ] [MAIN ] Derivative Progress: 1755/2091 symbols completed. STNG took 1.1s. Estimated remaining: 2m 10s. Rate: 155.1 symbols/min [2025-09-22T22:26:43.826086] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:43.826367] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:43.826452] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:43.840905] [DEBUG] [LOCAL ] STRV: Loaded 11643 existing records from primary storage. [2025-09-22T22:26:43.841055] [INFO ] [MAIN ] STRV: Loaded 11643 primary data records. [2025-09-22T22:26:44.032503] [DEBUG] [LOCAL ] STVN: Loaded 26415 existing records from primary storage. [2025-09-22T22:26:44.050735] [INFO ] [MAIN ] STVN: Loaded 26415 primary data records. [2025-09-22T22:26:44.275030] [DEBUG] [LOCAL ] STT: Loaded 51136 existing records from primary storage. [2025-09-22T22:26:44.292465] [INFO ] [MAIN ] STT: Loaded 51136 primary data records. [2025-09-22T22:26:44.874189] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:26:44.875258] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11643 primary records. [2025-09-22T22:26:44.876304] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-22T22:26:44.895571] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-09-22T22:26:44.895836] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-22T22:26:44.899133] [INFO ] [MAIN ] Derivative Progress: 1756/2091 symbols completed. STRV took 1.1s. Estimated remaining: 2m 10s. Rate: 154.9 symbols/min [2025-09-22T22:26:44.899697] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:44.917271] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:44.918202] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26415 primary records. [2025-09-22T22:26:44.918577] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-22T22:26:44.937936] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-09-22T22:26:44.938109] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-22T22:26:44.940198] [INFO ] [MAIN ] Derivative Progress: 1757/2091 symbols completed. STVN took 1.1s. Estimated remaining: 2m 9s. Rate: 155.0 symbols/min [2025-09-22T22:26:44.948252] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:44.953390] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:44.954682] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 51136 primary records. [2025-09-22T22:26:44.954881] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-22T22:26:44.974083] [DEBUG] [LOCAL ] STXD: Loaded 1330 existing records from primary storage. [2025-09-22T22:26:44.974956] [INFO ] [MAIN ] STXD: Loaded 1330 primary data records. [2025-09-22T22:26:45.141223] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-09-22T22:26:45.154722] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-22T22:26:45.154482] [DEBUG] [LOCAL ] STWD: Loaded 51899 existing records from primary storage. [2025-09-22T22:26:45.165911] [INFO ] [MAIN ] Derivative Progress: 1758/2091 symbols completed. STT took 1.3s. Estimated remaining: 2m 9s. Rate: 155.0 symbols/min [2025-09-22T22:26:45.166300] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:45.166421] [INFO ] [MAIN ] STWD: Loaded 51899 primary data records. [2025-09-22T22:26:45.375673] [DEBUG] [LOCAL ] STXE: Loaded 2217 existing records from primary storage. [2025-09-22T22:26:45.398920] [INFO ] [MAIN ] STXE: Loaded 2217 primary data records. [2025-09-22T22:26:45.971216] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-09-22T22:26:45.972149] [INFO ] [MAIN ] STXD: Generated 1790 derivative records from 1330 primary records. [2025-09-22T22:26:45.973061] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-22T22:26:45.992604] [DEBUG] [LOCAL ] STXD: Derivative data saved (1790 records). [2025-09-22T22:26:46.005448] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-22T22:26:46.007604] [INFO ] [MAIN ] Derivative Progress: 1759/2091 symbols completed. STXD took 1.1s. Estimated remaining: 2m 9s. Rate: 154.9 symbols/min [2025-09-22T22:26:46.009598] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:46.009883] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:46.011097] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51899 primary records. [2025-09-22T22:26:46.011698] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-22T22:26:46.033532] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:26:46.038283] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2217 primary records. [2025-09-22T22:26:46.041684] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-22T22:26:46.047060] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-09-22T22:26:46.056828] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-22T22:26:46.046756] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-22T22:26:46.059798] [INFO ] [MAIN ] Derivative Progress: 1760/2091 symbols completed. STWD took 1.2s. Estimated remaining: 2m 8s. Rate: 155.0 symbols/min [2025-09-22T22:26:46.059952] [INFO ] [MAIN ] STXG: Loaded 2612 primary data records. [2025-09-22T22:26:46.066566] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:46.111236] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-09-22T22:26:46.124008] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-22T22:26:46.141217] [INFO ] [MAIN ] Derivative Progress: 1761/2091 symbols completed. STXE took 1.0s. Estimated remaining: 2m 8s. Rate: 155.1 symbols/min [2025-09-22T22:26:46.165310] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:46.184936] [DEBUG] [LOCAL ] STXK: Loaded 1510 existing records from primary storage. [2025-09-22T22:26:46.185821] [INFO ] [MAIN ] STXK: Loaded 1510 primary data records. [2025-09-22T22:26:46.285006] [DEBUG] [LOCAL ] STXT: Loaded 2590 existing records from primary storage. [2025-09-22T22:26:46.306592] [INFO ] [MAIN ] STXT: Loaded 2590 primary data records. [2025-09-22T22:26:47.088289] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:26:47.089299] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2612 primary records. [2025-09-22T22:26:47.089475] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-22T22:26:47.134419] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-09-22T22:26:47.132956] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:26:47.135584] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:26:47.134583] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-22T22:26:47.135322] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1510 primary records. [2025-09-22T22:26:47.137919] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-22T22:26:47.137783] [INFO ] [MAIN ] Derivative Progress: 1762/2091 symbols completed. STXG took 1.1s. Estimated remaining: 2m 7s. Rate: 154.9 symbols/min [2025-09-22T22:26:47.138676] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2590 primary records. [2025-09-22T22:26:47.139765] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:47.139688] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-22T22:26:47.170823] [DEBUG] [LOCAL ] STXV: Loaded 1659 existing records from primary storage. [2025-09-22T22:26:47.166337] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-09-22T22:26:47.171558] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-22T22:26:47.174879] [INFO ] [MAIN ] STXV: Loaded 1659 primary data records. [2025-09-22T22:26:47.174423] [INFO ] [MAIN ] Derivative Progress: 1763/2091 symbols completed. STXK took 1.1s. Estimated remaining: 2m 7s. Rate: 155.0 symbols/min [2025-09-22T22:26:47.181130] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-09-22T22:26:47.188081] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:47.181250] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-22T22:26:47.222175] [INFO ] [MAIN ] Derivative Progress: 1764/2091 symbols completed. STXT took 1.1s. Estimated remaining: 2m 7s. Rate: 155.1 symbols/min [2025-09-22T22:26:47.242136] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:47.576018] [DEBUG] [LOCAL ] STZ: Loaded 52271 existing records from primary storage. [2025-09-22T22:26:47.576452] [INFO ] [MAIN ] STZ: Loaded 52271 primary data records. [2025-09-22T22:26:47.633329] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:26:47.698468] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1659 primary records. [2025-09-22T22:26:47.724293] [DEBUG] [LOCAL ] SU: Loaded 53459 existing records from primary storage. [2025-09-22T22:26:47.724390] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-22T22:26:47.724578] [INFO ] [MAIN ] SU: Loaded 53459 primary data records. [2025-09-22T22:26:48.052227] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-09-22T22:26:48.068599] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-22T22:26:48.081675] [INFO ] [MAIN ] Derivative Progress: 1765/2091 symbols completed. STXV took 0.9s. Estimated remaining: 2m 6s. Rate: 155.0 symbols/min [2025-09-22T22:26:48.133009] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:48.284431] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:48.285355] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52271 primary records. [2025-09-22T22:26:48.285449] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-22T22:26:48.311934] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-09-22T22:26:48.313031] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-22T22:26:48.315719] [INFO ] [MAIN ] Derivative Progress: 1766/2091 symbols completed. STZ took 1.1s. Estimated remaining: 2m 6s. Rate: 155.0 symbols/min [2025-09-22T22:26:48.316911] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:48.330898] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:48.331782] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53459 primary records. [2025-09-22T22:26:48.332008] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-22T22:26:48.352041] [DEBUG] [LOCAL ] SUI: Loaded 42116 existing records from primary storage. [2025-09-22T22:26:48.359917] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-09-22T22:26:48.360022] [INFO ] [MAIN ] SUI: Loaded 42116 primary data records. [2025-09-22T22:26:48.360201] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-22T22:26:48.362485] [INFO ] [MAIN ] Derivative Progress: 1767/2091 symbols completed. SU took 1.1s. Estimated remaining: 2m 5s. Rate: 155.1 symbols/min [2025-09-22T22:26:48.367932] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:48.551341] [DEBUG] [LOCAL ] SUN: Loaded 37290 existing records from primary storage. [2025-09-22T22:26:48.552538] [INFO ] [MAIN ] SUN: Loaded 37290 primary data records. [2025-09-22T22:26:48.899586] [DEBUG] [LOCAL ] SUPV: Loaded 47109 existing records from primary storage. [2025-09-22T22:26:48.928913] [INFO ] [MAIN ] SUPV: Loaded 47109 primary data records. [2025-09-22T22:26:49.419498] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:49.421263] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 42116 primary records. [2025-09-22T22:26:49.421753] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-22T22:26:49.439671] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-09-22T22:26:49.440488] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-22T22:26:49.443129] [INFO ] [MAIN ] Derivative Progress: 1768/2091 symbols completed. SUI took 1.3s. Estimated remaining: 2m 5s. Rate: 154.9 symbols/min [2025-09-22T22:26:49.459519] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:49.460293] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37290 primary records. [2025-09-22T22:26:49.460599] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-22T22:26:49.478917] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-09-22T22:26:49.479012] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-22T22:26:49.481485] [INFO ] [MAIN ] Derivative Progress: 1769/2091 symbols completed. SUN took 1.2s. Estimated remaining: 2m 5s. Rate: 155.0 symbols/min [2025-09-22T22:26:49.494262] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:49.494878] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47109 primary records. [2025-09-22T22:26:49.494940] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-22T22:26:49.510534] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-09-22T22:26:49.510592] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-22T22:26:49.512886] [INFO ] [MAIN ] Derivative Progress: 1770/2091 symbols completed. SUPV took 1.1s. Estimated remaining: 2m 4s. Rate: 155.1 symbols/min [2025-09-22T22:26:49.513358] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:49.513612] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:49.514320] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:49.575175] [DEBUG] [LOCAL ] SVV: Loaded 39434 existing records from primary storage. [2025-09-22T22:26:49.590848] [INFO ] [MAIN ] SVV: Loaded 39434 primary data records. [2025-09-22T22:26:49.603515] [DEBUG] [LOCAL ] SUZ: Loaded 45838 existing records from primary storage. [2025-09-22T22:26:49.628604] [INFO ] [MAIN ] SUZ: Loaded 45838 primary data records. [2025-09-22T22:26:49.842736] [DEBUG] [LOCAL ] SW: Loaded 53164 existing records from primary storage. [2025-09-22T22:26:49.874195] [INFO ] [MAIN ] SW: Loaded 53164 primary data records. [2025-09-22T22:26:50.553978] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:50.557020] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39434 primary records. [2025-09-22T22:26:50.557409] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-22T22:26:50.579290] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:50.587207] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45838 primary records. [2025-09-22T22:26:50.587562] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-22T22:26:50.619213] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-09-22T22:26:50.619573] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-22T22:26:50.621805] [INFO ] [MAIN ] Derivative Progress: 1771/2091 symbols completed. SVV took 1.1s. Estimated remaining: 2m 4s. Rate: 154.9 symbols/min [2025-09-22T22:26:50.622075] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:50.615486] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:50.623013] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-09-22T22:26:50.624158] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53164 primary records. [2025-09-22T22:26:50.624381] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-22T22:26:50.624316] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-22T22:26:50.627179] [INFO ] [MAIN ] Derivative Progress: 1772/2091 symbols completed. SUZ took 1.1s. Estimated remaining: 2m 3s. Rate: 155.0 symbols/min [2025-09-22T22:26:50.635076] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:50.645089] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-09-22T22:26:50.645222] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-22T22:26:50.647389] [INFO ] [MAIN ] Derivative Progress: 1773/2091 symbols completed. SW took 1.1s. Estimated remaining: 2m 3s. Rate: 155.1 symbols/min [2025-09-22T22:26:50.647760] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:50.656775] [DEBUG] [LOCAL ] SWZ: Loaded 6107 existing records from primary storage. [2025-09-22T22:26:50.656981] [INFO ] [MAIN ] SWZ: Loaded 6107 primary data records. [2025-09-22T22:26:50.793475] [DEBUG] [LOCAL ] SWX: Loaded 31356 existing records from primary storage. [2025-09-22T22:26:50.799574] [INFO ] [MAIN ] SWX: Loaded 31356 primary data records. [2025-09-22T22:26:51.127979] [DEBUG] [LOCAL ] SWK: Loaded 52493 existing records from primary storage. [2025-09-22T22:26:51.153352] [INFO ] [MAIN ] SWK: Loaded 52493 primary data records. [2025-09-22T22:26:51.693016] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:51.694168] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6107 primary records. [2025-09-22T22:26:51.694425] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-22T22:26:51.712679] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-09-22T22:26:51.712947] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-22T22:26:51.715102] [INFO ] [MAIN ] Derivative Progress: 1774/2091 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 3s. Rate: 154.9 symbols/min [2025-09-22T22:26:51.715605] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:51.732342] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:51.733254] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31356 primary records. [2025-09-22T22:26:51.733415] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-22T22:26:51.755897] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:51.761039] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52493 primary records. [2025-09-22T22:26:51.761222] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-22T22:26:51.777441] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-09-22T22:26:51.778166] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-22T22:26:51.780159] [INFO ] [MAIN ] Derivative Progress: 1775/2091 symbols completed. SWX took 1.2s. Estimated remaining: 2m 2s. Rate: 155.0 symbols/min [2025-09-22T22:26:51.781143] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:51.793671] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-09-22T22:26:51.793815] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-22T22:26:51.796474] [INFO ] [MAIN ] Derivative Progress: 1776/2091 symbols completed. SWK took 1.2s. Estimated remaining: 2m 2s. Rate: 155.1 symbols/min [2025-09-22T22:26:51.796834] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:51.814050] [DEBUG] [LOCAL ] SXC: Loaded 41630 existing records from primary storage. [2025-09-22T22:26:51.814275] [INFO ] [MAIN ] SXC: Loaded 41630 primary data records. [2025-09-22T22:26:51.899020] [DEBUG] [LOCAL ] SXI: Loaded 11475 existing records from primary storage. [2025-09-22T22:26:51.946371] [INFO ] [MAIN ] SXI: Loaded 11475 primary data records. [2025-09-22T22:26:52.121614] [DEBUG] [LOCAL ] SXT: Loaded 29013 existing records from primary storage. [2025-09-22T22:26:52.266533] [INFO ] [MAIN ] SXT: Loaded 29013 primary data records. [2025-09-22T22:26:52.841211] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:52.843007] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41630 primary records. [2025-09-22T22:26:52.843891] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-22T22:26:52.869670] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:52.874083] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-09-22T22:26:52.874350] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-22T22:26:52.875132] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11475 primary records. [2025-09-22T22:26:52.875246] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-22T22:26:52.877410] [INFO ] [MAIN ] Derivative Progress: 1777/2091 symbols completed. SXC took 1.2s. Estimated remaining: 2m 2s. Rate: 154.9 symbols/min [2025-09-22T22:26:52.890597] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:52.894689] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-09-22T22:26:52.894864] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-22T22:26:52.897941] [INFO ] [MAIN ] Derivative Progress: 1778/2091 symbols completed. SXI took 1.1s. Estimated remaining: 2m 1s. Rate: 155.0 symbols/min [2025-09-22T22:26:52.898191] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:52.914073] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:52.914895] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29013 primary records. [2025-09-22T22:26:52.915019] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-22T22:26:52.931677] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-09-22T22:26:52.937510] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-22T22:26:52.939752] [INFO ] [MAIN ] Derivative Progress: 1779/2091 symbols completed. SXT took 1.1s. Estimated remaining: 2m 1s. Rate: 155.1 symbols/min [2025-09-22T22:26:52.940144] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:52.987304] [DEBUG] [LOCAL ] SYK: Loaded 47072 existing records from primary storage. [2025-09-22T22:26:52.987508] [INFO ] [MAIN ] SYK: Loaded 47072 primary data records. [2025-09-22T22:26:53.123764] [DEBUG] [LOCAL ] SYF: Loaded 53459 existing records from primary storage. [2025-09-22T22:26:53.124107] [INFO ] [MAIN ] SYF: Loaded 53459 primary data records. [2025-09-22T22:26:53.200698] [DEBUG] [LOCAL ] SYY: Loaded 53246 existing records from primary storage. [2025-09-22T22:26:53.225134] [INFO ] [MAIN ] SYY: Loaded 53246 primary data records. [2025-09-22T22:26:54.034795] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:54.034469] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:54.035683] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53459 primary records. [2025-09-22T22:26:54.035813] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-22T22:26:54.037614] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 47072 primary records. [2025-09-22T22:26:54.047027] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-22T22:26:54.080478] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:54.082079] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53246 primary records. [2025-09-22T22:26:54.083531] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-09-22T22:26:54.083964] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-22T22:26:54.083864] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-22T22:26:54.088875] [INFO ] [MAIN ] Derivative Progress: 1780/2091 symbols completed. SYF took 1.2s. Estimated remaining: 2m 0s. Rate: 154.9 symbols/min [2025-09-22T22:26:54.090184] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:54.098746] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-09-22T22:26:54.099936] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-22T22:26:54.102152] [INFO ] [MAIN ] Derivative Progress: 1781/2091 symbols completed. SYK took 1.2s. Estimated remaining: 1m 60s. Rate: 155.0 symbols/min [2025-09-22T22:26:54.105198] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:54.114881] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-09-22T22:26:54.115046] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-22T22:26:54.117335] [INFO ] [MAIN ] Derivative Progress: 1782/2091 symbols completed. SYY took 1.2s. Estimated remaining: 1m 60s. Rate: 155.1 symbols/min [2025-09-22T22:26:54.117773] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:54.170517] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-22T22:26:54.171195] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-09-22T22:26:54.244573] [DEBUG] [LOCAL ] TAC: Loaded 42951 existing records from primary storage. [2025-09-22T22:26:54.281009] [INFO ] [MAIN ] TAC: Loaded 42951 primary data records. [2025-09-22T22:26:54.362343] [DEBUG] [LOCAL ] TAK: Loaded 49926 existing records from primary storage. [2025-09-22T22:26:54.387249] [INFO ] [MAIN ] TAK: Loaded 49926 primary data records. [2025-09-22T22:26:55.215016] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:55.228287] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-09-22T22:26:55.228412] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-22T22:26:55.240303] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:55.241191] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42951 primary records. [2025-09-22T22:26:55.241971] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-22T22:26:55.249855] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-09-22T22:26:55.273445] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-22T22:26:55.275352] [INFO ] [MAIN ] Derivative Progress: 1783/2091 symbols completed. T took 1.2s. Estimated remaining: 1m 59s. Rate: 154.9 symbols/min [2025-09-22T22:26:55.276905] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:55.278124] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49926 primary records. [2025-09-22T22:26:55.278673] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-22T22:26:55.294247] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-09-22T22:26:55.294589] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-22T22:26:55.297975] [INFO ] [MAIN ] Derivative Progress: 1784/2091 symbols completed. TAC took 1.2s. Estimated remaining: 1m 59s. Rate: 155.0 symbols/min [2025-09-22T22:26:55.301272] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-09-22T22:26:55.301361] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-22T22:26:55.303750] [INFO ] [MAIN ] Derivative Progress: 1785/2091 symbols completed. TAK took 1.2s. Estimated remaining: 1m 58s. Rate: 155.1 symbols/min [2025-09-22T22:26:55.304362] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:55.304670] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:55.304609] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:55.382023] [DEBUG] [LOCAL ] TALO: Loaded 50811 existing records from primary storage. [2025-09-22T22:26:55.382391] [INFO ] [MAIN ] TALO: Loaded 50811 primary data records. [2025-09-22T22:26:55.444122] [DEBUG] [LOCAL ] TAP: Loaded 52867 existing records from primary storage. [2025-09-22T22:26:55.485464] [INFO ] [MAIN ] TAP: Loaded 52867 primary data records. [2025-09-22T22:26:55.512066] [DEBUG] [LOCAL ] TAL: Loaded 52123 existing records from primary storage. [2025-09-22T22:26:55.540927] [INFO ] [MAIN ] TAL: Loaded 52123 primary data records. [2025-09-22T22:26:56.371323] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:56.373320] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50811 primary records. [2025-09-22T22:26:56.374416] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-22T22:26:56.389072] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:56.397635] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52867 primary records. [2025-09-22T22:26:56.397923] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-22T22:26:56.427006] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:56.437424] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 52123 primary records. [2025-09-22T22:26:56.442167] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-09-22T22:26:56.440754] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-22T22:26:56.442104] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-09-22T22:26:56.443084] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-22T22:26:56.443553] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-22T22:26:56.445264] [INFO ] [MAIN ] Derivative Progress: 1786/2091 symbols completed. TALO took 1.1s. Estimated remaining: 1m 58s. Rate: 154.9 symbols/min [2025-09-22T22:26:56.447974] [INFO ] [MAIN ] Derivative Progress: 1787/2091 symbols completed. TAP took 1.1s. Estimated remaining: 1m 58s. Rate: 155.0 symbols/min [2025-09-22T22:26:56.448254] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:56.447880] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:56.471978] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-09-22T22:26:56.472285] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-22T22:26:56.475912] [INFO ] [MAIN ] Derivative Progress: 1788/2091 symbols completed. TAL took 1.2s. Estimated remaining: 1m 57s. Rate: 155.1 symbols/min [2025-09-22T22:26:56.476393] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:56.488914] [DEBUG] [LOCAL ] TBB: Loaded 11697 existing records from primary storage. [2025-09-22T22:26:56.489127] [INFO ] [MAIN ] TBB: Loaded 11697 primary data records. [2025-09-22T22:26:56.681639] [DEBUG] [LOCAL ] TBI: Loaded 22640 existing records from primary storage. [2025-09-22T22:26:56.685609] [INFO ] [MAIN ] TBI: Loaded 22640 primary data records. [2025-09-22T22:26:56.687789] [DEBUG] [LOCAL ] TBBB: Loaded 35854 existing records from primary storage. [2025-09-22T22:26:56.708913] [INFO ] [MAIN ] TBBB: Loaded 35854 primary data records. [2025-09-22T22:26:57.804825] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:57.807942] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11697 primary records. [2025-09-22T22:26:57.808312] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-22T22:26:57.833908] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-09-22T22:26:57.834569] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-22T22:26:57.836538] [INFO ] [MAIN ] Derivative Progress: 1789/2091 symbols completed. TBB took 1.4s. Estimated remaining: 1m 57s. Rate: 154.9 symbols/min [2025-09-22T22:26:57.837217] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:57.845528] [DEBUG] [LOCAL ] TBN: Loaded 2975 existing records from primary storage. [2025-09-22T22:26:57.845929] [INFO ] [MAIN ] TBN: Loaded 2975 primary data records. [2025-09-22T22:26:57.926259] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:57.932452] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22640 primary records. [2025-09-22T22:26:57.949993] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-22T22:26:58.025459] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-09-22T22:26:58.077006] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-22T22:26:58.079253] [INFO ] [MAIN ] Derivative Progress: 1790/2091 symbols completed. TBI took 1.6s. Estimated remaining: 1m 57s. Rate: 154.9 symbols/min [2025-09-22T22:26:58.079522] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:58.048857] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:58.084775] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35854 primary records. [2025-09-22T22:26:58.085189] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-22T22:26:58.225080] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-09-22T22:26:58.226523] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-22T22:26:58.229401] [INFO ] [MAIN ] Derivative Progress: 1791/2091 symbols completed. TBBB took 1.8s. Estimated remaining: 1m 56s. Rate: 155.0 symbols/min [2025-09-22T22:26:58.230095] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:58.259116] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:58.274277] [INFO ] [MAIN ] TBN: Generated 1794 derivative records from 2975 primary records. [2025-09-22T22:26:58.274478] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-22T22:26:58.291483] [DEBUG] [LOCAL ] TBN: Derivative data saved (1794 records). [2025-09-22T22:26:58.314119] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-22T22:26:58.318156] [INFO ] [MAIN ] Derivative Progress: 1792/2091 symbols completed. TBN took 0.5s. Estimated remaining: 1m 56s. Rate: 155.0 symbols/min [2025-09-22T22:26:58.318667] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:58.319966] [DEBUG] [LOCAL ] TD: Loaded 52270 existing records from primary storage. [2025-09-22T22:26:58.320453] [INFO ] [MAIN ] TD: Loaded 52270 primary data records. [2025-09-22T22:26:58.423427] [DEBUG] [LOCAL ] TDC: Loaded 46931 existing records from primary storage. [2025-09-22T22:26:58.436825] [INFO ] [MAIN ] TDC: Loaded 46931 primary data records. [2025-09-22T22:26:58.443302] [DEBUG] [LOCAL ] TDF: Loaded 6452 existing records from primary storage. [2025-09-22T22:26:58.458699] [INFO ] [MAIN ] TDF: Loaded 6452 primary data records. [2025-09-22T22:26:59.321772] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:59.322718] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52270 primary records. [2025-09-22T22:26:59.322985] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-22T22:26:59.343011] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-09-22T22:26:59.356075] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-22T22:26:59.358005] [INFO ] [MAIN ] Derivative Progress: 1793/2091 symbols completed. TD took 1.3s. Estimated remaining: 1m 55s. Rate: 154.9 symbols/min [2025-09-22T22:26:59.358532] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:59.359580] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:59.361001] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6452 primary records. [2025-09-22T22:26:59.361967] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-22T22:26:59.386777] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-09-22T22:26:59.391807] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-22T22:26:59.394109] [INFO ] [MAIN ] Derivative Progress: 1794/2091 symbols completed. TDF took 1.1s. Estimated remaining: 1m 55s. Rate: 155.0 symbols/min [2025-09-22T22:26:59.394366] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:59.392103] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:26:59.395550] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46931 primary records. [2025-09-22T22:26:59.395774] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-22T22:26:59.417218] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-09-22T22:26:59.417355] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-22T22:26:59.419829] [INFO ] [MAIN ] Derivative Progress: 1795/2091 symbols completed. TDC took 1.2s. Estimated remaining: 1m 55s. Rate: 155.0 symbols/min [2025-09-22T22:26:59.420086] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:26:59.428998] [DEBUG] [LOCAL ] TDG: Loaded 22170 existing records from primary storage. [2025-09-22T22:26:59.429209] [INFO ] [MAIN ] TDG: Loaded 22170 primary data records. [2025-09-22T22:26:59.769011] [DEBUG] [LOCAL ] TDOC: Loaded 53347 existing records from primary storage. [2025-09-22T22:26:59.769312] [INFO ] [MAIN ] TDOC: Loaded 53347 primary data records. [2025-09-22T22:26:59.881962] [DEBUG] [LOCAL ] TDS: Loaded 42835 existing records from primary storage. [2025-09-22T22:26:59.894324] [INFO ] [MAIN ] TDS: Loaded 42835 primary data records. [2025-09-22T22:27:00.432812] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:00.434575] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22170 primary records. [2025-09-22T22:27:00.434969] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-22T22:27:00.456890] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-09-22T22:27:00.458173] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-22T22:27:00.460491] [INFO ] [MAIN ] Derivative Progress: 1796/2091 symbols completed. TDG took 1.1s. Estimated remaining: 1m 54s. Rate: 154.9 symbols/min [2025-09-22T22:27:00.461502] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:00.476579] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:00.477400] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53347 primary records. [2025-09-22T22:27:00.477506] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-22T22:27:00.505707] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-09-22T22:27:00.511891] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:00.511973] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-22T22:27:00.512820] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42835 primary records. [2025-09-22T22:27:00.514874] [INFO ] [MAIN ] Derivative Progress: 1797/2091 symbols completed. TDOC took 1.1s. Estimated remaining: 1m 54s. Rate: 155.0 symbols/min [2025-09-22T22:27:00.515241] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:00.515022] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-22T22:27:00.544298] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-09-22T22:27:00.544486] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-22T22:27:00.546788] [INFO ] [MAIN ] Derivative Progress: 1798/2091 symbols completed. TDS took 1.1s. Estimated remaining: 1m 53s. Rate: 155.0 symbols/min [2025-09-22T22:27:00.566542] [DEBUG] [LOCAL ] TDW: Loaded 45528 existing records from primary storage. [2025-09-22T22:27:00.566769] [INFO ] [MAIN ] TDW: Loaded 45528 primary data records. [2025-09-22T22:27:00.674783] [DEBUG] [LOCAL ] TDY: Loaded 22743 existing records from primary storage. [2025-09-22T22:27:00.687258] [INFO ] [MAIN ] TDY: Loaded 22743 primary data records. [2025-09-22T22:27:01.289811] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:01.290576] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45528 primary records. [2025-09-22T22:27:01.290697] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-22T22:27:01.323294] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-09-22T22:27:01.323547] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-22T22:27:01.325533] [INFO ] [MAIN ] Derivative Progress: 1799/2091 symbols completed. TDW took 0.9s. Estimated remaining: 1m 53s. Rate: 155.0 symbols/min [2025-09-22T22:27:01.325881] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:01.326853] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22743 primary records. [2025-09-22T22:27:01.326922] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-22T22:27:01.342150] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-09-22T22:27:01.342251] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-22T22:27:01.344438] [INFO ] [MAIN ] Derivative Progress: 1800/2091 symbols completed. TDY took 0.8s. Estimated remaining: 1m 53s. Rate: 155.0 symbols/min [2025-09-22T22:27:01.345134] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:01.345083] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:01.345266] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:01.357992] [DEBUG] [LOCAL ] TEAF: Loaded 7291 existing records from primary storage. [2025-09-22T22:27:01.358237] [INFO ] [MAIN ] TEAF: Loaded 7291 primary data records. [2025-09-22T22:27:01.602696] [DEBUG] [LOCAL ] TEF: Loaded 37410 existing records from primary storage. [2025-09-22T22:27:01.719696] [INFO ] [MAIN ] TEF: Loaded 37410 primary data records. [2025-09-22T22:27:01.720571] [DEBUG] [LOCAL ] TECK: Loaded 53437 existing records from primary storage. [2025-09-22T22:27:01.720939] [INFO ] [MAIN ] TECK: Loaded 53437 primary data records. [2025-09-22T22:27:02.383271] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:02.384305] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7291 primary records. [2025-09-22T22:27:02.384407] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-22T22:27:02.405607] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-09-22T22:27:02.405922] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-22T22:27:02.408200] [INFO ] [MAIN ] Derivative Progress: 1801/2091 symbols completed. TEAF took 1.1s. Estimated remaining: 1m 52s. Rate: 154.9 symbols/min [2025-09-22T22:27:02.409007] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:02.449991] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:02.449786] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:02.450887] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53437 primary records. [2025-09-22T22:27:02.451041] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-22T22:27:02.452450] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37410 primary records. [2025-09-22T22:27:02.452597] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-22T22:27:02.468408] [DEBUG] [LOCAL ] TEI: Loaded 20379 existing records from primary storage. [2025-09-22T22:27:02.488784] [INFO ] [MAIN ] TEI: Loaded 20379 primary data records. [2025-09-22T22:27:02.488393] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-09-22T22:27:02.501637] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-22T22:27:02.530536] [INFO ] [MAIN ] Derivative Progress: 1802/2091 symbols completed. TEF took 1.2s. Estimated remaining: 1m 52s. Rate: 154.9 symbols/min [2025-09-22T22:27:02.549038] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:02.601412] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-09-22T22:27:02.612628] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-22T22:27:02.630387] [INFO ] [MAIN ] Derivative Progress: 1803/2091 symbols completed. TECK took 1.3s. Estimated remaining: 1m 51s. Rate: 155.0 symbols/min [2025-09-22T22:27:02.630851] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:02.853325] [DEBUG] [LOCAL ] TEN: Loaded 31061 existing records from primary storage. [2025-09-22T22:27:02.871411] [INFO ] [MAIN ] TEN: Loaded 31061 primary data records. [2025-09-22T22:27:02.898064] [DEBUG] [LOCAL ] TEL: Loaded 51150 existing records from primary storage. [2025-09-22T22:27:02.914896] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:02.943677] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 20379 primary records. [2025-09-22T22:27:02.972398] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-22T22:27:02.972296] [INFO ] [MAIN ] TEL: Loaded 51150 primary data records. [2025-09-22T22:27:03.107160] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-09-22T22:27:03.121443] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-22T22:27:03.198445] [INFO ] [MAIN ] Derivative Progress: 1804/2091 symbols completed. TEI took 0.8s. Estimated remaining: 1m 51s. Rate: 155.0 symbols/min [2025-09-22T22:27:03.342289] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:03.608888] [DEBUG] [LOCAL ] TEO: Loaded 21805 existing records from primary storage. [2025-09-22T22:27:03.610343] [INFO ] [MAIN ] TEO: Loaded 21805 primary data records. [2025-09-22T22:27:03.949205] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:03.950019] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 31061 primary records. [2025-09-22T22:27:03.950116] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-22T22:27:03.970903] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-09-22T22:27:03.971571] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-22T22:27:03.973636] [INFO ] [MAIN ] Derivative Progress: 1805/2091 symbols completed. TEN took 1.3s. Estimated remaining: 1m 51s. Rate: 154.9 symbols/min [2025-09-22T22:27:03.974145] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:03.987606] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:03.988329] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51150 primary records. [2025-09-22T22:27:03.988549] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-22T22:27:04.007990] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-09-22T22:27:04.008127] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-22T22:27:04.010243] [INFO ] [MAIN ] Derivative Progress: 1806/2091 symbols completed. TEL took 1.5s. Estimated remaining: 1m 50s. Rate: 155.0 symbols/min [2025-09-22T22:27:04.010672] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:04.027931] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:04.028823] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 21805 primary records. [2025-09-22T22:27:04.028894] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-22T22:27:04.059080] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-09-22T22:27:04.059328] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-22T22:27:04.061757] [INFO ] [MAIN ] Derivative Progress: 1807/2091 symbols completed. TEO took 0.7s. Estimated remaining: 1m 50s. Rate: 155.0 symbols/min [2025-09-22T22:27:04.062061] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:04.093854] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-09-22T22:27:04.094666] [INFO ] [MAIN ] TEVA: Loaded 53633 primary data records. [2025-09-22T22:27:04.161073] [DEBUG] [LOCAL ] TEX: Loaded 44750 existing records from primary storage. [2025-09-22T22:27:04.184746] [INFO ] [MAIN ] TEX: Loaded 44750 primary data records. [2025-09-22T22:27:04.573057] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-22T22:27:04.603257] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-09-22T22:27:05.109117] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:05.122562] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53633 primary records. [2025-09-22T22:27:05.123993] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-22T22:27:05.125844] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:05.126544] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 44750 primary records. [2025-09-22T22:27:05.138445] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-22T22:27:05.143778] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-09-22T22:27:05.144319] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-22T22:27:05.157744] [INFO ] [MAIN ] Derivative Progress: 1808/2091 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 50s. Rate: 154.9 symbols/min [2025-09-22T22:27:05.158667] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:05.165965] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-09-22T22:27:05.167052] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-22T22:27:05.169198] [INFO ] [MAIN ] Derivative Progress: 1809/2091 symbols completed. TEX took 1.2s. Estimated remaining: 1m 49s. Rate: 155.0 symbols/min [2025-09-22T22:27:05.170469] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:05.186881] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:05.187614] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-09-22T22:27:05.187818] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-22T22:27:05.217212] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-09-22T22:27:05.217405] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-22T22:27:05.219859] [INFO ] [MAIN ] Derivative Progress: 1810/2091 symbols completed. TFC took 1.2s. Estimated remaining: 1m 49s. Rate: 155.0 symbols/min [2025-09-22T22:27:05.220289] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:05.240854] [DEBUG] [LOCAL ] TFII: Loaded 34464 existing records from primary storage. [2025-09-22T22:27:05.241185] [INFO ] [MAIN ] TFII: Loaded 34464 primary data records. [2025-09-22T22:27:05.263997] [DEBUG] [LOCAL ] TFIN: Loaded 23616 existing records from primary storage. [2025-09-22T22:27:05.280986] [INFO ] [MAIN ] TFIN: Loaded 23616 primary data records. [2025-09-22T22:27:05.808154] [DEBUG] [LOCAL ] TFPM: Loaded 37199 existing records from primary storage. [2025-09-22T22:27:05.815697] [INFO ] [MAIN ] TFPM: Loaded 37199 primary data records. [2025-09-22T22:27:06.292696] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:27:06.294315] [INFO ] [MAIN ] TFII: Generated 1793 derivative records from 34464 primary records. [2025-09-22T22:27:06.294430] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-22T22:27:06.318297] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:06.323443] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23616 primary records. [2025-09-22T22:27:06.325045] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-22T22:27:06.329193] [DEBUG] [LOCAL ] TFII: Derivative data saved (1793 records). [2025-09-22T22:27:06.329347] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-22T22:27:06.331692] [INFO ] [MAIN ] Derivative Progress: 1811/2091 symbols completed. TFII took 1.2s. Estimated remaining: 1m 48s. Rate: 154.9 symbols/min [2025-09-22T22:27:06.347883] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:06.349184] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-09-22T22:27:06.349728] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-22T22:27:06.352548] [INFO ] [MAIN ] Derivative Progress: 1812/2091 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 48s. Rate: 155.0 symbols/min [2025-09-22T22:27:06.353336] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:06.372799] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:06.373771] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 37199 primary records. [2025-09-22T22:27:06.373880] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-22T22:27:06.388680] [DEBUG] [LOCAL ] TG: Loaded 10477 existing records from primary storage. [2025-09-22T22:27:06.395868] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-09-22T22:27:06.396006] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-22T22:27:06.400542] [INFO ] [MAIN ] Derivative Progress: 1813/2091 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 48s. Rate: 155.0 symbols/min [2025-09-22T22:27:06.400786] [INFO ] [MAIN ] TG: Loaded 10477 primary data records. [2025-09-22T22:27:06.600840] [DEBUG] [LOCAL ] TFX: Loaded 37490 existing records from primary storage. [2025-09-22T22:27:06.602351] [INFO ] [MAIN ] TFX: Loaded 37490 primary data records. [2025-09-22T22:27:07.088444] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:07.089378] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10477 primary records. [2025-09-22T22:27:07.089742] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-22T22:27:07.106149] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-09-22T22:27:07.106352] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-22T22:27:07.108493] [INFO ] [MAIN ] Derivative Progress: 1814/2091 symbols completed. TG took 0.8s. Estimated remaining: 1m 47s. Rate: 155.0 symbols/min [2025-09-22T22:27:07.124601] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:07.125339] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 37490 primary records. [2025-09-22T22:27:07.125401] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-22T22:27:07.141038] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-09-22T22:27:07.141162] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-22T22:27:07.143286] [INFO ] [MAIN ] Derivative Progress: 1815/2091 symbols completed. TFX took 0.8s. Estimated remaining: 1m 47s. Rate: 155.0 symbols/min [2025-09-22T22:27:07.144083] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:07.144273] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:07.144182] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:07.192096] [DEBUG] [LOCAL ] TGLS: Loaded 28439 existing records from primary storage. [2025-09-22T22:27:07.192901] [DEBUG] [LOCAL ] TGS: Loaded 32397 existing records from primary storage. [2025-09-22T22:27:07.203699] [INFO ] [MAIN ] TGLS: Loaded 28439 primary data records. [2025-09-22T22:27:07.204037] [INFO ] [MAIN ] TGS: Loaded 32397 primary data records. [2025-09-22T22:27:07.436589] [DEBUG] [LOCAL ] TGNA: Loaded 48693 existing records from primary storage. [2025-09-22T22:27:07.452326] [INFO ] [MAIN ] TGNA: Loaded 48693 primary data records. [2025-09-22T22:27:08.266149] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:08.272207] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32397 primary records. [2025-09-22T22:27:08.273076] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-22T22:27:08.272967] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:08.275264] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 28439 primary records. [2025-09-22T22:27:08.275363] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-22T22:27:08.321094] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-09-22T22:27:08.305437] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-09-22T22:27:08.326888] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-22T22:27:08.327385] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:08.326589] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-22T22:27:08.329608] [INFO ] [MAIN ] Derivative Progress: 1816/2091 symbols completed. TGS took 1.2s. Estimated remaining: 1m 47s. Rate: 154.9 symbols/min [2025-09-22T22:27:08.330842] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48693 primary records. [2025-09-22T22:27:08.333843] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:08.333418] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-22T22:27:08.334032] [INFO ] [MAIN ] Derivative Progress: 1817/2091 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 46s. Rate: 154.9 symbols/min [2025-09-22T22:27:08.334273] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:08.352098] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-09-22T22:27:08.352215] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-22T22:27:08.354820] [INFO ] [MAIN ] Derivative Progress: 1818/2091 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 46s. Rate: 155.0 symbols/min [2025-09-22T22:27:08.355222] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:08.379545] [DEBUG] [LOCAL ] THG: Loaded 21919 existing records from primary storage. [2025-09-22T22:27:08.390764] [INFO ] [MAIN ] THG: Loaded 21919 primary data records. [2025-09-22T22:27:08.545169] [DEBUG] [LOCAL ] THC: Loaded 48174 existing records from primary storage. [2025-09-22T22:27:08.597261] [INFO ] [MAIN ] THC: Loaded 48174 primary data records. [2025-09-22T22:27:08.626899] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-22T22:27:08.643001] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-09-22T22:27:09.439542] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:09.440821] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21919 primary records. [2025-09-22T22:27:09.441108] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-22T22:27:09.475424] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-09-22T22:27:09.475699] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-22T22:27:09.485182] [INFO ] [MAIN ] Derivative Progress: 1819/2091 symbols completed. THG took 1.1s. Estimated remaining: 1m 45s. Rate: 154.9 symbols/min [2025-09-22T22:27:09.490583] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:09.491243] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:09.490332] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:09.492464] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-09-22T22:27:09.492559] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-22T22:27:09.494175] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 48174 primary records. [2025-09-22T22:27:09.494265] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-22T22:27:09.523459] [DEBUG] [LOCAL ] THIR: Loaded 2157 existing records from primary storage. [2025-09-22T22:27:09.527061] [INFO ] [MAIN ] THIR: Loaded 2157 primary data records. [2025-09-22T22:27:09.533911] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-09-22T22:27:09.551394] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-22T22:27:09.553914] [INFO ] [MAIN ] Derivative Progress: 1820/2091 symbols completed. THC took 1.2s. Estimated remaining: 1m 45s. Rate: 154.9 symbols/min [2025-09-22T22:27:09.564024] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:09.579957] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-09-22T22:27:09.602703] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-22T22:27:09.623433] [INFO ] [MAIN ] Derivative Progress: 1821/2091 symbols completed. TGT took 1.3s. Estimated remaining: 1m 45s. Rate: 155.0 symbols/min [2025-09-22T22:27:09.648753] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:09.651747] [DEBUG] [LOCAL ] THLV: Loaded 1635 existing records from primary storage. [2025-09-22T22:27:09.669060] [INFO ] [MAIN ] THLV: Loaded 1635 primary data records. [2025-09-22T22:27:10.188055] [DEBUG] [LOCAL ] THO: Loaded 42359 existing records from primary storage. [2025-09-22T22:27:10.190726] [INFO ] [MAIN ] THO: Loaded 42359 primary data records. [2025-09-22T22:27:10.514619] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:27:10.525805] [INFO ] [MAIN ] THIR: Generated 1793 derivative records from 2157 primary records. [2025-09-22T22:27:10.526425] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-22T22:27:10.555118] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-22T22:27:10.556977] [INFO ] [MAIN ] THLV: Generated 1792 derivative records from 1635 primary records. [2025-09-22T22:27:10.557581] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-22T22:27:10.567614] [DEBUG] [LOCAL ] THIR: Derivative data saved (1793 records). [2025-09-22T22:27:10.569203] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-22T22:27:10.571398] [INFO ] [MAIN ] Derivative Progress: 1822/2091 symbols completed. THIR took 1.1s. Estimated remaining: 1m 44s. Rate: 154.9 symbols/min [2025-09-22T22:27:10.574912] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:10.579593] [DEBUG] [LOCAL ] THLV: Derivative data saved (1792 records). [2025-09-22T22:27:10.580000] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-22T22:27:10.582680] [INFO ] [MAIN ] Derivative Progress: 1823/2091 symbols completed. THLV took 1.0s. Estimated remaining: 1m 44s. Rate: 155.0 symbols/min [2025-09-22T22:27:10.583177] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:10.601570] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:10.607754] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 42359 primary records. [2025-09-22T22:27:10.607981] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-22T22:27:10.632834] [DEBUG] [LOCAL ] THR: Loaded 19987 existing records from primary storage. [2025-09-22T22:27:10.641693] [INFO ] [MAIN ] THR: Loaded 19987 primary data records. [2025-09-22T22:27:10.641395] [DEBUG] [LOCAL ] THQ: Loaded 24432 existing records from primary storage. [2025-09-22T22:27:10.642489] [INFO ] [MAIN ] THQ: Loaded 24432 primary data records. [2025-09-22T22:27:10.816155] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-09-22T22:27:10.849483] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-22T22:27:10.865704] [INFO ] [MAIN ] Derivative Progress: 1824/2091 symbols completed. THO took 1.2s. Estimated remaining: 1m 43s. Rate: 155.0 symbols/min [2025-09-22T22:27:10.869366] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:11.302820] [DEBUG] [LOCAL ] THS: Loaded 37927 existing records from primary storage. [2025-09-22T22:27:11.303422] [INFO ] [MAIN ] THS: Loaded 37927 primary data records. [2025-09-22T22:27:11.680152] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:11.681751] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19987 primary records. [2025-09-22T22:27:11.682065] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:11.683672] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 24432 primary records. [2025-09-22T22:27:11.682898] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-22T22:27:11.683958] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-22T22:27:11.713174] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-09-22T22:27:11.716376] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-09-22T22:27:11.716549] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-22T22:27:11.716616] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-22T22:27:11.718885] [INFO ] [MAIN ] Derivative Progress: 1825/2091 symbols completed. THQ took 1.1s. Estimated remaining: 1m 43s. Rate: 154.9 symbols/min [2025-09-22T22:27:11.722194] [INFO ] [MAIN ] Derivative Progress: 1826/2091 symbols completed. THR took 1.1s. Estimated remaining: 1m 43s. Rate: 155.0 symbols/min [2025-09-22T22:27:11.722324] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:11.722909] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:11.747308] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:11.748043] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 37927 primary records. [2025-09-22T22:27:11.748204] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-22T22:27:11.767064] [DEBUG] [LOCAL ] THW: Loaded 19118 existing records from primary storage. [2025-09-22T22:27:11.767513] [INFO ] [MAIN ] THW: Loaded 19118 primary data records. [2025-09-22T22:27:11.867790] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-09-22T22:27:11.895795] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-22T22:27:11.909453] [INFO ] [MAIN ] Derivative Progress: 1827/2091 symbols completed. THS took 1.0s. Estimated remaining: 1m 42s. Rate: 155.0 symbols/min [2025-09-22T22:27:11.920053] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:11.947784] [DEBUG] [LOCAL ] TIMB: Loaded 36889 existing records from primary storage. [2025-09-22T22:27:11.948332] [INFO ] [MAIN ] TIMB: Loaded 36889 primary data records. [2025-09-22T22:27:12.172695] [DEBUG] [LOCAL ] TISI: Loaded 3851 existing records from primary storage. [2025-09-22T22:27:12.189997] [INFO ] [MAIN ] TISI: Loaded 3851 primary data records. [2025-09-22T22:27:12.723826] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:12.724736] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19118 primary records. [2025-09-22T22:27:12.724962] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-22T22:27:12.743671] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-09-22T22:27:12.744869] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-22T22:27:12.747766] [INFO ] [MAIN ] Derivative Progress: 1828/2091 symbols completed. THW took 1.0s. Estimated remaining: 1m 42s. Rate: 154.9 symbols/min [2025-09-22T22:27:12.761374] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:12.762046] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 36889 primary records. [2025-09-22T22:27:12.762188] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-22T22:27:12.788833] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:12.789931] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3851 primary records. [2025-09-22T22:27:12.790614] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-22T22:27:12.793545] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-09-22T22:27:12.793836] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-22T22:27:12.796186] [INFO ] [MAIN ] Derivative Progress: 1829/2091 symbols completed. TIMB took 1.1s. Estimated remaining: 1m 41s. Rate: 155.0 symbols/min [2025-09-22T22:27:12.809024] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-09-22T22:27:12.809084] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-22T22:27:12.811383] [INFO ] [MAIN ] Derivative Progress: 1830/2091 symbols completed. TISI took 0.9s. Estimated remaining: 1m 41s. Rate: 155.1 symbols/min [2025-09-22T22:27:12.812009] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:12.812527] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:12.811935] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:12.857519] [DEBUG] [LOCAL ] TIXT: Loaded 31270 existing records from primary storage. [2025-09-22T22:27:12.872910] [INFO ] [MAIN ] TIXT: Loaded 31270 primary data records. [2025-09-22T22:27:12.988151] [DEBUG] [LOCAL ] TK: Loaded 39812 existing records from primary storage. [2025-09-22T22:27:13.006908] [INFO ] [MAIN ] TK: Loaded 39812 primary data records. [2025-09-22T22:27:13.014323] [DEBUG] [LOCAL ] TJX: Loaded 53672 existing records from primary storage. [2025-09-22T22:27:13.025066] [INFO ] [MAIN ] TJX: Loaded 53672 primary data records. [2025-09-22T22:27:13.915516] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:13.917787] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31270 primary records. [2025-09-22T22:27:13.918101] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-22T22:27:13.948512] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-09-22T22:27:13.947103] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:13.948618] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-22T22:27:13.951328] [INFO ] [MAIN ] Derivative Progress: 1831/2091 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 41s. Rate: 154.9 symbols/min [2025-09-22T22:27:13.952142] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53672 primary records. [2025-09-22T22:27:13.953042] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-22T22:27:13.953567] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:13.983214] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-09-22T22:27:13.981894] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:13.984068] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39812 primary records. [2025-09-22T22:27:13.984166] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-22T22:27:13.984268] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-22T22:27:13.986540] [INFO ] [MAIN ] Derivative Progress: 1832/2091 symbols completed. TJX took 1.2s. Estimated remaining: 1m 40s. Rate: 155.0 symbols/min [2025-09-22T22:27:13.987396] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:14.003805] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-09-22T22:27:14.004365] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-22T22:27:14.006999] [INFO ] [MAIN ] Derivative Progress: 1833/2091 symbols completed. TK took 1.2s. Estimated remaining: 1m 40s. Rate: 155.1 symbols/min [2025-09-22T22:27:14.007284] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:14.034265] [DEBUG] [LOCAL ] TKC: Loaded 38172 existing records from primary storage. [2025-09-22T22:27:14.034482] [INFO ] [MAIN ] TKC: Loaded 38172 primary data records. [2025-09-22T22:27:14.378138] [DEBUG] [LOCAL ] TKR: Loaded 40056 existing records from primary storage. [2025-09-22T22:27:14.378883] [DEBUG] [LOCAL ] TKO: Loaded 44254 existing records from primary storage. [2025-09-22T22:27:14.378986] [INFO ] [MAIN ] TKO: Loaded 44254 primary data records. [2025-09-22T22:27:14.379064] [INFO ] [MAIN ] TKR: Loaded 40056 primary data records. [2025-09-22T22:27:15.000368] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:15.001254] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 38172 primary records. [2025-09-22T22:27:15.001496] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-22T22:27:15.019116] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-09-22T22:27:15.019589] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-22T22:27:15.022794] [INFO ] [MAIN ] Derivative Progress: 1834/2091 symbols completed. TKC took 1.1s. Estimated remaining: 1m 40s. Rate: 154.9 symbols/min [2025-09-22T22:27:15.023125] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:15.056967] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:15.058631] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 40056 primary records. [2025-09-22T22:27:15.057896] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:15.058884] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-22T22:27:15.059715] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 44254 primary records. [2025-09-22T22:27:15.060795] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-22T22:27:15.076602] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-09-22T22:27:15.076982] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-22T22:27:15.079392] [INFO ] [MAIN ] Derivative Progress: 1835/2091 symbols completed. TKR took 1.1s. Estimated remaining: 1m 39s. Rate: 155.0 symbols/min [2025-09-22T22:27:15.088708] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:15.105506] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-09-22T22:27:15.105720] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-22T22:27:15.107985] [INFO ] [MAIN ] Derivative Progress: 1836/2091 symbols completed. TKO took 1.1s. Estimated remaining: 1m 39s. Rate: 155.1 symbols/min [2025-09-22T22:27:15.108349] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:15.129129] [DEBUG] [LOCAL ] TLK: Loaded 39680 existing records from primary storage. [2025-09-22T22:27:15.129432] [INFO ] [MAIN ] TLK: Loaded 39680 primary data records. [2025-09-22T22:27:15.191694] [DEBUG] [LOCAL ] TLYS: Loaded 16940 existing records from primary storage. [2025-09-22T22:27:15.217905] [INFO ] [MAIN ] TLYS: Loaded 16940 primary data records. [2025-09-22T22:27:15.652766] [DEBUG] [LOCAL ] TM: Loaded 36688 existing records from primary storage. [2025-09-22T22:27:15.685412] [INFO ] [MAIN ] TM: Loaded 36688 primary data records. [2025-09-22T22:27:16.148661] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:16.149486] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 39680 primary records. [2025-09-22T22:27:16.150092] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-22T22:27:16.170588] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-09-22T22:27:16.170909] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-22T22:27:16.173003] [INFO ] [MAIN ] Derivative Progress: 1837/2091 symbols completed. TLK took 1.1s. Estimated remaining: 1m 38s. Rate: 154.9 symbols/min [2025-09-22T22:27:16.185413] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:16.186836] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:16.187796] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16940 primary records. [2025-09-22T22:27:16.188108] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-22T22:27:16.204385] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-09-22T22:27:16.204980] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-22T22:27:16.207430] [INFO ] [MAIN ] Derivative Progress: 1838/2091 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 38s. Rate: 155.0 symbols/min [2025-09-22T22:27:16.207787] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:16.223263] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:16.224050] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36688 primary records. [2025-09-22T22:27:16.224164] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-22T22:27:16.241039] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-09-22T22:27:16.241178] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-22T22:27:16.243718] [INFO ] [MAIN ] Derivative Progress: 1839/2091 symbols completed. TM took 1.1s. Estimated remaining: 1m 37s. Rate: 155.1 symbols/min [2025-09-22T22:27:16.244850] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:16.303369] [DEBUG] [LOCAL ] TME: Loaded 53200 existing records from primary storage. [2025-09-22T22:27:16.305000] [INFO ] [MAIN ] TME: Loaded 53200 primary data records. [2025-09-22T22:27:16.305690] [DEBUG] [LOCAL ] TMHC: Loaded 45672 existing records from primary storage. [2025-09-22T22:27:16.327322] [INFO ] [MAIN ] TMHC: Loaded 45672 primary data records. [2025-09-22T22:27:16.826242] [DEBUG] [LOCAL ] TMO: Loaded 52335 existing records from primary storage. [2025-09-22T22:27:16.827453] [INFO ] [MAIN ] TMO: Loaded 52335 primary data records. [2025-09-22T22:27:17.278937] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:17.280048] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45672 primary records. [2025-09-22T22:27:17.280235] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-22T22:27:17.301835] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:17.306788] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53200 primary records. [2025-09-22T22:27:17.310146] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-22T22:27:17.311184] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-09-22T22:27:17.311850] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-22T22:27:17.314169] [INFO ] [MAIN ] Derivative Progress: 1840/2091 symbols completed. TMHC took 1.1s. Estimated remaining: 1m 37s. Rate: 154.9 symbols/min [2025-09-22T22:27:17.314953] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:17.347267] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:17.353265] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52335 primary records. [2025-09-22T22:27:17.353368] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-22T22:27:17.354094] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-09-22T22:27:17.354666] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-22T22:27:17.356815] [INFO ] [MAIN ] Derivative Progress: 1841/2091 symbols completed. TME took 1.2s. Estimated remaining: 1m 37s. Rate: 155.0 symbols/min [2025-09-22T22:27:17.357624] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:17.378359] [DEBUG] [LOCAL ] TNC: Loaded 15270 existing records from primary storage. [2025-09-22T22:27:17.378782] [INFO ] [MAIN ] TNC: Loaded 15270 primary data records. [2025-09-22T22:27:17.378711] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-09-22T22:27:17.399673] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-22T22:27:17.413311] [INFO ] [MAIN ] Derivative Progress: 1842/2091 symbols completed. TMO took 1.2s. Estimated remaining: 1m 36s. Rate: 155.1 symbols/min [2025-09-22T22:27:17.424399] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:17.737036] [DEBUG] [LOCAL ] TNET: Loaded 28907 existing records from primary storage. [2025-09-22T22:27:17.737357] [INFO ] [MAIN ] TNET: Loaded 28907 primary data records. [2025-09-22T22:27:17.738037] [DEBUG] [LOCAL ] TNK: Loaded 35274 existing records from primary storage. [2025-09-22T22:27:17.770105] [INFO ] [MAIN ] TNK: Loaded 35274 primary data records. [2025-09-22T22:27:18.373878] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:18.377287] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 15270 primary records. [2025-09-22T22:27:18.378236] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-22T22:27:18.396439] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-09-22T22:27:18.396525] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-22T22:27:18.398827] [INFO ] [MAIN ] Derivative Progress: 1843/2091 symbols completed. TNC took 1.1s. Estimated remaining: 1m 36s. Rate: 154.9 symbols/min [2025-09-22T22:27:18.438002] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:18.438331] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:18.439209] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28907 primary records. [2025-09-22T22:27:18.439301] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-22T22:27:18.440110] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35274 primary records. [2025-09-22T22:27:18.440614] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-22T22:27:18.471351] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-09-22T22:27:18.472430] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-09-22T22:27:18.472532] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-22T22:27:18.472638] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-22T22:27:18.475162] [INFO ] [MAIN ] Derivative Progress: 1844/2091 symbols completed. TNK took 1.1s. Estimated remaining: 1m 36s. Rate: 155.0 symbols/min [2025-09-22T22:27:18.477681] [INFO ] [MAIN ] Derivative Progress: 1845/2091 symbols completed. TNET took 1.1s. Estimated remaining: 1m 35s. Rate: 155.1 symbols/min [2025-09-22T22:27:18.478470] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:18.478715] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:18.478831] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:18.531392] [DEBUG] [LOCAL ] TNL: Loaded 41900 existing records from primary storage. [2025-09-22T22:27:18.544265] [INFO ] [MAIN ] TNL: Loaded 41900 primary data records. [2025-09-22T22:27:18.641706] [DEBUG] [LOCAL ] TOL: Loaded 51121 existing records from primary storage. [2025-09-22T22:27:18.674527] [INFO ] [MAIN ] TOL: Loaded 51121 primary data records. [2025-09-22T22:27:18.736988] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-22T22:27:18.807623] [INFO ] [MAIN ] TOST: Loaded 53681 primary data records. [2025-09-22T22:27:19.543735] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:19.545115] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41900 primary records. [2025-09-22T22:27:19.545408] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-22T22:27:19.563891] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-09-22T22:27:19.564673] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-22T22:27:19.566813] [INFO ] [MAIN ] Derivative Progress: 1846/2091 symbols completed. TNL took 1.1s. Estimated remaining: 1m 35s. Rate: 154.9 symbols/min [2025-09-22T22:27:19.567705] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:19.581516] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:19.584896] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 51121 primary records. [2025-09-22T22:27:19.585226] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-22T22:27:19.607919] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:19.612395] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53681 primary records. [2025-09-22T22:27:19.615807] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-09-22T22:27:19.615939] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-22T22:27:19.618456] [INFO ] [MAIN ] Derivative Progress: 1847/2091 symbols completed. TOL took 1.1s. Estimated remaining: 1m 34s. Rate: 155.0 symbols/min [2025-09-22T22:27:19.625135] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:19.624854] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-22T22:27:19.648434] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-09-22T22:27:19.648639] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-22T22:27:19.652186] [INFO ] [MAIN ] Derivative Progress: 1848/2091 symbols completed. TOST took 1.2s. Estimated remaining: 1m 34s. Rate: 155.1 symbols/min [2025-09-22T22:27:19.652549] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:19.653699] [DEBUG] [LOCAL ] TPB: Loaded 24943 existing records from primary storage. [2025-09-22T22:27:19.653901] [INFO ] [MAIN ] TPB: Loaded 24943 primary data records. [2025-09-22T22:27:19.866601] [DEBUG] [LOCAL ] TPC: Loaded 38846 existing records from primary storage. [2025-09-22T22:27:19.984945] [INFO ] [MAIN ] TPC: Loaded 38846 primary data records. [2025-09-22T22:27:20.109547] [DEBUG] [LOCAL ] TPH: Loaded 45252 existing records from primary storage. [2025-09-22T22:27:20.125896] [INFO ] [MAIN ] TPH: Loaded 45252 primary data records. [2025-09-22T22:27:20.638222] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:20.639138] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 24943 primary records. [2025-09-22T22:27:20.639637] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-22T22:27:20.657934] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-09-22T22:27:20.658346] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-22T22:27:20.660920] [INFO ] [MAIN ] Derivative Progress: 1849/2091 symbols completed. TPB took 1.1s. Estimated remaining: 1m 34s. Rate: 155.0 symbols/min [2025-09-22T22:27:20.661771] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:20.678238] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:20.679083] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38846 primary records. [2025-09-22T22:27:20.679296] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-22T22:27:20.700447] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-09-22T22:27:20.700817] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-22T22:27:20.702902] [INFO ] [MAIN ] Derivative Progress: 1850/2091 symbols completed. TPC took 1.1s. Estimated remaining: 1m 33s. Rate: 155.0 symbols/min [2025-09-22T22:27:20.703203] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:20.721602] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:20.722701] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 45252 primary records. [2025-09-22T22:27:20.722906] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-22T22:27:20.721976] [DEBUG] [LOCAL ] TPL: Loaded 12372 existing records from primary storage. [2025-09-22T22:27:20.723436] [INFO ] [MAIN ] TPL: Loaded 12372 primary data records. [2025-09-22T22:27:20.843769] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-09-22T22:27:20.844306] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-22T22:27:20.852715] [INFO ] [MAIN ] Derivative Progress: 1851/2091 symbols completed. TPH took 1.2s. Estimated remaining: 1m 33s. Rate: 155.1 symbols/min [2025-09-22T22:27:20.868335] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:21.084761] [DEBUG] [LOCAL ] TPR: Loaded 53483 existing records from primary storage. [2025-09-22T22:27:21.085274] [INFO ] [MAIN ] TPR: Loaded 53483 primary data records. [2025-09-22T22:27:21.186178] [DEBUG] [LOCAL ] TPVG: Loaded 27100 existing records from primary storage. [2025-09-22T22:27:21.198804] [INFO ] [MAIN ] TPVG: Loaded 27100 primary data records. [2025-09-22T22:27:21.385317] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:21.565337] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12372 primary records. [2025-09-22T22:27:21.576424] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-22T22:27:21.799371] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-09-22T22:27:21.799560] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-22T22:27:21.801851] [INFO ] [MAIN ] Derivative Progress: 1852/2091 symbols completed. TPL took 1.1s. Estimated remaining: 1m 33s. Rate: 155.0 symbols/min [2025-09-22T22:27:21.803258] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:21.817727] [DEBUG] [LOCAL ] TPYP: Loaded 7872 existing records from primary storage. [2025-09-22T22:27:21.819066] [INFO ] [MAIN ] TPYP: Loaded 7872 primary data records. [2025-09-22T22:27:21.985548] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:22.026975] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53483 primary records. [2025-09-22T22:27:22.044933] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:22.140452] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27100 primary records. [2025-09-22T22:27:22.150688] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-22T22:27:22.159397] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-22T22:27:22.191592] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-09-22T22:27:22.192758] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-09-22T22:27:22.193353] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-22T22:27:22.193295] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-22T22:27:22.195978] [INFO ] [MAIN ] Derivative Progress: 1853/2091 symbols completed. TPVG took 1.3s. Estimated remaining: 1m 32s. Rate: 155.0 symbols/min [2025-09-22T22:27:22.198348] [INFO ] [MAIN ] Derivative Progress: 1854/2091 symbols completed. TPR took 1.5s. Estimated remaining: 1m 32s. Rate: 155.0 symbols/min [2025-09-22T22:27:22.198639] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:22.199239] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:22.207214] [DEBUG] [LOCAL ] TPZ: Loaded 5195 existing records from primary storage. [2025-09-22T22:27:22.207603] [INFO ] [MAIN ] TPZ: Loaded 5195 primary data records. [2025-09-22T22:27:22.318607] [DEBUG] [LOCAL ] TR: Loaded 18292 existing records from primary storage. [2025-09-22T22:27:22.347880] [INFO ] [MAIN ] TR: Loaded 18292 primary data records. [2025-09-22T22:27:22.366085] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:22.388508] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7872 primary records. [2025-09-22T22:27:22.403891] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-22T22:27:22.686189] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-09-22T22:27:22.696960] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-22T22:27:22.699601] [INFO ] [MAIN ] Derivative Progress: 1855/2091 symbols completed. TPYP took 0.9s. Estimated remaining: 1m 31s. Rate: 155.0 symbols/min [2025-09-22T22:27:22.732901] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:22.906282] [DEBUG] [LOCAL ] TRAK: Loaded 9317 existing records from primary storage. [2025-09-22T22:27:22.908080] [INFO ] [MAIN ] TRAK: Loaded 9317 primary data records. [2025-09-22T22:27:23.117995] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:27:23.141677] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 5195 primary records. [2025-09-22T22:27:23.274902] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-22T22:27:23.309584] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-09-22T22:27:23.310271] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-22T22:27:23.312733] [INFO ] [MAIN ] Derivative Progress: 1856/2091 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 31s. Rate: 155.0 symbols/min [2025-09-22T22:27:23.320699] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:23.327027] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:23.327937] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18292 primary records. [2025-09-22T22:27:23.328014] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-22T22:27:23.349768] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-09-22T22:27:23.350164] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-22T22:27:23.352365] [INFO ] [MAIN ] Derivative Progress: 1857/2091 symbols completed. TR took 1.2s. Estimated remaining: 1m 31s. Rate: 155.0 symbols/min [2025-09-22T22:27:23.353337] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:23.364526] [DEBUG] [LOCAL ] TRC: Loaded 16078 existing records from primary storage. [2025-09-22T22:27:23.365046] [INFO ] [MAIN ] TRC: Loaded 16078 primary data records. [2025-09-22T22:27:23.457411] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:23.487497] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9317 primary records. [2025-09-22T22:27:23.504497] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-22T22:27:23.597409] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-09-22T22:27:23.597583] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-22T22:27:23.600319] [INFO ] [MAIN ] Derivative Progress: 1858/2091 symbols completed. TRAK took 0.9s. Estimated remaining: 1m 30s. Rate: 155.1 symbols/min [2025-09-22T22:27:23.742323] [DEBUG] [LOCAL ] TREX: Loaded 50024 existing records from primary storage. [2025-09-22T22:27:23.743111] [INFO ] [MAIN ] TREX: Loaded 50024 primary data records. [2025-09-22T22:27:24.108340] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:24.109838] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 16078 primary records. [2025-09-22T22:27:24.110115] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-22T22:27:24.127092] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-09-22T22:27:24.127545] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-22T22:27:24.130361] [INFO ] [MAIN ] Derivative Progress: 1859/2091 symbols completed. TRC took 0.8s. Estimated remaining: 1m 30s. Rate: 155.0 symbols/min [2025-09-22T22:27:24.148756] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:24.149393] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 50024 primary records. [2025-09-22T22:27:24.149454] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-22T22:27:24.164554] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-09-22T22:27:24.164620] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-22T22:27:24.166785] [INFO ] [MAIN ] Derivative Progress: 1860/2091 symbols completed. TREX took 0.8s. Estimated remaining: 1m 29s. Rate: 155.1 symbols/min [2025-09-22T22:27:24.167630] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:24.167908] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:24.168215] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:24.230212] [DEBUG] [LOCAL ] TRNO: Loaded 44161 existing records from primary storage. [2025-09-22T22:27:24.229389] [DEBUG] [LOCAL ] TRN: Loaded 37376 existing records from primary storage. [2025-09-22T22:27:24.244360] [INFO ] [MAIN ] TRNO: Loaded 44161 primary data records. [2025-09-22T22:27:24.244253] [INFO ] [MAIN ] TRN: Loaded 37376 primary data records. [2025-09-22T22:27:24.495276] [DEBUG] [LOCAL ] TRGP: Loaded 50848 existing records from primary storage. [2025-09-22T22:27:24.511114] [INFO ] [MAIN ] TRGP: Loaded 50848 primary data records. [2025-09-22T22:27:25.234758] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:25.235780] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 44161 primary records. [2025-09-22T22:27:25.248111] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-22T22:27:25.249684] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:25.250611] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 37376 primary records. [2025-09-22T22:27:25.262106] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-22T22:27:25.275800] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-09-22T22:27:25.275900] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-22T22:27:25.280504] [INFO ] [MAIN ] Derivative Progress: 1861/2091 symbols completed. TRNO took 1.1s. Estimated remaining: 1m 29s. Rate: 155.0 symbols/min [2025-09-22T22:27:25.285233] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:25.284984] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-09-22T22:27:25.285534] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-22T22:27:25.289411] [INFO ] [MAIN ] Derivative Progress: 1862/2091 symbols completed. TRN took 1.1s. Estimated remaining: 1m 29s. Rate: 155.0 symbols/min [2025-09-22T22:27:25.291730] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:25.306635] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:25.307525] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50848 primary records. [2025-09-22T22:27:25.307724] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-22T22:27:25.327512] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-09-22T22:27:25.327680] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-22T22:27:25.330958] [INFO ] [MAIN ] Derivative Progress: 1863/2091 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 28s. Rate: 155.1 symbols/min [2025-09-22T22:27:25.331426] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:25.384627] [DEBUG] [LOCAL ] TRP: Loaded 52131 existing records from primary storage. [2025-09-22T22:27:25.385674] [INFO ] [MAIN ] TRP: Loaded 52131 primary data records. [2025-09-22T22:27:25.514968] [DEBUG] [LOCAL ] TROX: Loaded 51770 existing records from primary storage. [2025-09-22T22:27:25.520528] [INFO ] [MAIN ] TROX: Loaded 51770 primary data records. [2025-09-22T22:27:25.689795] [DEBUG] [LOCAL ] TRTX: Loaded 37353 existing records from primary storage. [2025-09-22T22:27:25.706475] [INFO ] [MAIN ] TRTX: Loaded 37353 primary data records. [2025-09-22T22:27:26.408412] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:26.409475] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52131 primary records. [2025-09-22T22:27:26.411857] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-22T22:27:26.443858] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-09-22T22:27:26.444568] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:26.444873] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-22T22:27:26.448259] [INFO ] [MAIN ] Derivative Progress: 1864/2091 symbols completed. TRP took 1.2s. Estimated remaining: 1m 28s. Rate: 155.0 symbols/min [2025-09-22T22:27:26.445983] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51770 primary records. [2025-09-22T22:27:26.448731] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-22T22:27:26.448680] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:26.470068] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-09-22T22:27:26.470360] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-22T22:27:26.472911] [INFO ] [MAIN ] Derivative Progress: 1865/2091 symbols completed. TROX took 1.2s. Estimated remaining: 1m 27s. Rate: 155.0 symbols/min [2025-09-22T22:27:26.481267] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:26.487038] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:26.487890] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37353 primary records. [2025-09-22T22:27:26.488171] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-22T22:27:26.504504] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-09-22T22:27:26.504798] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-22T22:27:26.507332] [INFO ] [MAIN ] Derivative Progress: 1866/2091 symbols completed. TRTX took 1.2s. Estimated remaining: 1m 27s. Rate: 155.1 symbols/min [2025-09-22T22:27:26.507694] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:26.558535] [DEBUG] [LOCAL ] TRU: Loaded 51198 existing records from primary storage. [2025-09-22T22:27:26.558891] [INFO ] [MAIN ] TRU: Loaded 51198 primary data records. [2025-09-22T22:27:26.714832] [DEBUG] [LOCAL ] TRV: Loaded 48275 existing records from primary storage. [2025-09-22T22:27:26.739782] [INFO ] [MAIN ] TRV: Loaded 48275 primary data records. [2025-09-22T22:27:26.919014] [DEBUG] [LOCAL ] TS: Loaded 51670 existing records from primary storage. [2025-09-22T22:27:26.976087] [INFO ] [MAIN ] TS: Loaded 51670 primary data records. [2025-09-22T22:27:27.642034] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:27.643014] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51198 primary records. [2025-09-22T22:27:27.643263] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-22T22:27:27.662224] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-09-22T22:27:27.662600] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-22T22:27:27.664839] [INFO ] [MAIN ] Derivative Progress: 1867/2091 symbols completed. TRU took 1.2s. Estimated remaining: 1m 27s. Rate: 155.0 symbols/min [2025-09-22T22:27:27.665765] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:27.686147] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:27.688091] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 48275 primary records. [2025-09-22T22:27:27.688319] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-22T22:27:27.702202] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:27.703625] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51670 primary records. [2025-09-22T22:27:27.703835] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-22T22:27:27.743855] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-09-22T22:27:27.740143] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-09-22T22:27:27.744064] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-22T22:27:27.743999] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-22T22:27:27.746235] [INFO ] [MAIN ] Derivative Progress: 1868/2091 symbols completed. TRV took 1.3s. Estimated remaining: 1m 26s. Rate: 155.0 symbols/min [2025-09-22T22:27:27.746624] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:27.749963] [INFO ] [MAIN ] Derivative Progress: 1869/2091 symbols completed. TS took 1.2s. Estimated remaining: 1m 26s. Rate: 155.1 symbols/min [2025-09-22T22:27:27.750372] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:27.760959] [DEBUG] [LOCAL ] TSE: Loaded 28835 existing records from primary storage. [2025-09-22T22:27:27.761190] [INFO ] [MAIN ] TSE: Loaded 28835 primary data records. [2025-09-22T22:27:27.856412] [DEBUG] [LOCAL ] TSI: Loaded 8336 existing records from primary storage. [2025-09-22T22:27:27.883167] [INFO ] [MAIN ] TSI: Loaded 8336 primary data records. [2025-09-22T22:27:28.085443] [DEBUG] [LOCAL ] TSLX: Loaded 35314 existing records from primary storage. [2025-09-22T22:27:28.199170] [INFO ] [MAIN ] TSLX: Loaded 35314 primary data records. [2025-09-22T22:27:28.747992] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:28.748956] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 28835 primary records. [2025-09-22T22:27:28.749210] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-22T22:27:28.769076] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-09-22T22:27:28.769313] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-22T22:27:28.771518] [INFO ] [MAIN ] Derivative Progress: 1870/2091 symbols completed. TSE took 1.1s. Estimated remaining: 1m 26s. Rate: 155.0 symbols/min [2025-09-22T22:27:28.780137] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:28.785773] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:28.786602] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 8336 primary records. [2025-09-22T22:27:28.786954] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-22T22:27:28.803413] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-09-22T22:27:28.803577] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-22T22:27:28.806864] [INFO ] [MAIN ] Derivative Progress: 1871/2091 symbols completed. TSI took 1.1s. Estimated remaining: 1m 25s. Rate: 155.0 symbols/min [2025-09-22T22:27:28.807360] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:28.820894] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:28.821684] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35314 primary records. [2025-09-22T22:27:28.821905] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-22T22:27:28.838476] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-09-22T22:27:28.838544] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-22T22:27:28.841503] [INFO ] [MAIN ] Derivative Progress: 1872/2091 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 25s. Rate: 155.1 symbols/min [2025-09-22T22:27:28.841857] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:28.869290] [DEBUG] [LOCAL ] TSQ: Loaded 12128 existing records from primary storage. [2025-09-22T22:27:28.869440] [INFO ] [MAIN ] TSQ: Loaded 12128 primary data records. [2025-09-22T22:27:29.080542] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-22T22:27:29.203329] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-09-22T22:27:29.218220] [DEBUG] [LOCAL ] TSN: Loaded 52850 existing records from primary storage. [2025-09-22T22:27:29.252019] [INFO ] [MAIN ] TSN: Loaded 52850 primary data records. [2025-09-22T22:27:29.897253] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:29.898803] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 12128 primary records. [2025-09-22T22:27:29.899268] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-22T22:27:29.916525] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-09-22T22:27:29.916675] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-22T22:27:29.919089] [INFO ] [MAIN ] Derivative Progress: 1873/2091 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 24s. Rate: 155.0 symbols/min [2025-09-22T22:27:29.936844] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:29.937817] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-09-22T22:27:29.937994] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-22T22:27:29.954566] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-09-22T22:27:29.954690] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-22T22:27:29.956781] [INFO ] [MAIN ] Derivative Progress: 1874/2091 symbols completed. TSM took 1.2s. Estimated remaining: 1m 24s. Rate: 155.0 symbols/min [2025-09-22T22:27:29.971820] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:29.972414] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52850 primary records. [2025-09-22T22:27:29.972475] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-22T22:27:29.987516] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-09-22T22:27:29.987576] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-22T22:27:29.990148] [INFO ] [MAIN ] Derivative Progress: 1875/2091 symbols completed. TSN took 1.2s. Estimated remaining: 1m 24s. Rate: 155.1 symbols/min [2025-09-22T22:27:29.990873] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:29.990976] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:29.990770] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:30.059533] [DEBUG] [LOCAL ] TTC: Loaded 42753 existing records from primary storage. [2025-09-22T22:27:30.059731] [INFO ] [MAIN ] TTC: Loaded 42753 primary data records. [2025-09-22T22:27:30.202525] [DEBUG] [LOCAL ] TTE: Loaded 51653 existing records from primary storage. [2025-09-22T22:27:30.218757] [INFO ] [MAIN ] TTE: Loaded 51653 primary data records. [2025-09-22T22:27:30.203161] [DEBUG] [LOCAL ] TT: Loaded 47955 existing records from primary storage. [2025-09-22T22:27:30.292461] [INFO ] [MAIN ] TT: Loaded 47955 primary data records. [2025-09-22T22:27:31.019243] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:31.020373] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42753 primary records. [2025-09-22T22:27:31.020725] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-22T22:27:31.041959] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-09-22T22:27:31.055008] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-22T22:27:31.055399] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:27:31.057270] [INFO ] [MAIN ] Derivative Progress: 1876/2091 symbols completed. TTC took 1.1s. Estimated remaining: 1m 23s. Rate: 155.0 symbols/min [2025-09-22T22:27:31.057754] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:31.066059] [INFO ] [MAIN ] TT: Generated 1793 derivative records from 47955 primary records. [2025-09-22T22:27:31.070604] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-22T22:27:31.073012] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:31.081412] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51653 primary records. [2025-09-22T22:27:31.085751] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-22T22:27:31.098419] [DEBUG] [LOCAL ] TT: Derivative data saved (1793 records). [2025-09-22T22:27:31.106126] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-09-22T22:27:31.106310] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-22T22:27:31.101838] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-22T22:27:31.108863] [INFO ] [MAIN ] Derivative Progress: 1877/2091 symbols completed. TTE took 1.1s. Estimated remaining: 1m 23s. Rate: 155.0 symbols/min [2025-09-22T22:27:31.109211] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:31.111631] [INFO ] [MAIN ] Derivative Progress: 1878/2091 symbols completed. TT took 1.1s. Estimated remaining: 1m 22s. Rate: 155.1 symbols/min [2025-09-22T22:27:31.112324] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:31.168078] [DEBUG] [LOCAL ] TTI: Loaded 45260 existing records from primary storage. [2025-09-22T22:27:31.168362] [INFO ] [MAIN ] TTI: Loaded 45260 primary data records. [2025-09-22T22:27:31.315295] [DEBUG] [LOCAL ] TU: Loaded 49920 existing records from primary storage. [2025-09-22T22:27:31.316010] [INFO ] [MAIN ] TU: Loaded 49920 primary data records. [2025-09-22T22:27:31.322228] [DEBUG] [LOCAL ] TUYA: Loaded 46618 existing records from primary storage. [2025-09-22T22:27:31.327592] [INFO ] [MAIN ] TUYA: Loaded 46618 primary data records. [2025-09-22T22:27:32.185428] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:32.189260] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45260 primary records. [2025-09-22T22:27:32.190096] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-22T22:27:32.224914] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-09-22T22:27:32.225374] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:32.226600] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49920 primary records. [2025-09-22T22:27:32.226793] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-22T22:27:32.226942] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-22T22:27:32.230064] [INFO ] [MAIN ] Derivative Progress: 1879/2091 symbols completed. TTI took 1.2s. Estimated remaining: 1m 22s. Rate: 155.0 symbols/min [2025-09-22T22:27:32.238511] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:32.256670] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:32.257391] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46618 primary records. [2025-09-22T22:27:32.257487] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-22T22:27:32.261139] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-09-22T22:27:32.261688] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-22T22:27:32.264461] [INFO ] [MAIN ] Derivative Progress: 1880/2091 symbols completed. TU took 1.2s. Estimated remaining: 1m 22s. Rate: 155.0 symbols/min [2025-09-22T22:27:32.265211] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:32.282407] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-09-22T22:27:32.282617] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-22T22:27:32.285282] [INFO ] [MAIN ] Derivative Progress: 1881/2091 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 21s. Rate: 155.1 symbols/min [2025-09-22T22:27:32.285838] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:32.288665] [DEBUG] [LOCAL ] TVC: Loaded 3510 existing records from primary storage. [2025-09-22T22:27:32.288893] [INFO ] [MAIN ] TVC: Loaded 3510 primary data records. [2025-09-22T22:27:32.384501] [DEBUG] [LOCAL ] TVE: Loaded 2815 existing records from primary storage. [2025-09-22T22:27:32.395841] [INFO ] [MAIN ] TVE: Loaded 2815 primary data records. [2025-09-22T22:27:32.804087] [DEBUG] [LOCAL ] TV: Loaded 43023 existing records from primary storage. [2025-09-22T22:27:32.867812] [INFO ] [MAIN ] TV: Loaded 43023 primary data records. [2025-09-22T22:27:33.258592] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:33.260450] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3510 primary records. [2025-09-22T22:27:33.261870] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-22T22:27:33.287517] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-09-22T22:27:33.292304] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-22T22:27:33.294541] [INFO ] [MAIN ] Derivative Progress: 1882/2091 symbols completed. TVC took 1.0s. Estimated remaining: 1m 21s. Rate: 155.0 symbols/min [2025-09-22T22:27:33.295152] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:33.294958] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:33.296177] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2815 primary records. [2025-09-22T22:27:33.296625] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-22T22:27:33.312469] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-09-22T22:27:33.312776] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-22T22:27:33.315085] [INFO ] [MAIN ] Derivative Progress: 1883/2091 symbols completed. TVE took 1.0s. Estimated remaining: 1m 20s. Rate: 155.1 symbols/min [2025-09-22T22:27:33.315669] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:33.342265] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:33.343170] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 43023 primary records. [2025-09-22T22:27:33.343282] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-22T22:27:33.359541] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-09-22T22:27:33.360332] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-22T22:27:33.363121] [INFO ] [MAIN ] Derivative Progress: 1884/2091 symbols completed. TV took 1.1s. Estimated remaining: 1m 20s. Rate: 155.1 symbols/min [2025-09-22T22:27:33.363398] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:33.375605] [DEBUG] [LOCAL ] TWI: Loaded 34588 existing records from primary storage. [2025-09-22T22:27:33.375902] [INFO ] [MAIN ] TWI: Loaded 34588 primary data records. [2025-09-22T22:27:33.399044] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-22T22:27:33.414612] [INFO ] [MAIN ] TWN: Loaded 3250 primary data records. [2025-09-22T22:27:33.681178] [DEBUG] [LOCAL ] TWLO: Loaded 52724 existing records from primary storage. [2025-09-22T22:27:33.758525] [INFO ] [MAIN ] TWLO: Loaded 52724 primary data records. [2025-09-22T22:27:34.402447] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:34.402841] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:34.404960] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 34588 primary records. [2025-09-22T22:27:34.404011] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3250 primary records. [2025-09-22T22:27:34.405490] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-22T22:27:34.405305] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-22T22:27:34.428629] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-09-22T22:27:34.431548] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-22T22:27:34.434000] [INFO ] [MAIN ] Derivative Progress: 1885/2091 symbols completed. TWN took 1.1s. Estimated remaining: 1m 20s. Rate: 155.0 symbols/min [2025-09-22T22:27:34.438922] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-09-22T22:27:34.439315] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:34.439415] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-22T22:27:34.442505] [INFO ] [MAIN ] Derivative Progress: 1886/2091 symbols completed. TWI took 1.1s. Estimated remaining: 1m 19s. Rate: 155.1 symbols/min [2025-09-22T22:27:34.444494] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:34.459298] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:34.460087] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52724 primary records. [2025-09-22T22:27:34.460191] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-22T22:27:34.476259] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-09-22T22:27:34.476330] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-22T22:27:34.480111] [INFO ] [MAIN ] Derivative Progress: 1887/2091 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 19s. Rate: 155.2 symbols/min [2025-09-22T22:27:34.480460] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:34.498821] [DEBUG] [LOCAL ] TX: Loaded 23768 existing records from primary storage. [2025-09-22T22:27:34.499016] [INFO ] [MAIN ] TX: Loaded 23768 primary data records. [2025-09-22T22:27:34.845862] [DEBUG] [LOCAL ] TWO: Loaded 48247 existing records from primary storage. [2025-09-22T22:27:34.847181] [INFO ] [MAIN ] TWO: Loaded 48247 primary data records. [2025-09-22T22:27:34.871806] [DEBUG] [LOCAL ] TXNM: Loaded 44034 existing records from primary storage. [2025-09-22T22:27:34.898072] [INFO ] [MAIN ] TXNM: Loaded 44034 primary data records. [2025-09-22T22:27:35.579131] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:35.580703] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23768 primary records. [2025-09-22T22:27:35.581851] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-22T22:27:35.600099] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-09-22T22:27:35.600318] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-22T22:27:35.602750] [INFO ] [MAIN ] Derivative Progress: 1888/2091 symbols completed. TX took 1.2s. Estimated remaining: 1m 19s. Rate: 155.0 symbols/min [2025-09-22T22:27:35.623259] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:35.624168] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48247 primary records. [2025-09-22T22:27:35.636818] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-22T22:27:35.636729] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:35.638348] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 44034 primary records. [2025-09-22T22:27:35.638664] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-22T22:27:35.665902] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-09-22T22:27:35.666015] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-22T22:27:35.670833] [INFO ] [MAIN ] Derivative Progress: 1889/2091 symbols completed. TWO took 1.2s. Estimated remaining: 1m 18s. Rate: 155.1 symbols/min [2025-09-22T22:27:35.672373] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-09-22T22:27:35.672717] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-22T22:27:35.676576] [INFO ] [MAIN ] Derivative Progress: 1890/2091 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 18s. Rate: 155.1 symbols/min [2025-09-22T22:27:35.677151] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:35.677279] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:35.677381] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:35.689864] [DEBUG] [LOCAL ] TY: Loaded 7646 existing records from primary storage. [2025-09-22T22:27:35.690012] [INFO ] [MAIN ] TY: Loaded 7646 primary data records. [2025-09-22T22:27:35.833619] [DEBUG] [LOCAL ] TXO: Loaded 18741 existing records from primary storage. [2025-09-22T22:27:35.849924] [INFO ] [MAIN ] TXO: Loaded 18741 primary data records. [2025-09-22T22:27:36.070376] [DEBUG] [LOCAL ] TXT: Loaded 49780 existing records from primary storage. [2025-09-22T22:27:36.115664] [INFO ] [MAIN ] TXT: Loaded 49780 primary data records. [2025-09-22T22:27:36.698761] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:36.699739] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7646 primary records. [2025-09-22T22:27:36.699947] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-22T22:27:36.719024] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-09-22T22:27:36.719459] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-22T22:27:36.721717] [INFO ] [MAIN ] Derivative Progress: 1891/2091 symbols completed. TY took 1.0s. Estimated remaining: 1m 17s. Rate: 155.0 symbols/min [2025-09-22T22:27:36.735418] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:36.735978] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:36.736990] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 18741 primary records. [2025-09-22T22:27:36.737216] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-22T22:27:36.754628] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-09-22T22:27:36.754737] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-22T22:27:36.757054] [INFO ] [MAIN ] Derivative Progress: 1892/2091 symbols completed. TXO took 1.1s. Estimated remaining: 1m 17s. Rate: 155.1 symbols/min [2025-09-22T22:27:36.757469] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:36.777628] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:36.778432] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49780 primary records. [2025-09-22T22:27:36.783782] [DEBUG] [LOCAL ] TYG: Loaded 14298 existing records from primary storage. [2025-09-22T22:27:36.783858] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-22T22:27:36.783945] [INFO ] [MAIN ] TYG: Loaded 14298 primary data records. [2025-09-22T22:27:36.888760] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-09-22T22:27:36.920150] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-22T22:27:36.923326] [INFO ] [MAIN ] Derivative Progress: 1893/2091 symbols completed. TXT took 1.2s. Estimated remaining: 1m 17s. Rate: 155.1 symbols/min [2025-09-22T22:27:36.939248] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:36.939909] [DEBUG] [LOCAL ] TYL: Loaded 22481 existing records from primary storage. [2025-09-22T22:27:36.951578] [INFO ] [MAIN ] TYL: Loaded 22481 primary data records. [2025-09-22T22:27:37.499949] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-22T22:27:37.501053] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-09-22T22:27:37.874025] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:37.875000] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 14298 primary records. [2025-09-22T22:27:37.875180] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-22T22:27:37.894962] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-09-22T22:27:37.895364] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-22T22:27:37.898228] [INFO ] [MAIN ] Derivative Progress: 1894/2091 symbols completed. TYG took 1.2s. Estimated remaining: 1m 16s. Rate: 155.0 symbols/min [2025-09-22T22:27:37.899037] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:37.914414] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:37.915371] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22481 primary records. [2025-09-22T22:27:37.915597] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-22T22:27:37.932354] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-09-22T22:27:37.932417] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-22T22:27:37.934803] [INFO ] [MAIN ] Derivative Progress: 1895/2091 symbols completed. TYL took 1.2s. Estimated remaining: 1m 16s. Rate: 155.1 symbols/min [2025-09-22T22:27:37.935244] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:37.952147] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:37.952894] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-09-22T22:27:37.953092] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-22T22:27:37.969787] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-09-22T22:27:37.969882] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-22T22:27:37.974455] [INFO ] [MAIN ] Derivative Progress: 1896/2091 symbols completed. U took 1.0s. Estimated remaining: 1m 15s. Rate: 155.1 symbols/min [2025-09-22T22:27:37.974809] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:37.993835] [DEBUG] [LOCAL ] UAN: Loaded 5468 existing records from primary storage. [2025-09-22T22:27:37.993939] [INFO ] [MAIN ] UAN: Loaded 5468 primary data records. [2025-09-22T22:27:38.144923] [DEBUG] [LOCAL ] UA: Loaded 50408 existing records from primary storage. [2025-09-22T22:27:38.146274] [INFO ] [MAIN ] UA: Loaded 50408 primary data records. [2025-09-22T22:27:38.178826] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-09-22T22:27:38.184088] [INFO ] [MAIN ] UAA: Loaded 53509 primary data records. [2025-09-22T22:27:39.073038] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:39.074241] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5468 primary records. [2025-09-22T22:27:39.074364] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-22T22:27:39.101213] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-09-22T22:27:39.105987] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-22T22:27:39.110031] [INFO ] [MAIN ] Derivative Progress: 1897/2091 symbols completed. UAN took 1.1s. Estimated remaining: 1m 15s. Rate: 155.0 symbols/min [2025-09-22T22:27:39.107420] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:39.111086] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50408 primary records. [2025-09-22T22:27:39.111189] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:39.111366] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-22T22:27:39.140203] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-09-22T22:27:39.140507] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-22T22:27:39.142910] [INFO ] [MAIN ] Derivative Progress: 1898/2091 symbols completed. UA took 1.2s. Estimated remaining: 1m 15s. Rate: 155.1 symbols/min [2025-09-22T22:27:39.143779] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:39.143537] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:39.144615] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53509 primary records. [2025-09-22T22:27:39.145162] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-22T22:27:39.162958] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-09-22T22:27:39.163186] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-22T22:27:39.166161] [INFO ] [MAIN ] Derivative Progress: 1899/2091 symbols completed. UAA took 1.2s. Estimated remaining: 1m 14s. Rate: 155.1 symbols/min [2025-09-22T22:27:39.166482] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:39.213710] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-22T22:27:39.234462] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-09-22T22:27:39.385160] [DEBUG] [LOCAL ] UCB: Loaded 38114 existing records from primary storage. [2025-09-22T22:27:39.391704] [INFO ] [MAIN ] UCB: Loaded 38114 primary data records. [2025-09-22T22:27:39.376430] [DEBUG] [LOCAL ] UBS: Loaded 52452 existing records from primary storage. [2025-09-22T22:27:39.392378] [INFO ] [MAIN ] UBS: Loaded 52452 primary data records. [2025-09-22T22:27:40.316920] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:40.326519] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-09-22T22:27:40.331459] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-22T22:27:40.332969] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:40.342857] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 38114 primary records. [2025-09-22T22:27:40.343140] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-22T22:27:40.352307] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-09-22T22:27:40.352788] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-22T22:27:40.363139] [INFO ] [MAIN ] Derivative Progress: 1900/2091 symbols completed. UBER took 1.3s. Estimated remaining: 1m 14s. Rate: 155.0 symbols/min [2025-09-22T22:27:40.379398] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:40.379171] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:40.382088] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52452 primary records. [2025-09-22T22:27:40.382302] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-22T22:27:40.403052] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-09-22T22:27:40.403157] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-22T22:27:40.402301] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-09-22T22:27:40.406959] [INFO ] [MAIN ] Derivative Progress: 1901/2091 symbols completed. UBS took 1.3s. Estimated remaining: 1m 14s. Rate: 155.0 symbols/min [2025-09-22T22:27:40.407213] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-22T22:27:40.410673] [INFO ] [MAIN ] Derivative Progress: 1902/2091 symbols completed. UCB took 1.2s. Estimated remaining: 1m 13s. Rate: 155.1 symbols/min [2025-09-22T22:27:40.411239] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:40.411020] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:40.422808] [DEBUG] [LOCAL ] UFI: Loaded 8192 existing records from primary storage. [2025-09-22T22:27:40.422947] [INFO ] [MAIN ] UFI: Loaded 8192 primary data records. [2025-09-22T22:27:40.798257] [DEBUG] [LOCAL ] UDR: Loaded 51790 existing records from primary storage. [2025-09-22T22:27:40.799206] [INFO ] [MAIN ] UDR: Loaded 51790 primary data records. [2025-09-22T22:27:40.799948] [DEBUG] [LOCAL ] UE: Loaded 42958 existing records from primary storage. [2025-09-22T22:27:40.800779] [INFO ] [MAIN ] UE: Loaded 42958 primary data records. [2025-09-22T22:27:41.469495] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:41.471186] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8192 primary records. [2025-09-22T22:27:41.471547] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-22T22:27:41.489165] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-09-22T22:27:41.489318] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-22T22:27:41.491912] [INFO ] [MAIN ] Derivative Progress: 1903/2091 symbols completed. UFI took 1.1s. Estimated remaining: 1m 13s. Rate: 155.0 symbols/min [2025-09-22T22:27:41.512328] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:41.513165] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42958 primary records. [2025-09-22T22:27:41.514102] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-22T22:27:41.537792] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:41.544166] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51790 primary records. [2025-09-22T22:27:41.544868] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-22T22:27:41.545350] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-09-22T22:27:41.550158] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-22T22:27:41.553673] [INFO ] [MAIN ] Derivative Progress: 1904/2091 symbols completed. UE took 1.1s. Estimated remaining: 1m 12s. Rate: 155.0 symbols/min [2025-09-22T22:27:41.568952] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-09-22T22:27:41.569037] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-22T22:27:41.571263] [INFO ] [MAIN ] Derivative Progress: 1905/2091 symbols completed. UDR took 1.2s. Estimated remaining: 1m 12s. Rate: 155.1 symbols/min [2025-09-22T22:27:41.572383] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:41.572502] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:41.572181] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:41.590974] [DEBUG] [LOCAL ] UHAL: Loaded 16429 existing records from primary storage. [2025-09-22T22:27:41.591161] [INFO ] [MAIN ] UHAL: Loaded 16429 primary data records. [2025-09-22T22:27:42.017254] [DEBUG] [LOCAL ] UGI: Loaded 50566 existing records from primary storage. [2025-09-22T22:27:42.007399] [DEBUG] [LOCAL ] UGP: Loaded 42582 existing records from primary storage. [2025-09-22T22:27:42.017569] [INFO ] [MAIN ] UGI: Loaded 50566 primary data records. [2025-09-22T22:27:42.017679] [INFO ] [MAIN ] UGP: Loaded 42582 primary data records. [2025-09-22T22:27:42.657119] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:42.659159] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16429 primary records. [2025-09-22T22:27:42.659304] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-22T22:27:42.678867] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-09-22T22:27:42.679350] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-22T22:27:42.682304] [INFO ] [MAIN ] Derivative Progress: 1906/2091 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 12s. Rate: 155.0 symbols/min [2025-09-22T22:27:42.683029] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:42.711438] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:42.712514] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42582 primary records. [2025-09-22T22:27:42.725470] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-22T22:27:42.727078] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:42.728101] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50566 primary records. [2025-09-22T22:27:42.739127] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-22T22:27:42.759203] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-09-22T22:27:42.760242] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-09-22T22:27:42.760503] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-22T22:27:42.763360] [INFO ] [MAIN ] Derivative Progress: 1907/2091 symbols completed. UGP took 1.2s. Estimated remaining: 1m 11s. Rate: 155.0 symbols/min [2025-09-22T22:27:42.773183] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:42.760606] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-22T22:27:42.776691] [INFO ] [MAIN ] Derivative Progress: 1908/2091 symbols completed. UGI took 1.2s. Estimated remaining: 1m 11s. Rate: 155.1 symbols/min [2025-09-22T22:27:42.777283] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:42.798879] [DEBUG] [LOCAL ] UHS: Loaded 41289 existing records from primary storage. [2025-09-22T22:27:42.799143] [INFO ] [MAIN ] UHS: Loaded 41289 primary data records. [2025-09-22T22:27:42.847278] [DEBUG] [LOCAL ] UHT: Loaded 10029 existing records from primary storage. [2025-09-22T22:27:42.860676] [INFO ] [MAIN ] UHT: Loaded 10029 primary data records. [2025-09-22T22:27:42.886861] [DEBUG] [LOCAL ] UI: Loaded 12558 existing records from primary storage. [2025-09-22T22:27:42.897312] [INFO ] [MAIN ] UI: Loaded 12558 primary data records. [2025-09-22T22:27:43.846271] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:43.847257] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 41289 primary records. [2025-09-22T22:27:43.848046] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-22T22:27:43.867927] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-09-22T22:27:43.877170] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-22T22:27:43.879255] [INFO ] [MAIN ] Derivative Progress: 1909/2091 symbols completed. UHS took 1.2s. Estimated remaining: 1m 10s. Rate: 155.0 symbols/min [2025-09-22T22:27:43.880279] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:43.887318] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:43.889120] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 12558 primary records. [2025-09-22T22:27:43.889344] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-22T22:27:43.904391] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:43.905782] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 10029 primary records. [2025-09-22T22:27:43.913301] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-22T22:27:43.929877] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-09-22T22:27:43.934680] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-22T22:27:43.940569] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-09-22T22:27:43.940486] [INFO ] [MAIN ] Derivative Progress: 1910/2091 symbols completed. UI took 1.2s. Estimated remaining: 1m 10s. Rate: 155.0 symbols/min [2025-09-22T22:27:43.940992] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-22T22:27:43.943747] [INFO ] [MAIN ] Derivative Progress: 1911/2091 symbols completed. UHT took 1.2s. Estimated remaining: 1m 10s. Rate: 155.1 symbols/min [2025-09-22T22:27:43.943910] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:43.944271] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:43.976253] [DEBUG] [LOCAL ] UIS: Loaded 37103 existing records from primary storage. [2025-09-22T22:27:43.976707] [INFO ] [MAIN ] UIS: Loaded 37103 primary data records. [2025-09-22T22:27:44.139102] [DEBUG] [LOCAL ] ULS: Loaded 39211 existing records from primary storage. [2025-09-22T22:27:44.145701] [INFO ] [MAIN ] ULS: Loaded 39211 primary data records. [2025-09-22T22:27:44.494587] [DEBUG] [LOCAL ] UL: Loaded 53067 existing records from primary storage. [2025-09-22T22:27:44.495684] [INFO ] [MAIN ] UL: Loaded 53067 primary data records. [2025-09-22T22:27:45.044245] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:45.046109] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 37103 primary records. [2025-09-22T22:27:45.046291] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-22T22:27:45.075012] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:45.079011] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39211 primary records. [2025-09-22T22:27:45.081363] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-22T22:27:45.093123] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-09-22T22:27:45.098385] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-22T22:27:45.107274] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-09-22T22:27:45.105795] [INFO ] [MAIN ] Derivative Progress: 1912/2091 symbols completed. UIS took 1.2s. Estimated remaining: 1m 9s. Rate: 155.0 symbols/min [2025-09-22T22:27:45.107913] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-22T22:27:45.112837] [INFO ] [MAIN ] Derivative Progress: 1913/2091 symbols completed. ULS took 1.2s. Estimated remaining: 1m 9s. Rate: 155.0 symbols/min [2025-09-22T22:27:45.109575] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:45.114111] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:45.129245] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:45.130140] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53067 primary records. [2025-09-22T22:27:45.130322] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-22T22:27:45.148280] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-09-22T22:27:45.148505] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-22T22:27:45.151259] [INFO ] [MAIN ] Derivative Progress: 1914/2091 symbols completed. UL took 1.2s. Estimated remaining: 1m 8s. Rate: 155.1 symbols/min [2025-09-22T22:27:45.151792] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:45.175328] [DEBUG] [LOCAL ] UNF: Loaded 11798 existing records from primary storage. [2025-09-22T22:27:45.175561] [INFO ] [MAIN ] UNF: Loaded 11798 primary data records. [2025-09-22T22:27:45.272955] [DEBUG] [LOCAL ] UMH: Loaded 33333 existing records from primary storage. [2025-09-22T22:27:45.290567] [INFO ] [MAIN ] UMH: Loaded 33333 primary data records. [2025-09-22T22:27:45.485301] [DEBUG] [LOCAL ] UMC: Loaded 52731 existing records from primary storage. [2025-09-22T22:27:45.497555] [INFO ] [MAIN ] UMC: Loaded 52731 primary data records. [2025-09-22T22:27:46.246473] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:46.248223] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11798 primary records. [2025-09-22T22:27:46.248325] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-22T22:27:46.267059] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-09-22T22:27:46.267330] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-22T22:27:46.270396] [INFO ] [MAIN ] Derivative Progress: 1915/2091 symbols completed. UNF took 1.1s. Estimated remaining: 1m 8s. Rate: 154.9 symbols/min [2025-09-22T22:27:46.272796] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:46.288080] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:46.289008] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33333 primary records. [2025-09-22T22:27:46.291054] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-22T22:27:46.320827] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-09-22T22:27:46.320991] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-22T22:27:46.321311] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:46.323839] [INFO ] [MAIN ] Derivative Progress: 1916/2091 symbols completed. UMH took 1.2s. Estimated remaining: 1m 8s. Rate: 155.0 symbols/min [2025-09-22T22:27:46.324371] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:46.325404] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52731 primary records. [2025-09-22T22:27:46.325888] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-22T22:27:46.351236] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-09-22T22:27:46.351301] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-22T22:27:46.354011] [INFO ] [MAIN ] Derivative Progress: 1917/2091 symbols completed. UMC took 1.2s. Estimated remaining: 1m 7s. Rate: 155.1 symbols/min [2025-09-22T22:27:46.354366] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:46.369994] [DEBUG] [LOCAL ] UNFI: Loaded 41841 existing records from primary storage. [2025-09-22T22:27:46.370202] [INFO ] [MAIN ] UNFI: Loaded 41841 primary data records. [2025-09-22T22:27:46.730759] [DEBUG] [LOCAL ] UNH: Loaded 53794 existing records from primary storage. [2025-09-22T22:27:46.731084] [INFO ] [MAIN ] UNH: Loaded 53794 primary data records. [2025-09-22T22:27:46.861696] [DEBUG] [LOCAL ] UNM: Loaded 48738 existing records from primary storage. [2025-09-22T22:27:46.861882] [INFO ] [MAIN ] UNM: Loaded 48738 primary data records. [2025-09-22T22:27:47.384294] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:47.385421] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 41841 primary records. [2025-09-22T22:27:47.385689] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-22T22:27:47.404495] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-09-22T22:27:47.404849] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-22T22:27:47.407509] [INFO ] [MAIN ] Derivative Progress: 1918/2091 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 7s. Rate: 155.0 symbols/min [2025-09-22T22:27:47.424624] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:47.425290] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53794 primary records. [2025-09-22T22:27:47.425434] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-22T22:27:47.453721] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:47.456209] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48738 primary records. [2025-09-22T22:27:47.456772] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-09-22T22:27:47.456850] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-22T22:27:47.456910] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-22T22:27:47.459629] [INFO ] [MAIN ] Derivative Progress: 1919/2091 symbols completed. UNH took 1.1s. Estimated remaining: 1m 7s. Rate: 155.0 symbols/min [2025-09-22T22:27:47.474947] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-09-22T22:27:47.475010] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-22T22:27:47.477729] [INFO ] [MAIN ] Derivative Progress: 1920/2091 symbols completed. UNM took 1.1s. Estimated remaining: 1m 6s. Rate: 155.1 symbols/min [2025-09-22T22:27:47.478466] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:47.478901] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:47.478968] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:47.485979] [DEBUG] [LOCAL ] UNMA: Loaded 3670 existing records from primary storage. [2025-09-22T22:27:47.486134] [INFO ] [MAIN ] UNMA: Loaded 3670 primary data records. [2025-09-22T22:27:47.824614] [DEBUG] [LOCAL ] UP: Loaded 43023 existing records from primary storage. [2025-09-22T22:27:47.824945] [INFO ] [MAIN ] UP: Loaded 43023 primary data records. [2025-09-22T22:27:47.945333] [DEBUG] [LOCAL ] UNP: Loaded 53234 existing records from primary storage. [2025-09-22T22:27:47.945591] [INFO ] [MAIN ] UNP: Loaded 53234 primary data records. [2025-09-22T22:27:48.519435] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:48.521144] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3670 primary records. [2025-09-22T22:27:48.522331] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-22T22:27:48.540101] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-09-22T22:27:48.540574] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-22T22:27:48.543429] [INFO ] [MAIN ] Derivative Progress: 1921/2091 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 6s. Rate: 155.0 symbols/min [2025-09-22T22:27:48.544020] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:48.563149] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:48.563935] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43023 primary records. [2025-09-22T22:27:48.564142] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-22T22:27:48.581045] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-09-22T22:27:48.581428] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-22T22:27:48.583610] [INFO ] [MAIN ] Derivative Progress: 1922/2091 symbols completed. UP took 1.1s. Estimated remaining: 1m 5s. Rate: 155.0 symbols/min [2025-09-22T22:27:48.584074] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:48.602937] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:48.604056] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53234 primary records. [2025-09-22T22:27:48.604185] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-22T22:27:48.620845] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-09-22T22:27:48.621125] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-22T22:27:48.637267] [INFO ] [MAIN ] Derivative Progress: 1923/2091 symbols completed. UNP took 1.2s. Estimated remaining: 1m 5s. Rate: 155.1 symbols/min [2025-09-22T22:27:48.637881] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:48.675489] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-22T22:27:48.676700] [INFO ] [MAIN ] UPS: Loaded 53710 primary data records. [2025-09-22T22:27:48.688425] [DEBUG] [LOCAL ] URI: Loaded 36513 existing records from primary storage. [2025-09-22T22:27:48.698183] [INFO ] [MAIN ] URI: Loaded 36513 primary data records. [2025-09-22T22:27:48.986883] [DEBUG] [LOCAL ] USA: Loaded 36159 existing records from primary storage. [2025-09-22T22:27:49.110090] [INFO ] [MAIN ] USA: Loaded 36159 primary data records. [2025-09-22T22:27:49.693081] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:49.695609] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53710 primary records. [2025-09-22T22:27:49.696291] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-22T22:27:49.718094] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-09-22T22:27:49.719414] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-22T22:27:49.721410] [INFO ] [MAIN ] Derivative Progress: 1924/2091 symbols completed. UPS took 1.2s. Estimated remaining: 1m 5s. Rate: 155.0 symbols/min [2025-09-22T22:27:49.722344] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:49.740576] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:49.742357] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 36513 primary records. [2025-09-22T22:27:49.742694] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-22T22:27:49.813407] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-09-22T22:27:49.812449] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:49.815164] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36159 primary records. [2025-09-22T22:27:49.815479] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-22T22:27:49.815411] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-22T22:27:49.819437] [INFO ] [MAIN ] Derivative Progress: 1925/2091 symbols completed. URI took 1.2s. Estimated remaining: 1m 4s. Rate: 155.0 symbols/min [2025-09-22T22:27:49.822790] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:49.850845] [DEBUG] [LOCAL ] USAC: Loaded 22907 existing records from primary storage. [2025-09-22T22:27:49.858736] [INFO ] [MAIN ] USAC: Loaded 22907 primary data records. [2025-09-22T22:27:49.881322] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-09-22T22:27:49.881672] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-22T22:27:49.908777] [INFO ] [MAIN ] Derivative Progress: 1926/2091 symbols completed. USA took 1.3s. Estimated remaining: 1m 4s. Rate: 155.1 symbols/min [2025-09-22T22:27:49.935529] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:50.413629] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-22T22:27:50.414418] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-09-22T22:27:50.547095] [DEBUG] [LOCAL ] USFD: Loaded 51236 existing records from primary storage. [2025-09-22T22:27:50.578914] [INFO ] [MAIN ] USFD: Loaded 51236 primary data records. [2025-09-22T22:27:51.016913] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:51.034919] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 22907 primary records. [2025-09-22T22:27:51.045497] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-22T22:27:51.242846] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-09-22T22:27:51.243951] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-22T22:27:51.247179] [INFO ] [MAIN ] Derivative Progress: 1927/2091 symbols completed. USAC took 1.5s. Estimated remaining: 1m 4s. Rate: 154.9 symbols/min [2025-09-22T22:27:51.247963] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:51.277479] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:51.278495] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-09-22T22:27:51.278672] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-22T22:27:51.298272] [DEBUG] [LOCAL ] USNA: Loaded 18228 existing records from primary storage. [2025-09-22T22:27:51.305491] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-09-22T22:27:51.301372] [INFO ] [MAIN ] USNA: Loaded 18228 primary data records. [2025-09-22T22:27:51.305890] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-22T22:27:51.308309] [INFO ] [MAIN ] Derivative Progress: 1928/2091 symbols completed. USB took 1.5s. Estimated remaining: 1m 3s. Rate: 154.9 symbols/min [2025-09-22T22:27:51.354298] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:51.355079] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:51.389673] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51236 primary records. [2025-09-22T22:27:51.389783] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-22T22:27:51.474023] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-09-22T22:27:51.479454] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-22T22:27:51.496038] [INFO ] [MAIN ] Derivative Progress: 1929/2091 symbols completed. USFD took 1.6s. Estimated remaining: 1m 3s. Rate: 155.0 symbols/min [2025-09-22T22:27:51.512156] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:51.543102] [DEBUG] [LOCAL ] USPH: Loaded 16607 existing records from primary storage. [2025-09-22T22:27:51.543335] [INFO ] [MAIN ] USPH: Loaded 16607 primary data records. [2025-09-22T22:27:52.002972] [DEBUG] [LOCAL ] UTF: Loaded 28480 existing records from primary storage. [2025-09-22T22:27:52.004216] [INFO ] [MAIN ] UTF: Loaded 28480 primary data records. [2025-09-22T22:27:52.091976] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:52.098950] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 18228 primary records. [2025-09-22T22:27:52.114362] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-22T22:27:52.202961] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-09-22T22:27:52.219669] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-22T22:27:52.243948] [INFO ] [MAIN ] Derivative Progress: 1930/2091 symbols completed. USNA took 1.0s. Estimated remaining: 1m 2s. Rate: 154.9 symbols/min [2025-09-22T22:27:52.367110] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:52.388024] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:52.389570] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 16607 primary records. [2025-09-22T22:27:52.389875] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-22T22:27:52.408411] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-09-22T22:27:52.409010] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-22T22:27:52.412458] [INFO ] [MAIN ] Derivative Progress: 1931/2091 symbols completed. USPH took 1.1s. Estimated remaining: 1m 2s. Rate: 155.0 symbols/min [2025-09-22T22:27:52.412907] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:52.442940] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:52.448209] [DEBUG] [LOCAL ] UTL: Loaded 11018 existing records from primary storage. [2025-09-22T22:27:52.449188] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 28480 primary records. [2025-09-22T22:27:52.449345] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-22T22:27:52.449447] [INFO ] [MAIN ] UTL: Loaded 11018 primary data records. [2025-09-22T22:27:52.568668] [DEBUG] [LOCAL ] UTI: Loaded 40552 existing records from primary storage. [2025-09-22T22:27:52.571042] [INFO ] [MAIN ] UTI: Loaded 40552 primary data records. [2025-09-22T22:27:52.631301] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-09-22T22:27:52.743165] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-22T22:27:52.823711] [INFO ] [MAIN ] Derivative Progress: 1932/2091 symbols completed. UTF took 1.3s. Estimated remaining: 1m 2s. Rate: 155.0 symbols/min [2025-09-22T22:27:52.828263] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:53.236939] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:53.237988] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11018 primary records. [2025-09-22T22:27:53.238217] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-22T22:27:53.268672] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-09-22T22:27:53.269533] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-22T22:27:53.271888] [INFO ] [MAIN ] Derivative Progress: 1933/2091 symbols completed. UTL took 0.9s. Estimated remaining: 1m 1s. Rate: 154.9 symbols/min [2025-09-22T22:27:53.273403] [DEBUG] [LOCAL ] UTZ: Loaded 44757 existing records from primary storage. [2025-09-22T22:27:53.273787] [INFO ] [MAIN ] UTZ: Loaded 44757 primary data records. [2025-09-22T22:27:53.354339] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:53.367012] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40552 primary records. [2025-09-22T22:27:53.372224] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-22T22:27:53.502180] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-09-22T22:27:53.509767] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-22T22:27:53.551983] [INFO ] [MAIN ] Derivative Progress: 1934/2091 symbols completed. UTI took 1.2s. Estimated remaining: 1m 1s. Rate: 155.0 symbols/min [2025-09-22T22:27:53.659513] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:53.660235] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44757 primary records. [2025-09-22T22:27:53.660303] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-22T22:27:53.682379] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-09-22T22:27:53.682559] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-22T22:27:53.685311] [INFO ] [MAIN ] Derivative Progress: 1935/2091 symbols completed. UTZ took 0.9s. Estimated remaining: 1m 0s. Rate: 155.0 symbols/min [2025-09-22T22:27:53.686355] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:53.686467] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:53.686854] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:53.727103] [DEBUG] [LOCAL ] UVE: Loaded 21834 existing records from primary storage. [2025-09-22T22:27:53.734447] [DEBUG] [LOCAL ] UVV: Loaded 22336 existing records from primary storage. [2025-09-22T22:27:53.734524] [INFO ] [MAIN ] UVE: Loaded 21834 primary data records. [2025-09-22T22:27:53.734731] [INFO ] [MAIN ] UVV: Loaded 22336 primary data records. [2025-09-22T22:27:54.109216] [DEBUG] [LOCAL ] UWMC: Loaded 52726 existing records from primary storage. [2025-09-22T22:27:54.139278] [INFO ] [MAIN ] UWMC: Loaded 52726 primary data records. [2025-09-22T22:27:54.805243] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:54.818785] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22336 primary records. [2025-09-22T22:27:54.819316] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-22T22:27:54.821131] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:54.833774] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21834 primary records. [2025-09-22T22:27:54.834141] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-22T22:27:54.854980] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-09-22T22:27:54.856596] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-22T22:27:54.859678] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-09-22T22:27:54.859179] [INFO ] [MAIN ] Derivative Progress: 1936/2091 symbols completed. UVE took 1.2s. Estimated remaining: 1m 0s. Rate: 154.9 symbols/min [2025-09-22T22:27:54.860051] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-22T22:27:54.862572] [INFO ] [MAIN ] Derivative Progress: 1937/2091 symbols completed. UVV took 1.2s. Estimated remaining: 59.6s. Rate: 154.9 symbols/min [2025-09-22T22:27:54.863017] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:54.863441] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:54.884968] [DEBUG] [LOCAL ] UZD: Loaded 6314 existing records from primary storage. [2025-09-22T22:27:54.888740] [DEBUG] [LOCAL ] UZE: Loaded 7454 existing records from primary storage. [2025-09-22T22:27:54.893834] [INFO ] [MAIN ] UZE: Loaded 7454 primary data records. [2025-09-22T22:27:54.894019] [INFO ] [MAIN ] UZD: Loaded 6314 primary data records. [2025-09-22T22:27:54.894382] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:54.938752] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52726 primary records. [2025-09-22T22:27:54.999382] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-22T22:27:55.549289] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-09-22T22:27:55.554967] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-22T22:27:55.557376] [INFO ] [MAIN ] Derivative Progress: 1938/2091 symbols completed. UWMC took 1.9s. Estimated remaining: 59.3s. Rate: 154.9 symbols/min [2025-09-22T22:27:55.568393] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:55.582215] [DEBUG] [LOCAL ] UZF: Loaded 6456 existing records from primary storage. [2025-09-22T22:27:55.582408] [INFO ] [MAIN ] UZF: Loaded 6456 primary data records. [2025-09-22T22:27:55.933535] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:27:55.935288] [INFO ] [MAIN ] UZE: Generated 1793 derivative records from 7454 primary records. [2025-09-22T22:27:55.934389] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:27:55.935515] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-22T22:27:55.936508] [INFO ] [MAIN ] UZD: Generated 1793 derivative records from 6314 primary records. [2025-09-22T22:27:55.938197] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-22T22:27:55.977821] [DEBUG] [LOCAL ] UZE: Derivative data saved (1793 records). [2025-09-22T22:27:55.978155] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-22T22:27:55.977963] [DEBUG] [LOCAL ] UZD: Derivative data saved (1793 records). [2025-09-22T22:27:55.981236] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-22T22:27:55.980959] [INFO ] [MAIN ] Derivative Progress: 1939/2091 symbols completed. UZE took 1.1s. Estimated remaining: 58.9s. Rate: 154.9 symbols/min [2025-09-22T22:27:55.986877] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:55.987169] [INFO ] [MAIN ] Derivative Progress: 1940/2091 symbols completed. UZD took 1.1s. Estimated remaining: 58.5s. Rate: 154.9 symbols/min [2025-09-22T22:27:55.988144] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:56.007529] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:27:56.008359] [INFO ] [MAIN ] UZF: Generated 1793 derivative records from 6456 primary records. [2025-09-22T22:27:56.008573] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-22T22:27:56.024332] [DEBUG] [LOCAL ] UZF: Derivative data saved (1793 records). [2025-09-22T22:27:56.024399] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-22T22:27:56.027168] [INFO ] [MAIN ] Derivative Progress: 1941/2091 symbols completed. UZF took 0.5s. Estimated remaining: 58.1s. Rate: 155.0 symbols/min [2025-09-22T22:27:56.027403] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:56.055096] [DEBUG] [LOCAL ] VAC: Loaded 34656 existing records from primary storage. [2025-09-22T22:27:56.055314] [INFO ] [MAIN ] VAC: Loaded 34656 primary data records. [2025-09-22T22:27:56.255011] [DEBUG] [LOCAL ] V: Loaded 53763 existing records from primary storage. [2025-09-22T22:27:56.271672] [INFO ] [MAIN ] V: Loaded 53763 primary data records. [2025-09-22T22:27:56.506694] [DEBUG] [LOCAL ] VAL: Loaded 50453 existing records from primary storage. [2025-09-22T22:27:56.531062] [INFO ] [MAIN ] VAL: Loaded 50453 primary data records. [2025-09-22T22:27:57.161666] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:57.162871] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34656 primary records. [2025-09-22T22:27:57.163068] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-22T22:27:57.186420] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-09-22T22:27:57.186560] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-22T22:27:57.189810] [INFO ] [MAIN ] Derivative Progress: 1942/2091 symbols completed. VAC took 1.2s. Estimated remaining: 57.7s. Rate: 154.9 symbols/min [2025-09-22T22:27:57.190088] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:57.205131] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:57.218976] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53763 primary records. [2025-09-22T22:27:57.219154] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-22T22:27:57.220433] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:57.221372] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50453 primary records. [2025-09-22T22:27:57.221727] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-22T22:27:57.254485] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-09-22T22:27:57.255550] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-22T22:27:57.255434] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-09-22T22:27:57.257752] [INFO ] [MAIN ] Derivative Progress: 1943/2091 symbols completed. V took 1.3s. Estimated remaining: 57.3s. Rate: 154.9 symbols/min [2025-09-22T22:27:57.258165] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-22T22:27:57.258347] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:57.261083] [INFO ] [MAIN ] Derivative Progress: 1944/2091 symbols completed. VAL took 1.2s. Estimated remaining: 56.9s. Rate: 155.0 symbols/min [2025-09-22T22:27:57.261858] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:57.283853] [DEBUG] [LOCAL ] VATE: Loaded 5717 existing records from primary storage. [2025-09-22T22:27:57.284104] [INFO ] [MAIN ] VATE: Loaded 5717 primary data records. [2025-09-22T22:27:57.422767] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-22T22:27:57.421730] [DEBUG] [LOCAL ] VBF: Loaded 7121 existing records from primary storage. [2025-09-22T22:27:57.423085] [INFO ] [MAIN ] VALE: Loaded 53694 primary data records. [2025-09-22T22:27:57.423026] [INFO ] [MAIN ] VBF: Loaded 7121 primary data records. [2025-09-22T22:27:58.318054] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:58.319303] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5717 primary records. [2025-09-22T22:27:58.319702] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-22T22:27:58.350842] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:58.352152] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7121 primary records. [2025-09-22T22:27:58.352471] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-22T22:27:58.380119] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:58.381688] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-09-22T22:27:58.383317] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53694 primary records. [2025-09-22T22:27:58.383956] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-22T22:27:58.382457] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-22T22:27:58.388887] [INFO ] [MAIN ] Derivative Progress: 1945/2091 symbols completed. VATE took 1.1s. Estimated remaining: 56.6s. Rate: 154.8 symbols/min [2025-09-22T22:27:58.390841] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:58.404844] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-09-22T22:27:58.410004] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-09-22T22:27:58.408208] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-22T22:27:58.412541] [INFO ] [MAIN ] Derivative Progress: 1946/2091 symbols completed. VBF took 1.2s. Estimated remaining: 56.2s. Rate: 154.9 symbols/min [2025-09-22T22:27:58.412626] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-22T22:27:58.415839] [INFO ] [MAIN ] Derivative Progress: 1947/2091 symbols completed. VALE took 1.2s. Estimated remaining: 55.7s. Rate: 155.0 symbols/min [2025-09-22T22:27:58.415993] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:58.416330] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:58.432351] [DEBUG] [LOCAL ] VCV: Loaded 13355 existing records from primary storage. [2025-09-22T22:27:58.436482] [INFO ] [MAIN ] VCV: Loaded 13355 primary data records. [2025-09-22T22:27:58.526638] [DEBUG] [LOCAL ] VEL: Loaded 13060 existing records from primary storage. [2025-09-22T22:27:58.561960] [INFO ] [MAIN ] VEL: Loaded 13060 primary data records. [2025-09-22T22:27:58.779826] [DEBUG] [LOCAL ] VEEV: Loaded 47404 existing records from primary storage. [2025-09-22T22:27:58.789681] [INFO ] [MAIN ] VEEV: Loaded 47404 primary data records. [2025-09-22T22:27:59.483912] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:59.487696] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13355 primary records. [2025-09-22T22:27:59.487818] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-22T22:27:59.515705] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:59.517156] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 13060 primary records. [2025-09-22T22:27:59.517800] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-22T22:27:59.535897] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-09-22T22:27:59.536262] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-22T22:27:59.538506] [INFO ] [MAIN ] Derivative Progress: 1948/2091 symbols completed. VEL took 1.1s. Estimated remaining: 55.4s. Rate: 154.8 symbols/min [2025-09-22T22:27:59.541957] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-09-22T22:27:59.542861] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-22T22:27:59.545054] [INFO ] [MAIN ] Derivative Progress: 1949/2091 symbols completed. VCV took 1.2s. Estimated remaining: 55.0s. Rate: 154.9 symbols/min [2025-09-22T22:27:59.557935] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:27:59.558481] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47404 primary records. [2025-09-22T22:27:59.558541] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-22T22:27:59.574478] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-09-22T22:27:59.574543] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-22T22:27:59.577022] [INFO ] [MAIN ] Derivative Progress: 1950/2091 symbols completed. VEEV took 1.2s. Estimated remaining: 54.6s. Rate: 155.0 symbols/min [2025-09-22T22:27:59.577816] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:59.577926] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:59.577993] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:27:59.585967] [DEBUG] [LOCAL ] VGI: Loaded 5195 existing records from primary storage. [2025-09-22T22:27:59.586108] [INFO ] [MAIN ] VGI: Loaded 5195 primary data records. [2025-09-22T22:27:59.936220] [DEBUG] [LOCAL ] VET: Loaded 44141 existing records from primary storage. [2025-09-22T22:27:59.936821] [INFO ] [MAIN ] VET: Loaded 44141 primary data records. [2025-09-22T22:28:00.081793] [DEBUG] [LOCAL ] VFC: Loaded 53611 existing records from primary storage. [2025-09-22T22:28:00.108449] [INFO ] [MAIN ] VFC: Loaded 53611 primary data records. [2025-09-22T22:28:00.459598] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:00.468081] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5195 primary records. [2025-09-22T22:28:00.468185] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-22T22:28:00.605221] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-09-22T22:28:00.605597] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-22T22:28:00.608023] [INFO ] [MAIN ] Derivative Progress: 1951/2091 symbols completed. VGI took 1.0s. Estimated remaining: 54.2s. Rate: 154.9 symbols/min [2025-09-22T22:28:00.609935] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:00.626074] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:00.626996] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44141 primary records. [2025-09-22T22:28:00.627198] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-22T22:28:00.643399] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-09-22T22:28:00.643564] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-22T22:28:00.646523] [INFO ] [MAIN ] Derivative Progress: 1952/2091 symbols completed. VET took 1.1s. Estimated remaining: 53.8s. Rate: 154.9 symbols/min [2025-09-22T22:28:00.651715] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:00.677435] [DEBUG] [LOCAL ] VGM: Loaded 18209 existing records from primary storage. [2025-09-22T22:28:00.678321] [DEBUG] [LOCAL ] VHI: Loaded 2896 existing records from primary storage. [2025-09-22T22:28:00.678151] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:00.678490] [INFO ] [MAIN ] VGM: Loaded 18209 primary data records. [2025-09-22T22:28:00.679207] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53611 primary records. [2025-09-22T22:28:00.679412] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-22T22:28:00.690799] [INFO ] [MAIN ] VHI: Loaded 2896 primary data records. [2025-09-22T22:28:00.842520] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-09-22T22:28:00.854225] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-22T22:28:00.898347] [INFO ] [MAIN ] Derivative Progress: 1953/2091 symbols completed. VFC took 1.3s. Estimated remaining: 53.4s. Rate: 155.0 symbols/min [2025-09-22T22:28:00.917833] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:01.405748] [DEBUG] [LOCAL ] VICI: Loaded 53649 existing records from primary storage. [2025-09-22T22:28:01.406417] [INFO ] [MAIN ] VICI: Loaded 53649 primary data records. [2025-09-22T22:28:01.626688] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:28:01.740413] [INFO ] [MAIN ] VHI: Generated 1793 derivative records from 2896 primary records. [2025-09-22T22:28:01.750355] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-22T22:28:01.750254] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:01.751318] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18209 primary records. [2025-09-22T22:28:01.752237] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-22T22:28:01.785239] [DEBUG] [LOCAL ] VHI: Derivative data saved (1793 records). [2025-09-22T22:28:01.787919] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-22T22:28:01.791240] [INFO ] [MAIN ] Derivative Progress: 1954/2091 symbols completed. VHI took 1.1s. Estimated remaining: 53.1s. Rate: 154.9 symbols/min [2025-09-22T22:28:01.793103] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:01.796350] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-09-22T22:28:01.796829] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-22T22:28:01.798873] [INFO ] [MAIN ] Derivative Progress: 1955/2091 symbols completed. VGM took 1.2s. Estimated remaining: 52.7s. Rate: 154.9 symbols/min [2025-09-22T22:28:01.799220] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:01.833580] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:01.834536] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53649 primary records. [2025-09-22T22:28:01.834712] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-22T22:28:01.852809] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-09-22T22:28:01.866185] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-22T22:28:01.868696] [INFO ] [MAIN ] Derivative Progress: 1956/2091 symbols completed. VICI took 1.0s. Estimated remaining: 52.3s. Rate: 155.0 symbols/min [2025-09-22T22:28:01.869211] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:01.903184] [DEBUG] [LOCAL ] VIPS: Loaded 51368 existing records from primary storage. [2025-09-22T22:28:01.903916] [INFO ] [MAIN ] VIPS: Loaded 51368 primary data records. [2025-09-22T22:28:01.999169] [DEBUG] [LOCAL ] VIK: Loaded 52512 existing records from primary storage. [2025-09-22T22:28:02.041628] [INFO ] [MAIN ] VIK: Loaded 52512 primary data records. [2025-09-22T22:28:02.381998] [DEBUG] [LOCAL ] VIRT: Loaded 46913 existing records from primary storage. [2025-09-22T22:28:02.393326] [INFO ] [MAIN ] VIRT: Loaded 46913 primary data records. [2025-09-22T22:28:03.003665] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:03.004485] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51368 primary records. [2025-09-22T22:28:03.004825] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-22T22:28:03.035614] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:03.037077] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52512 primary records. [2025-09-22T22:28:03.037300] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-22T22:28:03.055699] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-09-22T22:28:03.057616] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-09-22T22:28:03.059266] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-22T22:28:03.061283] [INFO ] [MAIN ] Derivative Progress: 1957/2091 symbols completed. VIK took 1.3s. Estimated remaining: 51.9s. Rate: 154.8 symbols/min [2025-09-22T22:28:03.059217] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-22T22:28:03.063718] [INFO ] [MAIN ] Derivative Progress: 1958/2091 symbols completed. VIPS took 1.3s. Estimated remaining: 51.5s. Rate: 154.9 symbols/min [2025-09-22T22:28:03.063934] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:03.064076] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:03.078872] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:03.079680] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46913 primary records. [2025-09-22T22:28:03.079783] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-22T22:28:03.096330] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-09-22T22:28:03.096451] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-22T22:28:03.098918] [INFO ] [MAIN ] Derivative Progress: 1959/2091 symbols completed. VIRT took 1.2s. Estimated remaining: 51.1s. Rate: 155.0 symbols/min [2025-09-22T22:28:03.099288] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:03.143047] [DEBUG] [LOCAL ] VKQ: Loaded 17382 existing records from primary storage. [2025-09-22T22:28:03.143324] [INFO ] [MAIN ] VKQ: Loaded 17382 primary data records. [2025-09-22T22:28:03.254005] [DEBUG] [LOCAL ] VIV: Loaded 45285 existing records from primary storage. [2025-09-22T22:28:03.266911] [INFO ] [MAIN ] VIV: Loaded 45285 primary data records. [2025-09-22T22:28:03.266731] [DEBUG] [LOCAL ] VIST: Loaded 45968 existing records from primary storage. [2025-09-22T22:28:03.278454] [INFO ] [MAIN ] VIST: Loaded 45968 primary data records. [2025-09-22T22:28:04.163890] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:04.164859] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17382 primary records. [2025-09-22T22:28:04.165971] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-22T22:28:04.180699] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:04.181422] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 45968 primary records. [2025-09-22T22:28:04.181521] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-22T22:28:04.224070] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-09-22T22:28:04.218850] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:04.225426] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-22T22:28:04.225356] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 45285 primary records. [2025-09-22T22:28:04.226085] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-09-22T22:28:04.227917] [INFO ] [MAIN ] Derivative Progress: 1960/2091 symbols completed. VKQ took 1.1s. Estimated remaining: 50.8s. Rate: 154.8 symbols/min [2025-09-22T22:28:04.228445] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:04.228128] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-22T22:28:04.228378] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-22T22:28:04.231738] [INFO ] [MAIN ] Derivative Progress: 1961/2091 symbols completed. VIST took 1.2s. Estimated remaining: 50.3s. Rate: 154.9 symbols/min [2025-09-22T22:28:04.240341] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:04.249076] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-09-22T22:28:04.249333] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-22T22:28:04.251893] [INFO ] [MAIN ] Derivative Progress: 1962/2091 symbols completed. VIV took 1.2s. Estimated remaining: 49.9s. Rate: 155.0 symbols/min [2025-09-22T22:28:04.252243] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:04.277133] [DEBUG] [LOCAL ] VLN: Loaded 28348 existing records from primary storage. [2025-09-22T22:28:04.277350] [INFO ] [MAIN ] VLN: Loaded 28348 primary data records. [2025-09-22T22:28:04.498708] [DEBUG] [LOCAL ] VLRS: Loaded 40969 existing records from primary storage. [2025-09-22T22:28:04.618388] [INFO ] [MAIN ] VLRS: Loaded 40969 primary data records. [2025-09-22T22:28:04.624431] [DEBUG] [LOCAL ] VLO: Loaded 53088 existing records from primary storage. [2025-09-22T22:28:04.633422] [INFO ] [MAIN ] VLO: Loaded 53088 primary data records. [2025-09-22T22:28:05.337909] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:05.340201] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 28348 primary records. [2025-09-22T22:28:05.340763] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-22T22:28:05.361920] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-09-22T22:28:05.362301] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-22T22:28:05.364781] [INFO ] [MAIN ] Derivative Progress: 1963/2091 symbols completed. VLN took 1.1s. Estimated remaining: 49.6s. Rate: 154.8 symbols/min [2025-09-22T22:28:05.387726] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:05.402543] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53088 primary records. [2025-09-22T22:28:05.402964] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:05.403167] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-22T22:28:05.404014] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 40969 primary records. [2025-09-22T22:28:05.404470] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-22T22:28:05.437828] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-09-22T22:28:05.437930] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-09-22T22:28:05.438165] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-22T22:28:05.438261] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-22T22:28:05.440215] [INFO ] [MAIN ] Derivative Progress: 1964/2091 symbols completed. VLO took 1.2s. Estimated remaining: 49.2s. Rate: 154.9 symbols/min [2025-09-22T22:28:05.443396] [INFO ] [MAIN ] Derivative Progress: 1965/2091 symbols completed. VLRS took 1.2s. Estimated remaining: 48.8s. Rate: 155.0 symbols/min [2025-09-22T22:28:05.444443] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:05.444557] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:05.444629] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:05.455294] [DEBUG] [LOCAL ] VLT: Loaded 4646 existing records from primary storage. [2025-09-22T22:28:05.455475] [INFO ] [MAIN ] VLT: Loaded 4646 primary data records. [2025-09-22T22:28:05.698365] [DEBUG] [LOCAL ] VMC: Loaded 43852 existing records from primary storage. [2025-09-22T22:28:05.699400] [INFO ] [MAIN ] VMC: Loaded 43852 primary data records. [2025-09-22T22:28:05.922193] [DEBUG] [LOCAL ] VLTO: Loaded 46032 existing records from primary storage. [2025-09-22T22:28:05.947844] [INFO ] [MAIN ] VLTO: Loaded 46032 primary data records. [2025-09-22T22:28:06.502244] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:06.504093] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4646 primary records. [2025-09-22T22:28:06.504312] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-22T22:28:06.523093] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-09-22T22:28:06.523963] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-22T22:28:06.526986] [INFO ] [MAIN ] Derivative Progress: 1966/2091 symbols completed. VLT took 1.1s. Estimated remaining: 48.4s. Rate: 154.8 symbols/min [2025-09-22T22:28:06.527683] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:06.545921] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:06.547039] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 43852 primary records. [2025-09-22T22:28:06.551379] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-22T22:28:06.576671] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-09-22T22:28:06.577120] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-22T22:28:06.580032] [INFO ] [MAIN ] Derivative Progress: 1967/2091 symbols completed. VMC took 1.1s. Estimated remaining: 48.0s. Rate: 154.9 symbols/min [2025-09-22T22:28:06.577495] [DEBUG] [LOCAL ] VMI: Loaded 15479 existing records from primary storage. [2025-09-22T22:28:06.580715] [INFO ] [MAIN ] VMI: Loaded 15479 primary data records. [2025-09-22T22:28:06.593526] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:06.594512] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:06.627735] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46032 primary records. [2025-09-22T22:28:06.662155] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-22T22:28:06.923456] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-09-22T22:28:06.932278] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-22T22:28:06.935186] [INFO ] [MAIN ] Derivative Progress: 1968/2091 symbols completed. VLTO took 1.5s. Estimated remaining: 47.6s. Rate: 154.9 symbols/min [2025-09-22T22:28:06.935739] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:06.946727] [DEBUG] [LOCAL ] VMO: Loaded 21015 existing records from primary storage. [2025-09-22T22:28:06.948443] [INFO ] [MAIN ] VMO: Loaded 21015 primary data records. [2025-09-22T22:28:07.001625] [DEBUG] [LOCAL ] VNCE: Loaded 6885 existing records from primary storage. [2025-09-22T22:28:07.017822] [INFO ] [MAIN ] VNCE: Loaded 6885 primary data records. [2025-09-22T22:28:07.590245] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:28:07.591380] [INFO ] [MAIN ] VMI: Generated 1793 derivative records from 15479 primary records. [2025-09-22T22:28:07.708305] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-22T22:28:07.741094] [DEBUG] [LOCAL ] VMI: Derivative data saved (1793 records). [2025-09-22T22:28:07.742288] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-22T22:28:07.744529] [INFO ] [MAIN ] Derivative Progress: 1969/2091 symbols completed. VMI took 1.2s. Estimated remaining: 47.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:07.745309] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:07.772771] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:07.776735] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 21015 primary records. [2025-09-22T22:28:07.776998] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-22T22:28:07.804497] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:07.808810] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 6885 primary records. [2025-09-22T22:28:07.811304] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-22T22:28:07.825359] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-09-22T22:28:07.826037] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-22T22:28:07.829364] [INFO ] [MAIN ] Derivative Progress: 1970/2091 symbols completed. VMO took 1.2s. Estimated remaining: 46.9s. Rate: 154.9 symbols/min [2025-09-22T22:28:07.835969] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:07.847901] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-09-22T22:28:07.848212] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-22T22:28:07.851030] [INFO ] [MAIN ] Derivative Progress: 1971/2091 symbols completed. VNCE took 0.9s. Estimated remaining: 46.5s. Rate: 155.0 symbols/min [2025-09-22T22:28:07.852304] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:07.867379] [DEBUG] [LOCAL ] VNO: Loaded 48973 existing records from primary storage. [2025-09-22T22:28:07.867696] [INFO ] [MAIN ] VNO: Loaded 48973 primary data records. [2025-09-22T22:28:07.979324] [DEBUG] [LOCAL ] VOC: Loaded 8930 existing records from primary storage. [2025-09-22T22:28:07.983028] [INFO ] [MAIN ] VOC: Loaded 8930 primary data records. [2025-09-22T22:28:08.322918] [DEBUG] [LOCAL ] VNT: Loaded 44081 existing records from primary storage. [2025-09-22T22:28:08.345489] [INFO ] [MAIN ] VNT: Loaded 44081 primary data records. [2025-09-22T22:28:08.909219] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:08.911443] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48973 primary records. [2025-09-22T22:28:08.911544] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-22T22:28:08.933513] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-09-22T22:28:08.946621] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-22T22:28:08.949567] [INFO ] [MAIN ] Derivative Progress: 1972/2091 symbols completed. VNO took 1.2s. Estimated remaining: 46.1s. Rate: 154.8 symbols/min [2025-09-22T22:28:08.947309] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:08.950478] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:08.951912] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8930 primary records. [2025-09-22T22:28:08.952276] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-22T22:28:08.969905] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-09-22T22:28:08.970079] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-22T22:28:08.972483] [INFO ] [MAIN ] Derivative Progress: 1973/2091 symbols completed. VOC took 1.1s. Estimated remaining: 45.7s. Rate: 154.9 symbols/min [2025-09-22T22:28:08.973092] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:08.991141] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:08.992132] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 44081 primary records. [2025-09-22T22:28:08.992375] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-22T22:28:09.014314] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-09-22T22:28:09.024492] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-22T22:28:09.028527] [INFO ] [MAIN ] Derivative Progress: 1974/2091 symbols completed. VNT took 1.2s. Estimated remaining: 45.3s. Rate: 155.0 symbols/min [2025-09-22T22:28:09.029079] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:09.037253] [DEBUG] [LOCAL ] VPG: Loaded 17204 existing records from primary storage. [2025-09-22T22:28:09.037434] [INFO ] [MAIN ] VPG: Loaded 17204 primary data records. [2025-09-22T22:28:09.136057] [DEBUG] [LOCAL ] VOYA: Loaded 42881 existing records from primary storage. [2025-09-22T22:28:09.160237] [INFO ] [MAIN ] VOYA: Loaded 42881 primary data records. [2025-09-22T22:28:09.212284] [DEBUG] [LOCAL ] VPV: Loaded 5379 existing records from primary storage. [2025-09-22T22:28:09.228861] [INFO ] [MAIN ] VPV: Loaded 5379 primary data records. [2025-09-22T22:28:10.089429] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:10.091138] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17204 primary records. [2025-09-22T22:28:10.091555] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-22T22:28:10.110462] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-09-22T22:28:10.111035] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-22T22:28:10.113169] [INFO ] [MAIN ] Derivative Progress: 1975/2091 symbols completed. VPG took 1.1s. Estimated remaining: 45.0s. Rate: 154.8 symbols/min [2025-09-22T22:28:10.113611] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:10.136895] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:10.156277] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42881 primary records. [2025-09-22T22:28:10.156693] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-22T22:28:10.157774] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:10.159530] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5379 primary records. [2025-09-22T22:28:10.166968] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-22T22:28:10.176863] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-09-22T22:28:10.186084] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-22T22:28:10.189464] [INFO ] [MAIN ] Derivative Progress: 1976/2091 symbols completed. VOYA took 1.2s. Estimated remaining: 44.5s. Rate: 154.9 symbols/min [2025-09-22T22:28:10.204960] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-09-22T22:28:10.205464] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-22T22:28:10.208691] [INFO ] [MAIN ] Derivative Progress: 1977/2091 symbols completed. VPV took 1.2s. Estimated remaining: 44.1s. Rate: 155.0 symbols/min [2025-09-22T22:28:10.205309] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:10.210323] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:10.222273] [DEBUG] [LOCAL ] VRE: Loaded 34931 existing records from primary storage. [2025-09-22T22:28:10.222857] [INFO ] [MAIN ] VRE: Loaded 34931 primary data records. [2025-09-22T22:28:10.347962] [DEBUG] [LOCAL ] VRTS: Loaded 9065 existing records from primary storage. [2025-09-22T22:28:10.363855] [INFO ] [MAIN ] VRTS: Loaded 9065 primary data records. [2025-09-22T22:28:10.727958] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-22T22:28:10.738941] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-09-22T22:28:11.351686] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:11.353420] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 34931 primary records. [2025-09-22T22:28:11.353526] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-22T22:28:11.372994] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-09-22T22:28:11.374056] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-22T22:28:11.376528] [INFO ] [MAIN ] Derivative Progress: 1978/2091 symbols completed. VRE took 1.3s. Estimated remaining: 43.8s. Rate: 154.8 symbols/min [2025-09-22T22:28:11.401096] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:11.405336] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9065 primary records. [2025-09-22T22:28:11.406005] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-22T22:28:11.419936] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:11.421312] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-09-22T22:28:11.421397] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-22T22:28:11.457786] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-09-22T22:28:11.456670] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-09-22T22:28:11.458157] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-22T22:28:11.458296] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-22T22:28:11.461193] [INFO ] [MAIN ] Derivative Progress: 1979/2091 symbols completed. VRT took 1.3s. Estimated remaining: 43.4s. Rate: 154.9 symbols/min [2025-09-22T22:28:11.464875] [INFO ] [MAIN ] Derivative Progress: 1980/2091 symbols completed. VRTS took 1.3s. Estimated remaining: 43.0s. Rate: 154.9 symbols/min [2025-09-22T22:28:11.465897] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:11.466332] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:11.466232] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:11.557583] [DEBUG] [LOCAL ] VSCO: Loaded 52886 existing records from primary storage. [2025-09-22T22:28:11.559051] [INFO ] [MAIN ] VSCO: Loaded 52886 primary data records. [2025-09-22T22:28:11.572129] [DEBUG] [LOCAL ] VSH: Loaded 48666 existing records from primary storage. [2025-09-22T22:28:11.588030] [INFO ] [MAIN ] VSH: Loaded 48666 primary data records. [2025-09-22T22:28:11.775784] [DEBUG] [LOCAL ] VST: Loaded 53720 existing records from primary storage. [2025-09-22T22:28:11.806680] [INFO ] [MAIN ] VST: Loaded 53720 primary data records. [2025-09-22T22:28:12.596500] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:12.611486] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52886 primary records. [2025-09-22T22:28:12.612376] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-22T22:28:12.612872] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:12.616206] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48666 primary records. [2025-09-22T22:28:12.623808] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-22T22:28:12.665926] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:12.666791] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-09-22T22:28:12.666911] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-22T22:28:12.667731] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53720 primary records. [2025-09-22T22:28:12.668394] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-09-22T22:28:12.668613] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-22T22:28:12.670755] [INFO ] [MAIN ] Derivative Progress: 1981/2091 symbols completed. VSH took 1.2s. Estimated remaining: 42.6s. Rate: 154.8 symbols/min [2025-09-22T22:28:12.668923] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-22T22:28:12.675902] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:12.680527] [INFO ] [MAIN ] Derivative Progress: 1982/2091 symbols completed. VSCO took 1.2s. Estimated remaining: 42.2s. Rate: 154.9 symbols/min [2025-09-22T22:28:12.689309] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:12.701517] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-09-22T22:28:12.701720] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-22T22:28:12.705556] [INFO ] [MAIN ] Derivative Progress: 1983/2091 symbols completed. VST took 1.2s. Estimated remaining: 41.8s. Rate: 154.9 symbols/min [2025-09-22T22:28:12.706022] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:12.773294] [DEBUG] [LOCAL ] VSTS: Loaded 49035 existing records from primary storage. [2025-09-22T22:28:12.775044] [INFO ] [MAIN ] VSTS: Loaded 49035 primary data records. [2025-09-22T22:28:12.781053] [DEBUG] [LOCAL ] VTEX: Loaded 43377 existing records from primary storage. [2025-09-22T22:28:12.800612] [INFO ] [MAIN ] VTEX: Loaded 43377 primary data records. [2025-09-22T22:28:13.070997] [DEBUG] [LOCAL ] VTLE: Loaded 48615 existing records from primary storage. [2025-09-22T22:28:13.134704] [INFO ] [MAIN ] VTLE: Loaded 48615 primary data records. [2025-09-22T22:28:13.858548] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:13.859788] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 49035 primary records. [2025-09-22T22:28:13.860028] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-22T22:28:13.889184] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-09-22T22:28:13.884953] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:13.889431] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-22T22:28:13.890279] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43377 primary records. [2025-09-22T22:28:13.890967] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-22T22:28:13.894843] [INFO ] [MAIN ] Derivative Progress: 1984/2091 symbols completed. VSTS took 1.2s. Estimated remaining: 41.5s. Rate: 154.8 symbols/min [2025-09-22T22:28:13.912070] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-09-22T22:28:13.912713] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:13.921030] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-22T22:28:13.929188] [INFO ] [MAIN ] Derivative Progress: 1985/2091 symbols completed. VTEX took 1.2s. Estimated remaining: 41.1s. Rate: 154.8 symbols/min [2025-09-22T22:28:13.930597] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:13.930286] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:13.936696] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48615 primary records. [2025-09-22T22:28:13.936999] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-22T22:28:13.954447] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-09-22T22:28:13.954587] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-22T22:28:13.957789] [INFO ] [MAIN ] Derivative Progress: 1986/2091 symbols completed. VTLE took 1.3s. Estimated remaining: 40.7s. Rate: 154.9 symbols/min [2025-09-22T22:28:13.964893] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:13.989406] [DEBUG] [LOCAL ] VTMX: Loaded 17377 existing records from primary storage. [2025-09-22T22:28:13.990053] [DEBUG] [LOCAL ] VTOL: Loaded 19716 existing records from primary storage. [2025-09-22T22:28:13.990447] [INFO ] [MAIN ] VTMX: Loaded 17377 primary data records. [2025-09-22T22:28:13.990566] [INFO ] [MAIN ] VTOL: Loaded 19716 primary data records. [2025-09-22T22:28:14.402676] [DEBUG] [LOCAL ] VTR: Loaded 52838 existing records from primary storage. [2025-09-22T22:28:14.520492] [INFO ] [MAIN ] VTR: Loaded 52838 primary data records. [2025-09-22T22:28:15.075284] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:15.076416] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19716 primary records. [2025-09-22T22:28:15.076551] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-22T22:28:15.097535] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-09-22T22:28:15.109691] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-22T22:28:15.111788] [INFO ] [MAIN ] Derivative Progress: 1987/2091 symbols completed. VTOL took 1.2s. Estimated remaining: 40.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:15.112387] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:15.113790] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:15.113696] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17377 primary records. [2025-09-22T22:28:15.113946] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-22T22:28:15.147537] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-09-22T22:28:15.147990] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-22T22:28:15.147807] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:15.150287] [INFO ] [MAIN ] Derivative Progress: 1988/2091 symbols completed. VTMX took 1.2s. Estimated remaining: 39.9s. Rate: 154.8 symbols/min [2025-09-22T22:28:15.151239] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52838 primary records. [2025-09-22T22:28:15.151446] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-22T22:28:15.151731] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:15.177020] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-09-22T22:28:15.185760] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-22T22:28:15.189715] [INFO ] [MAIN ] Derivative Progress: 1989/2091 symbols completed. VTR took 1.2s. Estimated remaining: 39.5s. Rate: 154.9 symbols/min [2025-09-22T22:28:15.190102] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:15.191289] [DEBUG] [LOCAL ] VTS: Loaded 30465 existing records from primary storage. [2025-09-22T22:28:15.191572] [INFO ] [MAIN ] VTS: Loaded 30465 primary data records. [2025-09-22T22:28:15.422741] [DEBUG] [LOCAL ] VVR: Loaded 30316 existing records from primary storage. [2025-09-22T22:28:15.423011] [INFO ] [MAIN ] VVR: Loaded 30316 primary data records. [2025-09-22T22:28:15.683861] [DEBUG] [LOCAL ] VVV: Loaded 50212 existing records from primary storage. [2025-09-22T22:28:15.690111] [INFO ] [MAIN ] VVV: Loaded 50212 primary data records. [2025-09-22T22:28:16.270415] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:16.271636] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30465 primary records. [2025-09-22T22:28:16.271863] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-22T22:28:16.291001] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-09-22T22:28:16.292252] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-22T22:28:16.294823] [INFO ] [MAIN ] Derivative Progress: 1990/2091 symbols completed. VTS took 1.2s. Estimated remaining: 39.2s. Rate: 154.8 symbols/min [2025-09-22T22:28:16.295428] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:16.312973] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:16.314077] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 30316 primary records. [2025-09-22T22:28:16.314306] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-22T22:28:16.361832] [DEBUG] [LOCAL ] VVX: Loaded 23361 existing records from primary storage. [2025-09-22T22:28:16.361079] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:16.362978] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50212 primary records. [2025-09-22T22:28:16.363624] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-09-22T22:28:16.363321] [INFO ] [MAIN ] VVX: Loaded 23361 primary data records. [2025-09-22T22:28:16.363942] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-22T22:28:16.371290] [INFO ] [MAIN ] Derivative Progress: 1991/2091 symbols completed. VVR took 1.2s. Estimated remaining: 38.8s. Rate: 154.8 symbols/min [2025-09-22T22:28:16.369142] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-22T22:28:16.389670] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:16.477187] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-09-22T22:28:16.492601] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-22T22:28:16.499115] [INFO ] [MAIN ] Derivative Progress: 1992/2091 symbols completed. VVV took 1.3s. Estimated remaining: 38.4s. Rate: 154.9 symbols/min [2025-09-22T22:28:16.505769] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:16.738620] [DEBUG] [LOCAL ] VYX: Loaded 49112 existing records from primary storage. [2025-09-22T22:28:16.738888] [INFO ] [MAIN ] VYX: Loaded 49112 primary data records. [2025-09-22T22:28:17.086902] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-22T22:28:17.087969] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-09-22T22:28:17.256356] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:17.293909] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23361 primary records. [2025-09-22T22:28:17.298540] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-22T22:28:17.439110] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-09-22T22:28:17.442894] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-22T22:28:17.445511] [INFO ] [MAIN ] Derivative Progress: 1993/2091 symbols completed. VVX took 1.2s. Estimated remaining: 38.0s. Rate: 154.8 symbols/min [2025-09-22T22:28:17.459039] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:17.460759] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 49112 primary records. [2025-09-22T22:28:17.461083] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-22T22:28:17.482185] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-09-22T22:28:17.482400] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-22T22:28:17.484776] [INFO ] [MAIN ] Derivative Progress: 1994/2091 symbols completed. VYX took 1.1s. Estimated remaining: 37.6s. Rate: 154.8 symbols/min [2025-09-22T22:28:17.497711] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:17.498357] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-09-22T22:28:17.498420] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-22T22:28:17.513829] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-09-22T22:28:17.513902] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-22T22:28:17.516598] [INFO ] [MAIN ] Derivative Progress: 1995/2091 symbols completed. VZ took 1.0s. Estimated remaining: 37.2s. Rate: 154.9 symbols/min [2025-09-22T22:28:17.517207] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:17.517372] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:17.517295] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:17.585235] [DEBUG] [LOCAL ] WAL: Loaded 45453 existing records from primary storage. [2025-09-22T22:28:17.585586] [INFO ] [MAIN ] WAL: Loaded 45453 primary data records. [2025-09-22T22:28:17.698097] [DEBUG] [LOCAL ] WAB: Loaded 44293 existing records from primary storage. [2025-09-22T22:28:17.704532] [INFO ] [MAIN ] WAB: Loaded 44293 primary data records. [2025-09-22T22:28:17.698811] [DEBUG] [LOCAL ] W: Loaded 53505 existing records from primary storage. [2025-09-22T22:28:17.717503] [INFO ] [MAIN ] W: Loaded 53505 primary data records. [2025-09-22T22:28:18.623271] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:18.624920] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45453 primary records. [2025-09-22T22:28:18.625081] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-22T22:28:18.623768] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:18.626442] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44293 primary records. [2025-09-22T22:28:18.626690] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-22T22:28:18.648542] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:18.658561] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53505 primary records. [2025-09-22T22:28:18.659822] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-22T22:28:18.675058] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-09-22T22:28:18.682787] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-22T22:28:18.685787] [INFO ] [MAIN ] Derivative Progress: 1996/2091 symbols completed. WAB took 1.2s. Estimated remaining: 36.8s. Rate: 154.7 symbols/min [2025-09-22T22:28:18.683365] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-09-22T22:28:18.689769] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-22T22:28:18.691866] [INFO ] [MAIN ] Derivative Progress: 1997/2091 symbols completed. WAL took 1.2s. Estimated remaining: 36.4s. Rate: 154.8 symbols/min [2025-09-22T22:28:18.692270] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:18.692463] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:18.700755] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-09-22T22:28:18.700926] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-22T22:28:18.703768] [INFO ] [MAIN ] Derivative Progress: 1998/2091 symbols completed. W took 1.2s. Estimated remaining: 36.0s. Rate: 154.9 symbols/min [2025-09-22T22:28:18.704165] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:18.732133] [DEBUG] [LOCAL ] WBX: Loaded 12761 existing records from primary storage. [2025-09-22T22:28:18.732340] [INFO ] [MAIN ] WBX: Loaded 12761 primary data records. [2025-09-22T22:28:18.874408] [DEBUG] [LOCAL ] WAT: Loaded 35108 existing records from primary storage. [2025-09-22T22:28:18.874628] [INFO ] [MAIN ] WAT: Loaded 35108 primary data records. [2025-09-22T22:28:18.875412] [DEBUG] [LOCAL ] WBS: Loaded 48833 existing records from primary storage. [2025-09-22T22:28:18.907314] [INFO ] [MAIN ] WBS: Loaded 48833 primary data records. [2025-09-22T22:28:19.745002] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:19.746565] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 12761 primary records. [2025-09-22T22:28:19.746751] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-22T22:28:19.763339] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-09-22T22:28:19.765560] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-22T22:28:19.767878] [INFO ] [MAIN ] Derivative Progress: 1999/2091 symbols completed. WBX took 1.1s. Estimated remaining: 35.7s. Rate: 154.8 symbols/min [2025-09-22T22:28:19.769044] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:19.786063] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:19.787367] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35108 primary records. [2025-09-22T22:28:19.787612] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-22T22:28:19.802498] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:19.818979] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-09-22T22:28:19.817565] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48833 primary records. [2025-09-22T22:28:19.819205] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-22T22:28:19.821736] [INFO ] [MAIN ] Derivative Progress: 2000/2091 symbols completed. WAT took 1.1s. Estimated remaining: 35.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:19.819259] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-22T22:28:19.822665] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:19.841009] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-09-22T22:28:19.841244] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-22T22:28:19.844547] [INFO ] [MAIN ] Derivative Progress: 2001/2091 symbols completed. WBS took 1.2s. Estimated remaining: 34.9s. Rate: 154.9 symbols/min [2025-09-22T22:28:19.845075] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:19.879521] [DEBUG] [LOCAL ] WCC: Loaded 40146 existing records from primary storage. [2025-09-22T22:28:19.879783] [INFO ] [MAIN ] WCC: Loaded 40146 primary data records. [2025-09-22T22:28:20.038596] [DEBUG] [LOCAL ] WD: Loaded 23499 existing records from primary storage. [2025-09-22T22:28:20.070994] [INFO ] [MAIN ] WD: Loaded 23499 primary data records. [2025-09-22T22:28:20.099299] [DEBUG] [LOCAL ] WCN: Loaded 48072 existing records from primary storage. [2025-09-22T22:28:20.150756] [INFO ] [MAIN ] WCN: Loaded 48072 primary data records. [2025-09-22T22:28:20.927887] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:20.929107] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 40146 primary records. [2025-09-22T22:28:20.929740] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-22T22:28:20.947074] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-09-22T22:28:20.947273] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-22T22:28:20.949711] [INFO ] [MAIN ] Derivative Progress: 2002/2091 symbols completed. WCC took 1.2s. Estimated remaining: 34.5s. Rate: 154.8 symbols/min [2025-09-22T22:28:20.952451] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:20.968172] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:20.969718] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23499 primary records. [2025-09-22T22:28:20.969923] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-22T22:28:21.002697] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-09-22T22:28:20.999366] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:21.008406] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-22T22:28:21.012671] [DEBUG] [LOCAL ] WDH: Loaded 16899 existing records from primary storage. [2025-09-22T22:28:21.012819] [INFO ] [MAIN ] WDH: Loaded 16899 primary data records. [2025-09-22T22:28:21.011276] [INFO ] [MAIN ] Derivative Progress: 2003/2091 symbols completed. WD took 1.2s. Estimated remaining: 34.1s. Rate: 154.8 symbols/min [2025-09-22T22:28:21.013178] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:21.012162] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 48072 primary records. [2025-09-22T22:28:21.024962] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-22T22:28:21.135823] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-09-22T22:28:21.136070] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-22T22:28:21.144022] [INFO ] [MAIN ] Derivative Progress: 2004/2091 symbols completed. WCN took 1.3s. Estimated remaining: 33.7s. Rate: 154.9 symbols/min [2025-09-22T22:28:21.199714] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:21.368989] [DEBUG] [LOCAL ] WEA: Loaded 7369 existing records from primary storage. [2025-09-22T22:28:21.370131] [INFO ] [MAIN ] WEA: Loaded 7369 primary data records. [2025-09-22T22:28:21.382585] [DEBUG] [LOCAL ] WDS: Loaded 43685 existing records from primary storage. [2025-09-22T22:28:21.441964] [INFO ] [MAIN ] WDS: Loaded 43685 primary data records. [2025-09-22T22:28:22.060141] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:22.061435] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 16899 primary records. [2025-09-22T22:28:22.061683] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-22T22:28:22.078442] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-09-22T22:28:22.078760] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-22T22:28:22.081724] [INFO ] [MAIN ] Derivative Progress: 2005/2091 symbols completed. WDH took 1.1s. Estimated remaining: 33.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:22.083901] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:22.105740] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:22.106466] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7369 primary records. [2025-09-22T22:28:22.106692] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-22T22:28:22.123113] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-09-22T22:28:22.135406] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-22T22:28:22.137899] [INFO ] [MAIN ] Derivative Progress: 2006/2091 symbols completed. WEA took 1.0s. Estimated remaining: 32.9s. Rate: 154.8 symbols/min [2025-09-22T22:28:22.146391] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:22.152390] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:22.153262] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43685 primary records. [2025-09-22T22:28:22.153541] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-22T22:28:22.183846] [DEBUG] [LOCAL ] WEAV: Loaded 42103 existing records from primary storage. [2025-09-22T22:28:22.184912] [INFO ] [MAIN ] WEAV: Loaded 42103 primary data records. [2025-09-22T22:28:22.184683] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-09-22T22:28:22.185119] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-22T22:28:22.220233] [INFO ] [MAIN ] Derivative Progress: 2007/2091 symbols completed. WDS took 1.2s. Estimated remaining: 32.5s. Rate: 154.9 symbols/min [2025-09-22T22:28:22.260737] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:22.540260] [DEBUG] [LOCAL ] WEC: Loaded 52216 existing records from primary storage. [2025-09-22T22:28:22.541331] [INFO ] [MAIN ] WEC: Loaded 52216 primary data records. [2025-09-22T22:28:22.880010] [DEBUG] [LOCAL ] WELL: Loaded 52364 existing records from primary storage. [2025-09-22T22:28:22.885603] [INFO ] [MAIN ] WELL: Loaded 52364 primary data records. [2025-09-22T22:28:23.095938] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:23.096894] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 42103 primary records. [2025-09-22T22:28:23.097278] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-22T22:28:23.235084] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-09-22T22:28:23.237269] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-22T22:28:23.240619] [INFO ] [MAIN ] Derivative Progress: 2008/2091 symbols completed. WEAV took 1.2s. Estimated remaining: 32.2s. Rate: 154.8 symbols/min [2025-09-22T22:28:23.253748] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:23.254436] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52216 primary records. [2025-09-22T22:28:23.254544] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-22T22:28:23.272029] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-09-22T22:28:23.272115] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-22T22:28:23.274239] [INFO ] [MAIN ] Derivative Progress: 2009/2091 symbols completed. WEC took 1.1s. Estimated remaining: 31.8s. Rate: 154.8 symbols/min [2025-09-22T22:28:23.289623] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:23.290187] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52364 primary records. [2025-09-22T22:28:23.290247] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-22T22:28:23.305318] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-09-22T22:28:23.305376] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-22T22:28:23.307619] [INFO ] [MAIN ] Derivative Progress: 2010/2091 symbols completed. WELL took 1.1s. Estimated remaining: 31.4s. Rate: 154.9 symbols/min [2025-09-22T22:28:23.308159] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:23.308411] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:23.308286] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:23.325479] [DEBUG] [LOCAL ] WF: Loaded 10918 existing records from primary storage. [2025-09-22T22:28:23.326073] [INFO ] [MAIN ] WF: Loaded 10918 primary data records. [2025-09-22T22:28:23.452613] [DEBUG] [LOCAL ] WEX: Loaded 35529 existing records from primary storage. [2025-09-22T22:28:23.463824] [INFO ] [MAIN ] WEX: Loaded 35529 primary data records. [2025-09-22T22:28:23.807411] [DEBUG] [LOCAL ] WES: Loaded 48034 existing records from primary storage. [2025-09-22T22:28:23.826792] [INFO ] [MAIN ] WES: Loaded 48034 primary data records. [2025-09-22T22:28:24.363909] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:24.365450] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10918 primary records. [2025-09-22T22:28:24.365598] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-22T22:28:24.401983] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:24.403263] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 35529 primary records. [2025-09-22T22:28:24.402438] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-09-22T22:28:24.403467] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-22T22:28:24.403400] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-22T22:28:24.406001] [INFO ] [MAIN ] Derivative Progress: 2011/2091 symbols completed. WF took 1.1s. Estimated remaining: 31.0s. Rate: 154.8 symbols/min [2025-09-22T22:28:24.407368] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:24.424106] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-09-22T22:28:24.424381] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-22T22:28:24.427194] [INFO ] [MAIN ] Derivative Progress: 2012/2091 symbols completed. WEX took 1.1s. Estimated remaining: 30.6s. Rate: 154.8 symbols/min [2025-09-22T22:28:24.427668] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:24.445766] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:24.446523] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48034 primary records. [2025-09-22T22:28:24.446666] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-22T22:28:24.462874] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-09-22T22:28:24.462986] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-22T22:28:24.465604] [INFO ] [MAIN ] Derivative Progress: 2013/2091 symbols completed. WES took 1.2s. Estimated remaining: 30.2s. Rate: 154.9 symbols/min [2025-09-22T22:28:24.466092] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:24.496444] [DEBUG] [LOCAL ] WFG: Loaded 24971 existing records from primary storage. [2025-09-22T22:28:24.496604] [INFO ] [MAIN ] WFG: Loaded 24971 primary data records. [2025-09-22T22:28:24.630810] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-22T22:28:24.652172] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-09-22T22:28:24.758036] [DEBUG] [LOCAL ] WGO: Loaded 39435 existing records from primary storage. [2025-09-22T22:28:24.910526] [INFO ] [MAIN ] WGO: Loaded 39435 primary data records. [2025-09-22T22:28:25.532852] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:25.533830] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24971 primary records. [2025-09-22T22:28:25.534789] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-22T22:28:25.557430] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-09-22T22:28:25.559322] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-22T22:28:25.562314] [INFO ] [MAIN ] Derivative Progress: 2014/2091 symbols completed. WFG took 1.1s. Estimated remaining: 29.9s. Rate: 154.8 symbols/min [2025-09-22T22:28:25.562973] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:25.579453] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:25.580780] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-09-22T22:28:25.581106] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-22T22:28:25.595190] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:25.603435] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 39435 primary records. [2025-09-22T22:28:25.607406] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-22T22:28:25.612907] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-09-22T22:28:25.613277] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-22T22:28:25.615908] [INFO ] [MAIN ] Derivative Progress: 2015/2091 symbols completed. WFC took 1.2s. Estimated remaining: 29.5s. Rate: 154.8 symbols/min [2025-09-22T22:28:25.627749] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:25.634066] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-09-22T22:28:25.634230] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-22T22:28:25.637105] [INFO ] [MAIN ] Derivative Progress: 2016/2091 symbols completed. WGO took 1.2s. Estimated remaining: 29.1s. Rate: 154.9 symbols/min [2025-09-22T22:28:25.637551] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:25.648109] [DEBUG] [LOCAL ] WHG: Loaded 3418 existing records from primary storage. [2025-09-22T22:28:25.648289] [INFO ] [MAIN ] WHG: Loaded 3418 primary data records. [2025-09-22T22:28:25.793171] [DEBUG] [LOCAL ] WH: Loaded 45898 existing records from primary storage. [2025-09-22T22:28:25.799343] [INFO ] [MAIN ] WH: Loaded 45898 primary data records. [2025-09-22T22:28:25.868702] [DEBUG] [LOCAL ] WHD: Loaded 40594 existing records from primary storage. [2025-09-22T22:28:25.957350] [INFO ] [MAIN ] WHD: Loaded 40594 primary data records. [2025-09-22T22:28:26.706468] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:28:26.707746] [INFO ] [MAIN ] WHG: Generated 1793 derivative records from 3418 primary records. [2025-09-22T22:28:26.709062] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-22T22:28:26.727005] [DEBUG] [LOCAL ] WHG: Derivative data saved (1793 records). [2025-09-22T22:28:26.727300] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-22T22:28:26.742806] [INFO ] [MAIN ] Derivative Progress: 2017/2091 symbols completed. WHG took 1.1s. Estimated remaining: 28.7s. Rate: 154.8 symbols/min [2025-09-22T22:28:26.744344] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:26.744268] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:26.745929] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45898 primary records. [2025-09-22T22:28:26.746197] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-22T22:28:26.766825] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:26.768563] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40594 primary records. [2025-09-22T22:28:26.768688] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-22T22:28:26.788241] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-09-22T22:28:26.791488] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-22T22:28:26.795139] [INFO ] [MAIN ] Derivative Progress: 2018/2091 symbols completed. WH took 1.2s. Estimated remaining: 28.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:26.796696] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-09-22T22:28:26.797128] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:26.797452] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-22T22:28:26.800361] [INFO ] [MAIN ] Derivative Progress: 2019/2091 symbols completed. WHD took 1.2s. Estimated remaining: 27.9s. Rate: 154.9 symbols/min [2025-09-22T22:28:26.801063] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:26.808962] [DEBUG] [LOCAL ] WIA: Loaded 4864 existing records from primary storage. [2025-09-22T22:28:26.809184] [INFO ] [MAIN ] WIA: Loaded 4864 primary data records. [2025-09-22T22:28:26.903989] [DEBUG] [LOCAL ] WINN: Loaded 11839 existing records from primary storage. [2025-09-22T22:28:26.930882] [INFO ] [MAIN ] WINN: Loaded 11839 primary data records. [2025-09-22T22:28:27.083208] [DEBUG] [LOCAL ] WHR: Loaded 48111 existing records from primary storage. [2025-09-22T22:28:27.128537] [INFO ] [MAIN ] WHR: Loaded 48111 primary data records. [2025-09-22T22:28:27.809141] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:27.810110] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4864 primary records. [2025-09-22T22:28:27.810212] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-22T22:28:27.830323] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:27.837288] [INFO ] [MAIN ] WINN: Generated 1794 derivative records from 11839 primary records. [2025-09-22T22:28:27.839222] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-09-22T22:28:27.837574] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-22T22:28:27.839933] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-22T22:28:27.842194] [INFO ] [MAIN ] Derivative Progress: 2020/2091 symbols completed. WIA took 1.0s. Estimated remaining: 27.5s. Rate: 154.8 symbols/min [2025-09-22T22:28:27.850634] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:27.861101] [DEBUG] [LOCAL ] WINN: Derivative data saved (1794 records). [2025-09-22T22:28:27.861259] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-22T22:28:27.864022] [INFO ] [MAIN ] Derivative Progress: 2021/2091 symbols completed. WINN took 1.1s. Estimated remaining: 27.1s. Rate: 154.8 symbols/min [2025-09-22T22:28:27.864395] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:27.877742] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:27.878547] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48111 primary records. [2025-09-22T22:28:27.878735] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-22T22:28:27.914232] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-09-22T22:28:27.914490] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-22T22:28:27.917361] [INFO ] [MAIN ] Derivative Progress: 2022/2091 symbols completed. WHR took 1.2s. Estimated remaining: 26.7s. Rate: 154.9 symbols/min [2025-09-22T22:28:27.917844] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:27.927078] [DEBUG] [LOCAL ] WIW: Loaded 20844 existing records from primary storage. [2025-09-22T22:28:27.927226] [INFO ] [MAIN ] WIW: Loaded 20844 primary data records. [2025-09-22T22:28:28.046199] [DEBUG] [LOCAL ] WIT: Loaded 52271 existing records from primary storage. [2025-09-22T22:28:28.046547] [INFO ] [MAIN ] WIT: Loaded 52271 primary data records. [2025-09-22T22:28:28.464688] [DEBUG] [LOCAL ] WK: Loaded 36586 existing records from primary storage. [2025-09-22T22:28:28.498588] [INFO ] [MAIN ] WK: Loaded 36586 primary data records. [2025-09-22T22:28:28.955503] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:28.956606] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20844 primary records. [2025-09-22T22:28:28.956927] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-22T22:28:28.974975] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-09-22T22:28:28.975618] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-22T22:28:28.978380] [INFO ] [MAIN ] Derivative Progress: 2023/2091 symbols completed. WIW took 1.1s. Estimated remaining: 26.4s. Rate: 154.8 symbols/min [2025-09-22T22:28:28.994132] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:28.994832] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52271 primary records. [2025-09-22T22:28:28.994978] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-22T22:28:29.024993] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:29.026100] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 36586 primary records. [2025-09-22T22:28:29.026858] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-09-22T22:28:29.026936] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-22T22:28:29.026995] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-22T22:28:29.029217] [INFO ] [MAIN ] Derivative Progress: 2024/2091 symbols completed. WIT took 1.2s. Estimated remaining: 26.0s. Rate: 154.8 symbols/min [2025-09-22T22:28:29.045515] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-09-22T22:28:29.045612] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-22T22:28:29.048427] [INFO ] [MAIN ] Derivative Progress: 2025/2091 symbols completed. WK took 1.1s. Estimated remaining: 25.6s. Rate: 154.9 symbols/min [2025-09-22T22:28:29.048997] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:29.049044] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:29.049283] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:29.058718] [DEBUG] [LOCAL ] WLKP: Loaded 6638 existing records from primary storage. [2025-09-22T22:28:29.058857] [INFO ] [MAIN ] WLKP: Loaded 6638 primary data records. [2025-09-22T22:28:29.303336] [DEBUG] [LOCAL ] WKC: Loaded 35178 existing records from primary storage. [2025-09-22T22:28:29.303207] [DEBUG] [LOCAL ] WLK: Loaded 45372 existing records from primary storage. [2025-09-22T22:28:29.449294] [INFO ] [MAIN ] WKC: Loaded 35178 primary data records. [2025-09-22T22:28:29.449709] [INFO ] [MAIN ] WLK: Loaded 45372 primary data records. [2025-09-22T22:28:30.205501] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:30.208925] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6638 primary records. [2025-09-22T22:28:30.209539] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-22T22:28:30.229325] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-09-22T22:28:30.229723] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-22T22:28:30.233802] [INFO ] [MAIN ] Derivative Progress: 2026/2091 symbols completed. WLKP took 1.2s. Estimated remaining: 25.2s. Rate: 154.8 symbols/min [2025-09-22T22:28:30.235096] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:30.251818] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:30.252898] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45372 primary records. [2025-09-22T22:28:30.253059] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-22T22:28:30.275853] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:30.280065] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 35178 primary records. [2025-09-22T22:28:30.280688] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-22T22:28:30.308066] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-09-22T22:28:30.308933] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-22T22:28:30.312468] [INFO ] [MAIN ] Derivative Progress: 2027/2091 symbols completed. WLK took 1.3s. Estimated remaining: 24.8s. Rate: 154.8 symbols/min [2025-09-22T22:28:30.314801] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:30.315213] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-09-22T22:28:30.315890] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-22T22:28:30.319135] [INFO ] [MAIN ] Derivative Progress: 2028/2091 symbols completed. WKC took 1.3s. Estimated remaining: 24.4s. Rate: 154.9 symbols/min [2025-09-22T22:28:30.319876] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:30.331804] [DEBUG] [LOCAL ] WLY: Loaded 30318 existing records from primary storage. [2025-09-22T22:28:30.332034] [INFO ] [MAIN ] WLY: Loaded 30318 primary data records. [2025-09-22T22:28:30.702509] [DEBUG] [LOCAL ] WM: Loaded 50960 existing records from primary storage. [2025-09-22T22:28:30.704180] [INFO ] [MAIN ] WM: Loaded 50960 primary data records. [2025-09-22T22:28:30.831357] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-22T22:28:30.897669] [INFO ] [MAIN ] WMB: Loaded 53671 primary data records. [2025-09-22T22:28:31.377973] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:28:31.379237] [INFO ] [MAIN ] WLY: Generated 1793 derivative records from 30318 primary records. [2025-09-22T22:28:31.379390] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-22T22:28:31.397527] [DEBUG] [LOCAL ] WLY: Derivative data saved (1793 records). [2025-09-22T22:28:31.398411] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-22T22:28:31.400969] [INFO ] [MAIN ] Derivative Progress: 2029/2091 symbols completed. WLY took 1.2s. Estimated remaining: 24.0s. Rate: 154.8 symbols/min [2025-09-22T22:28:31.401970] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:31.420047] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:31.420935] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50960 primary records. [2025-09-22T22:28:31.421153] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-22T22:28:31.442444] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-09-22T22:28:31.447831] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-22T22:28:31.450241] [INFO ] [MAIN ] Derivative Progress: 2030/2091 symbols completed. WM took 1.1s. Estimated remaining: 23.6s. Rate: 154.8 symbols/min [2025-09-22T22:28:31.450820] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:31.448167] [DEBUG] [LOCAL ] WMK: Loaded 14547 existing records from primary storage. [2025-09-22T22:28:31.451099] [INFO ] [MAIN ] WMK: Loaded 14547 primary data records. [2025-09-22T22:28:31.604406] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:31.637330] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53671 primary records. [2025-09-22T22:28:31.668608] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-22T22:28:31.802159] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-09-22T22:28:31.803477] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-22T22:28:31.819995] [INFO ] [MAIN ] Derivative Progress: 2031/2091 symbols completed. WMB took 1.5s. Estimated remaining: 23.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:31.822766] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:31.822241] [DEBUG] [LOCAL ] WMS: Loaded 39626 existing records from primary storage. [2025-09-22T22:28:31.823256] [INFO ] [MAIN ] WMS: Loaded 39626 primary data records. [2025-09-22T22:28:32.234889] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:32.235790] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14547 primary records. [2025-09-22T22:28:32.251563] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-22T22:28:32.254215] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-22T22:28:32.254400] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-09-22T22:28:32.365676] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-09-22T22:28:32.376573] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-22T22:28:32.378880] [INFO ] [MAIN ] Derivative Progress: 2032/2091 symbols completed. WMK took 1.0s. Estimated remaining: 22.9s. Rate: 154.8 symbols/min [2025-09-22T22:28:32.379476] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:32.599394] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:32.600783] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39626 primary records. [2025-09-22T22:28:32.610614] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-22T22:28:32.637220] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-09-22T22:28:32.638780] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-22T22:28:32.653934] [INFO ] [MAIN ] Derivative Progress: 2033/2091 symbols completed. WMS took 1.2s. Estimated remaining: 22.5s. Rate: 154.8 symbols/min [2025-09-22T22:28:32.654827] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:32.655967] [DEBUG] [LOCAL ] WNC: Loaded 40252 existing records from primary storage. [2025-09-22T22:28:32.656446] [INFO ] [MAIN ] WNC: Loaded 40252 primary data records. [2025-09-22T22:28:32.789502] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:32.801578] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-09-22T22:28:32.812091] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-22T22:28:33.021177] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-09-22T22:28:33.032432] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-22T22:28:33.034803] [INFO ] [MAIN ] Derivative Progress: 2034/2091 symbols completed. WMT took 1.2s. Estimated remaining: 22.1s. Rate: 154.8 symbols/min [2025-09-22T22:28:33.036635] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:33.037307] [DEBUG] [LOCAL ] WNS: Loaded 39866 existing records from primary storage. [2025-09-22T22:28:33.038125] [INFO ] [MAIN ] WNS: Loaded 39866 primary data records. [2025-09-22T22:28:33.414265] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:33.415383] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 40252 primary records. [2025-09-22T22:28:33.415607] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-22T22:28:33.417086] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-22T22:28:33.418917] [INFO ] [MAIN ] WOLF: Loaded 53532 primary data records. [2025-09-22T22:28:33.535004] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-09-22T22:28:33.549903] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-22T22:28:33.556700] [INFO ] [MAIN ] Derivative Progress: 2035/2091 symbols completed. WNC took 1.2s. Estimated remaining: 21.7s. Rate: 154.8 symbols/min [2025-09-22T22:28:33.557221] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:33.784261] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:33.785153] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 39866 primary records. [2025-09-22T22:28:33.785493] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-22T22:28:33.804902] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-09-22T22:28:33.805511] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-22T22:28:33.817969] [INFO ] [MAIN ] Derivative Progress: 2036/2091 symbols completed. WNS took 1.2s. Estimated remaining: 21.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:33.819537] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:33.820952] [DEBUG] [LOCAL ] WOR: Loaded 24577 existing records from primary storage. [2025-09-22T22:28:33.821291] [INFO ] [MAIN ] WOR: Loaded 24577 primary data records. [2025-09-22T22:28:34.047520] [DEBUG] [LOCAL ] WOW: Loaded 29992 existing records from primary storage. [2025-09-22T22:28:34.159606] [INFO ] [MAIN ] WOW: Loaded 29992 primary data records. [2025-09-22T22:28:34.278893] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:34.303113] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53532 primary records. [2025-09-22T22:28:34.304095] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-22T22:28:34.558324] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-09-22T22:28:34.568738] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-22T22:28:34.571844] [INFO ] [MAIN ] Derivative Progress: 2037/2091 symbols completed. WOLF took 1.5s. Estimated remaining: 20.9s. Rate: 154.7 symbols/min [2025-09-22T22:28:34.572234] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:34.594882] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:34.595870] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24577 primary records. [2025-09-22T22:28:34.596005] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-22T22:28:34.614773] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-09-22T22:28:34.615180] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-22T22:28:34.617444] [INFO ] [MAIN ] Derivative Progress: 2038/2091 symbols completed. WOR took 1.1s. Estimated remaining: 20.5s. Rate: 154.8 symbols/min [2025-09-22T22:28:34.644927] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:34.645726] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 29992 primary records. [2025-09-22T22:28:34.645874] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-22T22:28:34.662199] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-09-22T22:28:34.662420] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-22T22:28:34.678867] [INFO ] [MAIN ] Derivative Progress: 2039/2091 symbols completed. WOW took 0.9s. Estimated remaining: 20.1s. Rate: 154.9 symbols/min [2025-09-22T22:28:34.680082] [DEBUG] [LOCAL ] WPC: Loaded 48670 existing records from primary storage. [2025-09-22T22:28:34.680267] [INFO ] [MAIN ] WPC: Loaded 48670 primary data records. [2025-09-22T22:28:34.990078] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:34.990777] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48670 primary records. [2025-09-22T22:28:34.990843] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-22T22:28:35.005610] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-09-22T22:28:35.005707] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-22T22:28:35.008043] [INFO ] [MAIN ] Derivative Progress: 2040/2091 symbols completed. WPC took 0.4s. Estimated remaining: 19.8s. Rate: 154.9 symbols/min [2025-09-22T22:28:35.009073] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:35.009451] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:35.008947] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:35.056995] [DEBUG] [LOCAL ] WPP: Loaded 33716 existing records from primary storage. [2025-09-22T22:28:35.072072] [INFO ] [MAIN ] WPP: Loaded 33716 primary data records. [2025-09-22T22:28:35.209128] [DEBUG] [LOCAL ] WRB: Loaded 50615 existing records from primary storage. [2025-09-22T22:28:35.221894] [INFO ] [MAIN ] WRB: Loaded 50615 primary data records. [2025-09-22T22:28:35.229141] [DEBUG] [LOCAL ] WPM: Loaded 52724 existing records from primary storage. [2025-09-22T22:28:35.255936] [INFO ] [MAIN ] WPM: Loaded 52724 primary data records. [2025-09-22T22:28:36.094827] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:36.104478] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 33716 primary records. [2025-09-22T22:28:36.104728] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-22T22:28:36.122748] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:36.144794] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:36.144470] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-09-22T22:28:36.144919] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-22T22:28:36.147699] [INFO ] [MAIN ] Derivative Progress: 2041/2091 symbols completed. WPP took 1.1s. Estimated remaining: 19.4s. Rate: 154.7 symbols/min [2025-09-22T22:28:36.143319] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50615 primary records. [2025-09-22T22:28:36.145496] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52724 primary records. [2025-09-22T22:28:36.148097] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:36.148262] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-22T22:28:36.147907] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-22T22:28:36.185104] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-09-22T22:28:36.186015] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-22T22:28:36.188674] [INFO ] [MAIN ] Derivative Progress: 2042/2091 symbols completed. WPM took 1.2s. Estimated remaining: 19.0s. Rate: 154.8 symbols/min [2025-09-22T22:28:36.189630] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:36.196083] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-09-22T22:28:36.196303] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-22T22:28:36.199536] [INFO ] [MAIN ] Derivative Progress: 2043/2091 symbols completed. WRB took 1.2s. Estimated remaining: 18.6s. Rate: 154.9 symbols/min [2025-09-22T22:28:36.200102] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:36.233185] [DEBUG] [LOCAL ] WS: Loaded 23847 existing records from primary storage. [2025-09-22T22:28:36.233466] [INFO ] [MAIN ] WS: Loaded 23847 primary data records. [2025-09-22T22:28:36.355003] [DEBUG] [LOCAL ] WRBY: Loaded 50873 existing records from primary storage. [2025-09-22T22:28:36.360931] [INFO ] [MAIN ] WRBY: Loaded 50873 primary data records. [2025-09-22T22:28:36.716096] [DEBUG] [LOCAL ] WSM: Loaded 49931 existing records from primary storage. [2025-09-22T22:28:36.722884] [INFO ] [MAIN ] WSM: Loaded 49931 primary data records. [2025-09-22T22:28:37.263367] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:37.264567] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23847 primary records. [2025-09-22T22:28:37.264859] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-22T22:28:37.284843] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-09-22T22:28:37.286157] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-22T22:28:37.288483] [INFO ] [MAIN ] Derivative Progress: 2044/2091 symbols completed. WS took 1.1s. Estimated remaining: 18.2s. Rate: 154.7 symbols/min [2025-09-22T22:28:37.289116] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:37.303622] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:37.304778] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50873 primary records. [2025-09-22T22:28:37.305283] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-22T22:28:37.325763] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-09-22T22:28:37.326633] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-22T22:28:37.329244] [INFO ] [MAIN ] Derivative Progress: 2045/2091 symbols completed. WRBY took 1.2s. Estimated remaining: 17.8s. Rate: 154.8 symbols/min [2025-09-22T22:28:37.329623] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:37.343110] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:37.349981] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49931 primary records. [2025-09-22T22:28:37.350152] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-22T22:28:37.373047] [DEBUG] [LOCAL ] WSO: Loaded 24683 existing records from primary storage. [2025-09-22T22:28:37.373988] [INFO ] [MAIN ] WSO: Loaded 24683 primary data records. [2025-09-22T22:28:37.450269] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-09-22T22:28:37.498762] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-22T22:28:37.499682] [DEBUG] [LOCAL ] WSR: Loaded 23388 existing records from primary storage. [2025-09-22T22:28:37.502547] [INFO ] [MAIN ] Derivative Progress: 2046/2091 symbols completed. WSM took 1.3s. Estimated remaining: 17.4s. Rate: 154.9 symbols/min [2025-09-22T22:28:37.507941] [INFO ] [MAIN ] WSR: Loaded 23388 primary data records. [2025-09-22T22:28:37.523776] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:38.055352] [DEBUG] [LOCAL ] WST: Loaded 37728 existing records from primary storage. [2025-09-22T22:28:38.055856] [INFO ] [MAIN ] WST: Loaded 37728 primary data records. [2025-09-22T22:28:38.253199] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:38.260821] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24683 primary records. [2025-09-22T22:28:38.260985] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-22T22:28:38.459575] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:38.461874] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 23388 primary records. [2025-09-22T22:28:38.462866] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-22T22:28:38.464831] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-09-22T22:28:38.465333] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-22T22:28:38.467588] [INFO ] [MAIN ] Derivative Progress: 2047/2091 symbols completed. WSO took 1.2s. Estimated remaining: 17.1s. Rate: 154.7 symbols/min [2025-09-22T22:28:38.475949] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:38.485248] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-09-22T22:28:38.485506] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-22T22:28:38.487834] [INFO ] [MAIN ] Derivative Progress: 2048/2091 symbols completed. WSR took 1.2s. Estimated remaining: 16.7s. Rate: 154.8 symbols/min [2025-09-22T22:28:38.488730] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:38.507945] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:38.508672] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 37728 primary records. [2025-09-22T22:28:38.508887] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-22T22:28:38.526118] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-09-22T22:28:38.526334] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-22T22:28:38.528823] [INFO ] [MAIN ] Derivative Progress: 2049/2091 symbols completed. WST took 1.0s. Estimated remaining: 16.3s. Rate: 154.9 symbols/min [2025-09-22T22:28:38.540767] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:38.584233] [DEBUG] [LOCAL ] WTI: Loaded 43694 existing records from primary storage. [2025-09-22T22:28:38.585332] [DEBUG] [LOCAL ] WT: Loaded 47585 existing records from primary storage. [2025-09-22T22:28:38.585731] [INFO ] [MAIN ] WT: Loaded 47585 primary data records. [2025-09-22T22:28:38.585493] [INFO ] [MAIN ] WTI: Loaded 43694 primary data records. [2025-09-22T22:28:38.990705] [DEBUG] [LOCAL ] WTRG: Loaded 50932 existing records from primary storage. [2025-09-22T22:28:39.101033] [INFO ] [MAIN ] WTRG: Loaded 50932 primary data records. [2025-09-22T22:28:39.569945] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:39.571309] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 43694 primary records. [2025-09-22T22:28:39.584154] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-22T22:28:39.584726] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:39.587824] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47585 primary records. [2025-09-22T22:28:39.587989] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-22T22:28:39.604942] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-09-22T22:28:39.605372] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-22T22:28:39.607629] [INFO ] [MAIN ] Derivative Progress: 2050/2091 symbols completed. WTI took 1.1s. Estimated remaining: 15.9s. Rate: 154.7 symbols/min [2025-09-22T22:28:39.608140] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:39.638128] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-09-22T22:28:39.648214] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-22T22:28:39.643715] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:39.649098] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50932 primary records. [2025-09-22T22:28:39.649280] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-22T22:28:39.651804] [INFO ] [MAIN ] Derivative Progress: 2051/2091 symbols completed. WT took 1.2s. Estimated remaining: 15.5s. Rate: 154.8 symbols/min [2025-09-22T22:28:39.653227] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:39.675821] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-09-22T22:28:39.676533] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-22T22:28:39.676351] [DEBUG] [LOCAL ] WTS: Loaded 18557 existing records from primary storage. [2025-09-22T22:28:39.679130] [INFO ] [MAIN ] Derivative Progress: 2052/2091 symbols completed. WTRG took 1.2s. Estimated remaining: 15.1s. Rate: 154.9 symbols/min [2025-09-22T22:28:39.679345] [INFO ] [MAIN ] WTS: Loaded 18557 primary data records. [2025-09-22T22:28:39.679676] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:40.016227] [DEBUG] [LOCAL ] WTTR: Loaded 45079 existing records from primary storage. [2025-09-22T22:28:40.030446] [INFO ] [MAIN ] WTTR: Loaded 45079 primary data records. [2025-09-22T22:28:40.159459] [DEBUG] [LOCAL ] WU: Loaded 53451 existing records from primary storage. [2025-09-22T22:28:40.160320] [INFO ] [MAIN ] WU: Loaded 53451 primary data records. [2025-09-22T22:28:40.629752] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:40.733462] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 18557 primary records. [2025-09-22T22:28:40.733829] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-22T22:28:40.752752] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-09-22T22:28:40.753208] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-22T22:28:40.755814] [INFO ] [MAIN ] Derivative Progress: 2053/2091 symbols completed. WTS took 1.1s. Estimated remaining: 14.7s. Rate: 154.7 symbols/min [2025-09-22T22:28:40.777856] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:40.778521] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 45079 primary records. [2025-09-22T22:28:40.778869] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-22T22:28:40.796833] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-09-22T22:28:40.797607] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-22T22:28:40.800139] [INFO ] [MAIN ] Derivative Progress: 2054/2091 symbols completed. WTTR took 1.1s. Estimated remaining: 14.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:40.813119] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:40.813835] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53451 primary records. [2025-09-22T22:28:40.813902] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-22T22:28:40.829813] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-09-22T22:28:40.829913] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-22T22:28:40.832560] [INFO ] [MAIN ] Derivative Progress: 2055/2091 symbols completed. WU took 1.2s. Estimated remaining: 13.9s. Rate: 154.9 symbols/min [2025-09-22T22:28:40.833292] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:40.833511] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:40.833613] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:40.882249] [DEBUG] [LOCAL ] XFLT: Loaded 30093 existing records from primary storage. [2025-09-22T22:28:40.882489] [INFO ] [MAIN ] XFLT: Loaded 30093 primary data records. [2025-09-22T22:28:41.023072] [DEBUG] [LOCAL ] WWW: Loaded 49168 existing records from primary storage. [2025-09-22T22:28:41.055310] [INFO ] [MAIN ] WWW: Loaded 49168 primary data records. [2025-09-22T22:28:41.335786] [DEBUG] [LOCAL ] WY: Loaded 53118 existing records from primary storage. [2025-09-22T22:28:41.355375] [INFO ] [MAIN ] WY: Loaded 53118 primary data records. [2025-09-22T22:28:41.910312] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:41.911229] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 30093 primary records. [2025-09-22T22:28:41.911364] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-22T22:28:41.945684] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-09-22T22:28:41.945986] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-22T22:28:41.948585] [INFO ] [MAIN ] Derivative Progress: 2056/2091 symbols completed. XFLT took 1.1s. Estimated remaining: 13.6s. Rate: 154.7 symbols/min [2025-09-22T22:28:41.946385] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:41.949073] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:41.950591] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49168 primary records. [2025-09-22T22:28:41.950800] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-22T22:28:41.971099] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-09-22T22:28:41.971255] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-22T22:28:41.973666] [INFO ] [MAIN ] Derivative Progress: 2057/2091 symbols completed. WWW took 1.1s. Estimated remaining: 13.2s. Rate: 154.8 symbols/min [2025-09-22T22:28:41.974174] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:41.987720] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:41.991565] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53118 primary records. [2025-09-22T22:28:41.991941] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-22T22:28:42.009849] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-09-22T22:28:42.010061] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-22T22:28:42.012824] [INFO ] [MAIN ] Derivative Progress: 2058/2091 symbols completed. WY took 1.2s. Estimated remaining: 12.8s. Rate: 154.9 symbols/min [2025-09-22T22:28:42.013236] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:42.045387] [DEBUG] [LOCAL ] XHR: Loaded 44300 existing records from primary storage. [2025-09-22T22:28:42.045744] [INFO ] [MAIN ] XHR: Loaded 44300 primary data records. [2025-09-22T22:28:42.224227] [DEBUG] [LOCAL ] XPER: Loaded 29634 existing records from primary storage. [2025-09-22T22:28:42.265679] [INFO ] [MAIN ] XPER: Loaded 29634 primary data records. [2025-09-22T22:28:42.349487] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-22T22:28:42.442808] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-09-22T22:28:43.106274] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:43.107702] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 44300 primary records. [2025-09-22T22:28:43.107861] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-22T22:28:43.126930] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-09-22T22:28:43.127231] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-22T22:28:43.129980] [INFO ] [MAIN ] Derivative Progress: 2059/2091 symbols completed. XHR took 1.2s. Estimated remaining: 12.4s. Rate: 154.7 symbols/min [2025-09-22T22:28:43.130983] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:43.164968] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:43.166144] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 29634 primary records. [2025-09-22T22:28:43.166259] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-22T22:28:43.166800] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:43.168153] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-09-22T22:28:43.168542] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-22T22:28:43.200014] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-09-22T22:28:43.200613] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-22T22:28:43.204714] [INFO ] [MAIN ] Derivative Progress: 2060/2091 symbols completed. XPER took 1.2s. Estimated remaining: 12.0s. Rate: 154.8 symbols/min [2025-09-22T22:28:43.205013] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:43.220825] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-09-22T22:28:43.221031] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-22T22:28:43.224225] [INFO ] [MAIN ] Derivative Progress: 2061/2091 symbols completed. XOM took 1.3s. Estimated remaining: 11.6s. Rate: 154.9 symbols/min [2025-09-22T22:28:43.224966] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:43.253899] [DEBUG] [LOCAL ] XPEV: Loaded 53642 existing records from primary storage. [2025-09-22T22:28:43.254206] [INFO ] [MAIN ] XPEV: Loaded 53642 primary data records. [2025-09-22T22:28:43.506282] [DEBUG] [LOCAL ] XPOF: Loaded 38863 existing records from primary storage. [2025-09-22T22:28:43.504987] [DEBUG] [LOCAL ] XPO: Loaded 48220 existing records from primary storage. [2025-09-22T22:28:43.511700] [INFO ] [MAIN ] XPO: Loaded 48220 primary data records. [2025-09-22T22:28:43.506512] [INFO ] [MAIN ] XPOF: Loaded 38863 primary data records. [2025-09-22T22:28:44.544515] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:44.546761] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53642 primary records. [2025-09-22T22:28:44.547900] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-22T22:28:44.575433] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-09-22T22:28:44.576164] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-22T22:28:44.578478] [INFO ] [MAIN ] Derivative Progress: 2062/2091 symbols completed. XPEV took 1.4s. Estimated remaining: 11.2s. Rate: 154.7 symbols/min [2025-09-22T22:28:44.579199] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:44.624345] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:44.624945] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:44.625781] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 38863 primary records. [2025-09-22T22:28:44.626688] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 48220 primary records. [2025-09-22T22:28:44.626946] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-22T22:28:44.627032] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-22T22:28:44.684583] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-09-22T22:28:44.686114] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-22T22:28:44.689969] [INFO ] [MAIN ] Derivative Progress: 2063/2091 symbols completed. XPOF took 1.5s. Estimated remaining: 10.9s. Rate: 154.7 symbols/min [2025-09-22T22:28:44.694771] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:44.694078] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-09-22T22:28:44.695151] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-22T22:28:44.699216] [INFO ] [MAIN ] Derivative Progress: 2064/2091 symbols completed. XPO took 1.5s. Estimated remaining: 10.5s. Rate: 154.8 symbols/min [2025-09-22T22:28:44.699778] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:44.716491] [DEBUG] [LOCAL ] XPRO: Loaded 46119 existing records from primary storage. [2025-09-22T22:28:44.716911] [INFO ] [MAIN ] XPRO: Loaded 46119 primary data records. [2025-09-22T22:28:44.889947] [DEBUG] [LOCAL ] XYF: Loaded 27974 existing records from primary storage. [2025-09-22T22:28:44.923832] [INFO ] [MAIN ] XYF: Loaded 27974 primary data records. [2025-09-22T22:28:45.287962] [DEBUG] [LOCAL ] XYL: Loaded 48198 existing records from primary storage. [2025-09-22T22:28:45.301521] [INFO ] [MAIN ] XYL: Loaded 48198 primary data records. [2025-09-22T22:28:45.770373] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:45.771262] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 46119 primary records. [2025-09-22T22:28:45.771455] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-22T22:28:45.789984] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-09-22T22:28:45.791349] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-22T22:28:45.794410] [INFO ] [MAIN ] Derivative Progress: 2065/2091 symbols completed. XPRO took 1.2s. Estimated remaining: 10.1s. Rate: 154.7 symbols/min [2025-09-22T22:28:45.796699] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:45.812178] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:45.813170] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 27974 primary records. [2025-09-22T22:28:45.813345] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-22T22:28:45.832281] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-09-22T22:28:45.832519] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-22T22:28:45.836948] [INFO ] [MAIN ] Derivative Progress: 2066/2091 symbols completed. XYF took 1.1s. Estimated remaining: 9.7s. Rate: 154.7 symbols/min [2025-09-22T22:28:45.839230] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:45.862321] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:45.863159] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 48198 primary records. [2025-09-22T22:28:45.863304] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-22T22:28:45.881374] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-09-22T22:28:45.891132] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-22T22:28:45.894615] [INFO ] [MAIN ] Derivative Progress: 2067/2091 symbols completed. XYL took 1.2s. Estimated remaining: 9.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:45.895065] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:45.896388] [DEBUG] [LOCAL ] YALA: Loaded 37363 existing records from primary storage. [2025-09-22T22:28:45.896606] [INFO ] [MAIN ] YALA: Loaded 37363 primary data records. [2025-09-22T22:28:46.253507] [DEBUG] [LOCAL ] YELP: Loaded 45342 existing records from primary storage. [2025-09-22T22:28:46.253963] [INFO ] [MAIN ] YELP: Loaded 45342 primary data records. [2025-09-22T22:28:46.381202] [DEBUG] [LOCAL ] YETI: Loaded 52486 existing records from primary storage. [2025-09-22T22:28:46.387051] [INFO ] [MAIN ] YETI: Loaded 52486 primary data records. [2025-09-22T22:28:46.936521] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:46.938306] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37363 primary records. [2025-09-22T22:28:46.939689] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-22T22:28:46.964872] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-09-22T22:28:46.965347] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-22T22:28:46.968733] [INFO ] [MAIN ] Derivative Progress: 2068/2091 symbols completed. YALA took 1.2s. Estimated remaining: 8.9s. Rate: 154.7 symbols/min [2025-09-22T22:28:46.982493] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:46.983359] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45342 primary records. [2025-09-22T22:28:46.983522] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-22T22:28:47.014983] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:47.015430] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-09-22T22:28:47.016151] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52486 primary records. [2025-09-22T22:28:47.016204] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-22T22:28:47.016312] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-22T22:28:47.019386] [INFO ] [MAIN ] Derivative Progress: 2069/2091 symbols completed. YELP took 1.2s. Estimated remaining: 8.5s. Rate: 154.7 symbols/min [2025-09-22T22:28:47.034731] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-09-22T22:28:47.034791] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-22T22:28:47.039859] [INFO ] [MAIN ] Derivative Progress: 2070/2091 symbols completed. YETI took 1.1s. Estimated remaining: 8.1s. Rate: 154.8 symbols/min [2025-09-22T22:28:47.040571] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:47.041210] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:47.040665] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:47.118293] [DEBUG] [LOCAL ] YEXT: Loaded 43344 existing records from primary storage. [2025-09-22T22:28:47.119156] [INFO ] [MAIN ] YEXT: Loaded 43344 primary data records. [2025-09-22T22:28:47.206412] [DEBUG] [LOCAL ] YMM: Loaded 52698 existing records from primary storage. [2025-09-22T22:28:47.253724] [INFO ] [MAIN ] YMM: Loaded 52698 primary data records. [2025-09-22T22:28:47.292549] [DEBUG] [LOCAL ] YOU: Loaded 49873 existing records from primary storage. [2025-09-22T22:28:47.315184] [INFO ] [MAIN ] YOU: Loaded 49873 primary data records. [2025-09-22T22:28:48.129820] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:48.130974] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43344 primary records. [2025-09-22T22:28:48.131158] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-22T22:28:48.164817] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-09-22T22:28:48.165721] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:48.165782] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-22T22:28:48.166572] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52698 primary records. [2025-09-22T22:28:48.168439] [INFO ] [MAIN ] Derivative Progress: 2071/2091 symbols completed. YEXT took 1.1s. Estimated remaining: 7.8s. Rate: 154.7 symbols/min [2025-09-22T22:28:48.168563] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-22T22:28:48.181947] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:48.182881] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:48.184158] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49873 primary records. [2025-09-22T22:28:48.184272] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-22T22:28:48.212398] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-09-22T22:28:48.213472] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-22T22:28:48.215910] [INFO ] [MAIN ] Derivative Progress: 2072/2091 symbols completed. YMM took 1.2s. Estimated remaining: 7.4s. Rate: 154.7 symbols/min [2025-09-22T22:28:48.216527] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:48.220441] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-09-22T22:28:48.220721] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-22T22:28:48.225388] [INFO ] [MAIN ] Derivative Progress: 2073/2091 symbols completed. YOU took 1.2s. Estimated remaining: 7.0s. Rate: 154.8 symbols/min [2025-09-22T22:28:48.225918] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:48.236471] [DEBUG] [LOCAL ] YRD: Loaded 12606 existing records from primary storage. [2025-09-22T22:28:48.236593] [INFO ] [MAIN ] YRD: Loaded 12606 primary data records. [2025-09-22T22:28:48.583094] [DEBUG] [LOCAL ] YPF: Loaded 50483 existing records from primary storage. [2025-09-22T22:28:48.583318] [INFO ] [MAIN ] YPF: Loaded 50483 primary data records. [2025-09-22T22:28:48.584458] [DEBUG] [LOCAL ] YSG: Loaded 24933 existing records from primary storage. [2025-09-22T22:28:48.606443] [INFO ] [MAIN ] YSG: Loaded 24933 primary data records. [2025-09-22T22:28:49.330084] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:49.331811] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 12606 primary records. [2025-09-22T22:28:49.332912] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-22T22:28:49.355506] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-09-22T22:28:49.355804] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-22T22:28:49.357929] [INFO ] [MAIN ] Derivative Progress: 2074/2091 symbols completed. YRD took 1.1s. Estimated remaining: 6.6s. Rate: 154.7 symbols/min [2025-09-22T22:28:49.359236] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:49.388731] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:49.396707] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50483 primary records. [2025-09-22T22:28:49.397080] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-22T22:28:49.398110] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-22T22:28:49.398030] [INFO ] [MAIN ] YSG: Generated 1793 derivative records from 24933 primary records. [2025-09-22T22:28:49.398862] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-22T22:28:49.428401] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-09-22T22:28:49.428702] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-22T22:28:49.431791] [INFO ] [MAIN ] Derivative Progress: 2075/2091 symbols completed. YPF took 1.2s. Estimated remaining: 6.2s. Rate: 154.7 symbols/min [2025-09-22T22:28:49.435252] [DEBUG] [LOCAL ] YSG: Derivative data saved (1793 records). [2025-09-22T22:28:49.435681] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:49.435585] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-22T22:28:49.438872] [INFO ] [MAIN ] Derivative Progress: 2076/2091 symbols completed. YSG took 1.2s. Estimated remaining: 5.8s. Rate: 154.8 symbols/min [2025-09-22T22:28:49.439346] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:49.486060] [DEBUG] [LOCAL ] YUM: Loaded 51289 existing records from primary storage. [2025-09-22T22:28:49.486326] [INFO ] [MAIN ] YUM: Loaded 51289 primary data records. [2025-09-22T22:28:49.736783] [DEBUG] [LOCAL ] ZBH: Loaded 51226 existing records from primary storage. [2025-09-22T22:28:49.737926] [DEBUG] [LOCAL ] YUMC: Loaded 52724 existing records from primary storage. [2025-09-22T22:28:49.839893] [INFO ] [MAIN ] ZBH: Loaded 51226 primary data records. [2025-09-22T22:28:49.845265] [INFO ] [MAIN ] YUMC: Loaded 52724 primary data records. [2025-09-22T22:28:50.534907] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:50.535895] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51289 primary records. [2025-09-22T22:28:50.538206] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-22T22:28:50.557398] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-09-22T22:28:50.557627] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-22T22:28:50.559705] [INFO ] [MAIN ] Derivative Progress: 2077/2091 symbols completed. YUM took 1.2s. Estimated remaining: 5.4s. Rate: 154.6 symbols/min [2025-09-22T22:28:50.560417] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:50.580259] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:50.581118] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 51226 primary records. [2025-09-22T22:28:50.598851] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-22T22:28:50.598725] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:50.600632] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52724 primary records. [2025-09-22T22:28:50.601012] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-22T22:28:50.636719] [DEBUG] [LOCAL ] ZEPP: Loaded 16667 existing records from primary storage. [2025-09-22T22:28:50.640834] [INFO ] [MAIN ] ZEPP: Loaded 16667 primary data records. [2025-09-22T22:28:50.683124] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-09-22T22:28:50.683291] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-22T22:28:50.687090] [INFO ] [MAIN ] Derivative Progress: 2078/2091 symbols completed. YUMC took 1.3s. Estimated remaining: 5.0s. Rate: 154.7 symbols/min [2025-09-22T22:28:50.705485] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:50.729836] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-09-22T22:28:50.755812] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-22T22:28:50.762458] [INFO ] [MAIN ] Derivative Progress: 2079/2091 symbols completed. ZBH took 1.3s. Estimated remaining: 4.7s. Rate: 154.8 symbols/min [2025-09-22T22:28:50.762878] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:51.020110] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-22T22:28:51.020614] [INFO ] [MAIN ] ZETA: Loaded 53595 primary data records. [2025-09-22T22:28:51.139066] [DEBUG] [LOCAL ] ZGN: Loaded 40907 existing records from primary storage. [2025-09-22T22:28:51.170100] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:51.175866] [INFO ] [MAIN ] ZGN: Loaded 40907 primary data records. [2025-09-22T22:28:51.181888] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 16667 primary records. [2025-09-22T22:28:51.208818] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-22T22:28:51.551853] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-09-22T22:28:51.568300] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-22T22:28:51.621246] [INFO ] [MAIN ] Derivative Progress: 2080/2091 symbols completed. ZEPP took 1.1s. Estimated remaining: 4.3s. Rate: 154.7 symbols/min [2025-09-22T22:28:51.627847] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:51.783353] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:51.784266] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53595 primary records. [2025-09-22T22:28:51.784501] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-22T22:28:51.811518] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-09-22T22:28:51.809976] [DEBUG] [LOCAL ] ZH: Loaded 26895 existing records from primary storage. [2025-09-22T22:28:51.811759] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-22T22:28:51.811976] [INFO ] [MAIN ] ZH: Loaded 26895 primary data records. [2025-09-22T22:28:51.814055] [INFO ] [MAIN ] Derivative Progress: 2081/2091 symbols completed. ZETA took 1.1s. Estimated remaining: 3.9s. Rate: 154.7 symbols/min [2025-09-22T22:28:51.820902] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:51.938328] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:51.942896] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40907 primary records. [2025-09-22T22:28:51.943379] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-22T22:28:52.179949] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-09-22T22:28:52.181885] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-22T22:28:52.185907] [INFO ] [MAIN ] Derivative Progress: 2082/2091 symbols completed. ZGN took 1.4s. Estimated remaining: 3.5s. Rate: 154.7 symbols/min [2025-09-22T22:28:52.186533] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:52.213382] [DEBUG] [LOCAL ] ZIM: Loaded 53550 existing records from primary storage. [2025-09-22T22:28:52.213748] [INFO ] [MAIN ] ZIM: Loaded 53550 primary data records. [2025-09-22T22:28:52.370854] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:52.415036] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 26895 primary records. [2025-09-22T22:28:52.449319] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-22T22:28:52.589353] [DEBUG] [LOCAL ] ZIP: Loaded 44431 existing records from primary storage. [2025-09-22T22:28:52.600071] [INFO ] [MAIN ] ZIP: Loaded 44431 primary data records. [2025-09-22T22:28:52.685482] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-09-22T22:28:52.696687] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-22T22:28:52.716362] [INFO ] [MAIN ] Derivative Progress: 2083/2091 symbols completed. ZH took 1.1s. Estimated remaining: 3.1s. Rate: 154.7 symbols/min [2025-09-22T22:28:52.947784] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:52.948970] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53550 primary records. [2025-09-22T22:28:52.949316] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-22T22:28:52.968970] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-09-22T22:28:52.969243] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-22T22:28:52.971415] [INFO ] [MAIN ] Derivative Progress: 2084/2091 symbols completed. ZIM took 1.2s. Estimated remaining: 2.7s. Rate: 154.7 symbols/min [2025-09-22T22:28:52.990347] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:52.991059] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 44431 primary records. [2025-09-22T22:28:52.991123] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-22T22:28:53.007954] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-09-22T22:28:53.008074] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-22T22:28:53.010129] [INFO ] [MAIN ] Derivative Progress: 2085/2091 symbols completed. ZIP took 0.8s. Estimated remaining: 2.3s. Rate: 154.8 symbols/min [2025-09-22T22:28:53.010892] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:53.011040] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:53.010981] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:53.031471] [DEBUG] [LOCAL ] ZTR: Loaded 16743 existing records from primary storage. [2025-09-22T22:28:53.031633] [INFO ] [MAIN ] ZTR: Loaded 16743 primary data records. [2025-09-22T22:28:53.256957] [DEBUG] [LOCAL ] ZK: Loaded 40228 existing records from primary storage. [2025-09-22T22:28:53.264446] [INFO ] [MAIN ] ZK: Loaded 40228 primary data records. [2025-09-22T22:28:53.479331] [DEBUG] [LOCAL ] ZTO: Loaded 50073 existing records from primary storage. [2025-09-22T22:28:53.495058] [INFO ] [MAIN ] ZTO: Loaded 50073 primary data records. [2025-09-22T22:28:54.119272] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:54.121181] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16743 primary records. [2025-09-22T22:28:54.121441] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-22T22:28:54.145980] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-09-22T22:28:54.146732] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-22T22:28:54.152771] [INFO ] [MAIN ] Derivative Progress: 2086/2091 symbols completed. ZTR took 1.1s. Estimated remaining: 1.9s. Rate: 154.6 symbols/min [2025-09-22T22:28:54.153757] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:54.177938] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:54.180821] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 50073 primary records. [2025-09-22T22:28:54.181065] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-22T22:28:54.203410] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:54.208932] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 40228 primary records. [2025-09-22T22:28:54.210686] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-22T22:28:54.226533] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-09-22T22:28:54.228785] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-22T22:28:54.238168] [INFO ] [MAIN ] Derivative Progress: 2087/2091 symbols completed. ZTO took 1.2s. Estimated remaining: 1.6s. Rate: 154.7 symbols/min [2025-09-22T22:28:54.239130] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-09-22T22:28:54.239721] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:54.239622] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-22T22:28:54.246770] [INFO ] [MAIN ] Derivative Progress: 2088/2091 symbols completed. ZK took 1.2s. Estimated remaining: 1.2s. Rate: 154.8 symbols/min [2025-09-22T22:28:54.247018] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-22T22:28:54.313030] [DEBUG] [LOCAL ] ZTS: Loaded 53006 existing records from primary storage. [2025-09-22T22:28:54.313378] [INFO ] [MAIN ] ZTS: Loaded 53006 primary data records. [2025-09-22T22:28:54.441082] [DEBUG] [LOCAL ] ZVIA: Loaded 35427 existing records from primary storage. [2025-09-22T22:28:54.457028] [INFO ] [MAIN ] ZVIA: Loaded 35427 primary data records. [2025-09-22T22:28:54.747601] [DEBUG] [LOCAL ] ZWS: Loaded 42492 existing records from primary storage. [2025-09-22T22:28:54.765978] [INFO ] [MAIN ] ZWS: Loaded 42492 primary data records. [2025-09-22T22:28:55.304264] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:55.305317] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 53006 primary records. [2025-09-22T22:28:55.305852] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-22T22:28:55.327293] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-09-22T22:28:55.327609] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-22T22:28:55.337353] [INFO ] [MAIN ] Derivative Progress: 2089/2091 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 154.6 symbols/min [2025-09-22T22:28:55.342775] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:55.343475] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35427 primary records. [2025-09-22T22:28:55.343670] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-22T22:28:55.376164] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-22T22:28:55.377106] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42492 primary records. [2025-09-22T22:28:55.377809] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-22T22:28:55.377751] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-09-22T22:28:55.378453] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-22T22:28:55.380720] [INFO ] [MAIN ] Derivative Progress: 2090/2091 symbols completed. ZVIA took 1.1s. Estimated remaining: 0.4s. Rate: 154.7 symbols/min [2025-09-22T22:28:55.395816] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-09-22T22:28:55.395879] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-22T22:28:55.398197] [INFO ] [MAIN ] Derivative Progress: 2091/2091 symbols completed. ZWS took 1.2s. Estimated remaining: 0.0s. Rate: 154.8 symbols/min [2025-09-22T22:28:55.399202] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 31s [2025-09-22T22:28:55.399323] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2091/2091 symbols) [2025-09-22T22:28:56.310554] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2091/2091 @ 100.00%)' [2025-09-22T22:28:56.311612] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-22T22:28:56.311859] [INFO ] [STATE ] Last completion updated: 2025-09-22T22:28:56.311720